All my downloaded spreadsheets are going to Excel which is totally corrupted. I want them to open in Numbers instead and ditch Excel if possible.
Just move it to trash from the Applications folder. This page has list of files installed by Office 2011, but you don't have to care about them if you just want to remove Excel.
You can also change the default applications for file types from Finder's information windows (⌘I).