My advice... start small and expand. Get a FocusRite Scarlett... If it's just you, a 2i2 would suffice. If you want more inputs, 18i8. The pre's are really good and it's not that expensive. For a mic, don't waste your time on crazy nice tube condensers... you're not there yet. I agree with the condenser part... get a decent large diaphragm condenser mic like the Shure KSM32. You can get a
used one for $250. Get a few XLR cables (at least 15')... personally, I like the Whirlwind Accusonic 2, but I also do primarily live audio. The Mogami are amazing... but you'll pay for them.
As for your recording software, for the price, you can't beat
Reaper. It's $60 for a license, but if you don't mind being nagged, the software is fully functional forever... you just have to wait 5 seconds before being able to use the software. Plus, the built in plugins are really good.
Get a good mic stand. You don't need anything fancy. I'd get a K&M 210/9. You can use it live or in the studio.
Focusrite 18i8 - $300
Used Shure KSM32 - $350
A couple XLR Cables - $60
Reaper - $60
Mic stand - $100
You can get a decent one mic recording setup going for $870. With the 18i8, you'll be able to expand to 4 mic inputs. Once you get your feet wet, you can buy more mics and a different interface... and perhaps outboard gear or... save your money and sacrifice "botique" and buy some Waves plugins (and others... Waves is just the most popular).
Do a LOT of research and watch a lot of podcasts... Find Dave Pensado's Into The Lair videos. They're pretty good and easy to grasp for the beginner.