It's quite a tough road, especially the first couple of years, and dangerous too
Being obsessed about it at the start helps a lot to get you get going
Lathes can be pretty expensive and it's worthwhile starting out with a cheapo until you get an idea about what you're letting yourself in for.
Machining is: Dirty Dangerous, hard work and highly skilled
You get dirty and dangerous and hard work from day one, highly skilled can take years.
So don't go splurging out a big wodge of cash at the start
Ebay has revolutionised the hobby, making it easy to buy almost anything you will need.
I got a Drummond M series for $115… I was a lucky boy because it's such a good lathe
Then I gradually acquired some knowledge about the machine and different materials and gradually spent 1-2 grand on bits and bobs
You eventually end up with a mini machine shop
It's only after a few months of messing about that you can answer your own question because it's a real chicken and egg scenario
You may eventually gravitate towards tiny stuff, or the big lumpy stuff may do it for you
only you will know
One book to definitely get is Spareys Amateurs lathe, this is the Bible when you start out
GL