That's the thesis of "So Good They Can't Ignore You: Why Skills Trump Passion in the Quest for Work You Love
The book examines the passion hypothesis and finds it lacking. It turns out that the passions people have seldom correspond to a career. It is true that people who are passionate love what they do, but that passion is developed over time through success.
Newport suggests building "career capital" by developing skills in your current work through deliberate practice. That career capital can then be leveraged into work with more control, which is linked to job satisfaction.
At the end of the book, the author walks through the example of his own career path to an assistant professorship at Georgetown as an example of how the principles can be applied in practice.
It's a good read about how to focus energy away from daydreaming about other careers or the traditional "What Color Is Your Parachute?