Soldout makes a great point ...
Sacrifice now and the rewards in the future will probably be overflowing. I had a lousy 1st marriage but still had 4 children in the process. Via a combination of my selfishness for continuing to pursue all of my self-interests, and a wife who wasn't interested in participating, we ended up far, far apart. Most of my interests also involved including my kids, and they have turned into young adults who also selfishly pursue their own interests, most of them connected to the things I taught them. The only difference is that none of them seem to have any interest in marriage whatsoever.
I also found that my interests diverged with all of the seasons of my life. I can't tell you how many passions in outdoor activities I've pursued. Sailing was an early passion in my very young life, but after my youth, I didn't really come back to sailing a boat until I was near 50. I may not have the life-long experience of sailing, but it doesn't diminish my interest or enthusiasm right now. I guess my point is that I don't think it's so important to continue to pursue one thing for an entire life. I used to have an overwhelming passion for windsurfing, yet, I haven't been on a board for nearly 10 years now. I miss it sometimes, but I also moved on ...
Give up sailing now, do what's best, and always know that what goes around, comes around. If you want to, you'll be sailing your own boat again. If everything goes well, the conflicts will disappear and you'll be happy when the new opportunities arise.