My wife and attended an empty nester fireside a few months before we applied for our first mission and the guest speaker told the following story.
He was doing very well financially, and they had just built their dream home in St George. He was actually still very content in his work life. He had a dream where he passed and an angel met him and said, we only have on question for you. "Why did you keep working when you had enough"
He woke up his wife and said, I think we are supposed to serve a mission. Long story short, they were in the mission field 3 weeks later.

If you have enough, maybe there is other "work" you could be doing that would help you feel more enriched.