Versailles has a bike rental stand behind the chateau. You can hop on the bus and visit the temple quickly afterward.
As others have mentioned, Sainte Chapelle is a must. The Musee d'Orsay has been a better experience for me than the Louvre.
If you're looking for a quick day trip, renting a car to see Pierrefonds is worth it.