So your thought process is: keep it kinda cool while you drive to work, then
prevent the refrigerator from keeping it really cool for the next hour+ it sits in the fridge? Why not remove it from the bag when you put it in the fridge? I assume that at some point you will remove it from the bag, so I'm not adding a step, am I?