Same here, Booey.
I get extremely bummed out when I think of the things I'm missing out on. So bad, it sometimes brings my motivation into question. This does get worse for me when I'm on, probably because I tend worry more about getting everything just right and making sure I'm eating enough...