On days I lift shit all day should I just take the day off from the gym?

[Cro Magnon]

Construction work isn't nearly as intense as a set of EYE-BULGING squats. And that's what you need to keep/build muscle mass: intensity.

Also, make sure you're eating enough to compensate for those eight hours of manual labor. Snack as often as possible.

CM