I wouldn't worry about it at all. The therapudic bennefits that come from cuttin loose a little bit are much greater than any negative impact doing so might have. A glass of red wine ED or EOD is suposed to be good for the liver believe it or not. And weed, well... i blaze all the time sometimes before mostly after the gym, great way to relax =]
have fun with it