I have not much knowledge on this but I think you´d be better off refeeding on workout days, if possible. Which doesn´t mean you cannot refeed on a non working out day.
More carbs = more pumped muscles = more energy = more efficient training session
Am I wrong?