If you schedule your cheat meals (1/week or 1 cheat day / week) then you can save your sugar junk for those meals without destroying all your progress w/ your diet. You also notice that if you clean out the junk, eventually even for the cheats you either dont' crave the junk as much or dont' enjoy it as much when you eat it. I think its something that is appropriate to accommodate in moderation instead of trying to completely pull it out of your diet because the only successful diet is one that fits your lifestyle and your life.
Drink lots of water and during the first couple weeks you might have to make a conscious effort to hold off on the cheats until your scheduled cheat, but part of that is just establishing the habit. Allow yourself fun "rewards" that aren't food to keep yoru mind from fixating on the sweets as a reward. Stay busy. Don't sit down in front of the tv when you are hungry, etc. All sorts of things you can do -- if you can identify when you tend to head for the junk food, you can avoid those situations or create alternate habits. E.g. munching in front of the tv at nite. Leaving the grocery store, etc.
And like Jens said -- look for alternate "sweets" -- cup of good coffee w/ some splenda, a diet soda, Crystal Lite, chocolate protein shake. Sugar free ice pops. Sugar free / fat free jello. Natural peanut butter. Etc. I noticed I developed a huge appreciation for grillled chicken when I first started dieting. Or your favorite spice on your steak, stuff like that.