No shirts off in public, unless at a swimming pool. Guys waking around at a public place shirtless is in really bad taste anyways. It looks trashy.
Guys don't wear short shorts anyways so that's not an issue.
The biggest immodesty issue for male dress is boys wearing their pants halfway off their ass with their underwear or butt cracks showing.