You ask a hard question. I remember seeing a documentary on this stuff. What men and women find attractive in each other is dictated by genetics. If a man is athletic in build (narrow waist and broad shouldered), that's what most women desire. I suppose excess to either extreme doesn't fit the mold and so women don't care for them as much.
I'm out to be a freak. However, my current goal of 220 with < 5% body fat might never be obtainable without more time and work than I'm able to give. I have fast-twitch muscle, so I get lean and shreadded more than I put on mass. My G/F thinks I'm pretty huge now and doesn't understand why I'd want to be some freak at 250+.
This indicates to me that the average woman wants to walk into a room with a good looking guy whose built enough that he can't help but draw attention (he's her trophy) but not so big that he's out to draw attention for his own ego (remember, she want's to come first).
So, super freaks don't get the vote, bean poles don't get the vote, but average lean guys with some definition turn the magic switch. Still comes down to genetically-programmed attraction.