To the majority of the population the answer is unfortunately yes...most of the time people like to sum you up by your appearance and don't realize that there can either be so much or so little underneath that appearance...
Physical image is just the wrapping on the present. It might have the prettiest wrapping and be all neat, but when you open it, it might be a box of crap. In the end it still is a box of crap, just dressed up a little.
HAHA, THIS IS AN INTERESTING QUESTION, BECAUSE WHEN I WAS A YOUNG MAN I USED TO DRESS ALL NICE FOR AN INTERVIEW. NOW I HAVE PUT AWAY THAT BULLSHIT. I WEAR TO AN INTERVIEW EXACTLY WHAT I WEAR DAY IN DAY OUT, I.E. SOME JEANS AND A T-SHIRT (LONG SLEEVED SHIRT IF IT IS WINTER).