No, it isn't. If I apply for a job with two white guys and they both get jobs, is the fact I'm black AUTOMATICALLY the reason I'm not hired? I say no, maybe I was the least qualified. He was also the only foreigner. His slow reactions indicate he was drunk. Maybe he was just an easy mark. I can't tell where he is but wherever he is doesn't look like a good place for him to be. Hell, I wouldn't want to be where he is and I'm black.
The opinion of most whites I've heard on the Trayvon case say it isn't a hate crime every time a black person is the victim. I agree fully. The argument you just made is yes, it is. Skin color is the ONLY criteria that needs to be examined.