I don't use fresh peppers in my chili, nothing wrong, just never have. I get my flavor and some of the "hot" from the chili powder, good chili powder is pretty GD hot and the rest of the heat comes from the red pepper. I eat raw jalapenos w/ my hamburgers, hot sauce ( Lousiana original, but Franks is damn good too) with damn near everything else I eat. My spicy is most people hot, and my hot is their " what the hell is in that!". As posted before, habanero peppers will set you on fire, not as much taste as say serano or jalapenos, but just for the "GD! THIS SHIT'S HOT!!" effect, you can't go wrong.
TCW, why the need for such a chili? just curious...