Personally I could, but the relationship that just ended, did so in part because SHE couldn't handle the fact that we slept together 1 week after our first date (it wasn't a date, I was just over visiting when it happened), and she developed feelings for me faster than she thought was healthy, and it scared her.
Dayna, my advice is if he can handle it, don't dwell on it, and let it ruin a relationship that might lead to your happiness. Just accept it, and if you both think there is potential for soemthing long term, just go with it.