Is it wrong to react this way?

Report the idiot. I'm a teacher and so I don't say this lightly, what he said to you was unprofessional and just plain rude and totally inappropriate. Not in any way acceptable, ever. Hurting him is not the answer because you are at a disadvantage and he will make you look like a psycho or a liar. You need to be very cool and more mature than you have ever been to deal with this. Get your parents on your side and tell only the absolute truth, that is all you need. Good Luck.