A boy asked me to our prom what shall I do?

A boy in my class called Ben asked me to our end of year prom. I didn't reply and said I'd think about it. Next day my friend walks home with him and he calls me prick. On February 14 I gave my friend a prank valentine card so Ben called me a lesbian. the next day he asks me again will you go to the prom with me? I said no. He said why and I gave him my reason. Yesterday he texted me saying do you hate me if so why? What do I reply?? Should I go to the prom with him or not??? Please help!