Well high school is better (depending on where you go and people you know though even that depends on where you go) so you shouldn't have to worry
I go to Middleton Magnet High School so it's interesting. I'm a magnet student (basically means I signed up for a program that adds a specific elective focus to my normal classes, in my case engineering) and generally the magnet students don't associate with the local kids, mostly cause it's an inner-city school so most of the local kids are in regular classes while magnet students take AP and honors level classes. Some area students do have the right grades to do higher level classes so it's not predetermined.
As for fights, I've been called a wuss, wimp, chicken, and even gay and f-a-g-g-o-t (gotta space cause ZD sensors) for not wanting to fight. I think it's stupid cause they're basically saying "let me suspend myself by punching you in the nose so that my grades will suck". I take the insults cause they're always from people I don't give a sh*t about and I don't care enough to give them the satisfaction