The University of Florida’s band director says he was attacked after the football team’s victory over its rival the University of Miami.

Florida Gators band director Jay Watkins was roughed up Saturday night as the musicians marched to their buses in Orlando following the win in the Sunshine State showdown, news station WCJB reported.

The violent altercation allegedly started when a Miami Hurricanes fan tried to cut through the marching line. Watkins put his arm out to stop the woman, prompting another person to grab the band director from behind and shove him to the ground, police said.

Watkins was treated at the scene for injuries to his arm and head. A spokesperson for the University of Florida said the director was doing “OK” following the attack, CNN reported.

Orlando police said he has declined to press charges against the aggressive fan.