The game was canceled after the incident, the television station reported.
According to some parents, a flag on a play led to a push from a player and a push back from the official. At that point, the father of one of the players grabbed the referee and slammed him to the ground, the television station reported.
"Unfortunately some people get too excited for these events and they decide to go onto the field and take matters into their own hands," Officer Simon Drobik told KRQE.
The YAFL told the television station that since the code of conduct policy was violated, the entire team was banned from further play.
The New Mexico Activities Association, which does not have jurisdiction over the YAFL, said aggressive acts are causing a shortage of officials.
"It's disappointing to see something like that occur at a youth sporting event, and it's one of those things and other sportsmanship issues that are causing the shortage of officials," Dusty Young told KRQE.