Story highlights San Bernardino sheriff says 10 deputies have been put on leave

Video from a news helicopter shows deputies punching and kicking a man repeatedly

(CNN) There's a stampede of investigators in California.

The FBI said Friday that it will investigate whether civil rights were violated during the videotaped beating of a suspect in San Bernardino. The suspect allegedly fled by car, foot and horseback when law enforcement officers tried to arrest him.

Earlier Friday, San Bernardino Sheriff John McMahon said criminal investigations have begun into the actions of deputies as well as the suspect.

In addition, an internal investigation has been launched.

Ten deputies identified as being involved in the case have been put on paid administrative leave, McMahon said Friday.