The FBI said Friday that it will investigate whether civil rights were violated during the videotaped beating of a suspect in San Bernardino. The suspect allegedly fled by car, foot and horseback when law enforcement officers tried to arrest him.

Earlier Friday, San Bernardino Sheriff John McMahon said criminal investigations have begun into the actions of deputies as well as the suspect.

In addition, an internal investigation has been launched.

Ten deputies identified as being involved in the case have been put on paid administrative leave, McMahon said Friday.

In video captured by cameras aboard a helicopter for KNBC, deputies gather around the man after he falls from a horse he was riding to flee from them. The video shows deputies using a stun gun on him and then repeatedly kicking and hitting him.

KNBC reported that the man -- identified by authorities as Francis Pusok -- appeared to be kicked 17 times, punched 37 times and hit with a baton four times. Pusok was later hospitalized, KNBC reported, citing authorities.

"The video surrounding this arrest is disturbing and I have ordered an internal investigation be conducted immediately," McMahon said in a statement.

"What I saw on the television was thugs beating up my client," said Jim Terrell, Pusok's family attorney, according to CNN affiliate KCAL. "That's what I saw. And these questions about what was he doing? What did they do? This is far worse than Rodney King."

The ACLU of Southern California issued a statement Friday saying that it was "deeply troubled" by the images.

"While we applaud Sheriff John McMahon's prompt decision to investigate the disturbing actions of his deputies, we believe more is needed," the organization said. "Too often the department has failed to address questions, including those raised by the ACLU SoCal, about use of force and Taser policies."

The Thursday afternoon incident began when deputies tried to serve a search warrant in an identity-theft investigation, according to the San Bernardino County Sheriff's Department.

Pusok fled in a vehicle, and deputies pursued him through the unincorporated area of Apple Valley, the town of Apple Valley and farther into the unincorporated area of Hesperia, the sheriff's office said in a news release.

Pusok abandoned his vehicle and fled on foot into steep, rugged terrain, with deputies pursing with off-highway vehicles and helicopters, the sheriff's office said.

"Within minutes, deputies received information that the suspect came into contact with a group of people near the Deep Creek Hot Springs and stole a horse. He fled on horseback on dirt trails, through very rugged, steep terrain, causing numerous injuries to the horse," the sheriff's office said.

A helicopter dropped deputies onto the ground, and as they approached Pusok to make the arrest, he was thrown from the horse, the sheriff's office said. The sheriff's office said a Taser was used on Pusok but was ineffective because of his loose clothing.

A deputy was injured when the horse Pusok had been riding kicked him, the Sheriff's Department said. Two other deputies were treated for dehydration.

The incident comes amid heightened scrutiny of police use of force after the 2014 deaths of Eric Garner in New York and Michael Brown in Ferguson, Missouri, and the recent shooting of Walter Scott in South Carolina.

In the California case, the FBI said the results of its investigation will be forwarded to the U.S. Attorney's Office in the Central District of California and Justice Department in Washington to determine whether prosecution is warranted.