PARIS—Hundreds of French Muslims took to the streets of Paris and elsewhere in France on Friday to protest against Islamic State, days after the killing of a Frenchman by a self-proclaimed ally of the militant organization in Algeria.

"We, Muslims of France, say stop to barbarism," Dalil Boubakeur, rector of Paris's Grand Mosque, told a crowd of fellow Muslims in Paris.

The French gatherings follow a U.K.-launched campaign—dubbed "Not In My Name"— in which Muslims posted videos on Twitter and other social networks dissociating themselves from terrorist groups.

Various Muslim associations have called for a large demonstration against violence on Sunday in downtown Paris.

French Muslims, who account for an estimated 10% of the country's 65 million population, have rallied to pay tribute to Hervé Gourdel, the French mountain guide who earlier this week was abducted by a fringe Islamist militant group in Algeria that recently declared its allegiance to Islamic State.