CHARLOTTESVILLE, Va. — Brittany Caine-Conley, a minister in training at Sojourners United Church of Christ, arrived in downtown Charlottesville on Saturday morning expecting that there might be violence. She did not expect things to get out of hand so quickly.

But what began as a rally of white nationalists in a city park soon spun out of control, resulting in melees in the streets and the death of a 32-year-old woman after a car rammed a group of counterprotesters. The police have charged a 20-year-old Ohio man described as a Nazi sympathizer, accusing him of intentionally driving his car into the crowd.

On Sunday, Charlottesville tried to recover — as the police, in particular, came in for criticism.

At church services, pastors urged their congregations to fill their lives with love, not hate — a message echoed by Gov. Terry McAuliffe. The downtown mall, a pretty pedestrian plaza, was unusually quiet. People looked grief-stricken, as State Police officers in riot gear sat on a brick wall, taking a break in the midday sun.

At Emancipation Park, where the so-called Unite the Right rally had been planned for Saturday around a statue of the Confederate general Robert E. Lee, city workers picked up trash. On Water Street, where the authorities say the man from Ohio, James Alex Fields Jr., 20, took the life of Heather D. Heyer, 32, an impromptu memorial of flowers lay in the middle of the road.

And at City Hall, a planned news conference by Jason Kessler, the white nationalist who organized Saturday’s rally, came to an abrupt end when a man wearing a plaid shirt punched him.

“Jason Kessler has been bringing hate to our town for months and has been endangering the lives of people of color and endangering other lives in my community,” the man, Jeff Winder, said in an interview later. “Free speech does not protect hate speech.”

But if Charlottesville was grieving on Sunday, it was also questioning. Governor McAuliffe fiercely defended the police in an impromptu sidewalk interview, noting that many of the demonstrators were armed, and saying the officers had done “great work” in a “very delicate situation.” And he said Ms. Heyer’s death, which he called “car terrorism,” could not have been prevented.

“You can’t stop some crazy guy who came here from Ohio and used his car as a weapon,” Governor McAuliffe said. “He is a terrorist.”

But others, including Mr. Kessler and Ms. Caine-Conley, openly wondered if the violence could have been prevented.

“There was no police presence,” Ms. Caine-Conley said. “We were watching people punch each other; people were bleeding all the while police were inside of barricades at the park, watching. It was essentially just brawling on the street and community members trying to protect each other.”

Many cities, among them St. Louis and New Orleans, have wrestled with what to do about Confederate monuments. Like them, Charlottesville — the home of the University of Virginia, founded by Thomas Jefferson in 1819 — has been navigating tricky terrain. As Mayor Mike Signer asked in an interview Sunday, “How do you reconcile public safety and the First Amendment?”

Saturday was not the first time that white nationalists and white supremacists had rallied in Charlottesville. In May, Richard Spencer, a prominent white nationalist and a graduate of the University of Virginia, led a torch-lit rally here, and last month, the Ku Klux Klan came from North Carolina.

Sensing there might be trouble, the city tried to deny Mr. Kessler’s group a permit for Emancipation Park; officials wanted the gathering in a larger park, where they felt they could better control the crowd. But on Friday evening, a judge sided with Mr. Kessler. Mayor Signer would later lament on Twitter that it was a fateful turn of events.

“This is EXACTLY why City tried to change venue to McIntire,” he wrote.

On Saturday morning at sunrise, faith leaders and scores of counterprotesters — some from the Black Lives Matter movement, others from groups like Showing Up for Racial Justice — gathered at First Baptist Church, a historically African-American church here. Around 8 a.m., they started massing for a march downtown, toward Emancipation Park.

Across town, the white nationalists were gathering for their own trek to Emancipation Park, for a rally that was not supposed to begin until noon. “I’m tired of seeing white people pushed around,” said one man, Ted, who refused to give his last name.