The removals began late Tuesday night, a day after the City Council voted unanimously to take down the monuments immediately, CNN affiliate WBAL reported

By early Wednesday, video posted on social media showed cranes slowly lowering some of the monuments from their perches.

Crane is here at #Tubman (Wyman) dell park to remove the #JacksonandLee monument pic.twitter.com/rU8hqVYAcB

'There's enough grandstanding'

In a press conference Wednesday, Mayor Catherine Pugh defended her decision to remove the monuments "quickly and quietly" overnight, saying it was the best thing for Baltimore.

"The city charter says, according to our city attorney, if the mayor wants to protect or feels like she needs to protect the public or keep her community safe, she has the right to keep her community safe. I felt the best way to remove the monuments was to remove them overnight," Pugh said.

"I thought that there's enough grandstanding, enough speeches being made, get it done," she said, adding that the decision to relocate the monuments "shouldn't be a debate that's gripping this city."

A monument dedicated to Maryland's Confederate women gets taken down early Wednesday.

The memorials removed in Baltimore included the Roger B. Taney Monument, one honoring Confederate Gens. Robert E. Lee and Thomas J. "Stonewall" Jackson, and a monument dedicated to Confederate women, according to WBAL.

As chief justice, Taney wrote the US Supreme Court's majority opinion in the infamous Dred Scott decision shortly before the Civil War. The 1857 ruling found that slaves were not citizens of the United States and therefore were not protected under the US Constitution.

Workers remove the Jackson-Lee monument in Baltimore's Wyman Park.

Pugh said it is up to a city committee to designate where the memorials will end up, but city officials are looking to relocate them to Confederate cemeteries. Three of the four monuments are being temporarily stored at the Back River Wastewater Treatment Plant, said Anthony McCarthy, a spokesman for Pugh.

During the Civil War, Maryland was one of several border states and not part of the Confederacy. But it had split loyalties and was the scene of many battles. In April 1861, a bloody riot broke out in Baltimore, leaving at least a dozen people, including soldiers called to federal service, dead.

Monuments remain an issue in other cities