Vice President Mike Pence said his inclination is to encourage building more American monuments rather than tearing them down.

"I can't help but think that rather than ... tearing down monuments that have graced our cities all across this country for years we ought to be building more monuments," Pence remarked when he sat down with "Fox & Friends" on Tuesday.

Since the violent white nationalist rally in Charlottesville, Virginia that left one dead, Confederate statues have been defaced and knocked down by "anti-fascist" rioters. Lately the vandalizing has spread to statues of Christopher Columbus and Abraham Lincoln. Some are even calling for statues and parks honoring George Washington to be taken down and renamed.

Hannity to Afghan Amb: 'The Patience of the American People Is Rather Thin'

Kaepernick 'Artifacts' Will Be in Smithsonian Black Lives Matter Exhibit

The vice president said it should be a local decision whether to rename parks or remove statues that some find offensive because of the historical figures' connections to slavery.

However, it is "unacceptable" to destroy public property in the name of any cause, Pence stated, referring to the vandals.

While we must remember our history, we must "celebrate the progress we've made since that history," Pence encouraged. "celebrate the men and women who have helped nation move toward more perfect union."

Watch the Moment of the Total Solar Eclipse Over Madras, Oregon

Whitlock: NFL Players Won't Criticize Anthem Protests for Fear of Backlash