Story highlights Romney made his remarks during a Fourth of July parade in Wolfeboro, New Hampshire.

Romney also said he will meet with Jeb Bush and his wife, Columba, on Monday at Walker's Point, the Bush family home in Maine.

Wolfeboro, New Hampshire (CNN) Mitt Romney said Saturday that Donald Trump's comments on Mexico and undocumented immigrants have hurt the Republican Party, making the 2012 presidential nominee the latest Republican to slam the billionaire over his controversial remarks.

Romney made his remarks during a Fourth of July parade in Wolfeboro, New Hampshire, which was also attended by presidential candidates New Jersey Gov. Chris Christie and Florida Sen. Marco Rubio.

Asked if Trump's comments on Mexicans have hurt the Republican Party, Romney replied, "Yes."

"I think he made a severe error in saying what he did about Mexican-Americans," Romney said.

And when he was asked if Republican candidates should be speaking out about Trump's comments, Romney said, "I think a number of them have."

JUST WATCHED Fact-checking Donald Trump's immigration comments Replay More Videos ... MUST WATCH Fact-checking Donald Trump's immigration comments 03:54

Read More