Harare, Zimbabwe (CNN) Thousands of Zimbabweans took to the streets of Harare on Saturday to demand the resignation of President Robert Mugabe, in what could spell the political end for the 93-year-old leader who has ruled the country for nearly four decades.

Waving placards with slogans like "Mugabe Must Rest Now" and "No to Mugabe Dynasty," the atmosphere on the streets of the south African nation's capital was electric, just days after the army put Mugabe under house arrest and detained some of his key political allies.

People waved Zimbabwean flags while others ran alongside army tanks and hugged soldiers to show their gratitude. CNN did not see any police at the protest, which was originally called by the country's influential association of army veterans.

"The whole nation is celebrating today. We are finally getting rid of the old man," said Tanashe, a Harare resident who declined to provide a second name.

Mugabe's power appears to have finally been brought to check not by the opposition, but by the military and members of his own party, concerned about his apparent plans to have his wife Grace, 52, succeed him.

An army spokesman, speaking with demonstrators near the end of Saturday's rally, even cast Robert Mugabe as a foe to his own country.

"Yes, we are in uniform, but understand that all we are doing is simply dealing with the enemy of Zimbabwe," Gen. S.B. Noyo told remnants of the crowd in Harare, as he stood near a tank.

But Mugabe was still refusing to step down, an official with direct knowledge of the ongoing negotiations between the President and the military told CNN.

Mugabe was meeting with army chief Gen. Constantino Chiwenga to discuss what happens next, the source told CNN. Chiwenga is pushing for Mugabe to step down and an interim president to take over, the source said.

The central committee of Zimbabwe's ruling ZANU-PF Party will meet Sunday morning to consider a vote of confidence in Mugabe as a party leader, a senior Zimbabwe National Liberation War Veterans Association member who asked not to be identified told CNN.

In December, a conference of the party will take place. It's assumed that former Vice President Emmerson Mnangagwa will then become leader of the party and President of the country until elections next year, the source said.

ZANU-PF called for Mugabe to resign on Friday, the main state newspaper The Herald reported. It said party branches in all 10 provinces were also calling for the resignation of Grace Mugabe as the women's league leader.

Zimbabwe's Indigenization Minister Patrick Zhuwao, who is also Mugabe's nephew, criticized what he described as the "military siege" underway in the country.

"At the moment Zimbabwe is under military siege and it means nobody is able to express what they want freely. They are acting under coercion. Zimbabwe is currently undergoing a coup and people are trying to sugar coat it," he told CNN over the phone from South Africa.

He added: "Mugabe is willing to die for his principles. He is willing to die to protect the constitution."

VP's firing sparked chain reaction

Nicknamed "Ngwena" (The Crocodile) because of his ruthlessness, Emmerson Mnangagwa has held various senior posts in the country's defence and internal security apparatus.

The trigger for what is to all intents and purposes a coup came 10 days ago when Mugabe fired Mnangagwa, a former ally with strong connections and the support of the military who was widely tipped to become the country's next leader.

The timing, ahead of next year's presidential vote, fueled speculation that Mugabe was clearing the path for his wife to take over in the event of his retirement or death.

On Wednesday, a military spokesman announced on state television that the army had launched an operation to target "criminals" close to the President who were causing "social and economic suffering." Mugabe was confined to his multimillion dollar "Blue Roof" mansion.

Mugabe holds talks with army officials and others on Thursday.

Mugabe was photographed Thursday in talks with Gen. Chiwenga and other officials at the official State House. Grace Mugabe has not been seen in public since the military intervention.

On Friday, Mugabe emerged from house arrest to attend a university graduation ceremony in Harare, in a staged public appearance that belied the reality that he is no longer in control.

His appearance was apparently designed to convey a business-as-usual atmosphere -- the generals pulling the strings in Harare are desperate not to give the impression they are orchestrating an unconstitutional coup.

CNN has learned that Mnangagwa was instrumental in plans to seize control from Mugabe, one of Africa's longest serving heads of state.

"This takeover was planned a long time ago by Emmerson Mnangagwa and secret discussions did take place with opposition about a succession plan including forcing out Mugabe," a senior opposition leader with direct knowledge of the talks told CNN.

Opposition leaders have welcomed the developments.

Foreign powers urge restraint

A soldier greets protesters in Harare on Saturday.

An opposition lawmaker called Saturday's marches a "real turning point."

"The atmosphere was one of unity and joy. All peaceful an orderly," said Eddie Cross, a parliament member with the opposition Movement for Democratic Change (MDC-T). "It is a real turning point for all of us."

In an earlier statement calling on his supporters to join the demonstration, prominent MDC-T politician Douglas Mwonzora said: "While we may have fought and quarreled yesterday, today we are united by what is good for our country."

"We demand that President Mugabe resigns. But we have to think of tomorrow. The MDC-T demands a mechanism to ensure that the current economic meltdown is redressed. We must bring an end to all the poverty and misery that our people have been consigned to."

The atmosphere in Harare is electric. Zimbabweans of all races, colours and tribes are congregated to bid the dictator farewell. Soldiers shaking hands with civilians. Am I dreaming? @Wamagaisa @ProfJNMoyo @nelsonchamisa #thisflag — Douglas Mwonzora (@DMwonzora) November 18, 2017

Hundreds of people staged a peaceful protest Saturday outside the State House, the official residence of Mugabe, and there was talk in Zimbabwe of a march to Blue Roof.

Speaking to CNN, Mugabe's nephew Zhuwao said he feared for the safety of members of the Generation 40 faction of the ZANU-PF party that have remained loyal to the Mugabes.

"I don't even know if they are still alive," he said. "This is a coup. The president and first lady are not safe. They are captives."

Foreign powers have called on the military to show restraint in the upheaval, but have largely supported its actions so far.

US Secretary of State Rex Tillerson described the situation in Zimbabwe as an opportunity for the country.

"Zimbabwe has an opportunity to set itself on a new path, one that must include democratic elections and respect for human rights," he said Friday at an event in Washington, calling for a quick return to civilian rule.