Harare, Zimbabwe (CNN) Embattled Zimbabwean President Robert Mugabe gave a rambling televised speech to his country Sunday but did not resign -- despite an ultimatum from his own party that said it would move to impeach him if he did not step down by midday Monday.

Members of ZANU-PF, which Mugabe co-founded to usher his country into independence, voted the 93-year-old President out on Sunday and anointed Emmerson Mnangagwa, the former vice president fired by Mugabe earlier this month, as new party leader.

In his address late Sunday night, Mugabe said he had met with the nation's security force command before speaking to the nation, but vowed to stay in power.

Rumors were swirling before he spoke that Mugabe would resign the presidency.

While acknowledging the struggles and criticisms that led the nation's security forces to seize power, and the pressure for him to resign, Mugabe said he will preside over the ZANU-PF congress in December.

"Today's meeting with the command element has underscored the need for us to collectively start processes that return our nation to normalcy. So that all our people can go about their business unhindered, in an environment of perfect peace and security. "

He also enumerated all the concerns raised by the nation's security force and his own party, including the struggling Zimbabwean economy, and added they should be attended to with great urgency.

During his address, Mugabe was flanked by various uniformed members of the armed forces. While speaking, he shuffled his papers and at times seemed to lose his place, prompting him to apologize at the end.

"It was a long speech," Mugabe said, before receiving tepid applause by those sitting next to him. Minutes later he stood up and shook hands with members of the armed forces.

Removing Mugabe as party leader does not dethrone him as Zimbabwe's President, but it is a clear indication that if Parliament holds a vote on his future, they will have the numbers to impeach him.

Mugabe addresses a ZANU-PF youth rally in early November.

Key developments

Grace Mugabe gone: Mugabe's wife, who was maneuvering to run for president, was also expelled from the party, according to Reuters.

Talks in deadlock: Mugabe has refused to accept a deal with the military that will allow him to resign without being forced out.

Mugabe's support crumbles: took to the streets Saturday to demand an end to Mugabe's rule as several key allies turn against him. Tens of thousands of protesters took to the streets Saturday to demand an end to Mugabe's rule as several key allies turn against him.

Mugabe cornered

Social media video of the party meeting during which Mugabe was removed as leader showed ZANU-PF members singing and dancing in jubilation.

The decision came shortly after official Obert Mpofu opened the meeting at the party headquarters in Harare by declaring the party's intention to vote out Mugabe. His statement received a standing ovation and roars of support.

Mpofu is one of the many former Mugabe allies who have turned on the President. The former mining minister, who once described himself as Mugabe's most obedient son, said the decision was made Sunday with a "heavy heart."

Mugabe's 37-year rule has been on the brink of collapse since the army seized power in Harare on Wednesday. The military is losing patience with the leader, who is refusing to accept a deal that would allow him to resign without the disgrace of being forced from office.

But with his main power base now gone, there may be a breakthrough in negotiations. Mugabe is effectively now forced to make a choice between stepping down or waiting for Parliament to officially oust him.

Sources told CNN that any deal would involve Mugabe stepping down to make way for an interim President, while Mnangagwa would likely be installed as the next ZANU-PF leader at a congress in December, paving the way for the presidency in next year's election.

Mnangagwa has been central to the political chaos. Party members saw his dismissal on November 6 as the final assault after months of infighting over who would eventually replace Mugabe.

Mnangagwa has not been seen since his dismissal, but CNN has learned that he had been instrumental for some time in plans to seize control from the President.

Mnangagwa served as Mugabe's right-hand man throughout his entire leadership, and there are now concerns that his rise could mark a continuation of Mugabe's oppressive policies.

Like Mugabe, Mnangagwa has been accused of playing a central role in a string of massacres by the country's Fifth Brigade in the early 1980s, which are widely believed to have left up to 20,000 people dead.

Protesters demand change

There is strong appetite in the country to see Mugabe go. On Saturday, tens of thousands of protesters took to the streets to demand an end to the President's rule.

The country's powerful army veterans organization, once loyal to Mugabe, has also turned on the President. The group organized a rally in Harare on Saturday , in which tens of thousands of people called for an end to Mugabe's rule.

Photos: Political upheaval grips Zimbabwe Members of Zimbabwe's Parliament celebrate after the resignation of longtime President Robert Mugabe was announced on Tuesday, November 21. Mugabe, 93, had led the country for nearly four decades. His resignation comes six days after military leaders seized control of the nation and placed him under house arrest. Hide Caption 1 of 35 Photos: Political upheaval grips Zimbabwe Protesters call for Mugabe's impeachment near the Parliament building in Harare on November 21. Hide Caption 2 of 35 Photos: Political upheaval grips Zimbabwe Demonstrators protest outside the Parliament building on November 21. Hide Caption 3 of 35 Photos: Political upheaval grips Zimbabwe Jacob Mudenda, the speaker of Zimbabwe's Parliament, presides over a session where a motion was moved to impeach Mugabe. Hide Caption 4 of 35 Photos: Political upheaval grips Zimbabwe A man accused of supporting Mugabe is attacked outside Parliament on November 21. Hide Caption 5 of 35 Photos: Political upheaval grips Zimbabwe People gather to pray for the country in a park near Parliament on November 21. Hide Caption 6 of 35 Photos: Political upheaval grips Zimbabwe Lawmakers meet inside Parliament on November 21. Hide Caption 7 of 35 Photos: Political upheaval grips Zimbabwe Gen. Constantino Chiwenga speaks during a news conference in Harare on Monday, November 20. Military leaders had been in talks with Mugabe over his exit, and Chiwenga said that progress had been made. Hide Caption 8 of 35 Photos: Political upheaval grips Zimbabwe Students from the University of Zimbabwe participate in a demonstration in Harare on November 20. Hide Caption 9 of 35 Photos: Political upheaval grips Zimbabwe Newspapers are held in place with rocks at a newsstand in Harare on November 20. Hide Caption 10 of 35 Photos: Political upheaval grips Zimbabwe At a bar in Harare, people watch Mugabe give a televised address to the nation on Sunday, November 19. Mugabe ended the address without giving his resignation. Hide Caption 11 of 35 Photos: Political upheaval grips Zimbabwe Mugabe meets with generals in Harare on November 19. Hide Caption 12 of 35 Photos: Political upheaval grips Zimbabwe Members of the ruling party ZANU-PF react after the decision to oust Mugabe as party leader on November 19. Hide Caption 13 of 35 Photos: Political upheaval grips Zimbabwe A portrait of Mugabe hangs in the hall of the ZANU-PF headquarters, where delegates met for a special committee on November 19. Mugabe co-founded the party and had been its leader for decades. Hide Caption 14 of 35 Photos: Political upheaval grips Zimbabwe A woman and her daughter look out from their balcony as a crowd of protesters gather on the road leading to the State House in Harare on Saturday, November 18. Hide Caption 15 of 35 Photos: Political upheaval grips Zimbabwe People hold a portrait of Zimbabwe's former vice president, Emmerson Mnangagwa, during a demonstration demanding Mugabe's resignation on November 18. ZANU-PF announced Mnangagwa as its new party leader. He was fired by Mugabe on November 6. Hide Caption 16 of 35 Photos: Political upheaval grips Zimbabwe A soldier greets a citizen during a demonstration on November 18. Hide Caption 17 of 35 Photos: Political upheaval grips Zimbabwe People in Harare react as they see a military helicopter fly overhead during protests against Mugabe on November 18. Hide Caption 18 of 35 Photos: Political upheaval grips Zimbabwe Mugabe, center, arrives to preside over a student graduation ceremony at Zimbabwe Open University on Friday, November 17. It was his first public appearance since the military takeover. Hide Caption 19 of 35 Photos: Political upheaval grips Zimbabwe Mugabe, right, is seen in talks about his future in this image tweeted by Caesar Zvayi, the editor of The Herald newspaper, on Thursday, November 16. Hide Caption 20 of 35 Photos: Political upheaval grips Zimbabwe An armored vehicle is on patrol in Harare on November 16. Hide Caption 21 of 35 Photos: Political upheaval grips Zimbabwe Business continues as usual in Harare as roadside vendors sell vegetables on November 16. Hide Caption 22 of 35 Photos: Political upheaval grips Zimbabwe Members of the military check a gun as they stand atop an armored vehicle parked in Harare's central district on November 16. Hide Caption 23 of 35 Photos: Political upheaval grips Zimbabwe An overview of Harare on November 16. Hide Caption 24 of 35 Photos: Political upheaval grips Zimbabwe A banner of Mugabe remains outside the ZANU-PF headquarters in Harare on November 16. Hide Caption 25 of 35 Photos: Political upheaval grips Zimbabwe An armored vehicle patrols a street in Harare on Wednesday, November 15. In a dramatic televised statement, an army spokesman denied that a military takeover was underway, but the situation bore all the hallmarks of one. The military said Mugabe and his family were "safe." Hide Caption 26 of 35 Photos: Political upheaval grips Zimbabwe Soldiers seal off a main road to the parliament building in Harare on November 15. Hide Caption 27 of 35 Photos: Political upheaval grips Zimbabwe Soldiers patrol a street in Harare on November 15. Hide Caption 28 of 35 Photos: Political upheaval grips Zimbabwe Soldiers inspect a vehicle on a road leading to Mugabe's office in Harare on November 15. Hide Caption 29 of 35 Photos: Political upheaval grips Zimbabwe Residents in Zimbabwe's capital line up to withdraw money from a bank on November 15. Hide Caption 30 of 35 Photos: Political upheaval grips Zimbabwe Two pedestrians pass behind an armored personnel carrier stationed at an intersection in Harare on November 15. Hide Caption 31 of 35 Photos: Political upheaval grips Zimbabwe A man in Harare reads a special edition of The Herald newspaper on November 15. Hide Caption 32 of 35 Photos: Political upheaval grips Zimbabwe An armored military vehicle is seen outside the building of the state-run Zimbabwe Broadcasting Corp. on November 15. Hide Caption 33 of 35 Photos: Political upheaval grips Zimbabwe Soldiers monitor traffic in Harare on November 15 as the military set up checkpoints at key locations in the city. Hide Caption 34 of 35 Photos: Political upheaval grips Zimbabwe In a screen grab of a TV broadcast on the Zimbabwe Broadcasting Corp., Maj. Gen. Sibusiso Moyo reads a statement saying the military was conducting an operation to target "criminals" close to the President who were causing "social and economic suffering." He denied a coup was underway. Hide Caption 35 of 35

Some waved Zimbabwean flags and placards with slogans like "Mugabe Must Rest Now" and "No to Mugabe Dynasty," a rare sight in Zimbabwe, where such gatherings had been banned for decades.

"The whole nation is celebrating today. We are finally getting rid of the old man," said Tanashe, a Harare resident who declined to provide a second name.

Others ran alongside army tanks and hugged soldiers to show their gratitude for their actions.

Foreign powers have also largely supported the military's actions so far, with few international voices condemning its apparent coup.

US Secretary of State Rex Tillerson called on the army to show restraint but described the situation in Zimbabwe as an "opportunity" for the country.

Mugabe had said that he planned to contest next year's election, despite his age, and once infamously claimed that "only God" could remove him from office.

Zimbabwe's Indigenization Minister Patrick Zhuwao, who is also Mugabe's nephew, said the President "is willing to die for his principles."

"He is willing to die to protect the constitution."