MOSUL, Iraq (Reuters) - Iraqi forces on Tuesday recaptured the main government building in Mosul, the central bank branch and the museum where three years ago the militants filmed themselves destroying priceless statues.

A Rapid Response team stormed the Nineveh governorate complex in an overnight raid that lasted more than an hour, killing dozens of Islamic State fighters, spokesman Lieutenant Colonel Abdel Amir al-Mohammadawi said.

The buildings, already in ruins, were not being used by Islamic State, but their capture is a landmark in the push to retake the militants’ last major stronghold in Iraq, now restricted to the heavy populated western half of Mosul.

Prime Minister Haider al-Abadi flew into to Mosul to visit the troops fighting to oust Islamic State from the city in which it declared its sprawling caliphate in 2014.

“Iraqis shall walk tall when the war is over,” Abadi told state TV as he arrived.

Islamic State snipers continued to fire at the main government building after it was stormed, restricting the movements of the soldiers, and forces pushing further into western Mosul came under rifle and rocket fire.

“The fighting is strong because most of them are foreigners and they have nowhere to go,” said the head of a sniper unit for the Rapid Response, al-Moqdadi al-Saeedi.

Some of Islamic State’s foreign fighters are trying to flee Mosul, U.S. Air Force Brigadier General Matthew Isler said.

“The game is up,” Isler told Reuters at the Qayyara West Airfield, south of the city. “They have lost this fight and what you’re seeing is a delaying action.”

Iraq’s Counter Terrorism Service (CTS), which spearheaded the assaults that won back east Mosul, was on Tuesday moving into the western half of the city, the final and trickiest battleground in the nearly five-month campaign due to the dense civilian population living in its narrow streets.

STREET BY STREET

The CTS forces had fought their way well into the Mansour neighborhood and were trying to advance street by street, sending heavy fire on IS sniper positions, a Reuters correspondent visiting the special forces’ front lines reported.

Federal Police units arrived at a house that CTS forces were stationed in but had to move out, one-by-one, to a neighboring building as IS rocket fire hit homes nearby.

Slideshow ( 20 images )

One CTS operative on the ground said he thought it would take a few hours to retake Mansour, one of Mosul’s biggest neighborhoods which lies southwest of the old city and could serve as a base to advance into the historic center.

U.S. special forces were seen walking between buildings in the same area, some carrying assault rifles with scopes and silencers. Helicopters attacked targets just to the north and thick smoke filled the sky from various explosions.

Dozens of civilians streamed out of the Mamoun district toward the CTS troops as machinegun fire rang out in the background, adding to a wave of people displaced from Mosul that now numbers 211,000, 40,000 of whom fled last week alone, U.N. agencies say.

Slideshow ( 20 images )

Some 750,000 people were estimated to live in west Mosul when the offensive began on Feb. 19.

Among the symbolic buildings retaken overnight was one that had served at Islamic State’s main court, known for sentences including stonings, throwing people off roofs and chopping off hands, reflecting the group’s hardline ideology.

The militants looted the central bank when they took over the city in 2014 and took videos of themselves destroying archaeological artifacts. Traffic in antiquities that abound in the territory under their control, from Palmyra in Syria to Nineveh in Iraq, was one of their main sources of income.

The number of Islamic State fighters in Mosul was estimated at 6,000 at the start of the offensive on Mosul on Oct. 17, by the Iraqi military which estimates that several thousands have been killed since.

Lined up against them is a 100,000-strong force of Iraqi troops, Kurdish peshmerga fighters and Iranian-trained Shi’ite Muslim paramilitary groups.