New Jersey has opened an investigation into nursing home deaths across the state after officials discovered 17 bodies piled into a makeshift morgue and more than 100 residents infected with Covid-19 at a long-term care facility, state officials said Thursday.

Gov. Phil Murphy said he was "outraged" that staff at the Andover Subacute and Rehabilitation Center in northern New Jersey piled deceased residents into a small room at the facility.

"A story like this shakes you to the bone," Gov. Phil Murphy said at a press conference. "New Jerseyans living in our long-term care facilities deserve to be cared for with respect, compassion and dignity. We can and must do better."

State and local officials inspected the facility at about 2 a.m. on Sunday after receiving a call that it needed body bags and was storing 28 dead bodies, New Jersey Health Commissioner Judy Persichilli told reporters. There were just five bodies on the premises; three more were released to local mortuaries earlier, she said. They received another complaint on Tuesday, she said. It wasn't immediately made clear when the remainder of the bodies were discovered or whether they died due to Covid-19.

The Sussex County Department of Health did not immediately respond to CNBC's request for further details.

Officials have since discovered that 103 residents have tested positive for the coronavirus and 133 more have flu-like symptoms between the facility's two buildings, she said. At least 35 residents have died since March 30; 19 of those have been attributed to Covid-19, she said. At least 52 employees have reported flu-like symptoms.

Murphy said he's asked state Attorney General Gurbir Grewal to review all long-term care facilities across the state that have seen a disproportionate number of deaths since the epidemic began earlier this year.