(CNN) Carl Goldman and his wife, Jeri, were still aboard the Diamond Princess when the threats began.

The California couple, who had traveled to South Asia for vacation, were among the passengers stuck onboard the American-run cruise ship when the coronavirus pandemic hit in February.

For a time in early February, the Diamond Princess had the largest concentration of cases outside of mainland China -- and positive cases in the United States were in single digits. At least 712 passengers and crew members on the ship tested positive for coronavirus by late March, according to the Centers for Disease Control and Prevention.

Carl Goldman was one of the hundreds of passengers who tested positive for coronavirus. Jeri Goldman was not.

"People started posting that we shouldn't be allowed to come back to the US, or if we did, we should be locked up in cages," Carl Goldman told CNN.

The Goldmans said that since leaving the ship and returning home in March, the threats have only gotten worse. While the bulk of the threats occurred when Jeri returned home, they have not stopped weeks later.

The Goldman's and friends on day 10 of quarantine aboard the Diamond Princess.

The couple's experience reflects the stigma some people who have tested positive for the virus face, as the public increasingly has come to fear potentially catching it themselves.

Most states have stay-at-home orders in place. As a result, businesses have closed, bars and restaurants have turned to take-out or delivery-only options and schools have moved to remote teaching.

As of Wednesday midday, at least 399,979 people in the US had tested positive for Covid-19, according to Johns Hopkins University. There are at least 12,912 coronavirus-related deaths.

Departing the ship

After being evacuated from the cruise ship, the couple took a flight from Japan to Nebraska. They were transported to University of Nebraska Medical Center, where Carl tested positive for coronavirus.

He spent weeks under close medical supervision until he fully recovered. Health care workers performed multiple tests during his two week quarantine in Nebraska. Once he was free of symptoms and tested negative three days in a row, he was released.

He returned home on March 16.

Carl Goldman in quarantine at a hospital in Nebraska, after testing positive for coronavirus.

Jeri, he said, somewhat miraculously never contracted the virus and had already returned to their home in Santa Clarita Valley, California, two weeks earlier.

During that time, Carl said his wife feared for her safety after the initial threats. The Goldmans are known in their local community for owning the local radio station, KHTS. Now, they felt like they were being treated like pariahs.

All this came before Gov. Gavin Newsom implemented stay-at-home restrictions on March 19 in order to combat the spread of the virus.

"We kept getting threats on social media and YouTube directed at my wife," said Carl, who began blogging about his experience after testing positive for the virus. "There were vile descriptions of me dying from drowning in my own fluids. People we had never met posted on our radio station's Facebook."

Carl said the local sheriff set up additional patrols near their house, and neighbors were asked to be on alert for anything unusual in the neighborhood.

But even among their own community, they started to feel people's fear of encountering them.

Several friends refused to see Jeri, Carl said. She was denied services at businesses including her nail salon, personal workout trainer and hair stylist, where she had been a customer for nearly 30 years.

Carl said their dog walker and house sitter returned the house keys to Jeri. The house sitter, who declined CNN's request for comment, then got fired from his daytime job after the employer found out he had physical contact with Jeri, Carl said.

Carl says he has been assured by his doctors that it is not possible for him to contract the virus again, and his immunity may last for months, potentially even years. He thinks that reassurance will do little to quell the animosity.

"I think people are still so afraid, and are living in fear," he said. "There is still so little information about the virus, and so much misinformation."

Carl had planned the cruise as a surprise birthday and Christmas gift for his wife. It was supposed to be a fun celebration.

Now, the Goldmans, like nearly 40 million other Californians and 97% of the American public, are abiding by the state's stay-at-home orders for the foreseeable future.

He said he and Jeri are hoping to move past the threats.

"It's not coming from hatred, it's coming from a place of fear," Carl said. "We are making a conscious effort not to let it affect us. It is what it is."