Doormen have been quitting their jobs at a luxury rental building in Brooklyn that was once a hospital, sources said, spooked by eerie visions, sounds and even smells — sparking talk that the high-rise is haunted.

The 123 On The Park building on the southeast edge of Prospect Park was built on the site of the Caledonian Hospital, which closed in 2003.

After developers transformed the Flatbush building into a luxury rental and reopened its doors in July 2014, tales emerged of strange voices and mysterious footsteps — which are being blamed on the ghosts of former patients, sources told The Post.

At least three doormen have left in the past six months, according to a janitor who works in the building.

Aleksandra Scepanovic, managing director of Ideal Properties Group, confirmed that there has been high staff turnover at the building and said, “They’ve had issues renting.”

One doorman who still works there told a superintendent in a nearby building that On The Park “is a messed-up place to work because it’s haunted.”

“He said he was doing routine security walks in the basement and the back of the building, and every time he would go down there by himself, he would hear footsteps echoing around him,” the superintendent explained.

“He told me he felt like a presence was following him.”