The High Commissioner for India is set to leave New Zealand after claims his wife assaulted a "slave" who worked in their kitchen.

It is understood India has formally recalled High Commissioner Ravi Thapar. A moving van arrived at his $1.1 million Lower Hutt residence on Saturday morning after allegations emerged of domestic abuse against the worker.

Both Thapar and his wife, Sharmila, have declined to be interviewed by police and have barred other members of the mission from speaking to authorities. Sharmila Thapar refused to answer questions at the house on Saturday morning.

The worker, believed to be a chef, walked nearly 20km from the High Commissioner's house to Wellington one night where he was found by a member of the public in a distressed state.

He was taken to a police station and ended up staying several nights at the Wellington Night Shelter.

A moving truck at the Indian high commissioner's house in Lower Hutt on Saturday.

Through an interpreter, he alleged he was kept in slavery. He said he was physically assaulted by Sharmila Thapar and threatened with assault by Ravi Thapar. But he did notmake a formal complaint and wanted to return to India.

Government sources confirmed the incident, saying the allegations were directed at both the High Commissioner and his wife.

The police have decided not to press charges because the worker declined to lay a formal complaint, a source said.

"The alleged victim has gone home and the arrangements that the Indian government are for them to answer for, but we've been told they are taking their guy home."

A Government source confirmed that the couple has been accused of keeping the man as a slave, but that had not been confirmed by police. "The allegation the police were looking into was physical ill treatment."

Sharmila Thapar at the residence in Lower Hutt.

The police contacted the Ministry of Foreign Affairs and Trade (MFAT), which alerted India's Ministry of External Affairs.

An MFAT spokeswoman said they were aware the Indian High Commissioner was departing and said questions about his departure should be addressed to the Indian Ministry of External Affairs.

"MFAT was aware a staff member raised with New Zealand police concerns about his treatment in the High Commission.

"MFAT has been advised the individual concerned elected not to take the matter further. That staff member had independent legal representation and decided to return to India."

It's understood an official from India came to New Zealand to deal with the situation and the staff member left on May 28.

A neighbour who did not want to be named said they were shocked by the allegations.

"I thought she was a very nice person. She was very kind and very giving."

The neighbour recalled a previous houseboy at the residence who had returned home to India before being replaced by the domestic servant at the centre of the allegations.

"He was extremely shy and couldn't speak English."

* Do you know more about this story? Email newstips@stuff.co.nz