The parents of a boy they called "Adolf Hitler" have had their newborn baby taken away from them hours after his birth.

The boy, Adolf Hitler Campbell, and his two sisters JoyceLynn Aryan Nation and Honszlynn Hinler Jeannie were taken into custody back in 2009 by New Jersey welfare officials, New York Daily News reported.

Parents Heath and Deborah Campbell have since led a determined fight to have the children returned, and said officials had stripped them of custody because of the children's names.

Last week Deborah gave birth to a baby boy named Hons Campbell.

According Lehigh Valley's Express-Times, child welfare agents took the boy away from their parents hours after he was born, as the doctor who delivered him called the New Jersey Division of Youth and Family Services.

Mr Campbell said he doesn't know why his son was taken away.

"There's no legal binding court order," Campbell said. "It's basically a kidnapping, but they use different terms."

The agency told the paper that they're prohibited from commenting on specific cases.

Court records said that abuse and neglect, and the physical and mental disabilities of the parents were behind the children being taken away.

Back in 2009, Ms Campbell said: "I'm sorry if I hurt the world but it's just a name to us. Maybe when he [Adolf Hitler Campbell] gets older they'll just see that he loves everybody and they'll say, 'You know, maybe we did misjudge'."

Despite the children's names, the couple deny they are neo-Nazi supporters.

"The judge and [the Division of Youth and Family Services] told us that there was no evidence of abuse and that it was the names!" Heath Campbell told NBC 10 News in Philadelphia. "They were taken over the children's names."

“I don’t sleep, I don’t eat much. I miss my kids. Miss their pitter patters on the floor,” said Ms Campbell

The family first gained media attention when, for Adolf's 3rd birthday, the couple tried to order a birthday cake from their local Shoprite which said "Happy Birthday Adolf Hitler", but were refused.

They tried again at Walmart, and were successful in getting the cake made.