A former soldier charged with harassing and threatening an Army psychologist has been refused bail by a court in Canberra after being extradited from New South Wales.

Kingsley Kraschnefski, 46, was discharged from the Australian Defence Force in 2000 on the advice of three Army psychologists.

Fourteen years later, Kraschnefski allegedly began contacting one of those psychologists, who immediately sought a protection order against him.

It is alleged Kraschnefski continued to harass and threaten the psychologist on a number of occasions, via phone or text message, angry he had been discharged.

One voicemail stated: "You owe me a few years' wages, bitch."

In another, it is alleged he called her a "stinking f***ing c***" and said, "Where ever you hang your shingle, I will get you. I'll go to jail for it, I don't care".

According to court documents Kraschnefski said he would never forget the vow he gave to her, and also referred to having lots of firearms buried in the bush.

Kraschnefski was arrested in Wollongong on Thursday and extradited to the ACT.

He is now facing dozens of charges including using a carriage service to menace or harass, and contravening a protection order.

Representing himself in the ACT Magistrate's Court, he described himself as a "trained sniper" with the Australian Defence Force, who spent 10 years in the Army.

He labelled the allegations as "nothing more than vexatious".

He applied for bail, but was refused by Magistrate Bernadette Boss, on the grounds he was likely to commit further offences.

The matter will return to court later this month.