Brisbane, Australia (CNN) Cardinal George Pell has been freed from prison after Australia's High Court unanimously overturned his conviction on five counts of historical child sex abuse.

The momentous decision, handed down Tuesday by Chief Justice Susan Kiefel, ends a five-year legal battle that started when a man in his 30s approached police alleging Pell had abused him as a child in the mid-1990s.

At the time, Pell was Vatican Treasurer and the highest ranking Catholic official to ever be publicly accused of child sex offenses. Pell strenuously denied the charges, which he dismissed in a 2016 police interview as a "product of fantasy."

In its two-page summary of the ruling, the High Court said that the jury "ought to have entertained a doubt as to the applicant's guilt with respect to each of the offenses for which he was convicted, and ordered that the convictions be quashed and that verdicts of acquittal be entered in their place."

Tuesday's High Court ruling overturns his conviction on one count of sexual penetration of a child and four counts of committing an indecent act with a child. The cardinal'sname will also be removed from Australia's register of child sex offenders.

In a statement released from prison, Pell said he held "no ill will" toward his accuser.

"I do not want my acquittal to add to the hurt and bitterness so many feel; there is certainly hurt and bitterness enough.... The point was whether I had committed these awful crimes, and I did not," the statement said.

Pell was driven out of the gates of Victoria's Barwon Prison, less than three hours after the ruling. He could be seen seated in the back seat of a car, followed by news helicopters overhead.

Pell's accuser said in a statement released Wednesday that he respected the High Court's ruling and accepted the outcome. "I would hate to think that one outcome of this case is that people are discouraged from reporting to the police. I would like to reassure child sex abuse survivors that most people recognise the truth when they hear it. They know the truth when they look it in the face."

Very few people were present in the small Brisbane courtroom when the decision was handed down, a stark contrast from previous hearings when critics and supporters formed long queues to get a seat in the courtroom or spillover rooms specially set up to cope with demand.

With state borders closed and social distancing enforced due to the coronavirus pandemic, it was not possible for many people to travel north from Melbourne, where the trials were held, to Brisbane, a two-hour flight away. One child abuse survivor, who has attended most previous hearings, was refused entry on arrival at Brisbane Airport and flown back to Melbourne as part of pandemic control measures.

Convicted on evidence of one man

The jury's guilty verdict rested on the evidence of one man who testified that Pell had abused him and a fellow choirboy after mass at St. Patrick's Cathedral in Melbourne one Sunday when Pell was Archbishop. At the time, the boys were 13 years old.

The second man didn't tell anyone about the attack and took his own life in 2014 before the allegations surfaced. Neither man can be named due to Australian laws to protect victims of sexual abuse.

The man claimed that Pell cornered them in the priest's sacristy and forced them to perform sex acts. No one witnessed the alleged attack and there was no physical evidence, just one man's word against another's. The alleged victim's testimony has never been released, but the jury found him so convincing they reached an unanimous guilty verdict.

Pell didn't take the stand during his trial, but his lawyer Robert Richter QC told the court the allegations were so implausible that only a "mad man would attempt to rape boys" at such a time and place.

In these days of #Lent, we've been witnessing the persecution that Jesus underwent and how He was judged ferociously, even though He was innocent. Let us #PrayTogether today for all those persons who suffer due to an unjust sentence because of someone had it in for them. — Pope Francis (@Pontifex) April 7, 2020

The Holy See had pledged to conduct its own investigation into Pell once he had exhausted all avenues of appeal. That will no longer be necessary.

Lawyers for the father of the deceased choirboy said their client is "in shock." Lisa Flynn from Shine Lawyers confirmed the man, who cannot be named, is pursuing a civil claim against the cardinal.

Advocates say the decision will deliver a blow to survivors whose faith in the legal system had been restored by the guilty verdict.

The President of the Australian Catholic Bishops Conference, Archbishop Mark Coleridge acknowledged that Tuesday's ruling would be "devastating" for some. "Many have suffered greatly through the process, which has now reached its conclusion," he said in a statement.

He said the ruling doesn't change the church's commitment to a "just and compassionate response to survivors and victims of child sexual abuse."

Pell was granted leave from the Vatican to contest the charges. Last February, after his conviction became public, the Church confirmed that his position as the prefect of its secretariat for the economy -- or Vatican Treasurer -- had not been renewed. And, along with two other cardinals, Pell lost his place on the Pope's small council of advisers in 2018, which the Vatican attributed to his advancing age.

Succession of court cases

The cardinal was convicted in December 2018 after the second of two trials held in secret to avoid prejudicing a third trial, which the Crown Prosecution opted to abandon before it began.

The first trial ended in a hung jury when the 12 jurors failed to reach a verdict after several days of deliberation. The second trial led to a six-year prison sentence that started on March 13, 2019 when Pell was led by police from court to a waiting prison van.

His legal team took his case to the Victoria Court of Appeals, arguing that there were 13 reasons why there should have been reasonable doubt in the minds of jurors when they returned the five guilty verdicts.

Two of three appeals court judges disagreed. In a ruling handed down on August 21, Chief Justice Anne Ferguson and Justice Chris Maxwell said they found the victim to be a "very compelling witness, (he) was clearly not a liar, was not a fantasist and was a witness of truth."

They said it was possible for the jury to have convicted Pell beyond reasonable doubt. However, Justice Mark Weinberg disagreed. In his dissenting statement, he said he thought the witness "was inclined to embellish aspects of his account."

"Having had regard to the whole of the evidence led at trial, and having deliberated long and hard over this matter, I find myself in the position of having a genuine doubt as to (Pell's) guilt," he said. "My doubt is a doubt which the jury ought also to have had."

Pell spent several months in Melbourne Assessment Prison before being moved to the high security Barwon Prison earlier this year, according to local media reports.

He has spent just over one year in prison, reportedly in solitary confinement due to his age, poor health and for his own safety as a then convicted child sex offender.

After Tuesday's High Court ruling, Victoria Police issued a statement saying that is respects the decision and will continue to support complainants involved. "Victoria Police remains committed to investigating sexual assault offenses and providing justice for victims no matter how many years have passed," the statement said.

The Catholic Church has been plagued by claims of sexual abuse carried out by priests and other senior Catholic officials.

In December, Pope Francis abolished Vatican secrecy rules for cases of sexual abuse, effectively allowing the Catholic Church to share documents and information with civil authorities, and allowing victims to be updated of the status of their cases. It followed a historic summit in February 2019, called by the Pope to examine the church's response to claims of child sexual assault.