Josh Duggar released a statement on Thursday in which he admitted he had cheated on his wife Anna and had an addiction to pornography

Anna Duggar's Brother Bashes Cheating Husband Josh on Facebook: 'I Won't Stop Trying to Get That Pig out of Our Family'

Anna Duggar’s siblings beg her to leave husband Josh after his shocking double life is revealed. Subscribe now for more on the cheating scandal and the Duggars’ ultra-conservative lifestyle, only in PEOPLE!

One of Anna Duggar‘s brothers, Daniel Keller, is apparently coming to his sister’s defense in the wake of her husband Josh‘s recent admission that he was unfaithful to her and addicted to pornography.

Get push notifications with news, features and more.

“You have to confess and forsake your sin to have mercy. Not sin confess and repeat,” wrote Keller in reference to the quote posted by Jessa, which reads: “If we confess our sins, he is faithful and just to forgive us our sins, and to cleanse us from all unrighteousness.”

“Think for a min about the victims,” continued Keller in response to a reply left on his original comment. “Tell me how you would feel if someone cheated on your sister and brought so much disgrace to you and ur family.”

Addressing another reply on the comment thread, he continued, “Confessing and getting caught are two different things. You want to know what happens when you cover ur sin maybe you should go read ur bible instead of beating people over the head with it.”

Keller also wrote that he is thinking of Anna and “sick to [his] stomach for her for [the] last few days.”

“I have told her I would pay for her to move out here w me and pay for her kidz. I don’t think josh will see that this is a big deal and be truly broken till that happens,” he said, adding that he bet his “life on the fact” that Josh has not come “to true brokenness yet.”

Keller also criticized his parents for encouraging Anna to stay with Josh, writing that they were more interested in how a divorce would make them look than “trying to truly get josh some help and getting Anna and the kids out of there till he has gotten that help.”

In another comment, Keller bashed Josh: “I told her I would go get her and her children stay w me. She said she’s staying where she’s at. But I won’t stop trying to get that pig out of our family.”

“I tell you who I don’t give a s— about is that pig she calls her husband,” he concluded.

Josh’s Thursday confession, in which he called himself “the biggest hypocrite ever,” came three months after news broke that he molested five underage girls as a teenager, including his sisters Jessa and Jill (Duggar) Dillard.

A source with ties to the family told PEOPLE last week that Anna will likely not leave Josh despite his infidelity.

“Divorce is not even something that will be discussed,” the source said.