Following his nomination to the Supreme Court, Neil Gorsuch was packaged by his wealthy benefactors as the judicial equivalent of a carrot cake: mild and wholesome with the occasional hint of spice. Now that the justice has been safely installed on the court for life, he has revealed himself to be more akin to melted sorbet: sickly sweet and insubstantial with a tangy finish that induces slight nausea. Gorsuch’s abrupt pivot to arrogance has been on full display in his bumptious opinions and questions from the bench. But it also appears to be infecting his interactions with justices behind the scenes. Whispers emerging from the court indicate Gorsuch is more likely to alienate than influence even his conservative colleagues.

The latest sign of trouble comes from NPR’s Nina Totenberg, who dropped in on the indispensable Supreme Court podcast First Mondays to dish some gossip about the newest justice. Totenberg, a renowned court reporter who is friendly with several justices, noted that Gorsuch “ticks off some members of the court—and I don’t think it’s just the liberals.” Without exposing her sources—“you talk to former law clerks, you talk to friends, you talk to some of the justices”—Totenberg then dropped a bombshell:

My surmise, from what I’m hearing, is that Justice [Elena] Kagan really has taken [Gorsuch] on in conference. And that it’s a pretty tough battle and it’s going to get tougher. And she is about as tough as they come, and I am not sure he’s as tough—or dare I say it, maybe not as smart. I always thought he was very smart, but he has a tin ear somehow, and he doesn’t seem to bring anything new to the conversation.

Why is Totenberg’s reporting here so extraordinary? Because it’s astonishing that any reporter would hear details from conference, let alone score some genuinely juicy scuttlebutt. Conference is famously sacrosanct: It’s where the justices gather to cast their votes in the cases of the week, with each explaining his or her reasoning in order of seniority. Nobody else is allowed to attend. If rumors leak about a justice’s behavior in conference—and they basically never do—it is almost certainly a justice who leaked them. And when justices leak—which again, happens very rarely—they do so on purpose. The fact that we know about the “battle” in conference between Gorsuch and Kagan suggests that someone on the court wants us to know.

The substance of the leak is also startling since conference is not intended to foster the kind of arguments that Totenberg described. Sixty years ago, some justices did engage in ferocious debate during conference. But Chief Justice John Roberts, like William Rehnquist before him, prides himself on presiding over civil orderly discussions. By all accounts, Kagan has adhered to this tradition throughout her seven years on the bench. Gorsuch, it seems, has disrupted it. Is he needling Kagan to the point that she explodes? Or is he expounding his opinion so obnoxiously or condescendingly that she feels compelled to speak out?

A clue comes in the form of a recent article by CNN’s Joan Biskupic, another well-connected, widely respected Supreme Court reporter. Biskupic notes that Gorsuch has “shaken relations at the high court,” creating “personal tensions” at a formerly placid workplace. (The justices do get cranky toward the end of each term, and snippy at tense oral arguments, but they typically make up quickly.) In one ambiguously sourced yet tantalizing passage, Biskupic confirms what the rest of us have long suspected—that Gorsuch is irritating his colleagues:

It can be difficult for people outside the marble walls to know truly the relationships among the nine in their private chambers. But word seeps out, through clerks and other staff, through the justices’ friends, and through the justices themselves. Such communications make clear that Gorsuch has generated some ill will among justices. Signs have emerged from the bench, too, as Gorsuch has been on the receiving end of a few retorts.

Kagan is cool-headed and pragmatic, but she does not suffer fools gladly. She does enjoy sparring with Justice Samuel Alito, but Alito is a brilliant intellect with a misanthropic wit. Gorsuch, by comparison, is a Fox News anchor’s idea of a first-rate justice: an insipid ideologue peddling warmed-over dogmas. Kagan just might find him exasperating enough to merit a rebuttal, drawing her into the ongoing “battle” that Totenberg described.

We’ll get a better sense of this burgeoning feud once the justices begin issuing opinions later this term. (The ever-voluble Gorsuch will surely spill much ink detailing his penetrating insights and repudiating those who contradict him.) For now it is safe to say that, in Gorsuch, the justices did not get the deal they were promised. Justice Antonin Scalia could be a grouch, but he developed warm friendships with many of his colleagues, including those to his left. Gorsuch is a pale imitation of his predecessor, boasting a bratty attitude that has nettled justices across the ideological spectrum. He was supposed to build a new conservative consensus. Instead, it seems, his haughty demeanor has given his colleagues something they can agree on.