TORONTO — They got the wrong man.

Aaron Judge’s night off Friday got cut short when Yankees elder Brett Gardner found himself thrown out of his team’s game against the Blue Jays in the top of the fourth inning at Rogers Centre, with the Yankees trailing, 3-0.

Gardner grew so enraged by the news that he charged onto the field and had to be restrained by manager Aaron Boone.

Replays of the skirmish, broken down by Twitter video maven @Jomboy, showed the reason behind Gardner’s rage: Home-plate umpire Chris Segal had tossed him for something that his teammate Cameron Maybin said.

After Maybin got called out on a questionable third strike, Boone led the criticism of Segal, asking, “F–k are we doing? C’mon, man!”

Gardner, stealing his own tactic from a memorable game last month at Yankee Stadium, slammed his bat against the top of the visitors’ dugout as he glared … but said nothing.

When Segal called a strike on Toronto pitcher Sean Reid-Foley’s first pitch to Mike Tauchman, which also was low, Maybin yelled, “F—ing terrible, let’s go!”

Segal immediately responded; “Time, out, done!” and signaled someone was out of the game. When Boone inquired who had been ejected, Segal replied: “Gardner. He just told me I’m f—ing terrible.”

A confused Gardner came onto the field and protested: “I didn’t say anything. I didn’t say a word.” Gardner’s rage grew as Segal wouldn’t verify his account of the situation. After giving Boone a good workout, Gardner left the field.

With that, Judge entered in right field for the bottom of the fourth. Tauchman shifted from left field to center field to cover for Gardner, and Maybin switched from right field to left field.