(CNN) The Senate is still reeling from a combative exchange between the House impeachment managers and the President's defense team that triggered a rebuke from Chief Justice John Roberts and highlighted rising tensions at the impeachment trial.

Roberts, who is presiding over the trial, called for decorum in the early hours of Wednesday, saying, "It is appropriate for me to admonish both the House managers and the President's counsel in equal terms," after listening to the managers and the defense team tear into each other. In heated rhetoric, House Judiciary Chairman Jerry Nadler of New York, one of the Democratic impeachment managers, had said, "I see a lot of senators voting for a cover-up," while White House counsel Pat Cipollone fired back, "The only one who should be embarrassed, Mr. Nadler, is you."

Senators on both sides of the aisle said on Wednesday that it was appropriate for the chief justice to deliver the admonishment, but a number of Republican senators are bristling over the cutting commentary from Nadler.

"You don't come into the Senate and accuse senators of engaging in a cover-up or saying that we're on trial. No, we're not," Sen. Ron Johnson said, adding that the comments were "jaw-dropping, couldn't really believe what we were hearing."

The Wisconsin Republican called the admonishment "completely appropriate," adding, "I think we all realize he was admonishing the House Democrats, but, again, trying to keep it nonpartisan."

Read More