LOS ANGELES — Stephen Colbert's moving speech during Jon Stewart's final Daily Show was a highlight for viewers, but Colbert told reporters Monday he was convinced Stewart wouldn't stick around once the moment started.

"I thought he was honestly going to leave," Colbert said during a panel for The Late Show with Stephen Colbert at the Television Critics Association press tour.

See also: Comedians say goodbye to Jon Stewart

In fact, Colbert, who was asked by producers to spearhead the sincere moment, initially told producers he was sure his former boss would "flop around like a fish on a dock" the entire time.

That he did.

But eventually it led to the most awesome group hug of all time, featuring all of the show's former correspondents. What viewers didn't realize, though?

They were chanting, too.

"You can't hear it on the recording unfortunately, but we were all chanting 'Made him cry. Made him cry,'" Colbert said. "I think it might be my favorite thing that I've ever done at The Daily Show."

Colbert, meanwhile, is hard at work preparing for his own move. He's set to make his Late Show debut Sept. 8 on CBS.