First teased on E!'s live Oscar countdown, the duo gives us a rousing performance of "Rainbow Connection" at the Hollywood Roosevelt Hotel Sunday, singing in harmony as the Glee star strums away on his guitar.

Criss and Kermit performed together in celebration of the Oscar-nominated song "Man or Muppet" from The Muppets, which (sadly!) won't be performed during the actual Academy Awards.