The pair did not face one another on a BBC Question Time special, but the audience made sure it wasn't an easy ride.