My own personal headcanon, is that the mind space steven was in was projecting the thoughts of people. The gems were solely focused on fighting the diamonds mainly because of the fact they're are so powerful and could easily kill them. The diamonds are not really expending that much energy and are still hungover in grief, allowing their minds to be more relaxed by comparison.