Steven Errante was busted Wednesday after cops determined he allegedly had inappropriate contact with the horses on Aug. 25 and Sept. 4 at a stable in his home town of Dix Hills.