Former United Federation of Teachers Political Director Paul Egan, a political powerbroker whose influence once extended from lower Manhattan to Albany, was let go from his high-flying post Feb. 15 amid jealous accusations hurled by one of his spurned paramours, according to sources with knowledge of the matter.