Washington (CNN) Top Secret Service officials are out of their jobs following months of scandal at the law enforcement agency, sources said on Wednesday.

Four senior officials -- responsible for investigations, technology, protections and public affairs -- are being asked to leave their posts, though they could still technically stay with the Secret Service, a person at the agency said.

The four officials identified by the source: Dale Pupillo, Jane Murphy, Paul Morrissey, and Mark Copanzzi.

A fifth official, assistant director Vic Erevia, is retiring, though the agency said his retirement is unrelated to the problems the Secret Service has been facing.