Two hosts of ABC’s The View are out the door: Sherri Shepherd and Jenny McCarthy are not expected to return to the daytime chat show this fall, sources confirm.

Between the duo leaving and Barbara Walters retiring from the show, that leaves only Whoopi Goldberg as presumably the last woman standing. “The View will be moving in an exciting new direction next year and ABC has made decisions to evolve the show creatively,” the network said in a statement. Sources say that “exciting new direction” just might possibly include a male co-host or two (gasp!).

Shepherd joined the talk show as a guest co-host in 2006. McCarthy joined The View last year. Walters will return to the show as a guest host on Friday. The development comes as CBS’ rival The Talk has seen its demos grow with its stable hosting panel.