Gov. Ralph Northam (D) was surprised by the immediacy with which Democrats were ready to toss him out after the racist picture on his yearbook page circulated, and even considered switching his party registration to govern as an independent.

According to a Tuesday Washington Post report, Northam was initially shocked by the intensity of the backlash. He thought his allies would give him the benefit of the doubt and be more hesitant to throw him over.

Numerous top Democrats, including Speaker Pelosi (D-CA), Senate Minority Leader Chuck Schumer (D-NY), and Virginia’s two U.S. senators have called for his resignation. Northam’s consideration of shedding his Democratic party affiliation reveals the depth of his political isolation.