Sen. Richard Blumenthal wants to investigate the allegations of workplace misconduct against White House Physician Ronny Jackson, who withdrew his nomination to serve as secretary of Veterans Affairs Thursday.

The Connecticut Democrat said Thursday that the inspector general for the Navy, where Jackson serves as a rear admiral, should investigate accusations from 23 current and former colleagues. The charges — detailed by Sen. Jon Tester, D-Mont., the top Democrat on the Veterans Affairs Committee — include drunkenly crashing a car at a Secret Service party and improperly doling out prescriptions.

Reporters asked Blumenthal Thursday whether Jackson could continue as White House physician.

“I think there needs to be a full investigation by these allegations by the inspector general of the Navy,” Blumenthal responded. “They cannot be allowed to fester unaddressed.”

The outcome of the investigation could determine whether Jackson stays on as the doctor to President Trump, who nominated Jackson to serve as VA secretary despite lacking experience overseeing an agency as large as the VA.

Jackson also has been nominated to receive a second star in the Navy. The promotion was going to be in conjunction with him retiring from the Navy to serve at the VA.

But Blumenthal, who serves on the Senate Armed Services Committee that would authorize the promotion, said “we need to know the facts addressing these allegations.”

“I have spoken to colleagues on the Armed Services committee, and they feel some investigative work is necessary before that is necessary,” Blumenthal said, mentioning he has heard from both Democrats and Republicans.

Republicans have been reticent to call for an investigation. House Speaker Paul Ryan said Thursday at his weekly press conference that there should be an investigation only if the allegations were true.

Sen. Jerry Moran, R-Kan., who sits on the Veterans Affairs Committee, was also skeptical of a probe.

“I would assume if these allegations were true there would be reports filed with medical licensing boards,” he told reporters. “I would guess there is a record out there that exists.”

• Kimberly Leonard contributed to this report.