According to a report this Thursday afternoon from Buzzfeed, Former Congressman Allen West has left his job at Pajamas Media after he got into an altercation with a female staffer, allegedly calling her a “Jewish American princess.”

In a message to staff members, West wrote that he will be leaving his position as director of programming to “get back on the front lines to expand the message of constitutional conservatism across our country.”

Inside sources told Buzzfeed that West had gotten into an argument with a female employee and called her a “Jewish American princess” along with telling her to “shut up.”

In a phone interview with Buzzfeed, West said that he was leaving his job “voluntarily.” However, his statement is in direct contrast to one of Buzzfeed’s sources who said that West had been fired. In the phone interview, West didn’t deny that the confrontation took place, but said that his leaving the position wasn’t tied to any one event.

“No, I didn’t get fired,” West said. “I’m leaving to pursue political aspirations. That’s it. There’ll be a statement that comes out and it’s effective in October.”

When Buzzfeed asked West to specifically address the alleged anti-Semitic remarks, West said simply, “There was an exchange. That’s all.”

West is a controversial conservative figure who joined PJ Media’s Next Generation TV in January, hosting a web show with former Daily Caller reporter Michelle Fields and L.A. radio host John Phillips.