(CNN) Conservatives in the House of Representatives are making a push to hold Attorney General Jeff Sessions in contempt of Congress for failing to hand over documents related to the Russia investigation, but a senior White House official said Monday evening the administration is backing Sessions.

"I think we are supportive of our Cabinet," White House legislative affairs director Marc Short told CNN, though he acknowledged Hill "frustration" with the Justice Department over records.

Short would not say if the Justice Department should hand over the documents but when asked if the House should back off, he added again: "I think we are supportive of our Cabinet."

The fight has sparked concern among Democrats -- and some Republicans -- that Trump allies on Capitol Hill are seeking to interfere with special counsel Robert Mueller's Russia probe, believing a contempt resolution could be used by Trump as a pretext to fire Sessions and install a new attorney general who is not recused from the investigation. Short's comments are a notable contrast from the White House with Trump's extensive, public criticism of the Justice Department and Sessions specifically.

House Speaker Paul Ryan also appears noncommittal so far of the effort by House Intelligence Committee Chairman, Rep. Devin Nunes of California, to hold Sessions in contempt.

Read More