(CNN) House Speaker Paul Ryan did not rule out Thursday holding Deputy Attorney General Rod Rosenstein in contempt of Congress, saying the House expects "compliance" with its demands for documents from the Justice Department ahead of a Friday deadline.

"We expect compliance," Ryan said if he supported the demand from some House Republicans to hold Rosenstein in contempt.

"I'm still getting daily reports from our committee chairs about the progress on the compliance," Ryan said. "I'm going to regroup with them (Friday) but I expect them to comply with all of our very legitimate document requests because this is the legitimate congressional oversight of the executive branch."

The move comes as House Democrats on Thursday argued that Republicans failed to follow committee procedures for a GOP subpoena over the Justice Department records, charging the subpoena was invalid and Rosenstein could not be held in contempt as a result.

Last week, House Republicans set a Friday deadline for outstanding subpoenaed documents requested by the House Judiciary and Intelligence Committees to be produced to lawmakers.

Read More