Washington (CNN) Top White House aides are worried FBI Director Christopher Wray could quit if the highly controversial Republican memo alleging the FBI abused its surveillance tools is released, multiple sources with knowledge of the situation tell CNN.

Wray has made clear he is frustrated that President Donald Trump picked him to lead the FBI after he fired FBI Director James Comey in May, yet his advice on the Nunes memo is being disregarded and cast as part of the purported partisan leadership of the FBI, according to a senior law enforcement official.

Wray's stance is "raising hell," one source familiar with the matter said.

Wray has not directly threatened to resign after clashing with Trump over the possible release of the memo, the source added, because that is not his style of dealing with conflict.

The potential release of the memo penned by House Intelligence Chairman Rep. Devin Nunes has set up a standoff with Trump against both the FBI and Department of Justice. Although the President has signaled that he is inclined to release the memo, as part of an effort to undercut the special counsel Robert Mueller's investigation, senior officials inside the White House are trying to come up with a solution that satisfies both the President and law enforcement officials like Wray and Deputy Attorney General Rod Rosenstein.

Read More