Washington (CNN) President Donald Trump has discussed with advisers over the past few days the possibility of replacing Director of National Intelligence Dan Coats, sources familiar with the discussion said.

A senior White House official confirmed there is some discussion about Coats leaving his position, as he has been on the job for more than two years and is eyeing retirement again. However, it remains unclear when or if Trump will make a move.

Trump has expressed frustration in the past with Coats and has periodically considered replacing him, as CNN has reported. His conversations about possibly removing Coats appears to have been revived in recent days, but Trump has long disapproved of some of Coats' conduct.

Another senior White House official said Trump has never really warmed up to his intelligence director, and this official noted discussions between the President and his aides about removing Coats happened well after he contradicted Trump during a hearing on Capitol Hill earlier this year -- an episode that drew the President's ire.

Coats' office referred CNN to a March statement, in which Coats said, "I am focused on doing my job, and it is frustrating to repeatedly be asked to respond to anonymous sources and unsubstantiated, often false rumors that undercut the critical work of the Intelligence Community and its relationship with the President. I am proud to lead an IC singularly focused on the vital mission of providing timely and unbiased intelligence to President Trump, Vice President Pence and the national security team in support of our nation's security."

Read More