Washington (CNN) Attorney General Jeff Sessions says he believes the FBI needs a "fresh start" following FBI Deputy Director Andrew McCabe's decision to step down.

"Well, I have believed it was important to have a fresh start at the FBI, and actually, it was in my letter to the President when I recommended (former FBI Director James) Comey's removal. I used the words, 'fresh start,' and the FBI director is Chris Wray, a very talented, smart, capable leader," Sessions told the Washington Examiner on the day McCabe left the bureau. The interview was published on Tuesday.

Sessions also said there has been an "erosion" of public trust in the DOJ, telling the Examiner that the department needs to earn that back "because the heart and soul of the Department of Justice is very good."

A clean slate, he said, "will give them an opportunity to go straight to the American people and say, 'We are gonna win your confidence,'" adding that those within the department "tend to be defensive."

"At this point in time, I think we need to go the extra mile to make sure that everything we do is not political," Sessions added. "Everything we do is based on law and facts. And, whether we like it or not, there's been erosion in some of the confidence of the American people at the FBI and Department of Justice."

Read More