Story highlights FBI Director James Comey spoke to a roundtable of reporters on Wednesday

Comey said he didn't say "security inquiry" in reference to the probe into Hillary Clinton's use of a private email server

Washington (CNN) FBI Director James Comey stayed tight-lipped about the investigation into Hillary Clinton's private server and reiterated to reporters during a roundtable Wednesday that there is no external deadline to finish the probe, despite the upcoming Democratic convention in July.

However, Comey admitted he does feels "pressure" like he does with any high-profile case to do the investigation both promptly and well -- with an emphasis on "well."

Clinton and her team have consistently called the matter a "security inquiry," but Comey said that's not a term he's familiar with and said "we're conducting an investigation. That's what we do."

Asked about complaints from security clearance holders that they would be in jail if they acted similarly to Clinton, the FBI director would only say "there's no special set of rules for anybody that the FBI investigates."

Comey also said ISIS is losing its luster in the United States. adding, "the ISIL brand has lost significant power" and cited a decrease in the number of foreign fighters traveling or attempting to travel to Syria to fight with the terrorist group.

Read More