(CNN) Department of Homeland Security Secretary John Kelly was caught on a hot mic Wednesday telling President Donald Trump in jest that he should use a sword on the press.

The quip came during the United States Coast Guard commencement ceremony in New London, Connecticut, where the President delivered the keynote address. The Coast Guard Class of 2017 presented a ceremonial saber to Trump as a "token of our appreciation."

DHS chief caught on hot mic jokingly telling Trump to use his new ceremonial Coast Guard saber on the press https://t.co/pQcjGf4Wtj pic.twitter.com/FuVhABr4z5 — CNN (@CNN) May 17, 2017

Kelly then turned to the President as he sat down and said: "Use that on the press, sir."

The President chuckled and responded: "Yeah, that's right."

During his speech, the President bemoaned his treatment by the press to the graduates.

Read More