Story highlights "So pleased she is not the President," Chaffetz wrote on Instagram

He has previously pledged to keep going with the probe of Clinton's activities

Washington (CNN) Rep. Jason Chaffetz, chairman of the House Oversight and Government Affairs Committee that has investigated Hillary Clinton's actions as secretary of state, including her private email server, shook hands with the former Democratic presidential nominee Friday.

But on Instagram, the Utah Republican -- Jasoninthehouse -- wasn't nearly as diplomatic.

"So pleased she is not the President," Chaffetz wrote. "The investigation continues."

So pleased she is not the President. I thanked her for her service and wished her luck. The investigation continues. A photo posted by Jason Chaffetz (@jasoninthehouse) on Jan 20, 2017 at 12:31pm PST

He has previously pledged to keep going with the probe of Clinton's activities.

"Just because there was a political election doesn't mean it goes away," he said of the investigation last week, saying that classified emails that surfaced on Clinton's server were "the largest breach of security in the history of the State Department."

Read More