ALPINE, Utah -- Congressman Jason Chaffetz has announced he will leave office, effective June 30.

"I kinda had a little bit of a midlife crisis," he told reporters in his home on Thursday. "I turned 50, I’m sleeping on a cot, I spent more than 1,500 nights on a cot. I just happened to love my wife and adore my kids and being away is hard. It’s just really, really hard."

Chaffetz said he travels a lot and the thought of another 200 to 300 days on that cot in his office, and missing more family events is too much.

"As you kind of go forward and you see your kids graduate, get married, that’s hard," he said, choking back tears.

Chaffetz said that's why he sent a letter to Governor Gary Herbert on Thursday, announcing his resignation date.

"It also fulfills this promise I made, which is get in, serve and get out," he said.

As chairman of the powerful House Oversight Committee, Chaffetz has said he is proud of some of the inquiries that took place including Benghazi, Fast & Furious, the IRS and Hillary Clinton's emails. Asked if he leaves office with regrets, Chaffetz told FOX 13 he believes more needs to be done on the Clinton emails.

"I think the Clinton email investigation is still not complete and is of such importance to the nation," he said.

Watch Congressman Chaffetz's news conference here:

Chaffetz is leaving as investigations into President Trump heat up. Recently, he said he wanted to hold a hearing on the firing of FBI Director James Comey. On Wednesday, Chaffetz said investigations will continue without him.

"I’m not staying for any one particular investigation. We’ve completed a lot of investigations, too. There’s always something going on," he said. "There’s always a laundry list of literally hundreds of types of investigations going on."

Chaffetz held a news conference with reporters in his living room. He's home recovering from foot surgery. His wife, Julie, was next to him and their dog, Ruby, was in his lap as he spoke about his decision to resign. Chaffetz refused to discuss what he planned to do next, declining to talk about a rumored gig at FOX News Channel. He also said he would not endorse anyone to replace him in congress.

Governor Gary Herbert said Thursday he would hold a special election.

"By constitution, this is an election. This is not an appointment. Utah voters must have access to the ballot if it's going to be an election," the governor told reporters at his monthly news conference on KUED.

The governor is feuding with the legislature over the special election. Lawmakers insist they should be called into special session to decide the process. The governor claims the process was defined by past legislatures and there's no need for a special session.

"We remind the executive branch that the times, places and manner of our elections are clearly a legislative responsibility, defined in Article 1, Section 4 of the U.S. Constitution," Senate President Wayne Niederhauser, R-Sandy, said in a statement. "The path forward with the least amount of legal risk would be for the governor to call a special session to allow lawmakers to add appropriate election language to the state code."

The governor said the authority rests with him.

"I believe my responsibility is to see if we have a need for a special election, that it's conducted in a manner that meets the law, the constitution and the statutes, and it's a manner that meets the expectations particularly of the voters in the third congressional district," he said.

Read the letter Congressman Chaffetz wrote to constituents: