Rep. Adam Kinzinger, R-Ill., said he was surprised at the "hysteria" over President Donald Trump's "fire and fury" rhetoric against North Korea.

"This is how North Korea talks, so why not give it a shot to say, 'You talk about fire and fury, you say you are going to bury the United States in fire and fury? Hey, we got some fire and fury for you, too, if you want to play that game,'" Kinzinger said Wednesday on CNN's "New Day."

The congressman said not engaging in strong remarks against North Korea "led us to where we are today." Because of that, "I don't think the rhetoric is a huge deal."

Accepting that North Korea is now a nuclear power is "defeatism," the congressman said, adding, "This is a place we ought not to be yet."

"Nobody wants to use a military strike, but you have to have a credible strike option, which we do, and we have the capability to do."

He said he knew the U.S. had that option, but it would be a "very bloody" one.

The key to success against North Korea is to urge China to take action, Kinzinger said, although he added, "We sound like we're beating a dead horse." He said sanctions against China could be considered to pressure them to do so.

Host Alisyn Camerota pointed out the opposite sides of the spectrum between Trump's "fire and fury" comments and Secretary of State Rex Tillerson saying that Americans can "sleep well," and have "no concerns" about North Korea.

"I guess I'm in between … I don't think we need to just relax. It's sleep well at night, but understand we also have to continue to engage," the congressman said.

He said that Trump should address the nation on the North Korea issue. "I do think President Trump can do everybody a favor by giving that address, laying out our plans for the future, making people feel safe, but also understanding we have to pay attention to this."

The congressman also commented on North Korea in June, saying that harsher methods must be used to convince China to engage against North Korea. "We tried to do that with a carrot, it's not working. So there's going to have to be a stick."