Despite declining ratings, “The Tonight Show” host Jimmy Fallon says viewers shouldn’t expect him to get overtly political because “people that voted for Trump watch my show as well.”

Fallon has been criticized for an interview he had with Donald Trump back in September, which some viewers say was too pleasant with the future president. He concluded the segment by messing up Trump’s infamous hairdo.

“They have a right to be mad,” Fallon said of the backlash. “If I let anyone down, it hurt my feelings that they didn’t like it. I got it.”

“I’m a people pleaser,” he told The New York Times. “If there’s one bad thing on Twitter about me, it will make me upset. So, after this happened, I was devastated. I didn’t mean anything by it. I was just trying to have fun.”

However, Fallon says the backlash and falling ratings haven’t inspired him to change his show to make it more left-leaning. This is despite the success of his competitor Stephen Colbert, who recently came under fire for a blowjob joke about Trump but has had more overall nightly viewers than Fallon.

“I don’t want to be bullied into not being me, and not doing what I think is funny,” Fallon said determinedly. “Just because some people bash me on Twitter, it’s not going to change my humor or my show.”

Fallon isn’t averse to making fun of Trump, but said he doesn’t want all of his material to be about the president.

“I tossed and turned for a couple of weeks, but I have to make people laugh,” he said. “People that voted for Trump watch my show as well.”

Follow Amber on Twitter