Stephen Colbert started hosting the Late Show just last year. But there are already rumors that he might be getting replaced by James Corden.

It is possible the comedian will be offered Mr Corden's 12.30am slot which means he could use raunchier jokes - but would probably attract a smaller audience.

Page Six reports these rumors have been floating around since the summer. A TV insider told the website that producers are considering moving the show to Los Angeles for a week as a test.

Scroll down for video.

Rumor has it that James Corden will take Stephen Colbert's spot on the Late Show and Mr Colbert will have a show that airs later where he can use raunchier jokes

James Corden has previously told multiple outlets that the switch isn't going to happen.

But as Conan O'Brien is well aware, late night shows can be fickle. He switched time slots with Jay Leno and went from hosting Late Night with Conan O'Brien to the Tonight Show.

Less than a year later Mr O'Brien was booted off after low ratings and Jay Leno resumed hosting the Tonight Show.

The Late Show's ratings usually fall behind Tonight Show numbers. If the rumor is true, this move may show an effort to appeal to a more web-driven crowd by CBS considering the viral success of Mr Corden.

This is especially the case with his Carpool Karaoke skits which helped him nab the prestigious Grammys hosting gig.

James Corden's show has 8.3 million subscribers and the Late Show With Stephen Colbert's channel has 1.9 million

Mr Corden has done incredibly well online in the past year so he may be able to reach a larger audience.

Mr Corden's Late Late Show, which shares sketches featuring stars such as Madonna and Michelle Obama, has 8.3million subscribers on YouTube and the Late Show has just 1.9million.

Jimmy Fallon, whose ratings usually surpass Mr Colbert's, has also been successful with online video content and has 12.6million YouTube subscribers.

Les Moonves of CBS said at a UBS conference this week, 'We now have Colbert and Corden, both are doing extraordinarily well.

'Colbert had a little bit of a rocky start, but his ratings are going way up, and James Corden has become an Internet sensation.