Now, new kid on the block Fallon's ratings are making Letterman's staff shake. In his first week, Fallon's viewership was twice that of Letterman. "The audience will definitely shrink down to a more normal size in a few weeks, especially after the Olympics are over" and the Fallon "Tonight" loses its new show smell, one TV insider says.