On Sunday night Boardwalk Empire will wrap up its five-season run. The following day the latest installment of the show’s soundtrack will hit iTunes, featuring songs by Norah Jones, Elvis Costello, JD McPherson, series favorite Loudon Wainwright III, and Regina Spektor, whose rendition of “Love Me or Leave Me” will appear in the final episode. EW has the exclusive first listen here.

Written by Songwriting Hall of Famers Gus Kahn and Walter Donaldson (who also wrote “Makin’ Whoopee,” among other classics), it’s been recorded by everyone from Bing Crosby to Olivia Newton-John since it was first released in 1928. “We love Regina,” Boardwalk music supervisor Randall Poster writes in an email. “Her second appearance in Boardwalk Empire. While this song plays in the body of the show, it reinforces the happy fact that she would have been a singing sensation in any decade!”