Choir! Choir! Choir! is a Toronto-based group that offers open participation in public sing-alongs. Last weekend, David Byrne joined the throng for a cover of David Bowie’s “Heroes,” as Stereogum notes. The performance took place at New York’s Public Theater as part of this year’s Under the Radar Festival. Below, watch clips of Byrne and the group’s founders, Daveed Goldman and Nobu Adilman, singing along with the large crowd. In addition, scroll down to watch Byrne and Choir! Choir! Choir!’s take on Madonna’s “Borderline,” via Brooklyn Vegan.

David Byrne’s new album, American Utopia, is out March 9. He recently announced a world tour in support of the record.