On Thursday, the Lower East Side rock venue Arlene's Grocery closes its doors—to men.

Its act that night, Bulletproof Stockings, is a Hasidic, all-female band, and while its members follow the rules of Orthodox Judaism—covering their hair, knees and elbows, and only performing for women—it aims to rock, and fill, the room.

"We were hesitant,...