You could also use regular hook-and-loop tape, but these won't leave residue on or damage your walls. From Laura's Crafty Life.

Get four sets of strips on Amazon for $3.44.