Oh I get it! The wall itself was infinite, but it was only when Pinkie gave it shape using the Paint Can button and imagined the volume in her mind's eye, she could bring it onto her plane of existence (4th dimension to 3rd dimension) and go around it!