It seems the Xoom has a hard time playing high-profile encoded video. Worse yet, it’s a limitation of the Tegra 2 chipset.

Galaxy-S devices like the Galaxy Tab support high-profile encodes via hardware, showing no sign of stuttering. Historically, Samsung has supported high-profile codecs out-of-the-box.

This thread on the official Motorola forums details the whole thing.