A hotfix was applied to all realms 30 minutes ago that squashed that bug. The buffs obtained from the guards in Dire Maul North after completing a tribute run will no longer stack.

Thank you for your feedback on it!