WORCESTER, Mass.—This city is shaking off decades of post-industrial rust with help from downtown revival efforts, a restaurant scene and, coming soon, a minor-league baseball team.

There’s one thing Worcester can’t shake: the letter H.

From government to newspapers to visitors, people won’t stop calling New England’s second-largest city...