Ipsy, an online cosmetic brand, was a pioneer in paying social-media stars hefty fees to promote its eye shadow and lip gloss in Instagram posts and YouTube videos.

Now, the brand is leading the way again, this time by pulling back.

Companies will funnel billions of dollars this year to the online personalities, known as influencers, who pitch...