Alphabet Inc.’s Google is taking action to weed out scam artists who advertise on its platform aiming to defraud customers seeking technical support online.

The move comes after a Wall Street Journal investigation found fraudsters were exploiting Google’s advertising system by purchasing search ads and masquerading as authorized service agents for companies such as Apple Inc.

For...