A German price-comparison portal has become the first major company to sue Alphabet Inc.’s Google while invoking a 2017 European antitrust decision to fine the U.S. technology giant for abusing its dominant position in the search-engine market.

If it succeeds, the litigation could spark similar actions in Europe by other tech firms that have hesitated to take on the Silicon Valley company.

In...