WASHINGTON—The Trump administration is likely to end public access to a web portal used by hundreds of thousands of consumers each year to file complaints against financial companies.

The Consumer Financial Protection Bureau’s acting director, Mick Mulvaney, on Tuesday addressed his intention to eliminate public access to the complaint database, saying it contains information that hasn’t been fully vetted by the government.

“I...