WASHINGTON—Attorney General Eric Holder said Tuesday the Justice Department has opened a criminal probe of the Internal Revenue Service's treatment of tea-party groups, while an investigative report blamed the agency's managers for allowing the practices to continue for more than 18 months.

On Tuesday night, President Barack Obama termed the audit findings "intolerable and inexcusable" and said he directed Treasury Secretary Jacob Lew to hold those responsible accountable.

...