BERLIN—A scandal over the handling of asylum requests is threatening to destabilize German Chancellor Angela Merkel’s fractious coalition and trigger a parliamentary inquiry into her open-arms migration policy.

A criminal investigation into alleged corruption at Germany’s migration agency has uncovered serious flaws in the processing of asylum claims going back several years, law-enforcement officials said.

The...