In 2010, the president of Hobby Lobby spent $1.6 million on thousands of ancient artifacts that he hoped would help build a collection of antiquities related to the Bible.

There was one problem: The items appeared to have been stolen from Iraq, federal authorities alleged, then smuggled into the U.S. from the United Arab Emirates and Israel, bearing labels identifying them as “ceramic tiles” and “Tiles (Sample).”

The...