Arts and crafts chain Hobby Lobby will return thousands of illegally purchased Iraqi antiquities to Baghdad on Wednesday, according to U.S. Immigration and Customs Enforcement.

The Oklahoma-based retailer will return 3,800 of the more than 5,500 ancient artifacts that it purchased in 2010 for $1.6 million, NPR reports.

Hobby Lobby bought the artifacts despite being warned by an “expert on cultural property law” that the objects could have been looted from Iraqi archaeological sites, making their purchase a violation of federal law, according to a July 2017 statement from the U.S. Justice Department.

“The acquisition of the Artifacts was fraught with red flags,” the statement said.

The objects, which included cuneiform tablets, cylinder seals and clay bullae, were shipped out of Iraq via the United Arab Emirates and Israel falsely labeled as tile “samples.”

Last year, Hobby Lobby agreed to pay a $3 million fine to settle a civil lawsuit from the Justice Department over the acquisition.

“We should have exercised more oversight and carefully questioned how the acquisitions were handled,” the company’s President Steve Green in a statement last July.

Hobby Lobby made headlines in 2014 over a landmark challenge to President Obama’s Affordable Care Act, in which the Supreme Court ruled that requiring employers to cover employees’ contraception violated religious freedom protections. The company also helped fund a $500 million museum in Washington, D.C. The Museum of the Bible received $201 million worth of artifacts from Hobby Lobby and the Green family’s large collection of Christian pieces, the Washington Post reported.

Get The Brief. Sign up to receive the top stories you need to know right now. Please enter a valid email address. Sign Up Now Check the box if you do not wish to receive promotional offers via email from TIME. You can unsubscribe at any time. By signing up you are agreeing to our Terms of Use and Privacy Policy . This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply. Thank you! For your security, we've sent a confirmation email to the address you entered. Click the link to confirm your subscription and begin receiving our newsletters. If you don't get the confirmation within 10 minutes, please check your spam folder.

Write to Eli Meixler at eli.meixler@time.com.