In this photo illustration, a container of Johnson's baby powder made by Johnson and Johnson sits on a table on July 13, 2018 in San Francisco, California.

Walmart, CVS Health and Rite Aid are pulling all containers of Johnson & Johnson's 22-ounce baby powder after the FDA found sub-trace amounts of asbestos, the companies confirmed Thursday.

"CVS Pharmacy is complying with Johnson & Johnson's voluntary recall of Johnson's Baby Powder 22 oz. and is removing this product from all stores and from CVS.com," spokesman Mike DeAngelis said in a statement to CNBC. "We also initiated a 'Do Not Sell' register prompt in our stores to prevent the sale of this item during the product removal process."

The company is also warning customers who purchased the product from CVS locations to discontinue use and return the item for a refund.

Walmart, the world's largest retailer, said it removed and blocked all of the recalled baby powder, as did Rite Aid.

"Rite Aid informed all stores to pull all product from shelves and store it in a secure location. Additionally, we've applied a point of sale system block for this product to prevent it from being sold," Rite Aid said in an emailed statement.

Last week, J&J voluntarily recalled an estimated 33,000 bottle of its 22-ounce baby powder. It's working with investigators to determine the integrity of the test sample and the validity of the test results, the company said in a press release.

CVS, which has more than 9,900 locations nationwide, said it began removing the bottle as of last Friday after the J&J recall announcement.

— CNBC's Angelica LaVito contributed to this report.