U.S. Sen. Rand Paul (R-KY) sought to distance himself Thursday from Nevada rancher Cliven Bundy after the latter’s racially charged comments.

“His remarks on race are offensive and I wholeheartedly disagree with him,” Paul told Business Insider in a statement.

Bundy had openly wondered last weekend if black people had been “better off slaves” in comments reported Wednesday by the New York Times.

Paul had offered some support for Bundy’s cause in earlier remarks about the rancher’s standoff with the federal government, criticizing the armed federal presence.

“The federal government shouldn’t violate the law, nor should we have 48 federal agencies carrying weapons and having SWAT teams,” Paul had said.