Astrophysicist Neil deGrasse Tyson is holding off on commenting on President Donald Trump’s administration. At least, for now.

On Tuesday, the scientist told “Late Show” host Stephen Colbert that “lately people are just talking” about the government’s scientific policies and that he couldn’t “chase what people say because it flutters with the breeze.”

“I will act when they actually try to put legislation into place,” he told Colbert. ”If he puts down some legislation that requires that everyone think that, ooof, hold me back, oh, because then…”

Check out the full interview above.