As he returned to the White House five hours later, aides refused to say whom the President met with, or if he spent any time hitting the links.