The U.S. Department of Transportation has pulled out of the group leading the $23.9 billion Gateway Program that includes digging a new rail tunnel under the Hudson River.

In a letter sent to the Gateway Program Development Corporation board on Friday and obtained by The Wall Street Journal, the transportation department’s acting general counsel said the federal government will “permanently withdraw” from the board.

“It...