In federal court, Brett Kavanaugh may have a reputation for knowledge and expertise, but on the basketball court—well, he tries.

He isn’t the best shooter. And he can’t jump very high, according to fellow players and coaches.

“He wasn’t the biggest or most athletic or jumped the highest,” said Christen Dudley, who played pickup ball with Judge...