WASHINGTON—The Obama administration stepped up criticism of China's leadership Monday after pro-democracy protests in Hong Kong over the weekend turned into a major challenge of Beijing's authority over the former British colony.

But with a number of other geopolitical issues at stake, the administration is expected to tread carefully in its diplomatic prodding of Beijing.

White...