TOKYO—Japan's new prime minister unveiled a cabinet picked to signal a heightened resolve to curb public debt and cleanse his party's scandal-tainted reputation.

Four days after taking the helm of the ruling Democratic Party of Japan, Naoto Kan emphasized the goal of his administration is to pull Japan out of its two decades of malaise by achieving "a strong economy, strong fiscal conditions, and strong social security simultaneously."

"The...