Japan’s Olympic minister resigned Wednesday after making remarks deemed offensive to the people affected by the 2011 earthquake and tsunami, a gaffe that prompted some to question his credentials.

Yoshitaka Sakurada said he submitted his resignation to the prime minister, Shinzo Abe. He said he made comments that hurt the feelings those in the disaster-hit areas, and just retracting them would not be enough.

Sakurada, at a party earlier Wednesday for Hinako Takahashi – a ruling lawmaker from Iwate, one of the prefectures severely hit by the disaster – said Takahashi is more important than reconstruction.

Sakurada was in charge of the 2020 Games, whose main theme is to promote reconstruction of the disaster-struck region.

Abe was quickly in damage control. Soon after accepting Sakurada’s resignation, he apologised for the minister’s remark to the people in the disaster-hit region, reassuring them that his government has an unshakable policy to do the utmost for reconstruction while staying close to the feelings of the people affected.

“As prime minister, I offer an apology to everyone in the disaster-hit areas,” Abe said. “I have a responsibility for having appointed him.”

Former Olympic minister Shunichi Suzuki is expected to return to the post to replace Sakrada, Japanese media reports said.

Sakurada joined Abe’s cabinet as part of its reshuffle last year, quickly making a reputation as a gaffe-prone minister.

Sakurada, who also doubled as cybersecurity strategy chief, said in November that he did not use a computer. In February, he was forced to apologise after expressing disappointment over swimming gold medal hopeful Rikako Ikee’s disclosure of her leukemia diagnosis. Sakurada was also scolded for being late and holding up a parliamentary session.

“Minister Sakurada’s resignation is only natural. It was an unbelievable comment that hurt the feelings of the people in the region and others working hard for the reconstruction,” said Yukio Edano, leader of one of the a main opposition parties, the Constitutional Democratic Party of Japan.

Edano also criticised Abe for repeatedly defending Sakurada despite his repeated problems since his appointment.

Sakurada’s resignation is also an embarrassment for Abe, who saw another cabinet member step down over a questionable remark. Deputy minister of land, infrastructure, transport and tourism minister, Ichiro Tsukada, quit last week after suggesting he acted for the interests of Abe and the finance minister, Taro Aso, over a road project related to their constituencies, prompting opposition lawmakers to seek explanation though he denied any preferential treatment.