Tokyo (CNN) Japan's new emperor, Naruhito, has formally ascended to the Chrysanthemum Throne, replacing his father, Akihito, who had abdicated a day earlier .

The sun came out for a morning ceremony at the Imperial Palace in Tokyo on Wednesday, as Naruhito became the 126th Emperor of Japan, the latest in an unbroken line that stretches back 14 centuries.

During the special ritual in the palace's Matsu-no-Ma state room, an almost exclusively male audience saw Naruhito, 59, take possession of royal regalia and seals, including a sacred sword, that provide ceremonial proof of his ascension.

Japan's new Emperor Naruhito receives the Imperial regalia of sword and jewel as proof of succession at the ceremony at Imperial Palace in Tokyo, Wednesday, May 1, 2019. Standing at left is Crown Prince Akishino.

Only adult male imperial family members were allowed to attend the centuries-old ceremony, but Japan's lone female cabinet member, Satsuki Katayama, was in attendance.

Tuesday's abdication was the first in more than 200 years, since Emperor Kokaku stepped down in 1817.

First words as new emperor

The new emperor held the first audience with his government following the ceremony, using his first remarks to acknowledge the assumption of the role as an "important responsibility," and paying tribute to his father's legacy.

"I would like to express my heartfelt respect and appreciation of the comportment shown by His Majesty the Emperor Emeritus as the symbol of the state and of the unity of the people of Japan," he said.

"I also swear that I will act according to the Constitution and fulfill my responsibility as the symbol of the state and of the unity of the people of Japan.

Emperor Naruhito stands with his wife, Empress Masako at a ceremony in the State Hall of Tokyo's Imperial Palace.

"I sincerely pray for the happiness of the people and the further development of the nation as well as the peace of the world."

Japan's Prime Minister Shinzo Abe congratulated Naruhito and also pointed to Akihito's role in transforming the role.

"Emperor, we are looking up to you as a symbol of Japan and the Japanese people, and we are filled with hope for peace and prosperity, a bright future of Japan. Everybody is uniting together in heart and building up our new culture in the future."

Photos: In pictures: Japan's Naruhito ascends to the throne Japan's new Emperor Naruhito, right, attends his coronation ceremony at the Imperial Palace in Tokyo on Wednesday, May 1. Standing at left is his brother, Crown Prince Akishino. Hide Caption 1 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito is followed by his wife, Masako, as he walks to make his first address as Emperor. Hide Caption 2 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito delivers his first speech after his ascension to the throne. In his remarks, he acknowledged the assumption of his role as an "important responsibility," and he paid tribute to his father's legacy. Hide Caption 3 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito, standing on a dais, inherits the imperial regalia. Hide Caption 4 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne People take pictures as the royal family leaves the Imperial Palace. Hide Caption 5 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne People at Tokyo's Meiji Shrine receive sake as they celebrate the change of an era. Hide Caption 6 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito's motorcade leaves the Imperial Palace after his imperial rituals. Hide Caption 7 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Japanese Prime Minister Shinzo Abe and his wife, Akie, bow as they arrive for Naruhito's ascension ceremony. Hide Caption 8 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne People bow toward the Imperial Palace in Tokyo as they wait for the new emperor to ascend to the throne. Hide Caption 9 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Sumo wrestlers create the characters for "Reiwa," Japan's new imperial era, at a Tokyo sports arena. Hide Caption 10 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito's motorcade drives past crowds of well-wishers. Hide Caption 11 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito's wife, Masako, arrives at the Imperial Palace. Hide Caption 12 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Stamps are postmarked on the first day of the Reiwa era. Hide Caption 13 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Shinto priests recite religious passages before entering the Meiji Shrine's main building for a ceremony on Wednesday. The ceremony reported the new emperor's enthronement to the royal family's ancestors. Hide Caption 14 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne People gather to see the new Emperor leaving the Imperial Palace. Hide Caption 15 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne A girl holds calligraphy reading "Reiwa," the name of the new imperial era. Hide Caption 16 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne People gather to see the new Emperor and take photos. Hide Caption 17 of 18 Photos: In pictures: Japan's Naruhito ascends to the throne Naruhito waves to well-wishers. Hide Caption 18 of 18

New era begins

Naruhito's ascension signals the start of the "Reiwa" era -- each emperor's reign is marked by their era name. Naruhito's era name was adapted from an 8th century anthology of classic poetry.

While the official government translation of "Reiwa" is "beautiful harmony," it can also be interpreted as "commanded peace," a more authoritarian reading.

"It is his reign name to shape through his actions and gestures," says Jeffrey Kingston, director of Asian Studies at Temple University in Japan.

He says that Naruhito's challenge in defining his era will be to avoid getting "co-opted by Japan's right-leaning politicians."

Symbolic role

The role of Japan's emperor has changed significantly since Naruhito's grandfather, Emperor Hirohito, sat on the throne. Once considered the living embodiment of gods, the emperor has become a largely symbolic figure.

Unlike other monarchs, Naruhito is a symbol of the state rather than the head of state, and the Japanese emperor wields no political power.

Much like his father, who was seen as a reformist, Naruhito sees the role as an institution rather than an embodiment of divinity, says Andrew Gordon, a leading scholar of modern Japanese history at Harvard University.

Naruhito has indicated that he will continue the outreach and unifying role that his father played.

"There's nothing in the Constitution that says you have to go around cutting ribbons ... that's a role (Akihito) defined for himself," Gordon said.

"I think his son will continue in the mode of his father; he's said publicly that he was watching and learning from his father," he said. "I think the basic style of the monarchy and the (role of the) monarch that he's put in place, I expect will continue."