Decades of beach memories have come flooding back for people in northern Sydney as a push to rebuild the Manly boardwalk and pool gathers momentum.

Built in 1931, the original boardwalk and shark-proof pool extended from the wharf across to the pavilion and aquarium.

But an intense storm in May 1974, known as the Sygna storm, destroyed the promenade and it was never rebuilt.

Ninety-one-year-old Ross from Allambie Heights said he remembered thousands of people packing into the pool in 1935, which included pontoons and tall diving towers.

"It was a magnificent pool — 5,000 people could be swimming in the pool itself," he told ABC Radio Sydney's Breakfast program.

"There was a very big slippery dip down there which was about 30 yards high and I burnt my bum."

And despite the cheeky injury, he's supportive of the move to rebuild the boardwalk.

"They should rebuild it because it's great."

The boardwalk before and after it was destroyed by the Sygna storm in May 1974. ( Supplied: Sue Love )

Talkback caller Russell, who grew up in Chatswood, also recalled spending times enjoying the boardwalk, which didn't always end well.

"This mate of ours that we went to school with was walking along there and dived into the water and the water wasn't deep enough," he said.

"His head was stuck in the mud and his feet were flapping out in the air.

"So [our friend] jumped in and pulled him out and took him to Manly Hospital with a broken neck in a bus, holding him from the seat behind him."

"He turned out OK."

Despite the drama, Russell is also keen on plans to refurbish the precinct.

"Every time I walk past there now I used to think, 'Gee, it's a pity they ripped down that pool'."

Developing the wharf precinct

The Manly boardwalk master plan. ( Supplied: Candy Bingham )

Candy Bingham, the Deputy Mayor of Northern Beaches Council and a long-time Manly resident, is involved with efforts to reinstate the timber boardwalk and recreate a 300-metre harbourside swimming space.

She said the idea had been brewing for several years but received a push after the State Government committed $100,000 to develop a plan.

Aside from attracting tourists to the area, she said the boardwalk would allow young people to have "safe adventure".

"There's nowhere for people to have safe adventure anymore; this is what we'll create here, there will be places for kids to jump safely."

Ms Bingham said the reconstruction would provide a great opportunity for families.

"I used to be a bit of a groupie down at the Manly Harbour Pool and we would spend the whole day there as a family," she said.

"Your rite of passage was to swim out to the first pontoon, and then when you were really brave you went out and jumped off the boardwalk itself.

"We won't be doing this of course, but they also had the Tower of Death, this amazing diving tower. It had three or four platforms."

The Manly pontoon was popular with beachgoers. ( Supplied: Candy Bingham )

The Tower of Death was for the bravest of beachgoers. ( Supplied: Northern Beaches Council )

Protecting the penguins

According to Ms Bingham, the plan includes provisions to protect the location's animals and flora.

"That area is an environmentally sensitive area, and I think recreating the pool will protect the sea grasses," she said.

Diving circles were a popular attraction on the original boardwalk. ( Supplied: Northern Beaches Council )

"Provisions can be made for them, there can be a section of the wharf which won't be netted so penguins can still get access underneath the wharf."

Marine biologist Michelle Blewitt said while she knew the new attraction would be good for Manly as a suburb, the penguin population would have to be carefully managed.

"The little penguins that live under the pier in Manly are the only mainland breeding population anywhere in the world," she said.

"The other breeding populations are located on little islands, so they're very rare."

And while Dr Blewitt believes there is potential for the penguins to continue living underneath the pier, even if the boardwalk goes ahead, she does have concerns about human interaction and rubbish.

"They only come to the mainland between May and February, so it's the peak season for visiting Manly, but more so it is the impact of marine debris.

"As this stage we have the wonderful volunteers that look after the penguins. They'll have a hard job with all those extra visitors to the area."

A spokesperson from the NSW Office of Environment and Heritage said park rangers had worked with council for many years to ensure the long-term survival of the penguins and would continue to work together to investigate ways to avoid any impacts.

Council said the refurbishment would cost around $5 million if it went ahead.