NSW Labor leader Michael Daley has received a letter threatening defamation action over his explosive interview with broadcaster Alan Jones during which he declared he would sack the Sydney Cricket Ground Trust board.

Standing in front of Sydney's Allianz Stadium on Tuesday, Mr Daley said he had received the letter from one of the 14 members of the SCG Trust board.

Former government architect, Andrew Anderson with Labor leader Michael Daley and his deputy Penny Sharpe outside Allianz Stadium on Tuesday. Credit:Louise Kennerley

"The motivations for that letter aside, I can tell you I will continue to push on to save this stadium," he said, as heavy machinery tore down the Moore Park stadium.

"There are four days to go now until the election ... it's an absolutely ridiculous proposition that we, in caretaker mode and four days until an election, are seeing a government rushing headlong, dripping with arrogance and full of political spite to knock this thing down."