Resident action groups have hit out at the appointment of Sir Martin Moore-Bick to lead the public inquiry into the Grenfell Tower fire.

Calling his appointment “deeply distressing” and “completely inappropriate”, a collective of groups representing the survivors said it was outrageous that residents had not been consulted before the decision was made.

The retired Court of Appeal judge did meet with some residents close to the tower where at least 80 people died.

But Yvette Williams, campaign organiser for Justice4Grenfell, told The Independent that others had not even been made aware of the meeting.

“The only information I got was that a call was made to the church to book a meeting room. We’ve received nothing in writing, some survivors don't even know that meeting was happening,” she said. “I’ve had a survivor call me today, he didn't know anything about the meeting.”

The 70-year-old's appointment has proved controversial after it emerged he once ruled that Westminster council could rehouse a homeless mother-of-five 50 miles away in Milton Keynes.

His 2014 ruling against Titina Nzolameso was eventually overturned by the Supreme Court but her lawyer said at the time the decision "sets a terrible precedent for local authorities to engage in social cleansing of the poor on a mass scale”.

This has raised fears among survivors that a similar thing could happen to them, after the Government backtracked on its promise to rehouse all victims in the same borough of Kensington and Chelsea.

The Department for Communities and Local Government has said it may have to consider neighbouring areas

Ms Williams said residents felt “imposed on” and angry that their request to be consulted on the appointment of the judge had not been considered.

It comes just days after a resident action collective sent a letter to Theresa May demanding that survivors be consulted over the terms of reference of the inquiry and the choice of the chair, the counsel to the inquiry and composition of the advisory panel.

In Pictures: Grenfell Tower after the fire Show all 51 1 /51 In Pictures: Grenfell Tower after the fire In Pictures: Grenfell Tower after the fire Police have released images from inside the tower where at least 58 people have died Metropolitan Police In Pictures: Grenfell Tower after the fire A still from a video shared by polices what appears to be a stationary bicycle sitting among the ashes In Pictures: Grenfell Tower after the fire A still from a video shared by police shows the remnants of a burnt-out bathroom In Pictures: Grenfell Tower after the fire Picture showing the lifts on an unknown floor Metropolitan Police In Pictures: Grenfell Tower after the fire Emergency crews outside the front entrance to the tower Metropolitan Police In Pictures: Grenfell Tower after the fire Fire crews inspecting flats in the burnt out tower London Metropolitan Police In Pictures: Grenfell Tower after the fire Grenfell Tower is seen in the distance PA In Pictures: Grenfell Tower after the fire A drone flies near the scene of the fire which destroyed the Grenfell Tower block REUTERS/Stefan Wermuth In Pictures: Grenfell Tower after the fire 'Theresa May Stay Away' message written on the messages of support at Latymer Community Church for those affected by the fire Ray Tang/REX In Pictures: Grenfell Tower after the fire An aerial view of the area surrounding Grenfall tower Getty In Pictures: Grenfell Tower after the fire Donated shoes sit in the Westway Sports Centre near to the site of the Grenfell Tower fire Getty Images In Pictures: Grenfell Tower after the fire Messages of support for those affected by the massive fire in Grenfell Tower are displayed on a well near the tower in London AP In Pictures: Grenfell Tower after the fire A local resident stands on her balcony by the gutted Grenfell Tower in Latimer Road Getty Images In Pictures: Grenfell Tower after the fire Messages of condolence are left at a relief centre close to the scene of the fire that broke out at Grenfell Tower, EPA In Pictures: Grenfell Tower after the fire A police officer stands by a security cordon outside Latimer Road station Getty Images In Pictures: Grenfell Tower after the fire Firemen examine the scorched facade of the Grenfell Tower in London on a huge ladder AP In Pictures: Grenfell Tower after the fire A search dog is led through the rubble of the Grenfell Tower in London as firefighting continue to damp-down the deadly fire AP In Pictures: Grenfell Tower after the fire Labour leader Jeremy Corbyn comforts a local resident (name not given) at St Clement's Church in west London where volunteers have provided shelter and support for people affected by the fire at Grenfell Tower David Mirzoeff/PA In Pictures: Grenfell Tower after the fire Labour leader Jeremy Corbyn hugs councillor Mushtaq Lasharie as he arrives at St Clement's Church in Latimer Road, where volunteers have provided shelter and support for people affected by the fire at Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire Labour leader Jeremy Corbyn meeting staff and volunteers at St Clementís Church in Latimer Road David Mirzoeff/PA In Pictures: Grenfell Tower after the fire Firefighters with a dog walk around the base of the Grenfell Tower REUTERS/Peter Nicholls In Pictures: Grenfell Tower after the fire Emotions run high as people attend a candle lit vigil outside Notting Hill Methodist Church near the 24 storey residential Grenfell Tower block in Latimer Road, West London Getty Images In Pictures: Grenfell Tower after the fire Debris hangs from the blackened exterior of Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire A woman speaks to Mayor of London Sadiq Khan outside Notting Hill Methodist Church near Grenfell Tower in west London after a fire engulfed the 24-storey building Yui Mok/PA Wire In Pictures: Grenfell Tower after the fire A woman holds a missing person posters near the Grenfell Tower block REUTERS/Stefan Wermuth In Pictures: Grenfell Tower after the fire Sadiq Khan speaking with a resident James Gourley/REX In Pictures: Grenfell Tower after the fire Ken Livingstone walks near the scene of the Grenfell Tower fire Getty Images In Pictures: Grenfell Tower after the fire Mayor of London Sadiq Khan is confronted by Kai Ramos, 7, near Grenfell Tower in west London after a fire engulfed the 24-storey building Yui Mok/PA Wire In Pictures: Grenfell Tower after the fire Mayor of London Sadiq Khan speaks to a woman outside Notting Hill Methodist Church near Grenfell Tower Yui Mok/PA Wire In Pictures: Grenfell Tower after the fire Volunteers distribute aid near Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire Family and friends of missing Jessica Urbano, 12, wearing photographs of Jessica pinned to their t-shirts gather near Grenfell Tower EPA In Pictures: Grenfell Tower after the fire Family and friends of missing Jessica Urbano, 12, wearing photographs of Jessica pinned to their t-shirts gather near Grenfell Tower EPA In Pictures: Grenfell Tower after the fire Family and friends of missing Jessica Urbano, 12, wearing photographs of Jessica pinned to their t-shirts gather near Grenfell Tower EPA In Pictures: Grenfell Tower after the fire People attend a vigil at Notting Hill Methodist Church near Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire People gather to observe a vigil outside St Clement's Church following the blaze at Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire People light candles as they observe a vigil outside St Clement's Church following the blaze at Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire People attend a vigil at Notting Hill Methodist Church near Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire A man distributes food from the back of a van near the scene of the fire which destroyed the Grenfell Tower block REUTERS/Paul Hackett In Pictures: Grenfell Tower after the fire A firefighter is cheered near the scene of the fire which destroyed the Grenfell Tower block REUTERS/Paul Hackett In Pictures: Grenfell Tower after the fire A T-shirt with a written message from the London Fire Brigade hangs from a fence near The Grenfell Tower block REUTERS/Stefan Wermuth In Pictures: Grenfell Tower after the fire A young girl on her way to lay flowers near Grenfell Tower Getty Images In Pictures: Grenfell Tower after the fire The remains of residential tower block Grenfell Tower are seen from Dixon House a nearby tower block Getty In Pictures: Grenfell Tower after the fire Volunteers prepare supplies for people affected by the Grenfell Tower block which was destroyed in a fire REUTERS/Neil Hall In Pictures: Grenfell Tower after the fire Volunteers move a car to make space for a lorry picking up supplies for people affected by the Grenfell Tower block REUTERS/Stefan Wermuth In Pictures: Grenfell Tower after the fire People distribute boxes of food near the scene of the fire which destroyed the Grenfell Tower bloc REUTERS/Paul Hackett In Pictures: Grenfell Tower after the fire A woman touches a missing poster for 12-year-old Jessica Urbano on a tribute wall after laying flowers on the side of Latymer Community Church next to the fire-gutted Grenfell Tower AP In Pictures: Grenfell Tower after the fire A man looks at messages written on a wall near the scene of the fire which destroyed the Grenfell Tower block REUTERS/Paul Hackett In Pictures: Grenfell Tower after the fire Candles and messages of condolence near where the fire broke out at Grenfell Tower EPA In Pictures: Grenfell Tower after the fire Police carry a stretcher towards Grenfell Tower Rick Findler/PA Wire In Pictures: Grenfell Tower after the fire Emergency services at Grenfell Tower Rick Findler/PA Wire In Pictures: Grenfell Tower after the fire Police carry out a body from Grenfell Tower in west London after a fire engulfed the 24-storey building Rick Findler/PA Wire

But Downing Street rejected the request, saying: “We’ve been clear from the outset that we wish the residents to be consulted on the terms of reference of the inquiry. As for the appointment of a judge in a public inquiry, it follows a very specific set of rules. Essentially, the lord chief justice recommends someone to the prime minister, or whoever that inquiry is reporting back to – in this instance it’s the prime minister.”

Ms Williams said residents had been led to believe they would have their say.

She said: “We were led to understand that there would be a consultation around any judge to be appointed so the fact that appointment has gone ahead is not useful.

“They have learnt no lessons from anywhere about community engagement, it's just shoddy, it’s just process, no substance.”

She also claimed survivors had been given no option to be accompanied to the meeting with Sir Martin by legal representatives or support workers, and the meeting had been sprung upon them with little notice.

Grenfell Legal Support, a group advocating for fair legal representation for the survivors of the blaze, said: “A true and fair inquiry would be one where all parties are consulted at every stage of the process.”

Radical Housing Network, a network of housing campaigns from across London, said the Judge’s appointment was “deeply distressing.”

“The appointment of Sir Martin Moore-Pick as the judge in the Grenfell inquiry is deeply distressing. Sir Moore-Pick has a track record of facilitating the social cleansing of London,” the group said.