David Cameron has reportedly moved into a £17m, seven-bedroom townhouse in west London after leaving Downing Street.

The former prime minister, his wife, Samantha Cameron, and three children have moved into the three-storey home owned by PR mogul Sir Alan Parker on one of the most expensive streets in London, according to the London Evening Standard.

The Camerons’ move came as pictures emerged of the former prime minister enjoying coffee and pastries with George Osborne, who was sacked as chancellor on Wednesday night, at a cafe in north Kensington. Accompanied by their wives and children at Lisboa Patisserie, Cameron and Osborne sat outside the front of the cafe with their security detail watching nearby.

The cafe owner, Celia Gomez, 67, said the two men had coffee and pastéis de nata, Portuguese custard tarts. Cameron used to visit the area frequently but never came to the cafe as prime minister, she said.

Gomez wanted to take a photo of Cameron and Osborne but security guards stopped her, she said.

Meanwhile, Theresa May was clearing out the cabinet that they led for the past six years, with very few of Cameron’s ministers remaining in post.

Images of the Holland Park townhouse showed two armed police officers positioned outside on Thursday. Cameron and his family reportedly left the house and headed off on the school run.

Parker, who founded corporate and financial PR giant Brunswick, and his wife, Jane, bought the six-bathroom property in 2014 for £16.5m. Cameron and Parker have holidayed together and the Camerons were invited to the Parkers’ wedding in 2007.

Cameron stepped down on Wednesday after six years as prime minister and 11 years as leader of the Conservative party. May, Britain’s second female prime minister, took up the post after an audience with the Queen. She set about building her government on Wednesday night, bringing Brexiters David Davis, Liam Fox and surprise addition Boris Johnson into the fold.