Comments come in wake of government consultancy report suggesting development of part or whole of site to provide land for more homes