The entire heritage-listed Crown & Anchor hotel would be demolished leaving only a facade under plans for a 19-storey housing.