"If we don't turn this ship around, the very thing that is driving the exodus from California I think will beset Texas," one housing advocate said.