"What emerged from our work on this particular issue is that there is no clearly defined right or wrong here as to whether to allow or outlaw segregation. It is going to very much depend on the facts of the case."