Turns out the prefabs for each sector don't need to be just disabled, they needed to be deleted from the scene when you're not working on that particular sector, and added back when you need to align things etc.

Click to expand...