In sense Ino was probably one the best people Madara could get from this just. Most of her justus are mind-affecting ones. Thus it possibly that combing her own family's justu with his own. Even if someone were to fight off Ino's control they could be infected by the Bimbo Vision Justu in the process. So while they are busy did mostly with Ino the other justu starts taking root while they are too busy fighting Ino off