HATAY, Turkey—It didn’t take long for rebel commanders in Syria who lined up to join a Central Intelligence Agency weapons and training program to start scratching their heads.

After the program was launched in mid-2013, CIA officers secretly analyzed cellphone calls and email messages of commanders to make sure they were really in charge of the men they claimed to lead. Commanders were then interviewed, sometimes for days.

Those...