BRUSSELS—The secretary-general of the North Atlantic Treaty Organization opened a new joint training base in Georgia on Thursday, promising the country could count on its western allies.

But with Georgia outside NATO, and many members reluctant to bring them in, there are serious questions about how far that promise will go and whether a new alliance training base will deter or provoke Russia.

Georgian...