Netflix Inc. has proved itself a competitor to established networks in the world of high-quality television series.

As it moves into feature films with the release of “Beasts of No Nation” on its streaming service and simultaneously in a small number of theaters this past weekend, it showed it is taking a different approach: making the type of movies that studios no longer do.

An...