A decade ago, the Linux operating system helped spark a revolution in how software is developed. A move by GlaxoSmithKline PLC could test how well similar open-source principles work for developing new drugs.

The pharmaceutical giant last week opened to the public the designs behind 13,500 chemical compounds that it said may be capable of inhibiting the parasite that causes malaria.

Glaxo...