The controversy surrounding virtual currencies is prompting enthusiasts to try to bolster their legitimacy and fight perceptions that they attract illicit behavior.

A group of companies that are pushing virtual currencies such as bitcoin are expected on Tuesday to announce they have set up a self-regulatory organization to promote common rules for the fledgling industry.

The...