Many digital currency exchanges and administrators still haven't registered with federal and state authorities and could face financial penalties or even federal criminal charges, the Treasury Department's top official for terrorism and financial intelligence said Tuesday.

However, David S. Cohen, Treasury Under Secretary for Terrorism and Financial Intelligence, stressed that the U.S. government's approach to regulating digital currencies such as bitcoin is driven by a desire to foster innovation and transparency in an industry...