Stanford EE Computer Systems Colloquium



4:30 PM, Wednesday, Dec 6, 2017

NEC Auditorium, Gates Computer Science Building Room B3

http://ee380.stanford.edu

Petascale Deep Learning on a Single Chip

Tapabrata Ghosh

Vathys

Vathys.ai is a deep learning startup that has been developing a new deep learning processor architecture with the goal of massively improved energy efficiency and performance. The architecture is also designed to be highly scalable, amenable to next generation DL models. Although deep learning processors appear to be the "hot topic" of the day in computer architecture, the majority (we argue all) of such designs incorrectly identify the bottleneck as computation and thus neglect the true culprits in inefficiency; data movement and miscellaneous control flow processor overheads. This talk will cover many of the architectural strategies that the Vathys processor uses to reduce data movement and improve efficiency. The talk will also cover some circuit level innovations and will include a quantitative and qualitative comparison to many DL processor designs, including the Google TPU, demonstrating numerical evidence for massive improvements compared to the TPU and other such processors.

Slides:

Download the slides for this presentation in PDF or PPTX format: [PDF] [PPTX]

Videos:

Join the live presentation. Wednesday 4:30-5:45. Requires Microsoft Windows Media player.

View the Stanford Archive Lectures

View video by lecture sequence in HTML5. Available after 8PM Pacific on the day of the lecture.

View Video on YouTube. The YouTube video is uploaded the day following the presentation. You may need to disable your pop-up blocker for this link to work. Or use the direct YouTube link , which will be active a day or so after presentation.

About the speaker:

Tapabrata ("Tapa") Ghosh is the co-founder and CEO of Vathys.ai where he develops the core architecture of the Vathys deep learning processor. When he was a teenager, he developed a quadcopter drone with the intention of utilizing deep learning to make collision free drones, at the time a novel proposition. In attempting to do so, he experienced firsthand the computational requirements of deep learning in the real world. The experience led him to found Vathys with the goal of developing performant and power efficient deep learning processors. He also has multiple patents and papers related to the fields of deep learning, computer architecture and semiconductors.

Contact information:

Tapabrata Ghosh

Email: tapabrata_ghosh (at) vathys.ai

Email: tapabrata_ghosh (at) ingemini.com

