In this video from the DDN User Group at ISC’14, Satoshi Matsuoka from the Tokyo Institute of Technology presents: A Look at Big Data in HPC.

Big Data” was named by some the most annoying buzzword of 2012. I agree with this and react sometimes quite allergic to the use of “Big Data”. If you have a spreadsheet with more than 100 columns, then you have got “Big Data”. If you track your company’s mentioning on Twitter, then you are doing “Big Data”. HPC has been dealing with big data for all of its existence. But it turns out that the recent commercial emphasis on big data, has coincided with a fundamental change in the sciences as well. As scientific instruments and facilities produce large amounts of data in an unprecedented rate, the HPC community is reacting to this, with revisiting architecture, tools, and services to address this growth in data.