I/O performance exceeds one terabyte per second

DataDirect Networks says that Japan’s highest performance supercomputer has achieved effective I/O performance exceeding 1 TB per second using DDN’s Infinite Memory Engine (IME®) to deliver an ultra-high speed file cache system.

  • 8 years ago Posted in
“Storage performance has been one of the biggest challenges in developing supercomputers. To meet the demands for storage performance, IME was introduced to the Oakforest-PACS on a massive scale, the first such introduction in the world,” said Osamu Tatebe, lead, public relations, JCAHPC / professor, Center for Computational Sciences, University of Tsukuba. “We are very pleased that we could achieve effective I/O performance exceeding 1 TB per second in writing tens of thousands of processes to the same file. With this new storage technology, we believe that we will be able to contribute to society with the further development of computational science, big data analysis and machine learning.”
The Oakforest-PACS massively parallel supercomputer is operated by the Joint Center for Advanced High Performance Computing (JCAHPC), which is run collaboratively by the Information Technology Center at the University of Tokyo and the Center for Computational Sciences at the University of Tsukuba. With resources for joint use, Oakforest-PACS will dramatically advance research and development in a variety of next-generation science and technology fields. It will be used for cutting-edge computational science research, as well as to develop talent in the computational science and high performance computing fields, contributing to the future development of each field.
To measure effective I/O performance, DDN used IOR, the I/O throughput benchmark published by Livermore Computing Center of Lawrence Livermore National Laboratory, and achieved more than 1 TB per second in both I/O access patterns: FPP (File Per Process where parallel processes perform independent file I/O respectively) and SSF (Single Shared File where all parallel processes perform I/O to a single shared file). Importantly, SSF is an access method that cannot realize sufficient performance with a conventional parallel file system, but is considered an effective access method for the next generation of Exascale supercomputers. With its marks for effective performance across FPP and SSF I/O access patterns, DDN IME has proven its eminence as an I/O system not only for conventional I/O processing, but also for future Exascale supercomputing.
ATTO Technology has published the findings of an independent survey of IT decision-makers from...
NetApp extends its collaboration to accelerate Ducati Corse’s digital transformation and deliver...
Delivering on the promise of SSDs that address future enterprise infrastructure requirements KIOXIA...
FlashBlade at Equinix with Azure for EDA: industry first validated solution to leverage...
Infinidat says that Richard Bradbury has been appointed SVP, EMEA & APJ. Leveraging his extensive...
New storage automation and delivery platform and cloud native Database-as-a-Service offering bring...
Leveraging its strength and leadership in flash, Western Digital has launched the new WD Red SN700...
Nutanix has added new capabilities to the Nutanix® Cloud Platform that make it easier for...