File Systems

Livermore Computing staff member Ned Bass leads the Lustre DevOps team for LC.

Sequoia’s file system and its Lustre software, collectively called Grove, serve as the first stop for the flood of simulation data coming from the 20-petaFLOP/s Sequoia platform, which ranked as the world’s fastest in 2013. The availability, accessibility, and reliability of Grove’s data are critical to the success of the missions that rely on this world-class computer. To scale file system capabilities to meet the requirements of Sequoia, Livermore Computing’s (LC’s) Lustre Development Team, in conjunction with other LC personnel and third-party developers, engaged in a multi-year project to integrate the Zetabyte File System with Grove’s existing Lustre system, resulting in a simpler, more affordable, higher performance file system for Sequoia—and future advanced technology systems.

LC’s Lustre Development Team develops and supports the primarily Lustre-based high-performance parallel file systems used for LC’s large-scale systems. Lustre is a parallel distributed file system that works particularly well with large-scale cluster computing, the workhorses of parallel computing at the Lab. Lustre is also open-source, enabling LC developers to tailor it to specific systems and the needs of those systems’ users. The team’s work helps ensure efficient, secure, and reliable computation and data storage on an array of platforms. It is also influencing industry standards in file systems.

For more on computer storage and file systems: