
|
Sponsored by the IEEE Mass Storage Systems
Technical Committee |
|
MSST 2012 Speaker
Kent Koeninger, Veritomyx, Inc. |
|
Applying Immortal Cloud File System Techniques to HPC Petascale File Systems
Can 21st century cloud and social-media file-replication techniques work for data protection in ultra-fast HPC petascale file systems? Such file systems have come a long way this decade, but usually they remain fragile and hard to manage, dependent on complex dual-controller fail-over/fail-back mechanisms and fragile RAID parity. The goal is an immortal file system (many nines) that scales gracefully with petascale growth, that is self healing (through file replication), and that meets the demanding write speeds of HPC file systems: It's a hard nut to crack. In this talk, I propose exploring file replication—or at least distributed parity—as a solution. I will touch on the traditional performance barriers in a file-replication approach and suggest a configuration that might clear those barriers.
Kent Koeninger is CEO of Veritomyx, Inc., a subsidiary of Target Discovery, Inc. Veritomyx uses computationally intensive computers for high-accuracy protein identification by simulating mass spectrometers. Kent has three decades of experience deploying, designing, and marketing HPC technology and products at NASA, Apple, Cray, and HP. He was the product markeing manager for the Lustre-based HP SFS product at HP and and a champion of using the Ibrix file-replication filesystem in appropriate HPC applications. |
|