Clustered, parallel file systems provide the highest performance and lowest overall cost for access to temporary design data storage in batch processing pools, removing dependency on centralized monolithic NFS.

---

by Michael Ewan. Intel Corp.

This paper discusses recent research and testing of clustered, parallel file systems and object storage technology. Also included is an overview of product announcements from HP, IBM and Panasas in these areas.

The leading data access protocol for batch computing is currently Network File System (NFS), but even with bigger, faster, more expensive Network Attached Storage (NAS) hardware available, batch processing seems to have an insatiable appetite for I/O operations per second. The national labs have seen this NFS bottleneck in their high-performance computing (HPC) clusters and have abandoned NFS in favor of Lustre at Pacific Northwest National Lab (PNNL) and Lawrence Livermore National Lab (LLNL). LLNL and Los Alamos National Lab (LANL) have adopted Panasas hardware-based object storage. This paper details the research and testing of clustered, parallel file systems with applications to batch pool HPC methodologies and discusses object storage technology. It also discusses recent product announcements from HP, IBM, and Panasas in these areas.

During the research, the following file systems were investigated:

• Global File System (GFS) from Sistina (now Red Hat)
• General Parallel Files System (GPFS) from IBM
• iSCSI aggregation from Terascale
• Parallel Virtual File System (PVFS) and PVFS2 from Clemson University
• Lustre from cluster file systems

Out of this investigation, a lab test of PVFS2 and Lustre based on scalability and access criteria was performed. This paper details those selection criteria and test results, plus features of each file system explored.