[FLASH-USERS] hdf5_parallel performance

Brock Palen brockp at umich.edu
Thu Oct 23 10:02:39 EDT 2008


We are doing our firsts tests of using parallel hdf5 for flash2.  The  
backing filesystem is lustre.

Raw performance to lustre from 10 hosts using MPI_File_write() is  
about 650MB/s.

Looks like writing plot files from 40 hosts is only about 40MB/s  no  
matter the stripe count I use.

Our plot files are around 1.5GB.
Is there any insight into tuning?  writing takes 30 seconds which is  
much longer than we would like it to be for such a small file.


Brock Palen
www.umich.edu/~brockp
Center for Advanced Computing
brockp at umich.edu
(734)936-1985






More information about the flash-users mailing list