Scratch file system Notice
On February 2nd (4pm to 10pm) and February 13th (8pm to 11pm) two failures occurred on the HPCC SCRATCH file system. According to our log file, these failures are most likely caused by many small files being generated in a short time period. The scratch file system is not good at handling high frequency I/O operations on large numbers of small files. If your job creates or opens many small files in a short period of time, for example, using the “tar” command to unpack a .tar file, please choose a different file system to run your job. Please refer to the article about choosing file storage and I/O on HPCC: https://wiki.hpcc.msu.edu/display/hpccdocs/HPCC+File+Systems.
For question about using scratch, please contact us at https://contact.icer.msu.edu/contact. (MSU NetID login required)
Publish date: 02/15