[HPC-NEWS] LEONARDO: new job local storage resource

HPC Cineca portal at hpc.cineca.it
Mon Mar 18 17:44:29 CET 2024


LEONARDO: new job local storage resource management  (https://www.hpc.cineca.it/newsletter/leonardo-new-job-local-storage-resource-management/) 

Dear Users, 

As on the other CINECA clusters, also on LEONARDO a temporary storage area local to nodes is available for the job's execution, accessible via the environment variable  $TMPDIR . 

Differently from the other CINECA clusters, on LEONARDO the temporary area of a job is managed by the slurm job_container/tmpfs plugin, which provides a job-specific, private temporary file system space, with a private instance of /tmp (and /dev/shm) in the job's user space. Such tmpfs are removed at the end of the job (and all data will be lost). Please note that, thanks to this plugin: 

the local storage is considered a "resource" on LEONARDO, and can be explicitly asked on the diskful nodes only (DCGP and serial nodes) via the sbatch directive or srun option "--gres=tmpfs:XX" (for instance --gres=tmpfs=200GB). If not requested, the /tmp has the default dimension of 10 GB 
on the booster ( diskless ) partition the gres/tmpfs cannot be requested, and the /tmp area is created with a fixed quota of 10GB 
the requested amount of gres/tmpfs resource contributes to the consumed budget , changing the number of accounted equivalent core hours, see the dedicated section  (https://wiki.u-gov.it/confluence/display/SCAIUS/UG2.4%3A+Accounting#UG2.4:Accounting-%22Non-exclusive%22nodes:TMPDIRmatters(LEONARDOonly)!) on the Accounting on CINECA clusters. The accounting of this new resource will be active starting from tomorrow. 
For more details, please refer to the Disks and Filesystems  (https://wiki.u-gov.it/confluence/display/SCAIUS/UG3.2%3A+LEONARDO+UserGuide#UG3.2:LEONARDOUserGuide-DisksandFilesystems) section on Leonardo's User Guide. 

Best regards, 

HPC User Support @ CINECA 



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://list.cineca.it/pipermail/hpc-news/attachments/20240318/8ef03e68/attachment.htm>


More information about the Hpc-news mailing list