projectid)¶

About¶

Important

The purpose of the /disco2fs file system is to give the projects a fast storage location that can store files used by the simulation software for parallel read/write operations. That storage location has a limited capacity (27 TB in total) and its use is limited. Therefore, it is not advisable to use that location as a permanent storage and archive. Only live data created or needed by the simulations can be hosted with it. After the data processing is complete, the piled files must be either deleted or moved to another storage location (let us say, to the personal or per-project storage location, see Personal scratch and storage folder (/discofs/username) and Move and copy files between folders).

Your fast scratch folder is located at /disco2fs/projectid, where projectid is your Discoverer HPC projectid (the account name). Physically, that folder lives on Luster file system, which is able to handle high I/O loads. Your running jobs should be configured to write there their output files.

Warning

You MUST NOT use /disco2fs/projectid as an archive storage folder for data that isn’t being used or processed.

Size/Quota¶

Note

50 GB of per-project disk space (quota) on /disco2fs file system and up to 1300000 files and folders.

Each active project, receives 50 GB of shared disk space (quota) on /disco2fs file system, unless another number is negotiated (which is rare due to the limited total storage capacity of /disco2fs - only 27 TiB). The folder /disco2fs/projectid cannot contain more than 1300000 files and folders and the utilization of the disk space on /disco2fs (on a per-project base) is estimated as the sum of the size of all files on that file system that belong to the primary POSIX group of the project (replace projectid with the name of the POSIX group assigned to the project).

To check the current user disc space utilization on /disco2fs, execute the following command line on the login node (replace projectid with your actual projectid):

lfs quota -g projectid /disco2fs

on Discoverer HPC, the name of the primary POSIX group always coincides with the project ID

The document Calculation of the storage space utilization explains how to interpret the numeric information provided by the quota check.

Data retention policy¶

The files stored in /disco2fs/projectid are retained for 45 days after the project account has been deactivated. Afterwards, they undergo a wipe out. Discoverer HPC reserves the right to modify and augment the aforementioned policy, upon which the user shall be provided with an early warning.

Help¶

If you experience issues with accessing your scratch folder and the content stored there, contact the Discoverer HPC support team (see Getting help).