All MCSR systems share home directories. Home directories are stored on a network-attached storage appliance. It is attached to MCSR systems via Infiniband.
Home directories are subject to a 600GB quota. Temporary excursions to as much as 800GB are tolerated for up to seven days. Quota increases can be requested via email.
Unfortunately, at the moment there is no convenient way to check the status of your quota. We will have a solution in place shortly.
All systems also share a
/scratch area for large temporary files. Each user has their own directory inside the /scratch area. This area is stored on the same device as the home directories. Users should cleanup after themselves in their PBS scripts. This area is NOT backed up, and is subject to being purged as needed. It is subject to a separate 600GB quota.
All nodes have
/tmp directories for temporary files, but they vary greatly in size. Most are backed by hard drives. The exception is Maple’s newer nodes, which are diskless and use a RAM disk for
/tmp. They are very fast, but limited to 12GB.
In the past, all MCSR users had a
/ptmp directory in addition to their home directory for large files. During a 2017 upgrade these directories were combined. Existing users had their ptmp directories copied into their home directory and a symbolic link was setup in
/ptmp so that existing scripts would continue to work. Users created since the upgrade have no trace of a ptmp directory.
Mostly for historical reasons, our default settings allow users to see each other’s files. We have considered changing this in the past and have decided against it. If this is an issue for you, you should change the permissions on your existing files and change your default umask so that new files will be created with stricter permissions. Contact MCSR staff for assistance.