lightning: Current Storage Situation
Home directories
Currently each user has 1/4 GB in home directory (/home/).
Large short-term storage
For large short-term storage currently more than 4 TB of storage is
available in /ptmp . Issue:
mkdir /ptmp/$user
and use that directory.
Note that /ptmp files are deleted
*) 30 days after they are created or
*) 7 days after last access
whichever is sooner.
Long-term Group storage
Each group has a directory shared by all members of the
group (and only that group). These directories are links
under the directory /work. To find yours, issue the groups
command. The first group listed is your primnary group.
E.g. For user jjc, groups shows ccresearch users.
This means that /work/ccresearch is available on all nodes and
jjc can create files there using the ccresearch group's quota.
group quota for this space is based on the shares for the group
and can be seen using quota -gs.
Temporary local storage
One can use the storage on the disk drive on each of the compute
nodes by reading and writing to $TMPDIR (about 130 GB). This is
temporary storage that can be used only during the execution of
your program. Only processors executing on a node have access to
this disk drive. Since 4 processors share this same storage, you
must include the rank of the executing MPI processes when reading
and writing files to $TMPDIR.
Submitting MPI job
When submitting an MPI job make sure that the executable resides in
one of the shared locations:
/home/ (where is your user name)
/work/ (where is your group name)
/ptmp
All these locations are mounted on each of the compute nodes.