All eRSA HPC accounts have access to 25GB (Burstable to 50GB for a week) of storage in our home area.
We also provide 50GB (Burstable to 100GB for a week) of storage in our data area.
Data stored in our home area is backed up to tape weekly.
The South Australian Sustainable Repository (SASR) is an eResearch SA data management project set up to serve all researchers connected with one of South Australia's three universities. It offers researchers a streamlined approach to managing, storing, and sharing data.
SASR is more of an access mechanism to data, however there is a small pool of storage connected to it. Generally researchers purchase their own data storage and we connect it to the SASR network for easy access.
Details coming!
Details coming!
Yes. We can create unix groups to allow you and your colleagues to share data on the HPC system.
/home - Storage for your program code, submission scripts. This is network-based storage. (25GB / user)
/data - This is a storage area for application input and output files. This is network-based storage. (50GB / user)
/scratch - High performance storage used for storing temporary input and output files while a job is running. This is local node storage.
Reading input or writing output files to /home is strictly prohibited.
For MPI jobs please use /data.
ie /data/users/$USER
(* Note: you can use the linux shell to automagically substitute $USER for your USERNAME, or type it explicitly yourself *)
For sequential jobs please make use of scratch storage. Scratch storage is much faster than network storage, so jobs will complete quicker.
You will the first time need to create a directory for yourself to use in /scratch
ie mkdir -p /scratch/$USER
We currently do not offer a database hosting solution, however, we are able to offer custom solutions. Contact the service desk for details here.
Quotas.
What the heck is a Quota?
A quota is a restriction that is placed on the amount of data an account may use.
A quota consists of a soft/hard quota and a grace period.
A soft quota is a predetermined level where a warning email is sent out. This however does not prevent you writing more data until the grace period is reached.
A grace period is the amount of time you are allowed to go over the soft limit before the system blocks your ability to write more data.
A hard quota is a predetermined level where the system blocks your ability to write more data. You will still however be able to read your data.
Could I have an example of the Quota system?:
Scenario 1 -
I have 20GB of data in my home directory. I copy another 10GB to my home directory.
So I now have 30GB of data which means I'm 5GB over the soft limit. I receive an email stating I have gone over the quota.
A counter is now started on the server which is called the grace period.
I now have 7 days to reduce my data back down below 25GB (the soft limit). However I can still keep my data at 30GB safely for a week.
Scenario 2 -
I have 30GB of data in my home directory and I decide to copy another 25GB. As soon as I reach 50GB of usage on my home directory, the system stops me writing anymore data.
The copy / scp / rsync command would return an error "quota has been exceeded".
Scenario 3 -
I have 30GB of data in my home directory and I forget to reduce the data below 25G. The 7 day grace period then expires.
The 25GB soft limit now becomes a hard limit. I will be unable to write anymore data to my home directory until I reduce my usage below 25GB.