User Guidelines
The following policies, guidelines and best practices for effective usage of Param Shakti (henceforth denoted by PS) have been passed by the HPC Advisory Committee. These policies are subjected to revision/modification as and when necessary. Users of PS are expected to abide by the same.
Param Shakti Usage Policy and Guidelines
- Users are required to acknowledge the use of PS in all publications, presentations, thesis,
webpages, etc by including the following or similar statement:
“We acknowledge National Supercomputing Mission (NSM) for providing computing resources of ‘PARAM Shakti’ at IIT Kharagpur, which is implemented by C-DAC and supported by the Ministry of Electronics and Information Technology (MeitY) and Department of Science and Technology (DST), Government of India.”
Users are also requested to inform the PS administration on any such outcome for annual reports/documentation/uploading on website, etc. - All the announcements about PS will be made in the relevant local newsgroups and/or through the website (www.hpc.iitkgp.ac.in). Users are encouraged to go through such announcements regularly.
- PS resources are to be used for academic research purpose only.
- Project Guide/Adviser must have a user account on PS before requesting user accounts for his/her group members.
- Users should not share the password with anybody else. Using the same account by multiple users is not allowed. Users should monitor their usage of PS, for the purpose of detecting unauthorized use and accounting.
- Users must not engage in hacking, reverse-engineering or other activities that may constitute infringement of intellectual property rights of others. Users should not engage in activities that may be disparaging to or bring disrepute to the facility and the Institute.
- Users should ensure that the software, tools, libraries, and the material used or deployed by themselves comply with all the license terms and conditions. PS administration is not responsible for unauthorized licenses and usage.
- All jobs must be submitted using the Slurm scheduler. Login nodes are meant for simple tasks only – all CPU and/or memory intensive tasks must be run on the compute nodes. Running jobs on login nodes is strictly prohibited. In such instances, the user account will be deactivated immediately.
- Temporary scratch storage space is provided to all users according to the allocated disk quota. Scratch directories are subjected to automatic deletion without notice, when their time limit expires. Currently, scratch directories/files have a default time limit of 30 days. Data can be held in this temporary storage at your own risk.
- Each user will have a default disk quota up to 50 GB in his/her home space and up to 2TB (soft limit) in the Scratch space.
- User is the owner and hence responsible for all data copied and generated using PS, and PS administration is not responsible for the same. Users should ensure the required backup and protection of the data. PS administration is not responsible for compromising accounts, data theft, data publications, data claims, etc.
- Users’ data stored on scratch directory on PS is not backed up or archived by the system administration. The PS administration is also not responsible for restoring damaged or lost files for users. Backing up and archiving data is the responsibility of the user and his/her Project Guide/Adviser.
- Accounts Inactive: Accounts (except for faculty) that are not active for more than 90 days will be temporarily locked. For unlocking the account before 180 days, the user should send a request to the PS administration.
- Accounts Expired or Not Renewed: The account will be locked and, after 90 days, the user account along with its data will be deleted. PS administration will not be responsible for any data loss after the account deletion.
- Although PS administration will take utmost care in maintaining the resources, there are no guarantees that resources or services will be available at all times, that they will suit every purpose, or that data will never be lost or corrupted. System administration cannot be held responsible for the loss of the data in such events.
- Access to PS may be unavailable at some times due to scheduled maintenance, upgrades, etc. Access to PS may be unavailable without notification if hardware, software or other issues necessitate immediate maintenance for correction. Notification of all scheduled and unscheduled maintenance will be updated in the website (www.hpc.iitkgp.ac.in) or in the relevant local newsgroups.
- Faculty/Advisor are required to inform PS administration about the removal of user account of any student leaving the campus permanently.
- Any unauthorized usage of PS will have their accounts immediately suspended and may be subjected to appropriate disciplinary action as decided by the competent authority of the Institute.
Best Practices for HPC
- Do NOT run any job which is longer than few minutes on the login nodes. Login node is for compilation of job. It is best to run the job on computes (compute nodes).
- It is recommended to refer the quick start guide on the Paramshakti website. This should serve as a good starting point for the new users.
- It is recommended to check the slurm sample scripts at
/home/iitkgp/slurm-scriptsfor job submission. - Use the same compiler to compile different parts/modules/library-dependencies of an application.
Using different compilers (e.g.,
pgcc+icc) to compile different parts of an application may cause linking or execution issues. - Choosing appropriate compiler switches/flags/options (e.g.,
-O3) may increase the performance of an application substantially (accuracy of output must be verified). Please refer to documentation of compilers (online / docs present inside compiler installation path / man pages etc.). - Modules/libraries used for execution should be the same as those used for compilation. This can be specified in the job submission script.
- Be aware of the amount of disk space utilized by your job(s). Do an estimate before submitting multiple jobs.
- Please submit jobs only from
$SCRATCH. You can back up your results/summaries in your$HOME. $SCRATCHis NOT backed up! Please download all your data to your Desktop/Laptop.- Before installing any software in your home, ensure that it is from a reliable and safe source. Ransomware is on the rise!
- Please do not use spaces while creating directories and files.
- Please inform PARAM Shakti support when you notice something strange—e.g., unexpected slowdowns, files missing/corrupted etc.
- Please do not submit jobs to
gpuorgpu-lowpartition unless your code strictly needs GPU-based computing. - Please provide the
--time(wall-time) parameter judiciously in the job submission batch script, as it significantly affects queue waiting time.