Quick Start

List of Commands for experienced HPC Users

• PROGRAMER NOTICES

  Unlike the TACC Lonestar system, your code can contnain system() and fork()/exec() calls because the Ranger Linux kernel is 2.6.18, and MVAPICH MPI memory routines work correctly with the fork/system/exec calls.

  Do not use the qsub "-S" option to set the shell for batch jobs. Set it with the "shebang" #! line shell invocation (#!/bin/<shell>).

• Suggested default Intel compiler options:

  ifort	-xW -O2 -ipo prog.f90
  icc	-xW -O2 -ipo prog.c

  mpif90	-xW -O2 -ipo prog.f90
  mpicc	-xW -O2 -ipo prog.c

• Suggested default PGI compiler options:

  pgf95	-fast -tp barcelona-64 prog.f90
  pgcc or pgcpp	-fast -tp barcelona-64 prog.c

  mpif90	-fast -tp barcelona-64 prog.f90
  mpicc	-fast -tp barcelona-64 prog.c

• Suggested default gcc compiler options:

  gcc	-O3 -mtune=barcelona -march=barcelona prog.c
  f77	-O3 -mtune=barcelona -march=barcelona prog.f

• Job Script

  [shell:tcsh (use full path); use submission env. & directory; Jobname:myjob; stderr/out to same file; outfile:Jobname.o.JobID; 16tasks/node, 8 nodes = 128/16; queue:normal; time: 30 minutes; uncomment -M/-m for email notice; C-shell echo cmds (use set -x for Bourne); run a.out with IB support]

  #!/bin/tcsh

  #$ -V

  #$ -cwd

  #$ -N myjob

  #$ -j y

  #$ -o $JOB_NAME.o$JOB_ID

  #$ -pe 16way 128

  #$ -q normal

  #$ -l h_rt=00:30:00

  ## -M myemailname@address

  ## -m be

  set echo

  ibrun ./a.out

• Job Submission

  qsub job

• Job monitoring, job deletion, queue list, job-run info

  qstat	{info for your jobs; use -u "*" (with quotes) for all users}
  showq	{system-wide job summaries}
  qdel <jobid>	{kill a job}
  qconf -sql	{show queue list}

• File Systems. Variable contains your directory name.

  Directory	Limit	Access	Policy	Availability
  $HOME	6GB quota	Lustre (parallel)	permanent, backed up	all nodes
  $WORK	4TB quota (4 early users)	Lustre (parallel)	10-day purge policy	all nodes
  $SCRATCH	Not Available	Lustre (parallel)	TBD-day purge policy	all nodes
  $ARCHIVE	unlimited	DMF archive	Disk-to-Tape Migration	** login nodes

  ** If you need to transfer files from the TACC Archive:

  See the new archive document.