*4 nodes: [rztopaz188,rztopaz194,rztopaz572,rztopaz578]

There are 744 compute nodes, with 36 cores and 128 GiB of memory on each node.

Jobs are scheduled per node. RZTopaz has 2 scheduling pools (or partitions):

• pdebug—16 nodes (576 cores), interactive use only.
• pbatch— 728 nodes (26208 cores), batch use only.

Pools               Max nodes/job       Max runtime
---------------------------------------------------
pdebug                    8(*)            1 hour
pbatch                   64(**)          24 hours
---------------------------------------------------

(*) Please limit the use of pdebug to 8 nodes on a PER USER basis, not a PER JOB basis, to allow other users access.  Using more than the posted limit PER USER can result in job removal without notice. Please be a good neighbor, and be considerate of others utilizing the pdebug partition. Pdebug is scheduled using fairshare.

(**) In addition to the max-nodes / job limit, there is an additional limit of 64 nodes per user per bank across all of an individual user's jobs and a maximum of 10 running jobs per user per bank.

Pdebug is intended for debugging, visualization, and other inherently interactive work.  It is NOT intended for production work. Do not use pdebug to run batch jobs.  Do not chain jobs to run one after the other. Individuals who misuse the pdebug queue in this or any similar manner will be denied access to running jobs in the pdebug queue.

Hardware

Each node has 2 18-core Intel Xeon E5-2695 processors (2.1 GHz) and 128 GiB of memory.

•  login:  rztopaz[188,194,572,578]
•  pdebug: rztopaz[1-16]
•  pbatch: rztopaz[17-186,199-570,583-768]

RZTopaz uses an Intel Omni-Path Interconnect.

Documentation

• Linux Clusters Tutorial Part One | Linux Clusters Part Two
• Slurm Tutorial (formerly Slurm and Moab)
• TCE Home  

Contact

Please call or send email to the LC Hotline if you have questions. LC Hotline | phone: 925-422-4531 | email: lc-hotline@llnl.gov