*4 nodes: [rztopaz188,rztopaz194,rztopaz572,rztopaz578]

 

There are 744 compute nodes, with 36 cores and 128 GiB of memory on each node.

Jobs are scheduled per node. RZTopaz has 2 scheduling pools (or partitions):

  • pdebug—16 nodes (576 cores), interactive use only.
  • pbatch— 728 nodes (26208 cores), batch use only.
Pools               Max nodes/job       Max runtime
---------------------------------------------------
pdebug                    8(*)            1 hour
pbatch                   64(**)          24 hours
---------------------------------------------------

(*) Please limit the use of pdebug to 8 nodes on a PER USER basis, not a PER JOB basis, to allow other users access.  Using more than the posted limit PER USER can result in job removal without notice. Please be a good neighbor, and be considerate of others utilizing the pdebug partition. Pdebug is scheduled using fairshare.

(**) In addition to the max-nodes / job limit, there is an additional limit of 64 nodes per user per bank across all of an individual user's jobs and a maximum of 10 running jobs per user per bank.

Pdebug is intended for debugging, visualization, and other inherently interactive work.  It is NOT intended for production work. Do not use pdebug to run batch jobs.  Do not chain jobs to run one after the other. Individuals who misuse the pdebug queue in this or any similar manner will be denied access to running jobs in the pdebug queue.

Hardware

Each node has 2 18-core Intel Xeon E5-2695 processors (2.1 GHz) and 128 GiB of memory.

  •  login:  rztopaz[188,194,572,578]
  •  pdebug: rztopaz[1-16]
  •  pbatch: rztopaz[17-186,199-570,583-768]

RZTopaz uses an Intel Omni-Path Interconnect.

Documentation

Contact

Please call or send email to the LC Hotline if you have questions. LC Hotline | phone: 925-422-4531 | email: lc-hotline@llnl.gov

Zone
RZ
Vendor
Penguin
User-Available Nodes
Login Nodes*
4
Batch Nodes
728
Debug Nodes
16
Total Nodes
748
CPUs
CPU Architecture
Intel Xeon E5-2695 v4
Cores/Node
36
Total Cores
27,648
Memory Total (GB)
98,304
CPU Memory/Node (GB)
128
Peak Performance
Peak TFLOPS (CPUs)
928.9
Clock Speed (GHz)
2.1
Peak single CPU memory bandwidth (GB/s)
77
OS
TOSS 4
Interconnect
Cornelis Networks Omni-Path
Parallel job type
multiple nodes per job
Run Command
srun
Recommended location for parallel file space
Program
ASC
Class
CTS-1
Password Authentication
OTP
Year Commissioned
2017
Compilers
Documentation