Job Limits

Each LC platform is a shared resource. Users are expected to adhere to the following usage policies to ensure that the resources can be effectively and productively used by everyone. You can view the policies on a system itself by running either:

joblimits
news job.lim.MACHINENAME

Web version of Mammoth Job Limits

There are 64 compute nodes, with 128 cores and 2048 GiB of memory on each node.

Jobs are scheduled per node. Mammoth has 2 scheduling pools (or partitions):

  •  pdebug—8 nodes
  • pbatch—56 nodes (7168 cores), batch use only.
Pools               Max nodes/job       Max runtime
---------------------------------------------------
pdebug                   8(*)           60 minutes
pbatch                   56              24 hours
---------------------------------------------------

(*) Jobs in pdebug are limited to 4 nodes on a PER USER basis, not a PER JOB basis, to allow other users access to this limited resource.  Pdebug is scheduled using fairshare.

Pdebug is intended for debugging, visualization, and other inherently interactive work.  It is NOT intended for production work. Do not use pdebug to run batch jobs.  Do not chain jobs to run one after the other. Individuals who misuse the pdebug queue in this or any similar manner will be denied access to running jobs in the pdebug queue.

Hardware

Each node has dual 64-core AMD EPYC 7742 processors (2.25 GHz) and 2048 GiB of memory.

Mammoth uses a Cornelis Networks Omni-Path Interconnect.

Documentation

Contact

Please call or send email to the LC Hotline if you have questions. LC Hotline | phone: 925-422-4531 | email: lc-hotline@llnl.gov

 
Zone
CZ
Vendor
SuperMicro
User-Available Nodes
Login Nodes*
2
Batch Nodes
64
Debug Nodes
0
Total Nodes
69
CPUs
CPU Architecture
AMD Rome
Cores/Node
128
Total Cores
8,832
Memory Total (GiB)
131,072
CPU Memory/Node (GiB)
2,048
Peak Performance
Peak PFLOPS (CPUs)
0.294
Peak PFLOPS (CPUs+GPUs)
0.294
Clock Speed (GHz)
2.3
OS
TOSS 4
Interconnect
Cornelis Networks Omni-Path
Scheduling Policy (main batch queue)
node-scheduled
Scheduler
Slurm
Recommended location for parallel file space
/p/lustre{...}
Program
ASC, M&IC
Class
CTS-1
Year Commissioned
2020
Compilers

See Compilers page