*2 nodes: mica[188,194]

Job Limits

Each LC platform is a shared resource. Users are expected to adhere to the following usage policies to ensure that the resources can be effectively and productively used by everyone. You can view the policies on a system itself by running:

news job.lim.MACHINENAME

Web version of Mica

There are 5 generally available machines on the SCF. Please consider your needs to decide which machine is best for your flavor of work.

  • Agate—a 48 node machine for up to 36 core jobs (no interconnect)
  • Mica—a small machine for debugging (8hr job limit)
  • Jadeita—a machine for small jobs
  • Magma—a machine for small to medium jobs
  • Jade—a machine for large jobs (4 jobs/user limit)

Mica is now in General Availability mode and all jobs are scheduled per node in two pools. Remember you can run using qos=standby to get additional resources if there are a lot of empty nodes.

  •  pbatch—290 nodes (10440 cores), batch use only
  •  pdebug—16 nodes (576 cores), debug use only.
  •  pvis—67 nodes (2412 cores), interactive / visualization work.
Pools               Max nodes/job       Max runtime
---------------------------------------------------
pbatch                  32                8 hours
pdebug                   8(*)             2 hours
pvis                    32                4 hours
---------------------------------------------------

NOTE: there is also a limit of 48 nodes per user per bank.   This limit is aggregated across all of a users jobs on mica: pbatch + pdebug + pvis.

(*) pdebug is for debugging and other interactive work.

  •   Jobs are node scheduled
  •   Limit your work to 8 nodes on a per user basis.
  •   Do not use pdebug for production work or chain jobs
  •   Using more than these limits can result in job removal without notice.

Hardware

  •   Intel Xeon E5-2695 2.1GHz cores
  •   Intel Omni-Path Interconnect
  •   36 cores/node
  •   128GB memory/node
Zone
SCF
Vendor
Penguin
User-Available Nodes
Login Nodes*
2
Batch Nodes
357
Debug Nodes
16
Total Nodes
384
CPUs
CPU Architecture
Intel Xeon E5-2695 v4
Cores/Node
36
Total Cores
13,824
Memory Total (GB)
49,152
CPU Memory/Node (GB)
128
Peak Performance
Peak TFLOPS (CPUs)
464.5
Clock Speed (GHz)
2.1
Peak single CPU memory bandwidth (GB/s)
77
OS
TOSS 4
Interconnect
Cornelis Networks Omni-Path
Parallel job type
multiple nodes per job
Run Command
srun
Recommended location for parallel file space
Program
ASC
Class
CTS-1
Password Authentication
OTP, Kerberos
Compilers
Documentation