There are 4 main types of AI/ML capabilities at Livermore Computing. These services are linked to in the boxes below. See also, other consulting services or capabilities below the boxes.

 

AI Software and Tools

LC has a variety of software and tools to support AI/ML use cases on LC systems. These include: 

Machine Learning Frameworks

PyTorch is available on LC systems.

Jupyter Notebooks provide an interactive environment for developing and testing machine learning models using frameworks like PyTorch. For setup instructions and best practices on LC systems, please see "Orbit" and Jupyter notebooks".

Machine Learning Visualization

TensorBoard is available on LC. Please see Using TensorBoard on Login Nodes for info about how to run it securely.

Machine Learning Workflow Tools

If you're looking for a workflow orchestration tool, we recommend Merlin, which supports HPC workflows and scalability for ML-typical workflows composed of many jobs. 

LC's Workflow Enablement Group supports Merlin by providing you with the required Persistent Data Services in LaunchIT.

 

AI/ML Services

Please see our AI/ML services page for information about LLMs hosted on LC (service called LLamaMe) and how to get API keys in LaunchIT. (available in all LC network zones CZ, RZ, and SCF).

We support GitLab Duo on the CZ and RZ. For more information, see our LC GitLab Duo (Pilot) page.

 

AI/ML Hardware

Our systems that include GPUs are listed at Compute Platforms with GPUs.

 

AI/ML Data Storage and Sharing

We recommend our VAST filesystems for AI/ML workloads; VAST provides scalability for workloads that include working with many small input/output files and frequent I/O operations.

We also offer object storage compatible with the S3 protocol.

If you need to share models or other data with a group of collaborators, please don’t hesitate to reach out to us. We can create shared directories for groups of users upon request and are actively exploring additional solutions to facilitate model sharing.

Additional Consulting Services

In addition to consulting services related to the areas above, LC offers other consulting services:

Development

Contact the LC Hotline, and they will direct you to the appropriate person.

  • Performance Optimization
  • Debugging
  • Compilers

HPC Center Usage

We have dedicated teams of subject area experts available:

Additional Capabilities

Most LC Capabilities fall into one of the major categories above.

FIS: File Transfer to iSRD / iSNSI

FIS is a crucial capability that does not fall into any of the above categories.

What is FIS?

LC supports one way link (OWL) connections that allow one way transfers from the unclassified (EN, CZ, RZ) to the classified networks (iSNSI, iSRD) at LLNL. Full instructions can be found at: hpc.llnl.gov/documentation/user-guides/using-lc-file-interchange-service-fis