The High Performance Storage System (HPSS) archival storage system at Livermore Computing (LC) sets an upload* quota for the year. Reset each year on fiscal year boundaries, the FY24 (10/1/2023-9/30/2024) upload quotas per user are as follows:

  • Open Computing Facility (OCF) yearly growth quota: 300TB
  • Secure Computing Facility (SCF) yearly growth quota: 300TB

Users may arrange with their programs to receive additional allocation from programmatic "pools" if their yearly growth may go beyond these boundaries. Contact an LC Accountant Specialist (925-422-4531, option 2) to get information on your program contact.

The archival quota system will notify users, administrators, and managers of any users exceeding their archival data growth quota during a fiscal year. In addition, users who have far exceeded their annual growth quota for four consecutive weeks will be automatically blocked.

When a quota is exceeded, the notification system sends weekly email with the following messages:

Warning Users exceed yearly allocations
Critical Users excessively grow beyond the yearly allocations.
Blocked After four weeks and reminders to clean up, users will be denied further write access to the archives. Users in this state will still be able to clean up so that they can lower their usage below the quota.

Access will be restored within 24 hours if users either clean up below their total quota or receive additional allocation from a programmatic pool manager.

Archival Pools

A user is automatically given quota allocations in three pools as they store data. Every user is assigned a 1.5 TB allocation in the Default pool. As they pass 1.5 TB of growth, users are automatically given a 13.5 TB allocation in the midpool. Users exceeding 15 TB of growth are automatically given an allocation in largepool. The largepool allocation is 285TB, resulting in a total quota of 300TB. Users growing beyond their allocation in all three pools will need to receive allocations from programmatic pools.

The AQUOTA Tool

To manage the quota system, the aquota (archive quota) is available from any Oslic node on the OCF (for CZ-only users), RZslic (for CZ/RZ users), and any Cslic node on the SCF. In particular, the show quota command (requires a valid kerberos ticket obtained with kinit) will reveal a user’s current yearly growth along with details of their programmatic pools, as illustrated below:

>kinit   ##to get needed Kerberos ticket
>aquota
Welcome to HPSS Quota Server oslici.llnl.gov
aq> show quota
Welcome to HPSS OCF Production Aquota Server salamanca2.llnl.gov

Pool Name                 Pool Manager  Allowance
------------------------  ------------  ---------------
default                   lc-hotline             1.5 TB
midpool                   lc-hotline            13.5 TB
largepool                 lc-hotline           285.0 TB
   Total                                       300.0 TB

From 10/01/2022 through 10/02/2022:
608 files created
16.6 TB of data used. 5.53% of total.
Avg. Per Month: 16.6 TB
Total Data:   79.9 TB
Total files: 11909

More Information

This bulletin supersedes any previous bulletins with regard to archival quotas.

* The upload quota is a delta from the beginning to the end of the year. For example, a user can upload 300 TB to HPSS, delete 300 TB from HPSS, and then upload another 300 TB. After doing so, the user has uploaded 600 TB of data, but stayed within the 300TB quota.