Job Ephemeral Data Services (JEDS) is a lightweight command-line and Python tool that simplifies the creation of secure, short-lived data service containers for compute jobs on LC clusters. Unlike Persistent Data Services (PDS), JEDS provisions containerized instances of MariaDB, MongoDB, PostgreSQL, RabbitMQ, and Redis that exist only for the duration of a job, ensuring that all data is deleted when the job ends or the service is stopped. JEDS is accessible both as a CLI tool and a Python library, making it easy to integrate into workflows. All instances are password protected, use TLS encryption, and comply with LC security policies, leveraging Podman for container management.
To get started, install JEDS into you python virtual environment with `pip install jeds-cli` and use the `jeds run` command. Usage instructions, troubleshooting guidance, and examples are available in the official JEDS documentation