robrt/jolt repository overview

Jolt is a versatile tool for executing user-defined tasks written in Python. It offers the flexibility to run tasks either locally on a user’s computer or remotely on a cluster of workers. The tool is designed to be extensible and can handle tasks of any kind, making it particularly suitable for time-consuming and parallelizable tasks.

Tasks in Jolt are implemented as Python classes. For example, the following code defines a simple “Hello” task:

from jolt import Parameter, Task

class Hello(Task):
    name = Parameter("world")

    def run(self, deps, tools):
        print(f"Hello {self.name}!")

The task is executed by running:

jolt build hello:who=reader

When a task is executed, it generates an artifact containing files and metadata. All task artifacts are stored in a local cache directory and have a unique and reproducible identity, determined by a SHA1 sum of various task attributes. This identity ensures consistent exchange of artifacts between local and remote caches.

For full documentation, please visit http://jolt.readthedocs.io/⁠