Public Repository

Last pushed: 4 months ago
Short Description
High performance framework for distributed task execution.
Full Description

HyperLoom is a platform for defining and executing workflow pipelines in a distributed environment. HyperLoom is a highly scalable framework that is able to efficiently execute millions of interconnected tasks on hundreds of computational nodes.

HyperLoom features:

  • Optimized dynamic scheduling with low overhead.
  • In-memory data storage with a direct access over the network with a low I/O footprint.
  • Direct worker-to-worker data transfer for low server overhead.
  • Third party application support.
  • Data-location aware scheduling reducing inter-node network traffic.
  • C++ core with a Python client enabling high performance available through a simple API.
  • High scalability and native HPC support.
  • BSD license.

Repository: https://code.it4i.cz/ADAS/loom
Documentation: http://loom-it4i.readthedocs.io/en/latest/

Docker Pull Command
Owner
it4i

Comments (0)