NobleBlocks
Public

Cubed: Scalable array processing with bounded-memory in Python

Published in Zenodo (CERN European Organization for Nuclear Research) • Jul 10, 2025
NobleIDNI0P18W45R05S93
Authors:
Tom Nicholas
,
Tom White

Abstract

Cubed is a framework for distributed processing of large arrays without a cluster. Designed to respect memory constraints at all times, Cubed can express any NumPy-like array operation as a series of embarrassingly-parallel, bounded-memory steps. By using Zarr as persistent storage between steps, Cu...

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!