Cubed: Scalable array processing with bounded-memory in Python
Published in Zenodo (CERN European Organization for Nuclear Research) • Jul 10, 2025
NobleIDNI0P18W45R05S93
Authors:,
Tom Nicholas
Tom White
Abstract
Cubed is a framework for distributed processing of large arrays without a cluster. Designed to respect memory constraints at all times, Cubed can express any NumPy-like array operation as a series of embarrassingly-parallel, bounded-memory steps. By using Zarr as persistent storage between steps, Cu...
Finding related papers...
Discussions
(0)No comments yet
Be the first to share your thoughts!