NobleBlocks
Public

DaYu: Optimizing Distributed Scientific Workflows by Decoding Dataflow Semantics and Dynamics

Published in 2024 IEEE International Conference on Cluster Computing (CLUSTER) • Sep 24, 2024
NobleIDNI1P32W22R20S55
Authors:
Meng Tang
,
Jaime Cernuda
,
Jie Ye

Abstract

The combination of ever-growing scientific datasets and distributed workflow complexity creates I/O performance bottlenecks due to data volume, velocity, and variety. Although the increasing use of descriptive data formats (e.g., HDF5, netCDF) helps organize these datasets, it also introduces obscur...

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!