DaYu: Optimizing Distributed Scientific Workflows by Decoding Dataflow Semantics and Dynamics
Published in 2024 IEEE International Conference on Cluster Computing (CLUSTER) • Sep 24, 2024
NobleIDNI1P32W22R20S55
Authors:,,
Meng Tang
Jaime Cernuda
Jie Ye
Abstract
The combination of ever-growing scientific datasets and distributed workflow complexity creates I/O performance bottlenecks due to data volume, velocity, and variety. Although the increasing use of descriptive data formats (e.g., HDF5, netCDF) helps organize these datasets, it also introduces obscur...
Finding related papers...
Discussions
(0)No comments yet
Be the first to share your thoughts!