NobleBlocks

Research indexJournal article

A Different VIM: Visualizing Incremental Machine Learning

Al-Amin, Nur, Farooque and 3 others

Proceedings of the 31st ACM International Conference on Information & Knowledge Management16 Oct 2022

NobleIDark:/48914/w1/20260521/058A28F7DOI10.1145/3511808.3557175

Paywalled

The full text is at the publisher

You can read the abstract here, or open it at the publisher.

Read at the publisher

Abstract

Incremental learning is used to continuously update and tune an existing model, as more data points come in. However, there is a tradeoff between speed and accuracy as the model becomes stable. From a big data angle, computing machine learning models is challenging when data sets cannot fit in main memory or when they exceed CPU capacity. On the other hand, data summarization is a fundamental technique that has promise to accelerate data science computations and compress a data set. Keeping these motivations in mind, we present an innovative system, VIM, that computes machine learning models in an incremental manner, visualizing continuous learning of model parameters as the data set is scanned. Our system is fast, it works for a wide spectrum of machine learning models and it can handle data sets larger than main memory. We developed an intuitive GUI which: (1) guides the user to upload data sets and choose a machine learning model, (2) offers interactive visualization of model parameters, and (3) helps getting an approximate model, stopping early, without reading the whole data set.

Discussion

Citations

Topics

More

Suggest a correction or report