Research indexJournal article
Supervised Learning Under Distributed Features
Ying, Yuan, Sayed
IEEE Transactions on Signal Processing16 Nov 2018Open access
NobleIDark:/48914/w1/20260523/2F48AA97DOI10.1109/tsp.2018.2881661
Supervised Learning Under Distributed Features
Ying, Yuan, Sayed · IEEE Transactions on Signal Processing · 2018
NobleIDark:/48914/w1/20260523/2F48AA97DOI10.1109/tsp.2018.2881661
Abstract
This paper studies the problem of learning under both large datasets and large-dimensional feature space scenarios. The feature information is assumed to be spread across agents in a network, where each agent observes some of the features. Through local cooperation, the agents are supposed to interact with each other to solve an inference problem and converge towards the global minimizer of an empirical risk. We study this problem exclusively in the primal domain, and propose new and effective distributed solutions with guaranteed convergence to the minimizer with linear rate under strong convexity. This is achieved by combining a dynamic diffusion construction, a pipeline strategy, and variance-reduced techniques. Simulation results illustrate the conclusions.