Research indexJournal article
Density estimation trees
Ram, Gray
Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining21 Aug 2011
NobleIDark:/48914/w1/20260521/10F552EDDOI10.1145/2020408.2020507
Density estimation trees
Ram, Gray · Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining · 2011 · Subscription
NobleIDark:/48914/w1/20260521/10F552EDDOI10.1145/2020408.2020507
The full text is at the publisher
You can read the abstract here, or open it at the publisher.
Abstract
In this paper we develop density estimation trees (DETs), the natural analog of classification trees and regression trees, for the task of density estimation. We consider the estimation of a joint probability density function of a d-dimensional random vector X and define a piecewise constant estimator structured as a decision tree. The integrated squared error is minimized to learn the tree. We show that the method is nonparametric: under standard conditions of nonparametric density estimation, DETs are shown to be asymptotically consistent. In addition, being decision trees, DETs perform automatic feature selection. They empirically exhibit the interpretability, adaptability and feature selection properties of supervised decision trees while incurring slight loss in accuracy over other nonparametric density estimators. Hence they might be able to avoid the curse of dimensionality if the true density is sparse in dimensions. We believe that density estimation trees provide a new tool for exploratory data analysis with unique capabilities.