DOE OSTI · 1332538
Scalable Regression Tree Learning on Hadoop using OpenPlanet
Abstract
As scientific and engineering domains attempt to effectively analyze the deluge of data arriving from sensors and instruments, machine learning is becoming a key data mining tool to build prediction models. Regression tree is a popular learning model that combines decision trees and linear regression to forecast numerical target variables based on a set of input features. Map Reduce is well suited for addressing such data intensive learning applications, and a proprietary regression tree algorithm, PLANET, using MapReduce has been proposed earlier. In this paper, we describe an open source implement of this algorithm, OpenPlanet, on the Hadoop framework using a hybrid approach. Further, we evaluate the performance of OpenPlanet using realworld datasets from the Smart Power Grid domain to perform energy use forecasting, and propose tuning strategies of Hadoop parameters to improve the performance of the default configuration by 75% for a training dataset of 17 million tuples on a 64-core Hadoop cluster on FutureGrid.
Keep this discovery
Explore connections, maps & timelines
Yin, Wei, Simmhan, Yogesh, Prasanna, Viktor. 2012-06-18. Scalable Regression Tree Learning on Hadoop using OpenPlanet. https://doi.org/10.1145/2287016.2287027. https://searchnasa.com/record/osti%3A1332538/scalable-regression-tree-learning-on-hadoop-using-openplanet
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.