Search NASA⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 1111248

Feature Clustering for Accelerating Parallel Coordinate Descent

Scherrer, Chad·Tewari, Ambuj·Halappanavar, Mahantesh·Haglin, David J.
View original source ↗Export metadata ↓

Abstract

We demonstrate an approach for accelerating calculation of the regularization path for L1 sparse logistic regression problems. We show the benefit of feature clustering as a preconditioning step for parallel block-greedy coordinate descent algorithms.

Explore related subjects

classificationmachine learningparallel computingsparse data

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Scherrer, Chad, Tewari, Ambuj, Halappanavar, Mahantesh, Haglin, David J.. 2012-12-06. Feature Clustering for Accelerating Parallel Coordinate Descent. https://www.osti.gov/biblio/1111248

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

DOE OSTI2025

Clarifying the trophic state concept to advance macroscale freshwater science and management

For over a century, ecologists have used the concept of trophic state (TS) to characterize an aquatic ecosystem's biological productivity. However, multiple TS classification schemes, each relying on a variety of measurable parameters as proxies for productivity, have emerged to meet use‐specific needs. Frequently, chlorophyll a, phosphorus, and Secchi depth are used to classify TS based on autotrophic production, whereas phosphorus, dissolved organic carbon, and true color are used to classify TS based on both autotrophic and heterotrophic production. Both classification approaches aim to characterize an ecosystem's function broadly, but with varying degrees of autotrophic and heterotrophic processes considered in those characterizations. Moreover, differing classification schemes can create inconsistent interpretations of ecosystem integrity. For example, the US Clean Water Act focuses exclusively on algal threats to water quality, framed in terms of eutrophication in response to nutrient loading. This usage lacks information about non‐algal threats to water quality, such as dystrophication in response to dissolved organic carbon loading. Consequently, the TS classification schemes used to identify eutrophication and dystrophication may refer to ecosystems similarly (e.g., oligotrophic and eutrophic), yet these categories are derived from different proxies. These inconsistencies in TS classification schemes may be compounded when interdisciplinary projects employ varied TS frameworks. Even with these shortcomings, TS can still be used to distill information on complex aquatic ecosystem function into a set of generalizable expectations. The usefulness of distilling complex information into a TS index is substantial such that usage inconsistencies should be explicitly addressed and resolved. To emphasize the consequences of diverging TS classification schemes, we present three case studies for which an improved understanding of the TS concept advances freshwater research, management efforts, and interdisciplinary collaboration. To increase clarity in TS, the aquatic sciences could benefit from including information about the proxy variables, ecosystem type, as well as the spatiotemporal domains used to classify TS. As the field of aquatic sciences expands and climatic irregularity increases, we highlight the importance of re‐evaluating fundamental concepts, such as TS, to ensure their compatibility with evolving science.

classification↗
DOE OSTI2022

Classification of Photovoltaic Failures with Hidden Markov Modeling, an Unsupervised Statistical Approach

Failure detection methods are of significant interest for photovoltaic (PV) site operators to help reduce gaps between expected and observed energy generation. Current approaches for field-based fault detection, however, rely on multiple data inputs and can suffer from interpretability issues. In contrast, this work offers an unsupervised statistical approach that leverages hidden Markov models (HMM) to identify failures occurring at PV sites. Using performance index data from 104 sites across the United States, individual PV-HMM models are trained and evaluated for failure detection and transition probabilities. This analysis indicates that the trained PV-HMM models have the highest probability of remaining in their current state (87.1% to 93.5%), whereas the transition probability from normal to failure (6.5%) is lower than the transition from failure to normal (12.9%) states. A comparison of these patterns using both threshold levels and operations and maintenance (O&M) tickets indicate high precision rates of PV-HMMs (median = 82.4%) across all of the sites. Although additional work is needed to assess sensitivities, the PV-HMM methodology demonstrates significant potential for real-time failure detection as well as extensions into predictive maintenance capabilities for PV.

classification↗
DOE OSTI2017

Separating Facts from Fiction: Linguistic Models to Classify Suspicious and Trusted News Posts on Twitter

Pew research polls report 62 percent of U.S. adults get news on social media (Gottfried and Shearer, 2016). In a December poll, 64 percent of U.S. adults said that “made-up news” has caused a “great deal of confusion” about the facts of current events (Barthel et al., 2016). Fabricated stories spread in social media, ranging from deliberate propaganda to hoaxes and satire, contributes to this confusion in addition to having serious effects on global stability. In this work we build predictive models to classify 130 thousand news tweets as suspicious or verified, and predict four subtypes of suspicious news – satire, hoaxes, clickbait and propaganda. We demonstrate that neural network models trained on tweet content and social network interactions outperform lexical models. Unlike previous work on deception detection, we find that adding syntax and grammar features to our models decreases performance. Incorporating linguistic features, including bias and subjectivity, improves classification results, however social interaction features are most informative for finer-grained separation between our four types of suspicious news posts.

classification↗