Search NASA⌕ Search

SEARCH · Search NASA

Results for “feature engineering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Improving materials property predictions for graph neural networks with minimal feature engineering *

Graph neural networks (GNNs) have been employed in materials research to predict physical and functional properties, and have achieved superior performance in several application domains over prior machine learning approaches. Recent studies incorporate features of increasing complexity such as Gaussian radial functions, plane wave functions, and angular terms to augment the neural network models, with the expectation that these features are critical for achieving a high performance. Here, we propose a GNN that adopts edge convolution where hidden edge features evolve during training and extensive attention mechanisms, and operates on simple graphs with atoms as nodes and distances between them as edges. As a result, the same model can be used for very different tasks as no other domain-specific features are used. With a model that uses no feature engineering, we achieve performance comparable with state-of-the-art models with elaborate features for formation energy and band gap prediction with standard benchmarks; we achieve even better performance when the dataset size increases. Although some domain-specific datasets still require hand-crafted features to achieve state-of-the-art results, our selected architecture choices greatly reduce the need for elaborate feature engineering and still maintain predictive power in comparison.

42 ENGINEERING↗

Feature Engineering and Ensemble Methods for Imbalanced ICS Intrusion Detection: Pipeline Audit and Constrained Evaluation

Industries are becoming increasingly connected and are more vulnerable to cyberattacks due to the widened attack surface. Industrial Control Systems (ICS) are among the most critical sectors that malicious actors can target, as such attacks can cause significant operational disruption and physical damage. It is imperative to detect such attacks as early as possible. This paper evaluates constraint-conditioned optimistic performance estimates for traditional ML models in ICS intrusion detection (i.e., estimates obtained under contiguous, non-shuffled temporal evaluation without test-set alteration, but with pre-split feature engineering that may introduce temporal leakage, due to dataset constraints). Our findings are threefold. First, we quantify how iterative feature engineering affects tree-based ensemble performance and examine how pipeline decisions (split strategy, sampling scope, and cleaning policy) can inflate or reduce reported IDS results under constraint-bound evaluation. Second, we compare intrinsic class-imbalance handling across ensemble models. Third, under our current pipeline constraints (including pre-split feature engineering), CatBoost achieves the best performance on Water Storage Tank (accuracy: 0.9831, class-1 F1: 0.9682), while Light- GBM achieves the best performance on Gas Pipeline (accuracy: 0.9618, class-1 F1: 0.9086).

97 MATHEMATICS AND COMPUTING↗

Feature engineering descriptors, transforms, and machine learning for grain boundaries and variable-sized atom clusters

Abstract Obtaining microscopic structure-property relationships for grain boundaries is challenging due to their complex atomic structures. Recent efforts use machine learning to derive these relationships, but the way the atomic grain boundary structure is represented can have a significant impact on the predictions. Key steps for property prediction common to grain boundaries and other variable-sized atom clustered structures include: (1) describing the atomic structure as a feature matrix, (2) transforming the variable-sized feature matrix to a fixed length common to all structures, and (3) applying a machine learning algorithm to predict properties from the transformed matrices. We examine how these steps and different combinations of engineered features impact the accuracy of grain boundary energy predictions using a database of over 7000 grain boundaries. Additionally, we assess how different engineered features support interpretability, offering insights into the physics of the structure-property relationships.

36 MATERIALS SCIENCE↗

Enhancing dimensionality prediction in hybrid metal halides via feature engineering and class-imbalance mitigation

We present a machine learning (ML) framework for predicting the structural dimensionality of hybrid metal halides (HMHs), including organic-inorganic perovskites, using a combination of chemically-informed feature engineering and advanced class-imbalance handling techniques. This study is motivated by the small and highly imbalanced nature of experimentally available HMH datasets, which limits the applicability and reliability of conventional ML approaches. The dataset, consisting of 494 HMH structures, is highly imbalanced across dimensionality classes (0D, 1D, 2D, 3D), posing significant challenges to predictive modeling. To mitigate this limitation, the dataset was augmented to 1336 samples using the synthetic minority oversampling technique, enabling improved learning of underrepresented dimensionality classes while preserving chemically meaningful feature relationships. We developed interaction-based descriptors designed to capture coupled steric and polarity effects relevant to dimensionality prediction, which are not readily captured by standard single-parameter or composition-only descriptors. These descriptors are integrated into a multi-stage workflow combining feature selection, ensemble stacking, and performance optimization. Our approach significantly improves F1-scores for underrepresented classes, achieving robust cross-validation performance across all dimensionalities. This work demonstrates a generalizable strategy for extracting reliable and interpretable structure–dimensionality relationships from limited experimental data, enabling pre-synthesis screening of organic cations and providing a practical blueprint for small-data ML in hybrid materials systems.

36 MATERIALS SCIENCE↗

Quantum biological insights into CRISPR-Cas9 sgRNA efficiency from explainable-AI driven feature engineering

Abstract CRISPR-Cas9 tools have transformed genetic manipulation capabilities in the laboratory. Empirical rules-of-thumb have been developed for only a narrow range of model organisms, and mechanistic underpinnings for sgRNA efficiency remain poorly understood. This work establishes a novel feature set and new public resource, produced with quantum chemical tensors, for interpreting and predicting sgRNA efficiency. Feature engineering for sgRNA efficiency is performed using an explainable-artificial intelligence model: iterative Random Forest (iRF). By encoding quantitative attributes of position-specific sequences for Escherichia coli sgRNAs, we identify important traits for sgRNA design in bacterial species. Additionally, we show that expanding positional encoding to quantum descriptors of base-pair, dimer, trimer, and tetramer sequences captures intricate interactions in local and neighboring nucleotides of the target DNA. These features highlight variation in CRISPR-Cas9 sgRNA dynamics between E. coli and H. sapiens genomes. These novel encodings of sgRNAs enhance our understanding of the elaborate quantum biological processes involved in CRISPR-Cas9 machinery.

59 BASIC BIOLOGICAL SCIENCES↗

Feature engineering for machine learning enabled early prediction of battery lifetime

Accurate battery lifetime estimates enable accelerated design of novel battery materials and determination of optimal use protocols for longevity in deployments. Unfortunately, traditional battery testing may take years to reach thousands of cycles. Recent studies have shown that machine learning (ML) tools can predict lithium-ion battery lifetimes from 100 or fewer preliminary cycles, representing only a few weeks of cycling. Until now, conclusions about the efficacy and broad applicability of these predictions across a variety of cathode chemistries have been limited by available experimental information. In this work, we leverage a battery cycling dataset representing six cathode chemistries (NMC111, NMC532, NMC622, NMC811, HE5050, and 5Vspinel), multiple electrolyte/anode compositions, and 300 total carefully prepared pouch batteries to explore feature selection and battery chemistry's role in ML battery lifetime predictions. Here, a mean absolute error (MAE) of 78 cycles in prediction was seen for a chemistry-spanning test set from 100 preliminary cycles. Furthermore, an MAE of 103 cycles was seen when using only the first cycle. This study represents an in-depth investigation of strategies for feature selection for battery lifetime prediction, ML models' generalization across multiple battery chemistries, and predictions beyond the training set in the chemical space.

25 ENERGY STORAGE↗

Natural and Engineered Features Supporting Environmental Performance of Idaho National Laboratory’s Remote-Handled Low-Level Waste Disposal Facility

The Idaho National Laboratory’s (INL’s) Remote-Handled Low-Level Waste (RH LLW) Disposal Facility has been designed and constructed to receive waste generated at the INL site in support of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE) and Naval Reactors (NR) missions. The facility has been designed to receive legacy RH LLW currently in storage at INL facilities and new waste generated by nuclear research programs. RH LLW to be received at the facility is solid waste consisting of surface contaminated debris; ion exchange resins used to purify cooling and canal water; activated metals generated during reactor core change outs and Naval spent fuel management; and nuclear Research & Development. Disposal of INL's RH LLW poses unique disposal challenges due to high radiation levels (contact rates up to 600 Sv/hr [60,000 Rem/hr]) that require remote handling and adequate shielding for transportation and disposal. The facility has been designed to meet the requirements of DOE Order 435.1 [1], including the all-pathways dose, air pathway dose, inadvertent intruder doses, and radon emissions limits. This paper presents an overview of natural and engineered design features that support the safety case and enhance the environmental performance of the facility. These include location selection, use of reinforced pre-cast concrete vaults; a robust hydraulic drainage system; use of steel waste canisters for waste disposal; the facility monitoring system; facility layout; and crediting waste forms. The facility performance assessment (PA) [2] developed to meet the requirements of DOE Order 435.1 “Radioactive Waste Management” credits each of these protective features. Releases from waste forms disposed of at this facility are limited by corrosion of the steel waste canisters which will ultimately allow contact with infiltrating water followed by transport of radionuclides from the vault system. The steel waste canisters were credited for their ability to limit water contact with the waste based on the demonstrated ability of the reinforced pre-caste concrete vaults to provide long-term structural protection of the steel waste canisters. Verification of hydraulic and concrete performance was conducted through laboratory data, field infiltration tests supported by a robust monitoring system, and numerical modeling. Releases into the vault system from activated metals are based on site-specific corrosion data. Radionuclide transport from the vault system from all waste forms is based on site-specific climatological, hydrologic, and stratigraphic data. At INL, the groundwater pathway historically and appropriately has received the most attention. By crediting aspects of the natural system, the engineered vault system, and the waste, estimated radiologic doses via the groundwater pathway are minimal. Air pathway doses were reduced by differentially crediting corrosion of aluminum and stainless steel activated metals resulting in the pathway being screened out of the PA. Groundwater and inadvertent intruder doses were reduced through selective facility layout. This paper provides an overview of the system-wide protective features incorporated into the facility design along with an extensive reference list to supporting technical papers and analyses that provide data and interpretation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Natural and Engineered Features Supporting Environmental Performance of Idaho National Laboratory's Remote-Handled Low-Level Waste Disposal Facility - 19436

The Idaho National Laboratory's (INL's) Remote-Handled Low-Level Waste (RH LLW) Disposal Facility has been designed and constructed to receive waste generated at the INL site in support of the US DOE Office of Nuclear Energy (NE) and Naval Reactors (NR) missions. The facility has been designed to receive legacy RH LLW currently in storage at INL facilities and new waste generated by nuclear research programs. RH LLW to be received at the facility is solid waste consisting of surface contaminated materials; ion exchange resins used to purify cooling and canal water; and activated metal components generated during reactor core change outs and Naval spent fuel management; and nuclear R and D. Disposal of INL's RH LLW poses unique disposal challenges due to high radiation levels (contact rates up to 600 Sv/hr [60,000 Rem/hr]) that require remote handling and adequate shielding for transportation and disposal. The facility has been designed to meet the requirements of DOE Order 435.1, Radioactive Waste Management, including the all-pathways dose, air pathway dose, inadvertent intruder doses, and radon emissions limits. This paper presents an overview of natural and engineered design features that support the safety case and enhance the environmental performance of the facility. These features include location selection, use of reinforced pre-cast concrete vaults; a robust hydraulic drainage system; use of steel waste canisters for waste disposal; the facility monitoring system; facility layout; and crediting waste forms. The facility performance assessment (PA) developed to meet the requirements of DOE Order 435.1, credits each of these protective features. Releases from waste forms disposed of at this facility are limited by corrosion of the steel waste canisters which will ultimately allow contact with infiltrating water followed by transport of radionuclides from the vault system. The steel waste canisters were credited for their ability to limit water contact with the waste based on the demonstrated ability of the reinforced pre-caste concrete vaults to provide long-term structural protection of the steel waste canisters. Verification of hydraulic and concrete performance was conducted through laboratory data, field infiltration tests supported by a robust monitoring system, and numerical modeling. Releases into the vault system from activated metals are based on site-specific corrosion data. Radionuclide transport from the vault system from all waste forms is based on site-specific climatological, hydrologic, and stratigraphic data. At INL, the groundwater pathway historically and appropriately has received the most attention. By crediting aspects of the natural system, the engineered vault system, and the waste, estimated radiologic doses via the groundwater pathway are minimal. Air pathway doses were reduced by differentially crediting corrosion of aluminum and stainless steel activated metals resulting in the pathway being screened out of the PA. Groundwater and inadvertent intruder doses were reduced through selective facility layout. This paper provides an overview of the system-wide protective features incorporated into the facility design along with an extensive reference list to supporting technical papers and analyses that provide data and interpretation. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Kinematic Variables and Feature Engineering for Particle Phenomenology

Kinematic variables have been playing an important role in collider phenomenology, as they expedite discoveries of new particles by separating signal events from unwanted background events and allow for measurements of particle properties such as masses, couplings, spins, etc. For the past 10 years, an enormous number of kinematic variables have been designed and proposed, primarily for the experiments at the Large Hadron Collider, allowing for a drastic reduction of high-dimensional experimental data to lower-dimensional observables, from which one can readily extract underlying features of phase space and develop better-optimized data-analysis strategies. We review these recent developments in the area of phase space kinematics, summarizing the new kinematic variables with important phenomenological implications and physics applications. We also review recently proposed analysis methods and techniques specifically designed to leverage the new kinematic variables. As machine learning is nowadays percolating through many fields of particle physics including collider phenomenology, we discuss the interconnection and mutual complementarity of kinematic variables and machine learning techniques. We finally discuss how the utilization of kinematic variables originally developed for colliders can be extended to other high-energy physics experiments including neutrino experiments.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Combinatorial Evaluation of Physical Feature Engineering, Classical Machine Learning, and Deep Learning Models for Synchrophasor Data at Scale

A major objective of the project was to train and evaluate the effectiveness of multiple event and anomaly detection, identification and classification deep temporal learning models for processing of real-time phasor measurement unit (PMU) data streams. A vast dataset, consisting of two years of phasor measurements from all three U.S. Interconnections, was curated and released by the Department of Energy (DOE) through Pacific Northwest National Laboratory (PNNL). The dataset also included an event log that provided event times and types (e.g. generator trips, line trips, planned service events, transformer operations, etc.). Our analysis of this dataset addressed six (6) of the eleven (11) research priorities identified in Funding Opportunity Announcement (FOA) DE-FOA-0001861 “Big Data Analysis of Synchrophasor Data” (FOA 1861). Rather than being limited to pre-determined specific algorithms, this project relied on the uniquely structured, highly performant underlying time series database capabilities of the PredictiveGrid platform to assess the vast dataset utilizing a wide variety of algorithms.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Feature Engineering and Process Mining to Enable Hazard Detection in Health Information Technology

Motivation for this work originates from a recognized need for developing data-driven approaches through analysis of complex electronic health records. Specifically, we aim to enhance the reliability of health information technology (HIT) systems by detection of plausible HIT hazards in clinical order transactions. In the absence of well-defined event logs in corporate data warehouses, our proposed approach identifies relevant timestamped data fields that could indicate transactions in the clinical order life cycle generating raw event sequences. Subsequently, we adopt state transitions of the OASIS Human Task standard to map the raw event sequences and simplify the complex process that clinical radiology orders go through. We describe how the current approach provides the potential to investigate areas of improvement and potential hazards in HIT systems. The discussion concludes with a use case and opportunities for future applications.

Ozmen, Ozgur↗

Data and Code for Understanding Generative AI Content with Embedding Models

This repository contains code for the experiments in the paper "Understanding Generative AI Content with Embedding Models". Constructing high-quality features is critical to any quantitative data analysis. While feature engineering was historically addressed by carefully hand-crafting data representations based on domain expertise, deep neural networks (DNNs) now offer a radically different approach. DNNs implicitly engineer features by transforming their input data into hidden feature vectors called embeddings. For embedding vectors produced by foundation models -- which are trained to be useful across many contexts -- we demonstrate that simple and well-studied dimensionality-reduction techniques such as Principal Component Analysis uncover inherent heterogeneity in input data concordant with human-understandable explanations. Of the many applications for this framework, we find empirical evidence that there is intrinsic separability between real samples and those generated by artificial intelligence (AI).

Vargas, Max [Pacific Northwest National Laboratory↗

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗

HAZARD ANALYSIS OF DIGITAL ENGINEERED SAFETY FEATURES ACTUATION SYSTEM IN ADVANCED NUCLEAR POWER PLANTS USING A REDUNDANCY-GUIDED APPROACH

Replacing the existing aging analog instrumentation and control (I&C) systems with modern safety control and protection digital technology offers one of the foremost means of performance improvements and cost reductions for the existing nuclear power plants (NPPs). However, the qualification of digital I&C systems remains a challenge, especially considering the issue of software common-cause failures (CCFs), which are difficult to address. With the application and upgrades of advanced digital I&C systems, software CCFs have become a potential threat to plant safety because most redundant designs use similar digital platforms or software in the operating and application systems. With complex designs of multilayer redundancy to meet the single-failure criterion, digital I&C safety systems (e.g., engineered safety-features actuation system [ESFAS]) are of a particular concern in the U.S. Nuclear Regulatory Commission (NRC) licensing procedures. This paper applies a modularized approach to conduct redundancy-guided systems-theoretic hazard analysis for an advanced digital ESFAS with multilevel redundancy designs. Systematic methods and risk-informed tools are incorporated to address both hardware and software CCFs, which provide guidance to eliminate the triggers of potential single points of failure in the design of digital safety systems in advanced plant designs.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluation of the Performance of the SAVY Container Subjected to Various Impact Events using Finite Element Methods

The SAVY container is a Safety Class Design Feature utilized both inside engineered features and outside engineered features (e.g. gloveboxes) at TA-55 Plutonium Facility Building 4. These containers were certified as low damage ratio containers by demonstrating their ability to retain material after exposure to impacts and elevated temperatures resulting from a design basis seismic event. Original testing of the SAVY did not evaluate the effects of various facility specific insults to the SAVY while within a DOT Type A Container, caused either by design basis accident or an operational mishap. These insults include: 1. Impact of a structural I-beam (drum upright & drum on side); 2. Impact of a section of Positive Pressure Chilled Water Pipe (PPCWS); 3. Forklift fork tine impact; 4. Fuel truck impact. Abaqus Explicit Dynamics Finite Element Analysis was performed on a nested SAVY/DOT Type 7A container configuration to assess the structural integrity of the SAVY under the accident conditions listed.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗