Search NASA⌕ Search

SEARCH · Search NASA

Results for “feature set”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Contrasting Time-Frequency Representations for Unknown Waveform Detection

In real-world applications like spectrum management and interference detection, dealing with unseen electromagnetic waveforms is critical. Although some methods attempt to simulate open set data using generator models, they face challenges in generating synthetic samples for open set while simultaneously selecting an optimal discriminator for accurate classification. This results in difficulties capturing distinctive features across classes, especially in dynamic scenarios where new classes emerge. To detect unseen waveforms, we propose combining time and frequency domain features with cosine similarity loss to enhance feature distinctiveness and enabling more accurate predictions. This approach efficiently captures more comprehensive information than single-domain representations or approaches without cosine loss. Additionally, our model avoids generic feature vectors by extracting class-specific features during training, resulting in improved class representation. The experiment results show that this combined feature approach with cosine loss outperforms single-domain models and improves accuracy by 10\% over models without cosine loss.

99 - GENERAL AND MISCELLANEOUS↗

Understanding structure-processing relationships in metal additive manufacturing via featurization of microstructural images

Understanding and predicting accurate property-structure-processing relationships for additively manufactured components is important for both forward and inverse design of robust, reliable parts and assemblies. While direct mapping of process parameters to properties is sometimes plausible, it is often rendered difficult due to poor microstructural control. Exploring the direct relationship between processing conditions and microstructural features can thus provide significant physical insights and aid the overall design process. Here, in this study, we develop an automated high-throughput framework to simulate an uncertainty-aware additive manufacturing (AM) process, characterize microstructural images, and extract meaningful features/descriptors. A kinetic Monte Carlo (KMC) based model of the AM process is used to simulate microstructural evolution for a diverse set of experimentally relevant processing conditions. We perform a parametric study to explore the relationship between microstructural features and processing conditions. Our results indicate that a many-to-one mapping can exist between processing conditions and typical descriptors; therefore, multiple descriptors are thus necessary to unambiguously represent microstructural images. Our work provides crucial quantitative and qualitative in-formation that would aid in the selection of features for microstructural images. Featurized microstructures could then be utilized to build data-driven models for predictive control of microstructures and thereby properties of additively manufactured components.

36 MATERIALS SCIENCE↗

Reconstructing Richtmyer–Meshkov instabilities from noisy radiographs using low dimensional features and attention-based neural networks

We develop an ML-based approach for density reconstruction based on transformer neural networks. This approach is demonstrated in the setting of ICF-like double shell hydrodynamic simulations wherein the parameters related to material properties and initial conditions are varied. The new method can robustly recover the complex topologies given by the Richtmyer-Meshkoff instability (RMI) from a sequence of hydrodynamic features derived from radiographic images corrupted with blur, scatter, and noise. A noise model is developed to characterize errors in extracting features from synthetic radiographs of the simulated density field. The key component of the network is a transformer encoder that acts on a sequence of features extracted from noisy radiographs. This encoder includes numerous self-attention layers that act to learn temporal dependencies in the input sequences and increase the expressiveness of the model. This approach is shown to exhibit an excellent ability to accurately recover the RMI growth rates, despite the gas-metal interface being greatly obscured by radiographic noise. Our approach can be applied in a broad array of fields involving shock physics and material science.

47 OTHER INSTRUMENTATION↗

Extending Conformal Prediction to Hidden Markov Models with Exact Validity via de Finetti’s Theorem for Markov Chains

Conformal prediction is a widely used method to quantify uncertainty in settings where the data is independent and identically distributed (IID), or more generally, exchangeable. Conformal prediction takes in a pre-trained classifier and a calibration dataset as inputs, and returns a function which maps feature vectors to subsets of classes. The output of the returned function for a new feature vector is guaranteed to contain the true class with a pre-specified confidence. Despite its success and usefulness in IID settings, extending conformal prediction to non-exchangeable (e.g., Markovian) data in a manner that provably preserves all desirable theoretical properties has largely remained an open problem. As a solution, we extend conformal prediction to the setting of a Hidden Markov Model (HMM) with unknown parameters. The key idea behind the proposed method is to partition the non-exchangeable Markovian data from the HMM into exchangeable blocks by exploiting the de Finetti’s Theorem for Markov Chains discovered by Diaconis and Freedman (1980). The permutations of the exchangeable blocks are then viewed as randomizations of the observed Markovian data from the HMM. The proposed method provably retains all desirable theoretical guarantees offered by the classical conformal prediction framework and is general enough to be useful in many sequential prediction problems.

Nettasinghe, Don Buddhika Wijayantha↗

L-dwarf Detection from SDSS Images using Improved Faster R-CNN

We present a data-driven approach to automatically detect L dwarfs from Sloan Digital Sky Survey (SDSS) images using an improved Faster R-CNN framework based on deep learning. The established L-dwarf automatic detection (LDAD) model distinguishes L dwarfs from other celestial objects and backgrounds in SDSS field images by learning the features of 387 SDSS images containing L dwarfs. Applying the LDAD model to the SDSS images containing 93 labeled L dwarfs in the test set, we successfully detected 83 known L dwarfs with a recall rate of 89.25% for known L dwarfs. Several techniques are implemented in the LDAD model to improve its detection performance for L dwarfs, including the deep residual network and the feature pyramid network. As a result, the LDAD model outperforms the model of the original Faster R-CNN, whose recall rate of known L dwarfs is 80.65% for the same test set. The LDAD model was applied to detect L dwarfs from a larger validation set including 843 labeled L dwarfs, resulting in a recall rate of 94.42% for known L dwarfs. The newly identified candidates include L dwarfs, late M and T dwarfs, which were estimated from color (i – z) and spectral type relation. The contamination rates for the test candidates and validation candidates are 8.60% and 9.27%, respectively. The detection results indicate that our model is effective to search for L dwarfs from astronomical images.

79 ASTRONOMY AND ASTROPHYSICS↗

Active Learning Surrogates for Integrating Electron Microscopy and Computational Insights from Simulations in Autonomous Experiments

Artificial Intelligence (AI) combined with simulations and experiments has great potential to accelerate scientific discovery across technology and pharmaceuticals. However, the gap between simulations and experiments is challenging due to disparities in time and scale, making it difficult to estimate properties like energy and electronic states from experiments, and to provide feedback based on theoretical insights.Our research addresses the challenge by developing unique deep kernel based surrogate models that learns from microscopic images, mapping structural features to energy differences from defect formation. We start with full-training using simulated images to determine optimal settings, establishing a baseline for active learning. Using these settings from the baseline, active learning is trained, and predicts structures along simulation trajectories based on uncertainty and energetic stability, thus reducing data requirements, simulation time and computational costs. The results demonstrate that the model achieves a low average error margin of approximately 0.03 meV, indicating good performance. To enhance feature extraction and reconstruction capabilities, we developed an autoencoder-decoder as additional surrogate to create latent space to capture essential features, enabling precise comparisons between simulations and experiments. The results from this model achieved a reconstruction loss of around 0.2 and accurately reconstructed molecular structures.Overall, this work advances the steering of experiments through computational simulations by employing a surrogate models that actively predicts the trajectories of structural evolution, achieving time-to-solution comparable to experimental measurements.

Saranathan, Gayathri [Hewlett-Packard]↗

Shell Timeout Scripts

Automatic shell timeout configuration scripts for POSIX shells (bash/zsh) and C shells (csh/tcsh). These scripts automatically set shell timeout values based on User ID (UID) or Group ID (GID) membership (including secondary groups). When a matching user logs in, their shell will automatically terminate after a configured period of inactivity. NOTE: Not all shells implement this feature. Features UID and/or GID-based timeout configuration Additive and subtractive list management Validation of timeout values (positive integers only) Can set timeout to readonly (bash/zsh).

Riehecky, Pat [Fermilab]↗

Machine Learning Prediction of Tritium‐Helium Groundwater Ages in the Central Valley, California, USA

Abstract Groundwater ages provides insight into recharge rates, flow velocities, and vulnerability to contaminants. The ability to predict groundwater ages based on more accessible parameters via Machine Learning (ML) would advance our ability to guide sustainable management of groundwater resources. In this study, ML models were trained and tested on a large data set of tritium concentrations and tritium‐helium groundwater ages from the California Central Valley, a large groundwater basin with complex land use, irrigation, and water management practices. The ML models were trained on 63 features, including location, well construction information, landscape characteristics, and climate variables, water chemistry, and stable isotopes. The Bagging regressor method can accurately classify (F1‐score = 0.91) groundwater samples as either modern or pre‐modern whereas the accuracy of the ML prediction of continuous tritium‐helium groundwater ages is limited and explains only of the variability in this data set. In general, ML groundwater age prediction relies mostly on features related to (a) the source of groundwater recharge, (b) contaminant history, (c) aquifer materials, (d) well construction, and (e) geochemical reactions along flow paths.

54 ENVIRONMENTAL SCIENCES↗

DUET - Distribution of Understory using Elliptical Transport: A mechanistic model of leaf litter and herbaceous spatial distribution based on tree canopy structure

Heterogeneity in surface fuels produced by overstory trees and understory vegetation is a major driver of fire behavior and ecosystem dynamics. Previous attempts at predicting tree leaf and needle litter accumulation over time have been constrained in scope to probabilistic models that consider a limited number of key factors influencing tree litter dispersal patterns and decomposition processes. Here we present a mechanistic model for estimating variation in surface fuels called the Distribution of Understory using Elliptical Transport (DUET). DUET uses a pre-generated voxelated canopy array and distributes the leaf litter from the trees in an elliptical shape based on tree species characteristics, wind data, and location-specific features. DUET then calculates grass growth between trees and around the litter patterns and sets moisture levels based on relative humidity. In this study, we use DUET to simulate spatial distributions of leaf litter and illustrate model sensitivity to several parameters, providing inputs for testing fuel spatial heterogeneity impacts on fire behavior using process-based models.

54 ENVIRONMENTAL SCIENCES↗

Enhancing Monte Carlo Workflows for Nuclear Reactor Analysis with Metamodel-Driven Modeling

Monte Carlo codes are essential components of many reactor physics simulation workflows as high-fidelity continuous-energy neutron transport solvers. Among Monte Carlo radiation transport codes, MCNP is particularly notable due to its diverse simulation capabilities, large user base, and long validation history. Despite being a powerful simulation tool, MCNP provides limited capabilities to allow automated execution, model transformation, or support for user-defined logic and abstractions that limit its compatibility with modern workflows. Here, to better integrate MCNP into a modern scientific workflow, we have developed an intuitive yet full-featured MCNP Application Program Interface (API) in Python, named MCNPy, which provides a specialized set of classes for MCNP input development. Moreover, to guarantee that our reading, writing, and modeling capabilities remain self-consistent (and to render the huge scope of the MCNP API manageable), we have adopted a strategy of model-driven software development in which a generalized model of the MCNP input format has been created. From this generalized model, or “metamodel,” problem-specific implementations such as an engine for input validation or a codebase for programmatic operations may be automatically generated. Since MCNPy primarily acts as a Python front-end to the underlying Java API that directly interfaces with the metamodel, it is intrinsically linked to the metamodel and thus remains maintainable. With MCNPy, users can programmatically read, write, and modify any syntactically valid MCNP input file regardless of its origin. These capabilities allow users to automate complicated tasks like design optimization and model translation for nuclear systems. As examples, this work demonstrates the use of MCNPy to find the critical radius of a plutonium sphere and to translate a 9000+ line MCNP input file into a corresponding OpenMC model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Characterizing Sub-Cohorts via Data Normalization and Representation Learning

The process of identifying a cohort of interest is a very challenging task. It requires manually inspecting many patient records of complex structure that might include medical coding errors and missing data. This paper presents a computational pipeline for refining the process of cohort selection based on medical concepts recorded in the electronic health records (EHRs). The pipeline extracts EHR data for a given cohort and normalizes this data using standard vocabularies. Then a stacked denoising autoencoder is used to embed the normalized patient vectors in a low dimensional space, where the patients are subsequently clustered into sub-cohorts. The goal is to represent the cohort in a standard format and abstract variants of sub-populations. As a use-case, we applied the pipeline to 1.8 million Veterans diagnosed with major depressive disorder (MDD), and identified four meaningful sub-cohorts using the features learned by the autoencoder. Then, each sub-cohort was explored using a set of keywords for interpretation.

Rush III, Everett↗

Scalar Field Comparison with Topological Descriptors: Properties and Applications for Scientific Visualization

In topological data analysis and visualization, topological descriptors such as persistence diagrams, merge trees, contour trees, Reeb graphs, and Morse–Smale complexes play an essential role in capturing the shape of scalar field data. Herein we present a state–of–the–art report on scalar field comparison using topological descriptors. We provide a taxonomy of existing approaches based on visualization tasks associated with three categories of data: single fields, time–varying fields, and ensembles. These tasks include symmetry detection, periodicity detection, key event/feature detection, feature tracking, clustering, and structure statistics. Our main contributions include the formulation of a set of desirable mathematical and computational properties of comparative measures, and the classification of visualization tasks and applications that are enabled by these measures.

97 MATHEMATICS AND COMPUTING↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

Changing food nitrogen flow in a food-exporting city

Introduction Nitrogen (N) plays a significant role in food systems, but only a fraction of N is effectively utilized and the rest is lost to the environment and negatively affects the ecosystem. So far, there has been relatively little research on N flow associated with the food production and consumption of production-oriented cities in developing countries. Methods In this study, we present a comprehensive analysis of N flow in the food production and consumption system of Changchun in China between 1991 and 2014, and define three types of nitrogen use efficiency (NUE) and compare them. Results (1) Total new N input into the food system in Changchun increased by 63.75% (240.8 to 394.3 Gg N yr −1 ) during the study period, mainly attributable to the high volume of food exports(total output from 47.63 to 72.51 Gg N yr −1 ). (2) Changchun typically exhibited lower apparent NUE and virtual NUE of the food system, while its actual NUE was typically higher, compared to food-importing cities. (3) The consumption of crop food witnessed a decrease from 24.2 Gg N in 1991 to 18.7 Gg N in 2014, whereas the consumption of animal food showed an upward trend from 2.5 Gg N to 7.7 Gg N. Both urban and rural residents consumed less grain food but more fruits and meat. (4) The total N loss has increased from 131.3 Gg N in 1991 to 266.6 Gg N in 2014. The crop production caused 58.1% of the total N loss in 2014, and the atmospheric loss accounted for 40.2% of the total. Conclusion The study has revealed the distinctive features, fluctuations, and underlying drivers of N flow in the food-exporting city, setting it apart from food-importing city. These findings provide a valuable point of reference for the implementation of customized and diversified nitrogen management strategies in these specific urban areas.

Huang, Wei↗

APPLICATION OF MATURITY MODELS FOR EVALUATING CYBERSECURITY PROGRAMS AT NUCLEAR AND RADIOLOGICAL FACILITIES

Maturity models can be used to provide government agencies, industry associations, and organizations operating nuclear facilities with the ability to quickly evaluate the maturity of their cybersecurity programs and identify areas to prioritize for improvement. The Cybersecurity Capability Maturity Model (C2M2) was developed by the U.S. Department of Energy to allow organizations in the energy sector to evaluate the programmatic capabilities of their cybersecurity programs in a consistent manner, communicate programmatic maturity information, prioritize cybersecurity investments in targeted areas of concern, and track how the maturity of their cybersecurity program evolves over time. The C2M2 is designed for use by any critical infrastructure organization regardless of ownership, structure, or size. The C2M2 can be easily fine-tuned to access the maturity of nuclear cybersecurity programs and their application at individual facilities. Built on a foundation of existing cybersecurity standards, frameworks, programs, and initiatives, the model features 10 security domains. Performance in each security domain is characterized using a structured set of cybersecurity practices that represent activities an organization can perform to improve cybersecurity in their domain. Each practice can be quickly evaluated as being either fully, largely, partially, or not implemented. Once practices are evaluated for each security domain, the model defines four maturity indicator levels that apply independently to each domain in the model. To earn a maturity level in a given domain, an organization must adequately perform all the practices for that maturity level and its predecessor level(s). A small assessment team can conduct a C2M2 assessment in a single day. A screening version of the C2M2 allows an initial look at the maturity of nuclear cybersecurity programs that could be completed in under an hour.

Cyber security, Nuclear security, maturity model↗

Chemometric modeling of power conversion efficiency of organic dyes in dye sensitized solar cells for the future renewable energy

The present study reports chemometric modeling of power conversion efficiency (PCE) of dye sensitized solar cells (DSSCs) using the biggest available data set till date which comprises around 1200 dyes covering 7 chemical classes. To extract the best structural features required for higher PCE, we have developed multiple partial least squares (PLS) quantitative structure-property relationship (QSPR) models for the Triphenylamine, Phenothiazine, Indoline, Porphyrin, Coumarin, Carbazole and Diphenylamine chemical classes using descriptors derived from the best subset selection method followed by selection of best five models in each dataset based on the Mean Absolute Error (MAE) values. The models were validated both internally and externally followed by the consensus predictions employing “Intelligent Consensus Predictor” tool to examine whether the quality of predictions can be improved with the “intelligent” selection of multiple PLS models. The quality of predictions for the respective external sets showed that the consensus models (CM) are better than the individual models (IM) in most of the cases. From the insights of the developed models, we concluded that attributes like a packed structure toward higher conductivity of electrons, auxiliary donor fragment of aromatic tertiary amines, number of thiophenes inducing the bathochromic shift and augmenting the absorption, presence of additional electron donors, enhancement of electron-donating abilities, number of non-aromatic conjugated C(sp 2 ) which helps as conjugation extension units to broaden the absorption and highly conjugated $π$-systems exert positive contributions to the PCE. On the contrary, features negatively contributing to PCE are the followings: fragments which lower the tendency of localized $π–π*$ transition, fragments related to larger volume and surface area of dyes along with hydrophobicity resulting in poor adhesion, fragment RC = N causing dye hydrolysis, steric hindrance for π electronic mobility, fragments enhancing polarity, etc. Finally, the identified features from the best QSPR model of the coumarin dataset was employed in designing of ten more efficient coumarin dyes (predicted %PCE ranging from 8.93 to 10.62) than the existing ones.

14 SOLAR ENERGY↗

Ensemble learning-iterative training machine learning for uncertainty quantification and automated experiment in atom-resolved microscopy

Deep learning has emerged as a technique of choice for rapid feature extraction across imaging disciplines, allowing rapid conversion of the data streams to spatial or spatiotemporal arrays of features of interest. However, applications of deep learning in experimental domains are often limited by the out-of-distribution drift between the experiments, where the network trained for one set of imaging conditions becomes sub-optimal for different ones. This limitation is particularly stringent in the quest to have an automated experiment setting, where retraining or transfer learning becomes impractical due to the need for human intervention and associated latencies. Here we explore the reproducibility of deep learning for feature extraction in atom-resolved electron microscopy and introduce workflows based on ensemble learning and iterative training to greatly improve feature detection. This approach allows incorporating uncertainty quantification into the deep learning analysis and also enables rapid automated experimental workflows where retraining of the network to compensate for out-of-distribution drift due to subtle change in imaging conditions is substituted for human operator or programmatic selection of networks from the ensemble. This methodology can be further applied to machine learning workflows in other imaging areas including optical and chemical imaging.

36 MATERIALS SCIENCE↗