Search NASA⌕ Search

SEARCH · Search NASA

Results for “causal reasoning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

29 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Why it is Unfortunate that Linear Machine Learning “Works” so well in Electromechanical Switching of Ferroelectric Thin Films

Machine learning (ML) is relied on for materials spectroscopy. It is challenging to make ML models fail because statistical correlations can mimic the physics without causality. Here, using a benchmark band-excitation piezoresponse force microscopy polarization spectroscopy (BEPS) dataset the pitfalls of the so-called “better”, “faster”, and “less-biased” ML of electromechanical switching are demonstrated and overcome. Using a toy and real experimental dataset, it is demonstrated how linear nontemporal ML methods result in physically reasonable embedding (eigenvalues) while producing nonsensical eigenvectors and generated spectra, promoting misleading interpretations. A new method of unsupervised multimodal hyperspectral analysis of BEPS is demonstrated using long-short-term memory (LSTM) β-variational autoencoders (β-VAEs) . By including LSTM neurons, the ordinal nature of ferroelectric switching is considered. Further, to improve the interpretability of the latent space, a variational Kullback–Leibler-divergency regularization is imposed . Finally, regularization scheduling of β as a disentanglement metric is leveraged to reduce user bias. Combining these experiment-inspired modifications enables the automated detection of ferroelectric switching mechanisms, including a complex two-step, three-state one. Ultimately, this work provides a robust ML method for the rapid discovery of electromechanical switching mechanisms in ferroelectrics and is applicable to other multimodal hyperspectral materials spectroscopies.

36 MATERIALS SCIENCE↗
DOE OSTI2025

From Machine Learning to Machine Reasoning: A Model-based Approach to Analyze Equipment Reliability Data

In current nuclear power plants (NPPs) a large amount of condition-based data which can be used to assess and monitor component health and performance. Assessing component health from such data can be performed with a large variety of methods. While the analysis of numeric data can be performed with several methods, the extraction of information from textual data remains a challenge. Currently employed natural language processing (NLP) methods do not really provide quantitative information that might be contained in IRs. In addition, the integration of numeric and textual data to identify possible causal relationships between data elements is still an unresolved challenge. This paper presents an approach to extract information from textual (e.g., incident or maintenance reports) and numeric data that relies on model based system engineer (MBSE) models. MBSE are diagrams designed to represent system and component dependencies (from both a form and functional point of view). In our approach, MBSE models emulate system engineer knowledge about component/system architecture. NLP methods are employed to perform syntactic and semantic analyses. Syntactic analysis analyzes the grammatical structure of a sentence while semantic analysis is designed to analyze the logic structure of a sentence. An innovative element of our approach is that semantic analysis uses MBSE models to identify links between textual elements. Similarly, numeric data is directly linked to elements of the MBSE models in order to map which functions are being monitored.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Decision-making based on Markov decision process in integrated artificial reasoning framework—Part I: Theory

This paper presents a decision-making framework based on an integrated artificial reasoning framework and Markov decision process (MDP). The integrated artificial reasoning framework provides a physics-based approach that converts system information into state transition models, and the analysis result will be represented by the transition probabilities that can be used with an MDP to find a traceable and explainable optimal pathway. A dynamic Bayesian network (DBN) is well suited for representing the structure of an MDP. The causality information among process variables (or among subsystems) is mathematically represented in a DBN by the conditional probabilities of the node’s states provided different probabilities of the parent node’s states. To define node states in a physically understandable manner, we used multilevel flow modeling (MFM). An MFM follows the fundamental energy and mass conservation laws and supports the selection of process variables that represent the system of interest so that causal relations among process variables are properly captured. An MFM-based DBN supports developing state transition models in an MDP to capture the effect of process variables of system having physical relations. The operators of the target system can capture stochastic system dynamics as multiple subsystem state transitions based on their physical relations and uncertainties coming from component degradation or random failures. We analyzed a simplified exemplary system to illustrate an optimal operational policy using the suggested approach.

Markov decision process↗
DOE OSTI2022

Divertor plasma detachment: roles of plasma momentum, energy, and particle balances

Abstract Contrary to statements from some recent papers, the bifurcation of the scrape-off layer and divertor plasma parameters, as described within a 1D model, does exist. The analysis of both numerical simulations and experimental data shows that the real physical reasons that can cause a strong reduction of the plasma particle flux to the target j d are impurity radiation loss and volumetric plasma recombination. Fitting the parameter describing the ‘plasma momentum removal’, based on the results of 2D numerical simulations, then using this fit in subsequent analytic expressions for j d , and finally interpreting the evolution of j d as the result of elastic plasma-neutral interactions break the causality principle and lead to a wrong physical picture of divertor plasma detachment.

Physics↗
DOE OSTI2021

Lessons Learned—Fluoride Exposure and Response

Laboratory research can expose workers to a wide variety of chemical hazards. Researchers must not only take personal responsibility for their safety but also inevitably rely on coworkers to also work safely. The foundations for protocols, requirements, and behaviors come from our history and lessons learned from others. For that reason, here, a recent incident is examined in which a researcher suffered hydrofluoric acid (HF) burns while working with an inorganic digestion mixture of aqueous HF (8%) and nitric acid (HNO 3 , 58%). HF education is critical for workers because delays in treatment, improper treatment, and delay of symptoms are all factors in unfavorable outcomes in case reports. Furthermore, while the potential severity of the incident was elevated due to bypassed engineered controls and lack of proper personal protective equipment, only minor injuries were sustained. We discuss the results of a causal analysis of the incident that revealed areas of improvement in protocols, personal protective equipment, and emergency response that could help prevent similar accidents from occurring. We also present simple improvements that anyone can implement to reduce the potential consequences of an accident, based upon our lessons learned.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Astrophysical Equation-of-State Constraints on the Color-Superconducting Gap

We demonstrate that astrophysical constraints on the dense-matter equation of state place an upper bound on the color-superconducting gap in dense matter above the transition from nuclear matter to quark matter. Pairing effects in the color-flavor locked quark matter phase increase the pressure at high density, and if this effect is sufficiently large then the requirements of causality and mechanical stability make it impossible to reach such a pressure in a way that is consistent with what is known at lower densities. The intermediate-density equation of state is inferred by considering extensions of chiral effective field theory to neutron star densities, and conditioning these using current astrophysical observations of neutron star radius, maximum mass, and tidal deformability (PSR J⁢0348+0432, PSR J1624-2230, PSR J⁢0740+6620, GW170817). At baryon number chemical potential μ = 2.6 GeV we find a 95% upper limit on the color-flavor locked pairing gap Δ of 457 MeV using overly conservative assumptions and 216 MeV with more reasonable assumptions. Furthermore, this constraint may be strengthened by future astrophysical measurements as well as by future advances in high-density QCD calculations.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

RingX: Scalable Parallel Attention for Long-Context Learning on HPC

The attention mechanism has become foundational for remarkable AI breakthroughs since the introduction of the Transformer, driving the demand for increasingly longer context to power frontier models such as large-scale reasoning language models and high-resolution image/video generators. However, its quadratic computational and memory complexities present substantial challenges. Current state-of-the-art parallel attention methods, such as ring attention, are widely adopted for long-context training but utilize a point-to-point communication strategy that fails to fully exploit the capabilities of modern HPC network architectures. In this work, we propose ringX, a scalable family of parallel attention methods optimized explicitly for HPC systems. By enhancing workload partitioning, refining communication patterns, and improving load balancing, ringX achieves up to 3.4 × speedup compared to conventional ring attention on the Frontier supercomputer. Optimized for both bi-directional and causal attention mechanisms, ringX demonstrates its effectiveness through training benchmarks of a Vision Transformer (ViT) on a climate dataset and a Generative Pre-Trained Transformer (GPT) model, Llama3 8B. Our method attains an end-to-end training speedup of approximately 1.5 × in both scenarios. To our knowledge, the achieved 38% model FLOPs utilization (MFU) for training Llama3 8B with a 1M-token sequence length on 4,096 GPUs represents one of the highest training efficiencies reported for long-context learning on HPC systems. Our code implementation is available at https://github.com/jqyin/ringX-attention.

Yin, Junqi [ORNL] (ORCID:0000000338435520)↗
DOE OSTI2020

An Applied Strategy for Using Empirical and Hybrid Models in Online Monitoring

The monitoring of plant equipment for failure prediction is one of the key contributors to operation and maintenance (O&M) costs for a nuclear power plant (NPP) because O&M monitoring depends on labor-intensive activities that are required to meet high equipment reliability standards. These activities rely primarily on humans for information gathering, condition diagnosis, and predictive analysis. Online monitoring aims to automate these activities by relying on sensors to replace human information gathering and machine learning to replace human analysis and decision making. To facilitate automated monitoring, a systematic strategy for anomaly detection is needed to optimally use the available sensor data, empirical models, and physics-supported models. This strategy is essential to provide credible reasoning on why and when an empirical (i.e., purely data-driven) versus hybrid (i.e., physics-supported) approach should be used and to determine the ideal mix of these two approaches for a defined anomaly detection scope. The extant methods usually adopt an ad hoc trial-and-error approach that, in addition to being time-consuming and costly, is also highly subjective; it is impacted by the background and the skill set of the personnel making the decisions. Thus, such an approach cannot guarantee an optimum outcome. This represents the motivation of the current research effort, which is focused on devising a scientifically supported strategy for the optimum selection of anomaly detection methods. This report presents a detailed assessment of the main anomaly detection techniques within the empirical or hybrid method streams. Empirical methods include pattern, statistical, and causal inference. Hybrid methods include the use of physics models to train and test data methods, reduce data dimensionality, reduce data-model complexity, augment data, and reduce empirical uncertainty; hybrid methods also include the use of data to tune physics models. The listed techniques within these two streams represent the vast majority of techniques performed for anomaly detection. Using the techniques as outcomes, a strategy was developed to enable a systematic decision-making process to lead to one of these techniques. The strategy is driven by key decision points related to data relevance, simple modeling feasibility, data inference, physics-modeling value, data dimensionality, physics knowledge, method of validation, performance, data availability and suitability for training and testing, cause-effect, entropy inference, and model fitting. Each of these decision points in the strategy is explained in detail in this report with examples, along with the scientific basis behind the decisions and outcomes in common and simplified terminology. The strategy is developed for use by any NPP staff with basic engineering or science knowledge. A user-friendly graphical state flow diagram was also developed as a visual presentation of the strategy. The strategy was tested and demonstrated through two pilot projects for the application of anomaly detection at an NPP. Each pilot had two use cases: an initial case in which certain decisions were made that resulted in one or more empirical techniques and a revised use case where one or more key decisions were modified resulting in using a set of hybrid methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Effective radiative forcing of anthropogenic aerosols in E3SMv1: historical changes, causality, decomposition, and parameterization sensitivities

The effective radiative forcing of anthropogenic aerosols (ERF aer ) is an important measure of the anthropogenic aerosol effects simulated by a global climate model. Here we analyze ERF aer simulated by the E3SMv1 atmosphere model using both century-long free-running atmosphere-land simulations and short nudged simulations. We relate the simulated ERF aer to characteristics of the aerosol composition and optical properties, and evaluate the relationships between key aerosol and cloud properties. In terms of historical changes from the year 1870 to 2014, our results show that the global mean anthropogenic aerosol burden and optical depth increase during the simulation period as expected, but the regional averages show large differences in the temporal evolution. The largest regional differences are found in the emission-induced evolution of the burden and optical depth of the sulfate aerosol: a strong decreasing trend is seen in the Northern Hemisphere high-latitude region after around 1970, while a continued increase is simulated in the tropics. Consequently, although the global mean anthropogenic aerosol burden and optical depth increase from 1870 to 2014, the ERF aer magnitude does not increase after around year 1970. The relationships between key aerosol and cloud properties (relative changes between preindustrial and present-day conditions) also show evident changes after 1970, diverging from the linear relationships exhibited for the period from 1870 to 2014. The ERF aer in E3SMv1 is relatively large compared to the recently published multi-model estimates; the primary reason is the large indirect aerosol effect (i.e., through aerosol-cloud interactions). Compared to other models, E3SMv1 features a stronger sensitivity of the cloud droplet effective radius to changes in the cloud droplet number concentration. Large sensitivity is also seen in the liquid cloud optical depth, which is determined by changes in both the effective radius and liquid water path. Aerosol-induced changes in liquid and ice cloud properties in E3SMv1 are found to have a strong correlation, as the evolution of anthropogenic sulfate aerosols affects both the liquid cloud formation and the homogeneous ice nucleation in cirrus clouds. The ERF aer estimates in E3SMv1 for the shortwave and longwave components are sensitive to the parameterization changes in both liquid and ice cloud processes. When the parameterization of ice cloud processes is modified, the top-of-atmosphere forcing changes in the shortwave and longwave components largely offset each other, so the net effect is negligible. This suggests that, to reduce the magnitude of the net ERF aer , it would be more effective to reduce the anthropogenic aerosol effect through liquid or mixed-phase clouds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Effective radiative forcing of anthropogenic aerosols in E3SM version 1: historical changes, causality, decomposition, and parameterization sensitivities

Abstract. The effective radiative forcing of anthropogenic aerosols (ERFaer) is an important measure of the anthropogenic aerosol effects simulated by a global climate model. Here we analyze ERFaer simulated by the E3SM version 1 (E3SMv1) atmospheric model using both century-long free-running atmosphere–land simulations and short nudged simulations. We relate the simulated ERFaer to characteristics of the aerosol composition and optical properties, and we evaluate the relationships between key aerosol and cloud properties. In terms of historical changes from the year 1870 to 2014, our results show that the global mean anthropogenic aerosol burden and optical depth increase during the simulation period as expected, but the regional averages show large differences in the temporal evolution. The largest regional differences are found in the emission-induced evolution of the burden and optical depth of the sulfate aerosol: a strong decreasing trend is seen in the Northern Hemisphere high-latitude region after around 1970, while a continued increase is simulated in the tropics. The relationships between key aerosol and cloud properties (relative changes between pre-industrial and present-day conditions) also show evident changes after 1970, diverging from the linear relationships exhibited for the period of 1870–1969. In addition to the regional differences in the simulated relationships, a reduced sensitivity in cloud droplet number and other cloud properties to aerosol perturbations is seen when the aerosol perturbation is large. Consequently, the global annual mean ERFaer magnitude does not increase after around 1970. The ERFaer in E3SMv1 is relatively large compared to the recently published multi-model estimates; the primary reason is the large indirect aerosol effect (i.e., through aerosol–cloud interactions). Compared to other models, E3SMv1 features large relative changes in the cloud droplet effective radius in response to aerosol perturbations. Large sensitivity is also seen in the liquid cloud optical depth, which is determined by changes in both the effective radius and liquid water path. Aerosol-induced changes in liquid and ice cloud properties in E3SMv1 are found to have a strong correlation, as the evolution of anthropogenic sulfate aerosols affects both the liquid cloud formation and the homogeneous ice nucleation in cirrus clouds (that causes a large effect on longwave ERFaer). As suggested by a previous study, the large ERFaer appears to be one of the reasons why the model cannot reproduce the observed global mean temperature evolution in the second half of the 20th century. Sensitivity simulations are performed to understand which parameterization and/or parameter changes have a large impact on the simulated ERFaer. The ERFaer estimates in E3SMv1 for the shortwave and longwave components are sensitive to the parameterization changes in both liquid and ice cloud processes. When the parameterization of ice cloud processes is modified, the top-of-model forcing changes in the shortwave and longwave components largely offset each other, so the net effect is negligible. This suggests that, to reduce the magnitude of the net ERFaer, it would be more effective to reduce the anthropogenic aerosol effect through liquid or mixed-phase clouds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Evaluation of liquid cloud albedo susceptibility in E3SM using coupled eastern North Atlantic surface and satellite retrievals

The impact of aerosol number concentration on cloud albedo is a persistent source of spread in global climate predictions due to multi-scale, interactive atmospheric processes that remain difficult to quantify. We use 5 years of geostationary satellite and surface retrievals at the US Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) eastern North Atlantic (ENA) site in the Azores to evaluate the representation of liquid cloud albedo susceptibility for overcast cloud scenes in the DOE Energy Exascale Earth System Model version 1 (E3SMv1) and provide possible reasons for model–observation discrepancies. The overall distribution of surface 0.2 % CCN concentration values is reasonably simulated, but simulated liquid water path (LWP) is lower than observed and layer mean droplet concentration (N d ) comparisons are highly variable depending on the N d retrieval technique. E3SMv1's cloud albedo is greater than observed for given LWP and N d values due to a lower cloud effective radius than observed. However, the simulated albedo response to N d is suppressed due to a correlation between the solar zenith angle (SZA) and N d created by the seasonal cycle that is not observed. Controlling for this effect by examining the cloud optical depth (COD) shows that E3SMv1's COD response to CCN concentration is greater than observed. For surface-based retrievals, this is only true after controlling for cloud adiabaticity because E3SMv1's adiabaticities are much lower than observed. Assuming a constant adiabaticity in surface retrievals as done in top-of-atmosphere (TOA) retrievals narrows the retrieved ln N d distribution, which increases the cloud albedo sensitivity to ln N d to match the TOA sensitivity. The greater sensitivity of COD to CCN is caused by a greater Twomey effect in which the sensitivity of N d to CCN is greater than observed for TOA-retrieved N d , and once model–observation cloud adiabaticity differences are removed, this is also true for surface-retrieved N d . The LWP response to N d in E3SMv1 is overall negative as observed. Despite reproducing the observed LWP–N d relationship, observed clouds become much more adiabatic as N d increases, while E3SMv1 clouds do not, associated with more heavily precipitating clouds that are partially but not completely caused by deeper clouds and weaker inversions in E3SMv1. These cloud property differences indicate that the negative LWP–N d relationship is likely not caused by the same mechanisms in E3SMv1 and observations. The negative simulated LWP response also fails to mute the excessively strong Twomey effect, highlighting potentially important confounding factor effects that likely render the LWP–N d relationship non-causal. N d retrieval scales and assumptions, particularly related to cloud adiabaticity, contribute to substantial spreads in the model–observation comparisons, though enough consistency exists to suggest that aerosol activation, drizzle, and entrainment processes are critical areas to focus E3SMv1 development for improving the fidelity of aerosol–cloud interactions in E3SM.

54 ENVIRONMENTAL SCIENCES↗