Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

AI foundation models for experimental fusion tasks

Artificial Intelligence (AI) foundation models, while successful in various domains of language, speech, and vision, have not been adopted in production for fusion energy experiments. This brief paper presents how AI foundation models can be used for fusion energy diagnostics, enabling, for example, visual automated logbooks to provide greater insights into chains of plasma events in a discharge, in time for between-shot analysis.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Validation of the imaging neutral particle analyzer in nearly MHD quiescent plasmas using injected beam ions on DIII-D

The imaging neutral particle analyzer (INPA) is a scintillator-based diagnostic that provides energy and radially resolved measurements of confined fast ions. To verify operation, understanding, and modeling of the diagnostic performance, distributions of deuterium beam ions in low density, nearly MHD-quiescent plasmas are measured on the DIII-D tokamak using the INPA. Here, the distribution is altered by changing the pitch-angle scattering rate with electron cyclotron heating (ECH). Experimental images are mostly reproduced with simulation of core fast ions charge exchanging with injected beam and edge cold neutrals in classical cases. Image comparisons between the experiment and simulation show agreement with less than 25% discrepancies near the beam injection energy of 50 keV. Other strong passive signals, observed in a localized region on the image, are suggested to come from charge exchange between cold neutrals and fast ions around the plasma boundary.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Comprehensive Neural Posterior Estimation for Galaxy-Galaxy Strong Lensing

We present a deep learning model based on neural posterior estimation (NPE) for comprehensive extraction of astrophysical parameters from galaxy-scale strong gravitational lenses. The unprecedentedly large amount of galaxy-scale strong lenses expected in future cosmological surveys (${\cal O}(10^5)$) promises to enable valuable statistical constraints in various studies ranging from galaxy formation to the nature of dark matter, but it also poses a significant challenge for traditional modelling pipelines. To this end, our automated model includes several new, state-of-the-art features and approaches leveraging the framework of simulation-based inference (SBI). We infer a total of 20 parameters describing the mass and light profiles of both lens and source galaxies, using simulated raw multi-band data modelled under noise and observing conditions expected by the Legacy Survey of Space and Time (LSST), with its summary statistics generated by a residual network. We examine the efficacy of multi-band data in extracting nearly 20 model parameters simultaneous from strong lensing images including lens light. Finally, We perform a comprehensive set of diagnostics for SBI models, evaluating the model's prediction accuracy, stability, and uncertainty quantification.

Zhao, Roy J. [Chicago U., KICP]↗
DOE OSTI2025

Advancing the Representation of Human Actions in Large‐Scale Hydrological Models: Challenges and Future Research Directions

Characterizing the impact of human actions on terrestrial water fluxes and storages at multi-basin, continental, and global scales has long been on the agenda of scientists engaged in climate science, hydrology, and water resources systems analysis. This need has resulted in a variety of modeling efforts focused on the representation of water infrastructure operations. Yet, the representation of human-water interactions in large-scale hydrological models is still relatively crude, fragmented across models, and often achieved at coarse resolutions (~10–100 km) that cannot capture local water management decisions. In this commentary, we argue that the concomitance of four drivers and innovations is poised to change the status quo: “hyper-resolution” hydrological models (~0.1–1 km), multi-sector modeling, satellite missions able to monitor the outcome of human actions, and machine learning are creating a fertile environment for human-water research to flourish. We then outline four challenges that chart future research in hydrological modeling: (a) creating hyper-resolution global data sets of water management practices, (b) improving the characterization of anthropogenic interventions on water quantity, stream temperature, and sediment transport, (c) improving model calibration and diagnostic evaluation, and (d) reducing the computational requirements associated with the successful exploration of these challenges. Overcoming them will require addressing modeling, computational, and data development needs that cut across the hydrology community, thereby requiring a major communal effort.

catchment hydrology↗
DOE OSTI2023

Process-Oriented Diagnostics: Principles, Practice, Community Development, and Common Standards

Process-oriented diagnostics (PODs) aim to provide feedback for model developers through model analysis based on physical hypotheses. However, the step from a diagnostic based on relationships among variables, even when hypothesis driven, to specific guidance for revising model formulation or parameterizations can be substantial. The POD may provide more information than a purely performance-based metric, but a gap between POD principles and providing actionable information for specific model revisions can remain. Furthermore, in coordinating diagnostics development, there is a trade-off between freedom for the developer, aiming to capture innovation, and near-term utility to the modeling center. Best practices that allow for the former, while conforming to specifications that aid the latter, are important for community diagnostics development that leads to tangible model improvements. Promising directions to close the gap between principles and practice include the interaction of PODs with perturbed physics experiments and with more quantitative process models as well as the inclusion of personnel from modeling centers in diagnostics development groups for immediate feedback during climate model revisions. Examples are provided, along with best-practice recommendations, based on practical experience from the NOAA Model Diagnostics Task Force (MDTF). Common standards for metrics and diagnostics that have arisen from a collaboration between the MDTF and the Department of Energy’s Coordinated Model Evaluation Capability are advocated as a means of uniting community diagnostics efforts.

58 GEOSCIENCES↗
DOE OSTI2026

Correlation function metrology for warm dense matter: Recent developments and practical guidelines

X-ray Thomson scattering (XRTS) has emerged as a valuable diagnostic for matter under extreme conditions, as it captures the intricate many-body physics of the probed sample. Recent advances, such as the model-free temperature diagnostic of Dornheim et al. [Nat. Commun. 13 , 7911 (2022)], have demonstrated how much information can be extracted directly within the imaginary-time formalism. However, since the imaginary-time formalism is a concept often difficult to grasp, we provide here a systematic overview of its theoretical foundations and explicitly demonstrate its practical applications to temperature inference, including relevant subtleties. Furthermore, we present recent developments that enable the determination of the absolute normalization, Rayleigh weight, and density from XRTS measurements without reliance on uncontrolled model assumptions. Finally, we outline a unified workflow that guides the extraction of these key observables, offering a practical framework for applying the method to interpret experimental measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Evaluation of Mesoscale Convective Systems in Climate Simulations: Methodological Development and Results from MPAS-CAM over the U.S.

In this study, a process-oriented approach is developed to evaluate warm-season mesoscale convective system (MCS) precipitation and their favorable large-scale meteorological patterns (FLSMPs) over the U.S. This approach features a novel observation-driven MCS-tracking algorithm using infrared brightness temperature and precipitation feature at 12, 25 and 50 km resolution and metrics to evaluate the model large-scale environment favorable for MCS initiation. The tracking algorithm successfully reproduces the observed MCS statistics from a reference 4-km radar MCS database. To demonstrate the utility of the new methodologies in evaluating MCS in climate simulations with mesoscale resolution, the process-oriented approach is applied to two climate simulations produced by the Variable-Resolution Model for Prediction Across Scales coupled to the Community Atmosphere Model physics, with refined horizontal grid spacing at 50 km and 25 km over North America. With the tracking algorithm applied to simulations and observations at equivalent resolutions, the simulated number of MCS and associated precipitation amount, frequency and intensity are found to be consistently underestimated in the Central U.S., particularly from May to August. The simulated MCS precipitation shows little diurnal variation and lasts too long, while MCS precipitation area is too large and intensity is too weak. The model is able to simulate four types of observed FLSMP associated with frontal systems and low-level jets (LLJ) in spring, but the frequencies are underestimated because of low-level dry bias and weaker LLJ. Precipitation simulated under different FLSMPs peak during daytime, in contrast to the observed nocturnal peak. Implications of these findings for future model development and diagnostics are discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Global biomass supply modeling for long-run management of the climate system

Bioenergy is projected to have a prominent, valuable, and maybe essential, role in climate management. However, there is significant variation in projected bioenergy deployment results, as well as concerns about the potential environmental and social implications of supplying biomass. Bioenergy deployment projections are market equilibrium solutions from integrated modeling, yet little is known about the underlying modeling of the supply of biomass as a feedstock for energy use in these modeling frameworks. We undertake a novel diagnostic analysis with ten global models to elucidate, compare, and assess how biomass is supplied within the models used to inform long-run climate management. With experiments that isolate and reveal biomass supply modeling behavior and characteristics (costs, emissions, land use, market effects), we learn about biomass supply tendencies and differences. The insights provide a new level of modeling transparency and understanding of estimated global biomass supplies that informs evaluation of the potential for bioenergy in managing the climate and interpretation of integrated modeling. For each model, we characterize the potential distributions of global biomass supply across regions and feedstock types for increasing levels of quantity supplied, as well as some of the potential societal externalities of supplying biomass. We also evaluate the biomass supply implications of managing these externalities. Finally, we interpret biomass market results from integrated modeling in terms of our new understanding of biomass supply. Overall, we find little consensus between models on where biomass could be cost-effectively produced and the implications. We also reveal model specific biomass supply narratives, with results providing new insights into integrated modeling bioenergy outcomes and differences. The analysis finds that many integrated models are considering and managing emissions and land use externalities of supplying biomass and estimating that environmental and societal trade-offs in the form of land emissions, land conversion, and higher agricultural prices are cost-effective, and to some degree a reality of using biomass, to address climate change.

09 BIOMASS FUELS↗
DOE OSTI2023

Simulation of a rapid compression machine for evaluation of ignition chemistry and soot formation using gasoline/ethanol blends

Due to the projected decline of demand for gasoline in light duty engines and the advent of ethanol as a green fuel, the use of gasoline/ethanol blend fuels in heavy duty applications are being investigated as they are projected to have lower cost and lower lifecycle green house gas (GHG) emissions. In heavy duty engines, the primary mode of combustion is mixing controlled combustion where wide range of mixture conditions (equivalence ratio) exist. Soot emissions of these fuels in richer conditions are not well understood. The goal of this research is to evaluate some commercially available soot modeling codes for the particulate matter emissions from gasoline/ethanol fuel blends, especially at fuel rich conditions. A Rapid Compression Machine (RCM) is modeled in a three-dimensional numerical simulation using CONVERGE computational software using a reduced chemical kinetic mechanism with SAGE chemistry solver and a RANS k-ϵturbulence model with a sector model including the creviced piston. The creviced piston is used in the experimental setup to reduce boundary layer effects and to maintain a homogeneous core in the reaction cylinder. Computational fluid dynamics simulations are conducted for different gasoline-ethanol fuel blends from E10 (10% ethanol v/v) to E100. The fuel blend is modeled as a surrogate mixture of toluene, iso-octane, n-heptane for gasoline content, and ethanol. The computational results were validated against experimental results using pressure measurements and laser extinction diagnostics. Different soot models are investigated to evaluate their capability of predicting the sooting tendencies of fuel blends, especially in richer conditions experienced during mixing-controlled combustion. The experimental combustion characteristics such as the ignition delay of different blends of fuel are reasonably well predicted. The Particulate Size Mimic (PSM) model accurately predicts the soot generation characteristics of the different fuels, but the Hiroyasu-NSC model falls short in this regard. For accurate prediction of soot with the PSM model, the thermodynamic conditions during combustion must be accurately modeled. While the current computational modeling tools can produce accurate results for the prediction of particulate matter emissions, there is much work to be done in improving our understanding of the underlying fundamental processes.

Energy & Fuels↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗
DOE OSTI2024

IDAES-PSE 2.5.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.5.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New diagnostics check for near-parallel variables and constraints. New diagnostics tools for identifying causes of infeasibility in models. New example for creating a custom model of a liquid-liquid extractor unit operation. Bug Fixes Fixed bug in Gibbs reactor that caused it to appear to have additional spurious degrees of freedom. Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Testing and Robustness Deployed the IDAES Diagnostics Toolbox to confirm that there are no structural or numerical issues in the core model libraries. Additional robustness tests for core model, and some associated improvements in the converge tester class. Fixed a number of issues that were causing unexpected warnings to be emitted during testing. Deprecations and Removals Removed examples for RIPE tool which has not been supported for a number of releases.

AS↗
DOE OSTI2020

Online Modelling and Optimization of Nonlinear Integrable Systems

Nonlinear integrable optics was recently proposed as a design approach to increase the limits on beam brightness and intensity imposed by fast collective instabilities. To study these systems experimentally, a new research electron and proton storage ring, the Integrable Optics Test Accelerator, was constructed and recently commissioned at Fermilab. Beam-based diagnostics and online modelling of nonlinear systems presents unique challenges - in this paper, we report on our efforts to develop optimization methods suited for such lattices. We explore the effectiveness of neural networks as fast online surrogate estimators, and integrate them into a beam-based tuning algorithm. We also develop a method of knob dimensionality reduction and subsequent robust multivariate optimization for maximizing key performance metrics under complicated lattice optics constraints.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Spatial-Temporal Recurrent Graph Neural Networks for Fault Diagnostics in Power Distribution Systems

Fault diagnostics are extremely important to decide proper actions toward fault isolation and system restoration. The growing integration of inverter-based distributed energy resources imposes strong influences on fault detection using traditional overcurrent relays. This paper utilizes emerging graph learning techniques to build new temporal recurrent graph neural network models for fault diagnostics. The temporal recurrent graph neural network structures can extract the spatial-temporal features from data of voltage measurement units installed at the critical buses. From these features, fault event detection, fault type/phase classification, and fault location are performed. Compared with previous works, the proposed temporal recurrent graph neural networks provide a better generalization for fault diagnostics. Moreover, the proposed scheme retrieves the voltage signals instead of current signals so that there is no need to install relays at all lines of the distribution system. Therefore, the proposed scheme is generalizable and not limited by the number of relays installed. The effectiveness of the proposed method is comprehensively evaluated on the Potsdam microgrid and IEEE 123-node system in comparison with other neural network structures.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗
DOE OSTI2024

Probabilistic machine learning for battery health diagnostics and prognostics—review and perspectives

Abstract Diagnosing lithium-ion battery health and predicting future degradation is essential for driving design improvements in the laboratory and ensuring safe and reliable operation over a product’s expected lifetime. However, accurate battery health diagnostics and prognostics is challenging due to the unavoidable influence of cell-to-cell manufacturing variability and time-varying operating circumstances experienced in the field. Machine learning approaches informed by simulation, experiment, and field data show enormous promise to predict the evolution of battery health with use; however, until recently, the research community has focused on deterministic modeling methods, largely ignoring the cell-to-cell performance and aging variability inherent to all batteries. To truly make informed decisions regarding battery design in the lab or control strategies for the field, it is critical to characterize the uncertainty in a model’s predictions. After providing an overview of lithium-ion battery degradation, this paper reviews the current state-of-the-art probabilistic machine learning models for health diagnostics and prognostics. Details of the various methods, their advantages, and limitations are discussed in detail with a primary focus on probabilistic machine learning and uncertainty quantification. Last, future trends and opportunities for research and development are discussed.

25 ENERGY STORAGE↗
DOE OSTI2025

Water Mass Transformation Budgets in Finite‐Volume Generalized Vertical Coordinate Ocean Models

Water Mass Transformation (WMT) theory provides conceptual tools that in principle enable innovative analyses of numerical ocean models; in practice, however, these methods can be challenging to implement and interpret, and therefore remain under-utilized. Our aim is to demonstrate the feasibility of diagnosing all terms in the water mass budget and to exemplify their usefulness for scientific inquiry and model development by quantitatively relating water mass changes, overturning circulations, boundary fluxes, and interior mixing. We begin with a pedagogical derivation of key results of classical WMT theory. We then describe best practices for diagnosing each of the water mass budget terms from the output of Finite-Volume Generalized Vertical Coordinate (FV-GVC) ocean models, including the identification of a non-negligible remainder term as the spurious numerical mixing due to advection scheme discretization errors. We illustrate key aspects of the methodology through the analysis of a polygonal region of the Greater Baltic Sea in a regional demonstration simulation using the Modular Ocean Model v6 (MOM6). We verify the convergence of our WMT diagnostics by brute-force, comparing time-averaged (“offline”) diagnostics on various vertical grids to timestep-averaged (“online”) diagnostics on the native model grid. Finally, we briefly describe a stack of xarray-enabled Python packages for evaluating WMT budgets in FV-GVC models (culminating in the new xwmb package), which is intended to be model-agnostic and available for community use and development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modeling the 3-D structure of ignition experiments at the NIF

This study details a model used to infer the 3-D structure of the stagnated hot-spot and shell of inertial confinement fusion implosion experiments at the National Ignition Facility. The model assumes that 3-D low-mode drive perturbations can account for the majority of stagnation asymmetries experimentally observed. It uses an adaptive sampling algorithm to navigate the 24-D input parameter space to find a 3-D x-ray flux asymmetry whose application to an otherwise symmetric implosion results in a consistent match between synthetic and experimental diagnostic observables. The model is applied to a series of experiments and is able to achieve a consistent match for over 41 different observables, providing a high-fidelity reconstruction of the stagnation hot-spot and shell profile.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗