Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Fault Tree Based Diagnosis with Optimal Test Sequencing for Field Service Engineers

When field service engineers go to customer sites to service equipment, they want to diagnose and repair failures quickly and cost effectively. Symptoms exhibited by failed equipment frequently suggest several possible causes which require different approaches to diagnosis. This can lead the engineer to follow several fruitless paths in the diagnostic process before they find the actual failure. To assist in this situation, we have developed the Fault Tree Diagnosis and Optimal Test Sequence (FTDOTS) software system that performs automated diagnosis and ranks diagnostic hypotheses based on failure probability and the time or cost required to isolate and repair each failure. FTDOTS first finds a set of possible failures that explain exhibited symptoms by using a fault tree reliability model as a diagnostic knowledge to rank the hypothesized failures based on how likely they are and how long it would take or how much it would cost to isolate and repair them. This ordering suggests an optimal sequence for the field service engineer to investigate the hypothesized failures in order to minimize the time or cost required to accomplish the repair task. Previously, field service personnel would arrive at the customer site and choose which components to investigate based on past experience and service manuals. Using FTDOTS running on a portable computer, they can now enter a set of symptoms and get a list of possible failures ordered in an optimal test sequence to help them in their decisions. If facilities are available, the field engineer can connect the portable computer to the malfunctioning device for automated data gathering. FTDOTS is currently being applied to field service of medical test equipment. The techniques are flexible enough to use for many different types of devices. If a fault tree model of the equipment and information about component failure probabilities and isolation times or costs are available, a diagnostic knowledge base for that device can be developed easily.

Iverson, David L.↗
DOE OSTI2026

Correlation function metrology for warm dense matter: Recent developments and practical guidelines

X-ray Thomson scattering (XRTS) has emerged as a valuable diagnostic for matter under extreme conditions, as it captures the intricate many-body physics of the probed sample. Recent advances, such as the model-free temperature diagnostic of Dornheim et al. [Nat. Commun. 13 , 7911 (2022)], have demonstrated how much information can be extracted directly within the imaginary-time formalism. However, since the imaginary-time formalism is a concept often difficult to grasp, we provide here a systematic overview of its theoretical foundations and explicitly demonstrate its practical applications to temperature inference, including relevant subtleties. Furthermore, we present recent developments that enable the determination of the absolute normalization, Rayleigh weight, and density from XRTS measurements without reliance on uncontrolled model assumptions. Finally, we outline a unified workflow that guides the extraction of these key observables, offering a practical framework for applying the method to interpret experimental measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1986

Regional-scale estimates of surface moisture availability and thermal inertia using remote thermal measurements

A review is presented of numerical models which were developed to interpret thermal IR data and to identify the governing parameters and surface energy fluxes recorded in the images. Analytic, predictive, diagnostic and empirical models are described. The limitations of each type of modeling approach are explored in terms of the error sources and inherent constraints due to theoretical or measurement limitations. Sample results of regional-scale soil moisture or evaporation patterns derived from the Heat Capacity Mapping Mission and GOES satellite data through application of the predictive model devised by Carlson (1981) are discussed. The analysis indicates that pattern recognition will probably be highest when data are collected over flat, arid, sparsely vegetated terrain. The soil moisture data then obtained may be accurate to within 10-20 percent.

Carlson, T. N.↗
NASA NTRS2008

Testing HyDE on ADAPT

The IVHM Project in the Aviation Safety Program has funded research in electrical power system (EPS) health management. This problem domain contains both discrete and continuous behavior, and thus is directly relevant for the hybrid diagnostic tool HyDE. In FY2007 work was performed to expand the HyDE diagnosis model of the ADAPT system. The work completed resulted in a HyDE model with the capability to diagnose five times the number of ADAPT components previously tested. The expanded diagnosis model passed a corresponding set of new ADAPT fault injection scenario tests with no incorrect faults reported. The time required for the HyDE diagnostic system to isolate the fault varied widely between tests; this variance was reduced by tuning HyDE input parameters. These results and other diagnostic design trade-offs are discussed. Finally, possible future improvements for both the HyDE diagnostic model and HyDE itself are presented.

Sweet, Adam↗
DOE OSTI2020

Evaluation of Mesoscale Convective Systems in Climate Simulations: Methodological Development and Results from MPAS-CAM over the U.S.

In this study, a process-oriented approach is developed to evaluate warm-season mesoscale convective system (MCS) precipitation and their favorable large-scale meteorological patterns (FLSMPs) over the U.S. This approach features a novel observation-driven MCS-tracking algorithm using infrared brightness temperature and precipitation feature at 12, 25 and 50 km resolution and metrics to evaluate the model large-scale environment favorable for MCS initiation. The tracking algorithm successfully reproduces the observed MCS statistics from a reference 4-km radar MCS database. To demonstrate the utility of the new methodologies in evaluating MCS in climate simulations with mesoscale resolution, the process-oriented approach is applied to two climate simulations produced by the Variable-Resolution Model for Prediction Across Scales coupled to the Community Atmosphere Model physics, with refined horizontal grid spacing at 50 km and 25 km over North America. With the tracking algorithm applied to simulations and observations at equivalent resolutions, the simulated number of MCS and associated precipitation amount, frequency and intensity are found to be consistently underestimated in the Central U.S., particularly from May to August. The simulated MCS precipitation shows little diurnal variation and lasts too long, while MCS precipitation area is too large and intensity is too weak. The model is able to simulate four types of observed FLSMP associated with frontal systems and low-level jets (LLJ) in spring, but the frequencies are underestimated because of low-level dry bias and weaker LLJ. Precipitation simulated under different FLSMPs peak during daytime, in contrast to the observed nocturnal peak. Implications of these findings for future model development and diagnostics are discussed.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2009

Alternative Representations of Convective Processes in the NASA GEOS-5 AGCM

The gap in explicit resolution of phenomena between global climate models and cloud resolving models is shrinking at a steady pace with global integrations of several km in resolution now practical for at least some time scales. In moving toward finer resolution the long standing problem of convective parameterization is being examined along with the assumption of convective quasi-equilibrium and how this can be reconciled with the stochastic and intermittent nature of convection. In this context we examine the nature of parameterized convection in the NASA Goddard Earth Observing System (GEOS-5) Atmospheric General Circulation Model. Our analysis uses both coarse (2.5 degree) and fine scale 0.25 degree spatial resolution integrations. Two basic formulations are compared: the default option is the Relaxed Arakawa-Schubert (RAS) scheme which invokes a sequence of linearly entraining plumes and quasi-equilibrium closure. An optional modification of this method (the "Stochastic Tokioka" constraint) places a random lower limit on plume entrainment. An alternative representation is the Kain-Fritsch parameterization which was originally developed for mesoscale numerical modeling strategies. Here entrainment is determined by a crude buoyancy sorting approach that allows the plume spectrum to be more responsive to ambient vertical stratification of moisture. Diagnostics of the model behavior are referenced to recent observational evidence of continuous phase transition behavior. In particular we examine the relationship between column water vapor and probablility of convective presence and intensity. Sensitivity of the statistics of convective behavior to parcel mixing/entrainment formulations and parcel initial thermodynamics are considered. Observational statistics from A-Train and TRMM sensors provide validation of the model integrations.

Robertson, Franklin↗
NASA NTRS1996

Method of Testing and Predicting Failures of Electronic Mechanical Systems

A method employing a knowledge base of human expertise comprising a reliability model analysis implemented for diagnostic routines is disclosed. The reliability analysis comprises digraph models that determine target events created by hardware failures human actions, and other factors affecting the system operation. The reliability analysis contains a wealth of human expertise information that is used to build automatic diagnostic routines and which provides a knowledge base that can be used to solve other artificial intelligence problems.

Iverson, David L.↗
NASA NTRS2021

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗
DOE OSTI2022

Global biomass supply modeling for long-run management of the climate system

Bioenergy is projected to have a prominent, valuable, and maybe essential, role in climate management. However, there is significant variation in projected bioenergy deployment results, as well as concerns about the potential environmental and social implications of supplying biomass. Bioenergy deployment projections are market equilibrium solutions from integrated modeling, yet little is known about the underlying modeling of the supply of biomass as a feedstock for energy use in these modeling frameworks. We undertake a novel diagnostic analysis with ten global models to elucidate, compare, and assess how biomass is supplied within the models used to inform long-run climate management. With experiments that isolate and reveal biomass supply modeling behavior and characteristics (costs, emissions, land use, market effects), we learn about biomass supply tendencies and differences. The insights provide a new level of modeling transparency and understanding of estimated global biomass supplies that informs evaluation of the potential for bioenergy in managing the climate and interpretation of integrated modeling. For each model, we characterize the potential distributions of global biomass supply across regions and feedstock types for increasing levels of quantity supplied, as well as some of the potential societal externalities of supplying biomass. We also evaluate the biomass supply implications of managing these externalities. Finally, we interpret biomass market results from integrated modeling in terms of our new understanding of biomass supply. Overall, we find little consensus between models on where biomass could be cost-effectively produced and the implications. We also reveal model specific biomass supply narratives, with results providing new insights into integrated modeling bioenergy outcomes and differences. The analysis finds that many integrated models are considering and managing emissions and land use externalities of supplying biomass and estimating that environmental and societal trade-offs in the form of land emissions, land conversion, and higher agricultural prices are cost-effective, and to some degree a reality of using biomass, to address climate change.

09 BIOMASS FUELS↗
DOE OSTI2023

Simulation of a rapid compression machine for evaluation of ignition chemistry and soot formation using gasoline/ethanol blends

Due to the projected decline of demand for gasoline in light duty engines and the advent of ethanol as a green fuel, the use of gasoline/ethanol blend fuels in heavy duty applications are being investigated as they are projected to have lower cost and lower lifecycle green house gas (GHG) emissions. In heavy duty engines, the primary mode of combustion is mixing controlled combustion where wide range of mixture conditions (equivalence ratio) exist. Soot emissions of these fuels in richer conditions are not well understood. The goal of this research is to evaluate some commercially available soot modeling codes for the particulate matter emissions from gasoline/ethanol fuel blends, especially at fuel rich conditions. A Rapid Compression Machine (RCM) is modeled in a three-dimensional numerical simulation using CONVERGE computational software using a reduced chemical kinetic mechanism with SAGE chemistry solver and a RANS k-ϵturbulence model with a sector model including the creviced piston. The creviced piston is used in the experimental setup to reduce boundary layer effects and to maintain a homogeneous core in the reaction cylinder. Computational fluid dynamics simulations are conducted for different gasoline-ethanol fuel blends from E10 (10% ethanol v/v) to E100. The fuel blend is modeled as a surrogate mixture of toluene, iso-octane, n-heptane for gasoline content, and ethanol. The computational results were validated against experimental results using pressure measurements and laser extinction diagnostics. Different soot models are investigated to evaluate their capability of predicting the sooting tendencies of fuel blends, especially in richer conditions experienced during mixing-controlled combustion. The experimental combustion characteristics such as the ignition delay of different blends of fuel are reasonably well predicted. The Particulate Size Mimic (PSM) model accurately predicts the soot generation characteristics of the different fuels, but the Hiroyasu-NSC model falls short in this regard. For accurate prediction of soot with the PSM model, the thermodynamic conditions during combustion must be accurately modeled. While the current computational modeling tools can produce accurate results for the prediction of particulate matter emissions, there is much work to be done in improving our understanding of the underlying fundamental processes.

Energy & Fuels↗
NASA NTRS2015

Diagnostic Reasoning using Prognostic Information for Unmanned Aerial Systems

With increasing popularity of unmanned aircraft, continuous monitoring of their systems, software, and health status is becoming more and more important to ensure safe, correct, and efficient operation and fulfillment of missions. The paper presents integration of prognosis models and prognostic information with the R2U2 (REALIZABLE, RESPONSIVE, and UNOBTRUSIVE Unit) monitoring and diagnosis framework. This integration makes available statistically reliable health information predictions of the future at a much earlier time to enable autonomous decision making. The prognostic information can be used in the R2U2 model to improve diagnostic accuracy and enable decisions to be made at the present time to deal with events in the future. This will be an advancement over the current state of the art, where temporal logic observers can only do such valuation at the end of the time interval. Usefulness and effectiveness of this integrated diagnostics and prognostics framework was demonstrated using simulation experiments with the NASA Dragon Eye electric unmanned aircraft.

Diagnostics↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗
DOE OSTI2024

IDAES-PSE 2.5.0 Release

The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications. IDAES-PSE 2.5.0 Release Highlights Upcoming Changes IDAES will be switching to the new Pyomo solver interface in the next release. Whilst this will hopefully be a smooth transition for most users, there are a few important changes to be aware of. The new solver interface uses a different version of the IPOPT writer (“ipopt_v2”) and thus any custom configuration options you might have set for IPOPT will not carry over and will need to be reset. By default, the new Pyomo linear presolver will be activated with ipopt_v2. Whilst are working to identify any bugs in the presolver, it is possible that some edge cases will remain. IDAES will begin deploying a new set of scaling tools and APIs over the next few releases that make use of the new solver writers. The old scaling tools and APIs will remain for backward compatibility but will begin to be deprecated. New Models, Tools and Features New diagnostics check for near-parallel variables and constraints. New diagnostics tools for identifying causes of infeasibility in models. New example for creating a custom model of a liquid-liquid extractor unit operation. Bug Fixes Fixed bug in Gibbs reactor that caused it to appear to have additional spurious degrees of freedom. Fixed bug in the Modular Property Framework that would cause errors when trying to use phase-based material balances with phase equilibria. Fixed bug in Modular Properties Framework that caused errors when initializing models with non-vapor-liquid phase equilibria. Testing and Robustness Deployed the IDAES Diagnostics Toolbox to confirm that there are no structural or numerical issues in the core model libraries. Additional robustness tests for core model, and some associated improvements in the converge tester class. Fixed a number of issues that were causing unexpected warnings to be emitted during testing. Deprecations and Removals Removed examples for RIPE tool which has not been supported for a number of releases.

AS↗
NASA NTRS1994

Comparison and analysis of aircraft measurements and mesoscale atmospheric chemistry model simulations of tropospheric ozone

The Regional Acid Deposition Model (RADM) has been applied to several of the field experiments which were part of the Acid Models Operational and Diagnostic Evaluation Study (Acid MODES). The experiment which was of particular interest with regards to ozone photochemistry involved horizontal zig-zag flight patterns (ZIPPER) over an area from the eastern Ohio River valley to the Adirondacks of New York. Model simulations by both the standard resolution RADM (delta x = 80 km) and the nested grid RADM (delta x = 26.7 km) compare well to measurements in the low emission regions in central Pennsylvania and upstate New York, but underestimate in the high emission upper Ohio River valley. The nested simulation does considerably better, however, than the coarse grid simulation in terms of horizontal pattern and concentration magnitudes. Analysis of NO(x) and HO(x) concentrations and photochemical products rates of ozone show that the model's response to large point source emissions is very unsystematic both spatially and temporally. This is due to the models instability to realistically simulate the small scale (subgrid) gradients in precursor concentrations in and around large point source plumes.

Pleim, Jonathan E.↗
DOE OSTI2020

Online Modelling and Optimization of Nonlinear Integrable Systems

Nonlinear integrable optics was recently proposed as a design approach to increase the limits on beam brightness and intensity imposed by fast collective instabilities. To study these systems experimentally, a new research electron and proton storage ring, the Integrable Optics Test Accelerator, was constructed and recently commissioned at Fermilab. Beam-based diagnostics and online modelling of nonlinear systems presents unique challenges - in this paper, we report on our efforts to develop optimization methods suited for such lattices. We explore the effectiveness of neural networks as fast online surrogate estimators, and integrate them into a beam-based tuning algorithm. We also develop a method of knob dimensionality reduction and subsequent robust multivariate optimization for maximizing key performance metrics under complicated lattice optics constraints.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1992

Diagnostics of electron-heated solar flare models. III - Effects of tapered loop geometry and preheating

A series of hydrodynamic numerical simulations of nonthermal electron-heated solar flare atmospheres and their corresponding soft X-ray Ca XIX emission-line profiles, under the conditions of tapered flare loop geometry and/or a preheated atmosphere, is presented. The degree of tapering is parameterized by the magnetic mirror ratio, while the preheated atmosphere is parameterized by the initial upper chromospheric pressure. In a tapered flare loop, it is found that the upward motion of evaporated material is faster compared with the case where the flare loop is uniform. This is due to the diverging nozzle seen by the upflowing material. In the case where the flare atmosphere is preheated and the flare geometry is uniform, the response of the atmosphere to the electron collisional heating is slow. The upward velocity of the hydrodynamic gas is reduced due not only to the large coronal column depth, but also to the increased inertia of the overlying material. It is concluded that the only possible electron-heated scenario in which the predicted Ca XIX line profiles agree with the BCS observations is when the impulsive flare starts in a preheated dense corona.

Emslie, A. G.↗
NASA NTRS2003

Review of Diagnostics for Water Sources in General Circulation Models (GCMs)

We will describe the uses of passive tracers in GCMs to compute the geographical sources of water for precipitation. We will present a summary of recent research and how this methodology can be applied in climate and climate change studies. We will also discuss the possibility of using passive tracers in conjunction with simulations and observations of stable observations.

Bosilovich, M.↗