Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Multiscale modeling and laser diagnostics to reveal non-equilibrium reaction chemistry at a plasma-liquid interface

Low-temperature, atmospheric-pressure plasmas in contact with liquid are at the core of a wide range of applications including water treatment, medicine, materials synthesis, and chemical transformation. In general, plasma-liquid processes are scientifically compelling because reactivity can be produced without a catalyst, in relatively inert molecules, such as air or nitrogen and liquid water, in their native states at ambient conditions. However, reactions at a plasma-liquid interface are extremely complex, occurring at a multiphase, gas-liquid boundary where excited or dissociate gaseous species dissolve and react with solution-phase species, and unique reaction pathways are induced by non-equilibrium chemistry. In particular, detailed knowledge of the physical and chemical processes, including what species are produced in the gas phase and how these species are subsequently transported across and react near the interfacial region, remains largely unanswered. In this project, modeling of the non-equilibrium reaction chemistry at the interface of low-temperature, atmospheric-pressure plasmas and liquid water is developed, supported by advanced laser diagnostics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term, high-frequency measurements from ARM in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data.

54 ENVIRONMENTAL SCIENCES↗

Transfer learning for probabilistic localization of hidden cracks in concrete structures

Abstract The utility of discriminative supervised learning models built using multiple training-data sources is investigated for hidden crack localization in concrete. Feed-forward neural network (FFNN) is chosen as the model architecture, and transfer learning is used to assimilate the information obtained from different sources (computational physics simulations and laboratory experiments). The labeled training data consists of values of a damage index and the known locations of hidden cracks. The classification models need to learn how the presence of damage (hidden cracks) affects the damage index at different sensors for different test conditions. To this end, diagnostic FFNN models are built by sequentially adding and training new hidden layers to assimilate labeled information from computer models (different model geometries, test conditions, crack lengths, crack locations) and laboratory experiments on a plain cement slab. These transfer learning-based models are then used to localize damage in concrete specimens that reflect real-world conditions (i.e., specimens with steel reinforcement and randomly distributed aggregate). The actual damage state in these specimens is determined by extracting cores and performing petrographic studies on the extracted cores. The damage probability estimated by transfer learning-based models is compared with the petrographic damage rating index (DRI) to identify the most suitable approach to train the diagnostic models. The transfer learning-based diagnostic methodology shows promise and could be used in various structural health monitoring applications, where sufficient labeled data are typically not available from a single data source.

Miele, S.↗

ARM data-oriented metrics and diagnostics package for climate model evaluation (ARM-DIAGS-V3) version 3

A Python-based metrics and diagnostics package is currently being developed by the ARM Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term high frequency measurements from the ARM program in evaluating the regional climate simulation of clouds, radiation, precipitation, and aerosols. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The CMIP model data sets are also included in the package to enable model inter-comparison as demonstrated in Zhang et al. (2018) and Zhang et al. (2020). The mean of the CMIP model can be served as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, aerosol optical depth, and radiative fluxes, with plan to extend to more fields, such as the evaluation of model simulated aerosol physicochemical properties and cloud microphysics properties. Process-oriented diagnostics focusing on aerosol, cloud, and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. In addition to the Southern Great Plains (SGP), North Slope of Alaska (NSA) and Tropical Western Pacific (TWP) atmospheric observatories in the ARMDIAGS version 2.0, the version 3.0 package have extended to the data collected at the ARM Eastern North Atlantic (ENA) atmospheric observatory and the Observation and Modeling of the Green Ocean Amazon (GOAMAZON) field campaign. The metrics and diagnostics package are currently built upon standard Python libraries and additional Python packages developed by DOE (CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first provide an overview of major metrics in section 2. The input data, which constitutes the core content of the metrics and diagnostics package, is summarized in section 3. A user's guide documenting the workflow/structure of the version 3.0 codes and including step-by-step instruction for running the package is described in section 4.

54 ENVIRONMENTAL SCIENCES↗

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗

Improving Reliability of Large Language Models for Nuclear Power Plant Diagnostics Technical Presentation

Large Language Models (LLMs) struggle out of the box when answering factually about detailed questions, especially in domains that are sparsely represented in their training data. This causes hallucinations and reduces reliability making it difficult for them to be used in practice. This work shows that using RAG techniques can improve factual accuracy and reliability, allowing for the application of LLMs in specialized areas, even when those areas that aren’t extensively covered in their initial training.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Diagnostic evaluation of numerical model simulations using the tendency equation

A procedure is proposed to expand the diagnostic capabilities of the pressure tendency equation of a primitive equation NWP model by computing the pressure tendency in physical coordinates. The advantages of isolating the density advection as a diagnostic tool to understand pressure changes is shown. By simple thermodynamic arguments it is demonstrated that in areas of synoptic-scale cyclonic development, the vertically integrated density advection is more than sufficient to explain the depletion of mass over a growing depression. Consequently, the joint contribution of the net divergence and vertical motion opposes the pressure fall. This is illustrated for a case of rapid cyclogenesis in southern South America.

Jusem, Juan C.↗

Transportation technology: Earth-to-orbit propulsion

The topics presented are covered in viewgraph form and include the following: (1) sensor autodiagnosis and autocalibration; (2) autodiagnostic and autocalibration program; (3) plume diagnostics; (4) plume diagnostics program; (5) failure modeling; (6) mass data storage and retrieval; (7) fiber optic instrumentation bus; (8) model based diagnostics; (9) safety monitoring system (SMS); (10) control and real time diagnostics; (11) current intelligent controls program; (12) augumented intelligent controls program; (13) current real time diagnostics program; (14) augumented RT diagnostics program; and (15) control and diagnostic system hardware.

Gorland, S.↗

An Overview of the NASA Aviation Safety Program Propulsion Health Monitoring Element

The NASA Aviation Safety Program (AvSP) has been initiated with aggressive goals to reduce the civil aviation accident rate, To meet these goals, several technology investment areas have been identified including a sub-element in propulsion health monitoring (PHM). Specific AvSP PHM objectives are to develop and validate propulsion system health monitoring technologies designed to prevent engine malfunctions from occurring in flight, and to mitigate detrimental effects in the event an in-flight malfunction does occur. A review of available propulsion system safety information was conducted to help prioritize PHM areas to focus on under the AvSP. It is noted that when a propulsion malfunction is involved in an aviation accident or incident, it is often a contributing factor rather than the sole cause for the event. Challenging aspects of the development and implementation of PHM technology such as cost, weight, robustness, and reliability are discussed. Specific technology plans are overviewed including vibration diagnostics, model-based controls and diagnostics, advanced instrumentation, and general aviation propulsion system health monitoring technology. Propulsion system health monitoring, in addition to engine design, inspection, maintenance, and pilot training and awareness, is intrinsic to enhancing aviation propulsion system safety.

Simon, Donald L.↗

A balanced diagnostic system compatible with a barotropic prognostic model

A system of diagnostic equations for the velocity field, or wind laws, for a barotropic primitive-equation model of large-scale atmospheric flow is derived. Attention is given to the classical balance equation and its ellipticity condition. Numerical solutions of the diagnostic system are presented, including examples of cases of the mixed elliptic-hyperbolic type and cases with non-zero divergence. Procedures for implementing such a system are outlined, along with a review of factors in using the technique for operational numerical weather prediction.

Ghil, M.↗

A Hybrid Neural Network-Genetic Algorithm Technique for Aircraft Engine Performance Diagnostics

In this paper, a model-based diagnostic method, which utilizes Neural Networks and Genetic Algorithms, is investigated. Neural networks are applied to estimate the engine internal health, and Genetic Algorithms are applied for sensor bias detection and estimation. This hybrid approach takes advantage of the nonlinear estimation capability provided by neural networks while improving the robustness to measurement uncertainty through the application of Genetic Algorithms. The hybrid diagnostic technique also has the ability to rank multiple potential solutions for a given set of anomalous sensor measurements in order to reduce false alarms and missed detections. The performance of the hybrid diagnostic technique is evaluated through some case studies derived from a turbofan engine simulation. The results show this approach is promising for reliable diagnostics of aircraft engines.

Kobayashi, Takahisa↗

Integrated Data Analysis to Improve Te and Zeff Measurement on NSTX-U

The multi-energy soft x-ray (ME-SXR) camera is a new concept for a fusion plasma diagnostic based on a pixelated detector with adjustable photon cutoff thresholds. It is a single, compact, solid-state detector which combines spatial and spectral sensitivity and can be configured remotely at run time, making it ideal for a fusion environment. The detector can be configured for application to a wide range of physics problems including impurity transport, electron temperature profiles, and non-thermal effects. The detector has been installed on the Madison Symmetric Torus (MST) as part of a collaboration between Princeton Plasma Physics Laboratory and the University of Wisconsin–Madison to develop the technology and analysis techniques. A full diagnostic forward model of the ME-SXR diagnostic has been developed to enable analysis of the raw photon count data. This model incorporates the atomic physics underlying the plasma emission, diagnostic geometry, and detector response characteristics. Employing this model, a Bayesian analysis approach is used to extract electron temperature from the raw data. This analysis approach uses all available information, clearly quantifies prior information, and handles uncertainties transparently. The ME-SXR camera is being used to study the 3D (helical, stellarator-like) state that forms in the MST device. This helical core structure has improved energy confinement. The transition to the helical state is accompanied by a rise in electron temperature in the central part of the helical structure, but then this enhancement fluctuates. The characteristics of this fluctuation are being compared to a magneto-hydrodynamics model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Model-based Health Monitoring and Diagnostic System for the UH-60 Helicopter

Model-based reasoning techniques hold much promise in providing comprehensive monitoring and diagnostics capabilities for complex systems. We are exploring the use of one of these techniques, which utilizes multi-signal modeling and the TEAMS-RT real-time diagnostic engine, on the UH-60 Rotorcraft Aircrew Systems Concepts Airborne Laboratory (RASCAL) flight research aircraft. We focus on the engine and transmission systems, and acquire sensor data across the 1553 bus as well as by direct analog-to-digital conversion from sensors to the QHuMS (Qualtech health and usage monitoring system) computer. The QHuMS computer uses commercially available components and is rack-mounted in the RASCAL facility. A multi-signal model of the transmission and engine subsystems enables studies of system testability and analysis of the degree of fault isolation available with various instrumentation suites. The model and examples of these analyses will be described and the data architectures enumerated. Flight tests of this system will validate the data architecture and provide real-time flight profiles to be further analyzed in the laboratory.

Patterson-Hine, Ann↗

Biogeochemical Protocols and Diagnostics for the CMIP6 Ocean Model Intercomparison Project (OMIP)

The Ocean Model Intercomparison Project (OMIP) focuses on the physics and biogeochemistry of the ocean component of Earth system models participating in the sixth phase of the Coupled Model Intercomparison Project (CMIP6). OMIP aims to provide standard protocols and diagnostics for ocean models, while offering a forum to promote their common assessment and improvement. It also offers to compare solutions of the same ocean models when forced with reanalysis data (OMIP simulations) vs. when integrated within fully coupled Earth system models (CMIP6). Here we detail simulation protocols and diagnostics for OMIP's biogeochemical and inert chemical tracers. These passive-tracer simulations will be coupled to ocean circulation models, initialized with observational data or output from a model spin-up, and forced by repeating the 1948-2009 surface fluxes of heat, fresh water, and momentum. These so-called OMIP-BGC simulations include three inert chemical tracers (CFC-11, CFC-12, SF [subscript] 6) and biogeochemical tracers (e.g., dissolved inorganic carbon, carbon isotopes, alkalinity, nutrients, and oxygen). Modelers will use their preferred prognostic BGC model but should follow common guidelines for gas exchange and carbonate chemistry. Simulations include both natural and total carbon tracers. The required forced simulation (omip1) will be initialized with gridded observational climatologies. An optional forced simulation (omip1-spunup) will be initialized instead with BGC fields from a long model spin-up, preferably for 2000 years or more, and forced by repeating the same 62-year meteorological forcing. That optional run will also include abiotic tracers of total dissolved inorganic carbon and radiocarbon, CTabio and 14CTabio, to assess deep-ocean ventilation and distinguish the role of physics vs. biology. These simulations will be forced by observed atmospheric histories of the three inert gases and CO2 as well as carbon isotope ratios of CO2. OMIP-BGC simulation protocols are founded on those from previous phases of the Ocean Carbon-Cycle Model Intercomparison Project. They have been merged and updated to reflect improvements concerning gas exchange, carbonate chemistry, and new data for initial conditions and atmospheric gas histories. Code is provided to facilitate their implementation.

Carbon↗

A Pacific Tropical Decadal Variability Challenge for Climate Models

Understanding and forecasting Tropical Pacific Decadal-scale Variability (TPDV) strongly rely on climate model simulations. Using a Linear Inverse Modeling (LIM) diagnostic approach, we reveal Coupled Model Intercomparison Project Phase 6 models have significant challenges in reproducing the spatial structure and dominant mechanisms of TPDV. Specifically, while the models' ensemble mean pattern of TPDV resembles that of observations, the spread across models is very large and most models show significant differences from observations. In observations, removing the coupling between extratropics and tropics reduces TPDV by ~60%–70%, and removing the tropical thermocline variability makes the central tropical Pacific a key center of action for TPDV and El Niño Southern Oscillation variability. These characteristics are only confirmed in a subset of models. Differences between observations and simulations are outside the range of natural internal TPDV noise and pose important questions regarding our ability to model the impacts of natural internal low-frequency variability superimposed on long-term climate change.

54 ENVIRONMENTAL SCIENCES↗

Using Transport Diagnostics to Understand Chemistry Climate Model Ozone Simulations

We demonstrate how observations of N2O and mean age in the tropical and midlatitude lower stratosphere (LS) can be used to identify realistic transport in models. The results are applied to 15 Chemistry Climate Models (CCMs) participating in the 2010 WMO assessment. Comparison of the observed and simulated N2O/mean age relationship identifies models with fast or slow circulations and reveals details of model ascent and tropical isolation. The use of this process-oriented N2O/mean age diagnostic identifies models with compensating transport deficiencies that produce fortuitous agreement with mean age. We compare the diagnosed model transport behavior with a model's ability to produce realistic LS O3 profiles in the tropics and midlatitudes. Models with the greatest tropical transport problems show the poorest agreement with observations. Models with the most realistic LS transport agree more closely with LS observations and each other. We incorporate the results of the chemistry evaluations in the SPARC CCMVal Report (2010) to explain the range of CCM predictions for the return-to-1980 dates for global (60 S-60 N) and Antarctic column ozone. Later (earlier) Antarctic return dates are generally correlated to higher (lower) vortex Cl(sub y) levels in the LS, and vortex Cl(sub y) is generally correlated with the model's circulation although model Cl(sub y) chemistry or Cl(sub y) conservation can have a significant effect. In both regions, models that have good LS transport produce a smaller range of predictions for the return-to-1980 ozone values. This study suggests that the current range of predicted return dates is unnecessarily large due to identifiable model transport deficiencies.

Strahan, S. E.↗

A Model-Based Expert System for Space Power Distribution Diagnostics

When engineers diagnose system failures, they often use models to confirm system operation. This concept has produced a class of advanced expert systems that perform model-based diagnosis. A model-based diagnostic expert system for the Space Station Freedom electrical power distribution test bed is currently being developed at the NASA Lewis Research Center. The objective of this expert system is to autonomously detect and isolate electrical fault conditions. Marple, a software package developed at TRW, provides a model-based environment utilizing constraint suspension. Originally, constraint suspension techniques were developed for digital systems. However, Marple provides the mechanisms for applying this approach to analog systems such as the test bed, as well. The expert system was developed using Marple and Lucid Common Lisp running on a Sun Sparc-2 workstation. The Marple modeling environment has proved to be a useful tool for investigating the various aspects of model-based diagnostics. This report describes work completed to date and lessons learned while employing model-based diagnostics using constraint suspension within an analog system.

Quinn, Todd M.↗