Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Time-Dependent Boundary Modeling to Inform Design of SPARC Diagnostic and Actuators

The purpose of this work was to inform the design of diagnostic and actuator systems for a new experimental facility for Commonwealth Fusion Systems (CFS), called SPARC [Creely2020], using time-dependent plasma boundary simulations with the Scrape Off Layer Plasma Simulator (SOLPS) code [Wiesen2015]. The SPARC tokamak is a device that aims to demonstrate fusion energy production and high-field plasma operating scenarios. The developed technologies will be incorporated into a net-electricity pilot that will demonstrate approximately 200MW of electric power. A major difference from other private industry fusion companies is the use of a standard aspect ratio, but at a high magnetic field strength, which provides a well-established physics basis and a modest extrapolation to reactor operation. Time-dependent simulations were used to inform the design of main-chamber plasma facing components, which are protected by feedback control of the heat and particle loads during high power operation. The simulations provide the timescales and magnitudes of plasma and neutral particle response useful for determining the position and operation of diagnostics and actuators that will enable control. The plasma response and phase-space diagrams also provide input into advanced model-based control schemes, which are envisioned for later SPARC operation. Model-based control can reduce the risk of component failure, which would require expensive in-situ repairs and the associated delays, by predicting the system response to actuators over a short time-horizon.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ENSO-Induced Teleconnection: Process-Oriented Diagnostics to Assess Rossby Wave Sources and Ambient Flow Properties in Climate Models

Climate model fidelity in representing ENSO-induced teleconnection is assessed with process-oriented diagnostics that examine a chain of processes, from equatorial Pacific precipitation to the midlatitude circulation pattern over the Pacific–North American regions. Such processes are rarely addressed during model development. Using an upper-tropospheric divergent level, local vorticity gradient of the ambient zonal flow (∂ 2 U¯/∂y 2 ) and a restoring force for Rossby waves (β * ) are estimated, the equivalent barotropic vorticity equation is solved, and an anomalous Rossby wave source (RWS') quantified. The analysis is applied to AMIP5 and AMIP6 simulations. For a realistic circulation response representation, the hypothesis that models accurately represent the strength and location of RWS', and spatial variations in β * is tested. Compared to AMIP5, in AMIP6 there are clear improvements in representing RWS' and β * . To validate the hypothesis, the analysis identifies two metrics: spatially coherent RWS' in the subtropical North Pacific, and longitudes of negative β * over the western-central North Pacific. By projecting these metrics in two and three-dimensional views, improvements or degradations in model versions are apparent. If a model’s fidelity in representing ∂ 2 U¯/∂y 2 and RWS' are compromised, then radiated Rossby waves are reflected more equatorward, resulting in zonally elongated circulation anomalies over the central North Pacific. Thus, during climate model development, applying this analysis frequently will keep a regular check on the fidelity of the modeled response to anomalous El Niño convection in conjunction with changing model ambient flow dependencies. As a result, this analysis is intended to form a process-oriented diagnostics package, a community contribution to the NOAA Model Diagnostics Task Force.

54 ENVIRONMENTAL SCIENCES↗

Hourly Carbon Fluxes Estimation Using the GOES Advanced Baseline Imager (ABI) Data Over the Conterminous USA

Tremendous efforts by Fluxnet scientists over the past few decades have made thousands of site-years of carbon flux observations available for advancing our understanding of carbon cycling in terrestrial ecosystems. One of key Fluxnet measurements is net ecosystem exchange (NEE) as it is directly related to carbon budget of terrestrial ecosystems. However, carbon flux estimation studies using satellite remote sensing have focused mainly on daily Gross Primary Production (GPP). The satellite based carbon flux estimation used the polar orbiting satellite sensors (e.g., Moderate Resolution Imaging Spectroradiometer (MODIS)), which allow us to observe target regions only once during the day. Because daily NEE is close to zero value, the carbon flux models using the polar orbiting satellite data have not been well used for NEE estimation. The new generation of geostationary satellite sensors (e.g., GOES Advanced Baesline Imager (ABI) and Himawari Advanced Himawari Imager (AHI)) provide frequent observations, often less than every 10 minutes. Here, we use GOES ABI data to estimate hourly NEE over the conterminous USA. We used the Terrestrial Observation Prediction System (TOPS) model for estimating hourly NEE. TOPS is a diagnostic ecosystem process model that simulates the fluxes of carbon and water through vegetation in response to climate variability. For the climate input, we developed hourly climate data using the same algorithm with NASA Earth Exchange Gridded Daily Meteorology (NEX-GDM) datasets based on machine learning techniques. The hourly climate data includes precipitation, maximum temperature, minimum temperature, dew point temperature, and, in particular, solar radiation that is directly derived from the Geostationary observations. The spatial patterns of ecosystem parameters used in TOPS are optimized using satellite Solar Induced Fluorescence (SIF) data. The high frequency GPP estimations from geostationary satellite sensors make it comparable to the instantaneous SIF data than daily GPP. We also used Fluxnet data for optimization of model parameters and the validation of the output. The derived data addresses the diurnal dynamics of carbon cycling at large scales and should help in reducing the uncertainties in carbon budget studies.

Geostationary satellite↗

Development of Carbon Flux Model Using ABI Data Over the Conterminous US

The satellite-driven carbon flux estimation has been playing important role to estimate continental-scale carbon budget. One of the biggest recent advances in the satellite-driven carbon flux modeling is utilization of high-frequent geostationary satellites to estimate diurnal cycle in carbon fluxes. The satellite based carbon flux estimation used the polar orbiting satellite sensors (e.g., Moderate Resolution Imaging Spectroradiometer (MODIS)), which allow us to observe target regions only once during the day. The new generation of geostationary satellite sensors provide frequent observations, often less than every 10 minutes. Here, we use GOES Advanced Baseline Imager (ABI) data to estimate hourly NEE over the conterminous US. We used the Terrestrial Observation Prediction System (TOPS) model for estimating hourly NEE. TOPS is a diagnostic ecosystem process model that simulates the fluxes of carbon and water through vegetation in response to climate variability. For the climate input, we developed hourly climate data using the same algorithm with NASA Earth Exchange Gridded Daily Meteorology (NEX-GDM) datasets based on machine learning techniques. The hourly climate data includes precipitation, maximum temperature, minimum temperature, dew point temperature, and solar radiation were derived from the Geostationary observations. The spatial patterns of ecosystem parameters used in TOPS are optimized using satellite Solar Induced Fluorescence (SIF) data. The high frequency GPP estimations from geostationary satellite sensors make it comparable to the instantaneous SIF data than daily GPP. We also used Ameriflux data for optimization of model parameters and the validation of the output. The derived data addresses the diurnal dynamics of carbon cycling at large scales and should help in reducing the uncertainties in carbon budget studies.

geostationary satellite↗

The NASA-JPL advanced propulsion program

The NASA Advanced Propulsion Concepts (APC) program at the Jet Propulsion Laboratory (JPL) consists of two main areas: The first involves cooperative modeling and research activities between JPL and various universities and industry; the second involves research at universities and industry that is directly supported by JPL. The cooperative research program consists of mission studies, research and development of ion engine technology using C-60 (Buckminsterfullerene) propellant, and research and development of lithium-propellant Lorentz-force accelerator (LFA) engine technology. The university/industry- supported research includes research (modeling and proof-of-concept experiments) in advanced, long-life electric propulsion, and in fusion propulsion. These propulsion concepts were selected primarily to cover a range of applications from near-term to far-term missions. For example, the long-lived pulsed-xenon thruster research that JPL is supporting at Princeton University addresses the near-term need for efficient, long-life attitude control and station-keeping propulsion for Earth-orbiting spacecraft. The C-60-propellant ion engine has the potential for good efficiency in a relatively low specific impulse (Isp) range (10,000 - 30,000 m/s) that is optimum for relatively fast (less than 100 day) cis-lunar (LEO/GEO/Lunar) missions employing near-term, high-specific mass electric propulsion vehicles. Research and modeling on the C-60-ion engine are currently being performed by JPL (engine demonstration), Caltech (C-60 properties), MIT (plume modeling), and USC (diagnostics). The Li-propellant LFA engine also has good efficiency in the modest Isp range (40,000 - 50,000 m/s) that is optimum for near-to-mid-term megawatt-class solar- and nuclear-electric propulsion vehicles used for Mars missions transporting cargo (in support of a piloted mission). Research and modeling on the Li-LFA engine are currently being performed by JPL (cathode development), Moscow Aviation Institute (engine testing), Thermacore (electrode development), as well as at MIT (plume modeling), and USC (diagnostics). Also, the mission performance of a nuclear-electric propulsion (NEP) Li-LFA Mars cargo vehicle is being modeled by JPL (mission analysis; thruster and power processor modeling) and the Rocketdyne Energy Technology and Engineering Center (ETEC) (power system modeling). Finally, the fusion propulsion research activities that JPL is supporting at Pennsylvania State University (PSU) and at Lawrenceville Plasma Physics (LPP) are aimed at far-term fast (less than 100 day round trip) piloted Mars missions and, in the very far term, interstellar missions.

Frisbee, Robert H.↗

Model-driven prediction for accelerator magnet diagnostics to improve operation reliability

Reliability is one of the most critical metrics for accelerator operation, especially in user facilities. To reduce costly facility downtime and provide an operational environment where system performance can be reliably predicted in support of scientific studies, we are developing a model-driven approach for prediction and anomaly detection. Here, in this study, we present the application of a model-driven method that employs a linear regression model to predict the future temperature, in real time, of accelerator magnets at the NSLS-II light source. This approach enables proactive identification of magnet-heating issues, facilitating magnet flushing prior to the occurrence of permanent damage without interrupting machine operation. The implementation of this method in the NSLS-II control room is described and the analysis of the online results is presented. The results demonstrate the model’s effectiveness in providing early alerts to engineers and improving the reliability of accelerator operations.

36 MATERIALS SCIENCE↗

A Generic Modeling Process to Support Functional Fault Model Development

Functional fault models (FFMs) are qualitative representations of a system's failure space that are used to provide a diagnostic of the modeled system. An FFM simulates the failure effect propagation paths within a system between failure modes and observation points. These models contain a significant amount of information about the system including the design, operation and off nominal behavior. The development and verification of the models can be costly in both time and resources. In addition, models depicting similar components can be distinct, both in appearance and function, when created individually, because there are numerous ways of representing the failure space within each component. Generic application of FFMs has the advantages of software code reuse: reduction of time and resources in both development and verification, and a standard set of component models from which future system models can be generated with common appearance and diagnostic performance. This paper outlines the motivation to develop a generic modeling process for FFMs at the component level and the effort to implement that process through modeling conventions and a software tool. The implementation of this generic modeling process within a fault isolation demonstration for NASA's Advanced Ground System Maintenance (AGSM) Integrated Health Management (IHM) project is presented and the impact discussed.

Design Analysis↗

An evidential reasoning extension to quantitative model-based failure diagnosis

The detection and diagnosis of failures in physical systems characterized by continuous-time operation are studied. A quantitative diagnostic methodology has been developed that utilizes the mathematical model of the physical system. On the basis of the latter, diagnostic models are derived each of which comprises a set of orthogonal parity equations. To improve the robustness of the algorithm, several models may be used in parallel, providing potentially incomplete and/or conflicting inferences. Dempster's rule of combination is used to integrate evidence from the different models. The basic probability measures are assigned utilizing quantitative information extracted from the mathematical model and from online computation performed therewith.

Gertler, Janos J.↗

Integration of Condition-Based, Diagnostic, Prognostic, And Anomaly Detection Data into Reliability Models to Support a Predictive Maintenance Context

Reliability data employed in plant reliability models are an approximated integral representation of the past industrywide operational experience, and they neglect the present asset health status (available, for example, from online monitoring data and diagnostic assessments) and forecasted health projection (when available from prognostic models). Ideally, in a predictive maintenance context, system reliability models should support decision making by propagating actual health information from the asset to the system level in order to provide a quantitative snapshot of system health and identify the most critical assets. Asset health should be informed solely by that specific asset’s current and historical performance data and should not be an approximated integral representation of the past industrywide operational experience (as currently performed by system reliability models through Bayesian updating processes). This paper proposes a reliability modeling approach that relies on asset diagnostic and prognostic assessments, along with monitoring data to measure asset health. We show how state-of-the art condition-based, diagnostic, prognostic, and anomaly detection models can be linked to system reliability models not in probability terms, but in terms of margin where margin is defined as the “distance” between the present status and an undesired event (e.g., failure or unacceptable performance). Then, we show how the propagation of margin data from the asset to the system level is performed through classical reliability models such as fault trees or reliability block diagrams. The described method is in fact able to propagate heterogenous health data from the asset to the system level in order to analytically assess system health.

97 MATHEMATICS AND COMPUTING↗

Understanding Air-Sea Feedbacks to the MJO through Process Evaluation of Observations and Models (Final Report)

The goal of our project was to enhance our understanding of the role of coupling in the simulation of the Madden Julian Oscillation (MJO) in coupled climate models. We developed diagnostics of precipitation and Sea Surface Temperature variability in climate models and investigated how they are related to metrics of MJO simulation performance. We found a relationship between models with a high spatial coherence of precipitation and a good propagation of the MJO through the Maritime Continent region, but no relationship between metrics of precipitation organisation and intensity. Analysis of coupled and uncoupled model simulations from the Sixth Coupled Model Intercomparison Project (CMIP6) shows that coupling systematically improved the MJO simulation in both metrics that we investigated. We analysed the role of background moisture gradients in the MJO simulation performance following Lim et al. (2018) and found that although the model to model variation in moisture gradients to the west of Indonesia was related to model MJO performance, in general no single moisture gradient was as good at explaining a large fraction of MJO performance across the models as compared to a linear combination of those metrics, which was able to explain a significant fraction of the variance in the MJO performance. Those relationships were much stronger for coupled simulations than uncoupled simulations and stronger for those metrics that measured propagation of the MJO across the Maritime Continent than for overall MJO activity.

54 ENVIRONMENTAL SCIENCES↗

The UV silicon spectra of early B stars

Equivalent widths of UV silicon lines obtained from high dispersion IUE SWP spectra for a sample of 37 mid- to early B stars are presented. These are compared to other atmospheric diagnostics and to model atmosphere calculations. It is found that some of the UV silicon lines are extremely sensitive to stellar temperature and luminosity over the range B5-B0.5, or roughly a factor of two in effective temperature. The potential usefulness of these lines is stressed, and it is demonstrated that they could determine temperatures and surface gravities to the same accuracy as other commonly used diagnostics once adequate models become available. Although the available models fail to predict the quantitative behavior of the line strengths, they do, in most instances, describe their qualitative behavior. Since the existing models are somewhat out of date, the results suggest that models based upon more complete opacity tables may be quite reliable.

Massa, D.↗

Technical Note: AQMEII4 Activity 1: Evaluation of Wet and Dry Deposition Schemes as an Integral Part of Regional-scale Air Quality Models

We present in this technical note the research protocol for phase 4 of the Air Quality Model Evaluation International Initiative (AQMEII4). This research initiative is divided into two activities, collectively having three goals: (i) to define the current state of the science with respect to representations of wet and especially dry deposition in regional models, (ii) to quantify the extent to which different dry deposition parameterizations influence retrospective air pollutant concentration and flux predictions, and (iii) to identify, through the use of a common set of detailed diagnostics, sensitivity simulations, model evaluation, and reduction of input uncertainty, the specific causes for the current range of these predictions. Activity 1 is dedicated to the diagnostic evaluation of wet and dry deposition processes in regional air quality models (described in this paper), and Activity 2 to the evaluation of dry deposition point models against ozone flux measurements at multiple towers with multiyear observations (to be described in future submissions as part of the special issue on AQMEII4). The scope of this paper is to present the scientific protocols for Activity 1, as well as to summarize the technical information associated with the different dry deposition approaches used by the participating research groups of AQMEII4. In addition to describing all common aspects and data used for this multi-model evaluation activity, most importantly, we present the strategy devised to allow a common process-level comparison of dry deposition obtained from models using sometimes very different dry deposition schemes. The strategy is based on adding detailed diagnostics to the algorithms used in the dry deposition modules of existing regional air quality models, in particular archiving diagnostics specific to land use–land cover (LULC) and creating standardized LULC categories to facilitate cross-comparison of LULC-specific dry deposition parameters and processes, as well as archiving effective conductance and effective flux as means for comparing the relative influence of different pathways towards the net or total dry deposition. This new approach, along with an analysis of precipitation and wet deposition fields, will provide an unprecedented process-oriented comparison of deposition in regional air quality models. Examples of how specific dry deposition schemes used in participating models have been reduced to the common set of comparable diagnostics defined for AQMEII4 are also presented.

Air Quality Model Evaluation International Initiat↗

Technical note: AQMEII4 Activity 1: evaluation of wet and dry deposition schemes as an integral part of regional-scale air quality models

We present in this technical note the research protocol for phase 4 of the Air Quality Model Evaluation International Initiative (AQMEII4). This research initiative is divided into two activities, collectively having three goals: (i) to define the current state of the science with respect to representations of wet and especially dry deposition in regional models, (ii) to quantify the extent to which different dry deposition parameterizations influence retrospective air pollutant concentration and flux predictions, and (iii) to identify, through the use of a common set of detailed diagnostics, sensitivity simulations, model evaluation, and reduction of input uncertainty, the specific causes for the current range of these predictions. Activity 1 is dedicated to the diagnostic evaluation of wet and dry deposition processes in regional air quality models (described in this paper), and Activity 2 to the evaluation of dry deposition point models against ozone flux measurements at multiple towers with multiyear observations (to be described in future submissions as part of the special issue on AQMEII4). The scope of this paper is to present the scientific protocols for Activity 1, as well as to summarize the technical information associated with the different dry deposition approaches used by the participating research groups of AQMEII4. In addition to describing all common aspects and data used for this multi-model evaluation activity, most importantly, we present the strategy devised to allow a common process-level comparison of dry deposition obtained from models using sometimes very different dry deposition schemes. The strategy is based on adding detailed diagnostics to the algorithms used in the dry deposition modules of existing regional air quality models, in particular archiving diagnostics specific to land use–land cover (LULC) and creating standardized LULC categories to facilitate cross-comparison of LULC-specific dry deposition parameters and processes, as well as archiving effective conductance and effective flux as means for comparing the relative influence of different pathways towards the net or total dry deposition. This new approach, along with an analysis of precipitation and wet deposition fields, will provide an unprecedented process-oriented comparison of deposition in regional air quality models. Examples of how specific dry deposition schemes used in participating models have been reduced to the common set of comparable diagnostics defined for AQMEII4 are also presented.

54 ENVIRONMENTAL SCIENCES↗

Radiative transfer in circumstellar 1612 MHz OH masers

A detailed investigation of radiative transfer in the 1612 MHz OH maser in the expanding envelopes around evolved stars is made in the context of the standard model in which the mass outflow is windlike. The most sensitive diagnostic of the models is the maser emission at the velocity of the star for which VLA and MERLIN data exist. Fully saturated models are analytically eliminated. Detailed numerical modeling also eliminates partially saturated models. The need to examine alternative models for the mass outflow is suggested by this conclusion. A model for the mass outflow from these stars is advocated in which all mass is lost by the ejection of blobs of material. These blobs, acted on by radiation pressure on grains, evolve into platelike structures in the OH maser region. It is shown that the peculiar difficulties of the standard model for the OH masers do not occur in this picture.

Alcock, C.↗

An architecture for the development of real-time fault diagnosis systems using model-based reasoning

Presented here is an architecture for implementing real-time telemetry based diagnostic systems using model-based reasoning. First, we describe Paragon, a knowledge acquisition tool for offline entry and validation of physical system models. Paragon provides domain experts with a structured editing capability to capture the physical component's structure, behavior, and causal relationships. We next describe the architecture of the run time diagnostic system. The diagnostic system, written entirely in Ada, uses the behavioral model developed offline by Paragon to simulate expected component states as reflected in the telemetry stream. The diagnostic algorithm traces causal relationships contained within the model to isolate system faults. Since the diagnostic process relies exclusively on the behavioral model and is implemented without the use of heuristic rules, it can be used to isolate unpredicted faults in a wide variety of systems. Finally, we discuss the implementation of a prototype system constructed using this technique for diagnosing faults in a science instrument. The prototype demonstrates the use of model-based reasoning to develop maintainable systems with greater diagnostic capabilities at a lower cost.

Hall, Gardiner A.↗

Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based

Abstract Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

54 ENVIRONMENTAL SCIENCES↗

A quasi-Lagrangian diagnostic case study of the effect of satellite sounding data assimilation on model cyclone prediction

A quasi-Lagrangian diagnostic study was performed to compare weather forecast accuracy with and without use of satellite data. Attention was focused on the mass and angular momentum budgets of the cyclone. The diagnostic study isolated the effects of physical processes within a cyclone and the effects of transport processes moving with the cyclone. Satellite data furnished different initialization values for horizontal mass and eddy angular momentum. Colder temperatures and weaker stabilities in the NW quadrant lower layers in the budget volume and increased stability in the middle and lower layers of another quadrant were obtained when the satellite data were considered. The addition of satellite data was concluded to have enhanced the accuracy of the forecast.

Vergin, J. M.↗