Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Vertical structure and physical processes of the Madden-Julian oscillation: Exploring key model physics in climate simulations

Aimed at reducing deficiencies in representing the Madden-Julian oscillation (MJO) in general circulation models (GCMs), a global model evaluation project on vertical structure and physical processes of the MJO was coordinated. In this paper, results from the climate simulation component of this project are reported. Here, it is shown that the MJO remains a great challenge in these latest generation GCMs. The systematic eastward propagation of the MJO is only well simulated in about one fourth of the total participating models. The observed vertical westward tilt with altitude of the MJO is well simulated in good MJO models but not in the poor ones. Damped Kelvin wave responses to the east of convection in the lower troposphere could be responsible for the missing MJO preconditioning process in these poor MJO models. Several process-oriented diagnostics were conducted to discriminate key processes for realistic MJO simulations. While large-scale rainfall partition and low-level mean zonal winds over the Indo-Pacific in a model are not found to be closely associated with its MJO skill, two metrics, including the low-level relative humidity difference between high- and low-rain events and seasonal mean gross moist stability, exhibit statistically significant correlations with the MJO performance. It is further indicated that increased cloud-radiative feedback tends to be associated with reduced amplitude of intraseasonal variability, which is incompatible with the radiative instability theory previously proposed for the MJO. Finally, results in this study confirm that inclusion of air-sea interaction can lead to significant improvement in simulating the MJO.

54 ENVIRONMENTAL SCIENCES↗

A Statistical Model of Tropical Cyclone Tracks in the Western North Pacific with ENSO-Dependent Cyclogenesis

A new statistical model for western North Pacific Ocean tropical cyclone genesis and tracks is developed and applied to estimate regionally resolved tropical cyclone landfall rates along the coasts of the Asian mainland, Japan, and the Philippines. The model is constructed on International Best Track Archive for Climate Stewardship (IBTrACS) 1945-2007 historical data for the western North Pacific. The model is evaluated in several ways, including comparing the stochastic spread in simulated landfall rates with historic landfall rates. Although certain biases have been detected, overall the model performs well on the diagnostic tests, for example, reproducing well the geographic distribution of landfall rates. Western North Pacific cyclogenesis is influenced by El Nino-Southern Oscillation (ENSO). This dependence is incorporated in the model s genesis component to project the ENSO-genesis dependence onto landfall rates. There is a pronounced shift southeastward in cyclogenesis and a small but significant reduction in basinwide annual counts with increasing ENSO index value. On almost all regions of coast, landfall rates are significantly higher in a negative ENSO state (La Nina).

Yonekura, Emmi↗

THE SYSTEMATICS OF STRONG LENS MODELING QUANTIFIED: THE EFFECTS OF CONSTRAINT SELECTION AND REDSHIFT INFORMATION ON MAGNIFICATION, MASS, AND MULTIPLE IMAGE PREDICTABILITY

Until now, systematic errors in strong gravitational lens modeling have been acknowledged but have never been fully quantified. Here, we launch an investigation into the systematics induced by constraint selection. We model the simulated cluster Ares 362 times using random selections of image systems with and without spectroscopic redshifts and quantify the systematics using several diagnostics: image predictability, accuracy of model-predicted redshifts, enclosed mass, and magnification. We find that for models with >15 image systems, the image plane rms does not decrease significantly when more systems are added; however, the rms values quoted in the literature may be misleading as to the ability of a model to predict new multiple images. The mass is well constrained near the Einstein radius in all cases, and systematic error drops to <2% for models using >10 image systems. Magnification errors are smallest along the straight portions of the critical curve, and the value of the magnification is systematically lower near curved portions. For >15 systems, the systematic error on magnification is ∼2%. We report no trend in magnification error with the fraction of spectroscopic image systems when selecting constraints at random; however, when using the same selection of constraints, increasing this fraction up to ∼0.5 will increase model accuracy. The results suggest that the selection of constraints, rather than quantity alone, determines the accuracy of the magnification. We note that spectroscopic follow-up of at least a few image systems is crucial because models without any spectroscopic redshifts are inaccurate across all of our diagnostics.

79 ASTRONOMY AND ASTROPHYSICS↗

Simulation of Ozone and Long Lived Tracers in the GSFC Two-Dimensional Model

The GSFC two-dimensional transport and chemistry model has been used for a wide variety of scientific and assessment studies of stratospheric ozone. Transport is a key element in the ozone simulations, and we have recently upgraded our model transport formulation to include much of the information about atmospheric transport processes available from existing data sets. To properly evaluate the model transport, it is desirable to examine the effects of transport and photochemistry separately. Recently, high quality observations of several long lived stratospheric tracers have become available from aircraft, balloon, and satellite measurement systems. This data provides a means to do a detailed model transport evaluation, as has been done in the recent Models and Measurements Intercomparison Project II. In this paper, we will discuss the GSFC 2D model simulations of ozone together with model-data comparisons of long lived tracers such as methane and the age of air transport diagnostic. We will show that the model can reproduce many of the transport-sensitive features observed in the stratosphere, and can compare reasonably well with measurements of both total ozone and long lived tracers simultaneously. We will also discuss the model deficiencies in simulating some of the detailed aspects of the observations.

Fleming, Eric L.↗

Reduced fast-ion transport calculations of m = n = 1 fishbone-like instabilities in MAST-U

Fast-ion transport associated with an m = n = 1 fishbone-like burst in MAST-U discharge 47128 is investigated using a reduced guiding-center-based transport model (ORBIT-Kick) constrained by multi-diagnostic measurements. The two-dimensional beam-emission spectroscopy system provides measurements of the core poloidal mode structure and fluctuation amplitude, while EFIT++ reconstructions constrained by the motional Stark effect diagnostic indicate a flat q-profile with q 0 > 1⁠, indicating the absence of a resonant q = 1 surface and supporting a pressure-driven infernal-mode interpretation. Analytic m = n = 1 displacement profiles consistent with the measured core mode structure and equilibrium constraints are used as the mode structure inputs to ORBIT-Kick. The calculations show that the dominant resonances occur between the mode and co-passing fast ions, producing redistribution localized near the magnetic axis. Synthetic neutron camera signals from TRANSP-Kick recover up to 90% of the experimentally observed neutron deficit at the time of peak mode amplitude, indicating that the measured m = n = 1 mode is a dominant contributor to core fast-ion transport. However, the synthetic neutron signals recover rapidly, whereas the measured neutron emission continues to decrease after the peak amplitude. In conclusion, the remaining discrepancy may arise from contributions not included in the present single-harmonic model, including higher-m and higher-n harmonics, multi-harmonic interactions, and additional transport mechanisms, motivating future diagnostic development and modeling efforts to resolve and incorporate these additional contributions.

Wong, Henry H. [University of California, Los Ange↗

Diagnosing the Dynamics of Observed and Simulated Ecosystem Gross Primary Productivity with Time Causal Information Theory Quantifiers

Data analysis and model-data comparisons in the environmental sciences require diagnostic measures that quantify time series dynamics and structure, and are robust to noise in observational data. This paper investigates the temporal dynamics of environmental time series using measures quantifying their information content and complexity. The measures are used to classify natural processes on one hand, and to compare models with observations on the other. The present analysis focuses on the global carbon cycle as an area of research in which model-data integration and comparisons are key to improving our understanding of natural phenomena. We investigate the dynamics of observed and simulated time series of Gross Primary Productivity (GPP), a key variable in terrestrial ecosystems that quantifies ecosystem carbon uptake. However, the dynamics, patterns and magnitudes of GPP time series, both observed and simulated, vary substantially on different temporal and spatial scales. Here we demonstrate that information content and complexity, or Information Theory Quantifiers (ITQ) for short, serve as robust and efficient data-analytical and model benchmarking tools for evaluating the temporal structure and dynamical properties of simulated or observed time series at various spatial scales. At continental scale, we compare GPP time series simulated with two models and an observations-based product. This analysis reveals qualitative differences between model evaluation based on ITQ compared to traditional model performance metrics, indicating that good model performance in terms of absolute or relative error does not imply that the dynamics of the observations is captured well. Furthermore, we show, using an ensemble of site-scale measurements obtained from the FLUXNET archive in the Mediterranean, that model-data or model-model mismatches as indicated by ITQ can be attributed to and interpreted as differences in the temporal structure of the respective ecological time series. At global scale, our understanding of C fluxes relies on the use of consistently applied land models. Here, we use ITQ to evaluate model structure: The measures are largely insensitive to climatic scenarios, land use and atmospheric gas concentrations used to drive them, but clearly separate the structure of 13 different land models taken from the CMIP5 archive and an observations-based product. In conclusion, diagnostic measures of this kind provide data-analytical tools that distinguish different types of natural processes based solely on their dynamics, and are thus highly suitable for environmental science applications such as model structural diagnostics.

54 ENVIRONMENTAL SCIENCES↗

Urban weather modeling using WRF: linking physical assumptions, code implementation, and observational needs

The Weather Research and Forecasting (WRF) model includes urban schemes that simulate the influence of urban surfaces on the atmosphere using parameterizations for flux, and radiative exchanges. Three core schemes – the Bulk urban parameterization, Single-Layer Urban Canopy Model (SLUCM), and Multi-Layer Urban Canopy Model (MLUCM) – represent increasing levels of complexity. Although the parameterizations within these urban schemes are described in the literature, their specific implementation remains poorly documented, thus slowing down model development efforts. This manuscript provides a roadmap to the three urban schemes in WRF version 4.5.2, presenting equations using the same symbols as in the model code, along with references to code lines, and including graphics and explanations that connect the code to its physical foundations. Our thorough review of the urban parameterizations implemented in WRF version 4.5.2 highlighted a handful of parameters that may introduce discontinuities in simulations: (i) in the SLUCM, a 1 mm h −1 rain rate threshold is employed to switch between two minimum moisture availability parameterizations, thus impacting latent heat flux calculations; (ii) in the SLUCM a threshold is used to partition shortwave radiation into direct and diffuse components; (iii) in all three urban schemes, the bulk Richardson number is employed to select the similarity function, which influences the vertical distribution of heat and momentum. We also identified a highly simplified treatment of the radiative balance on roof surfaces. The implications of these simplifications can be assessed through targeted observations across relevant conditions, including varying precipitation rates, cloud cover, and transitions between stability regimes. Furthermore, the widespread application of the Monin-Obukhov similarity theory in these urban schemes warrants model evaluation under highly stable and unstable conditions and in heterogeneous urban settings with variable land cover and building heights on scales finer than model resolution. To address these challenges, we offer guidance on observational strategies, emphasizing the need for multi-parametric measurements to capture potential compensating biases and multi-height measurements that align with the levels where quantities are diagnostic and prognosed in the model (i.e., the lowest atmospheric level of the WRF model). Finally, our inspection of the code revealed implementation bugs that have now been corrected in WRF versions 4.6.0 and 4.6.1. Sensitivity tests over the Atlanta urban area show that these corrections affect surface temperatures, underscoring the importance of performing rigorous documentation and verification of the implementation of parameterizations in model code.

54 ENVIRONMENTAL SCIENCES↗

Uncertainties in Evapotranspiration Estimates over West Africa

An evapotranspiration (ET) ensemble composed of 36 land surface model (LSM) experiments and four diagnostic datasets (GLEAM, ALEXI, MOD16, and FLUXNET) is used to investigate uncertainties in ET estimate over five climate regions in West Africa. Diagnostic ET datasets show lower uncertainty estimates and smaller seasonal variations than the LSM-based ET values, particularly in the humid climate regions. Overall, the impact of the choice of LSMs and meteorological forcing datasets on the modeled ET rates increases from north to south. The LSM formulations and parameters have the largest impact on ET in humid regions, contributing to 90% of the ET uncertainty estimates. Precipitation contributes to the ET uncertainty primarily in arid regions. The LSM-based ET estimates are sensitive to the uncertainty of net radiation in arid region and precipitation in humid region. This study serves as support for better determining water availability for agriculture and livelihoods in Africa with earth observations and land surface models.

land surface model↗

Synthetic diagnostics platform for fusion plasmas (invited)

A Synthetic Diagnostics Platform (SDP) for fusion plasmas has been developed which provides state of the art synthetic reflectometry, beam emission spectroscopy, and Electron Cyclotron Emission (ECE) diagnostics. Interfaces to the plasma simulation codes GTC, XGC-1, GTS, and M3D-C{sup 1} are provided, enabling detailed validation of these codes. In this paper, we give an overview of SDP’s capabilities, and introduce the synthetic diagnostic modules. A recently developed synthetic ECE Imaging module which self-consistently includes refraction, diffraction, emission, and absorption effects is discussed in detail. Its capabilities are demonstrated on two model plasmas. The importance of synthetic diagnostics in validation is shown by applying the SDP to M3D-C{sup 1} output and comparing it with measurements from an edge harmonic oscillation mode on DIII-D.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Detection of questionable occlusal carious lesions using an electrical bioimpedance method with fractional electrical model

This in vitro study evaluated the diagnostic performance of an alternative electric bioimpedance spectroscopy technique (BIS-STEP) detect questionable occlusal carious lesions. Six specialists carried out the visual (V), radiography (R), and combined (VR) exams of 57 sound or non-cavitated occlusal carious lesion teeth classifying the occlusal surfaces in sound surface (H), enamel caries (EC), and dentinal caries (DC). Measurements were based on the current response to a step voltage excitation (BIS-STEP). A fractional electrical model was used to predict the current response in the time domain and to estimate the model parameters: Rs and Rp (resistive parameters), and C and α (fractional parameters). Histological analysis showed caries prevalence of 33.3% being 15.8% hidden caries. Combined examination obtained the best traditional diagnostic results with specificity = 59.0%, sensitivity = 70.9%, and accuracy = 60.8%. There were statistically significant differences in bioimpedance parameters between the H and EC groups (p = 0.016) and between the H and DC groups (Rs, p = 0.006; Rp, p = 0.022, and α, p = 0.041). Using a suitable threshold for the Rs, we obtained specificity = 60.7%, sensitivity = 77.9%, accuracy = 73.2%, and 100% of detection for deep lesions. It can be concluded that BIS-STEP method could be an important tool to improve the detection and management of occlusal non-cavitated primary caries and pigmented sites.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Comprehensive Chemistry Evaluation and Diagnostics Package for E3SM – ChemDyg Version 1.1.0

The Chemistry Evaluation and Diagnostics Package (ChemDyg) is an open-source tool designed for the Energy Exascale Earth System Model (E3SM) developed by the U.S. Department of Energy. ChemDyg facilitates routine evaluation, tailored development, and in-depth analysis of atmospheric chemistry through its modular architecture, allowing users to compare model outputs with observational data. Version 1.1.0 introduces a robust set of diagnostic capabilities, including climatology, time evolution of key tracers, diurnal and annual cycle analyses, and extensive budget diagnostics. These features help identify model discrepancies and enhance the representation of atmospheric chemistry in E3SM. Each self-contained diagnostic set includes dedicated scripts and documentation for ease of use. The interactive HTML output improves data accessibility, accelerating chemistry model development. Additionally, ChemDyg's flexible framework allows for customization, enabling users to create unique diagnostic sets for specific scientific contributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dark Energy Survey year 3 results: point spread function modelling

ABSTRACT We introduce a new software package for modelling the point spread function (PSF) of astronomical images, called piff (PSFs In the Full FOV), which we apply to the first three years (known as Y3) of the Dark Energy Survey (DES) data. We describe the relevant details about the algorithms used by piff to model the PSF, including how the PSF model varies across the field of view (FOV). Diagnostic results show that the systematic errors from the PSF modelling are very small over the range of scales that are important for the DES Y3 weak lensing analysis. In particular, the systematic errors from the PSF modelling are significantly smaller than the corresponding results from the DES year one (Y1) analysis. We also briefly describe some planned improvements to piff that we expect to further reduce the modelling errors in future analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

Integrated diagnostic analysis of inertial confinement fusion capsule performance

A conceptual model is developed for typical inertial confinement fusion implosion conditions that integrates available diagnostic information to determine the stagnation properties of the interior fill and surrounding shell. Assuming pressure equilibrium at peak compression and invoking radiative and equation-of-state relations, the pressure, density, and electron temperature are obtained by optimized fitting of the experimental output to smooth, global functional forms. Typical observational data that may be used includes x-ray self-emission, directional neutron time-of-flight signals, neutron yield, high-resolution x-ray spectra, and radiographic images. This approach has been validated by comparison with radiation-hydrodynamic simulations, producing semi-quantitative agreement. Model results implicate poor kinetic energy coupling to the hot core as the primary cause of the observed low thermonuclear burn yields.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A synthetic diagnostic for beam emission spectroscopy in the helically symmetric experiment stellarator

The Helically Symmetric Experiment (HSX) has a number of active spectroscopy diagnostics. Due to the relatively large beam width compared to the plasma minor radius, it is difficult to achieve good spatial resolution at the core of the HSX plasma. This is due to the fact that the optical sightline cuts through many flux surfaces with varying field vectors within the beam. In order to compare the experimental results with theoretical models it is important to accurately model the beam width effects. A synthetic diagnostic has been developed for this purpose. This synthetic diagnostic calculates the effect of spot size and beam width on the measurements of quantities of interest, including radial electric field, flow velocity, and Stark polarization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Megahertz Rate Optical Diagnostics of Explosively Generated Soot

Detonation of a solid explosive produces a turbulent and luminous post‐detonation fireball containing condensed carbon soot. Diagnostics of soot dynamics are needed for model validation and to interpret emission signals. Diffuse back‐illumination extinction imaging (DBI‐EI) and laser‐induced incandescence (LII) are two common optical diagnostics for flame soot. This work extends both to measure time‐resolved soot dynamics from a 12 mm HMX hemisphere. DBI‐EI measured line‐of‐sight optical extinction exceeds 99% in some regions. Results are tomographically inverted to obtain a signal proportional to the soot volume fraction. Pulse‐burst LII measures are presented at 1 MHz. For the first time, LII results are combined with DBI‐EI extinction measurements to quantify and correct for signal trapping. Following this, spatially and temporally resolved DBI‐EI and LII measures are shown to be in reasonable agreement. Finally, experimental results are compared against recently developed simulations. Quantitative differences in the soot mixing dynamics are resolved. These findings motivate future model improvements and demonstrate ongoing needs for diagnostic advancements for heavily sooting environments.

diffuse back-illumination extinction imaging↗