Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Diagnosing the representation of surface and layered soil moisture in Earth system models

Surface soil moisture (mrsos) and vertically integrated soil moisture (mrsol) over the top 10 cm should, by definition, be physically consistent in Earth System Models (ESMs). However, an evaluation of nine CMIP6 models reveals substantial inconsistencies: in some models, mrsos and integrated mrsol agree globally; in others, they align only in specific regions; and in a few, they diverge across all grid cells. These discrepancies arise from a combination of factors, including metadata errors, inconsistent variable definitions, or diagnostic sequencing within the model. We demonstrate how such issues can lead to significant biases, even when both variables are present and seemingly well-defined. As model complexity increases and multi-model comparisons become more common, assumptions about variable equivalence may lead to flawed conclusions. This study highlights the need for routine consistency checks, improved metadata standards, and community-wide practices that ensure reliability of derived variables across ESM outputs, particularly in preparation for CMIP7.

Earth system models↗

Kepler Data Validation I: Architecture, Diagnostic Tests, and Data Products for Vetting Transiting Planet Candidates

The Kepler Mission was designed to identify and characterize transiting planets in the Kepler Field of View and to determine their occurrence rates. Emphasis was placed on identification of Earth-size planets orbiting in the Habitable Zone of their host stars. Science data were acquired for a period of four years. Long-cadence data with 29.4 min sampling were obtained for approx. 200,000 individual stellar targets in at least one observing quarter in the primary Kepler Mission. Light curves for target stars are extracted in the Kepler Science Data Processing Pipeline, and are searched for transiting planet signatures. A Threshold Crossing Event is generated in the transit search for targets where the transit detection threshold is exceeded and transit consistency checks are satisfied. These targets are subjected to further scrutiny in the Data Validation (DV) component of the Pipeline. Transiting planet candidates are characterized in DV, and light curves are searched for additional planets after transit signatures are modeled and removed. A suite of diagnostic tests is performed on all candidates to aid in discrimination between genuine transiting planets and instrumental or astrophysical false positives. Data products are generated per target and planet candidate to document and display transiting planet model fit and diagnostic test results. These products are exported to the Exoplanet Archive at the NASA Exoplanet Science Institute, and are available to the community. We describe the DV architecture and diagnostic tests, and provide a brief overview of the data products. Transiting planet modeling and the search for multiple planets on individual targets are described in a companion paper. The final revision of the Kepler Pipeline code base is available to the general public through GitHub. The Kepler Pipeline has also been modified to support the Transiting Exoplanet Survey Satellite (TESS) Mission which is expected to commence in 2018.

data analysis↗

Evaluation of an urban vegetative canopy scheme and impact on plume dispersion

The Quick Urban and Industrial Complex (QUIC) atmospheric dispersion modeling system attempts to fill an important gap between the fast, but nonbuilding-aware Gaussian plume models and the building-aware but slow computational fluid dynamics (CFD) models. While Gaussian models have the ability to give answers quickly to emergency responders, they are unlikely to be able to adequately account for the effects of the building-induced complex flow patterns on the near-source dispersion of contaminants. QUIC uses a diagnostic massconsistent empirical wind model called QUIC-URB that is based on the methodology of Rockle (1990), (see also Kaplan and Dinar 1996). In this approach, the recirculation zones that form around and between buildings are inserted into the flow using empirical parameterizations and then the wind field is forced to be mass consistent. Although not as accurate as CFD codes, this approach is several orders of magnitude faster and accounts for the bulk effects of buildings.

54 ENVIRONMENTAL SCIENCES↗

Real-time estimation of the electron temperature profile in DIII-D by leveraging neural-network surrogate models

Control of both the magnitude and the shape of tokamak profiles will be necessary to achieve stable, high-performance plasmas. In order to reject disturbances in real time, feedback-control algorithms rely on accurate real-time knowledge of the plasma state. When diagnostics alone are insufficient, either because they are limited in number or their measurements are too noisy, observers can be used to combine diagnostic data with a response model to provide a better estimation of different plasma properties. An observer has been developed to estimate the electron temperature profile in real time using both diagnostic data from the Thomson scattering system and a model based on the electron heat transport equation describing the evolution of the electron temperature profile. Here, neural network surrogate models are leveraged to help improve the overall model prediction while staying within computation time constraints for real-time use. The observer algorithm is shown in offline tests to produce smooth profiles that are consistent with both the diagnostic data and the electron heat transport equation. When implemented into the real-time plasma control system, this observer will provide valuable information on the electron temperature profile to many potential feedback-control applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evidence cross-validation and Bayesian inference of MAST plasma equilibria

In this paper, current profiles for plasma discharges on the mega-ampere spherical tokamak are directly calculated from pickup coil, flux loop, and motional-Stark effect observations via methods based in the statistical theory of Bayesian analysis. By representing toroidal plasma current as a series of axisymmetric current beams with rectangular cross-section and inferring the current for each one of these beams, flux-surface geometry and q-profiles are subsequently calculated by elementary application of Biot-Savart's law. The use of this plasma model in the context of Bayesian analysis was pioneered by Svensson and Werner on the joint-European tokamak [Svensson and Werner,Plasma Phys. Controlled Fusion 50(8), 085002 (2008)]. In this framework, linear forward models are used to generate diagnostic predictions, and the probability distribution for the currents in the collection of plasma beams was subsequently calculated directly via application of Bayes' formula. In this work, we introduce a new diagnostic technique to identify and remove outlier observations associated with diagnostics falling out of calibration or suffering from an unidentified malfunction. These modifications enable a good agreement between Bayesian inference of the last-closed flux-surface with other corroborating data, such as that from force balance considerations using EFIT++[Appel et al., ''A unified approach to equilibrium reconstruction'' Proceedings of the 33rd EPS Conference on Plasma Physics (Rome, Italy, 2006)]. In addition, this analysis also yields errors on the plasma current profile and flux-surface geometry as well as directly predicting the Shafranov shift of the plasma core.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Reconciling Simulated and Observed Views of Clouds: MODIS, ISCCP, and the Limits or Instrument Simulators

The properties of clouds that may be observed by satellite instruments, such as optical depth and cloud top pressure, are only loosely related to the way clouds m-e represented in models of the atmosphere. One way to bridge this gap is through "instrument simulators," diagnostic tools that map the model representation to synthetic observations so that differences between simulator output and observations can be interpreted unambiguously as model error. But simulators may themselves be restricted by limited information available from the host model or by internal assumptions. This paper considers the extent to which instrument simulators are able to capture essential differences between MODIS and ISCCP, two similar but independent estimates of cloud properties. The authors review the measurements and algorithms underlying these two cloud climatologies, introduce a MODIS simulator, and detail data sets developed for comparison with global models using ISCCP and MODIS simulators, In nature MODIS observes less mid-level doudines!> than ISCCP, consistent with the different methods used to determine cloud top pressure; aspects of this difference are reproduced by the simulators running in a climate modeL But stark differences between MODIS and ISCCP observations of total cloudiness and the distribution of cloud optical thickness can be traced to different approaches to marginal pixels, which MODIS excludes and ISCCP treats as homogeneous. These pixels, which likely contain broken clouds, cover about 15 k of the planet and contain almost all of the optically thinnest clouds observed by either instrument. Instrument simulators can not reproduce these differences because the host model does not consider unresolved spatial scales and so can not produce broken pixels. Nonetheless, MODIS and ISCCP observation are consistent for all but the optically-thinnest clouds, and models can be robustly evaluated using instrument simulators by excluding ambiguous observations.

Ackerman, Steven A.↗

Reconciling Simulated and Observed Views of Clouds: MODIS, ISCCP, and the Limits of Instrument Simulators in Climate Models

The properties of clouds that may be observed by satellite instruments, such as optical depth and cloud top pressure, are only loosely related to the way clouds are represented in models of the atmosphere. One way to bridge this gap is through "instrument simulators," diagnostic tools that map the model representation to synthetic observations so that differences between simulator output and observations can be interpreted unambiguously as model error. But simulators may themselves be restricted by limited information available from the host model or by internal assumptions. This work examines the extent to which instrument simulators are able to capture essential differences between MODIS and ISCCP, two similar but independent estimates of cloud properties. We focus on the stark differences between MODIS and ISCCP observations of total cloudiness and the distribution of cloud optical thickness can be traced to different approaches to marginal pixels, which MODIS excludes and ISCCP treats as homogeneous. These pixels, which likely contain broken clouds, cover about 15% of the planet and contain almost all of the optically thinnest clouds observed by either instrument. Instrument simulators can not reproduce these differences because the host model does not consider unresolved spatial scales and so can not produce broken pixels. Nonetheless, MODIS and ISCCP observation are consistent for all but the optically-thinnest clouds, and models can be robustly evaluated using instrument simulators by excluding ambiguous observations.

Pincus, Robert↗

Advancing the science of explosive fragmentation and afterburn fireballs though experiments and simulations at the benchtop scale

Detonation of explosive devices produces extremely hazardous fragments and hot, luminous fireballs. Prior experimental investigations of these post-detonation environments have primarily considered devices containing hundreds of grams of explosives. While relevant to many applications, such large- scale testing also significantly restricts experimental diagnostics and provides limited data for model validation. As an alternative, the current work proposes experiments and simulations of the fragmentation and fireballs from commercial detonators with less than a gram of high explosive. As demonstrated here, reduced experimental hazards and increased optical access significantly expand the viability of advanced imaging and laser diagnostics. Notable developments include the first known validation of MHz-rate optical fragment tracking and the first ever Coherent Anti-Stokes Raman Scattering (CARS) measures of post-detonation fireball temperatures. While certainly not replacing the need for full-scale verification testing, this work demonstrates new opportunities to accelerate developments of diagnostics and predictive models of post-detonation environments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Diagnostics for Linac Optimization With Machine Learning

The Fermilab Linac delivers 400 MeV H- beam to the rest of the accelerator chain. Providing stable intensity, energy, and emittance is key since it directly affects downstream machines. To counter fluctuations of Linac output due to various effects to be described below we are working on implementing dynamic longitudinal parameter optimization based on Machine Learning (ML). As inputs for the ML model, signals from beam diagnostics have to be well understood and reliable. In this paper we discuss the status and plans for ML-based optimization as well as preliminary results of diagnostics studies.

43 PARTICLE ACCELERATORS↗

Modeling and Validation of Sodium Plugging for Heat Exchangers in Sodium-cooled Fast Reactor Systems

The project “Modeling and Validation of Sodium Plugging for Heat Exchangers in Sodium-cooled Fast Reactor Systems” was conducted jointly by Westinghouse Electric Company (Westinghouse) and Argonne National Laboratory (ANL), over the period October 1, 2013- March 31, 2016. The project’s motivation was the need to provide designers of Sodium Fast Reactors (SFRs) with a validated, state-of-the-art computational tool for the prediction of sodium oxide (Na 2 O) deposition in small-diameter sodium heat exchanger (HX) channels, such as those in the diffusion bonded HXs proposed for SFRs coupled with a supercritical CO 2 (sCO 2 ) Brayton cycle power conversion system. In SFRs, Na 2 O deposition can potentially occur following accidental air ingress in the intermediate heat transport system (IHTS) sodium and simultaneous failure of the IHTS sodium cold trap. In this scenario, oxygen can travel through the IHTS loop and reach the coldest regions, represented by the cold end of the sodium channels of the HXs, where Na 2 O precipitation may initiate and continue. In addition to deteriorating HX heat transfer and pressure drop performance, Na 2 O deposition can lead to channel plugging especially when the size of the sodium channels is small, which is the case for diffusion bonded HXs whose sodium channel hydraulic diameter is generally below 5 mm. Sodium oxide melts at a high temperature well above the sodium melting temperature such that removal of a solid plug such as through dissolution by pure sodium could take a lengthy time. The Sodium Plugging Phenomena Loop (SPPL) was developed at ANL, prior to this project, for investigating Na 2 O deposition phenomena within sodium channels that are prototypical of the diffusion bonded HX channels envisioned for SFR-sCO 2 systems. In this project, a Computational Fluid Dynamic (CFD) model capable of simulating the thermal-hydraulics of the SPPL test section and provided with Na 2 O deposition prediction capabilities, was developed. This state-of-the-art computational tool incorporates a first-principles Na 2 O deposition model developed by ANL, and combines it with predictive capabilities for the spatial and temporal variation of temperature, velocity, dissolved oxygen concentration, and wall temperature under flowing sodium conditions. The CFD model was validated under no-deposition conditions using experimental data collected with the SPPL, demonstrating the model’s capability to predict the thermal-hydraulics of the SPPL test section within the measurement uncertainty characterizing the SPPL instrumentation. The model’s deposition prediction capability was not, however, validated as the SPPL could not be operated under plugging conditions during the project, resulting in the lack of deposition data with adequate pedigree for a CFD model validation. Two novel diagnostic techniques to detect and characterize Na 2 O deposits, i.e. Ultrasonic Time Domain Reflectometry (UTDR) and Potential Drop (PD) techniques, were developed to ultimately assist in the validation effort under plugging conditions, which can be performed once the SPPL becomes operational. This development effort consisted first in demonstrating, analytically and/or computationally, the capability of these techniques to diagnose Na 2 O deposits inside of small channels (particularly the deposit’s thickness), and subsequently in the fabrication and testing of prototypical UTDR and PD instrumentation. The testing, performed on mockups of the SPPL test section, demonstrated the capability of these techniques to detect and characterize material discontinuities like those induced by sodium oxide deposition on stainless steel channel walls. Because of the mentioned impossibility to run the SPPL in a plugging mode, the developed instrumentation could not be tested in-situ, i.e. at the SPPL while deposits are being formed inside of the SPPL test section. Recommended future work includes a possible enhancement in the CFD modeling technique and installation of the developed UTDR and PD instrumentation on the test section, followed by plugging tests to be conducted with the SPPL. The installation of the UTDR and PD diagnostic instrumentation on the SPPL test section will allow collection of Na 2 O deposition data after the onset of deposition to nearly complete channel plugging, which can ultimately be used for the validation of the CFD model.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

AMPPED LDRD: Advanced Models of the Physics & Phenomena of Electrical Discharge.

This Laboratory Directed Research and Development (LDRD) project aimed at addressing an unmet need for physics-based models that enable prediction of electrical breakdown in the presence of high voltage gradients and real-world environments. This project focused on understanding coupled plasma-surface feedback phenomena critical to electrical discharge processes and design of breakdown voltages, breakdown times, and breakdown paths. New secondary electron emission and coupled plasma-surface measurement methods and models were developed. Highly reproducible discharge experiments were developed to provide current-voltage data as a function of time, and methods were developed to condition electrodes for predictable discharge. To assess plasma-surface feedback mechanisms, new surface physics capabilities, including measurement systems for local and global photoemission yield and ion-induced secondary electron emission yield were developed. Discharge models were developed to incorporate these yields for predicting discharge behavior to understand influence of surface physics on discharge current and time evolution, and methods to accelerate these simulations were demonstrated. A key finding was that the initiation process of a non-vacuum discharge appears highly dependent on photoemission at the cathode. Advanced diagnostics were developed, including spatial electrical field imaging, spectroscopy of plasmas, and high-speed imaging of discharge event s in metal and dielectric environments. These diagnostics and improved electrical models are a step toward enabling quantitative design margins, assurance of safety architectures, and implementation of novel materials and technologies for wide ranging energy and electronics applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Empirical Modeling of Direct Expansion (DX) Cooling System for Multiple Research Use Cases

This study provides a general procedure to generate a direct expansion (DX) cooling coil system for a roof top unit (RTU), which is a typical heating ventilation and air-conditioning (HVAC) system for commercial buildings in the United States. Experimental data from a full-scale unoccupied 2-story commercial building is used for the HVAC modeling. The regression for identifying the model coefficients was carried out with multiple stages, and the results were validated with measured data. The model’s applicability was evaluated with multiple case studies, including a building energy simulation (BES) program validation, model-based predictive control (MPC), and fault diagnostics and detection (FDD).

42 ENGINEERING↗

Eigenvector analysis of some observed and model-generated Climatological fields

An empirical orthogonal function analysis of monthly mean synoptic fields computed with a general circulation model and the corresponding observed climatological patterns is presented. A computer program was used to compute the principal components of the data matrices representing global maps of various observed and model-generated climatological fields. The variables analyzed were: 500mb geopotential height, 850 mb temperature, and sea level pressure. It is concluded that eigenvector analysis of observed and model-generated synoptic climatological fields is a useful diagnostic aid in the evaluation of global model simulation. The maps of any climatological variables are readily decomposed into a few orthogonal components which account for a large fraction of the total spatial variance, and the observed and model-generated patterns may then be compared in terms of these principal components of the original data matrices.

Dennis, M.↗

Theoretical H II region models - The effects of stellar atmosphere models

Several grids of theoretical H II region models are computed by photoionization modeling in order to determine the extent to which the choice of the ionizing stellar atmosphere model affects the calibration of emission-line diagnostic diagrams of Evans and Dopita (1985) and the semiempirical H II region abundance sequence calibration of Evans and Dopita. Emission-line diagnostic diagrams are presented and compared for model nebulae ionized by Hummer and Mihalas (1970) unblanketed LTE atmospheres, Kurucz (1979) line-blanketed LTE atmospheres, Mihalas (1972) unblanketed non-LTE, and a truncated blackbody spectrum. The models demonstrate that for solar nebular and atmospheric abundances, there are only minor differences between H II models ionized by the Hummer and Mihalas atmospheres. The unblanketed non-LTE stellar atmosphere models of Mihalas and truncated blackbody spectra are shown to be unsuitable for general H II region modelling.

Evans, I. N.↗

Metrics for Improved Reanalyses in Polar Regions

Atmospheric reanalyses are widely used for a variety of scientific endeavors in the Arctic and Antarctic. Reanalyses are used as boundary conditions for a regional and process-based models, for climate model validation, and for diagnostic analysis of physical processes, weather and climatic events. However, reanalyses are typically global and often do not account for specific, regional considerations, such as for polar regions. In this work, we provide a brief evaluation of a prototype for a new GMAO reanalysis, which incorporates higher spatial resolution, an updated approach for data assimilation, and a revised atmospheric model. We identify differences in the representation of the Arctic atmosphere in comparison to recent reanalyses. Furthermore, we provide a forum for Arctic scientists to consider the future improvements for reanalyses, and seek feedback for the following questions: 1) What are important performance factors to consider in evaluating new reanalyses? 2) What physical processes should be incorporated into new reanalyses? 3) What spatio-temporal scales should be considered?

Parker, Chelsea L.↗

Predicting Decade-to-Century Climate Change: Prospects for Improving Models

Recent research has led to a greatly increased understanding of the uncertainties in today's climate models. In attempting to predict the climate of the 21st century, we must confront not only computer limitations on the affordable resolution of global models, but also a lack of physical realism in attempting to model key processes. Until we are able to incorporate adequate treatments of critical elements of the entire biogeophysical climate system, our models will remain subject to these uncertainties, and our scenarios of future climate change, both anthropogenic and natural, will not fully meet the requirements of either policymakers or the public. The areas of most-needed model improvements are thought to include air-sea exchanges, land surface processes, ice and snow physics, hydrologic cycle elements, and especially the role of aerosols and cloud-radiation interactions. Of these areas, cloud-radiation interactions are known to be responsible for much of the inter-model differences in sensitivity to greenhouse gases. Recently, we have diagnostically evaluated several current and proposed model cloud-radiation treatments against extensive field observations. Satellite remote sensing provides an indispensable component of the observational resources. Cloud-radiation parameterizations display a strong sensitivity to vertical resolution, and we find that vertical resolutions typically used in global models are far from convergence. We also find that newly developed advanced parameterization schemes with explicit cloud water budgets and interactive cloud radiative properties are potentially capable of matching observational data closely. However, it is difficult to evaluate the realism of model-produced fields of cloud extinction, cloud emittance, cloud liquid water content and effective cloud droplet radius until high-quality measurements of these quantities become more widely available. Thus, further progress will require a combination of theoretical and modeling research, together with intensified emphasis on both in situ and space-based remote sensing observations.

Somerville, Richard C. J.↗

Large Ensemble Diagnostic Evaluation of Hydrologic Parameter Uncertainty in the Community Land Model Version 5 (CLM5)

Abstract Land surface models such as the Community Land Model version 5 (CLM5) seek to enhance understanding of terrestrial hydrology and aid in the evaluation of anthropogenic and climate change impacts. However, the effects of parametric uncertainty on CLM5 hydrologic predictions across regions, timescales, and flow regimes have yet to be explored in detail. The common use of the default hydrologic model parameters in CLM5 risks generating streamflow predictions that may lead to incorrect inferences for important dynamics and/or extremes. In this study, we benchmark CLM5 streamflow predictions relative to the commonly employed default hydrologic parameters for 464 headwater basins over the conterminous United States (CONUS). We evaluate baseline CLM5 default parameter performance relative to a large (1,307) Latin Hypercube Sampling‐based diagnostic comparison of streamflow prediction skill using over 20 error measures. We provide a global sensitivity analysis that clarifies the significant spatial variations in parametric controls for CLM5 streamflow predictions across regions, temporal scales, and error metrics of interest. The baseline CLM5 shows relatively moderate to poor streamflow prediction skill in several CONUS regions, especially the arid Southwest and Central U.S. Hydrologic parameter uncertainty strongly affects CLM5 streamflow predictions, but its impacts vary in complex ways across U.S. regions, timescales, and flow regimes. Overall, CLM5's surface runoff and soil water parameters have the largest effects on simulated high flows, while canopy water and evaporation parameters have the most significant effects on the water balance.

54 ENVIRONMENTAL SCIENCES↗