Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Assessment of Precipitating Marine Stratocumulus Clouds in the E3SMv1 Atmosphere Model: A Case Study from the ARM MAGIC Field Campaign

This paper presents a process-oriented evaluation of precipitating stratocumulus and its transition to cumulus in version 1 of the Energy Exascale Earth System Model (E3SMv1) using comprehensive case-study observations from a field campaign of the Atmospheric Radiation Measurement program (ARM). The E3SMv1 single-column model (SCM) of the marine boundary layer and its low clouds and precipitation are compared to observations including subcloud drizzle retrievals from a combination of Doppler radar and lidar backscatter measurements. Additionally, the SCM is also compared to a large-eddy simulation (LES) of the same case. The combination of advanced remote sensing observations and LES is a powerful framework to evaluate the physical parameterizations of large-scale models. Given the observed large-scale environment, the E3SMv1 SCM realistically represents the evolution of clouds and boundary layer structure during the stratocumulus-to-cumulus transition. The model well simulates the liquid water path and its diurnal cycle in the stratocumulus period as well as the two-layer vertical thermodynamic structure and lower cloud fraction in the transition period. E3SMv1’s success in simulating the cloud in the stratocumulus period permitted examination of its precipitation processes. Here problems were identified with E3SMv1 producing an unrealistically small subcloud precipitation fraction, an unrealistic double peak in the vertical profiles of precipitation mass, and drizzle that evaporates too close to the surface. Further model diagnostics determined that these unrealistic characteristics resulted from an overly long microphysics time step and an unrealistic parameterization of the precipitation fraction. These results imply that careful consideration of these issues is needed in order to better simulate precipitation processes in marine stratocumulus.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Accurate assessment of land–atmosphere coupling in climate models requires high-frequency data output

Land–atmosphere (L–A) interactions are important for understanding convective processes, climate feedbacks, the development and perpetuation of droughts, heatwaves, pluvials, and other land-centered climate anomalies. Local L–A coupling (LoCo) metrics capture relevant L–A processes, highlighting the impact of soil and vegetation states on surface flux partitioning and the impact of surface fluxes on boundary layer (BL) growth and development and the entrainment of air above the BL. A primary goal of the Climate Process Team in the Coupling Land and Atmospheric Subgrid Parameterizations (CLASP) project is parameterizing and characterizing the impact of subgrid heterogeneity in global and regional Earth system models (ESMs) to improve the connection between land and atmospheric states and processes. A critical step in achieving that aim is the incorporation of L–A metrics, especially LoCo metrics, into climate model diagnostic process streams. However, because land–atmosphere interactions span timescales of minutes (e.g., turbulent fluxes), hours (e.g., BL growth and decay), days (e.g., soil moisture memory), and seasons (e.g., variability in behavioral regimes between soil moisture and latent heat flux), with multiple processes of interest happening in different geographic regions at different times of year, there is not a single metric that captures all the modes, means, and methods of interaction between the land and the atmosphere. And while monthly means of most of the LoCo-relevant variables are routinely saved from ESM simulations, data storage constraints typically preclude routine archival of the hourly data that would enable the calculation of all LoCo metrics. Here, we outline a reasonable data request that would allow for adequate characterization of sub-daily coupling processes between the land and the atmosphere, preserving enough sub-daily output to describe, analyze, and better understand L–A coupling in modern climate models. A secondary request involves embedding calculations within the models to determine mean properties in and above the BL to further improve characterization of model behavior. Higher-frequency model output will (i) allow for more direct comparison with observational field campaigns on process-relevant timescales, (ii) enable demonstration of inter-model spread in L–A coupling processes, and (iii) aid in targeted identification of sources of deficiencies and opportunities for improvement of the models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Diagnosing the sensitivity of grounding-line flux to changes in sub-ice-shelf melting

Abstract. Using a numerical ice flow model, we study changes in ice shelf buttressing and grounding-line flux due to localized ice thickness perturbations, a proxy for localized changes in sub-ice-shelf melting. From our experiments, applied to idealized (MISMIP+) and realistic (Larsen C) ice shelf domains, we identify a correlation between a locally derived buttressing number on the ice shelf, based on the first principal stress, and changes in the integrated grounding-line flux. The origin of this correlation, however, remains elusive from the perspective of a theoretical or physically based understanding. This and the fact that the correlation is generally much poorer when applied to realistic ice shelf domains motivate us to seek an alternative approach for predicting changes in grounding-line flux. We therefore propose an adjoint-based method for calculating the sensitivity of the integrated grounding-line flux to local changes in ice shelf geometry. We show that the adjoint-based sensitivity is identical to that deduced from pointwise, diagnostic model perturbation experiments. Based on its much wider applicability and the significant computational savings, we propose that the adjoint-based method is ideally suited for assessing grounding-line flux sensitivity to changes in sub-ice-shelf melting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Searching for a Pulse: Evaluating the Use of Rapid DC Pulses for Diagnosing Battery Health, State-of-Charge, and Safety

Rapid electrochemical diagnostics, like DC pulse sequences or electrochemical impedance spectroscopy, are known to be useful for capacity prediction. However, it is unclear how previous results will map to different cell types and use cases and whether rapid diagnostics are useful for remaining useful life prediction or for detecting potential safety issues. To that end, we have collected a data set with ∼50,000 DC pulse measurements from four types of commercial lithium-ion batteries to enable training of state-of-charge, health, and safety diagnostic models via machine-learning. We demonstrate that 120-second DC pulse sequences can be used to predict capacity with 2%–9% average error, which can separate high- from low-capacity cells with only a 0.3% false positive rate but is not accurate enough to estimate remaining useful life. We also find that no safety related targets can be accurately predicted, highlighting the critical need for other non-invasive methods to diagnose battery safety.

25 ENERGY STORAGE↗
DOE OSTI2022

Integration of Omics into a New Comprehensive Rate Law for Competitive Terminal Electron-Accepting Processes in Reactive Transport Models: Application to N, Fe, S, and Contaminant Transformations in Stream and Wetland Sediments

Surface waters represent important sources of alternate energy and drinking water in the United States, and characterizing the biogeochemical processes that affect surface water quality is relevant to the DOE-BER mission. Sediment biogeochemical processes regulate the release of carbon (C), nutrients, and contaminants to surface waters and thus influence water quality. Sediment biogeochemical processes are dynamic and affected by the deposition and remobilization of solid material and changes in environmental conditions driven by water discharge variations. Wetlands are important natural filters of surface waters which may either trap, metabolize, or mobilize nutrients and contaminants. Despite their importance, biogeochemical processes regulating nutrient and contaminant release and C transformation in stream and wetland sediments cannot be predicted accurately by current mathematical models. These reactive transport models largely rely on detectable changes in geochemical conditions to activate metabolic processes, do not accurately account for the competition between microbial processes, and poorly constrain effects of hydrological perturbations on biogeochemical processes. In this BER-SBR exploratory project, metagenomic and geochemical signatures were combined to identify microbially-mediated redox processes in anaerobic stream and wetland sediments from the Savannah River Site (SRS, ANL SFA) and East Fork Poplar Creek (EFPC, ORNL SFA) that play important roles in C, uranium (U), and mercury (Hg) transformations. In addition, sediment incubations were conducted to examine the competition between anaerobic respiration processes Finally, new rate laws were developed for reactive transport models that rely on complementary metagenomic and geochemical signatures to identify the underlying anaerobic microbial processes in stream and wetland sediments, describe the competition between the dominant metabolic processes involved in nutrient release and U and Hg mobilization, and more accurately quantify carbon transformation and the response of microbial processes to changes in redox conditions associated with hydrological forcing. These rate laws were optimized in batch reactors with SRS wetland sediments, where iron and sulfate reduction dominate. Anaerobic carbon remineralization processes followed the expected thermodynamic sequence of microbial respiration with depth in both sediments, except that geochemical signals indicated that sulfate reduction was inactive in EFPC sediments and moderate in SRS wetland sediments. Estimates indicated that microbial iron reduction contributed to at least half of the production of reduced iron in these sediments. Incubations demonstrated that nitrate reduction, denitrification, and dissimilatory nitrate reduction to ammonium were active in the natural EFPC sediment and activated upon nitrate amendment in these nitrate-rich sediments. In turn, these processes were outcompeted by the addition of either iron oxides or sulfate as alternative terminal electron acceptors. Although geochemical products of sulfate reduction were not detected in the incubations, the abundance of sulfate reduction genes increased with depth in the sediment and was equally more pronounced in treatments amended with either iron oxides or sulfate. Simultaneously, anaerobic sulfide oxidizing bacteria coupling sulfide oxidation to DNRA (and not conventional denitrification) were apparently enriched over time, regardless of the treatments. These findings indicate that sulfate reduction is important in freshwater stream sediments and probably catalyzed by a cryptic sulfur cycle involving nitrogen species, in which the sulfur products from sulfate reduction are immediately removed by side reactions and not detectable by geochemical measurements alone. Similar experiments in SRS sediments, however, demonstrated little interaction between nitrogen and sulfur cycling microorganisms. Sulfate reduction was impacted by the addition of more thermodynamically favorable electron acceptors, suggesting either that iron-reducing microorganisms outcompeted sulfate-reducing microorganisms for organic substrate, depleting the stock of electron donor available for sulfate reduction, or that the cryptic sulfur cycle was shunted by the precipitation of FeS generated as a result of the abiotic reduction of iron oxides by dissolved sulfide. A diagnostic modeling exercise was conducted to further investigate the competition between terminal electron accepting processes. As conventional kinetic models typically do not account for cryptic cycles and used inaccurate formulations to describe competition between microbial communities, new metabolic rate laws were developed that explicitly express the electron acceptor-specific enzyme of each energetically favorable metabolic process based on gene abundance detected in the incubations. The model was tested with the sediment slurry incubation data to determine whether substrate competition could explain the decrease in sulfate reduction observed in the presence of iron oxide competitor. The model was able to reproduce geochemical concentrations really well in each treatment once the model was calibrated with the unamended control, suggesting that microbial competition was indeed driven by thermodynamic considerations. Overall, carbon remineralization processes and rates will be reproduced much more realistically with the new metabolic rate laws.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Root Cause Analysis of Degradation in Protonic Ceramic Electrochemical Cell with Interfacial Electrical Sensors Using Data‐Driven Machine Learning

Abstract Protonic ceramic electrochemical cells (PCECs) offer promising paths for energy storage and conversion. Despite considerable achievements made, PCECs still face challenges such as physiochemical compatibility between componenets and suboptimal solid–solid contact at the interfaces between the electrolytes and electrodes. In this study, a novel approach is proposed that combines in situ electrochemical characterization of interfacial electrical sensor embedded PCECs and machine learning to quantify the contributions of different cell components to total degradation, as well as to predict the remaining useful life. The experimental results suggest that the overpotential induced by the oxygen electrode is 48% less than that of oxygen electrode/electrolyte interfacial contact for up to 1171 h. The data‐driven machine learning simulation predicts the RUL of up to 2132 h. The root cause of degradation is overpotential increase induced by oxygen electrode, which accounts for 82.9% of total cell degradation. The success of the failure diagnostic model is demonstrated by its consistency with degradation modes that do not manifest in electrolysis fade during early real operations. This synergistic approach provides valuable insights into practical failure diagnosis of PCECs and has the potential to revolutionize their development by enabling improved performance prediction and material selection for enhanced durability and efficiency.

25 ENERGY STORAGE↗
DOE OSTI2022

Toward More Actionable Flood‐Risk Information

Abstract The increasingly urgent need to develop knowledge and practices to manage flood risks drives innovative information design. However, experts often disagree about design practices. As a result, flood‐risk estimates can diverge, leading to different conclusions for decision‐making. Using examples of household‐scale fluvial (riverine) flood‐risk information in the United States, we assess design features and risk communication approaches that may lead to more actionable information for decision‐making. We argue that increased attention to uncertainty characterization and model diagnostics is a critical intermediate step for developing simpler approaches for designing flood‐risk information. Simpler frameworks are desirable because flood risks change over time, and simpler frameworks are less costly to update. Developing frameworks for large spatial domains require collaboration grounded in principles of open science. Finally, systematically evaluating how decision‐makers access and use information can provide new insights to guide risk communication and information design.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Yield From Iowa's First Commercial Miscanthus Fields: Implications of Spatial Variability for Productivity and Sustainability Beyond Research Plots

The cultivation of sterile giant miscanthus (Miscanthus × giganteus, M × g) for bioenergy and bioproducts has expanded into grain-cropped land in the United States (US) as local markets developed for this high-yielding perennial grass (10–30 Mg DM ha −1 ). However, the magnitude of spatial and temporal variability in yield within US Corn Belt fields, along with impacts on economic return and sustainable land management, is poorly understood. This study established a diagnostic model relating remote sensing-derived vegetation indices to ground truth data from 105 hand-harvested stem biomass samples, which were strategically selected to represent the full range of vegetation index observations. The high-resolution satellite-sensed vegetation indices captured > 90% of the yield variation measured within fields. This model was then used to predict yield variability and assess economic performance across four of the first commercial M × g fields in the Corn Belt state of Iowa, US. Significant spatial variability in biomass dry matter (DM) yields (9.3–18.1 Mg DM ha −1 ) and net profits ($\$$83 to $\$$1211.5 ha −1 ) was observed. All fields were profitable in all site-years. When low profit occurred, it was explained by limited management experience of the crop in Iowa. The breakeven yield at a selling price of $\$$130 Mg −1 varied from 9.0–12.1 Mg ha −1 at 15% moisture content (7.6–10.3 Mg DM ha −1 ). Breakeven prices ranged from $\$$73 to $\$$122.4 Mg −1 , matching ranges used in the Department of Energy Billion Ton Report (US Department of Energy, 2023). Notably, M × g yield and profits were commensurate with grain crops particularly with favorable precipitation. This study provides insight on the M × g management “learning curve”, performance on marginal land and in drought conditions, and demonstrates that addressing yield gaps, reducing costs, and implementing precision agriculture strategies can enhance profitability. These findings emphasize the value of remote sensing technologies in guiding sustainable and competitive commercial-scale M × g production.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Hot Droughts and Forest Tree Dynamics in the Amazon - Statistical Models, Scripts, Data, and Outputs

This package contains data, outputs, equations, and R scripts for analyses for manuscript entitled "Hot droughts in the Amazon: A window to a future hypertropical climate" by J. Chambers et al., in particular it contains statistical models and analyses for the INPA BIONTE tree mortality study. The Models folder contains details for all statistical models in PDF files. The Scripts folder contains the R scripts for Bayesian Hierarchical Models (two text files) and SEMs (one text file) are separate and reasonably annotated. All data associated with these scripts are in the data folder. The Data folder contains two of the three CSV files used for the analyses and are called by the R scripts. Two of them are part of published datasets (`BIONTE_mortality-rates.csv` from Lima et al. 2024, DOI:10.15486/ngt/1898910 and `SPEI.csv` from Pastorello et al. 2023 DOI:10.15486/ngt/1958257) and also provided in this package for convenience (please see the corresponding datasets for usage and citation terms). The third dataset (`BIONTE_gapfilled_wd.csv`) contains sensitive information and can be obtained by contacting the manuscript lead author. The Outputs folder contains the two output files that provide extra information about the analyses. The file `figuresFeb2025d.pdf` contains all the figures from the manuscript - captions are in the manuscript. The file `ChambersMS.pdf` contains primary results from Bayesian statistical models, regression analyses, and validation steps applied to the tree mortality data from the INPA experiments. The document includes visual summaries, model diagnostics, and leave-one-out (LOO) validation results. A breakdown of file contents can be found in the README file that is part of this package.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Understanding the Inner-Workings of Language Models Through Representation Dissimilarity

We use model stitching to understand the internal representations of language models. Similar to vision models, we find that "more is better," and representations learned with more data and larger width can improve the performance of weaker models via stitching. We likewise find that certain architecture choices, using GeLU vs SoLU activation functions, influence the quality of learned representations. Finally, model stitching (as opposed to other model diagnostic methods, like mode connectivity) can localize the different generalization strategies of text classifiers under domain shift to certain hidden layers.

Brown, Davis R.↗
DOE OSTI2020

Demonstrated Low Pressure Loss Inlet and Low Equivalence Ratio Operation of a Rotating Detonation Engine (RDE) for Power Generation

Presentation. An Aerojet Rocketdyne (AR) program was funded by the National Energy Technology Laboratory (NETL), part of the U.S. Department of Energy, to evaluate the benefits of an RDE in a turbine power plant system. Aerojet Rocketdyne subcontracted a variety of support for the program with efforts in modeling, diagnostic techniques, and test campaigns. Over the span of the program more than 700 hot fire tests were conducted at 4 facilities with 7 RDE assemblies. This presentation will cover results from the final test campaign conducted by Aerojet Rocketdyne.

03 NATURAL GAS↗
DOE OSTI2022

On the Feasibility of Geophysical Methods for CO 2 Monitoring in the North Dakota CarbonSAFE Project

Conference presentation at American Institute of Chemical Engineers (AIChE) Annual Meeting, Phoenix, AZ, November 13–18, 2022. An analysis of rock physics crossplots and diagnostic models suggests that the baseline seismic data may be sensitive to changes in lithology and porosity of the Broom Creek Formation and that these changes may be detectable by prestack seismic inversion.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Cloud condensation nuclei concentrations derived from the CAMS reanalysis

Determining number concentrations of cloud condensation nuclei (CCN) is one of the first steps in the chain in analysis of cloud droplet formation, the direct microphysical link between aerosols and cloud droplets, and a process key for aerosol–cloud interactions (ACI). However, due to sparse coverage of in situ measurements and difficulties associated with retrievals from satellites, a global exploration of their magnitude, source as well as temporal and spatial distribution cannot be easily obtained. Thus, a better representation of CCN numbers is one of the goals for quantifying ACI processes and achieving uncertainty-reduced estimates of their associated radiative forcing. Here, we introduce a new CCN dataset which is derived based on aerosol mass mixing ratios from the latest Copernicus Atmosphere Monitoring Service reanalysis (CAMSRA) in a diagnostic model that uses CAMSRA aerosol properties and a simplified kappa-Köhler framework suitable for global models. The emitted aerosols in CAMSRA are not only based on input from emission inventories using aerosol observations, they also have a strong tie to satellite-retrieved aerosol optical depth (AOD) as this is assimilated as a constraining factor in the reanalysis. Furthermore, the reanalysis interpolates for cases of poor or missing retrievals and thus allows for a full spatiotemporal quantification of CCN numbers. The derived CCN dataset captures the general trend and spatial and temporal distribution of total CCN number concentrations and CCN from different aerosol species. A brief evaluation with ground-based in situ measurements demonstrates the improvement of the modelled CCN over the sole use of AOD as a proxy for CCN as the overall correlation coefficient improved from 0.37 to 0.71. However, we find the modelled CCN from CAMSRA to be generally high biased and find a particular erroneous overestimation at one heavily polluted site which emphasises the need for further validation. The CCN dataset (https://doi.org/10.26050/WDCC/QUAERERE_CCNCAMS_v1, Block, 2023), which is now freely available to users, features 3-D CCN number concentrations of global coverage for various supersaturations and aerosol species covering the years 2003–2021 with daily frequency. This dataset is one of its kind as it offers lots of opportunities to be used for evaluation in models and in ACI studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 1: assessing E3SM aerosol predictions using aircraft, ship, and surface measurements

Abstract. An Earth system model (ESM) aerosol–cloud diagnostics package is developed to facilitate the routine evaluation of aerosols, clouds, and aerosol–cloud interactions simulated by the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). The first version focuses on comparing simulated aerosol properties with aircraft, ship, and surface measurements, which are mostly measured in situ. The diagnostics currently cover six field campaigns in four geographical regions: eastern North Atlantic (ENA), central US (CUS), northeastern Pacific (NEP), and Southern Ocean (SO). These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the Atmospheric Radiation Measurement (ARM) program and other agencies. Various types of diagnostics and metrics are performed for aerosol number, size distribution, chemical composition, cloud condensation nuclei (CCN) concentration, and various meteorological quantities to assess how well E3SM represents observed aerosol properties across spatial scales. Overall, E3SM qualitatively reproduces the observed aerosol number concentration, size distribution, and chemical composition reasonably well, but it overestimates Aitken-mode aerosols and underestimates accumulation-mode aerosols over the CUS and ENA regions, suggesting that processes related to particle growth or coagulation might be too weak in the model. The current version of E3SM struggles to reproduce the new particle formation events frequently observed over both the CUS and ENA regions, indicating missing processes in current parameterizations. The diagnostics package is coded and organized in a way that can be extended to other field campaign datasets and adapted to higher-resolution model simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Abstract. Poor representations of aerosols, clouds, and aerosol–cloud interactions (ACIs) in Earth system models (ESMs) have long been the largest uncertainties in predicting global climate change. Huge efforts have been made to improve the representation of these processes in ESMs, and the key to these efforts is the evaluation of ESM simulations with observations. Most well-established ESM diagnostics packages focus on the climatological features; however, they lack process-level understanding and representations of aerosols, clouds, and ACIs. In this study, we developed the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package to facilitate the routine evaluation of aerosols, clouds, and ACIs simulated the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). This paper documents its version 2 functionality (ESMAC Diags v2), which has substantial updates compared with version 1 (Tang et al., 2022a). The simulated aerosol and cloud properties have been extensively compared with in situ and remote-sensing measurements from aircraft, ship, surface, and satellite platforms in ESMAC Diags v2. It currently includes six field campaigns and two permanent sites covering four geographical regions: the eastern North Atlantic, the central US, the northeastern Pacific, and the Southern Ocean. These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the DOE Atmospheric Radiation Measurement user facility and other agencies. ESMAC Diags v2 generates various types of single-variable and multivariable diagnostics, including percentiles, histograms, joint histograms, and heatmaps, to evaluate the model representation of aerosols, clouds, and ACIs. Select examples highlighting the capabilities of ESMAC Diags are shown using E3SM version 2 (E3SMv2). In general, E3SMv2 can reasonably reproduce many observed aerosol and cloud properties, with biases in some variables such as aerosol particle and cloud droplet sizes and number concentrations. The coupling of aerosol and cloud number concentrations may be too strong in E3SMv2, possibly indicating a bias in processes that control aerosol activation. Furthermore, the liquid water path response to a perturbed cloud droplet number concentration behaves differently in E3SMv2 and observations, which warrants further study to improve the cloud microphysics parameterizations in E3SMv2.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Toward model-free temperature diagnostics of warm dense matter from multiple scattering angles

Warm dense matter plays an important role in astrophysical objects and technological applications, but the rigorous diagnostics of corresponding experiments is notoriously difficult. In this work, we present a model-free analysis of x-ray Thomson scattering (XRTS) measurements on isochorically heated graphite obtained at the Linac Coherent Light Source at multiple scattering angles. We demonstrate that the recent imaginary-time thermometry technique works for scattering data that have been measured in both forward and backward scattering geometry. This opens up the way toward a rigorous quantification of nonequilibrium effects in future experiments, where XRTS measurements are being obtained from multiple scattering angles from the same sample.

Equations of state↗
DOE OSTI2024

Improving Reliability of Large Language Models for Nuclear Power Plant Diagnostics [Poster]

Large Language Models (LLMs) struggle out of the box when answering factually about detailed questions, especially in domains that are sparsely represented in their training data. This causes hallucinations and reduces reliability making it difficult for them to be used in practice. This work shows that using RAG techniques can improve factual accuracy and reliability, allowing for the application of LLMs in specialized areas, even when those areas that aren’t extensively covered in their initial training.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation

Abstract. The E3SM Diagnostics Package (E3SM Diags) is a modern, Python-based Earth system model (ESM) evaluation tool (with Python module name e3sm_diags), developed to support the Department of Energy (DOE) Energy Exascale Earth System Model (E3SM). E3SM Diags provides a wide suite of tools for evaluating native E3SM output, as well as ESM data on regular latitude–longitude grids, including output from Coupled Model Intercomparison Project (CMIP) class models. E3SM Diags is modeled after the National Center for Atmospheric Research (NCAR) Atmosphere Model Working Group (AMWG, 2022) diagnostics package. In its version 1 release, E3SM Diags included a set of core essential diagnostics to evaluate the mean physical climate from model simulations. As of version 2.7, more process-oriented and phenomenon-based evaluation diagnostics have been implemented, such as analysis of the quasi-biennial oscillation (QBO), the El Niño–Southern Oscillation (ENSO), streamflow, the diurnal cycle of precipitation, tropical cyclones, ozone and aerosol properties. An in situ dataset from DOE's Atmospheric Radiation Measurement (ARM) program has been integrated into the package for evaluating the representation of simulated cloud and precipitation processes. This tool is designed with enough flexibility to allow for the addition of new observational datasets and new diagnostic algorithms. Additional features include customizable figures; streamlined installation, configuration and execution; and multiprocessing for fast computation. The package uses an up-to-date observational data repository maintained by its developers, where recent datasets are added to the repository as they become available. Finally, several applications for the E3SM Diags module were introduced to fit a diverse set of use cases from the scientific community.

54 ENVIRONMENTAL SCIENCES↗