Search NASA⌕ Search

SEARCH · Search NASA

Results for “Evaluation Model Development and Assessment Process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Implementation and Evaluation of Emission‐Driven Land‐Atmosphere Coupled Simulation in E3SMv2.1

Emissions-driven (prognostic CO 2 ) simulations are essential for representing two-way carbon-climate feedback in Earth System Models. We present an emissions-driven land–atmosphere coupled biogeochemistry (BGC) configuration (BGCLNDATM_progCO2) in version 2.1 of the Energy Exascale Earth System Model (E3SMv2.1). This is the first E3SM configuration that performs land-atmosphere emission-hindcasts. Here, we document its implementation, evaluate the model's performance against observations and other models, and propose a structured evaluation protocol for such emissions-driven simulations. We conducted transient historical simulations (1850–2014) with BGCLNDATM_progCO2 and compare them to reference simulations—a land-atmosphere coupled simulation without BGC and a standalone land simulation with BGC, both using prescribed CO 2 concentrations—and to observations. BGCLNDATM_progCO2 overestimates atmospheric CO 2 concentrations by 11–23 ppm yet stays within the 40-ppm spread CMIP6 emission-driven models and retains physical climate properties comparable to the reference runs. The CO 2 biases are partly attributed to underrepresented oceanic CO 2 uptake and inadequate representations of some terrestrial processes. In general, introducing prognostic CO 2 did not change physical climate metrics at the global scale but had larger regional effects, particularly over land where spatially heterogeneous CO 2 and prognostic leaf area index influenced surface energy balance. Finally, we propose a general evaluation protocol including spin-up assessment, atmospheric CO 2 benchmarking, physical climate evaluation, and land biogeochemical analysis to support scientific rigor and facilitate inter-model comparisons. The new configuration lays the groundwork for future enhancements, including improved terrestrial biogeochemical processes, integrated marine biogeochemistry, and additional human–Earth system interactions. These developments advance E3SM toward fully coupled emissions-driven simulations, enabling more accurate carbon–climate feedback projections and informing mitigation policy by providing physically consistent carbon-budget metrics for mitigation scenarios.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3)

The Water Technoeconomic Assessment Pipe-Parity Platform (WaterTAP3) was developed under the National Alliance for Water Innovation (NAWI) to facilitate consistent technoeconomic assessments of desalination treatment trains. The WaterTAP3 is an analytically robust modeling tool that can be used to evaluate water technology cost, energy, environmental, and resiliency tradeoffs across different water sources, sectors, and scales. The model simulates steady-state water treatment train performance and costs including flow and constituent mass balance across unit processes, based on source water conditions, configurations of treatment technologies, and system-level techno-economic assumptions. Users can build a new treatment train by connecting any number of unit processes, specific for their context and system, or selecting a train from the treatment train library. The model contains various technical and cost parameter options for a range of treatment processes and a library of influent water quality characteristics for a variety of source waters and case studies. Users can customize water quality parameters to evaluate the technology performance in their context. The model can be set up for different assessment needs including simulation, optimization, and uncertainty and sensitivity analyses. The results from WaterTAP3 can help identify trade-offs among the different system performance metrics, with insight on how particular technologies or systems promote pipe-parity. The flexibility and comprehensive scope of the tool makes it a promising solution to industry-wide water technoeconomic evaluations, leading to more informed water investment decisions and technologies. As a user-friendly, open-source platform, WaterTAP3 can be used by industry, academia, policymakers, planners, and those with or without extensive analytical experience. A publicly available graphical user interface is currently under development.

Miara, Ariel↗
DOE OSTI2021

Robust evaluation of ENSO in climate models: How many ensemble members are needed?

Large ensembles of model simulations require considerable resources, and thus defining an appropriate ensemble size for a particular application is an important experimental design criterion. We estimate the ensemble size (N) needed to assess a model's ability to capture observed El Niño-Southern Oscillation (ENSO) behavior by utilizing the recently developed International CLIVAR ENSO Metrics Package (Planton et al., 2021). Using the larger ensembles available from CMIP6 and the US CLIVAR Large Ensemble Working Group, we find that larger ensembles are needed to robustly capture baseline ENSO characteristics (N > 50) and physical processes (N > 50) than the background climatology (N ≥ 12) and remote ENSO teleconnections (N ≥ 6). While these results vary somewhat across metrics and models, our study quantifies how larger ensembles are required to robustly evaluate simulated ENSO behavior, thereby providing some guidance for the design of model ensembles.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Fuel Fabrication and Single Stage Aqueous Process Modeling

The Material Protection, Accounting, and Control Technologies program utilizes modeling and simulation to assess Material Control and Accountability (MC&A) concerns for a variety of nuclear facilities. Single analyst tools allow for rapid design and evaluation of advanced approaches for new and existing nuclear facilities. A low enriched uranium (LEU) fuel conversion and fabrication facility simulator is developed to assist with MC&A for existing facilities. Measurements are added to the model (consistent with current best practices). Material balance calculations and statistical tests are also added to the model. In addition, scoping work is performed for developing a single stage aqueous reprocessing model. Preliminary results are presented and discussed, and next steps outlined.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

GDSA Framework Development and Process Model Integration FY2022

The Spent Fuel and Waste Science and Technology (SFWST) Campaign of the U.S. Department of Energy (DOE) Office of Nuclear Energy (NE), Office of Spent Fuel & Waste Disposition (SFWD) is conducting research and development (R&D) on geologic disposal of spent nuclear fuel (SNF) and high-level nuclear waste (HLW). A high priority for SFWST disposal R&D is disposal system modeling (Sassani et al. 2021). The SFWST Geologic Disposal Safety Assessment (GDSA) work package is charged with developing a disposal system modeling and analysis capability for evaluating generic disposal system performance for nuclear waste in geologic media. This report describes fiscal year (FY) 2022 advances of the Geologic Disposal Safety Assessment (GDSA) performance assessment (PA) development groups of the SFWST Campaign. The common mission of these groups is to develop a geologic disposal system modeling capability for nuclear waste that can be used to assess probabilistically the performance of generic disposal options and generic sites. The modeling capability under development is called GDSA Framework (pa.sandia.gov). GDSA Framework is a coordinated set of codes and databases designed for probabilistically simulating the release and transport of disposed radionuclides from a repository to the biosphere for post-closure performance assessment. Primary components of GDSA Framework include PFLOTRAN to simulate the major features, events, and processes (FEPs) over time, Dakota to propagate uncertainty and analyze sensitivities, meshing codes to define the domain, and various other software for rendering properties, processing data, and visualizing results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

Stochastic Thermo-Hydro Modeling and Neural Network Surrogate Development for Thermal Resource Assessment of the Galleries-to-Calories Geobattery

The Galleries-to-Calories Geobattery concept explores the use of abandoned coal mine workings for large-scale thermal energy transport and storage. The system involves injecting waste heat from a supercomputing facility into flooded mine galleries, where groundwater flow can store and transport thermal energy for potential recovery in downgradient district heating and cooling applications. To evaluate the feasibility and performance of the Geobattery under geological and operational uncertainty, we developed a suite of stochastic thermo-hydrological (TH) simulations using Monte Carlo sampling of key uncertain parameters (e.g., permeability, porosity, thermal conductivity, specific heat capacity) and operating conditions (e.g., injection rate, injection temperature). Results identified injection rate and temperature as the most influential parameters governing thermal front propagation, while the geometry of the room-and-pillar structure played a critical role in directing the extent and orientation of thermal advancement. Optimal combinations of material properties for maximizing heat recovery were also determined. To address the high computational cost of coupled-process stochastic modeling, we trained a neural network surrogate model on 24,000 physics-based realizations, achieving an R² > 0.99 and MAE < 0.1 for temperature predictions at monitoring locations. This surrogate enabled an additional 100,000 realizations for global sensitivity analysis and probabilistic thermal resource assessment. The integrated stochastic physics–surrogate modeling framework offers a computationally efficient tool for quantifying uncertainty, identifying key drivers, and informing early-stage design decisions for Geobattery systems.

15 - GEOTHERMAL ENERGY↗
DOE OSTI2025

Assessment of Physical Security Modeling and Simulation in the Vulnerability Assessment Process

This report provides a comprehensive assessment of physical security modeling and simulation tools available for use in the vulnerability assessment (VA) process for nuclear facilities. It outlines the historical evolution of VA methodologies, emphasizing the transition from traditional layer-based approaches to a more holistic framework that integrates detection probabilities directly into combat simulations. The document details the critical components of the VA process, including the characterization of targets, threats, and protective measures, as well as the development of adversary scenarios that reflect both insider and outsider threats. It highlights the importance of performance assurance programs, emphasizing the need for continuous evaluation and testing of security systems to ensure their effectiveness against evolving threats. Additionally, the report discusses the significance of utilizing accredited modeling and simulation tools in accredited areas to accurately represent adversary actions and the corresponding responses of protective forces. By establishing a systematic approach to VA, this document aims to enhance the overall security posture of nuclear facilities, ensuring compliance with regulatory standards while effectively mitigating risks associated with potential adversarial actions.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2026

Thermomechanical analysis and modeling of a high-temperature light trapping planar cavity solar receiver

The development of durable particle-based high-temperature solar receivers is critical for advancing concentrating solar-thermal (CST) technologies to enable high-efficiency power generation and industrial process heat. Here, this study presents a computational framework to evaluate the thermomechanical performance of a proposed enclosed light-trapping planar cavity receiver designed for particle-based thermal energy systems. The receiver incorporates absorptive cavities and fluidized particle-bed channels to enhance heat capture and reduce thermal losses. Finite element analysis (FEA) is employed to assess stress, strain, and creep-fatigue behavior under concentrated solar flux using realistic thermal boundary conditions derived from coupled system models and experimental assembly parameters. The analysis investigates the influence of particle-to-wall heat transfer coefficients (HTC) ranging from 800 to 1800 W/m 2 .K on the thermomechanical response of six candidate high-temperature alloys: Alloy 740H, Alloy 282, Alloy 617, 316H, Alloy 230, and 800H. Results show that increasing HTC reduces thermal gradients, leading to lower stresses and strains and extended minimum predicted creep life. While all materials satisfy fatigue life requirements under the investigated conditions, significant differences in creep resistance are observed. Alloy 740H consistently exhibits the longest minimum predicted creep life and the most favorable durability margins, followed by Alloy 282, with the remaining materials showing reduced creep resistance under identical loading. The reported creep lives are conservative lower-bound estimates intended for comparative material evaluation. This framework highlights the critical roles of material selection and geometry optimization in improving mechanical durability and reliability of solar-thermal receivers, forming a foundation for future experimental validation and design optimization.

14 SOLAR ENERGY↗
DOE OSTI2025

Remotely Sensed High‐Resolution Soil Moisture and Evapotranspiration: Bridging the Gap Between Science and Society

This paper reviews the current state of high‐resolution remotely sensed soil moisture (SM) and evapotranspiration (ET) products and modeling, and the coupling relationship between SM and ET. SM downscaling approaches for satellite passive microwave products leverage advances in artificial intelligence and high‐resolution remote sensing using visible, near‐infrared, thermal‐infrared, and synthetic aperture radar sensors. Remotely sensed ET continues to advance in spatiotemporal resolutions from MODIS to ECOSTRESS to Hydrosat and beyond. These advances enable a new understanding of bio‐geo‐physical controls and coupled feedback mechanisms between SM and ET reflecting the land cover and land use at field scale (3–30 m, daily). Still, the state‐of‐the‐science products have their challenges and limitations, which we detail across data, retrieval algorithms, and applications. We describe the roles of these data in advancing 10 application areas: drought assessment, food security, precision agriculture, soil salinization, wildfire modeling, dust monitoring, flood forecasting, urban water, energy, and ecosystem management, ecohydrology, and biodiversity conservation. We discuss that future scientific advancement should focus on developing open‐access, high‐resolution (3–30 m), sub‐daily SM and ET products, enabling the evaluation of hydrological processes at finer scales and revolutionizing the societal applications in data‐limited regions of the world, especially the Global South for socio‐economic development.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A Dose Assessment Model for Radioactive Waste Exposed by Gully Erosion at West Valley - 20513

The Western New York Nuclear Service Center (WNYNSC), located approximately 48 km south of Buffalo, New York, is the site of a former nuclear fuel reprocessing and radioactive waste disposal facility. Spent nuclear fuel was processed there from 1966 to 1972, leaving behind radioactive and chemical wastes in two disposal areas and a waste tank farm. Site operations also resulted in releases of radioactivity to site soils, groundwater, and to surface waters draining the site. The New York State Energy Research and Development Authority (NYSERDA) and the U.S. Department of Energy (DOE) are collaborating in a process of decision making for decommissioning those facilities remaining at the WNYNSC following the completion of Phase 1 decommissioning. Neptune and Company, Inc. (Neptune) was contracted to develop a probabilistic performance assessment (PPA) computer model to assist the agencies in this process. The PPA Model includes a contaminant transport component focusing on the movement of contaminants within and among environmental media including groundwater and surface water transport, contaminant translocation by plants and animals, diffusion, and erosion. The model also includes evaluation of potential exposure and health effects for a Resident Farmer exposure scenario, where the Resident Farmer represents a critical group, described as that group of individuals reasonably expected to receive the greatest exposure to residual radioactivity for any applicable set of circumstances. The West Valley Site is located in the glaciated Allegheny Plateau region of western New York State. The waste reprocessing and disposal areas were constructed on a relatively fat area of plateau dissected by drainages of Buttermilk Creek, including Erdman Brook, Franks Creek, and Quarry Creek. An important aspect of the contaminant transport component of the PPA model is consideration of erosive processes such as slumping of the stream slopes and the advance of gullies from these streams. These erosion processes remove material from the plateau, growing the size of the creek valleys and making them wider and deeper. Of particular interest for the impact of erosion is radioactive waste contained in the Nuclear Regulatory Commission (NRC)-Licensed Disposal Area (NDA), the New York State-Licensed Disposal Area (SDA), and residual radiological inventory in the underground storage tanks at the Waste Tank Farm (WTF). The PPA Model is organized around geographically-defined facilities which were constructed upon the plateau, including the NDA, SDA, and WTF. Ongoing stream erosion processes will potentially transfer radioactive waste and residual inventory from these facilities to the ground surface on adjacent hillslope areas where erosion has breached the facility. Hence, it is important to evaluate the consequences of potential exposures to a Resident Farmer on the hillslopes below a breached facility. Two interrelated aspects of the dose assessment model related to hillslope exposure are discussed: 1) representation of the physical processes related to transport of radionuclides from facilities onto the hillslopes, and from the hillslopes into adjoining creeks where contaminated material migrates downstream with surface water and sediment, and; 2) adaptation of the activities associated with the Resident Farmer scenario to assess potential exposures to contamination in the hillslope areas. This discussion will cover the conceptual basis of the hillslope exposure and transport models, and also implementation in the PPA computer model. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Evaluation of Potential Impacts of Free Chlorine during Washing of Fresh-Cut Leafy Greens on Escherichia coli O157:H7 Cross-Contamination and Risk of Illness

Addition of chlorine-based antimicrobial substances to fresh-cut leafy green wash water is done to minimize microbial cross-contamination during processing. We developed the FDA Leafy Green Risk Assessment Model (FDA-LGRAM) to quantify the impact of free chlorine concentration in wash water during fresh-cut lettuce processing on the extent of water-mediated cross-contamination between shredded lettuce and the associated risk of illness due to exposure to Escherichia coli O157:H7. At different contamination prevalence and levels of E. coli O157:H7 on incoming lettuce heads, the model compared the predicted prevalence of contaminated fresh-cut lettuce packages and the risk of illness per serving between: (1) a scenario where fresh-cut lettuce was packaged without washing; and (2) scenarios involving washing fresh-cut lettuce with different levels of free chlorine (0 ppm, 5 ppm, 10 ppm, 15 ppm, and 20 ppm) prior to packaging. Our results indicate that the free chlorine level in wash water has a substantial impact on the predicted prevalence of contaminated fresh-cut lettuce packages and the risk of illness associated with E. coli O157:H7 in fresh-cut lettuce. Results showed that the required level of free chlorine that can minimize water-mediated cross-contamination and reduce the corresponding risk of illness depended on contamination prevalence and levels of E. coli O157:H7 on incoming lettuce heads. Our model also indicated that the pathogen inactivation rate in wash water via free chlorine was a key model parameter that had a significant impact on the extent of cross-contamination during washing and the predicted associated risk of illness.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗
DOE OSTI2022

Mechanical and tribological properties of anodic Al coatings as a function of anodizing conditions

Enhanced wear and corrosion resistance properties are vital for numerous functional and decorative applications. Anodizing is a process frequently used to generate stable oxide coatings on metal surfaces, including aluminium (Al). In this work, we present an evaluation of process variables for optimized anodized coating properties using existing methods and as a baseline for novel coating development. A representative relatively pure Al alloy was chosen as a model system with a goal of finding conditions to achieve high wear coatings with retained ductility. AA5052 alloy coupons were anodized in two different electrolytes (sulfuric and phosphoric acid) to study the effects of anodizing conditions on the mechanical and tribological properties of the anodic coatings. Porosity was evaluated with microscopy, coating hardness was determined via nanoindentation, and tribological properties were characterized using a pin-on-disk tribometer. These measurements were correlated and a loading evaluation was performed to assess the optimum nanoindentation parameters for the use of representative coupons without the need for special processing prior to anodizing. The porosity and coating thickness were found to depend on the anodizing time and the type of electrolyte. Thicker and harder anodic coatings were generated in sulfuric acid compared to phosphoric acid. Porosity studies of the anodic coatings generated in phosphoric acid revealed that coating porosity decreased as the anodizing time increased. Both electrolytes generated anodic coatings with improved tribological properties (friction coefficient and dimensional wear rate), and an optimum processing time was identified for best wear properties.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Low-Cost Recyclable Oxygen Carrier and Novel Process for Chemical Looping Combustion

The University of North Dakota, through its Institute for Energy Studies and Energy & Environmental Research Center, partnered with Envergex LLC, Barr Engineering and Microbeam Technologies to develop a transformational enabling technology for advancement of Chemical Looping Combustion technology. Industrial support was provided by Carbontec Energy Corporation. The project targeted the two biggest challenges to chemical looping combustion: (1) High costs of oxygen carrier replacement/loss due to expensive manufacturing and high replacement rates from physical attrition and/or decrease in reactivity, and (2) Inherently slow fuel char conversion which represents the rate-limiting step for chemical looping combustion and results in very large equipment sizes, and overall lower carbon dioxide capture efficiency. The project activities were addressed in a series of seven tasks. Task 1 extended throughout the entire project and oversaw project management and execution. Task 2 and 3 focused on development and evaluation of the novel oxygen carrier. Task 4 to 7 focused on design of the novel reactor, testing with the novel oxygen carrier and a techno-economic assessment of the process. The list of tasks are: Task 1 – Project management and planning, Task 2 – Laboratory scale oxygen carrier manufacturing and assessment, Task 3 – Modeling and laboratory-scale evaluation of oxygen carrier performance with coal, Task 4 – 10-kilowatt thermal integrated system installation, Task 5 – Scaled-up oxygen carrier manufacturing, Task 6 – 10-kilowatt testing, and Task 7 – Process design and techno-economic analysis.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

Development of an Assessment Methodology That Enables the Nuclear Industry to Evaluate Adoption of Advanced Automation

Nuclear power has a crucial role in providing safe, reliable, and economical carbon-free electricity for today and the future. For continued operation, many of the existing United States nuclear power plants will begin the subsequent license renewal process for extending their operating license periods. As plants extend their expected operating lifetimes, there is a significant opportunity to modernize. These plants have a much stronger business case with these extended mission periods to modernize and significantly enhance their economic viability in current and future energy markets by implementing digital technologies that support innovation, efficiency gains, and business-model transformation. Ensuring continued safety and reliability is crucial. Transformative digital technologies—including automation—that fundamentally change the concept of operation for the nuclear power plant operating model requires a critical focus on the human and technology integration element. Further, the nuclear industry has historically been reluctant to modernize due to having a risk adverse culture and lack of clarity for a transformative new state vision (Joe & Remer, 2019; Thomas et al., 2020). Common barriers include (1) the perceived value and return on investment (ROI) of digital technology, (2) the perceived risk associated with licensing, regulatory, and cybersecurity, and (3) insufficient guidance for performing digital modifications to power generation systems. This work presents a methodology to address these barriers and support the industry in adopting advanced automation and digital technology through developing a transformative vision and implementation strategy that will address the human and technology integration element. This research leverages previous LWRS Program and industry results. It draws specifically on previous LWRS Program research in the areas of advanced alarm systems, computer-based procedures, model informed decision support, and advanced human-system interface displays (e.g., overviews and task-based). The modernization methodology can be used to guide transformative thinking when integrating a set of vendor-specific capabilities to support a new concept of operations and a utility’s end-state vision. The results of this research are organized into six major sections: - Section 1 introduces the need for supporting large-scale digital modifications that will renew the technology base for extended operating life beyond 60 years - Section 2 describes the challenges that the nuclear industry is enduring with modernizing. - Section 3 summarizes the primary standards and guidance. - Section 4 presents earlier work from the LWRS Program regarding the development of a transformative conceptual design for an advanced control room of a hybrid plants. - Section 5 presents a methodology that is designed at addressing the challenges in the industry today in achieving a transformative new state vision and concept of operations. - Conclusions and next steps of this research are provided in Section 6.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2023

Development of a Benchmark Eddy Flux Evapotranspiration Dataset for Evaluation of Satellite-Driven Evapotranspiration Models Over the CONUS

A large sample of ground-based evapotranspiration (ET) measurements made in the United States, primarily from eddy covariance systems, were post-processed to produce a benchmark ET dataset. The dataset was produced primarily to support the intercomparison and evaluation of the OpenET satellite-based remote sensing ET (RSET) models and could also be used to evaluate ET data from other models and approaches. OpenET is a web-based service that makes field-delineated and pixel-level ET estimates from well-established RSET models readily available to water managers, agricultural producers, and the public. The benchmark dataset is composed of flux and meteorological data from a variety of providers covering native vegetation and agricultural settings. Flux footprint predictions were developed for each station and included static flux footprints developed based on average wind direction and speed, as well as dynamic hourly footprints that were generated with a physically based model of upwind source area. The two footprint prediction methods were rigorously compared to evaluate their relative spatial coverage. Data from all sources were post-processed in a consistent and reproducible manner including data handling, gap-filling, temporal aggregation, and energy balance closure correction. The resulting dataset included 243,048 daily and 5,284 monthly ET values from 194 stations, with all data falling between 1995 and 2021. We assessed average daily energy imbalance using 172 flux sites with a total of 193,021 days of data, finding that overall turbulent fluxes were understated by about 12% on average relative to available energy. Multiple linear regression analyses indicated that daily average latent energy flux may be typically understated slightly more than sensible heat flux. This dataset was developed to provide a consistent reference to support evaluation of RSET data being developed for a wide range of applications related to water accounting and water resources management at field to watershed scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

NRAP-Open-IAM: NRAP Open Source Integrated Assessment Model

Note: This is the last version (a2.6.1) of NRAP-Open-IAM released during NRAP Phase II in 2022. The latest version of NRAP-Open-IAM is available here: https://edx.netl.doe.gov/dataset/phase-iii-nrap-open-iam NRAP-Open-IAM is an open-source software product that enables quantification of containment effectiveness and leakage risk at storage sites in the context of system uncertainties and variability. NRAP-Open-IAM represents the next-generation in a line of systems-based computational models developed for quantitative geological carbon storage (GCS) risk assessment. The model comprises a set of reduced-order and analytical models of various components of the GCS system, potential leakage pathways, receptors of concern including impact to groundwater resources and the atmosphere, a framework to support stochastic simulation, time stepping, uncertainty quantification, other analytical functionality for scenario and risk-performance evaluation, and a basic graphical user interface to support scenario development, data input simulation definition, and basic post-processing and results display. As the NRAP Open-IAM functionality continues to evolve, we continue to add to its capability to develop quantitative, probabilistic, and time-dependent profiles of the evolution of risk at a GCS site and evaluate the influence of uncertain parameters on uncertainty in predicted risk. It can be used to quantify the dynamics of reservoir saturation plume and pressure-affected area, for evaluation of the area of potential groundwater impact (i.e., Area of Review) and monitoring requirements to support cost and regulatory analysis, and for consideration of different post-injection site care and closure scenarios. This submission contains the current version of NRAP-Open-IAM available for evaluation and testing. To use the NRAP-Open-IAM, download the source code (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/4c24a3da-3b40-4ffe-9892-c807ae9f8760) then open the NRAP-Open-IAM user's guide (https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669) to read more about the tool. Installation instructions for Windows, Mac, and Linux can be found in the "installers" folder of the extracted NRAP-Open-IAM folder and describe setup of environment (e.g., Python libraries) needed for proper work of the tool. Test of installation can be done by running "python openiam_setup_tests.py" in the "setup" folder. The installation test also runs a test suite to see if the NRAP-Open-IAM has been installed correctly. To run the test suite separately, run "python iam_test.py" in the "test" folder. User's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/8b27335a-343c-4836-b8a3-3ad0bdc9e669 Developer's guide: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/3bc6ee7d-609d-4eb6-80ba-fa6130ee0313 Reservoir simulation data used in some examples distributed with NRAP-Open-IAM: - Kimberlina: https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/eb62cece-61b2-4037-9b6d-32407dde2ab8 - Kimberlina (compartmentalized): https://edx.netl.doe.gov/dataset/08f396c8-bc5f-44ad-a028-6e98a6ea6d70/resource/366f9530-3b32-4b84-affe-ab2df1d9a8b5 - FutureGen 2.0: https://edx.netl.doe.gov/dataset/futuregen-2-0-1008-simulation-reservoir-lookup-table NRAP-Open-IAM GitLab repository: https://gitlab.com/NRAP/OpenIAM Related publications: - Bacon, D., Yonkofski, C., Brown, C., Demirkanli, D. and Whiting, J., 2019. Risk-based post injection site care and monitoring for commercial-scale carbon storage: Reevaluation of the FutureGen 2.0 site using NRAP-Open-IAM and DREAM. International Journal of Greenhouse Gas Control 90: 102784. - Bacon, D. Demirkanli, D., and White, S., 2020. Probabilistic risk-based Area of Review (AoR) determination for a deep-saline carbon storage site. International Journal of Greenhouse Gas Control 102: 103153. - Harp, D., Oldenburg, C., and Pawar, R., 2019. A metric for evaluating conformance robustness during geologic CO2 sequestration operations. International Journal of Greenhouse Gas Control 85: 100-108. - Lackey, G., Vasylkivska, V., Huerta, N., King, S., and Dilmore, R., 2019. Managing well leakage risks at a geologic carbon storage site with many wells, International Journal of Greenhouse Gas Control, 88 :182-194. - Vasylkivska, V., Dilmore, R., Lackey, G., Zhang, Y., King, S., Bacon, D., Chen, B., Mansoor, K., and Harp, D., 2021. NRAP-Open-IAM: A flexible open-source integrated assessment model for geologic carbon storage risk assessment and management, Environmental Modelling & Software, 143: 105114. Presentations: - Chen, B., Harp, D., and Pawar, R., A data assimilation approach (ES-MDA) coupling with NRAP-Open-IAM for quantifying uncertainty reduction in geological CO2 sequestration. AGUFM 2019: T44A-02. - Chen, B., and Harp, D., Improving risk analysis precision for geologic CO2 sequestration by quantifying the uncertainty reduction before and after acquiring monitoring data. 14th Greenhouse Gas Control Technologies Conference, Melbourne, Australia, 2018, pp. 21-26. - Harp, D., National Risk Assessment Partnership Task 2: Containment Assurance. No. LA-UR-19-28654, Los Alamos National Laboratory (LANL), Los Alamos, NM (United States), 2019. - Vasylkivska, V., King, S., Bacon, D., Harp, D., Chen, B., Mansoor, K., Onishi, T., Yang, Y., Zhang, Y., and Keating, E., NRAP-Open-IAM: An open-source integrated assessment model, poster, Mastering the Subsurface Through Technology Innovation, Partnerships and Collaboration: Carbon Storage and Oil and Natural Gas Technologies Review Meeting, Pittsburgh, PA, August 13-16, 2018. - Vasylkivska, V., Lackey, G., King, S., Wentworth, A., Huerta, N., Creason, C., DiGiulio, J., Yang, Y., and Dilmore, R., Long-term risk analysis of a geologic CO2 storage project during the post-injection period, SIAM Conference on Computational Science and Engineering, Spokane, WA, February 25-March 1, 2019. - Vasylkivska, V., Overview of the NRAP-Open-IAM tool for carbon storage (beta release), 2019 Annual NRAP Tool Users Meeting, Pittsburgh, PA, August 27, 2019. - Vasylkivska, V., Bacon, D., Chen, B., Dilmore, R., Harp, D., King, S., Lackey, G., Lindner, E., Liu, G., Mansoor, K. and Zhang, Y., NRAP-Open-IAM: A new, open-source code for integrated assessment of geologic carbon storage containment effectiveness and leakage risk, poster, American Geophysical Union Fall Meeting 2020 (virtual meeting), December 2020. - Vasylkivska, V., NRAP open-source integrated assessment model and relevant application, oral presentation, NRAP workshop "NRAP Tools for Geologic Carbon Storage Risk-Based Decision Making" held in conjunction with Groundwater Protection Council (GWPC) 2021 Annual Forum (virtual meeting), Salt Lake City, UT, September 2021. - Vasylkivska, V., NRAP-Open-IAM: open-source integrated assessment model, digital poster/demonstration, software demonstration session, 2022 Carbon Management Project Review Meeting, August 16, 2022

AoR↗
DOE OSTI2026

Robust Explanations using Diverse Adversarially Trained Ensembles, Multi-Modal Contrastive Learning, and Attribution-based Confidence Metrics

The primary objective of this project is to strengthen the trustworthiness of AI systems by designing algorithms that make their internal decision-making processes more understandable to human users. This involves creating clear, interpretable explanations for AI decisions and developing metrics to assess these explanations' validity and reliability. Significant progress has been achieved through (i) developing symbolic explanations, (ii) generating meaningful interpretive insights, (iii) establishing accuracy and confidence metrics, and (iv) devising methods to evaluate the knowledge boundaries of AI models. To date, the research findings have been shared in peer-reviewed publications, with accompanying scientific and technical information (STI) detailed below.

97 MATHEMATICS AND COMPUTING↗