Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗

Redshifts of radio sources in the Million Quasars Catalogue from machine learning

ABSTRACT With the aim of using machine learning techniques to obtain photometric redshifts based upon a source’s radio spectrum alone, we have extracted the radio sources from the Million Quasars Catalogue. Of these, 44 119 have a spectroscopic redshift, required for model validation, and for which photometry could be obtained. Using the radio spectral properties as features, we fail to find a model which can reliably predict the redshifts, although there is the suggestion that the models improve with the size of the training sample. Using the near-infrared–optical–ultraviolet bands magnitudes, we obtain reliable predictions based on the 12 503 radio sources which have all of the required photometry. From the 80:20 training–validation split, this gives only 2501 validation sources, although training the sample upon our previous SDSS model gives comparable results for all 12 503 sources. This makes us confident that SkyMapper, which will survey southern sky in the u, v, g, r, i, z bands, can be used to predict the redshifts of radio sources detected with the Square Kilometre Array. By using machine learning to impute the magnitudes missing from much of the sample, we can predict the redshifts for 32 698 sources, an increase from 28 to 74 per cent of the sample, at the cost of increasing the outlier fraction by a factor of 1.4. While the ‘optical’ band data prove successful, at this stage we cannot rule out the possibility of a radio photometric redshift, given sufficient data which may be necessary to overcome the relatively featureless radio spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

Grid Modeling and Hosting Capacity Analysis

An interface with the OpenDSS distribution grid simulator, facilitating users in calibrating and validating models. Additionally, three distinct tools have been developed: PV Hosting Capacity: This tool allows users to determine the additional amount of photovoltaic (PV) generation that can be integrated into the system without breaching operational constraints. EV Hosting Capacity: This tool focuses on identifying the capacity for incorporating extra electric vehicle (EV) load into the system without surpassing operational limitations. Project Impact Analysis Tool: This tool is designed to assess and report all potential grid violations associated with a specific project, providing valuable insights into its impact on the distribution grid.

Poudel, Shiva↗

Tracking vegetation phenology across diverse North American biomes using PhenoCam imagery

Vegetation phenology controls the seasonality of many ecosystem processes, as well as numerous biosphere-atmosphere feedbacks. Phenology is also highly sensitive to climate change and variability. Here we present a series of datasets, together consisting of almost 750 years of observations, characterizing vegetation phenology in diverse ecosystems across North America. Our data are derived from conventional, visible-wavelength, automated digital camera imagery collected through the PhenoCam network. For each archived image, we extracted RGB (red, green, blue) colour channel information, with means and other statistics calculated across a region-of-interest (ROI) delineating a specific vegetation type. From the high-frequency (typically, 30 min) imagery, we derived time series characterizing vegetation colour, including "canopy greenness", processed to 1- and 3-day intervals. For ecosystems with one or more annual cycles of vegetation activity, we provide estimates, with uncertainties, for the start of the "greenness rising" and end of the "greenness falling" stages. Lastly, the database can be used for phenological model validation and development, evaluation of satellite remote sensing data products, benchmarking earth system models, and studies of climate change impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗

The Double-edged Sword of Data-driven Super-Resolution: Adversarial Super-resolution Models

Data-driven super-resolution (SR) methods are often integrated into imaging pipelines as preprocessing steps to improve downstream tasks such as classification and detection. However, these SR models introduce a previously unexplored attack surface into imaging pipelines. In this paper, we present AdvSR, a framework demonstrating that adversarial behavior can be embedded directly into SR model weights during training, requiring no access to inputs at inference time. Unlike prior attacks that perturb inputs or rely on backdoor triggers, AdvSR operates entirely at the model level. By jointly optimizing for reconstruction quality and targeted adversarial outcomes, AdvSR produces models that appear benign under standard image quality metrics while inducing downstream misclassification. We evaluate AdvSR on three SR architectures (SRCNN, EDSR, SwinIR) paired with a YOLOv11 classifier and demonstrate that AdvSR models can achieve high attack success rates with minimal quality degradation. These findings highlight a new model-level threat for imaging pipelines, with implications for how practitioners source and validate models in safety-critical applications.

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Analysis of the Effect of Vehicle Platooning on the Optimal Control of a Heavy Duty Engine Thermal System

One promising method for reducing fuel consumption and emissions, particularly in heavy duty trucks, is platooning. As the distance between vehicles decreases, the following vehicles will experience less aerodynamic drag on the front of the vehicle. However, reducing the velocity of the air contacting the front of the vehicle could have adverse effects on the temperature of the engine. To compensate for this effect, the energy consumption of the engine cooling system might increase, ultimately limiting the overall improvements obtained with platooning. Understanding the coupling between drag reduction and engine cooling load requirement is key for successfully implementing platooning strategies. Additionally, in a Connected and Automated Vehicle (CAV) environment, where information of the future engine load becomes available, the operation of the cooling system can be optimized in order to achieve the maximum fuel consumption reduction. In this paper, a control-oriented physics-based model for the engine cooling loop of a Volvo engine is developed and validated against road data. Starting from the validated model, an optimal control problem for the coolant system is formulated considering the tradeoff between the tracking of the engine temperature setpoint and the corresponding fuel consumption under different trailing distances. To compare the coolant system performance, Dynamic Programming (DP) is used to determine the global optimal solution for the coolant system actuator. The coupling between optimal cooling system operation and reduction in ram air are evaluated by comparing the results obtained from the DP under different platooning conditions against the unrestricted scenario. In addition, the paper analyzes the changes in the tradeoff between fuel consumption and setpoint tracking for different vehicle distances. This analysis will provide useful insight on the sensitivity of the coolant system controller calibration to the platoon distance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

RELAP5-3D validation studies based on the High Temperature Test facility

In the spring and summer of 2019, experiments were conducted at the High Temperature Test Facility (HTTF) that form the basis of an upcoming high-temperature gas-cooled reactor (HTGR) thermal hydraulics (T/H) benchmark. HTTF is an integral effects test facility for HTGR T/H modeling validation. This paper presents RELAP5-3D models of two of those experiments: PG-27, a pressurized conduction cooldown (PCC); and PG-29, a depressurized conduction cooldown (DCC). These models used the RELAP5-3D model of HTTF originally developed by Paul Bayless as a starting point. The sensitivity analysis and uncertainty quantification code, RAVEN was used to perform calibration studies for the steady-state portion of PG-27. Here we developed four PG-27 calibrations based on steady-state conditions. These calibrations all used an effective thermal conductivity equal to 36 % of the measured thermal conductivity, but they differed with respect to the frictional pressure drops and radial conduction models. These models all captured the trends in steady-state temperature distributions and transient temperature behavior well. All four calibrations show room for improvement in predicting the transient temperature rise. The smallest error in temperature rise during the transient was a 21 % underprediction, and the largest was a 48 % underprediction. The errors in transient temperature rise are largely a result of a mismatch in power density between the RELAP5-3D model and the experiment due to the location of active heater rods along the boundary between heat structures in the model. The best of these calibrations was applied to PG-29 to model the DCC. Once again, temperatures during the transient were underpredicted but trends in temperature were captured. The RELAP5-3D model captured trends in the data but could not reproduce measured temperatures exactly. This result is not attributed to deficiencies in the experimental data or to RELAP5–3D itself. Rather, this result likely arises due to the some of the assumptions and decisions made when the RELAP5-3D model was first developed, prior to the execution of HTTF experiments. An agreement in prediction of temperature trends but challenges reproducing HTTF temperatures within measurement uncertainty is consistent with previous analyses of HTTF in the literature. Future RELAP5-3D validation activities centered around HTTF may be able to provide greater insight into the code’s capabilities for HTGR modeling with a more finely nodalized model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

On the competition between mixing rate and uniformity in a coaxial hydrodynamic focusing mixer

Fast microfluidic mixers for use with line-of-sight integrating detection schemes pose unique challenges. Such detectors typically cannot discriminate signal from slow moving (e.g. near internal walls) and fast-moving portions of the fluid stream. This convolves reaction rate dynamics with fluid flow residence time dynamics. Further, the small cross sections of typical three-dimensional hydrodynamic focusing devices lead to lower detection signals. The current study focuses on achieving both small time scales of mixing and homogenous residence times. This is achieved by injecting sample through a center capillary and hydrodynamically focusing using a sheath flow within a tapered second capillary. The current design also features a third, larger coaxial capillary. The mixed stream flows into the large cross-section of this third capillary to decelerate and expand the stream by up to 14-fold to improve line-of-sight signal strength of reaction products. Hydrodynamic focusing, mixing, and expansion are studied using analytical and numerical models and also studied experimentally using a fluorescein-iodide quenching reaction. The experimentally validated models are used to explore trade-offs between mixing rate and uniformity. For the first time, this work presents detailed analysis of the Lagrangian time history of species transport during mixing inside coaxial capillaries to measure mixing nonuniformity. The mixing region enables order 100 μs mixing times and residence time widths of the same order (140 μs).

42 ENGINEERING↗

Evaluation of Engineered Barrier Systems FY20 Report

This report describes research and development (R&D) activities conducted during fiscal year 2020 (FY20) specifically related to the Engineered Barrier System (EBS) R&D Work Package in the Spent Fuel and Waste Science and Technology (SFWST) Campaign supported by the United States (U.S.) Department of Energy (DOE). The R&D activities focus on understanding EBS component evolution and interactions within the EBS, as well as interactions between the host media and the EBS. A primary goal is to advance the development of process models that can be implemented directly within the Generic Disposal System Analysis (GDSA) platform or that can contribute to the safety case in some manner such as building confidence, providing further insight into the processes being modeled, establishing better constraints on barrier performance, etc. The FY20 EBS activities involved not only modeling and analysis work, but experimental work as well. Despite delays to some planned activities due to COVID-19 precautions, progress was made during FY20 in multiple research areas and documented in this report as follows: (1) EBS Task Force: Task 9/FEBEX Modeling Final Report: Thermo-Hydrological Modeling with PFLOTRAN, (2) preliminary sensitivity analysis for the FEBEX in-situ heater test, (3) cement-carbonate rock interaction under saturated conditions: from laboratory to modeling, (4) hydrothermal experiments, (5) progress on investigating the high temperature behavior of the uranyl-carbonate complexes, (6) in-situ and electrochemical work for model validation, (7) investigation of the impact of high temperature on EBS bentonite with THMC modeling, (8) sorption and diffusion experiments on bentonite, (9) chemical controls on montmorillonite structure and swelling pressure, (10) microscopic origins of coupled transport processes in bentonite, (11) understanding the THMC evolution of bentonite in FEBEX-DP—coupled THMC modeling, (12) modeling in support of HotBENT, an experiment studying the effects of high temperatures on clay buffers/near-field, and (13) high temperature heating and hydration column test on bentonite.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Investigation of post-injection strategies for diesel engine Catalyst Heating Operation using a vapor-liquid-equilibrium-based spray model

Most multidimensional engine simulations spend much time solving for non-equilibrium spray dynamics (atomization, collision, vaporization). However, their accuracy is limited by significant grid dependency, and the need for extensive calibration. This is critical for modeling cold-start diesel fuel post injections, which occur at low temperatures and pressures, far from typical model validation ranges. At the same time, resolving micron-scale spray phenomena would render full Eulerian multiphase calculations prohibitive. In this study, an improved phase equilibrium based approach was implemented and assessed for simulating diesel catalyst heating operation strategies. A phase equilibrium solver based on the model by Yue and Reitz [1] was implemented: a fully multiphase CFD solver is employed with an engineering-size engine grid, and fuel injection is modeled using the standard Lagrangian parcels approach. Mass and energy from the liquid parcels are released to the Eulerian multiphase mixture according to an equilibrium-based liquid jet model. An improved phase equilibrium solver was developed to handle large real-gas mixtures such as those from accurate chemical kinetics mechanisms. The liquid-jet model was improved such that momentum transfer to the Eulerian solver better reproduces the physical spray jet structure. Validation of liquid/vapor penetration predictions showed that the model yields accurate results with very limited tuning and low sensitivity to the few calibration constants. In-cylinder simulations of diesel catalyst heating operation strategies showed that capturing spray structure is paramount when short, transient injection pulses and low temperatures are present. Furthermore, the EP model provides improved predictions of post-injection spray structure and ignitability, while conventional spray modeling does not capture the increase of liquid penetration during the expansion stroke. Finally, the only important EP model calibration constant, Cliq, does not affect momentum transfer, but it changes the local charge cooling distribution through the local energy transfer, which makes it candidate to additional research. The results confirm that non-equilibrium spray processes do not need to be resolved in engineering simulations of high-pressure diesel sprays.

42 ENGINEERING↗

Dynamic order reduction of thin-film deposition kinetics models: A reaction factorization approach

A set of numerical tools for the analysis and dynamic dimension reduction of chemical vapor and atomic layer deposition (ALD) surface reaction models is developed in this work. The approach is based on a two-step process where in the first, the chemical species surface balance dynamic equations are factored to effectively decouple the (nonlinear) reaction rates, a process that eliminates redundant dynamic modes and that identifies conserved quantities. If successful, the second phase is implemented to factor out redundant dynamic modes when species relatively minor in concentration are omitted; if unsuccessful, the technique points to potential model structural problems. An alumina ALD process is used for an example consisting of 19 reactions and 23 surface and gas-phase species. Using the approach developed, the model is reduced by nineteen modes to a four-dimensional dynamic system without any knowledge of the reaction rate values. Results are interpreted in the context of potential model validation studies.

42 ENGINEERING↗

HyRAM V1.0 User Guide

Hydrogen Risk Assessment Models (HyRAM) is a prototype software toolkit that integrates data and methods relevant to assessing the safety of hydrogen fueling and storage infrastructure. The HyRAM toolkit integrates deterministic and probabilistic models for quantifying accident scenarios, predicting physical effects, and characterizing the impact of hydrogen hazards, including thermal effects from jet fires and thermal pressure effects from deflagration. HyRAM version 1.0 incorporates generic probabilities for equipment failures for nine types of components, and probabilistic models for the impact of heat flux on humans and structures, with computationally and experimentally validated models of various aspects of gaseous hydrogen release and flame physics. This document provides an example of how to use HyRAM to conduct analysis of a fueling facility. This document will guide users through the software and how to enter and edit certain inputs that are specific to the user-defined facility. Description of the methodology and models contained in HyRAM is provided in [1]. This User’s Guide is intended to capture the main features of HyRAM version 1.0 (any HyRAM version numbered as 1.0.X.XXX). This user guide was created with HyRAM 1.0.1.798. Due to ongoing software development activities, newer versions of HyRAM may have differences from this guide.

08 HYDROGEN↗

Importance of treating correlations in the uncertainty quantification of radiation damage metrics - 25461

The radiation effects community embraces the importance of quantifying uncertainty in model predictions and the importance of propagating this uncertainty into the integral metrics used to validate models, but they are not always aware of the importance of addressing the energy- and reaction-dependent correlations in the underlying uncertainty contributors. This paper presents a rigorous high-fidelity Total Monte Carlo approach that addresses the correlation in the underlying uncertainty components and quantifies the role of both energy and reaction-dependent correlations in a sample application that addresses the damage metrics relevant to silicon semiconductors. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Grid Modernization Laboratory Consortium - Testing and Verification

This paper highlights some of the unique testing capabilities and projects being performed at several national laboratories as part of the U. S. Department of Energy Grid Modernization Laboratory Consortium. As part of this effort, the Grid Modernization Laboratory Consortium Testing Network isbeing developed to accelerate grid modernization by enablingaccess to a comprehensive testing infrastructure and creating a repository of validated models and simulation tools that will be publicly available. This work is key to accelerating thedevelopment, validation, standardization, adoption, and deployment of new grid technologies to help meet U. S. energy goals.

24 POWER TRANSMISSION AND DISTRIBUTION↗

TH-CD-207A-08: Simulated Real-Time Image Guidance for Lung SBRT Patients Using Scatter Imaging

Purpose: To develop a comprehensive Monte Carlo-based model for the acquisition of scatter images of patient anatomy in real-time, during lung SBRT treatment. Methods: During SBRT treatment, images of patient anatomy can be acquired from scattered radiation. To rigorously examine the utility of scatter images for image guidance, a model is developed using MCNP code to simulate scatter images of phantoms and lung cancer patients. The model is validated by comparing experimental and simulated images of phantoms of different complexity. The differentiation between tissue types is investigated by imaging objects of known compositions (water, lung, and bone equivalent). A lung tumor phantom, simulating materials and geometry encountered during lung SBRT treatments, is used to investigate image noise properties for various quantities of delivered radiation (monitor units(MU)). Patient scatter images are simulated using the validated simulation model. 4DCT patient data is converted to an MCNP input geometry accounting for different tissue composition and densities. Lung tumor phantom images acquired with decreasing imaging time (decreasing MU) are used to model the expected noise amplitude in patient scatter images, producing realistic simulated patient scatter images with varying temporal resolution. Results: Image intensity in simulated and experimental scatter images of tissue equivalent objects (water, lung, bone) match within the uncertainty (∼3%). Lung tumor phantom images agree as well. Specifically, tumor-to-lung contrast matches within the uncertainty. The addition of random noise approximating quantum noise in experimental images to simulated patient images shows that scatter images of lung tumors can provide images in as fast as 0.5 seconds with CNR∼2.7. Conclusions: A scatter imaging simulation model is developed and validated using experimental phantom scatter images. Following validation, lung cancer patient scatter images are simulated. These simulated patient images demonstrate the clinical utility of scatter imaging for real-time tumor tracking during lung SBRT.

60 APPLIED LIFE SCIENCES↗

Low-Cost Sulfur Thermal Storage for Solar Industrial Process Heat Applications

Industrial process heat (IPH) is one of the largest energy demands in U.S., representing about 10% of all domestic energy consumption. Fuel costs to generate this industrial process heat are generally a top three cost for industry, a major component in American manufacturing competitiveness. Roughly 60% of US IPH demand (about 6,500 TBtu annually) falls in the medium-temperature range of 100–250 °C. While concentrated solar thermal (CST) technologies can provide a cost-effective source of heat in this temperature range, solar intermittency limits their adoption in industries that operate 24/7. Element 16 Technologies, Inc. developed a low-cost sulfur thermal energy storage (TES) technology to bridge this gap by capturing excess solar heat during the day and dispatching it reliably during non-solar hours. The core innovation is the use of sulfur, an abundant, industrial waste byproduct that costs ten times less than molten salt used in commercial TES systems. The overall goal of the project was to advance the design and development of molten sulfur TES to a manufacturing-relevant prototype stage for solar industrial process heat applications, while establishing and validating a realistic pathway to commercial success. Key tasks included corrosion and mechanical durability testing to identify cost-effective materials, design investigations using physics-based simulation tools, techno-economic evaluations of system lifetime costs, and pilot-scale testing for performance verification. Corrosion testing of steel alloys under cyclic molten sulfur conditions showed that austenitic stainless steels in the 300 series performed particularly well, with no structural degradation of welds or joints. Thermal cyclic testing of pilot sulfur TES units up to 1.5 MWh quantified charge/discharge rates, heat losses, round-trip efficiency and validated the system's capability to operate effectively under intermittent charging conditions. A techno-economic model, informed by sulfur TES performance model validated using pilot test data, showed that hybrid solar+sulfur TES+NG boiler systems are economically competitive with incumbent natural gas boilers for multiple locations in the southwest US. In summary, this project established molten sulfur TES as a technically viable pathway to improve economic competitiveness of American manufacturing by lowering the cost of solar industrial process heat.

14 SOLAR ENERGY↗

EVALUATION OF PRESSURE DROP CORRELATIONS FOR THE WIRE-WRAPPED ROD BUNDLES

The accurate prediction of pressure drop in the fuel rod bundle is of importance for the design and thermal-hydraulic analysis of nuclear reactor system. Due to very complex geometry of wire-wrapped fuel rod bundle geometry for the Sodium Fast Reactor (SFR), a simple method using hydraulic (equivalent) diameter is not sufficient to predict the pressure drop of rod bundle accurately. For several decades, many experimental works have been performed to develop an accurate correlation for wire-wrapped fuel bundle friction factor. In these works, the friction factor correlation of wire-wrapped fuel bundle has been developed as a function of Reynolds number of the flow and the design parameters such as fuel pin diameter, wire diameter, rod pitch, and wire lead length. The Cheng and Todreas correlations are well-known and used in many subchannel analysis code, such as CADET, TRIO-U, MATRA-LMW, SE2-ANL, etc. Novendstern model, Rehme model, Baxi and Dalle Donne model are also well-known and widely referred. Computational Fluid Dynamics is another typical approach to predict the pressure drop of wire-wrapped fuel rod bundle, but it requires the model validation because the accuracy of pressure drop prediction by the CFD simulation depends on what turbulence model is employed. The present work aims at evaluating the existing pressure drop correlations for the wire-wrapped fuel rod bundle and evaluating the pressure drop of 217-pin rod bundle by the CFD analysis.

99 GENERAL AND MISCELLANEOUS↗