Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

The Ground Truth Program: Simulations as Test Beds for Social Science Research Methods.

Social systems are uniquely complex and difficult to study, but understanding them is vital to solving the world’s problems. The Ground Truth program developed a new way of testing the research methods that attempt to understand and leverage the Human Domain and its associated complexities. The program developed simulations of social systems as virtual world test beds. Not only were these simulations able to produce data on future states of the system under various circumstances and scenarios, but their causal ground truth was also explicitly known. Research teams studied these virtual worlds, facilitating deep validation of causal inference, prediction, and prescription methods. The Ground Truth program model provides a way to test and validate research methods to an extent previously impossible, and to study the intricacies and interactions of different components of research.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Verification and Validation of Flow Confinement Modeling using OpenFAST Source Panel Method

Blockage or flow confinement effects in scale wind and water turbine testing in experimental facilities, including wind and water tunnels and tow tanks, can significantly alter incident aerodynamic and hydrodynamic loads, turbine performance (thrust, torque, power output), and wake dynamics compared to unconfined conditions. As scale model tests are key sources of OpenFAST model validation measurements, directly modeling flow confinement and its effects in OpenFAST enables improved model validat

Kim, Dongyoung [Sandia National Laboratories (SNL-↗
DOE OSTI2026

Nondestructive Evaluation of Carbon Fiber Reinforced Polymers

The American Society of Mechanical Engineers Boiler and Pressure Vessel Code requires repair and replacement of safety-related piping materials to meet the original Construction Code; however, no construction criteria currently exist for carbon fiber reinforced polymer (CFRP) materials in the nuclear industry. Although nondestructive examination (NDE) techniques for cast and wrought ferritic and austenitic steels are well established, licensees are increasingly deploying novel materials such as CFRP for which assessment of the use of NDE is required, as the inspectability of such materials and the influence of manufacturing processes on inspectability remain insufficiently understood. To address these gaps, Pacific Northwest National Laboratory (PNNL) evaluated the fabrication of several CFRP repair mockups and the effectiveness of NDE methods to support regulatory review of CFRP repairs in nuclear power plant applications. Representative flat-plate mockups containing realistic fabrication defects were manufactured and inspected using manual and automated tap testing, dynamic response spectroscopy (DRS), and ultrasonic testing (UT). The study identified significant fabrication variability, particularly in controlling defect size and epoxy thickness, which strongly influenced defect detectability by NDE methods. Tap testing was effective for shallow defects in thin epoxy configurations but unreliable for thicker repairs and deeper flaws. DRS demonstrated higher sensitivity to dry spots but produced unconfirmed indications for thicker plates, requiring further validation. Conventional UT, particularly at 1.0 MHz, showed the strongest overall capability for detecting a range of defects, although performance degraded with increasing repair thickness and complexity. The results highlight the need to better define critical defect sizes, develop reliable mockup fabrication methods, and validate NDE methods needed to support CFRP repairs.

36 MATERIALS SCIENCE↗
DOE OSTI2020

SCALE capabilities for high temperature gas-cooled reactor analysis

The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Challenges in the Use of AI-Driven Non-Destructive Spectroscopic Tools for Rapid Food Analysis

Routine, remote, and process analysis for foodstuffs is gaining attention and can provide more confidence for the food supply chain. A new generation of rapid methods is emerging both in the literature and in industry based on spectroscopy coupled with AI-driven modelling methods. Current published studies using these advanced methods are plagued by weaknesses, including sample size, abuse of advanced modelling techniques, and the process of validation for both the acquisition method and modelling. This paper aims to give a comprehensive overview of the analytical challenges faced in research and industrial settings where screening analysis is performed while providing practical solutions in the form of guidelines for a range of scenarios. After extended literature analysis, we conclude that there is no easy way to enhance the accuracy of the methods by using state-of-the-art modelling methods and the key remains that capturing good quality raw data from authentic samples in sufficient volume is very important along with robust validation. A comprehensive methodology involving suitable analytical techniques and interpretive modelling methods needs to be considered under a tailored experimental design whenever conducting rapid food analysis.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies

ABSTRACT Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey (DES) is an essential component to mapping the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the DES Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: self-organizing map p(z) (sompz), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SRs), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of σ〈z〉 ∼ 0.01 on the mean redshift in each tomographic bin.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

The future of Earth system prediction: Advances in model-data fusion

Predictions of the Earth system, such as weather forecasts and climate projections, require models informed by observations at many levels. Some methods for integrating models and observations are very systematic and comprehensive (e.g., data assimilation), and some are single purpose and customized (e.g., for model validation). We review current methods and best practices for integrating models and observations. We highlight how future developments can enable advanced heterogeneous observation networks and models to improve predictions of the Earth system (including atmosphere, land surface, oceans, cryosphere, and chemistry) across scales from weather to climate. As the community pushes to develop the next generation of models and data systems, there is a need to take a more holistic, integrated, and coordinated approach to models, observations, and their uncertainties to maximize the benefit for Earth system prediction and impacts on society.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Dynamic Phasor Modeling of Multi-Converter Systems

Generalized form of Dynamic Phasor (DP)-based modeling of multi-converter systems containing high order harmonics has not been proposed in the literature yet due to the complexity and large number of variables that should be included in the model. In this work a generalized form of a system-level model comprising high number of single-phase converters is presented. The proposed method can be applied to any number of single-phase voltage source converters (VSIs). Test cases of this modeling method containing 5 to 100 parallel connected single-phase voltage source inverters are modeled and simulation times are recorded. The results of the proposed method are compared and validated with conventional average models as well as detailed switching models. A systematic approach for comparing the accuracy and timestep between dynamic phasor modeling method and detailed switching model is illustrated. Advantage of DP models over conventional average models for stability assessment are also discussed at the end of the paper.

Xue, Yaosuo↗
DOE OSTI2022

On the novel 3-D neutron transport kinetic tRAPID algorithm and its validation

The Real-time Analysis for Particle-transport and In-situ Detection (RAPID) Code System, based on the Multi-stage Response-function Transport (MRT) methodology, allows for real-time simulation of nuclear systems based on 3-D continuous-energy particle transport. RAPID's steady-state (criticality) neutron transport algorithm is based on the Fission Matrix (FM) method, and has been extensively verified and validated against computational benchmarks and experiments. This paper introduces the novel 3-D time-dependent transport algorithm that has been implemented into the code, tRAPID, and its validation using the JSI TRIGA Mark-II reactor. tRAPID accurately and efficiently calculates neutron kinetics parameters (such as β{sub eff}, l{sub eff} , Λ, α{sub Rossi}) and 3-D time-dependent neutron fission source distribution and neutron importances for both prompt and delayed neutrons. tRAPID is used to simulate a rod insertion experiment performed at the JSI TRIGA Mark-II reactor, during which signals from four fission chambers at four different locations in the core were collected. The results demonstrate how tRAPID is capable of calculating detailed and accurate results with only a minimal use computational resources and time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗
DOE OSTI2022

Coarse-Grained Simulations for the Characterization and Optimization of Hybrid Protein–DNA Nanostructures

We present here the combination of experimental and computational modeling tools for the design and characterization of protein–DNA hybrid nanostructures. Our work incorporates several features in the design of these nanostructures: (1) modeling of the protein–DNA linker identity and length; (2) optimizing the design of protein–DNA cages to account for mechanical stresses; (3) probing the incorporation efficiency of protein–DNA conjugates into DNA nanostructures. The modeling tools were experimentally validated using structural characterization methods like cryo-TEM and AFM. Our method can be used for fitting low-resolution electron density maps when structural insights cannot be deciphered from experiments, as well as enable in-silico validation of nanostructured systems before their experimental realization. Finally, these tools will facilitate the design of complex hybrid protein–DNA nanostructures that seamlessly integrate the two different biomolecules.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Digital image correlation and infrared thermography data for seven unique geometries of 304L stainless steel

Material Testing 2.0 (MT2.0) is a paradigm that advocates for the use of rich, full-field data, such as from digital image correlation and infrared thermography, for material identification. By employing heterogeneous, multi-axial data in conjunction with sophisticated inverse calibration techniques such as finite element model updating and the virtual fields method, MT2.0 aims to reduce the number of specimens needed for material identification and to increase confidence in the calibration results. To support continued development, improvement, and validation of such inverse methods—specifically for rate-dependent, temperature-dependent, and anisotropic metal plasticity models—we provide here a thorough experimental data set for 304L stainless steel sheet metal. The data set includes full-field displacement, strain, and temperature data for seven unique specimen geometries tested at different strain rates and in different material orientations. Commensurate extensometer strain data from tensile dog bones is provided as well for comparison. We believe this complete data set will be a valuable contribution to the experimental and computational mechanics communities, supporting continued advances in material identification methods.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Acidities of MgO surface sites: implications for the formation mechanism of Mg(OH) 2

The hydroxylation of periclase (MgO) to brucite (Mg(OH) 2 ) is thought to be an important intermediate step when using MgO to capture CO 2 from the atmosphere. However, the mechanism of hydroxylation of MgO to form Mg(OH) 2 is poorly understood. In this work, we used atomic-scale density functional tight binding simulations coupled with the metadynamics rare event method to analyze the surface chemistry of MgO and the acid dissociation equilibrium constants (pK a ) of its surface sites. The method and parameters were validated by calculating the pK a for hydroxylation of the first shell water bound to aqueous Mg 2+ ion. The pK a value derived using a probabilistic method was 12.3, which is in fair agreement with the accepted value of 11.4, with the difference between them equal to a ∼5 kJ mol −1 error in the calculations. We then extended these pK a calculations to probe the hydroxylation reactions of the surface sites of the MgO(100)–water interface, arriving at pK a s of 5.4 to deprotonate terminal water molecules bound to the surface magnesium sites (η-OH 2 or 〉MgOH 2 ), and 13.9 to deprotonate hydroxylated bridging oxygen sites (μ 5 -oxo or 〉O). Hydroxide (OH − ) adsorption on the surface was also probed and found to be less thermodynamically favorable than deprotonation of the terminal water molecule. The plausibility of the computed pK a s was verified using an activity-based speciation model and compared to pH measurements of water equilibrated with MgO nanoparticles and single crystals. The model predicted a solution pH of 7.1 when surface sites buffered and the pH of 12.0 when MgO dissolution dominated. These are close to the experimental initial solution pHs of 7–7.5 and the long term pHs of ∼10.5. The similarity suggests that the calculated pK a values from the DFTB+/metadynamics simulations are plausible and that these methods can be a useful tool to probe reaction mechanisms involving covalent bonds.

Adapa, Sai Krishna Reddy [Oak Ridge National Labor↗
DOE OSTI2024

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems With High Levels of Inverter-Based Resources

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression-based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power-hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗
DOE OSTI2022

Characterization of Particle and Heat Losses from a High-Temperature Particle Receiver (2 nd Ed)

High - temperature particle receivers are being pursued to enable next - generation concentrating solar thermal power (CSP) systems that can achieve higher temperatures (> 700 C) to enable more efficient power cycles, lower overall system costs, and emerging CSP - based process - heat applications. The objective of this work was to develop characterization methods to quantify the particle and heat losses from the open aperture of the particle receiver. Novel camera - based imaging methods were developed and applied to both laboratory - scale and larger 1 MW t on - sun tests at the National Solar Thermal Test Facility in Albuquerque, New Mexico. Validation of the imaging methods was performed using gravimetric and calorimetric methods. In addition, conventional particle - sampling methods using volumetric particle - air samplers were applied to the on - sun tests to compare particle emission rates with regulatory standards for worker safety and pollution. Novel particle sampling methods using 3 - D printed tipping buckets and tethered balloons were also developed and applied to the on - sun particle - receiver tests. Finally, models were developed to simulate the impact of particle size and wind on particle emissions and concentrations as a function of location. Results showed that particle emissions and concentrations were well below regulatory standards for worker safety and pollution. In addition, estimated particle temperatures and advective heat losses from the camera - based imaging methods correlated well with measured values during the on - sun tests.

14 SOLAR ENERGY↗
DOE OSTI2024

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems with High Penetration of Inverter-Based Resources: Preprint

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression- based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power- hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗