Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Split Variable Refrigerant Flow (VRF) System Building Energy Simulations Using Performance Maps

Multi-split variable refrigerant flow (VRF) systems are highly energy-efficient HVAC (heating, ventilation and air conditioning) technologies that connect a single outdoor unit to multiple independent indoor terminal units using a common refrigerant circuit and a variable-speed compressor. Building energy simulations that incorporate VRF systems help model their unique operational characteristics and predict energy consumption in specific building designs. Traditionally, EnergyPlus models these systems by employing multiple sets of performance curves to characterize both individual terminal units and the outdoor unit. However, producing these curves is labor intensive and error prone, and they often do not capture all the key input and output variables. This paper introduces a novel approach that uses multi-dimensional performance maps to model VRF systems in building environments for space cooling. In this approach, performance maps are developed at the component level—separately for the outdoor unit and for each indoor terminal. The new modeling method is validated within EnergyPlus via a Python plug-in that contains a simple solver loop to coordinate the component-level, indoor, and outdoor unit maps. Furthermore, because performance maps can span more variables than traditional performance curves, they offer the opportunity to implement advanced controls, such as enhanced dehumidification and compressor modulation. A VRF air conditioner’s hardware system was modeled using the DOE/ORNL Heat Pump Design Model, which was automated to produce extensive performance maps for both the indoor and outdoor units.

Shen, Bo [ORNL] (ORCID:0000000336600393)↗
DOE OSTI2026

SPT-3G D1: Foreground-Robust Lensing Templates for Primordial Gravitational Wave Searches

Gravitational lensing of the cosmic microwave background (CMB) generates B-mode polarization that acts as a source of contamination to searches for B modes generated by primordial gravitational waves (PGWs). The strongest constraint on PGW B modes is already significantly limited by lensing B modes, as shown in the most recent BICEP result. In this work, we present CMB lensing B-mode templates constructed using SPT-3G and Planck data, which characterize the lensing B modes and can be used to improve PGW B-mode searches. We use SPT-3G data from the 2019 and 2020 observing seasons for the E modes and the CMB-reconstructed lensing potential, and a cosmic infrared background (CIB) map from Planck as an external lensing tracer. To test for extragalactic foreground biases in the lensing template, we consider CMB lensing reconstruction variants with different levels of foreground immunity: the standard and profile-hardened global minimum variance (GMV) quadratic estimators, and a polarization-only quadratic estimator. We validate the template construction using Gaussian simulations and Agora simulations with realistic non-Gaussian foregrounds. From simulations, we find that foreground-induced biases are strongly suppressed for the template constructed with the profile-hardened GMV + CIB tracer, with residual bias below 10% of the statistical uncertainty on the template power spectrum. Data difference tests on this template similarly show no evidence for significant foreground contamination. This foreground-immune lensing template achieves delensed residual BB power of $A_{\rm lens}^{\rm res} \simeq 0.48$ averaged over $20 \leq \ell \leq 200$, the highest delensing efficiency lensing template to date. These results demonstrate and validate a method to construct foreground-robust lensing templates which will be used in upcoming delensed PGW B-mode analyses of BICEP data.

Nakato, Y. [Stanford U.]↗
NASA NTRS1996

Modification and Validation of Conceptual Design Aerodynamic Prediction Method HASC95 With VTXCHN

A conceptual/preliminary design level subsonic aerodynamic prediction code HASC (High Angle of Attack Stability and Control) has been improved in several areas, validated, and documented. The improved code includes improved methodologies for increased accuracy and robustness, and simplified input/output files. An engineering method called VTXCHN (Vortex Chine) for predicting nose vortex shedding from circular and non-circular forebodies with sharp chine edges has been improved and integrated into the HASC code. This report contains a summary of modifications, description of the code, user's guide, and validation of HASC. Appendices include discussion of a new HASC utility code, listings of sample input and output files, and a discussion of the application of HASC to buffet analysis.

Aerodynamics prediction↗
NASA NTRS1991

A finite element conjugate gradient FFT method for scattering

Validated results are presented for the new 3D body of revolution finite element boundary integral code. A Fourier series expansion of the vector electric and mangnetic fields is employed to reduce the dimensionality of the system, and the exact boundary condition is employed to terminate the finite element mesh. The mesh termination boundary is chosen such that is leads to convolutional boundary operatores of low O(n) memory demand. Improvements of this code are discussed along with the proposed formulation for a full 3D implementation of the finite element boundary integral method in conjunction with a conjugate gradiant fast Fourier transformation (CGFFT) solution.

Collins, Jeffery D.↗
NASA NTRS2019

Benchmarking Mixed Mode Failure in Progressive Damage and Failure Analysis Methods

The verification and validation of progressive-damage-analysis finite element methods are difficult but critical tasks to undertake during their development. Verification exercises assess whether a predictive analysis tool produces results that are consistent with the fundamental concepts and assumptions of the tool under evaluation. Ideally, closed-form analytical solutions can be derived for which method verification results can be compared. Problems selected for computational tool verification are often simple and isolate individual features of the tool. In the case of progressive damage finite element methods, verifications should be performed to evaluate the ability of the model to predict the initiation of damage and its growth through the finite element mesh under a variety of conditions. Mabson et al. proposed a test case of a unidirectional, fiber-reinforced plate with a center crack subjected to tensile loads to evaluate matrix crack propagation predictions. The problem was modeled using the Abaqus Hashin continuum damage mechanics (CDM) model for fiber-reinforced composites. Different combinations of matrix strengths and element sizes were used in the simulations, and the results were compared to a closed-form solution based on linear elastic fracture mechanics (LEFM). It was determined that the Abaqus CDM model could predict the LEFM solution of Mode I cracks only when the finite element mesh density met specific requirements based on the material properties. This paper presents closed-form LEFM solutions for a center notch mixed mode (CNMM) verification problem. Parametric finite element analyses were developed using progressive damage analysis methods of both the Discrete Damage Mechanics (DDM) and CDM classes. The progressive damage analysis methods applied in the analyses of the CNMM problem include CompDam and the Floating Node Method. Analyses were conducted with various mode mixities and element sizes to verify that the damage models were working as intended and to identify any limits of applicability.

Leone, Frank↗
DOE OSTI2023

A novel data gaps filling method for solar PV output forecasting

This study proposes a modified gaps filling method, expanding the column mean imputation method and evaluated using randomly generated missing values comprising 5%, 10%, 15%, and 20% of the original data on power output. The XGBoost algorithm was implemented as a forecasting model using the original and processed datasets and two sources of solar radiation data, namely, Shortwave Radiation (SWR) from Advanced Himawari Imager 8 (AHI-8) and Surface Solar Radiation Downward (SSRD) from ERA5 global reanalysis data. Further, the accuracy of the two sets of forecasted power output was evaluated using Root Mean Square Error (RMSE) and Mean Absolute Error (MAE). Results show that by applying the proposed gap filling method and using SWR in forecasting solar photovoltaic (PV) output, the improvement in the RMSE and MAE values range from 12.52% to 24.30% and from 21.10% to 31.31%, respectively. Meanwhile, using SSRD, the improvement in the RMSE values range from 14.01% to 28.54% and MAE values from 22.39% to 35.53%. To further evaluate the accuracy of the proposed gap-filling method, the proposed method could be validated using different datasets and other forecasting methods. Future studies could also consider applying the said method to datasets with data gaps higher than 20%.

Energy & Fuels↗
NASA NTRS2010

Global Precipitation Measurement (GPM) Validation Network

The method averages the minimum TRMM PR and Ground Radar (GR) sample volumes needed to match-up spatially/temporally coincident PR and GR data types. PR and GR averages are calculated at the geometric intersection of the PR rays with the individual Ground Radar(GR)sweeps. Along-ray PR data are averaged only in the vertical, GR data are averaged only in the horizontal. Small difference in PR & GR reflectivity high in the atmosphere, relatively larger differences. Version 6 TRMM PR underestimates rainfall in the case of convective rain in the lower part of the atmosphere by 30 to 40 percent.

Schwaller, Mathew↗
NASA NTRS2005

Verification, Validation, and Solution Quality in Computational Physics: CFD Methods Applied to Ice Sheet Physics

Procedures and methods for veri.cation of coding algebra and for validations of models and calculations used in the aerospace computational fluid dynamics (CFD) community would be ef.cacious if used by the glacier dynamics modeling community. This paper presents some of those methods, and how they might be applied to uncertainty management supporting code veri.cation and model validation for glacier dynamics. The similarities and differences between their use in CFD analysis and the proposed application of these methods to glacier modeling are discussed. After establishing sources of uncertainty and methods for code veri.cation, the paper looks at a representative sampling of veri.cation and validation efforts that are underway in the glacier modeling community, and establishes a context for these within an overall solution quality assessment. Finally, a vision of a new information architecture and interactive scienti.c interface is introduced and advocated.

Thompson, David E.↗
NASA NTRS1978

An analytical method for designing low noise helicopter transmissions

The development and experimental validation of a method for analytically modeling the noise mechanism in the helicopter geared power transmission systems is described. This method can be used within the design process to predict interior noise levels and to investigate the noise reducing potential of alternative transmission design details. Examples are discussed.

Bossler, R. B., Jr.↗
DOE OSTI2019

PreDSLpmo: A neural network-based prediction tool for functional annotation of lytic polysaccharide monooxygenases

Lytic polysaccharide monooxygenases (LPMOs), a family of copper-dependent oxidative enzymes, boost the degradation of polysaccharides such as cellulose, chitin, and others. While experimental methods are used to validate LPMO function, a computational method that can aid experimental methods and provide fast and accurate classification of sequences into LPMOs and its families would be an important step towards understanding the breadth of contributions these enzymes make in deconstruction of recalcitrant polysaccharides. In this study, we developed a machine learning-based tool called PreDSLpmo that employs two different approaches to functionally classify protein sequences into the major LPMO families (AA9 and AA10). The first approach uses a traditional neural network or multilayer percerptron-based approach, while the second employs bi-directional long short-term memory for sequence classification. Finally, our method shows improvement in predictive power when compared with dbCAN2, an existing HMM-profile-based CAZyme predicting tool, on both validation and independent benchmark set.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Data-driven model validation for neutrino-nucleus cross section measurements

Neutrino-nucleus cross section measurements are needed to improve interaction modeling to meet the precision needs of neutrino experiments in efforts to measure oscillation parameters and search for physics beyond the Standard Model. We review the difficulties associated with modeling neutrino-nucleus interactions that lead to a dependence on event generators in oscillation analyses and cross section measurements alike. We then describe data-driven model validation techniques intended to address this model dependence. The method relies on utilizing various goodness-of-fit tests and the correlations between different observables and channels to probe the model for defects in the phase space relevant for the desired analysis. These techniques shed light on relevant mismodeling, allowing it to be detected before it begins to bias the cross section results. We compare more commonly used model validation methods which directly validate the model against alternative ones to these data-driven techniques and show their efficacy with fake data studies. These studies demonstrate that employing data-driven model validation in cross section measurements represents a reliable strategy to produce robust results that will stimulate the desired improvements to interaction modeling.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Framework For Spatial Agricultural Crop Yield Prediction Model Development

This framework was developed to provide data preprocessing for spatiotemporal agricultural yield data and remote sensing data for modelling using artificial neural networks (ANNs) to predict subfield crop yield estimates. The software includes methods to train, validate, and test ANN models. It also include methods to infer on new remote sensing data.

Griffel, LloydM.↗
NASA NTRS2013

The Intercalibration of Geostationary Visible Imagers Using Operational Hyperspectral SCIAMACHY Radiances

Spectral band differences between sensors can complicate the process of intercalibration of a visible sensor against a reference sensor. This can be best addressed by using a hyperspectral reference sensor whenever possible because they can be used to accurately mitigate the band differences. This paper demonstrates the feasibility of using operational Scanning Imaging Absorption Spectrometer for Atmospheric Cartography (SCIAMACHY) large-footprint hyperspectral radiances to calibrate geostationary Earth-observing (GEO) sensors. Near simultaneous nadir overpass measurements were used to compare the temporal calibration of SCIAMACHY with Aqua Moderate Resolution Imaging Spectroradiometer band radiances, which were found to be consistent to within 0.44% over seven years. An operational SCIAMACHY/GEO ray-matching technique was presented, along with enhancements to improve radiance pair sampling. These enhancements did not bias the underlying intercalibration and provided enough sampling to allow up to monthly monitoring of the GEO sensor degradation. The results of the SCIAMACHY/GEO intercalibration were compared with other operational four-year Meteosat-9 0.65-μm calibration coefficients and were found to be within 1% of the gain, and more importantly, it had one of the lowest temporal standard errors of all the methods. This is more than likely that the GEO spectral response function could be directly applied to the SCIAMACHY radiances, whereas the other operational methods inferred a spectral correction factor. This method allows the validation of the spectral corrections required by other methods.

Doelling, David R.↗
DOE OSTI2021

Determination of Seven Organic Impurities in FD&C Yellow No. 6 by Ultra-High-Performance Liquid Chromatography

The U.S. Food and Drug Administration (FDA) batch certifies FD&C Yellow No. 6 (Y6) to ensure that the color additive meets requirements published in the Code of Federal Regulations (CFR), including specifications for seven organic manufacturing impurities consisting of two intermediates, a reaction by-product, an impurity originating from an intermediate, and three subsidiary colors. An ultra-high-performance liquid chromatography (UHPLC) method was developed and validated for determining seven organic impurities in Y6. For comparison, the currently used high-performance liquid chromatography (HPLC) method was also validated. The new UHPLC method uses a 1.7 µm particle size biphenyl column with aqueous ammonium formate and methanol as eluants. Analytes are identified by comparing their retention times and UV-visible spectra to those of reference standards. Calibration is performed in the presence of the dye matrix and analyte levels are determined from their peak areas. UHPLC and HPLC validation studies obtained linear calibration curves and excellent values for limits of detection, limits of quantitation, recovery, repeatability, and intermediate precision for all analytes. Survey analyses of 30 samples using the UHPLC and HPLC methods yielded results that were consistent within experimental error; however, the UHPLC method provided more accurate results for two analytes that coelute using the HPLC method. The UHPLC method satisfies the accuracy and precision requisites for routine certification of Y6. The UHPLC method is faster and generates less waste than the HPLC method while delivering better sensitivity, separation, and accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Validation of the single-event method for low-energy electron transport via stopping power calculations with $\mathrm{MCNP}$

Monte Carlo simulations of low-energy ( <50 keV) electron transport in matter are essential for a broad range of application fields. Several Monte Carlo codes have developed specialized treatments for this case, but a comprehensive validation of low-energy electron transport for general-purpose simulations remains lacking in the literature. One approach to accomplish this validation is calculation of stopping power using low-energy electron transport physics, as stopping power is a fundamental radiation transport quantity which must be simulated accurately for nearly any application. Here in this work, we use the Monte Carlo N-Particle (MCNP) radiation transport code with the single-event method for electron transport to calculate stopping powers of low-energy electrons (50 eV to 30 keV) in 41 elemental solids, 14 compound solids, and five rare gas solids, comparing simulation results to published semi-empirical stopping power calculations from optical measurements. In general, the simulations give good agreement (typically within ±10%) with semi-empirical stopping power values at higher energies: 300 eV and above for most elemental solids, 1 keV and above for compound solids, and 400 eV and above for rare gas solids. Agreement between MCNP and semi-empirical values is worse below these energies. The most significant source of error is the EPRDATA14 cross section data, which does not account for changes in electronic structure due to solid-state bonding, particularly in compound materials. The simplistic model of atomic excitation used to generate the EPRDATA14 cross sections is another key source of error. Additionally, the breakdown of the continuous slowing-down approximation introduces significant uncertainty at low energies, although this is a limitation of the calculation method and not of the simulation procedure. Accounting for these and other uncertainty sources, the single event method in MCNP is robust and able to give good accuracy for a variety of low-energy electron transport problems through diverse kinds of materials.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2024

Photovoltaic inverter-based quantification of snow conditions and power loss

Snow is a significant challenge for photovoltaic (PV) systems at northern latitudes, where the pace of deployment is rapid but snow-related power losses can exceed 30% of annual production. Accurate snow-related power loss estimation methods for utility-scale sites can support snow mitigation strategies, inform resource planning and validate predictive snow-loss models. This study builds on our previous work on inverter-based detection of snow, and its implications for utility-scale power production, by validating the accuracy of our snow-loss method across different PV sites and system designs and highlighting its value in bringing greater visibility to PV plant operations in winter. Our estimation method is both novel and scalable, requiring only standard monitoring data to correlate snow-related losses with meteorological data. As demonstrated here, our validation method involved three main steps: 1) estimation of performance losses for multiple systems by comparing measured inverter data to modeled data; 2) application of a detection framework to identify which performance losses are snow-related; and 3) comparison of snow-related losses among three utility-scale sites differing in tilt angle. Results show that utility-scale systems at higher tilt angles consistently shed snow more quickly/completely than their lower-tilt counterparts. Further, monthly and seasonal snow losses are inversely and non-linearly correlated with tilt angle when normalized for cumulative snowfall. These results are consistent with the findings of previous studies and support the broad applicability of this method to fixed-tilt utility-scale PV systems around the world that routinely experience snow-related performance losses.

Cooper, Emma C. (ORCID:0000000190554098)↗