Search NASASearch

SEARCH · Search NASA

Results for “Benchmark data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

An Investigation of Parallel Programming Techniques Applied to Monte Carlo Simulations for Post-Flight Reconstruction of Spacecraft Trajectory

Parallelizing software to execute on multi-core central processing units (CPUs) and graphics processing units (GPUs) can be challenging. For some fields outside of Computer Science, this transition comes with new issues. For example, memory limitations can require modifications to code not initially developed to run on GPUs. This work applies the Open Multi-Processing (OpenMP) and Open Accelerators (OpenACC) directive-based parallelization strategies on a Monte Carlo simulation approach for trajectory reconstruction enabling it to run on multi-core CPUs and GPUs. Large matrix operations are the most common use of GPUs, which are not present in this algorithm; however, the natural parallelism of independent trajectories in Monte Carlo simulations is exploited. Benchmarking data are presented comparing execution times of the software for single-thread CPUs, multi-thread CPUs with OpenMP, and multi-thread GPUs using OpenACC. These data were collected using nodes with Intel® Xeon® E5-2670 (Sandy Bridge) CPUs enhanced with NVIDIA® Tesla® K40 GPUs on the Pleiades Supercomputer cluster at the National Aeronautics and Space Administration (NASA) Ames Research Center (ARC) and a local Intel® Xeon Phi™ node at NASA Langley Research Center (LaRC).

Williams, R. Anthony

Exploring Airfoil Table Generation using XFOIL and OVERFLOW

The rotorcraft design process is a continuously evolving field of research that incorporates a number of software programs. An accurate airfoil table is critical in the design and testing process for rotorcraft. With multiple flow solvers available and flow conditions of multirotor UAM vehicles potentially covering a wide range of Reynolds and Mach numbers, a documented approach for developing airfoil tables is needed. Using benchmark data from legacy airfoil tables and wind tunnel tests for comparison, simulations for a comprehensive test matrix could guide rotorcraft design engineers in generating their own airfoil tables using the XFOIL and OVERFLOW solvers. The motivation for this study is to investigate flow solver features to develop a best practices document for airfoil table generation. The study uses the OVERFLOW and XFOIL flow solvers, coupled with the airfoil table generator AFTGen, to analyze three airfoils for a specific Reynolds numbers flow regime and provide details on how well each flow solver performs within a specific angle of attack range, Mach number range, Reynolds number range, and in different flow conditions, such as turbulent and transitional flow. OVERFLOW analyses in AFTGen for fully turbulent and transition flow are compared with XFOIL results and experimental test data for the section lift, section drag, and pressure coefficients. XFOIL ultimately yields results that are accurate within the linear angle of attack range and below a Mach number of 0.4 but tends to overpredict lift and underpredict drag unless the flow is in the compressible regime. XFOIL cannot accurately model stall and post-stall conditions due to the nature of the solver. This is evident in nearly every case run with XFOIL, where the linear range is usually predicted acceptably and the lift coefficient is overpredicted as the stall angle of attack is approached (with the exception being the generally poor correlation with most of the SSC-A09 cases). OVERFLOW is limited at low Mach numbers, and appears to perform best at Mach numbers of 0.4 and above. The exploration of airfoil table generation using XFOIL and OVERFLOW yielded moderately successful results for the NACA 0012 airfoil, reasonably good results for the RC(4)-10 airfoil, and less accurate results for the SSC-A09 airfoil.

Airfoil Table Generation

Optical and Laser-based Measurements for NASA’s Artemis Program

NASA and their partners are on the cusp of embarking on a series of space missions to the moon and beyond, collectively known as the Artemis Program. The Artemis I mission is scheduled for launch in late November 2022. This talk briefly summarizes the upcoming Artemis missions and describes laser and optical measurement technique development and application to ground and flight tests related to, or inspired by, the Artemis program. In particular, development and application of three different measurement techniques (planar laser-induced fluorescence [PLIF], femtosecond laser electronic excitation and tagging [FLEET] and photogrammetry) are described. These techniques have been applied to study vehicle launch, lunar landing, and earth entry. Such optical and laser-based instrumentation can provide unique qualitative and quantitative information to inform the underlying physics of space flight while also providing benchmark data for validating ever advancing predictive codes.

Artemis Program

Optical and Laser-based Measurements for NASA’s Artemis Program

NASA and their partners have embarked on a series of space missions to the moon and beyond, collectively known as the Artemis Program. The Artemis I mission occurred in November 2022. This talk briefly summarizes the upcoming Artemis missions and describes laser and optical measurement technique development and application to ground and flight tests related to, or inspired by, the Artemis program. In particular, development and application of three different measurement techniques (planar laser-induced fluorescence [PLIF], femtosecond laser electronic excitation and tagging [FLEET] and photogrammetry) are described. These techniques have been applied to study vehicle launch, lunar landing, and earth entry. Such optical and laser-based instrumentation can provide unique qualitative and quantitative information to inform the underlying physics of space flight while also providing benchmark data for validating ever advancing predictive codes.

Artemis Program

CFD Simulations of Lower Plenum Mixing

Review of model development and validation performed in the Advanced Reactor Technologies (ART) program for thermal mixing at the outlet of High Temperature Gas Reactors (HTGRs). Understanding the mixing that occurs in the lower plenum in an HTGR is necessary to facilitate design improvements and to perform reactor safety analysis. Numerical models are one possible approach to gain a better understanding of mixing in the lower plenum. Given the complexity of the geometry and the intense mixing present, it is important to perform validation of numerical models. Three models have been developed during FY2025: a porous media with Pronghorn, a Reynolds Averaged Navier Stokes (RANS) with STAR-CCM+, and a Large Eddy Simulation (LES) with NekRS. The reference facility is a scaled-down version of the lower plenum of the High Temperature Gas-Cooled Reactor - Pebble-bed Module (HTR-PM) demonstration reactor. Preliminary results of the porous media and the RANS shows general good agreement against experimental benchmark data. Future work will leverage high-fidelity results obtained through LES to guide model selection and improvements to the lower-fidelity models, with particular attention to the Pronghorn porous media.

22 - GENERAL STUDIES OF NUCLEAR REACTORS

The Use of the BSRN Data as A Benchmark for the POWER Hourly DHI and DNI and In Validating Derived Hourly GTI

The satellite-based CERES SYN1deg hourly data is the source data of the POWER GIS solar data that covers 2001 to near present. The SYN1deg(Ed4.1) hourly GHI agrees well with the BSRN data, but the hourly DHI and DirHI (Direct Horizontal Irradiance) are positively and negatively, respectively, biased with appreciable magnitudes. The hourly DNI, derived by dividing the DirHI by cos(SZA), or the cosine of the solar zenith angle, is therefore negatively biased. Based on the statistics of comparisons with the BSRN data, we performed bias corrections on the hourly DHI and DNI. The corrections were executed in the 3-D phase space of latitude, cos(SZA), and cloud fraction (CLFR). The isotropic model is then used to derive the hourly global tilted irradiance (GTI). For validation purpose, we applied the isotropic model to the BSRN data at the original 1-, 2-, 3- or 5-minute interval. The satellite-based hourly GTI shows good agreement with their BSRN counterpart. We also examined two monthly-mean-based methods that empirically derive monthly mean GTI and DNI from monthly mean GHI and from both monthly mean GHI and DHI. The monthly-mean-based results compare favorably with the hourly-mean-based results. The GEWEX SRB (V4-IP) provides POWER with daily mean GHI for the years before the CERES era, and the data were corrected using quantile mapping by referencing the CERES SYN1deg data. We used the Kolmogorov -Smirnov test (K-S test) and Cramer-von Mises test to examine how well the results agree with the BSRN data. We found that if we set the lower limit for the daily mean GHI to 30 W m-2, the data can pass the K-S test at 0.01 significance level and the Cramer-von Mises test at 0.001 significance level. If no lower limit is set on the daily means, the data fail both tests. The satellite-based CERES SYN1deg hourly data is the source data of the POWER GIS solar data that covers 2001 to near present. The SYN1deg(Ed4.1) hourly GHI agrees well with the BSRN data, but the hourly DHI and DirHI (Direct Horizontal Irradiance) are positively and negatively, respectively, biased with appreciable magnitudes. The hourly DNI, derived by dividing the DirHI by cos(SZA), or the cosine of the solar zenith angle, is therefore negatively biased. Based on the statistics of comparisons with the BSRN data, we performed bias corrections on the hourly DHI and DNI. The corrections were executed in the 3-D phase space of latitude, cos(SZA), and cloud fraction (CLFR). The isotropic model is then used to derive the hourly global tilted irradiance (GTI). For validation purpose, we applied the isotropic model to the BSRN data at the original 1-, 2-, 3- or 5-minute interval. The satellite-based hourly GTI shows good agreement with their BSRN counterpart. We also examined two monthly-mean-based methods that empirically derive monthly mean GTI and DNI from monthly mean GHI and from both monthly mean GHI and DHI. The monthly-mean-based results compare favorably with the hourly-mean-based results. The GEWEX SRB (V4-IP) provides POWER with daily mean GHI for the years before the CERES era, and the data were corrected using quantile mapping by referencing the CERES SYN1deg data. We used the Kolmogorov -Smirnov test (K-S test) and Cramer-von Mises test to examine how well the results agree with the BSRN data. We found that if we set the lower limit for the daily mean GHI to 30 W m-2, the data can pass the K-S test at 0.01 significance level and the Cramer-von Mises test at 0.001 significance level. If no lower limit is set on the daily means, the data fail both tests.

Taiping Zhang

Experimental Data from the Benchmark SuperCritical Wing Wind Tunnel Test on an Oscillating Turntable

The Benchmark SuperCritical Wing (BSCW) wind tunnel model served as a semi-blind testcase for the 2012 AIAA Aeroelastic Prediction Workshop (AePW). The BSCW was chosen as a testcase due to its geometric simplicity and flow physics complexity. The data sets examined include unforced system information and forced pitching oscillations. The aerodynamic challenges presented by this AePW testcase include a strong shock that was observed to be unsteady for even the unforced system cases, shock-induced separation and trailing edge separation. The current paper quantifies these characteristics at the AePW test condition and at a suggested benchmarking test condition. General characteristics of the model's behavior are examined for the entire available data set.

Heeg, Jennifer

Cray performance data from five benchmarks

The five benchmark programs discussed in TM-88956, February 1987, were run on the CRAY X-MP/24 under different operating systems and compilers. Performance data is reported for runs under early versions of UNICOS and CFT77. The most recent data includes a system of configuration for a X-MP hardware upgrade. Performance figures for the Y-MP are shown for comparison. Differences in the figures are analyzed and discussed.

Pennline, James A.

Benchmark Wall Heat Flux Data for a GO2/GH2 Single Element Injector

Computational Fluid Dynamics (CFD) is becoming an important component of injector design in the rocket industry. Injector designers who use CFD in the design process need to understand the accuracy level of the particular code being used for certain aspects of the design. This paper presents a recent effort to acquire benchmark quality data to be used for CFD code validation. Detailed chamber wall temperature and heat flux data was acquired for a gaseous oxygen, gaseous hydrogen single element shear coaxial injector in a 1.5 inch diameter copper heat sink chamber at Penn State University. The data was taken using both coaxial and water cooled heat flux gauges. Tests were run using hot gases generated from both fuel and oxidizer preburners. Tests were conducted over a chamber pressure range of 300 to 750 psia. Data analysis and uncertainty information will also be presented.

Pal, Sibtosh

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of nonintrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively. Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under subcritical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain. Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date. As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.

An Experimental Study of Characteristic Combustion-Driven Flow for CFD Validation

A series of uni-element rocket injector studies were completed to provide benchmark quality data needed to validate computational fluid dynamic models. A shear coaxial injector geometry was selected as the primary injector for study using gaseous hydrogen/oxygen and gaseous hydrogen/liquid oxygen propellants. Emphasis was placed on the use of non-intrusive diagnostic techniques to characterize the flowfields inside an optically-accessible rocket chamber. Measurements of the velocity and species fields were obtained using laser velocimetry and Raman spectroscopy, respectively Qualitative flame shape information was also obtained using laser-induced fluorescence excited from OH radicals and laser light scattering studies of aluminum oxide particle seeded combusting flows. The gaseous hydrogen/liquid oxygen propellant studies for the shear coaxial injector focused on breakup mechanisms associated with the liquid oxygen jet under sub-critical pressure conditions. Laser sheet illumination techniques were used to visualize the core region of the jet and a Phase Doppler Particle Analyzer was utilized for drop velocity, size and size distribution characterization. The results of these studies indicated that the shear coaxial geometry configuration was a relatively poor injector in terms of mixing. The oxygen core was observed to extend well downstream of the injector and a significant fraction of the mixing occurred in the near nozzle region where measurements were not possible to obtain Detailed velocity and species measurements were obtained to allow CFD model validation and this set of benchmark data represents the most comprehensive data set available to date As an extension of the investigation, a series of gas/gas injector studies were conducted in support of the X-33 Reusable Launch Vehicle program. A Gas/Gas Injector Technology team was formed consisting of the Marshall Space Flight Center, the NASA Lewis Research Center, Rocketdyne and Penn State. Injector geometries studied under this task included shear and swirl coaxial configurations as well as an impinging jet injector.

Santoro, Robert J.

Benchmarking Memory Performance with the Data Cube Operator

Data movement across a computer memory hierarchy and across computational grids is known to be a limiting factor for applications processing large data sets. We use the Data Cube Operator on an Arithmetic Data Set, called ADC, to benchmark capabilities of computers and of computational grids to handle large distributed data sets. We present a prototype implementation of a parallel algorithm for computation of the operatol: The algorithm follows a known approach for computing views from the smallest parent. The ADC stresses all levels of grid memory and storage by producing some of 2d views of an Arithmetic Data Set of d-tuples described by a small number of integers. We control data intensity of the ADC by selecting the tuple parameters, the sizes of the views, and the number of realized views. Benchmarking results of memory performance of a number of computer architectures and of a small computational grid are presented.

Frumkin, Michael A.

Benchmarking a Defeatured Geant4 NIF Model with HTOAD and HNED Neutron Data

This study benchmarks a simplified Geant4 NIF Target Chamber (TC) model against foil measurements in two instruments: the HTOAD and HNED Snout. The number of product atoms per source neutron per gram ( N 0 /n/g ) is compared across multiple locations and material configurations. The model reproduces high energy threshold reactions dominated by 14 MeV neutrons to within a few percent, depending on location. Discrepancies occur where scattering and moderation are significant for low energy threshold reactions. The defeatured Geant4 model achieves comparable statistical precision with ∼400 times less CPU time than a full fidelity TC model in MCNP. The results can be produced locally on a laptop without the need for high performance computing. Low energy biasing can be improved by preserving room return pathways and implementing IRDFF cross section evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Benchmark aerodynamic heat-transfer data from the first flight of the Space Shuttle Orbiter

Benchmark entry aerodynamic heat-transfer data were determined from the first flight of the Space Shuttle Orbiter. The convective heating-rate data result from a rigorous mathematical analysis of one-dimensional, transient heat conduction within the orbiter thermal protection system (TPS) and reradiation from its surface during entry. Temperatures measured at the TPS surface during orbiter entry provide a constraint to the analysis. On the vehicle leeside, where heating rate levels are low, corrections are made to the computed convective heating rates to account for solar radiation and cross-radiation between fuselage and wing surfaces. The source of the entry thermal data, the mathematical analysis technique, and the TPS thermal models are discussed. Typical convective heating rate data from the STS-1 mission are presented.

Throckmorton, D. A.

Benchmarking a Soil Moisture Data Assimilation System for Agricultural Drought Monitoring

Despite considerable interest in the application of land surface data assimilation systems (LDAS) for agricultural drought applications, relatively little is known about the large-scale performance of such systems and, thus, the optimal methodological approach for implementing them. To address this need, this paper evaluates an LDAS for agricultural drought monitoring by benchmarking individual components of the system (i.e., a satellite soil moisture retrieval algorithm, a soil water balance model and a sequential data assimilation filter) against a series of linear models which perform the same function (i.e., have the same basic inputoutput structure) as the full system component. Benchmarking is based on the calculation of the lagged rank cross-correlation between the normalized difference vegetation index (NDVI) and soil moisture estimates acquired for various components of the system. Lagged soil moistureNDVI correlations obtained using individual LDAS components versus their linear analogs reveal the degree to which non-linearities andor complexities contained within each component actually contribute to the performance of the LDAS system as a whole. Here, a particular system based on surface soil moisture retrievals from the Land Parameter Retrieval Model (LPRM), a two-layer Palmer soil water balance model and an Ensemble Kalman filter (EnKF) is benchmarked. Results suggest significant room for improvement in each component of the system.

soil moisture

Impact of recent ENDF nuclear data update, high initial enrichment and high burnup fuel on critical experiments applicability determination via the integral index c k for burnup credit validation

In 2012, NUREG/CR-7109 reported on the validation of burnup credit calculations involving major and minor actinides and major fission products which was investigated for pressurized and boiling water reactor (PWR and BWR) fuel enrichments up to 5 wt% 235 U and assembly-average burnups up to 60 GWd/MTU. Recently, there has been interest in increasing the maximum enrichment used in PWR fuel as high as 8 wt% 235 U and correspondingly increasing the maximum assembly-average burnups to approximately 75 GWd/MTU. These proposed increases in enrichment and burnup necessitate reinvestigation of the validation basis for k eff calculations for this expanded application space. Additionally, the 2012 study was performed by using the Evaluated Nuclear Data File (ENDF)/B-VII.0 nuclear data with the SCALE 6 covariance library, and the effects of using the newly released ENDF/B-VII.1 and ENDF/B-VIII.0 nuclear data and covariance libraries should be evaluated. In this work, published in NUREG/CR-7309 in 2025, the validation assessment was performed consistently with NUREG/CR-7109: modeling irradiated fuel assemblies in the Generic Burnup Credit (GBC)-32 cask defined in NUREG/CR-6747. The TSUNAMI-3D sequence was used to generate sensitivity data for the application model, and the data were compared with sensitivity data from select benchmark models. The integral parameter c k is the metric of similarity used in this study and is consistent with NUREG/CR-7109, where a c k value in excess of 0.8 indicates sufficient similarity for use in validation. A new set of benchmark experiments with sensitivity data has been assembled for this effort. The number of experiments with available sensitivity data is now 2,104, compared to 474 in NUREG/CR-7109. This increase was facilitated by the efforts of the Nuclear Energy Agency to generate sensitivity data for a majority of the experiments in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook to supplement the data available in the Oak Ridge National Laboratory (ORNL) Verified, Archived Library of Inputs and Data (VALID). The complete set of benchmarks considered here includes experiments for low-enriched uranium (LEU), intermediate enriched uranium (IEU), and a mixture of uranium and plutonium (MIX) from the ICSBEP Handbook and VALID, as well as ORNL models of the Haut Taux de Combustion (HTC) experiments and other potentially relevant models not included in VALID. The updated similarity study shows that none of the extended burnup and higher enrichment combinations considered show a significant decrease in the number of potentially applicable experiments, meaning sufficient critical experiments exist for the validation of BUC criticality safety calculations, with initial enrichments up to 8 wt% 235 U and burnups up to 80 GWd/MTU. Additionally, both the ENDF/B-VII.1 and ENDF/B-VIII.0 nuclear data libraries can be used for validation since the number of critical experiments applicable for validation increases for most cases with the most recent nuclear data compared to the previous one. As in previous BUC validation studies, the French HTC experiments are the most similar in a majority of the application cases studied, especially from representative discharge burnups ranging from 40 to 80 GWd/MTU. In conclusion, these results match the conclusions presented in NUREG/CR-7109 regarding validation of the primary actinides in BUC analyses.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS