Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Experimental Results for an Annular Aerospike with Differential Throttling

A) MSFC funded an internal study on Altitude Compensating Nozzles: 1) Develop an ACN design and performance prediction tool. 2) Design, build and test cold flow ACN nozzles. 3) An annular aerospike nozzle was designed and tested. 4) Incorporated differential throttling to assess Thrust Vector Control. B) Objective of the test hardware: 1) Provide design tool verification. 2) Provide benchmark data for CFD calculations. 3) Experimentally measure side force, or TVC, for a differentially throttled annular aerospike.

Ruf, Joseph H.↗

Systematic Benchmarking of Diagnostic Technologies for an Electrical Power System

Automated health management is a critical functionality for complex aerospace systems. A wide variety of diagnostic algorithms have been developed to address this technical challenge. Unfortunately, the lack of support to perform large-scale V&V (verification and validation) of diagnostic technologies continues to create barriers to effective development and deployment of such algorithms for aerospace vehicles. In this paper, we describe a formal framework developed for benchmarking of diagnostic technologies. The diagnosed system is the Advanced Diagnostics and Prognostics Testbed (ADAPT), a real-world electrical power system (EPS), developed and maintained at the NASA Ames Research Center. The benchmarking approach provides a systematic, empirical basis to the testing of diagnostic software and is used to provide performance assessment for different diagnostic algorithms.

Kurtoglu, Tolga↗

Open Rotor Tone Shielding Methods for System Noise Assessments Using Multiple Databases

Advanced aircraft designs such as the hybrid wing body, in conjunction with open rotor engines, may allow for significant improvements in the environmental impact of aviation. System noise assessments allow for the prediction of the aircraft noise of such designs while they are still in the conceptual phase. Due to significant requirements of computational methods, these predictions still rely on experimental data to account for the interaction of the open rotor tones with the hybrid wing body airframe. Recently, multiple aircraft system noise assessments have been conducted for hybrid wing body designs with open rotor engines. These assessments utilized measured benchmark data from a Propulsion Airframe Aeroacoustic interaction effects test. The measured data demonstrated airframe shielding of open rotor tonal and broadband noise with legacy F7/A7 open rotor blades. Two methods are proposed for improving the use of these data on general open rotor designs in a system noise assessment. The first, direct difference, is a simple octave band subtraction which does not account for tone distribution within the rotor acoustic signal. The second, tone matching, is a higher-fidelity process incorporating additional physical aspects of the problem, where isolated rotor tones are matched by their directivity to determine tone-by-tone shielding. A case study is conducted with the two methods to assess how well each reproduces the measured data and identify the merits of each. Both methods perform similarly for system level results and successfully approach the experimental data for the case study. The tone matching method provides additional tools for assessing the quality of the match to the data set. Additionally, a potential path to improve the tone matching method is provided.

Bahr, Christopher J.↗

Chemical Modeling of the Reactivity of Short-Lived Greenhouse Gases: A Model Inter-Comparison Prescribing a Well-Measured, Remote Troposphere

We develop a new protocol for merging in situ measurements with 3-D model simulations of atmospheric chemistry with the goal of integrating over the data to identify the most reactive air parcels in terms of tropospheric production and loss of the greenhouse gases ozone and methane. Presupposing that we can accurately measure atmospheric composition, we examine whether models constrained by such measurements agree on the chemical budgets for ozone and methane. In applying our technique to a synthetic data stream of 14,880 parcels along 180W, we are able to isolate the performance of the photochemical modules operating within their global chemistry-climate and chemistry-transport models, removing the effects of modules controlling tracer transport, emissions, and scavenging. Differences in reactivity across models are driven only by the chemical mechanism and the diurnal cycle of photolysis rates, which are driven in turn by temperature, water vapor, solar zenith angle, clouds, and possibly aerosols and overhead ozone, which are calculated in each model. We evaluate six global models and identify their differences and similarities in simulating the chemistry through a range of innovative diagnostics. All models agree that the more highly reactive parcels dominate the chemistry (e.g., the hottest 10% of parcels control 25-30% of the total reactivities), but do not fully agree on which parcels comprise the top 10%. Distinct differences in specific features occur, including the regions of maximum ozone production and methane loss, as well as in the relationship between photolysis and these reactivities. Unique, possibly aberrant, features are identified for each model, providing a benchmark for photochemical module development. Among the 6 models tested here, 3 are almost indistinguishable based on the inherent variability caused by clouds, and thus we identify 4, effectively distinct, chemical models. Based on this work, we suggest that water vapor differences in model simulations of past and future atmospheres may be a cause of the different evolution of tropospheric O3 and CH4, and lead to different chemistry-climate feedbacks across the models.

greenhouse gases↗

Results of the KRUSTY Warm Critical Experiments

The Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototypic nuclear-powered test of a 5-kW(thermal) Kilopower space reactor. This paper presents results from the KRUSTY warm critical experiments, which were completed prior to the final system test. The first set of criticals comprised cold or zero-power criticals; i.e., the core was not heated by fission power. These were followed by three warm criticals, where fission power heated the core to 200°C, 300°C, and 450°C, respectively. These criticals provided the data, confidence, and regulatory framework that were needed to proceed with the KRUSTY nuclear system test. The criticals also provided valuable data for the benchmarking of codes applicable to all nuclear systems. Finally, a comparison of KRUSTY results to pretest predictions is provided, and overall, the models matched the experimental results very closely.

David I. Poston↗

Summary of Shock Wave Turbulent Boundary Layer Interaction Experiments In a Circular Test Section

A series of experiments were performed at Mach 2.5 in a 17 cm diameter circular test section to characterize an impinging/reflected shock wave turbulent boundary layer interaction generated by a cone-cylinder centerbody. The cone-cylinder centerbody generates a conical shock wave that interacts with the naturally occurring boundary layer developing on the test section wall. Three different cone angles were used in the experiment to study unseparated, incipiently separated, and separated interactions. When the cone-cylinder centerbody is positioned on the centerline, a flowfield which is two-dimensional in the mean is generated. Three dimensional interactions were also created by offsetting the cone-cylinder centerbody from the test section centerline. The results are intended to provide benchmark quality datasets for computational fluid dynamics (CFD) validation without the pitfalls inherent in rectangular configurations where corner effects prohibit a truly two-dimensional flow in the mean. The experimental measurements included surface flow visualization, wall static pressure, flowfield Pitot tube pressure, constant-voltage anemometry (CVA) normal hot-wire, and particle image velocimetry (PIV) measurements. The hot-wire measurements were used to calculate mean mass flux and total temperature profiles, mass flux and total temperature turbulence intensities, and the mass flux-total temperature correlation. The PIV measurements provide three-dimensional mean velocity measurements. Agreement between the pressure, hot-wire, and PIV measurements is established in the undisturbed upstream flowfield.

Supersonic↗

Summary of Shock Wave Turbulent Boundary Layer Interaction Experiments in a Circular Test Section

A series of experiments were performed at Mach 2.5 in a 17 cm diameter circular test section to characterize an impinging/reflected shock wave turbulent boundary layer interaction generated by a cone-cylinder centerbody. The cone-cylinder centerbody generates a conical shock wave that interacts with the naturally occurring boundary layer developing on the test section wall. Three different cone angles were used in the experiment to study unseparated, incipiently separated, and separated interactions. When the cone-cylinder centerbody is positioned on the centerline, a flowfield which is two-dimensional in the mean is generated. Three dimensional interactions were also created by offsetting the cone-cylinder centerbody from the test section centerline. The results are intended to provide benchmark quality datasets for computational fluid dynamics (CFD) validation without the pitfalls inherent in rectangular configurations where corner effects prohibit a truly two-dimensional flow in the mean. The experimental measurements included surface flow visualization, wall static pressure, flowfield Pitot tube pressure, constant-voltage anemometry (CVA) normal hot-wire, and particle image velocimetry (PIV) measurements. The hot-wire measurements were used to calculate mean mass flux and total temperature profiles, mass flux and total temperature turbulence intensities, and the mass flux-total temperature correlation. The PIV measurements provide three-dimensional mean velocity measurements. Agreement between the pressure, hot-wire, and PIV measurements is established in the undisturbed upstream flowfield.

compressible flow↗

Linearity for Ca2+-Doped CeBr3 Scintillating Materials

The Remote Sensing Laboratory (RSL) developed an aliovalently calcium-doped cerium tribromide (CeBr3:Ca2+) crystal with 3.2% resolution. RSL completed a crystal assessment, and Sandia National Laboratories calculated the predictive performance and physical characteristics using proven density functional theory (DFT) formalism. Results are reported for the work done to map the detector performance, characteristics, calcium doping concentration, and crystal strength. Preliminary scintillation measurements for this aliovalently calcium-doped CeBr3 scintillator exhibit a slight blue shift in fluorescence emission at 371 nm excitation for CeBr3. The structural, electronic, and optical properties of CeBr3 crystals were investigated using DFT within generalized gradient approximation. The calculated lattice parameters are in good agreement with the experimental data. The energy band structures and density of states were obtained. The optical properties of CeBr3, including the dielectric function, were calculated. Specifically, we report excellent linearity with the aliovalently calcium-doped CeBr3 crystal. Proportionality of light yield is one area of performance in which Ce-doped and Ce-based lanthanide halides excel. Maintaining proportionality is key to producing a strong, high-performance scintillator. Relative light yield proportionality was measured for both doped and undoped samples of CeBr3 to ensure no loss in performance was incurred during doping. The light output and proportionality, however, appear to be similar to CeBr3. There was a reduced yield at low energy. Relative light yield proportionality measurements suggest that dopants do not significantly affect proportionality at higher energies. RSL completed additional testing and evaluation of the new crystal and assessed benchmark spectroscopy measurements. Results, which present energy resolution as a function of energy, are summarized. Typical spectroscopy results using a 137Cs radiation source are shown for our crystallite. We obtain 4.5% for the packaged crystallite. More spectra are presented for 241Am, 60Co, 228Th, and background to exemplify CeBr3:Ca2+ over a broader energy range.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Evaluating Safeguards Statistical Assumptions via Stochastic Simulation

Herein, the authors built and tested a stochastic simulation to estimate achieved detection probabilities (DPs) on a stratum basis, over a tailorable range of diverted amounts from 0 to 2 SQ, using typical IAEA inspection data: i.e., SQ in stratum, number of items, number of gross/partial/bias defect measurements conducted, and realistic relative standard deviation (RSD) values for typical IAEA verification measurements. For bulk strata, the model calculates achieved DP at 0.01 SQ diversion increments; for item strata, the model calculates DP using the smallest realistic diversion increment (e.g., a plate, pin, or coupon). After successfully benchmarking against IAEA deterministic models, the simulation was used to test the sensitivity of DP to certain standard assumptions and selected input parameters. First, the equal defect assumption was tested; the results suggest significant complexity in the effectiveness of partial defect measurements. Next, the authors explored the sensitivity of DP to the assumed RSD of attribute tests. Then, the authors compared non-normal models for instrument performance (e.g., logistic, step, or arbitrary functions) to the typical results from a normal distribution (characterized by RSD). This last comparison was supplemented with experimentally derived performance data for an HM-5. The HM-5 was used to make enrichment measurements on both LEU and HEU MTR fuel elements as plates were removed, and the results fit with logistic and step curves and applied in the simulation. These stochastic DP results were compared to DP estimates from a deterministic model assuming a normal curve and typical RSD, yielding insights that could improve effectiveness in the field. These early results illustrate the potential of stochastic models to better understand achieved DP and to improve safeguards effectiveness.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Verification of a neutronic code for transient analysis in reactors with Hex-z geometry

Due to the geometry of the fuel bundles, to simulate reactors such as VVER reactors it is necessary to develop methods that can deal with hexagonal prisms as basic elements of the spatial discretization. The main features of a code based on a high order finite element method for the spatial discretization of the neutron diffusion equation and an implicit difference method for the time discretization of this equation are presented and the performance of the code is tested solving the first exercise of the AER transient benchmark. The obtained results are compared with the reference results of the benchmark and with the results provided by PARCS code. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Linear source approximation in CASMO5

A Linear Source (LS) approximation has been implemented in the two-dimensional Method of Characteristics (MOC) transport solver in a prototype version of CASMO5. The LS approximation, which relies on the computation of trajectory-based spatial moments over source regions to obtain the linear source expansion coefficients, improves the solution accuracy relative to the 'flat' or constant source approximation. In addition, the LS formulation is capable of treating arbitrarily-shaped source regions and is compatible with standard Coarse-Mesh Finite Difference (CMFD) acceleration. Numerical tests presented in this paper for the C5G7 MOX benchmark show that, for comparable accuracy with respect to the reference solution, the LS approximation can reduce the run time by a factor of four and the memory requirements by a factor often relative to the FS scheme. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Cylindrical Kernel Density Estimators For Monte Carlo Neutron Transport Reactor Physics Problems

Kernel Density Estimators (KDEs) have been investigated as an alternative to histogram tallies in Monte Carlo radiation transport simulations for capturing spatially-resolved quantities such as scalar flux and reaction rate densities. KDEs are non-parametric estimators that show potential for producing smooth estimates of quantities of interest with reduced variance compared to traditional histogram tallies. Furthermore, KDEs obtain estimates of the underlying distribution at user-defined points without requiring an underlying mesh, thus making KDEs an attractive potential alternative to histogram tallies. Recent work has introduced the Mean Free Path based KDE (MFP KDE) in order to capture distributions with large curvature at material interfaces, e.g. absorption reaction rates in UO{sub 2} fuel in light water reactors. However, the multivariate MFP KDE produces inaccuracies in the form of localized spikes in problems with material cross sections that contain large resonances. Since the MFP KDE works well in one dimension, it is hypothesized that a different MFP KDE formulation where the normalization coefficient only contains one factor of the cross section would be able to capture these distributions with large curvature without producing spikes in the estimate. This can be accomplished by using a cylindrical KDE whose 2-D support area is wedge-shaped and applying the MFP KDE to the radial component of the cylindrical KDE. These cylindrical KDEs use 2-D (r,θ) cylindrical coordinates with no dependence in axial dimension z. This paper derives the cylindrical KDE and the cylindrical MFP KDE and tests them on a reactor physics pin-cell benchmark problem, producing accurate estimates of flux and reaction rate densities with differences less than 0.5% when compared to a reference histogram. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Pressure Measurements in a Wire-Wrapped 61-Pin Hexagonal Fuel Bundle

Texas A and M University is conducting isothermal experiments in a wire-wrapped 61-pin hexagonal fuel bundle to support the research on advanced nuclear fuel development sponsored by the Department of Energy (DOE). The purpose of these experiments is to produce high spatial and temporal resolution measurements of the flow and pressure measurements at different locations of the test bundle. The experimental data will be used to benchmark numerical simulations of the experiments using both industry-standard Reynolds-averaged Navier-Stokes (RANS) based computational fluid dynamics (CFD) methods and highly resolved large eddy simulations (LES). (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Assessing the Impact of Effective Thermal Conductivity on Gas-cooled Reactor Transients in RELAP5-3D

In block-type high-temperature gas-cooled reactors (HTGRs), coolant holes in blocks lead to a reduction in heat transfer through conduction. In systems codes like RELAP5-3D, we must account for this degradation by using an effective thermal conductivity (ETC). This presentation discusses a few ETC relationships and demonstrates the impact of ETC for the modular High-Temperature Gas-Cooled Reactor 350 MW -- a computational benchmark for HTGR modeling -- and for the High Temperature Test Facility (HTTF) -- an HTGR thermal hydraulics test facility. We demonstrate that the use of ETC leads to temperatures that are higher than the bulk thermal conductivity of the block material would yield, but these differences have no meaningful impact on the transient performance of the reactors. The ETC also reduces the cooldown rate, leading to more time at elevated temperatures. Overall, while accounting for ETC is important in capturing the physics of the reactor, it is not expected to have a meaningful impact on transient performance.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Stochastic Approaches for Calculating and Aggregating Detection Probabilities for Nuclear Material Diversion

The authors built and tested a stochastic simulation to estimate achieved detection probabilities (DPs) on a stratum basis, over a tailorable range of diverted amounts from 0 to 2 significant quantities (SQ), using typical International Atomic Energy Agency (IAEA) inspection data: i.e., SQ in stratum, number of items, number of gross/partial/bias defect measurements conducted, and realistic relative standard deviation (RSD) values for typical IAEA verification measurements. For bulk strata, the model calculates achieved DP at 0.01 SQ diversion increments; for item strata, the model calculates DP using the smallest realistic diversion increment (e.g., a plate, pin, or coupon). After successfully benchmarking against IAEA deterministic models, the simulation was used to test the sensitivity of DP to certain standard assumptions and selected input parameters. First, the equal defect assumption was tested; the results suggest significant complexity in the effectiveness of partial defect measurements. Next, the authors explored the sensitivity of DP to the assumed RSD of attribute tests. Then, the authors compared non-normal models for instrument performance (e.g., logistic, step, or arbitrary functions) to the typical results from a normal distribution (characterized by RSD). This last comparison was supplemented with experimentally derived performance data for an HM-5 gamma spectrometer. The HM-5 was used to make enrichment measurements on both LEU and HEU MTR fuel elements as plates were removed, and the results fit with logistic and step curves and applied in the simulation. These stochastic DP results were compared to DP estimates from a deterministic model assuming a normal curve and typical RSD, yielding insights that could improve effectiveness in the field. These early results illustrate the potential of stochastic models to better understand achieved DP and to improve safeguards effectiveness.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Benchmarking the Collocation Stand-Alone Library and Toolkit (CSALT)

This paper describes the processes and results of Verification and Validation (VV) efforts for the Collocation Stand Alone Library and Toolkit (CSALT). We describe the test program and environments, the tools used for independent test data, and comparison results. The VV effort employs classical problems with known analytic solutions, solutions from other available software tools, and comparisons to benchmarking data available in the public literature. Presenting all test results are beyond the scope of a single paper. Here we present high-level test results for a broad range of problems, and detailed comparisons for selected problems.

trajectory optimization↗

CALiPER Report 20.3: Robustness of LED PAR38 Lamps

Three samples of 40 of the Series 20 PAR38 lamps underwent multi-stress testing, whereby samples were subjected to increasing levels of simultaneous thermal, humidity, electrical, and vibrational stress. The results do not explicitly predict expected lifetime or reliability, but they can be compared with one another, as well as with benchmark conventional products, to assess the relative robustness of the product designs. On average, the 32 LED lamp models tested were substantially more robust than the conventional benchmark lamps. As with other performance attributes, however, there was great variability in the robustness and design maturity of the LED lamps. Several LED lamp samples failed within the first one or two levels of the ten-level stress plan, while all three samples of some lamp models completed all ten levels. One potential area of improvement is design maturity, given that more than 25% of the lamp models demonstrated a difference in failure level for the three samples that was greater than or equal to the maximum for the benchmarks. At the same time, the fact that nearly 75% of the lamp models exhibited better design maturity than the benchmarks is noteworthy, given the relative stage of development for the technology.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Full Life Wind Turbine Gearbox Lubricating Fluids

Industrial gear box lubricants typically are hydrocarbon based mineral oils with considerable amounts of additives to overcome the lack of base fluid properties like wear protection, oxidation stability, load carrying capacity, low temperature solidification and drop of viscosity at higher temperatures. For today's wind turbine gearboxes, the requirements are more severe and synthetic hydrocarbon oils are used to improve on this, but all such hydrocarbon based lubricants require significant amounts of Extreme Pressure (EP) additives to meet performance requirements. Perfluoropolyether (PFPE) fluids provide load carrying capacity as an inherent property. During the course of the project with the main tasks of 'Establish a Benchmark', 'Lubricant Evaluation', 'Full Scale Gearbox Trial' and 'Economic Evaluation', the PAO Reference oil exhibited significant changes after laboratory gear testing, in service operation in the field and full scale gearbox trial. Four hydrocarbon base oils were selected for comparison in the benchmarking exercise and showed variation with respect to meeting the requirements for the laboratory micro-pitting tests, while the PFPE fluid exceeded the requirements even with the material taken after the full scale gear box trial. This is remarkable for a lubricant without EP additives. Laboratory bearing tests performed on the PFPE fluids before and after the full scale gear box trial showed the results met requirements for the industry standard. The PFPE fluid successfully completed the full scale gear box test program which included baseline and progressive staged load testing. The evaluation of gears showed no micro-pitting or objectionable wear. By the final stage, lubricant film thickness had been reduced to just 21% of its original value, this was by design and resulted in a lambda ratio of well below 1.

17 WIND ENERGY↗