SEARCH · Search NASA

Results for “Benchmark Cases”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2019

A Benchmark Example for Delamination Growth Predictions Based on the Single Leg Bending Specimen Under Fatigue Loading

Analysis benchmarking is used to evaluate new algorithms for automated VCCT-based delamination growth analysis. First, existing benchmark cas s based on the Single Leg Bending (SLB) specimen for crack propagation prediction under quasi-static loading are summarized. Second, the development of new SLB-based benchmark cases to assess the static and fatigue growth prediction capabilities under mixed-mode I/II conditions is discussed in detail. Additionally, a scheme is proposed to interpolate between known fatigue delamination growth rates to obtain values for mixed-mode ratios for which data has not been defined in the input. Further, a comparison is presented, in which the benchmark cases are used to assess new analysis tools in ABAQUS/Standard FD03. These recently implemented tools yield results that are in good agreement with the benchmark examples. The ability to assess the implementation of new methods in one finite element code illustrates the value of establishing benchmark solutions.

Krueger, Ronald↗

DOE OSTI2020

Verification benchmarks for single-phase flow in three-dimensional fractured porous media

Flow in fractured porous media occurs in the earth’s subsurface, in biological tissues, and in man-made materials. Fractures have a dominating influence on flow processes, and the last decade has seen an extensive development of models and numerical methods that explicitly account for their presence. To support these developments, four benchmark cases for single-phase flow in three-dimensional fractured porous media are presented. Furthermore, the cases are specifically designed to test the methods’ capabilities in handling various complexities common to the geometrical structures of fracture networks. Based on an open call for participation, results obtained with 17 numerical methods were collected. This paper presents the underlying mathematical model, an overview of the features of the participating numerical methods, and their performance in solving the benchmark cases.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2010

Toward Establishing a Realistic Benchmark for Airframe Noise Research: Issues and Challenges

The availability of realistic benchmark configurations is essential to enable the validation of current Computational Aeroacoustic (CAA) methodologies and to further the development of new ideas and concepts that will foster the technologies of the next generation of CAA tools. The selection of a real-world configuration, the subsequent design and fabrication of an appropriate model for testing, and the acquisition of the necessarily comprehensive aeroacoustic data base are critical steps that demand great care and attention. In this paper, a brief account of the nose landing-gear configuration, being proposed jointly by NASA and the Gulfstream Aerospace Company as an airframe noise benchmark, is provided. The underlying thought processes and the resulting building block steps that were taken during the development of this benchmark case are given. Resolution of critical, yet conflicting issues is discussed - the desire to maintain geometric fidelity versus model modifications required to accommodate instrumentation; balancing model scale size versus Reynolds number effects; and time, cost, and facility availability versus important parameters like surface finish and installation effects. The decisions taken during the experimental phase of a study can significantly affect the ability of a CAA calculation to reproduce the prevalent flow conditions and associated measurements. For the nose landing gear, the most critical of such issues are highlighted and the compromises made to resolve them are discussed. The results of these compromises will be summarized by examining the positive attributes and shortcomings of this particular benchmark case.

Khorrami, Mehdi R.↗

NASA NTRS2003

Effect of Turbulence Models on Two Massively-Separated Benchmark Flow Cases

Two massively-separated flow cases (the 2-D hill and the 3-D Ahmed body) were computed with several different turbulence models in the Reynolds-averaged Navier-Stokes code CFL3D as part of participation in a turbulence modeling workshop held in Poitiers, France in October, 2002. Overall, results were disappointing, but were consistent with results from other RANS codes and other turbulence models at the workshop. For the 2-D hill case, those turbulence models that predicted separation location accurately ended up yielding a too-long separation extent downstream. The one model that predicted a shorter separation extent in better agreement with LES data did so only by coincidence: its prediction of earlier reattachment was due to a too-late prediction of the separation location. For the Ahmed body, two slant angles were computed, and CFD performed fairly well for one of the cases (the larger slant angle). Both turbulence models tested in this case were very similar to each other. For the smaller slant angle, CFD predicted massive separation, whereas the experiment showed reattachment about half-way down the center of the face. These test cases serve as reminders that state- of-the-art CFD is currently not a reliable predictor of massively-separated flow physics, and that further validation studies in this area would be beneficial.

Rumsey, Christopher L.↗

DOE OSTI2023

PMT-004 Validation Testing for Thermal Scattering Laws and Some Interesting Temperature-Dependent Implications [Slides]

This presentation finds that PMT-004 has four new benchmark cases highly sensitive to PE TSL (2 cases) and PMMA TSL (2 Cases). Additionally discovered was that the PE cases were well predicted using MCNP6.2 and ENDF/B-VIII.0. PMMA cases overpredicted by approximately 0.6-0.7% in k eff likely due to the lack of integral benchmarks sensitive to PMMA. The NCSU ENDF/B-VIII.1 PMMA TSL is an improvement over VIII.0. This was Accepted at last ICSBEP meeting pending comment resolution, should be published in 2024 version of the Handbook. It was found that temperature had a large impact on reactivity of the critical configuration. This has Implications for validation work for thermal cases- need to adjust TSL data to correct temperature as it can have hundreds of pcm effects for a few °C. Future thermal experiments should try and measure reactivity at multiple temperatures to add in data testing and benchmark adjustment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2020

Flutter Analysis with Stabilized Finite Elements Based on the Linearized Frequency-Domain Approach

When designing and certifying aircraft, engineers must take into consideration aeroelastic effects such as flutter. Design and certification of a vehicle may require analysis of thousands of aeroelastic responses. Standard tools in the aerospace industry are based on linear aerodynamic models such as the doublet-lattice method, but these methods can be nonconservative in certain situations such as in the transonic regime. While computational fluid dynamics (CFD) is a higher fidelity alternative, the time-marching approach has a drastically increased computational cost compared to the linear aerodynamic methods. By taking advantage of the periodic nature of flutter, frequency-domain methods offer a more efficient alternative to time-marching CFD. In this work, a linearized frequency-domain method is implemented and verified in the stabilized finite-element solver in FUN3D. The linearized frequency-domain method is demonstrated and compared to other methods for traditional benchmark cases for computational aeroelasticity: the AGARD 445.6 wing, the Benchmark Supercritical Wing, and the Benchmark NACA 0012Wing.

Kevin E Jacobson↗

DOE OSTI2022

IER 555: Godiva Benchmark Update CED-2 (Final Design Report)

The International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluation of the Godiva IV critical assembly, HEU-MET-FAST-086: GODIVA-IV DELAYED-CRITICAL EXPERIMENTS (HMF-086), was completed by Russ Mosteller. Five critical experiment configurations performed at the Los Alamos National Laboratory (LANL) Technical Area (TA)-18 were evaluated as acceptable benchmark cases. The five cases consist of four delayed critical configurations which differ in control rod positions and one prompt critical configuration. All cases calculated a lower $k_{eff}$ than measured by experiment. This data is referred to as the TA-18 Godiva IV benchmark in this report. In 2005, Godiva IV was disassembled for relocation to the Nevada Test Site (NTS), now Nevada National Security Site (NNSS), at the National Criticality Experiments Research Center (NCERC). Following the disassembly and subsequent reassembly and startup of Godiva IV at NCERC, additional information about the Godiva IV components was obtained. An errata note was added to the HMF-086 evaluation in the ICSBEP handbook to provide this new information until a revision to the benchmark evaluation could be performed. In addition to those corrections, there are differences between the Godiva IV assembly at TA-18 and the Godiva IV assembly at NCERC. These differences include both assembly-specific differences (differences in the safety block gap, differences in the control rod positions, a new NCERC Top Hat and contamination shield) as well as environmental differences, such as the size and shape of the experimental building where the assembly is located. An additional model with similar cases, referred to as the NCERC Godiva IV benchmark in this report, will be added to the revised HMF-086 to capture these additional differences. This will provide the best benchmark model of Godiva for use by those performing experiments at NCERC. The IER 555 CED-2 report documents the information that will be updated in the HMF-086 revision, both the corrections to the TA-18 Godiva IV benchmark and the subsequent changes to create a NCERC Godiva IV benchmark. It describes the measurements that will be performed for cases similar to those performed at TA-18. It also describes measurements that will be included in the evaluation as additional data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Material Interactions in Severe Accidents – Benchmarking the MELCOR V2.2 Eutectics Model for a BWR-3 Mark-I Station Blackout: Part II – Uncertainty Analysis

Single case comparisons between severe accident simulations can provide detailed insights into severe accident model behavior, however, they cannot offer insights into model uncertainty, sensitivity to uncertain parameters, or underlying model biases.Here in this analysis, the single case benchmark comparison of the MELCOR material interaction models for a station blackout (SBO) scenario of a boiling water reactor (BWR) using representative Fukushima Daiichi Unit 1 boundary conditions is expanded to include an uncertainty analysis. As part of this uncertainty analysis, 1200 simulations are performed for each material interaction model (2400 total), with random sampling of 14 uncertain MELCOR input parameters. Input parameters are selected for their impact on models representing core degradation processes. These include candling, fuel rod failure, debris quenching and dryout. The analysis performed here is not a traditional “best-estimate” uncertainty analysis that uses best-estimate parameters or identifies best-estimate figure of merit distributions. Instead, it is an exploratory uncertainty analysis that identifies and interrogates underlying model form biases of the two material interaction models (eutectics and interactive materials models). Uniform distributions are applied to all uncertain parameters to ensure coverage of the model parameter uncertainty space. Key findings from this study include underlying model form biases exhibited by material interaction models, and notable differences in accident progression outcomes between the material interaction models. This uncertainty study extends and confirms the conclusions from the first part of this study, which compared the impact of material interaction modeling on simulation of a short-term station blackout scenario with representative Fukushima Daiichi Unit I boundary conditions. In particular, this study confirms that the eutectics model generally exhibits accelerated degradation and failure of fuel components, the core plate, and the lower head. The eutectics model also has a tendency to exhibit a greater degree of core degradation, greater debris mass formation, and larger debris mass ejection. Finally, the eutectics model exhibits higher maximum temperatures for fuel, cladding, particulate debris, oxidic molten pool, and metallic molten pool components than the interactive materials model; interactive materials model simulations exhibit a soft “limitation” on maximum temperatures that is related to the temperature at which material relocation occurs.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2024

An international benchmark for wind plant wakes from the American WAKE ExperimeNt (AWAKEN)

This article introduces the first benchmark study within the International Energy Agency Wind Task 57 framework, focusing on wind plant wakes. Leveraging data from the American WAKE ExperimeNt (AWAKEN), the benchmark aims to assess the accuracy of simulation tools in modeling wind plant wakes and their impact on the downstream flow under diverse inflow conditions. The AWAKEN field campaign, conducted in Oklahoma from 2022 to 2024, provides unprecedented observations of wind plant-atmosphere interactions, thus offering a large dataset to validate numerical models of different complexity. The benchmark will include three phases—code calibration, blind comparison, and iteration—allowing participants to refine their numerical models based on the feedback from the benchmark team. This article describes the benchmark case study selected from observations providing details on atmospheric conditions, wake evidence, and wind turbine operation. The benchmark’s structure and timeline, along with the expected publication of results, are discussed as well. This collaborative effort aims to enhance the accuracy of wind plant wake simulations, thus contributing to the improvement of wind energy production estimates.

17 WIND ENERGY↗

NASA NTRSDate not supplied

TPSAS-NF1676L-13122-DND

An approach for assessing the delamination propagation and growth capabilities in commercial finite element codes was developed and demonstrated for the Virtual Crack Closure Technique (VCCT) implementations in ABAQUS?. The Double Cantilever Beam (DCB) specimen was chosen as an example. First, benchmark results to assess delamination propagation capabilities under static loading were created using models simulating specimens with different delamination lengths. Second, starting from an initially straight front, the delamination was allowed to propagate based on the algorithms implemented in the commercial finite element software. The load-displacement relationship obtained from the propagation analysis results and the benchmark results were compared. Good agreements could be achieved by selecting the appropriate input parameters, which were determined in an iterative procedure. A benchmark case to assess the fatigue growth prediction capabilities was also created. Input control parameters were varied to study the effect on the computed delamination growth. The benchmarks enabled the selection of the appropriate input parameters that yielded good agreements between the results obtained from the automated analysis and the benchmark results. Overall, the results are encouraging but further assessment for mixed-mode delamination is required.

Ronald Krueger↗

NASA NTRS2002

WIND Validation Cases: Computational Study of Thermally-perfect Gases

The ability of the WIND Navier-Stokes code to predict the physics of multi-species gases is investigated in support of future high-speed, high-temperature propulsion applications relevant to NASA's Space Transportation efforts. Three benchmark cases are investigated to evaluate the capability of the WIND chemistry model to accurately predict the aerodynamics of multi-species chemically non-reacting (frozen) gases. Case 1 represents turbulent mixing of sonic hydrogen and supersonic vitiated air. Case 2 consists of heated and unheated round supersonic jet exiting to ambient. Case 3 represents 2-D flow through a converging-diverging Mach 2 nozzle. For Case 1, the WIND results agree fairly well with experimental results and that significant mixing occurs downstream of the hydrogen injection point. For Case 2, the results show that the Wilke and Sutherland viscosity laws gave similar results, and the available SST turbulence model does not predict round supersonic nozzle flows accurately. For Case 3, results show that experimental, frozen, and 1-D gas results agree fairly well, and that frozen, homogeneous, multi-species gas calculations can be approximated by running in perfect gas mode while specifying the mixture gas constant and Ratio of Specific Heats.

DalBello, Teryn↗

DOE OSTI2024

IER 480: TEX-Pu Benchmark (PU-MET-THERM-004) to Test Polyethylene and Lucite Thermal Scattering Laws [Slides]

This presentation finds that PMT-004 has four new benchmark cases highly sensitive to PE TSL (2 cases) and PMMA TSL (2 Cases). PE cases were well predicted using MCNP6.2 and ENDF/B-VIII.0. PMMA cases overpredicted by approximately 0.6-0.7% in k eff at 20°C. Accepted into 2023 version of the ICSBEP Handbook. Temperature had a large impact on reactivity of the critical configuration. Implications for validation work for thermal cases- need to adjust TSL data to correct temperature as it can have hundreds of pcm effects for a few °C. Future thermal experiments should try and measure reactivity at multiple temperatures to aid in data testing and benchmark adjustment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2011

Development of Benchmark Examples for Delamination Onset and Fatigue Growth Prediction

An approach for assessing the delamination propagation and growth capabilities in commercial finite element codes was developed and demonstrated for the Virtual Crack Closure Technique (VCCT) implementations in ABAQUS. The Double Cantilever Beam (DCB) specimen was chosen as an example. First, benchmark results to assess delamination propagation capabilities under static loading were created using models simulating specimens with different delamination lengths. For each delamination length modeled, the load and displacement at the load point were monitored. The mixed-mode strain energy release rate components were calculated along the delamination front across the width of the specimen. A failure index was calculated by correlating the results with the mixed-mode failure criterion of the graphite/epoxy material. The calculated critical loads and critical displacements for delamination onset for each delamination length modeled were used as a benchmark. The load/displacement relationship computed during automatic propagation should closely match the benchmark case. Second, starting from an initially straight front, the delamination was allowed to propagate based on the algorithms implemented in the commercial finite element software. The load-displacement relationship obtained from the propagation analysis results and the benchmark results were compared. Good agreements could be achieved by selecting the appropriate input parameters, which were determined in an iterative procedure.

Krueger, Ronald↗

NASA NTRS2016

Conceptual Design and Structural Optimization of NASA Environmentally Responsible Aviation (ERA) Hybrid Wing Body Aircraft

Simultaneously achieving the fuel consumption and noise reduction goals set forth by NASA's Environmentally Responsible Aviation (ERA) project requires innovative and unconventional aircraft concepts. In response, advanced hybrid wing body (HWB) aircraft concepts have been proposed and analyzed as a means of meeting these objectives. For the current study, several HWB concepts were analyzed using the Hybrid wing body Conceptual Design and structural optimization (HCDstruct) analysis code. HCDstruct is a medium-fidelity finite element based conceptual design and structural optimization tool developed to fill the critical analysis gap existing between lower order structural sizing approaches and detailed, often finite element based sizing methods for HWB aircraft concepts. Whereas prior versions of the tool used a half-model approach in building the representative finite element model, a full wing-tip-to-wing-tip modeling capability was recently added to HCDstruct, which alleviated the symmetry constraints at the model centerline in place of a free-flying model and allowed for more realistic center body, aft body, and wing loading and trim response. The latest version of HCDstruct was applied to two ERA reference cases, including the Boeing Open Rotor Engine Integration On an HWB (OREIO) concept and the Boeing ERA-0009H1 concept, and results agreed favorably with detailed Boeing design data and related Flight Optimization System (FLOPS) analyses. Following these benchmark cases, HCDstruct was used to size NASA's ERA HWB concepts and to perform a related scaling study.

Quinlan, Jesse R.↗

DOE OSTI2021

Benchmark of the Kilowatt Reactor Using Stirling TechnologY (KRUSTY) Component Critical Configurations

Kilowatt Reactor Using Stirling TechnologY (KRUSTY) was a prototype for the U.S. National Aeronautics and Space Administration’s Kilopower Program. KRUSTY has a highly enriched uranium–molybdenum alloy (with 7.65 wt% molybdenum) annular core reflected by beryllium oxide with an outer stainless steel shield. Five configurations from the experimental campaign were chosen to be evaluated as benchmark cases. Uncertainties were evaluated in five categories: (1) criticality measurement, (2) mass and density, (3) dimensions, (4) material compositions, and (5) positioning. The largest contribution to the overall uncertainty in each case was from the radial alignment of the movable platen. A simplified model was created to increase computational efficiency, and an average bias of –16 pcm was calculated due to the simplifications. Sample calculations were completed for each case using MCNP6.2, COG, and MC21, all with ENDF/B-VIII.0 nuclear data. For MCNP6.2, the average difference (absolute value) between the calculated and experimental $k_{eff}$ for the five configurations was 14 pcm for both the detailed and the simplified models. The $k_{eff}$ results from all three codes are within 1σ of the benchmark values. KRUSTY’s value as a benchmark is due to its sensitivity to beryllium and molybdenum. For beryllium, KRUSTY adds an 18th benchmark with a total cross-section sensitivity greater than 0.05%/%/(unit lethargy). For molybdenum, KRUSTY adds a 9th benchmark with a total cross-section sensitivity greater than 0.004%/%/(unit lethargy).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Modeling receiver flux of commercial power tower concentrating solar power plants using ray tracing: a round-robin comparison of SolTrace, Solstice, and TieSOL

This study presents a multi-stage, cross-validation comparison of three software packages for Monte Carlo ray tracing (MCRT) applied to central tower concentrating solar power (CSP) systems. The three packages evaluated are: (1) SolTrace, an open-source tool developed by the National Renewable Energy Laboratory (NREL); (2) Solstice, an open-source program created by CNRS-PROMES and Meso-Star, with enhancements for CSP applications (called solsticepy) from the Australian National University; and (3) TieSOL, a commercial software developed by Tietronix. This investigation extends previous ray tracing comparisons by incorporating models of multi-facet heliostats within a commercial-scale solar field, taking into account zoned focal lengths and canting configurations. Receiver flux distributions were compared across the tools using a series of case studies, including single-heliostat scenarios, isolated blocking situations, and comprehensive full-field simulations. The case studies were designed to diagnose differences across the models at varying levels of complexity, and to identify and resolve discrepancies as additional parameters were introduced. Key factors examined in the analysis include sun positions, heliostat location, facet and canting focus, and aimpoint strategies. The comparison aims to improve the accuracy and reliability of these tools while providing benchmark cases for validating future optical modeling tools.

14 SOLAR ENERGY↗

DOE OSTI2026

NeuDiff Agent: a governed AI workflow for single-crystal neutron crystallography

Large-scale facilities increasingly face analysis and reporting latency as a limiting step in scientific throughput, particularly for structural studies that require iterative reduction, integration, refinement and validation. To improve the time to result and analysis efficiency, NeuDiff Agent is introduced as a governed, tool-using AI workflow for TOPAZ at the Spallation Neutron Source. NeuDiff Agent takes instrument data through reduction, integration, refinement and validation to a validated crystal structure and a publication-ready CIF. NeuDiff Agent coordinates established crystallographic tools under explicit governance by restricting actions to allowlisted tools, enforcing fail-closed verification gates at key workflow boundaries, and capturing complete provenance for inspection, auditing and controlled replay. The present benchmark is limited to structural crystallography for periodic structures; magnetic structure analysis and incommensurate or superspace refinement are outside the scope of the current workflow. Performance is assessed using a fixed prompt protocol and repeated end-to-end runs with two large language model backends, with user and machine time partitioned and intervention burden and recovery behaviors quantified under gating. In a reference-case benchmark, NeuDiff Agent reduces wall time from 435 min (manual) to 86.5 ± 4.7 to 94.4 ± 3.5 min (4.6–5.0× faster) while producing a validated CIF with no checkCIF level A or B alerts. These results establish a practical route to deploy agentic AI in facility crystallography while preserving traceability and publication-facing validation requirements.

Xiao, Zhongcan [ORNL] (ORCID:0000000220761961)↗

DOE OSTI2021

Detecting Atmospheric Molecules of Nontransiting Temperate Terrestrial Exoplanets Using High-resolution Spectroscopy in the Mid-infrared Domain

Motivated by the development of high-dispersion spectrographs in the mid-infrared (MIR) range, we study their application to the atmospheric characterization of nearby nontransiting temperate terrestrial planets around M-type stars. We examine the detectability of CO{sub 2}, H{sub 2}O, N{sub 2}O, and O{sub 3 }features in high-resolution planetary thermal emission spectra at 12–18 μm assuming an Earth-like profile and a simplified thermal structure. The molecular line width of such planets can be comparable to or broader than the Doppler shift due to the planetary orbital motion. Given the likely difficulty in knowing the high-resolution MIR spectrum of the host star with sufficient accuracy, we propose observing the target system at two quadrature phases and extracting the differential spectra as the planetary signal. In this case, the signals can be substantially suppressed compared with the case where the host star spectrum is perfectly known, as some parts of the spectral features do not remain in the differential spectra. Despite this self-subtraction, the CO{sub 2} and H{sub 2}O features of nearby (≲5 pc) systems with mid-/late-M host stars would be feasible with a 6.5 m class cryogenic space telescope, and orbital inclination could also be constrained for some of them. For CO{sub 2} and N{sub 2}O in a 1 bar Earth-like atmosphere, this method would be sensitive when the mixing ratio is 1–10{sup 3} ppm. The detectability of molecules except O{sub 3} is not significantly improved when the spectral resolution is higher than R≳10,000, although the constraint on the orbital inclination is improved. This study provides some benchmark cases useful for assessing the value of MIR high-resolution spectroscopy in terms of characterization of potentially habitable planets.

47 OTHER INSTRUMENTATION↗