Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Benchmark Modeling and Simulation of the FFTF LOFWOS Test #13 Using SAM

The Fast Flux Test Facility (FFTF) was a 400 MW thermal powered, oxide-fueled, liquid sodium cooled test reactor, built to assist development and testing of advanced fuels and materials for fast breeder reactors. In July 1986, a series of unprotected Loss of Flow Without Scram (LOFWOS) transients were performed in FFTF as part of the Passive Safety Testing (PST) program. The LOFWOS Test #13, which was initiated at 50% power and 100% flow with the pump pony motors left off, has been chosen as a benchmark case by IAEA to support collaborative efforts within international partnerships on the validation of simulation tools and models in the area of sodium fast reactor passive safety in an IAEA Coordinated Research Project (CRP), launched in October 2018. The System Analysis Module (SAM) is an advanced and modern system analysis tool under development at Argonne National Laboratory for advanced non-LWR safety analysis. It utilizes the object-oriented application framework MOOSE to leverage the modern software environment and advanced numerical methods. The capabilities of SAM are being extended to enable the transient modeling, analysis, and design of various advanced nuclear reactor systems. To participate the IAEA CRP and enhance the SAM validation base for advanced reactor transient safety analysis, benchmark simulations of the FFTF LOFWOS Test #13 are performed using the SAM code. In this first phase of the validation effort, the thermal-hydraulic behavior of the reactor system is the focus and the reactor kinetics is not considered in the SAM FFTF model. Instead, the results of Argonne’s neutronics calculations are directly used, including the power shape of the active core region and the power history during the transient. The simulation results of FFTF at steady state agreed well with the measured data from the test. During the transient, reasonably good agreement were also obtained. Future work to improve the model will focus on introducing the reactivity predictions into the model, as well as better understanding or resolving the current discrepancies with the measured data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Status of the KRUSTY Benchmark Modeling and Uncertainty Analysis

The U.S. National Aeronautics and Space Administration’s (NASA) desire for a small nuclear reactor for space applications led to a prototype assembly, Kilopower Reactor Using Stirling Technology (KRUSTY). The KRUSTY experiments included four phases: component critical, cold critical, warm critical, and high temperature. The KRUSTY benchmark described in this paper includes five configurations from the component critical experiments that were performed at the National Criticality Experiments Research Center (NCERC) beginning in November 2017. Preliminary results have been reported. The benchmark is now nearing completion (although it is still preliminary until formally accepted by the International Criticality Safety Benchmark Evaluation Project [ICSBEP] working group). In this paper, we present the updated benchmark and its uncertainties. These results were computed using MCNP6.2 ® with ENDF/B-VIII.0 cross sections.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Leveraging the signature of heterotrophic respiration on atmospheric CO 2 for model benchmarking

Spatial and temporal variations in atmospheric carbon dioxide (CO 2 ) reflect large-scale net carbon exchange between the atmosphere and terrestrial ecosystems. Soil heterotrophic respiration (HR) is one of the component fluxes that drive this net exchange, but, given observational limitations, it is difficult to quantify this flux or to evaluate global-scale model simulations thereof. Here, we show that atmospheric CO 2 can provide a useful constraint on large-scale patterns of soil heterotrophic respiration. We analyze three soil model configurations (CASA-CNP, MIMICS, and CORPSE) that simulate HR fluxes within a biogeochemical test bed that provides each model with identical net primary productivity (NPP) and climate forcings. We subsequently quantify the effects of variation in simulated terrestrial carbon fluxes (NPP and HR from the three soil test-bed models) on atmospheric CO 2 distributions using a three-dimensional atmospheric tracer transport model. Our results show that atmospheric CO 2 observations can be used to identify deficiencies in model simulations of the seasonal cycle and interannual variability in HR relative to NPP. In particular, the two models that explicitly simulated microbial processes (MIMICS and CORPSE) were more variable than observations at interannual timescales and showed a stronger-than-observed temperature sensitivity. Our results prompt future research directions to use atmospheric CO 2 , in combination with additional constraints on terrestrial productivity or soil carbon stocks, for evaluating HR fluxes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Stable and radioactive carbon isotope partitioning in soils and saturated systems: a reactive transport modeling benchmark study

This benchmark provides the first rigorous test of a three-isotope system [ 12 C, 13 C, and 14 C] subject to the combined effects of radioactive decay and both stable equilibrium and kinetic fractionation. We present a series of problems building in complexity based on the cycling of carbon in both organic and inorganic forms. The key components implement (1) equilibrium fractionation between multiple coexisting carbon species as a function of pH, (2) radioactive decay of radiocarbon with associated mass-dependent speciation demonstrating appropriate correction of the Δ 14 C value in agreement with reporting convention, and (3) kinetic stable isotope fractionation due to the oxidation of organic carbon to inorganic forms as a function of time and space in an open, through-flowing system. Participating RTM codes are CrunchTope, ToughReact, Hytec, and The Geochemist’s Workbench. Across all problem levels, simulation results from all RTMs demonstrate good agreement.

58 GEOSCIENCES↗
DOE OSTI2021

Whisper Results of a PuCl "Solution" System Using LLNL TEX Cl Benchmark Model

This data set is to be shared with the Nuclear Criticality Safety Division (NCSD) at LLNL as part of a TEX Cl experiment. NCSD at LLNL shared the experimental model with the Nuclear Criticality Safety (NCS) Division at LANL for comparison with an MCNP model of a PuCl application system. The experimental model was used in conjunction with Whisper to see how including it would impact the baseline USL for the PuCl application.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Impacts of benchmarking choices on inferred model skill of the Arctic–Boreal terrestrial carbon cycle

Abstract Land surface models require continuous validation against observations to improve and reduce simulation uncertainty. However, inferred model performance can be heavily influenced by subjective choices made in the selection and application of observational data products. A key area often misrepresented by models is the Arctic–Boreal region, which is a potential tipping point region in Earth’s climate system due to large permafrost carbon stocks that are vulnerable to release with climate warming. We use the International Land Model Benchmarking (ILAMB) framework to evaluate how the model skill of TRENDY-v9 models varies based on the choice of observational-based benchmark and how benchmarks are applied in model evaluation. This analysis uses global datasets integrated into ILAMB and new, regionally-specific observational products from the Arctic–Boreal Vulnerability Experiment. Our results cover the overall time period of 1979–2019 and show that model scores can vary substantially depending on the data product applied, with higher model scores indicating better model performance against observations. The lowest model scores occur when benchmarked against regional, compared to global, datasets. We also evaluate observed and modeled functional relationships between ecosystem respiration and air temperature and between gross primary production and precipitation. Here, we find that the magnitude and shape of the responses are strongly impacted by the choice of observational dataset and the approach used to construct the functional relationship benchmark. These results suggest that model evaluation studies could conclude a false sense of model skill if only using a single benchmark data product or if not applying regional data products when performing a regional model analysis. Collectively, our findings highlight the influence of benchmarking choices on model evaluation and point to the need for benchmarking guidelines when assessing model skill.

Poe, Jeralyn (ORCID:0000000318495278)↗
NASA NTRS2017

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗
NASA NTRS1998

Modeling the Benchmark Active Control Technology Wind-Tunnel Model for Active Control Design Applications

This report describes the formulation of a model of the dynamic behavior of the Benchmark Active Controls Technology (BACT) wind tunnel model for active control design and analysis applications. The model is formed by combining the equations of motion for the BACT wind tunnel model with actuator models and a model of wind tunnel turbulence. The primary focus of this report is the development of the equations of motion from first principles by using Lagrange's equations and the principle of virtual work. A numerical form of the model is generated by making use of parameters obtained from both experiment and analysis. Comparisons between experimental and analytical data obtained from the numerical model show excellent agreement and suggest that simple coefficient-based aerodynamics are sufficient to accurately characterize the aeroelastic response of the BACT wind tunnel model. The equations of motion developed herein have been used to aid in the design and analysis of a number of flutter suppression controllers that have been successfully implemented.

Waszak, Martin R.↗
NASA NTRS1996

Modeling the Benchmark Active Control Technology Wind-Tunnel Model for Application to Flutter Suppression

This paper describes the formulation of a model of the dynamic behavior of the Benchmark Active Controls Technology (BACT) wind-tunnel model for application to design and analysis of flutter suppression controllers. The model is formed by combining the equations of motion for the BACT wind-tunnel model with actuator models and a model of wind-tunnel turbulence. The primary focus of this paper is the development of the equations of motion from first principles using Lagrange's equations and the principle of virtual work. A numerical form of the model is generated using values for parameters obtained from both experiment and analysis. A unique aspect of the BACT wind-tunnel model is that it has upper- and lower-surface spoilers for active control. Comparisons with experimental frequency responses and other data show excellent agreement and suggest that simple coefficient-based aerodynamics are sufficient to accurately characterize the aeroelastic response of the BACT wind-tunnel model. The equations of motion developed herein have been used to assist the design and analysis of a number of flutter suppression controllers that have been successfully implemented.

Waszak, Martin R.↗
NASA NTRS1991

A status report on a model for Benchmark active controls testing

This 'work-in-progress' paper presents a status report on an active controls flutter model which is currently in the design and fabrication phase. This model is a part of the Benchmark Models Program (BMP). The BMP is a NASA LaRC program that includes a series of models which will be used to study different aeroelastic phenomena and to validate aeroelastic methods. The objective of Benchmark Active Controls testing is to validate active control design tools. Flutter testing will be conducted with a pressure-instrumented rigid model attached to a flexible pitch and plunge mount system. Unsteady pressure distributions and transonic flutter boundaries will be measured with and without active control system engaged.

Durham, Michael H.↗
NASA NTRS1991

The benchmark aeroelastic models program: Description and highlights of initial results

An experimental effort was implemented in aeroelasticity called the Benchmark Models Program. The primary purpose of this program is to provide the necessary data to evaluate computational fluid dynamic codes for aeroelastic analysis. It also focuses on increasing the understanding of the physics of unsteady flows and providing data for empirical design. An overview is given of this program and some results obtained in the initial tests are highlighted. The tests that were completed include measurement of unsteady pressures during flutter of rigid wing with a NACA 0012 airfoil section and dynamic response measurements of a flexible rectangular wing with a thick circular arc airfoil undergoing shock boundary layer oscillations.

Bennett, Robert M.↗
NASA NTRS1992

The benchmark aeroelastic models program: Description and highlights of initial results

An experimental effort was implemented in aeroelasticity called the Benchmark Models Program. The primary purpose of this program is to provide the necessary data to evaluate computational fluid dynamic codes for aeroelastic analysis. It also focuses on increasing the understanding of the physics of unsteady flows and providing data for empirical design. An overview is given of this program and some results obtained in the initial tests are highlighted. The tests that were completed include measurement of unsteady pressures during flutter of a rigid wing with an NACA 0012 airfoil section and dynamic response measurements of a flexible rectangular wing with a thick circular arc airfoil undergoing shock boundary layer oscillations.

Bennett, Robert M.↗
DOE OSTI2024

Model-ready benchmarks for NPP, ANPP, litter fluxes, and recruitment into the 1 cm dbh size class

The intended use of this dataset is to serve as an observational benchmark to evaluate model predictions of NPP, ANPP, litter fluxes, and recruitment at Barro Colorado Island, Panama. This dataset contains four CSV files and one text file. “Benchmarks-NPP-ANPP-R-L.csv” provides estimates of annual ecosystem-level reproductive litter flux (R), leaf litter flux (L), aboveground net primary productivity (ANPP), and net primary productivity (NPP) for 61 field plots throughout tropical, temperate, and boreal forest biomes. An additional 499 plots (n = 550) include estimates of just R, L, and R/L. Each row reports a distinct set of estimates for one sampling interval at one plot. “Metadata-Benchmarks-NPP-ANPP-R-L.csv” contains field descriptions for all data fields in “Benchmarks-NPP-ANPP-R-L.csv”. “References-Benchmarks-NPP-ANPP-R-L.txt” contains full references to the original studies used to produce the observations at each plot included in the data. “Benchmarks-Recruitment.csv” provides estimates of species-level recruitment rates into the 1 cm dbh size class at four CTFS-ForestGeo sites using methods that account for unobserved mortality of new recruits between census intervals (Kohyama et al., 2018). “Metadata-Benchmarks-Recruitment.csv” contains field descriptions for all data fields in “Benchmarks-Recruitment.csv”.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2013

Elastic-Plastic J-Integral Solutions or Surface Cracks in Tension Using an Interpolation Methodology. Appendix C -- Finite Element Models Solution Database File, Appendix D -- Benchmark Finite Element Models Solution Database File

No closed form solutions exist for the elastic-plastic J-integral for surface cracks due to the nonlinear, three-dimensional nature of the problem. Traditionally, each surface crack must be analyzed with a unique and time-consuming nonlinear finite element analysis. To overcome this shortcoming, the authors have developed and analyzed an array of 600 3D nonlinear finite element models for surface cracks in flat plates under tension loading. The solution space covers a wide range of crack shapes and depths (shape: 0.2 less than or equal to a/c less than or equal to 1, depth: 0.2 less than or equal to a/B less than or equal to 0.8) and material flow properties (elastic modulus-to-yield ratio: 100 less than or equal to E/ys less than or equal to 1,000, and hardening: 3 less than or equal to n less than or equal to 20). The authors have developed a methodology for interpolating between the goemetric and material property variables that allows the user to reliably evaluate the full elastic-plastic J-integral and force versus crack mouth opening displacement solution; thus, a solution can be obtained very rapidly by users without elastic-plastic fracture mechanics modeling experience. Complete solutions for the 600 models and 25 additional benchmark models are provided in tabular format.

Allen, Phillip A.↗