Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Preliminary efforts toward development of data handling and analysis software for unsteady flow measurements: An application for aeroelastic transonic flow configurations

A few years ago the Structural Dynamics Division at LaRC started ambitious experimental research efforts known as the Benchmark Models Program. The primary objective of this program was to provide experimental data that may serve as a calibration source for computational fluid dynamics (CFD) efforts that deal with aeroelastic unsteady flow configurations. It also focuses on the understanding of complex flow phenomenon associated with unsteady flow developments. The overall plan for the program has been described by Bennett, including a presentation of initial test results of flutter of a rigid wing mounted on flexible supports. An example of a test model employed to measure the dynamic response along with corresponding pressure distributions is shown. This model incorporates eighty pressure transducers distributed along two spanwise stations. In addition, the models are equipped with four accelerometers and two strain gages. The data handling system for the Benchmark Model Program is under development. Several interactive computer routines designed for the user interface, dynamic memory allocation, unsteady flow measurements data extraction, and further data processing were developed. To present a few examples of measured data, the unsteady pressure distributions and the wing model dynamic response were plotted.

Finaish, Fathi↗

Test Cases for the Benchmark Active Controls: Spoiler and Control Surface Oscillations and Flutter

As a portion of the Benchmark Models Program at NASA Langley, a simple generic model was developed for active controls research and was called BACT for Benchmark Active Controls Technology model. This model was based on the previously-tested Benchmark Models rectangular wing with the NACA 0012 airfoil section that was mounted on the Pitch and Plunge Apparatus (PAPA) for flutter testing. The BACT model had an upper surface spoiler, a lower surface spoiler, and a trailing edge control surface for use in flutter suppression and dynamic response excitation. Previous experience with flutter suppression indicated a need for measured control surface aerodynamics for accurate control law design. Three different types of flutter instability boundaries had also been determined for the NACA 0012/PAPA model, a classical flutter boundary, a transonic stall flutter boundary at angle of attack, and a plunge instability near M = 0.9. Therefore an extensive set of steady and control surface oscillation data was generated spanning the range of the three types of instabilities. This information was subsequently used to design control laws to suppress each flutter instability. There have been three tests of the BACT model. The objective of the first test, TDT Test 485, was to generate a data set of steady and unsteady control surface effectiveness data, and to determine the open loop dynamic characteristics of the control systems including the actuators. Unsteady pressures, loads, and transfer functions were measured. The other two tests, TDT Test 502 and TDT Test 5 18, were primarily oriented towards active controls research, but some data supplementary to the first test were obtained. Dynamic response of the flexible system to control surface excitation and open loop flutter characteristics were determined during Test 502. Loads were not measured during the last two tests. During these tests, a database of over 3000 data sets was obtained. A reasonably extensive subset of the data sets from the first two tests have been chosen for Test Cases for computational comparisons concentrating on static conditions and cases with harmonically oscillating control surfaces. Several flutter Test Cases from both tests have also been included. Some aerodynamic comparisons with the BACT data have been made using computational fluid dynamics codes at the Navier-Stokes level (and in the accompanying chapter SC). Some mechanical and active control studies have been presented. In this report several Test Cases are selected to illustrate trends for a variety of different conditions with emphasis on transonic flow effects. Cases for static angles of attack, static trailing-edge and upper-surface spoiler deflections are included for a range of conditions near those for the oscillation cases. Cases for trailing-edge control and upper-surface spoiler oscillations for a range of Mach numbers, angle of attack, and static control deflections are included. Cases for all three types of flutter instability are selected. In addition some cases are included for dynamic response measurements during forced oscillations of the controls on the flexible mount. An overview of the model and tests is given, and the standard formulary for these data is listed. Some sample data and sample results of calculations are presented. Only the static pressures and the first harmonic real and imaginary parts of the pressures are included in the data for the Test Cases, but digitized time histories have been archived. The data for the Test Cases are also available as separate electronic files.

Bennett, Robert M.↗

Computational fluid dynamic analysis of a novel particle-to-air fluidized-bed heat exchanger for particle-based thermal energy storage applications

Long-duration energy storage technologies are being targeted to enable cost-effective, decarbonized energy systems. Particle-based thermal energy storage systems are one promising technology by storing excess electricity or heat as sensible thermal energy in inexpensive, solid, inert particles. These systems are only possible if an effective and economical particle-to-working fluid heat exchanger exists. This study predicts the performance of a proposed, direct-contact, particle-to-air, pressurized fluidized-bed heat exchanger using computational fluid dynamics. The common Eulerian-Eulerian framework for modeling fluidized beds is first benchmarked to experimental results at a previously untested operating condition and application. Then, the benchmarked model evaluates the performance of a proposed design for a commercial-scale version of the novel particle-to-air heat exchanger. The results show pressure drop and gas-phase approach temperatures are advantageous compared to other proposed designs for particle-to-air heat exchangers in the literature; approach temperatures were less than 5 °C and gas-phase pressure drop across the fluidized bed was 32 kPa. The model also highlights the importance of gas distributor design and representation in the Eulerian-Eulerian framework to control fluidization behavior. In conclusion, the model built and benchmarked in this study can be leveraged to advance the design and analysis of these heat exchangers critical to the deployment of a promising long-duration energy storage technology.

25 ENERGY STORAGE↗

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

Robust Multivariable Flutter Suppression for the Benchmark Active Control Technology (BACT) Wind-Tunnel Model

The Benchmark Active Controls Technology (BACT) project is part of NASA Langley Research Center s Benchmark Models Program for studying transonic aeroelastic phenomena. In January of 1996 the BACT wind-tunnel model was used to successfully demonstrate the application of robust multivariable control design methods (H and -synthesis) to flutter suppression. This paper addresses the design and experimental evaluation of robust multivariable flutter suppression control laws with particular attention paid to the degree to which stability and performance robustness was achieved.

Waszak, Martin R.↗

Dark scalars and heavy neutral leptons at DarkQuest

The proposed DarkQuest beam dump experiment, a modest upgrade to the existing SeaQuest/SpinQuest experiment, has great potential for uncovering new physics within a dark sector. We explore both the near-term and long-term prospects for observing two distinct, highly-motivated hidden sector benchmark models: heavy neutral leptons and Higgs-mixed scalars. We comprehensively examine the particle production and detector acceptance at DarkQuest, including an updated treatment of meson production, and light scalar production through both bremsstrahlung and gluon-gluon fusion. In both benchmark models, DarkQuest will provide an opportunity to probe previously inaccessible interesting regions of parameter space on a fairly short timescale when compared to other proposed experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Validation of Continuous-Energy ENDF/B-VIII.0 16 O, 56 Fe, and 63,65 Cu Cross Sections for Nuclear Criticality Safety Applications

Recently completed cross-section evaluations sponsored in part by the Nuclear Criticality Safety Program were incorporated into the 2018 release of the ENDF/B-VIII.0 cross-section library. Evaluated isotopes of interest to the nuclear data and criticality safety community include 16 O, 56 Fe, and 63,65 Cu. For performance validation, benchmark models defined in the International Criticality Safety Benchmark Evaluation Project Handbook were selected based on energy-integrated k eff sensitivities to total cross sections of interest and compared with experimental values. Of the 102 benchmark configurations that were utilized, 63 are sensitive to 16 O, 32 sensitive to 63,65 Cu, and 25 sensitive to 56 Fe. Selected benchmarks were modeled in SCALE 6.2.3 Criticality Safety Analysis Sequence (CSAS) continuous-energy Monte Carlo k eff calculations with ENDF/B-VII.1, with a hybrid ENDF/B-VII.1 with ENDF/B-VIII.0 data substituted for individual isotopes of interest, and with ENDF/B-VIII.0. ENDF/B-VIII.0 showed improved agreement with experimental k eff for 56 Fe, 63 Cu, elemental copper, and full library substitution while producing lessened agreement for 16 O and 65 Cu. Furthermore, with full library and isotope-specific ENDF/B-VIII.0 performance, a best-case ENDF library was formed by excluding underperforming isotopes’ ENDF/B-VIII.0 data, reverting 16 O and 65 Cu cross sections to ENDF/B-VII.1. This resulted in the average relative deviation between calculated and experimental data improving from 1.45σ for the ENDF/B-VIII.0 library to 1.32σ for the best-case library, relative to benchmark uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ILAMBv2.7 benchmarking results comparing E3SMv2.1 land-atmosphere coupled (BGCv2LNDATM) and stand alone land (ELM) simulations with CMIP6 emission driven historical simulations

This dataset contains land model benchmarking results for the Energy Exascale Earth System Model version 2.1 (E3SMv2.1), including outputs from both coupled biogeochemistry simulations and stand-alone land model simulations. These results are compared against several emission-driven historical simulations from the Coupled Model Intercomparison Project Phase 6 (CMIP6). Benchmarking was conducted using the International Land Model Benchmarking (ILAMB) package, version 2.7 (ILAMBv2.7). CMIP6 model outputs were sourced from the Earth System Grid Federation (ESGF), while the E3SMv2.1 results were derived from raw model outputs. These outputs underwent processing steps such as time serialization, conservative regridding, and data standardization to ensure comparability. For spatial interpolation, the Earth System Modeling Framework (ESMF) tool, ESMF_RegridWeightGen, was employed to generate regridding weights, enabling the transformation of E3SM’s native cubed-sphere grid to a regular latitude-longitude grid.

Feng, Sha [PNNL]↗

RANS Modeling of Benchmark Shockwave / Boundary Layer Interaction Experiments

This presentation summarizes the computations of a set of shock wave / turbulent boundary layer interaction (SWTBLI) test cases using the Wind-US code, as part of the 2010 American Institute of Aeronautics and Astronautics (AIAA) shock / boundary layer interaction workshop. The experiments involve supersonic flows in wind tunnels with a shock generator that directs an oblique shock wave toward the boundary layer along one of the walls of the wind tunnel. The Wind-US calculations utilized structured grid computations performed in Reynolds-averaged Navier-Stokes mode. Three turbulence models were investigated: the Spalart-Allmaras one-equation model, the Menter Shear Stress Transport wavenumber-angular frequency two-equation model, and an explicit algebraic stress wavenumber-angular frequency formulation. Effects of grid resolution and upwinding scheme were also considered. The results from the CFD calculations are compared to particle image velocimetry (PIV) data from the experiments. As expected, turbulence model effects dominated the accuracy of the solutions with upwinding scheme selection indicating minimal effects.!

Georgiadis, Nick↗

SBbadger: biochemical reaction networks with definable degree distributions

Abstract Motivation An essential step in developing computational tools for the inference, optimization and simulation of biochemical reaction networks is gauging tool performance against earlier efforts using an appropriate set of benchmarks. General strategies for the assembly of benchmark models include collection from the literature, creation via subnetwork extraction and de novo generation. However, with respect to biochemical reaction networks, these approaches and their associated tools are either poorly suited to generate models that reflect the wide range of properties found in natural biochemical networks or to do so in numbers that enable rigorous statistical analysis. Results In this work, we present SBbadger, a python-based software tool for the generation of synthetic biochemical reaction or metabolic networks with user-defined degree distributions, multiple available kinetic formalisms and a host of other definable properties. SBbadger thus enables the creation of benchmark model sets that reflect properties of biological systems and generate the kinetics and model structures typically targeted by computational analysis and inference software. Here, we detail the computational and algorithmic workflow of SBbadger, demonstrate its performance under various settings, provide sample outputs and compare it to currently available biochemical reaction network generation software. Availability and implementation SBbadger is implemented in Python and is freely available at https://github.com/sys-bio/SBbadger and via PyPI at https://pypi.org/project/SBbadger/. Documentation can be found at https://SBbadger.readthedocs.io. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗

Performance analysis and comparison of data-driven models for predicting indoor temperature in multi-zone commercial buildings

Building thermal models, which characterize the properties of a building’s envelope and thermal mass, are essential for accurate indoor temperature and cooling/heating demand prediction. Because of their flexibility and ease of use, data-driven models are increasingly used. Here, this study compared and analyzed the performance of gray-box (resistance-capacitance) and black-box (recurrent neural network) models for predicting indoor air temperature in a real multi-zone commercial building. The developed resistance-capacitance model served as a benchmark model for which full sets of temporal data and building information were used as inputs. The recurrent neural network models were trained and tested assuming various available types and amounts of temporal data and known building physical information to investigate the effects of data and information availability. Feature importance analysis was conducted to select the key variables for different prediction targets under different scenarios. This research provides guidance in selecting an appropriate building thermal response modeling method based on the measured data availability, building physical information, and application.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Primordial black holes from first-order phase transition in the singlet-extended SM

Supercooled first-order phase transition (FOPT) can lead to the formation of primordial black holes (PBHs). This scenario imposes stringent requirements on the profile of the effective potential. In this work, we use the singlet extended Standard Model (xSM) as a benchmark model to investigate this possibility at the electroweak scale. The PBHs formed during a supercooled FOPT have a narrow mass distribution around the mass of Earth. This distribution is closely tied to the temperature at which the PBHs form, corresponding to the FOPT at the electroweak scale. This scenario can be probed with microlensing experiments, space-based gravitational wave detectors, and collider experiments. Remarkably, the future space-based gravitational wave detector LISA will hold the potential to either confirm this scenario that leads to PBH formation across the observable Universe in the xSM or completely rule it out. Interestingly, our findings suggest that PBHs within the xSM framework may align with observations of the six ultrashort timescale events reported by the OGLE microlensing experiment. Published by the American Physical Society 2025

Gonçalves, Dorival (ORCID:0000000342234238)↗

SC Wall-to-RC Basemat Over-Strength Connection: Behavior and Design

This paper presents results from experimental and analytical investigations conducted to evaluate the lateral load behavior and capacity of steel-plate composite (SC) wall-to-reinforced concrete (RC) basemat connections. Two SC wall-to-reinforced concrete basemat connection specimens were tested. These SC wall specimens had a height-to-length ratio of 0.6 and did not include boundary elements. The experimental results include the lateral force-displacement (V-Δ) responses of the specimens and observations of local damage such as steel plate local buckling and concrete crushing. 3D finite element models were developed and benchmarked using the experimental results. The benchmarked models were used to conduct analytical parametric studies, expand the database, and gain additional insights into the behavior of SC wall-to-RC basemat connections. The parameters included in analytical investigations were the wall aspect ratio (h/lw), reinforcement ratio (ρ), and wall thickness (T).

Kurt, Efe G.↗

Elastic-Plastic J-Integral Solutions or Surface Cracks in Tension Using an Interpolation Methodology

No closed form solutions exist for the elastic-plastic J-integral for surface cracks due to the nonlinear, three-dimensional nature of the problem. Traditionally, each surface crack must be analyzed with a unique and time-consuming nonlinear finite element analysis. To overcome this shortcoming, the authors have developed and analyzed an array of 600 3D nonlinear finite element models for surface cracks in flat plates under tension loading. The solution space covers a wide range of crack shapes and depths (shape: 0.2 less than or equal to a/c less than or equal to 1, depth: 0.2 less than or equal to a/B less than or equal to 0.8) and material flow properties (elastic modulus-to-yield ratio: 100 less than or equal to E/ys less than or equal to 1,000, and hardening: 3 less than or equal to n less than or equal to 20). The authors have developed a methodology for interpolating between the goemetric and material property variables that allows the user to reliably evaluate the full elastic-plastic J-integral and force versus crack mouth opening displacement solution; thus, a solution can be obtained very rapidly by users without elastic-plastic fracture mechanics modeling experience. Complete solutions for the 600 models and 25 additional benchmark models are provided in tabular format.

Allen, P. A.↗

Greedy Sampling and Incremental Surrogate Model-Based Tailoring of Aeroservoelastic Model Database for Flexible Aircraft

This paper presents a data analysis and modeling framework to tailor and develop linear parameter-varying (LPV) aeroservoelastic (ASE) model database for flexible aircrafts in broad 2D flight parameter space. The Kriging surrogate model is constructed using ASE models at a fraction of grid points within the original model database, and then the ASE model at any flight condition can be obtained simply through surrogate model interpolation. The greedy sampling algorithm is developed to select the next sample point that carries the worst relative error between the surrogate model prediction and the benchmark model in the frequency domain among all input-output channels. The process is iterated to incrementally improve surrogate model accuracy till a pre-determined tolerance or iteration budget is met. The methodology is applied to the ASE model database of a flexible aircraft currently being tested at NASA/AFRC for flutter suppression and gust load alleviation. Our studies indicate that the proposed method can reduce the number of models in the original database by 67%. Even so the ASE models obtained through Kriging interpolation match the model in the original database constructed directly from the physics-based tool with the worst relative error far below 1%. The interpolated ASE model exhibits continuously-varying gains along a set of prescribed flight conditions. More importantly, the selected grid points are distributed non-uniformly in the parameter space, a) capturing the distinctly different dynamic behavior and its dependence on flight parameters, and b) reiterating the need and utility for adaptive space sampling techniques for ASE model database compaction. The present framework is directly extendible to high-dimensional flight parameter space, and can be used to guide the ASE model development, model order reduction, robust control synthesis and novel vehicle design of flexible aircraft.

numerical analysi↗

Benchmarking MCNP models to support gamma irradiation experiments

Seismic isolators and damping devices have been used for 30+ years to reduce seismic forces and deployed in 10,000+ structures, including bridges, buildings, and mission-critical infrastructure. Studies have shown that seismic isolation of nuclear power plants can reduce the seismic risk by several orders of magnitude and substantially reduce the overnight capital cost. Advanced reactor developers are considering seismic isolation as an integral design feature in their reactor design. It can either be deployed at the building level, isolating the entire reactor building, or at the component level, isolating individual pieces of safety-class equipment, such as a reactor vessel or a steam generator. For equipment isolation, located close to the reactor vessel, the seismic isolators and/or damping devices may be exposed to gamma and neutron radiation, with a possible effect on their mechanical properties which would affect the response of the isolated equipment under earthquake shaking. The Department of Energy, as part of its Nuclear Energy University Program (NEUP), in collaboration with the Idaho National Laboratory (INL), is funding a project at the University at Buffalo (UB) to investigate the effect of gamma radiation on the mechanical properties of various seismic protective devices. (When isolating equipment, the seismic protective devices will be located outside the reactor vessel where the neutron exposure will be insignificant.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗