Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,225 records · Page 68

Exploring Airfoil Table Generation using XFOIL and OVERFLOW

The rotorcraft design process is a continuously evolving field of research that incorporates a number of software programs. An accurate airfoil table is critical in the design and testing process for rotorcraft. With multiple flow solvers available and flow conditions of multirotor UAM vehicles potentially covering a wide range of Reynolds and Mach numbers, a documented approach for developing airfoil tables is needed. Using benchmark data from legacy airfoil tables and wind tunnel tests for comparison, simulations for a comprehensive test matrix could guide rotorcraft design engineers in generating their own airfoil tables using the XFOIL and OVERFLOW solvers. The motivation for this study is to investigate flow solver features to develop a best practices document for airfoil table generation. The study uses the OVERFLOW and XFOIL flow solvers, coupled with the airfoil table generator AFTGen, to analyze three airfoils for a specific Reynolds numbers flow regime and provide details on how well each flow solver performs within a specific angle of attack range, Mach number range, Reynolds number range, and in different flow conditions, such as turbulent and transitional flow. OVERFLOW analyses in AFTGen for fully turbulent and transition flow are compared with XFOIL results and experimental test data for the section lift, section drag, and pressure coefficients. XFOIL ultimately yields results that are accurate within the linear angle of attack range and below a Mach number of 0.4 but tends to overpredict lift and underpredict drag unless the flow is in the compressible regime. XFOIL cannot accurately model stall and post-stall conditions due to the nature of the solver. This is evident in nearly every case run with XFOIL, where the linear range is usually predicted acceptably and the lift coefficient is overpredicted as the stall angle of attack is approached (with the exception being the generally poor correlation with most of the SSC-A09 cases). OVERFLOW is limited at low Mach numbers, and appears to perform best at Mach numbers of 0.4 and above. The exploration of airfoil table generation using XFOIL and OVERFLOW yielded moderately successful results for the NACA 0012 airfoil, reasonably good results for the RC(4)-10 airfoil, and less accurate results for the SSC-A09 airfoil.

Airfoil Table Generation↗

Evaluating and adjusting {sup 239}Pu, {sup 56}Fe, {sup 28}Si and {sup 95}Mo nuclear data with a Monte Carlo technique

In this paper, Monte Carlo optimization and nuclear data evaluation are combined to produce optimal adjusted nuclear data files. The methodology is based on the so-called 'Total Monte Carlo' and the TALYS system. Not only a single nuclear data file is produced for a given isotope, but virtually an infinite number, defining probability distributions for each nuclear quantity. Then each of these random nuclear data libraries is used in a series of benchmark calculations. With a goodness-of-fit estimator, best {sup 239}Pu, {sup 56}Fe, {sup 28}Si and {sup 95}Mo evaluations for that benchmark set can be selected. A few thousands of random files are used and each of them is tested with a large number of fast, thermal and intermediate energy criticality benchmarks. From this, the best performing random file is chosen and proposed as the optimum choice among the studied random set. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Importance of Sea Ice for Validating Global Climate Models

Reproduction of current day large-scale physical features and processes is a critical test of global climate model performance. Without this benchmark, prognoses of future climate conditions are at best speculation. A fundamental question relevant to this issue is, which processes and observations are both robust and sensitive enough to be used for model validation and furthermore are they also indicators of the problem at hand? In the case of global climate, one of the problems at hand is to distinguish between anthropogenic and naturally occuring climate responses. The polar regions provide an excellent testing ground to examine this problem because few humans make their livelihood there, such that anthropogenic influences in the polar regions usually spawn from global redistribution of a source originating elsewhere. Concomitantly, polar regions are one of the few places where responses to climate are non-anthropogenic. Thus, if an anthropogenic effect has reached the polar regions (e.g. the case of upper atmospheric ozone sensitivity to CFCs), it has most likely had an impact globally but is more difficult to sort out from local effects in areas where anthropogenic activity is high. Within this context, sea ice has served as both a monitoring platform and sensitivity parameter of polar climate response since the time of Fridtjof Nansen. Sea ice resides in the polar regions at the air-sea interface such that changes in either the global atmospheric or oceanic circulation set up complex non-linear responses in sea ice which are uniquely determined. Sea ice currently covers a maximum of about 7% of the earth's surface but was completely absent during the Jurassic Period and far more extensive during the various ice ages. It is also geophysically very thin (typically <10 m in Arctic, <3 m in Antarctic) compared to the troposphere (roughly 10 km) and deep ocean (roughly 3 to 4 km). Because of these unique conditions, polar researchers regard sea ice as one of the more important features to monitor in terms of heat, mass, and momentum transfer between the air and sea and furthermore, the impact of such responses to global climate.

Geiger, Cathleen A.↗

FY2010 Annual Progress Report for Vehicle and Systems Simulation and Testing

The VSST team evaluates the technologies and performance characteristics of advanced automotive powertrain components and subsystems in an integrated vehicle systems context, covering light to heavy platforms. This work is directed toward evaluating and verifying the targets of the VTP R&D teams and to provide guidance in establishing roadmaps for achievement of these goals.

33 ADVANCED PROPULSION SYSTEMS↗

Attention-Augmented Parametric Kernel Graph Neural Network (APKGNN) for Node Classification

We present a new graph neural network, the Attention-based Parametric-Kernel augmented Graph Neural Network (APKGNN), developed for node classification tasks. Despite extensive work on modeling multi-faceted relationships between connected nodes of a graph, the effect of attention on edge features mapped to relationships has not yet been analyzed through learning representation. This study derives such an attention vector by first calculating node features corresponding to endpoints of an edge and then aggregating these with extracted local intrinsic patches of a given graph to generate augmented local patch vectors. This process uses a parametric kernel based on Gaussian mixture models (GMMs) to embed local neighborhoods of the graph in local patches. The patch vectors then convolve with the above node features to produce an updated node representation. We show that this new learning representation (APKGNN) achieves higher node classification accuracy on tasks - both standard benchmarks (Cora, PubMed, Citeseer) and new experimental short text corpora where nodes correspond to text documents and words. This implementation of the GNN convolution layer outperforms state-of-the-art (SOTA) algorithms, achieving higher training, validation, and test accuracy by a significant margin on three standard benchmark data sets under both SOTA experimental settings and those for new testbeds.

Bose, Avishek↗

FY2011 Annual Progress Report for Vehicle and Systems Simulation and Testing

The VSST team's mission is to evaluate the technologies and performance characteristics of advanced automotive powertrain components and subsystems in an integrated vehicle systems context. These evaluations address light-, medium-, and heavy-duty vehicle platforms. This work is directed toward evaluating and verifying the targets of the VTP R&D teams and to providing guidance in establishing roadmaps for achievement of these goals.

33 ADVANCED PROPULSION SYSTEMS↗

NAS Grid Benchmarks

We provide a paper-and-pencil specification of a benchmark suite for computational grids. It is based on the NAS (NASA Advanced Supercomputing) Parallel Benchmarks (NPB) and is called the NAS Grid Benchmarks (NGB). NGB problems are presented as data flow graphs encapsulating an instance of a slightly modified NPB task in each graph node, which communicates with other nodes by sending/receiving initialization data. Like NPB, NGB specifies several different classes (problem sizes). In this report we describe classes S, W, and A, and provide verification values for each. The implementor has the freedom to choose any language, grid environment, security model, fault tolerance/error correction mechanism, etc., as long as the resulting implementation passes the verification test and reports the turnaround time of the benchmark.

VanderWijngaart, Rob↗

Chemical cleaning of porous stainless steel cross-flow filter elements for nuclear waste applications

The Waste Treatment and Immobilization Plant (WTP) currently under construction for treatment of High-Level Waste (HLW) at the Hanford Site will rely on cross-flow ultrafiltration to provide solids-liquid separation as a core part of the treatment process. To optimize process throughput, periodic chemical cleaning of the porous stainless steel filter elements has been incorporated into the design of the plant. It is currently specified that chemical cleaning with nitric acid will occur after significant irreversible membrane fouling is observed. Irreversible fouling is defined as fouling that cannot be removed by backpulsing the filter. PNNL has investigated chemical cleaning processes as part of integrated tests with HLW simulants and with actual Hanford tank wastes. To quantify the effectiveness of chemical cleaning, the residual membrane resistance after cleaning was compared against the initial membrane resistance for each test in a series of long-term fouling tests. The impact of the small amount of residual resistance in these tests could not be separated from other parameters and the historical benchmark of >1 GPM/ft2 for clean water flux was determined to be an adequate metric for chemical cleaning. Using the results from these tests, a process optimization strategy is presented suggesting that for the simulant material under test, the value of chemical cleaning may be suspect. The period of enhanced filtration may not be enough to offset the down time required for chemical cleaning, without respect to the other associated costs.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Status of SAS4A/SASSYS-1 Software Development and Application (FY2024)

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analysis of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over fifty years. It has been identified as a critical element of safety analysis capabilities for the U.S. Department of Energy and is utilized within industry to perform the transient safety analyses required to support the licensing of Liquid Metal-cooled Fast Reactors (LMFRs). This report summarizes the code development and update activities carried out during FY2024. In FY2024, programmatic activities focused on key improvements to software useability, such as enhanced user interfaces for reactivity feedback modeling, improvements in stability/useability of the Code Manual, and improvements to the acceptance testing infrastructure, including automation of acceptance testing and generation of the Acceptance Testing Report. To support end user applications, an open training was held, a semi-public forum was maintained, and a practical benchmarking and validation matrix was developed which allowed limitations of existing testing capabilities to be assessed. The existing fuel models were also enhanced with improved modeling capabilities and testing for the oxide and annular fuel models.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scintilla European project, the successful research results

The Scintilla FP7 project is ended in December 2014, the fruitful results of 3 years development and tests will be presented. SCINTILLA offers the capacity to finding a reliable alternative to Helium-3 based detection systems since the gas which is predominantly used in nuclear safeguards and security applications has now become very expensive, rare and nearly unavailable. SCINTILLA benchmarks results are based on international standards. Radiation Portal tests were carried out at the Joint Research Centre (JRC) in Ispra (Italy). The scintilla project addresses few mains issues. The first is to develop neutron detectors for Radiation Portal Monitor (RPM) and the second is the need of new wearable integrated solutions for Spectrometric Personal Radiation Monitor (SPRM). The partners which provide technical systems of the scintilla project are INFN-ANSALDO, CEA, SYMETRICA and SAPHYMO. For RPM, the objective is to find reliable alternatives to Helium-3 historical neutron detector and provide technical solutions which cope with tests for reliable mobile and cost effective. For Spectrometric Personal Radiation Monitor (SPRM), SCINTILLA is innovating in technology areas that offer complementary capabilities for detecting and identifying gamma, Two CZT (Cadmium Zinc Telluride) addressing contexts of used by first responder technologies, one is a wearable detector and the second is a gamma camera complemented by advanced image processing technologies. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Updates and Validation for the n+ 63,65 Cu Cross Sections [Abstract]

The neutron induced total, elastic, and capture cross sections of 63,65 Cu isotopes were selected for evaluation in the resolved and unresolved resonance energy ranges by the National Criticality Safety Program to resolve discrepancies related to benchmark performance. This is especially evident for the series of ZEUS benchmarks in which copper is used as a reflector. Because copper is also used as structural material in both fission and fusion reactors, the need to address benchmark discrepancies linked to nuclear data deficiencies is a task of primary importance. The aim of this work is to describe the steps of evaluation work towards a consistent improvement of the benchmark performance. The R-matrix analysis with the SAMMY code focused on the 63 Cu(n,γ) reaction channel between 100-300 keV coupled to unresolved resonance region parameters up to 650 keV to fit average cross section data from a recent experiment. Due to the high sensitivity of many benchmarks to elastic scattering angular distribution data, especially for the 65 Cu isotope, the impact of these data was tested by generating Legendre coefficients from both resonance parameters and the Hauser-Feshbach model. Guided by the findings of Shaw et al., the performance of the current evaluation for 65 Cu was compared to that of ENDF/B-VII.1 and ENDF/B-VIII.0 by testing the reactivity coefficients corresponding to the validation suite of experimental criticality benchmarks for thermal, intermediate, and fast systems taken from the International Criticality Safety Benchmark Experiments Project Handbook. The benchmark performance is especially sensitive to 63 Cu(n,γ) and 65 Cu elastic scattering for neutron energies in the 100–500 keV region, whereas 100 keV is the upper limit of the resolved resonance region in the ENDF/B-VIII.0 evaluations for 63,65 Cu. The results highlight the need to handle the transition from the resolved resonance region to the high energy region carefully.

07 ISOTOPE AND RADIATION SOURCES↗

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗

Noisy intermediate-scale quantum algorithms

A universal fault-tolerant quantum computer that can efficiently solve problems such as integer factorization and unstructured database search requires millions of qubits with low error rates and long coherence times. While the experimental advancement toward realizing such devices will potentially take decades of research, noisy intermediate-scale quantum (NISQ) computers already exist. These computers are composed of hundreds of noisy qubits, i.e., qubits that are not error corrected, and therefore perform imperfect operations within a limited coherence time. In the search for achieving quantum advantage with these devices, algorithms have been proposed for applications in various disciplines spanning physics, machine learning, quantum chemistry, and combinatorial optimization. The overarching goal of such algorithms is to leverage the limited available resources to perform classically challenging tasks. In this review, a thorough summary of NISQ computational paradigms and algorithms is provided. The key structure of these algorithms and their limitations and advantages are discussed. Finally, a comprehensive overview of various benchmarking and software tools useful for programming and testing NISQ devices is additionally provided.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmarking of the mono-energetic transport coefficients-results from the International Collaboration on Neoclassical Transport in Stellarators (ICNTS)

Numerical results for the three mono-energetic transport coefficients required for a complete neoclassical description of stellarator plasmas have been benchmarked within an international collaboration. These transport coefficients are flux-surface-averaged moments of solutions to the linearized drift kinetic equation which have been determined using field-line-integration techniques, Monte Carlo simulations, a variational method employing Fourier-Legendre test functions and a finite-difference scheme. The benchmarking has been successfully carried out for past, present and future devices which represent different optimization strategies within the extensive configuration space available to stellarators. A qualitative comparison of the results with theoretical expectations for simple model fields is provided. The behaviour of the results for the mono-energetic radial and parallel transport coefficients can be largely understood from such theoretical considerations but the mono-energetic bootstrap current coefficient exhibits characteristics which have not been predicted.

Beidler, C. D.↗

An extensible simulation environment and movement metrics for testing walking behavior in agent-based models

Human movement is a significant ingredient of many social, environmental, and technical systems, yet the importance of movement is often discounted in considering systems complexity. Movement is commonly abstracted in agent-based modeling (which is perhaps the methodological vehicle for modeling complex systems), despite the influence of movement upon information exchange and adaptation in a system. In particular, agent-based models of urban pedestrians often treat movement in proxy form at the expense of faithfully treating movement behavior with realistic agency. There exists little consensus about which method is appropriate for representing movement in agent-based schemes. In this paper, we examine popularly-used methods to drive movement in agent-based models, first by introducing a methodology that can flexibly handle many representations of movement at many different scales and second, introducing a suite of tools to benchmark agent movement between models and against real-world trajectory data. We find that most popular movement schemes do a relatively poor job of representing movement, but that some schemes may well be 'good enough' for some applications. We also discuss potential avenues for improving the representation of movement in agent-based frameworks.

99 GENERAL AND MISCELLANEOUS↗

Code Verification and Confidence-Building

This document described the current status of verification and confidence building activities for the four simulation codes used for groundwater flow and transport simulations in the NRAP project. This is meant to be a ‘living document’ which will evolve as the verification suites expand and the models are tested against new field and laboratory experiments. Documenting these activities will enable the simulation teams at different laboratories to share verification problems, to benchmark against other codes. It will also help stakeholders understand the testing process and to gain confidence in model results.

54 ENVIRONMENTAL SCIENCES↗

Test Plan for the Horizontal Dry Cask Simulator

The thermal performance of commercial spent nuclear fuel dry storage casks is evaluated through detailed numerical analysis. These modeling efforts are completed by the vendor to demonstrate performance and regulatory compliance. The calculations are then independently verified by the Nuclear Regulatory Commission(NRC). Canistered dry storage cask systems rely on ventilation between the inner canister and the overpack to convect heat away from the canister to the surrounding environment for both horizontal and vertical configurations. Recent advances in dry storage cask designs have significantly increased the maximum thermal load allowed in a cask in part by increasing the efficiency of internal conduction pathways and by increasing the internal convection through greater canister helium pressure. Carefully measured data sets generated from testing of full sized casks or smaller cask analogs are widely recognized as vital for validating these models. While several testing programs have been previously conducted, these earlier validation studies did not integrate all the physics or components important in a modern, horizontal dry cask system. The purpose of the investigation described in this test plan is to produce data sets that can be used to benchmark the codes and best practices presently used to determine cladding temperatures and induced cooling air flows in modern horizontal dry storage systems. The horizontal dry cask simulator(HDCS) has been designed to generate this benchmark data and add to the existing knowledgebase. The pressure vessel representing the canister has been designed, fabricated, and pressure tested for a maximum allowable pressure(MAWP)rating of 2,400 kPa at400 °C. An existing electrically heated but otherwise prototypic boiling water reactor(BWR), Incoloy-clad test assembly will be deployed inside of a representative storage basket and canister. An insulated sheet metal enclosure will be used to mimic the thermal properties of the concrete vault enclosure used in a modern horizontal storage system. Radial and axial temperature profiles along with induced cooling air flow will be measured for a wide range of decay powers and representative(and higher)cask pressures using various backfills of helium, argon, or air. The single assembly geometry with well-controlled boundary conditions simplifies computational requirements while preserving relevant physics. The proposed test apparatus integrates all the underlying thermal-hydraulics important to defining the performance of a modern horizontal storage system. These include combined-mode heat transfer from the electrically-heated assembly to the canister walls and the primarily natural-convective heat transfer from the canister to the cooling air flow passing through the horizontal vault enclosure. The objective of the HDCS is not to reproduce the performance of a commercial dry storage system for any given set of operational parameters. Rather ,the objective is to capture the dominant physics in a well-characterized test apparatus. The close coupling between the thermal response of the canister system and the resulting induced cooling air flow rate is of particular importance. While incorporating the best available information based on thermal-hydraulic scaling arguments as well as previous vertical testing, this test plan is subject to changes due to improved understanding or from as built deviations to designs. As-built conditions and actual procedures will be documented in the final test report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗