Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

The maximum clique enumeration problem: algorithms, applications, and implementations

Background: The maximum clique enumeration (MCE) problem asks that we identify all maximum cliques in a finite, simple graph. MCE is closely related to two other well-known and widely-studied problems: the maximum clique optimization problem, which asks us to determine the size of a largest clique, and the maximal clique enumeration problem, which asks that we compile a listing of all maximal cliques. Naturally, these three problems are N P -hard, given that they subsume the classic version of the N P -complete clique decision problem. MCE can be solved in principle with standard enumeration methods due to Bron, Kerbosch, Kose and others. Unfortunately, these techniques are ill-suited to graphs encountered in our applications. We must solve MCE on instances deeply seeded in data mining and computational biology, where high-throughput data capture often creates graphs of extreme size and density. MCE can also be solved in principle using more modern algorithms based in part on vertex cover and the theory of fixed-parameter tractability (FPT). While FPT is an improvement, these algorithms too can fail to scale sufficiently well as the sizes and densities of our datasets grow. Results: An extensive testbed of benchmark graphs are created using publicly available transcriptomic datasets from the Gene Expression Omnibus (GEO). Empirical testing reveals crucial but latent features of such high-throughput biological data. In turn, it is shown that these features distinguish real data from random data intended to reproduce salient topological features. In particular, with real data there tends to be an unusually high degree of maximum clique overlap. Armed with this knowledge, novel decomposition strategies are tuned to the data and coupled with the best FPT MCE implementations. Conclusions: Several algorithmic improvements to MCE are made which progressively decrease the run time on graphs in the testbed. Frequently the final runtime improvement is several orders of magnitude. As a result, instances which were once prohibitively time-consuming to solve are brought into the domain of realistic feasibility.

59 BASIC BIOLOGICAL SCIENCES↗

FY13 Annual Report:APEEM Components Analysis and Evaluation

The objectives of this evaluation is to Support the evaluation of current and proposed electric machine and power electronics technologies in a vehicle context to understand the applicability of a particular powertrain technology to a given vehicle and to determine areas/regions for component design improvement based upon system usage patterns; and Enhance the current benchmarking and prototype evaluation capabilities of DOE APEEM programs with the addition of transient-capable testing facilities for power electronics and electric machinery components.

33 ADVANCED PROPULSION SYSTEMS↗

Numerical Implementation of Time-Dependent Density Functional Theory for Extended Systems in Extreme Environments

In recent years, DFT-MD has been shown to be a useful computational tool for exploring the properties of WDM. These calculations achieve excellent agreement with shock compression experiments, which probe the thermodynamic parameters of the Hugoniot state. New X-ray Thomson Scattering diagnostics promise to deliver independent measurements of electronic density and temperature, as well as structural information in shocked systems. However, they require the development of new levels of theory for computing the associated observables within a DFT framework. The experimentally observable x-ray scattering cross section is related to the electronic density-density response function, which is obtainable using TDDFT - a formally exact extension of conventional DFT that describes electron dynamics and excited states. In order to develop a capability for modeling XRTS data and, more generally, to establish a predictive capability for first principles simulations of matter in extreme conditions, real-time TDDFT with Ehrenfest dynamics has been implemented in an existing PAW code for DFT-MD calculations. The purpose of this report is to record implementation details and benchmarks as the project advances from software development to delivering novel scientific results. Results range from tests that establish the accuracy, efficiency, and scalability of our implementation, to calculations that are verified against accepted results in the literature. Aside from the primary XRTS goal, we identify other more general areas where this new capability will be useful, including stopping power calculations and electron-ion equilibration.

97 MATHEMATICS AND COMPUTING↗

When to use rsync

We have endeavored to show, using a series of data transfer results obtained from two testbeds, when to use the popular data copying tool rsync and related tools. Tests have been conducted in local area network (LAN) and wide area network (WAN) environments. We conclude that for files in a certain size range and network latency ≦ 10 ms round trip time (RTT), rsync is still useful for data moving tasks in the category 4 of the U.S. DOE Technical Report “Data Movement Categories”. For more demanding data movement requirements, tools of different classes are suggested. Sample histograms from two DOE user facilities are provided to further support our conclusions.

97 MATHEMATICS AND COMPUTING↗

Transport in Stochastic Media with Random Chord Length Distributions

Thermal radiation transport computations in binary Markovian random mixtures rely almost exclusively on the Levermore-Pomraning (LP) model which is obtained by applying a heuristic closure to the ensemble averaged random medium transport equation. The validity of this model has been extensively tested by comparing numerical results over a broad parameter range (material types and mixing parameters) against benchmark solutions in planar geometry. The conditions under which the LP-model provides useful results and when it breaks down are now well established, but work to date has been largely restricted to homogeneous mixing statistics, i.e., the mean chord lengths of both materials are taken to be spatially constant. In recent work, this limitation was relaxed by allowing the mean chord lengths and, in a consistent fashion, the volume fractions in the LP-model to vary spatially and in a follow-up investigation benchmark solutions were obtained by ensemble averaging results over material realizations sampled from a nonhomogeneous Poisson process (NHPP). Numerical experiments in rod geometry with specifically linear and quadratic spatial dependence of chord lengths showed that the material averaged radiation intensities vary nonmonotonically with depth into the medium, in stark contrast to solutions obtained assuming uniform chord lengths. Moreover, depending on the local optical thickness and strength of scattering, the LP-model results showed locally more nuanced deviations from the benchmark solutions than was the case with constant chord lengths. These limited numerical investigations highlight the nontrivial qualitative and quantitative consequences of nonhomogeneous mixing statistics, in particular that closure approximations may not be uniformly valid or invalid over the problem domain.

42 ENGINEERING↗

An Evaluation of Co-Simulation for Modeling Coupled Natural Gas and Electricity Networks

Reliance on natural gas for power generation has increased the coupling between gas and power networks. While this coupling can bring operational and economic benefits, it can also yield challenges, as the constraints in one system can impact the other. Co-simulation can capture the constraints and interactions between these systems, but so far, there has been limited comparison of co-simulation results to those of an integrated model. In this work, we develop a new co-simulation framework using the HELICS platform and the SAInt tool for modeling transient gas and AC optimal power flow. We evaluate this co-simulation framework against a fully integrated version of the SAInt power and gas simulators, thus providing a benchmarking of the co-simulation approach. We compare results across the two approaches for two test networks and a network representing the Belgian power and gas networks, testing both normal operating conditions and cases with compressor disruptions. In each of the cases tested, we find nearly identical results from the two approaches across various metrics of interest, such as nodal pressure, gas flow rates, and active power generation. This alignment suggests that co-simulation can yield comparable results to fully integrated models for modeling coupled gas and electricity networks.

03 NATURAL GAS↗

Image-Driven Hybrid Structural Analysis Based on Continuum Point Cloud Method with Boundary Capturing Technique

Conventional approaches for the structural health monitoring of infrastructures often rely on physical sensors or targets attached to structural members, which require considerable preparation, maintenance, and operational effort, including continuous on-site adjustments. This paper presents an image-driven hybrid structural analysis technique that combines digital image processing (DIP) and regression analysis with a continuum point cloud method (CPCM) built on a particle-based strong formulation. Polynomial regressions capture the boundary shape change due to the structural loading and precisely identify the edge and corner coordinates of the deformed structure. The captured edge profiles are transformed into essential boundary conditions. This allows the construction of a strongly formulated boundary value problem (BVP), classified as the Dirichlet problem. Capturing boundary conditions from the digital image is novel, although a similar approach was applied to the point cloud data. It was shown that the CPCM is more efficient in this hybrid simulation framework than the weak-form-based numerical schemes. Unlike the finite element method (FEM), it can avoid aligning boundary nodes with regression points. A three-point bending test of a rubber beam was simulated to validate the developed technique. The simulation results were benchmarked against numerical results by ANSYS and various relevant numerical schemes. The technique can effectively solve the Dirichlet-type BVP, yielding accurate deformation, stress, and strain values across the entire problem domain when employing a linear strain model and increasing the number of CPCM nodes. In addition, comparative analysis with conventional displacement tracking techniques verifies the developed technique’s robustness. The proposed technique effectively circumvents the inherent limitations of traditional monitoring methods resulting from the reliance on physical gauges or target markers so that a robust and non-contact solution for remote structural health monitoring in real-scale infrastructures can be provided, even in unfavorable experimental environments.

Chemistry↗

Aerothermal modeling, phase 1. Volume 1: Model assessment

Phase 1 was conducted as part of the overall NASA Hot Section Technology (HOST) Program. The purpose of this effort was to determine the predictive accuracy of and the deficiencies within the various analytical modules comprising the overall combustor aerothermal model used at General Electric, as well as to formulate recommendations for improvement where needed. This effort involved the assembly of a benchmark quality data base from selected available literature, and from General Electric engine and combustor component test data. This data base was supplemented with additional definitive data obtained from an experimental test program conducted as part of the Phase 1 effort. Using selections from this data base, assessment studies were conducted to evaluate the various modules. Assessment of the internal flow module was conducted using 2-D parabolic and ellipitic, as well as 3-D elliptic internal flow calculations of definitive test data selected from the assembled data base. The 2-D assessment provided methodical examination of the mathematical techniques and the physical submodules, while the 3-D assessment focused on usefulness as a design tool. Calculations of combustor linear metal temperatures, pressure loss performance, and airflow distribution were performed using aerothermal modules which were in general use for many years at General Electric. The results of these assessment provided for the identification of deficiencies within the modules. The deficiencies were addressed in some detail providing a foundation on which to formulate a prioritized list of recommendations for improvement.

Kenworthy, M. J.↗

Basin-scale estimates of oceanic primary production by remote sensing - The North Atlantic

The monthly averaged CZCS data for 1979 are used to estimate annual primary production at ocean basin scales in the North Atlantic. The principal supplementary data used were 873 vertical profiles of chlorophyll and 248 sets of parameters derived from photosynthesis-light experiments. Four different procedures were tested for calculation of primary production. The spectral model with nonuniform biomass was considered as the benchmark for comparison against the other three models. The less complete models gave results that differed by as much as 50 percent from the benchmark. Vertically uniform models tended to underestimate primary production by about 20 percent compared to the nonuniform models. At horizontal scale, the differences between spectral and nonspectral models were negligible. The linear correlation between biomass and estimated production was poor outside the tropics, suggesting caution against the indiscriminate use of biomass as a proxy variable for primary production.

Platt, Trevor↗

A Benchmark Problem for Development of Autonomous Structural Modal Identification

This paper summarizes modal identification results obtained using an autonomous version of the Eigensystem Realization Algorithm on a dynamically complex, laboratory structure. The benchmark problem uses 48 of 768 free-decay responses measured in a complete modal survey test. The true modal parameters of the structure are well known from two previous, independent investigations. Without user involvement, the autonomous data analysis identified 24 to 33 structural modes with good to excellent accuracy in 62 seconds of CPU time (on a DEC Alpha 4000 computer). The modal identification technique described in the paper is the baseline algorithm for NASA's Autonomous Dynamics Determination (ADD) experiment scheduled to fly on International Space Station assembly flights in 1997-1999.

Pappa, Richard S.↗

Core-Noise

This presentation is a technical progress report and near-term outlook for NASA-internal and NASA-sponsored external work on core (combustor and turbine) noise funded by the Fundamental Aeronautics Program Subsonic Fixed Wing (SFW) Project. Sections of the presentation cover: the SFW system level noise metrics for the 2015, 2020, and 2025 timeframes; the emerging importance of core noise and its relevance to the SFW Reduced-Noise-Aircraft Technical Challenge; the current research activities in the core-noise area, with some additional details given about the development of a high-fidelity combustion-noise prediction capability; the need for a core-noise diagnostic capability to generate benchmark data for validation of both high-fidelity work and improved models, as well as testing of future noise-reduction technologies; relevant existing core-noise tests using real engines and auxiliary power units; and examples of possible scenarios for a future diagnostic facility. The NASA Fundamental Aeronautics Program has the principal objective of overcoming today's national challenges in air transportation. The SFW Reduced-Noise-Aircraft Technical Challenge aims to enable concepts and technologies to dramatically reduce the perceived aircraft noise outside of airport boundaries. This reduction of aircraft noise is critical for enabling the anticipated large increase in future air traffic. Noise generated in the jet engine core, by sources such as the compressor, combustor, and turbine, can be a significant contribution to the overall noise signature at low-power conditions, typical of approach flight. At high engine power during takeoff, jet and fan noise have traditionally dominated over core noise. However, current design trends and expected technological advances in engine-cycle design as well as noise-reduction methods are likely to reduce non-core noise even at engine-power points higher than approach. In addition, future low-emission combustor designs could increase the combustion-noise component. The trend towards high-power-density cores also means that the noise generated in the low-pressure turbine will likely increase. Consequently, the combined result from these emerging changes will be to elevate the overall importance of turbomachinery core noise, which will need to be addressed in order to meet future noise goals.

Hultgren, Lennart S.↗

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

Iodine has been widely employed as a residual biocide in potable water applications during crewed missions. Unlike other biocides, it is essential to remove iodine from drinking water prior to consumption, as its biocidal concentration raises health concerns. Consequently, effectively removing iodine species from water is a critical step in potable water processing. Although the non-biocided heated leg has not violated microbial specifications on the International Space Station, any wetted volume lacking biocide presents potential risks for long‑duration exploration missions and for systems that are sensitive to microbial growth/contamination. Recent assessments indicate, however, that iodine‑removal performance may degrade under elevated temperature conditions, such as those required for dispensing hot water for food preparation. This reduction in efficacy appears to stem from both the potential physical degradation of filtration media and the temperature‑dependent behavior of adsorption processes. To investigate the influence of water temperature on the efficacy of filtration media for iodine removal, a series of adsorption capacity tests were conducted at both room temperature and elevated temperatures (90 °C). These experiments aimed to benchmark the performance of the adsorbents that constitute the ACTEX filter in the ISS’s potable water dispenser. The findings of this study provide critical insights into the iodine filtration process, verify the potential performance shortfall under elevated temperature conditions, and establish the basis for defining new absorbent requirements to ensure reliable iodine removal in future mission architectures.

iodine↗

Hot Water, Cold Reality: Experimental Analysis of Sorption Constraints in Iodine Filtration Media Under Heated-Water Conditions

Iodine has been widely employed as a residual biocide in potable water applications during crewed missions. Unlike other biocides, it is essential to remove iodine from drinking water prior to consumption, as its biocidal concentration raises health concerns. Consequently, effectively removing iodine species from water is a critical step in potable water processing. Although the non-biocided heated leg has not violated microbial specifications on the International Space Station, any wetted volume lacking biocide presents potential risks for long‑duration exploration missions and for systems that are sensitive to microbial growth/contamination. Recent assessments indicate, however, that iodine‑removal performance may degrade under elevated temperature conditions, such as those required for dispensing hot water for food preparation. This reduction in efficacy appears to stem from both the potential physical degradation of filtration media and the temperature‑dependent behavior of adsorption processes. To investigate the influence of water temperature on the efficacy of filtration media for iodine removal, a series of adsorption capacity tests were conducted at both room temperature and elevated temperatures (90 °C). These experiments aimed to benchmark the performance of the adsorbents that constitute the ACTEX filter in the ISS’s potable water dispenser. The findings of this study provide critical insights into the iodine filtration process, verify the potential performance shortfall under elevated temperature conditions, and establish the basis for defining new absorbent requirements to ensure reliable iodine removal in future mission architectures.

drinking water↗

The MAX facility for CFD code validation

ANL has recently completed construction of a fluid dynamics test facility devised to provide validation data for CFD simulation tools used to evaluate various aspects of nuclear power plant design and safety. Experiments with the facility involve mixing air jets within a 1x1x1.7m long glass tank at atmospheric pressure. A particle image velocimetry system measures flow velocity and turbulence quantities within the tank while a high-speed infrared camera records temperatures across the tank lid. The tandem of high fidelity thermal and turbulence data is particularly useful for benchmarking transient heat transfer phenomena such as thermal striping. This paper describes the MAX facility, preliminary data obtained during shakedown tests, and the results of companion CFD calculations employing RANS-based Star-CCM+ and large eddy simulations with Nek 5000. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

Benchmarking quantum trial wavefunctions for phaseless auxiliary-field quantum Monte Carlo

The phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) method is a stochastic imaginary-time projection technique for computing ground-state properties of strongly correlated quantum systems, with accuracy that depends critically on the choice of trial wavefunction. Here, we investigate ph-AFQMC with trial states prepared using parameterized quantum circuits. In this work, we present a comprehensive benchmarking study of quantum trial wavefunctions spanning unitary coupled-cluster, Hamiltonian-informed, Jastrow-inspired, and adaptively constructed ansatze. The benchmarking evaluates accuracy, expressibility, and scalability of these ansatze within the QC-AFQMC framework. We test these ansatze on linear hydrogen chains under bond stretching and find that several ansatz families produce chemically accurate ph-AFQMC energies across the dissociation curve. We have performed simulations using the CUDA-Q quantum development platform on the GPU partition of the Perlmutter supercomputer. When comparing ansatze at similar numbers of variational parameters, we find that different ansatz families yield comparable ph-AFQMC results despite exhibiting substantially different variational energies, optimization costs, and circuit depths. Our results indicate that the variational energy of an ansatz is not always a reliable indicator of its quality for ph-AFQMC and reveal instances of over-parameterization. In the strongly correlated regime, trial wavefunctions obtained from adaptive ansatze, exemplified here by ADAPT-VQE with the UCCSD operator pool, can outperform their fixed-ansatz counterparts (UCCSD) in terms of projected energies while using substantially more compact circuits, providing a flexible route to optimize quantum resources within the ph-AFQMC framework.

Rofougaran, Rod [LBNL, Berkeley; Columbia U.; PNL,↗

Evaluation of the Start-Up Core Physics Tests at Japan's High Temperature Engineering Test Reactor (Annular Core Loadings)

The High Temperature Engineering Test Reactor (HTTR) of the Japan Atomic Energy Agency (JAEA) is a 30 MWth, graphite-moderated, helium-cooled reactor that was constructed with the objectives to establish and upgrade the technological basis for advanced high-temperature gas-cooled reactors (HTGRs) as well as to conduct various irradiation tests for innovative high-temperature research. The core size of the HTTR represents about one-half of that of future HTGRs, and the high excess reactivity of the HTTR, necessary for compensation of temperature, xenon, and burnup effects during power operations, is similar to that of future HTGRs. During the start-up core physics tests of the HTTR, various annular cores were formed to provide experimental data for verification of design codes for future HTGRs. The Japanese government approved construction of the HTTR in the 1989 fiscal year budget; construction began at the Oarai Research and Development Center in March 1991 and was completed May 1996. Fuel loading began July 1, 1998, from the core periphery. The first criticality was attained with an annular core on November 10, 1998 at 14:18, followed by a series of start-up core physics tests until a fully-loaded core was developed on December 16, 1998. Criticality tests were carried out into January 1999. The first full power operation with an average core outlet temperature of 850ºC was completed on December 7, 2001, and operational licensing of the HTTR was approved on March 6, 2002. The HTTR attained high temperature operation at 950 ºC in April 19, 2004. After a series of safety demonstration tests, it will be used as the heat source in a hydrogen production system by 2015. Hot zero-power critical, rise-to-power, irradiation, and safety demonstration testing , have also been performed with the HTTR, representing additional means for computational validation efforts. Power tests were performed in steps from 0 to 30 MW, with various tests performed at each step to confirm core characteristics, thermal-hydraulic properties, and radiation shielding. The high-temperature test operation at 950 ºC represented the fifth and final phase of the rise-to-power tests. The safety tests demonstrated inherent safety features of the HTTR such as slow temperature response during abnormal events due to the large heat capacity of the core and the negative reactivity feedback. The experimental benchmark performed and currently evaluated in this report pertains to the data available for the annular core criticals from the initial six isothermal, annular and fully-loaded, core critical measurements performed at the HTTR. Evaluation of the start-up core physics tests specific to the fully-loaded core is compiled elsewhere (HTTR-GCR-RESR-001).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Synthetic, Realistic Transmission and Distribution Co-Simulation for Voltage Control Benchmarking

As distributed energy resources (DERs) play an increasing role in generation and grid services, control and market paradigms will need to be tested with models that incorporate transmission and distribution systems. The test systems will need to be realistic and accessible for researchers to form conclusions about realistic behaviors and maintain comparability and repeatability of results. These test systems also must have high resolution models of sufficient size for realistic distribution and transmission interaction. This paper demonstrates the tightly coupled HELICS-based co-simulation of realistic synthetic distribution and transmission models for the Austin metropolitan area and how this framework can be used to analyze resultant behaviors from distributed resources and their controls. These results are compared to the same distribution system run without co-simulation using a fixed feed-in voltage. Results show that even without advanced voltage controls, the feed-in voltage response when coupled to the transmission system results a lower level of voltage excursions, suggesting the importance of using this type of realistic, tightly coupled, transmission and distribution cosimulation when assessing DERs.

27 ARPA - Advanced Research Projects Agency-Energy↗