Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Performance Assessment of OVERFLOW on Distributed Computing Environment

The aerodynamic computer code, OVERFLOW, with a multi-zone overset grid feature, has been parallelized to enhance its performance on distributed and shared memory paradigms. Practical application benchmarks have been set to assess the efficiency of code's parallelism on high-performance architectures. The code's performance has also been experimented with in the context of the distributed computing paradigm on distant computer resources using the Information Power Grid (IPG) toolkit, Globus. Two parallel versions of the code, namely OVERFLOW-MPI and -MLP, have developed around the natural coarse grained parallelism inherent in a multi-zonal domain decomposition paradigm. The algorithm invokes a strategy that forms a number of groups, each consisting of a zone, a cluster of zones and/or a partition of a large zone. Each group can be thought of as a process with one or multithreads assigned to it and that all groups run in parallel. The -MPI version of the code uses explicit message-passing based on the standard MPI library for sending and receiving interzonal boundary data across processors. The -MLP version employs no message-passing paradigm; the boundary data is transferred through the shared memory. The -MPI code is suited for both distributed and shared memory architectures, while the -MLP code can only be used on shared memory platforms. The IPG applications are implemented by the -MPI code using the Globus toolkit. While a computational task is distributed across multiple computer resources, the parallelism can be explored on each resource alone. Performance studies are achieved with some practical aerodynamic problems with complex geometries, consisting of 2.5 up to 33 million grid points and a large number of zonal blocks. The computations were executed primarily on SGI Origin 2000 multiprocessors and on the Cray T3E. OVERFLOW's IPG applications are carried out on NASA homogeneous metacomputing machines located at three sites, Ames, Langley and Glenn. Plans for the future will exploit the distributed parallel computing capability on various homogeneous and heterogeneous resources and large scale benchmarks. Alternative IPG toolkits will be used along with sophisticated zonal grouping strategies to minimize the communication time across the computer resources.

Djomehri, M. Jahed↗

Jet tagging in the Lund plane with graph networks

The identification of boosted heavy particles such as top quarks or vector bosons is one of the key problems arising in experimental studies at the Large Hadron Collider. In this article, we introduce LundNet, a novel jet tagging method which relies on graph neural networks and an efficient description of the radiation patterns within a jet to optimally disentangle signatures of boosted objects from background events. We apply this framework to a number of different benchmarks, showing significantly improved performance for top tagging compared to existing state-of-the-art algorithms. We study the robustness of the LundNet taggers to non-perturbative and detector effects, and show how kinematic cuts in the Lund plane can mitigate overfitting of the neural network to model-dependent contributions. Finally, we consider the computational complexity of this method and its scaling as a function of kinematic Lund plane cuts, showing an order of magnitude improvement in speed over previous graph-based taggers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Cascade Optimization Strategy with Neural Network and Regression Approximations Demonstrated on a Preliminary Aircraft Engine Design

A preliminary aircraft engine design methodology is being developed that utilizes a cascade optimization strategy together with neural network and regression approximation methods. The cascade strategy employs different optimization algorithms in a specified sequence. The neural network and regression methods are used to approximate solutions obtained from the NASA Engine Performance Program (NEPP), which implements engine thermodynamic cycle and performance analysis models. The new methodology is proving to be more robust and computationally efficient than the conventional optimization approach of using a single optimization algorithm with direct reanalysis. The methodology has been demonstrated on a preliminary design problem for a novel subsonic turbofan engine concept that incorporates a wave rotor as a cycle-topping device. Computations of maximum thrust were obtained for a specific design point in the engine mission profile. The results (depicted in the figure) show a significant improvement in the maximum thrust obtained using the new methodology in comparison to benchmark solutions obtained using NEPP in a manual design mode.

Hopkins, Dale A.↗

Exponentially-Biased Ground-State Sampling of Quantum Annealing Machines with Transverse-Field Driving Hamiltonians

We study the performance of the D-Wave 2X quantum annealing machine on systems with well-controlled ground-state degeneracy. While obtaining the ground state of a spin-glass benchmark instance represents a difficult task, the gold standard for any optimization algorithm or machine is to sample all solutions that minimize the Hamiltonian with more or less equal probability. Our results show that while naive transverse-field quantum annealing on the D-Wave 2X device can find the ground-state energy of the problems, it is not well suited in identifying all degenerate ground-state configurations associated to a particular instance. Even worse, some states are exponentially suppressed, in agreement with previous studies on toy model problems [New J. Phys. 11, 073021 (2009)]. These results suggest that more complex driving Hamiltonians are needed in future quantum annealing machines to ensure a fair sampling of the ground-state manifold.

Quantum Annealing↗

Automatic inspection of program state in an uncooperative environment

Abstract The program state is formed by the values that the program manipulates. These values are stored in the stack, in the heap, or in static memory. The ability to inspect the program state is useful as a debugging or as a verification aid. Yet, there exists no general technique to insert inspection points in type‐unsafe languages such as C or C++. The difficulty comes from the need to traverse the memory graph in a so‐called uncooperative environment. In this article, we propose an automatic technique to deal with this problem. We introduce a static code transformation approach that inserts in a program the instrumentation necessary to report its internal state. Our technique has been implemented in LLVM. It is possible to adjust the granularity of inspection points trading precision for performance. In this article, we demonstrate how to use inspection points to debug compiler optimizations; to augment benchmarks with verification code; and to visualize data structures.

Magalhães, José Wesley de Souza↗

Axion-like particle searches at DarkQuest

Axion-like particles (ALPs) interacting with the Standard Model can be abundantly produced in proton beam fixed-target experiments. Looking for their displaced decays is therefore an effective search strategy for ALPs with a mass in the MeV to GeV range. Focusing on the benchmark models where the ALP interacts dominantly with photons or gluons, we show that the proposed DarkQuest experiment at Fermilab will be able to test parameter space which has been previously inaccessible. We pay particular attention to the self-consistency of gluon-coupled ALP production and decay calculations, which has been recently shown to be a problem in many existing predictions. We also apply these results to explore existing constraints in the ALP parameter space.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Initial validation of ALFRED: A Monte Carlo code built on Geant4 for TREAT energy deposition

Predicting the energy deposited in the specimen during an experiment in the Transient Reactor Test (TREAT) Facility is a complex problem due to the nature of the transients occurring in the reactor. In addition, the many particles contributing to energy deposition have different behavior in time and space. ALFRED, a new Geant4 based code, is developed to transport and simulate each particle generated in the core. This code is verified against OpenMC (Open Monte Carlo) on the Godiva benchmark and a simple TREAT model. Next, the energy deposition in TREAT is calculated: 181.05 ± 0.01 MeV for the “instantaneous” energy deposition (which accounts for the energy deposited within 1 s after neutron emission) in fuel and 189.90 ± 0.01 MeV for the total energy deposition in fuel. We discuss these results in this paper with previous calculations and experimental evaluations. This work demonstrates ALFRED’s potential as a high-fidelity tool for computing the spatial and temporal energy deposition in TREAT paving the way for a better understanding of the energy coupling factors in TREAT.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MS25: Materials Science-Focused Benchmark Data Set for Machine Learning Interatomic Potentials

Here, we present MS25, a benchmark data set for evaluating machine learning interatomic potentials (MLIPs) across diverse materials-relevant systems including MgO surfaces, liquid water, zeolites, a catalytic Pt surface reaction, high-entropy alloys (HEAs), and disordered Zr-oxides. Five MLIP architectures (MACE, NequIP, Allegro, MTP, and Torch-ANI) are trained and tested, focusing not only on traditional metrics (energies, forces, and stresses) but also explicitly validating derived physical observables such as lattice constants, volumes, and reaction barriers. We find that most models reach comparable accuracy on standard error metrics across the simple systems, although equivariant MLIPs offer 1.5–2× improvements over nonequivariant MLIPs in energy and force error for structurally complex or compositionally disordered environments such as HEAs and Zr–O systems. Our analysis highlights that low errors in energy and force predictions do not guarantee reliable observables, emphasizing the necessity of explicit validation. We demonstrate limitations in cross-framework transferability, as models trained on one zeolite framework (CHA) fail to reliably generalize to predictions of structurally distinct frameworks (e.g., MFI). Size-extensive tests show some dependence on system size for MgO, resulting from forced periodicity. The HEA and Zr–O data sets are identified as challenging tests for future benchmarks and MLIP model architecture developments as they show significant differentiation in error between MLIP architectures and are still relatively difficult at 1000 training images. Moving forward, we recommend that benchmarking efforts shift their focus from marginal accuracy improvements in energy and force errors toward identifying and understanding model failure modes, rigorously assessing transferability, and evaluating how their errors affect observable predictions. For researchers looking to choose an MLIP architecture, we suggest selecting equivariant MLIP architectures if the complexity of the system is a challenge. For simple materials problems, auxiliary features such as integration with molecular dynamics engines, trade-offs between computational data set generation cost vs MLIP inference speed, and framework integration may play a more important decision factor than small differences in error metrics that are unlikely to matter for production-level research.

chemical structure↗

Revealing the frequency-dependent oscillations in the nonlinear terahertz response induced by the Josephson current

ABSTRACT Nonlinear responses of superconductors to intense terahertz radiation has been an active research frontier. Using terahertz pump-terahertz probe spectroscopy, we investigate the c-axis nonlinear optical response of a high-temperature superconducting cuprate. After excitation by a single-cycle terahertz pump pulse, the reflectivity of the probe pulse oscillates as the pump-probe delay is varied. Interestingly, the oscillatory central frequency scales linearly with the probe frequency, a fact widely overlooked in pump-probe experiments. By theoretically solving the nonlinear optical reflection problem on the interface, we show that our observation is well explained by the Josephson-type third-order nonlinear electrodynamics, together with the emission coefficient from inside the material into free space. The latter results in a strong enhancement of the emitted signal whose physical frequency is around the Josephson plasma edge. Our result offers a benchmark for and new insights into strong-field terahertz spectroscopy of related quantum materials.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Distributionally Robust Building Load Control to Compensate Fluctuations in Solar Power Generation

This paper investigates the use of a collection of dispatchable heating, ventilation and air conditioning (HVAC) systems to absorb low-frequency fluctuations in renewable energy sources, especially in solar photo-voltaic (PV) generation. Given the uncertain and time-varying nature of solar PV generation, its probability distribution is difficult to be estimated perfectly, which poses a challenging problem of how to optimally schedule a fleet of HVAC loads to consume as much as local PV generation. We formulate a distributionally robust chance-constrained (DRCC) model to ensure that PV generation is consumed with a desired probability for a family of probability distributions, termed as an ambiguity set, built upon mean and covariance information. We benchmark the DRCC model with a deterministic optimization model and a stochastic programming model in a one-day simulation. We show that the DRCC model achieves constantly good performance to consume most PV generation even in the case with the presence of probability distribution ambiguity.

Zhang, Yiling↗

Adiabatic quantum support vector machines

Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with an increasing number of features and an increasing number of data points in the training dataset. In conclusion, our scalability results show that the quantum approach obtains a 3.5–4.5x speedup over the classical approach on datasets with many (millions of) features.

Computational Complexity↗

Long-range correlation energy calculated from coupled atomic response functions

An accurate determination of the electron correlation energy is an essential prerequisite for describing the structure, stability, and function in a wide variety of systems. Therefore, the development of efficient approaches for the calculation of the correlation energy (and hence the dispersion energy as well) is essential and such methods can be coupled with many density-functional approximations, local methods for the electron correlation energy, and even interatomic force fields. In this work, we build upon the previously developed many-body dispersion (MBD) framework, which is intimately linked to the random-phase approximation for the correlation energy. We separate the correlation energy into short-range contributions that are modeled by semi-local functionals and long-range contributions that are calculated by mapping the complex all-electron problem onto a set of atomic response functions coupled in the dipole approximation. We propose an effective range-separation of the coupling between the atomic response functions that extends the already broad applicability of the MBD method to non-metallic materials with highly anisotropic responses, such as layered nanostructures. Application to a variety of high-quality benchmark datasets illustrates the accuracy and applicability of the improved MBD approach, which offers the prospect of first-principles modeling of large structurally complex systems with an accurate description of the long-range correlation energy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Energy storage arbitrage under day-ahead and real-time price uncertainty

Electricity markets must match real-time supply and demand of electricity. With increasing penetration of renewable resources, it is important that this balancing is done effectively, considering the high uncertainty of wind and solar energy. Storing electrical energy can make the grid more reliable and efficient and energy storage is proposed as a complement to highly variable renewable energy sources. However, for investments in energy storage to increase, participating in the market must become economically viable for owners. This paper proposes a stochastic formulation of a storage owner’s arbitrage profit maximization problem under uncertainty in day-ahead (DA) and real-time (RT) market prices. The proposed model helps storage owners in market bidding and operational decisions and in estimation of the economic viability of energy storage. Finally, case study results on realistic market price data show that the novel stochastic bidding approach does significantly better than the deterministic benchmark.

25 ENERGY STORAGE↗

ORNL Neutron Cross Section Measurements of 90 Zr

Nuclear criticality modeling and simulations rely on the quality of the existing evaluated nuclear data libraries such as Evaluated Nuclear Data File (ENDF)/B, the Joint Evaluated Fission and Fusion (JEFF) nuclear data library, or the Japanese Evaluated Nuclear Data Library (JENDL). In some cases, the cross-section evaluations of those libraries were found to be deficient in describing criticality benchmarks accurately. More than two decades ago, the US Nuclear Criticality Safety Program (NCSP) established a Nuclear Data (ND) task which encompassed experiments and evaluations. In response to this, the Oak Ridge National Laboratory (ORNL) formed a Nuclear Criticality and Data group which performed ND experiments, data analysis, and evaluations to produce ENDF files for the ND libraries as identified in the NCSP Five-Year Plan. Before being submitted to the ENDF library, files were processed and tested for performance by running benchmark calculations. This procedure was centralized in the ORNL group and is now often referred to as the ND pipeline. NCSP collaborates with the Joint Research Center (JRC) of the European Commission in Geel, Belgium, to perform high-resolution neutron-induced cross section measurements at the Geel Linear Accelerator (GELINA). The objective is to address emerging ND problems in criticality calculations. Difficulties with ND include insufficient neutron energy range, missing covariances, and previously unrecognized inaccuracies with experiments. New neutron total and capture cross sections of 90 Zr in the neutron energy range from 100 eV to several hundred keV were recently performed. These measured data will be used, together with existing high-resolution transmission data from a metallic 90 Zr sample, to improve representation of the cross sections.

97 MATHEMATICS AND COMPUTING↗

MOLECULAR SPECTROSCPY AND REACTIONS OF ACTINIDES IN THE GAS PHASE AND CRYOGENIC MATRICES

In this chapter we review the spectroscopic data for actinide molecules and the reaction dynamics for atomic and molecular actinides that have been examined in the gas phase or in inert cryogenic matrices. The motivation for this type of investigation is that physical properties and reactions can be studied in the absence of external perturbations (gas phase) or under minimally perturbing conditions (cryogenic matrices). This information can be compared directly with the results from high-level theoretical models. The interplay between experiment and theory is critically important for advancing our understanding of actinide chemistry. For example, elucidation of the role of the 5f electrons in bonding and reactivity can only be achieved through the application of experimentally verified theoretical models. Theoretical calculations for the actinides are challenging due the large numbers of electrons that must be treated explicitly and the presence of strong relativistic effects. This topic has been reviewed in depth in Chapter 17 of this series. One of the goals of the experimental work described in this chapter has been to provide benchmark data that can be used to evaluate both empirical and ab initio theoretical models. While gas-phase data are the most suitable for comparison with theoretical calculations, there are technical difficulties entailed in generating workable densities of gas-phase actinide molecules that have limited the range of species that have been characterized. Many of the compounds of interest are refractory, and problems associated with the use of high temperature vapors have complicated measurements of spectra, ionization energies, and reactions. One approach that has proved to be especially valuable in overcoming this difficulty has been the use of pulsed laser ablation to generate plumes of vapor from refractory actinide-containing materials. The vapor is entrained in an inert gas, which can be used to cool the actinide species to room temperature or below. For many spectroscopic measurements, low temperatures have been achieved by co-condensing the actinide vapor in rare gas or inert molecule host matrices. Spectra recorded in matrices are usually considered to be minimally perturbed. Trapping the products from gas-phase reactions that occur when trace quantities of reactants are added to the inert host gas has resulted in the discovery of many new actinide species. Selected aspects of the matrix isolation data were discussed in chapter 17. In the present chapter we review the spectroscopic matrix data in terms of its relationship to gas-phase measurements, and update the description of the new reaction products found in matrices to reflect the developments that have occurred during the past two years. Spectra recorded in matrix environments are usually considered to be minimally perturbed, and this expectation is borne out for many closed shell actinide molecules. However, there is growing evidence that significant perturbations can occur for open shell molecules, resulting in geometric distortions and/or electronic state reordering. Studies of actinide reactions in the gas phase provide an opportunity to probe the relationship between electronic structure and reactivity. Much of this work has focused on the reactions of ionic species, as these may be selected and controlled using various forms of mass spectrometry. As an example of the type of insight derived from reaction studies, it has been established that the reaction barriers for An+ ions are determined by the promotion energies required to achieve the 5fn6d7s configuration. Gas-phase reaction studies also provide fundamental thermodynamic properties such as bond dissociation and ionization energies. In recent years, an increased number of gas-phase ion chemistry studies of bare (atomic) and ligated (molecular) actinide ions have appeared, in which relevant contributions to fundamental actinide chemistry have been made. These studies were initiated in the 1970's and carried out in an uninterrupted way over the course of the past three decades. Initial studies unsurprisingly focused on naturally occurring U (and Th) and were later extended (starting ten years ago) to Pa and several of the more abundant members of the transuranium series, Np through Es. The main purpose of the reaction dynamics section of this chapter is to summarize (up to late 2008) the work done in the gas phase involving ionic species, with an emphasis on the key accomplishments. This topic was recently reviewed in a comprehensive way (Gibson 2002a; Gibson and Marcalo 2006). The small number of studies reported for gas-phase reactions of neutral actinide species are also briefly summarized.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A high accuracy/resolution spectral element/Fourier–Galerkin method for the simulation of shoaling non-linear internal waves and turbulence in long domains with variable bathymetry

A high-order hybrid continuous-Galerkin numerical method, designed for the simulation of non-linear, non -hydrostatic internal waves and turbulence in long computational domains with complex bathymetry, is presented. The spatial discretization in the non-periodic wave-propagating directions, utilizes the nodal spectral element method. Such a high-order element-based discretization allows the highly accurate representation of complex domain geometry along with the flexibility of concentrating resolution in areas of interest. Under the assumption of the normal-to-isobath propagation of non-linear internal waves, a third periodic direction is incorporated via a Fourier-Galerkin discretization. The distinct non-hydrostatic nature of non-linear internal waves and, any instabilities and turbulence therein, necessitates the numerically challenging solution of the pressure Poisson problem. A defining feature of this work is the application of a domain decomposition approach, combined with block-Jacobi/deflation-based preconditioning to the pressure Poisson problem. Such a combined approach is particularly suitable for the long high aspect-ratio complex domains of interest and enables the efficient high-accuracy reproduction of the non-hydrostatic dynamics of non-linear internal waves. Implementation details are also described in the context of the stability of the solver and its parallelization strategy. A series of benchmarks of increasing complexity demonstrate the robustness of the flow solver. The benchmarks culminate with the three-dimensional simulation of a convectively breaking mode-one non-linear internal wave over a realistic South-China-Sea bathymetric transect and background current/stratification profiles.

Deflation↗

Timely Reporting of Heavy Hitters Using External Memory

Given an input stream S of size N, a Φ-heavy hitter is an item that occurs at least ΦN times in S. The problem of finding heavy-hitters is extensively studied in the database literature. In this work, we study a real-time heavy-hitters variant in which an element must be reported shortly after we see its T = Φ N-th occurrence (and hence it becomes a heavy hitter). We call this the Timely Event Detection (TED) Problem. The TED problem models the needs of many real-world monitoring systems, which demand accurate (i.e., no false negatives) and timely reporting of all events from large, high-speed streams with a low reporting threshold (high sensitivity). Like the classic heavy-hitters problem, solving the TED problem without false-positives requires large space (Ω (N) words). Thus in-RAM heavy-hitters algorithms typically sacrifice accuracy (i.e., allow false positives), sensitivity, or timeliness (i.e., use multiple passes). We show how to adapt heavy-hitters algorithms to external memory to solve the TED problem on large high-speed streams while guaranteeing accuracy, sensitivity, and timeliness. Our data structures are limited only by I/O-bandwidth (not latency) and support a tunable tradeoff between reporting delay and I/O overhead. With a small bounded reporting delay, our algorithms incur only a logarithmic I/O overhead. We implement and validate our data structures empirically using the Firehose streaming benchmark. Multi-threaded versions of our structures can scale to process 11M observations per second before becoming CPU bound. In comparison, a naive adaptation of the standard heavy-hitters algorithm to external memory would be limited by the storage device’s random I/O throughput, i.e., ≈100K observations per second.

97 MATHEMATICS AND COMPUTING↗