Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Review of multi-fidelity models

Multi-fidelity models provide a framework for integrating computational models of varying complexity, allowing for accurate predictions while optimizing computational resources. These models are especially beneficial when acquiring high-accuracy data is costly or computationally intensive. This review offers a comprehensive analysis of multi-fidelity models, focusing on their applications in scientific and engineering fields, particularly in optimization and uncertainty quantification. It classifies publications on multi-fidelity modeling according to several criteria, including application area, surrogate model selection, types of fidelity, combination methods and year of publication. The study investigates techniques for combining different fidelity levels, with an emphasis on multi-fidelity surrogate models. Here this work discusses reproducibility, open-sourcing methodologies and benchmarking procedures to promote transparency. The manuscript also includes educational toy problems to enhance understanding. Additionally, this paper outlines best practices for presenting multi-fidelity-related savings in a standardized, succinct and yet thorough manner. The review concludes by examining current trends in multi-fidelity modeling, including emerging techniques, recent advancements, and promising research directions.

42 ENGINEERING↗

Efficient solutions of two-dimensional incompressible steady viscous flows

A simple, efficient, and robust numerical technique is provided for solving two dimensional incompressible steady viscous flows at moderate to high Reynolds numbers. The proposed approach employs an incremental multigrid method and an extrapolation procedure based on minimum residual concepts to accelerate the convergence rate of a robust block-line-Gauss-Seidel solver for the vorticity-stream function Navier-Stokes equations. Results are presented for the driven cavity flow problem using uniform and nonuniform grids and for the flow past a backward facing step in a channel. For this second problem, mesh refinement and Richardson extrapolation are used to obtain useful benchmark solutions in the full range of Reynolds numbers at which steady laminar flow is established.

Morrison, J. H.↗

Efficient solutions of two-dimensional incompressible steady viscous flows

A simple, efficient, and robust numerical technique is provided for solving two dimensional incompressible steady viscous flows at moderate to high Reynolds numbers. The proposed approach employs an incremental multigrid method and an extrapolation procedure based on minimum residual concepts to accelerate the convergence rate of a robust block-line-Gauss-Seidel solver for the vorticity-stream function Navier-Stokes equations. Results are presented for the driven cavity flow problem using uniform and nonuniform grids and for the flow past a backward facing step in a channel. For this second problem, mesh refinement and Richardson extrapolation are used to obtain useful benchmark solutions in the full range of Reynolds numbers at which steady laminar flow is established.

Morrison, J. H.↗

Self-growing neural network architecture using crisp and fuzzy entropy

The paper briefly describes the self-growing neural network algorithm, CID3, which makes decision trees equivalent to hidden layers of a neural network. The algorithm generates a feedforward architecture using crisp and fuzzy entropy measures. The results for a real-life recognition problem of distinguishing defects in a glass ribbon, and for a benchmark problen of telling two spirals apart are shown and discussed.

Cios, Krzysztof J.↗

A Fuzzy Approach of the Competition on the Air Transport Market

The aim of this communication is to study with a new scope the conditions of the equilibrium in an air transport market where two competitive airlines are operating. Each airline is supposed to adopt a strategy maximizing its profit while its estimation of the demand has a fuzzy nature. This leads each company to optimize a program of its proposed services (frequency of the flights and ticket prices) characterized by some fuzzy parameters. The case of monopoly is being taken as a benchmark. Classical convex optimization can be used to solve this decision problem. This approach provides the airline with a new decision tool where uncertainty can be taken into account explicitly. The confrontation of the strategies of the companies, in the ease of duopoly, leads to the definition of a fuzzy equilibrium. This concept of fuzzy equilibrium is more general and can be applied to several other domains. The formulation of the optimization problem and the methodological consideration adopted for its resolution are presented in their general theoretical aspect. In the case of air transportation, where the conditions of management of operations are critical, this approach should offer to the manager elements needed to the consolidation of its decisions depending on the circumstances (ordinary, exceptional events,..) and to be prepared to face all possibilities. Keywords: air transportation, competition equilibrium, convex optimization , fuzzy modeling,

Charfeddine, Souhir↗

Bayesian sequential optimal experimental design for nonlinear models using policy gradient reinforcement learning

We present a mathematical framework and computational methods for optimally designing a finite sequence of experiments. This sequential optimal experimental design (sOED) problem is formulated as a finite-horizon partially observable Markov decision process (POMDP) under a Bayesian setting and with information-theoretic utilities. The formulation is general and may accommodate continuous random variables, non-Gaussian posteriors, and nonlinear forward models. The sOED design policy incorporates elements of feedback and lookahead simultaneously, and we show it to generalize the commonly-used batch and greedy design strategies. We solve for the sOED policy using the policy gradient (PG) method from reinforcement learning, and provide a derivation for the PG expression in the sOED context. Adopting an actor-critic approach, the policy and value functions are parameterized using deep neural networks and improved via PG estimates produced from simulated episodes of designs and observations. The new PG-sOED algorithm is first validated on a linear-Gaussian benchmark, and then compared against other design baselines on a sensor movement problem for contaminant source inversion in a convection-diffusion field. As a result, we provide explanation for the policy behaviors using knowledge of the underlying physical process.

97 MATHEMATICS AND COMPUTING↗

Containerless Ripple Turbulence

One of the longest standing unsolved problems in physics relates to the behavior of fluids that are driven far from equilibrium such as occurs when they become turbulent due to fast flow through a grid or tidal motions. In turbulent flows the distribution of vortex energy as a function of the inverse length scale [or wavenumber 'k'] of motion is proportional to 1/k(sup 5/3) which is the celebrated law of Kolmogorov. Although this law gives a good description of the average motion, fluctuations around the average are huge. This stands in contrast with thermally activated motion where large fluctuations around thermal equilibrium are highly unfavorable. The problem of turbulence is the problem of understanding why large fluctuations are so prevalent which is also called the problem of 'intermittency'. Turbulence is a remarkable problem in that its solution sits simultaneously at the forefront of physics, mathematics, engineering and computer science. A recent conference [March 2002] on 'Statistical Hydrodynamics' organized by the Los Alamos Laboratory Center for Nonlinear Studies brought together researchers in all of these fields. Although turbulence is generally thought to be described by the Navier-Stokes Equations of fluid mechanics the solution as well as its existence has eluded researchers for over 100 years. In fact proof of the existence of such a solution qualifies for a 1 M$ millennium prize. As part of our NASA funded research we have proposed building a bridge between vortex turbulence and wave turbulence. The latter occurs when high amplitude waves of various wavelengths are allowed to mutually interact in a fluid. In particular we have proposed measuring the interaction of ripples [capillary waves] that run around on the surface of a fluid sphere suspended in a microgravity environment. The problem of ripple turbulence poses similar mathematical challenges to the problem of vortex turbulence. The waves can have a high amplitude and a strong nonlinear interaction. Furthermore, the steady state distribution of energy again follows a Kolmogorov scaling law; in this case the ripple energy is distributed according to 1/k (sup 7/4). Again, in parallel with vortex turbulence ripple turbulence exhibits intermittency. The problem of ripple turbulence presents an experimental opportunity to generate data in a controlled, benchmarked system. In particular the surface of a sphere is an ideal environment to study ripple turbulence. Waves run around the sphere and interact with each other, and the effect of walls is eliminated. In microgravity this state can be realized for over 2 decades of frequency. Wave turbulence is a physically relevant problem in its own right. It has been studied on the surface of liquid hydrogen and its application to Alfven waves in space is a source of debate. Of course, application of wave turbulence perspectives to ocean waves has been a major success. The experiment which we plan to run in microgravity is conceptually straightforward. Ripples are excited on the surface of a spherical drop of fluid and then their amplitude is recorded with appropriate photography. A key challenge is posed by the need to stably position a 10cm diameter sphere of water in microgravity. Two methods are being developed. Orbitec is using controlled puffs of air from at least 6 independent directions to provided the positioning force. This approach has actually succeeded to position and stabilize a 4cm sphere during a KC 135 segment. Guigne International is using the radiation pressure of high frequency sound. These transducers have been organized into a device in the shape of a dodecahedron. This apparatus 'SPACE DRUMS' has already been approved for use for combustion synthesis experiments on the International Space Station. A key opportunity presented by the ripple turbulence data is its use in driving the development of codes to simulate its properties.

Putterman, Seth↗

A real-time algorithm for the harmonic estimation and frequency tracking of dominant components in fusion plasma magnetic diagnostics

The real-time tracking of instantaneous quantities such as frequency, amplitude, and phase of components immerse in noisy signals has been a common problem in many scientific and engineering fields such as power systems and delivery, telecommunications, and acoustics for the past decades. In magnetically confined fusion research, extracting this sort of information from magnetic signals can be of valuable assistance in, for instance, feedback control of detrimental magnetohydrodynamic modes and disruption avoidance mechanisms by monitoring instability growth or anticipating mode-locking events. This work is focused on nonlinear Kalman filter based methods for tackling this problem. Similar methods have already proven their merits and have been successfully employed in this scientific domain in applications such as amplitude demodulation for the motional Stark effect diagnostic. In the course of this work, three approaches are described, compared, and discussed using magnetic signals from the Joint European Torus tokamak plasma discharges for benchmarking purposes.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Linear and nonlinear verification of gyrokinetic microstability codes

Verification of nonlinear microstability codes is a necessary step before comparisons or predictions of turbulent transport in toroidal devices can be justified. By verification we mean demonstrating that a code correctly solves the mathematical model upon which it is based. Some degree of verification can be accomplished indirectly from analytical instability threshold conditions, nonlinear saturation estimates, etc., for relatively simple plasmas. However, verification for experimentally relevant plasma conditions and physics is beyond the realm of analytical treatment and must rely on code-to-code comparisons, i.e., benchmarking. The premise is that the codes are verified for a given problem or set of parameters if they all agree within a specified tolerance. True verification requires comparisons for a number of plasma conditions, e.g., different devices, discharges, times, and radii. Running the codes and keeping track of linear and nonlinear inputs and results for all conditions could be prohibitive unless there was some degree of automation. We have written software to do just this and have formulated a metric for assessing agreement of nonlinear simulations. We present comparisons, both linear and nonlinear, between the gyrokinetic codes GYRO[J. Candy and R. E. Waltz, J. Comput. Phys. 186, 545 (2003)] and GS2[W. Dorland, F. Jenko, M. Kotschenreuther, and B. N. Rogers, Phys. Rev. Lett. 85, 5579 (2000)]. We do so at the mid-radius for the same discharge as in earlier work [C. Holland, A. E. White, G. R. McKee, M. W. Shafer, J. Candy, R. E. Waltz, L. Schmitz, and G. R. Tynan, Phys. Plasmas 16, 052301 (2009)]. The comparisons include electromagnetic fluctuations, passing and trapped electrons, plasma shaping, one kinetic impurity, and finite Debye-length effects. Results neglecting and including electron collisions (Lorentz model) are presented. We find that the linear frequencies with or without collisions agree well between codes, as do the time averages of the nonlinear fluxes without collisions. With collisions, the differences between the time-averaged fluxes are larger than the uncertainties defined as the oscillations of the fluxes, with the GS2 fluxes consistently larger (or more positive) than those from GYRO. However, the electrostatic fluxes are much smaller than those without collisions (the electromagnetic energy flux is negligible in both cases). In fact, except for the electron energy fluxes, the absolute magnitudes of the differences in fluxes with collisions are the same or smaller than those without. None of the fluxes exhibit large absolute differences between codes. Beyond these results, the specific linear and nonlinear benchmarks proposed here, as well as the underlying methodology, provide the basis for a wide variety of future verification efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Discontinuous finite element space-angle treatment of the first order linear Boltzmann transport equation with magnetic fields: Application to MRI-guided radiotherapy

Purpose: The advent of magnetic resonance imaging (MRI) guided radiotherapy systems demands the incorporation of the magnetic field into dose calculation algorithms of treatment planning systems. This is due to the fact that the Lorentz force of the magnetic field perturbs the path of the relativistic electrons, hence altering the dose deposited by them. Building on the previous work, the authors have developed a discontinuous finite element space-angle treatment of the linear Boltzmann transport equation to accurately account for the effects of magnetic fields on radiotherapy doses. Methods: The authors present a detailed description of their new formalism and compare its accuracy to GEANT4 Monte Carlo calculations for magnetic fields parallel and perpendicular to the radiation beam at field strengths of 0.5 and 3 T for an inhomogeneous 3D slab geometry phantom comprising water, bone, and air or lung. The accuracy of the authors’ new formalism was determined using a gamma analysis with a 2%/2 mm criterion. Results: Greater than 98.9% of all points analyzed passed the 2%/2 mm gamma criterion for the field strengths and orientations tested. The authors have benchmarked their new formalism against Monte Carlo in a challenging radiation transport problem with a high density material (bone) directly adjacent to a very low density material (dry air at STP) where the effects of the magnetic field dominate collisions. Conclusions: A discontinuous finite element space-angle approach has been proven to be an accurate method for solving the linear Boltzmann transport equation with magnetic fields for cases relevant to MRI guided radiotherapy. The authors have validated the accuracy of this novel technique against GEANT4, even in cases of strong magnetic field strengths and low density air.

61 RADIATION PROTECTION AND DOSIMETRY↗

Experimental/Analytical Characterization of the RBCC Rocket-Ejector Mode

The experimental/analytical research work described here addresses the rocket-ejector mode (Mach 0-2 operational range) of the RBCC engine. The experimental phase of the program includes studying the mixing and combustion characteristics of the rocket-ejector system utilizing state-of-the-art diagnostic techniques. A two-dimensional variable geometry rocket-ejector system with enhanced optical access was utilized as the experimental platform. The goals of the experimental phase of the research being conducted at Penn State are to: (a) systematically increase the range of rocket-ejector understanding over a wide range of flow/geometry parameters and (b) provide a comprehensive data base for evaluating and anchoring CFD codes. Concurrent with the experimental activities, a CFD code benchmarking effort at Marshall Space Flight Center is also being used to further investigate the RBCC rocket-ejector mode. Experiments involving the single rocket based optically-accessible rocket-ejector system have been conducted for Diffusion and Afterburning (DAB) as well as Simultaneous Mixing and Combustion configurations. For the DAB configuration, air is introduced (direct-connect) or ejected (sea-level static) into a constant area mixer section with a centrally located gaseous oxygen (GO2)/gaseous hydrogen (GH2) rocket combustor. The downstream flowpath for this configuration includes a diffuser, an afterburner and a final converging nozzle. For the SMC configuration, the rocket is centrally located in a slightly divergent duct. For all tested configurations, global measurements of the axial pressure and heat transfer profiles as well as the overall engine thrust were made. Detailed measurements include major species concentration (H2 O2 N2 and H2O) profiles at various mixer locations made using Raman spectroscopy. Complementary CFD calculations of the flowfield at the experimental conditions also provide additional information on the physics of the problem. These calculations are being conducted at Marshall Space Flight Center to benchmark the FDNS code for RBCC engine operations for such configurations. The primary fluid physics of interests are the mixing and interaction of the rocket plume and secondary flow, subsequent combustion of the fuel rich rocket exhaust with the secondary flow and combustion of the injected afterburner flow. The CFD results are compared to static pressure along the RBCC duct walls, Raman Spectroscopy specie distribution data at several axial locations, net engine thrust and entrained air for the SLS cases. The CFD results compare reasonably well with the experimental results.

Ruf, J. H.↗

Surface hopping with a manifold of electronic states. I. Incorporating surface-leaking to capture lifetimes

We investigate the incorporation of the surface-leaking (SL) algorithm into Tully’s fewest-switches surface hopping (FSSH) algorithm to simulate some electronic relaxation induced by an electronic bath in conjunction with some electronic transitions between discrete states. The resulting SL-FSSH algorithm is benchmarked against exact quantum scattering calculations for three one-dimensional model problems. The results show excellent agreement between SL-FSSH and exact quantum dynamics in the wide band limit, suggesting the potential for a SL-FSSH algorithm. Discrepancies and failures are investigated in detail to understand the factors that will limit the reliability of SL-FSSH, especially the wide band approximation. Considering the easiness of implementation and the low computational cost, we expect this method to be useful in studying processes involving both a continuum of electronic states (where electronic dynamics are probabilistic) and processes involving only a few electronic states (where non-adiabatic processes cannot ignore short-time coherence)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Can I/O Variability Be Reduced on QoS-Less HPC Storage Systems?

For a production high-performance computing (HPC) system, where storage devices are shared between multiple applications and managed in a best effort manner, I/O contention is often a major problem. In this paper, we propose a balanced messaging-based re-routing in conjunction with throttling at the middleware level. This work tackles two key challenges that have not been fully resolved in the past: whether I/O variability can be reduced on a QoS-less HPC storage system, and how to design a runtime scheduling system that can scale up to a large amount of cores. The proposed scheme uses a two-level messaging system to re-route I/O requests to a less congested storage location so that write performance is improved, while limiting the impact on read by throttling re-routing. An analytical model is derived to guide the setup of optimal throttling factor. We thoroughly analyze the virtual messaging layer overhead and explore whether the in-transit buffering is effective in managing I/O variability. Contrary to the intuition, in-transit buffer cannot completely solve the problem. It can reduce the absolute variability but not the relative variability. The proposed scheme is verified against a synthetic benchmark as well as being used by production applications.

Huang, Dan↗

3-regular three-XORSAT planted solutions benchmark of classical and quantum heuristic optimizers

With current semiconductor technology reaching its physical limits, special-purpose hardware has emerged as an option to tackle specific computing-intensive challenges. Optimization in the form of solving quadratic unconstrained binary optimization problems, or equivalently Ising spin glasses, has been the focus of several new dedicated hardware platforms. These platforms come in many different flavors, from highly-efficient hardware implementations on digital-logic of established algorithms to proposals of analog hardware implementing new algorithms. In this work, we use a mapping of a specific class of linear equations whose solutions can be found efficiently, to a hard constraint satisfaction problem (three-regular three-XORSAT, or an Ising spin glass) with a 'golf-course' shaped energy landscape, to benchmark several of these different approaches. We perform a scaling and prefactor analysis of the performance of Fujitsu's digital annealer unit (DAU), the D-Wave advantage quantum annealer, a virtual MemComputing machine, Toshiba's simulated bifurcation machine (SBM), the SATonGPU algorithm from Bernaschi et al, and our implementation of parallel tempering. We identify the SATonGPU and DAU as currently having the smallest scaling exponent for this benchmark, with SATonGPU having a small scaling advantage and in addition having by far the smallest prefactor thanks to its use of massive parallelism. Furthermore, our work provides an objective assessment and a snapshot of the promise and limitations of dedicated optimization hardware relative to a particular class of optimization problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Posiform planting: generating QUBO instances for benchmarking

We are interested in benchmarking both quantum annealing and classical algorithms for minimizing quadratic unconstrained binary optimization (QUBO) problems. Such problems are NP-hard in general, implying that the exact minima of randomly generated instances are hard to find and thus typically unknown. While brute forcing smaller instances is possible, such instances are typically not interesting due to being too easy for both quantum and classical algorithms. In this contribution, we propose a novel method, called posiform planting , for generating random QUBO instances of arbitrary size with known optimal solutions, and use those instances to benchmark the sampling quality of four D-Wave quantum annealers utilizing different interconnection structures (Chimera, Pegasus, and Zephyr hardware graphs) and the simulated annealing algorithm. Posiform planting differs from many existing methods in two key ways. It ensures the uniqueness of the planted optimal solution, thus avoiding groundstate degeneracy, and it enables the generation of QUBOs that are tailored to a given hardware connectivity structure, provided that the connectivity is not too sparse. Posiform planted QUBOs are a type of 2-SAT boolean satisfiability combinatorial optimization problems. Our experiments demonstrate the capability of the D-Wave quantum annealers to sample the optimal planted solution of combinatorial optimization problems with up to 5, 627 qubits.

97 MATHEMATICS AND COMPUTING↗

Adaptive variational quantum minimally entangled typical thermal states for finite temperature simulations

Scalable quantum algorithms for the simulation of quantum many-body systems in thermal equilibrium are important for predicting properties of quantum matter at finite temperatures. Here we describe and benchmark a quantum computing version of the minimally entangled typical thermal states (METTS) algorithm for which we adopt an adaptive variational approach to perform the required quantum imaginary time evolution. The algorithm, which we name AVQMETTS, dynamically generates compact and problem-specific quantum circuits, which are suitable for noisy intermediate-scale quantum (NISQ) hardware. We benchmark AVQMETTS on statevector simulators and perform thermal energy calculations of integrable and nonintegrable quantum spin models in one and two dimensions and demonstrate an approximately linear system-size scaling of the circuit complexity. We further map out the finite-temperature phase transition line of the two-dimensional transverse field Ising model. Finally, we study the impact of noise on AVQMETTS calculations using a phenomenological noise model.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A compatible high-order meshless method for the Stokes equations with applications to suspension flows

A stable numerical solution of the steady Stokes problem requires compatibility between the choice of velocity and pressure approximation that has traditionally proven problematic for meshless methods. Here in this work, we present a discretization that couples a staggered scheme for pressure approximation with a divergence-free velocity reconstruction to obtain an adaptive, high-order, finite difference-like discretization that can be efficiently solved with conventional algebraic multigrid techniques. We use analytic benchmarks to demonstrate equal-order convergence for both velocity and pressure when solving problems with curvilinear geometries. In order to study problems in dense suspensions, we couple the solution for the flow to the equations of motion for freely suspended particles in an implicit monolithic scheme. The combination of high-order accuracy with fully-implicit schemes allows the accurate resolution of stiff lubrication forces directly from the solution of the Stokes problem without the need to introduce sub-grid lubrication models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Benchmarking numerical methods for impact and cratering applications

Large scale computational models are important for studying impact cratering events that are prevalent both on Earth and, more broadly, in this solar system. To address these problems, models must reliably account for both large length scales (e.g., kilometers) and relatively long time scales (hundreds of seconds). This work benchmarks two such approaches, a more traditional hydrodynamics approach and a finite-discrete element method (FDEM), for impact cratering applications. Both 2D and 3D results are discussed for two different impact velocities, 5 km/s and 20 km/s, striking normal to the target and, for 3D simulations, 45° from vertical. In addition, comparisons to previously published data are presented. Finally, differences in how these methods model damage are discussed. Ultimately, both approaches show successful modeling of several different impact scenarios.

58 GEOSCIENCES↗