Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark problem”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

Regarding the use and misuse of retinal protonated Schiff base photochemistry as a test case for time-dependent density-functional theory

The excited-state relaxation of retinal protonated Schiff bases (PSBs) is an important test case for biological applications of time-dependent (TD) density-functional theory (DFT). While well-known shortcomings of approximate TD-DFT might seem discouraging for application to PSB relaxation, progress continues to be made in the development of new functionals and of criteria allowing problematic excitations to be identified within the framework of TD-DFT itself. Furthermore, experimental and theoretical ab initio advances have recently lead to a revised understanding of retinal PSB photochemistry, calling for a reappraisal of the performance of TD-DFT in describing this prototypical photoactive system. Here, we re-investigate the performance of functionals in (TD-)DFT calculations in light of these new benchmark results, which we extend to larger PSB models. We focus on the ability of the functionals to describe primarily the early skeletal relaxation of the chromophore and investigate how far along the out-of-plane pathways these functionals are able to describe the subsequent rotation around formal single and double bonds. Conventional global hybrid and range-separated hybrid functionals are investigated as the presence of Hartree-Fock exchange reduces problems with charge-transfer excitations as determined by the Peach-Benfield-Helgaker-Tozer Λ criterion and by comparison with multi-reference perturbation theory results. While we confirm that most functionals cannot render the complex photobehavior of the retinal PSB, do we also observe that LC-BLYP gives the best description of the initial part of the photoreaction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Beyond the geodesic approximation: Conservative effects of the gravitational self-force in eccentric orbits around a Schwarzschild black hole

We study conservative finite-mass corrections to the motion of a particle in a bound (eccentric) strong-field orbit around a Schwarzschild black hole. We assume the particle's mass {mu} is much smaller than the black hole mass M, and explore post-geodesic corrections of O({mu}/M). Our analysis uses numerical data from a recently developed code that outputs the Lorenz-gauge gravitational self-force (GSF) acting on the particle along the eccentric geodesic. First, we calculate the O({mu}/M) conservative correction to the periastron advance of the orbit, as a function of the (gauge-dependent) semilatus rectum and eccentricity. A gauge-invariant description of the GSF precession effect is made possible in the circular-orbit limit, where we express the correction to the periastron advance as a function of the invariant azimuthal frequency. We compare this relation with results from fully nonlinear numerical-relativistic simulations. In order to obtain a gauge-invariant measure of the GSF effect for fully eccentric orbits, we introduce a suitable generalization of Detweiler's circular-orbit ''redshift'' invariant. We compute the O({mu}/M) conservative correction to this invariant, expressed as a function of the two invariant frequencies that parametrize the orbit. Our results are in good agreement with results from post-Newtonian calculations in the weak-field regime, as we shall report elsewhere. The results of our study can inform the development of analytical models for the dynamics of strongly gravitating binaries. They also provide an accurate benchmark for future numerical-relativistic simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Resilience-Motivated Distribution System Restoration Considering Electricity-Water-Gas Interdependency

A major outage in the electricity distribution system may affect the operation of water and natural gas supply systems, leading to an interruption of multiple services to critical customers. Therefore, enhancing resilience of critical infrastructures requires joint efforts of multiple sectors. In this paper, a distribution system service restoration method considering the electricity-water-gas interdependency is proposed. The objective is maximizing the supply of electricity, water, and gas to critical customers after an extreme event. The operational constraints of electricity, water, and natural gas networks are considered. Additionally, the characteristics of electricity-driven coupling components, including water pumps and gas compressors, are also modeled. Relaxation techniques are applied to non convex constraints posed by physical laws of those networks. Consequently, the restoration problem is formulated as a mixed-integer second-order cone program, which can readily be solved by the off-the-shelf solvers. The proposed method is validated by numerical simulations on an electricity-water-gas integrated system, developed based on benchmark models of the subsystems. The results indicate that considering the interdependency refines the allocation of limited generation resources and demonstrate the exactness of the proposed convex relaxation

24 POWER TRANSMISSION AND DISTRIBUTION↗

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗

Solid Surface Combustion Experiment Yields Significant Observations

The spread of a flame over solid fuel is not only a fundamental textbook combustion phenomenon, but also the central element of destructive fires that cause tragic loss of life and property each year. Throughout history, practical measures to prevent and fight fires have been developed, but these have often been based on lessons learned in a costly fire. Since the 1960 s, scientists and engineers have employed powerful tools of scientific research to understand the details of flame spread and how a material can be rendered nonflammable. High-speed computers have enabled complex flame simulations, whereasand lasers have provided measurements of the chemical composition, temperature, and air velocities inside flames. The microgravity environment has emerged as the third great tool for these studies. Spreading flames are complex combinations of chemical reactions and several physical processes including the transport of oxygen and fuel vapor to the flame and the transfer of heat from the flame to fresh fuel and to the surroundings. Depending on its speed, air motion in the vicinity of the flame can affect the flame in substantially different ways. For example, consider the difference between blowing on a campfire and blowing out a match. On Earth, gravity induces air motion because of buoyancy (the familiar rising hot gases); this process cannot be controlled experimentally. For theoreticians, buoyant air motion complicates the problem modeling of flame spread beyond the capacity of modern computers to simulate. The microgravity environment provides experimental control of air motion near spreading flames, with results that can be compared with detailed theory. The Solid Surface Combustion Experiment (SSCE) was designed to obtain benchmark flame spreading data in quiescent test atmospheres--the limiting case of flames spreading. Professor Robert Altenkirch, Vice President for Research at Mississippi State University, proposed the experiment concept, and the NASA Lewis Research Center designed, built, and tested the SSCE hardware. It was the first microgravity science experiment built by Lewis for the space shuttle and the first combustion science experiment flown in space.

Sacksteder, Kurt R.↗

Reducing the cost of energy estimation in the variational quantum eigensolver algorithm with robust amplitude estimation

Quantum chemistry and materials is one of the most promising applications of quantum computing. Yet much work is still to be done in matching industry-relevant problems in these areas with quantum algorithms that can solve them. Most previous efforts have carried out resource estimations for quantum algorithms run on large-scale fault-tolerant architectures, which include the quantum phase estimation algorithm. In contrast, few have assessed the performance of near-term quantum algorithms, which include the variational quantum eigensolver (VQE) algorithm. Recently, a large-scale benchmark study [Gonthier et al. 2020] found evidence that the performance of the variational quantum eigensolver for a set of industry-relevant molecules may be too inefficient to be of practical use. This motivates the need for developing and assessing methods that improve the efficiency of VQE. In this work, we predict the runtime of the energy estimation subroutine of VQE when using robust amplitude estimation (RAE) to estimate Pauli expectation values. Under conservative assumptions, our resource estimation predicts that RAE can reduce the runtime over the standard estimation method in VQE by one to two orders of magnitude. Despite this improvement, we find that the runtimes are still too large to be practical. These findings motivate two complementary efforts towards quantum advantage: 1) the investigation of more efficient near-term methods for ground state energy estimation and 2) the development of problem instances that are of industrial value and classically challenging, but better suited to quantum computation.

Johnson, Peter D.↗

Parametrization and Benchmark of Long-Range Corrected DFTB2 for Organic Molecules

In this paper, we present the parametrization and benchmark of long-range corrected second-order density functional tight binding (DFTB), LC-DFTB2, for organic and biological molecules. The LC-DFTB2 model not only improves fundamental orbital energy gaps but also ameliorates the DFT self-interaction error and overpolarization problem, and further improves charge-transfer excited states significantly. Electronic parameters for the construction of the DFTB2 Hamiltonian as well as repulsive potentials were optimized for molecules containing C, H, N, and O chemical elements. We use a semiautomatic parametrization scheme based on a genetic algorithm. With the new parameters, LC-DFTB2 describes geometries and vibrational frequencies of organic molecules similarly well as third-order DFTB3/3OB, the de facto standard parametrization based on a GGA functional. Finally, LC-DFTB2 performs well also for atomization and reaction energies, however, slightly less satisfactorily than DFTB3/3OB.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Microbial community-level regulation explains soil carbon responses to long-term litter manipulations

Climatic, atmospheric, and land-use changes all have the potential to alter soil microbial activity, mediated by changes in plant inputs. Many microbial models of soil organic carbon (SOC) decomposition have been proposed recently to advance prediction of climate and carbon (C) feedbacks. Most of these models, however, exhibit unrealistic oscillatory behavior and SOC insensitivity to long-term changes in C inputs. Here we diagnose the source of these problems in four archetypal models and propose a density-dependent formulation of microbial turnover, motivated by community-level interactions, that limits population sizes and reduces oscillations. We compare model predictions to 24 long-term C-input field manipulations and identify key benchmarks. The proposed formulation reproduces soil C responses to long-term C-input changes and implies greater SOC storage associated with CO 2 -fertilization-driven increases in C inputs over the coming century compared to recent microbial models. This study provides a simple modification to improve microbial models for inclusion in Earth System Models.

59 BASIC BIOLOGICAL SCIENCES↗

Linearised Fokker–Planck collision model for gyrokinetic simulations

We introduce a gyrokinetic, linearised Fokker–Planck collision model that satisfies conservation laws and is accurate at arbitrary collisionalities. The differential test-particle component of the operator is exact; the integral field-particle component is approximated using a spherical harmonic and a modified Laguerre polynomial expansion developed by Hirshman and Sigmar (1976 Phys. Fluids 19 1532). The numerical methods of the implementation in the δf-gyrokinetic code stella (Barnes et al 2019 J. Comput. Phys. 391 365–80) are discussed, and conservation properties of the operator are demonstrated. The collision model is then benchmarked against the collision model of the gyrokinetic solver GS2 in the limiting cases of a reduced test-particle collision operator and energy- and momentum-conserving operator. The accuracy of the full collision model is investigated by solving the parallel Spitzer-Härm problem for the transport coefficients. It is shown that retaining collisional energy flux and higher-order terms in the field-particle operator reduces errors in the transport coefficients from 10%–25% for a simple momentum- and energy-conserving model to under 1%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Benchmarking of ENDF/B-VIII.0 cross sections for LWR ex-core transport applications

ENDF/B-VIII.0 cross section data is benchmarked on a simple Monte-Carlo model representative of the ex-core geometry of a PWR used for reactor vessel neutron fluence calculations. The benchmarking indicates that the ENDF/B-VIII.0 results show large differences as compared to previous evaluations, which have been extensively compared to measured data. This exercise suggests that ENDF/B-VIII.0 nuclear data is not suitable for ex-core LWR radiation transport applications. Evaluators are aware of the problems with the ENDF/B-VIII.0 evaluation of iron and work is underway to improve the evaluations for an upcoming release.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Reduced Order Modeling for Prediction and Control of Large-Scale Systems.

This report describes work performed from June 2012 through May 2014 as a part of a Sandia Early Career Laboratory Directed Research and Development (LDRD) project led by the first author. The objective of the project is to investigate methods for building stable and efficient proper orthogonal decomposition (POD)/Galerkin reduced order models (ROMs): models derived from a sequence of high-fidelity simulations but having a much lower computational cost. Since they are, by construction, small and fast, ROMs can enable real-time simulations of complex systems for onthe- spot analysis, control and decision-making in the presence of uncertainty. Of particular interest to Sandia is the use of ROMs for the quantification of the compressible captive-carry environment, simulated for the design and qualification of nuclear weapons systems. It is an unfortunate reality that many ROM techniques are computationally intractable or lack an a priori stability guarantee for compressible flows. For this reason, this LDRD project focuses on the development of techniques for building provably stable projection-based ROMs. Model reduction approaches based on continuous as well as discrete projection are considered. In the first part of this report, an approach for building energy-stable Galerkin ROMs for linear hyperbolic or incompletely parabolic systems of partial differential equations (PDEs) using continuous projection is developed. The key idea is to apply a transformation induced by the Lyapunov function for the system, and to build the ROM in the transformed variables. It is shown that, for many PDE systems including the linearized compressible Euler and linearized compressible Navier-Stokes equations, the desired transformation is induced by a special inner product, termed the “symmetry inner product”. Attention is then turned to nonlinear conservation laws. A new transformation and corresponding energy-based inner product for the full nonlinear compressible Navier-Stokes equations is derived, and it is demonstrated that if a Galerkin ROM is constructed in this inner product, the ROM system energy will be bounded in a way that is consistent with the behavior of the exact solution to these PDEs, i.e., the ROM will be energy-stable. The viability of the linear as well as nonlinear continuous projection model reduction approaches developed as a part of this project is evaluated on several test cases, including the cavity configuration of interest in the targeted application area. In the second part of this report, some POD/Galerkin approaches for building stable ROMs using discrete projection are explored. It is shown that, for generic linear time-invariant (LTI) systems, a discrete counterpart of the continuous symmetry inner product is a weighted L2 inner product obtained by solving a Lyapunov equation. This inner product was first proposed by Rowley et al., and is termed herein the “Lyapunov inner product“. Comparisons between the symmetry inner product and the Lyapunov inner product are made, and the performance of ROMs constructed using these inner products is evaluated on several benchmark test cases. Also in the second part of this report, a new ROM stabilization approach, termed “ROM stabilization via optimization-based eigenvalue reassignment“, is developed for generic LTI systems. At the heart of this method is a constrained nonlinear least-squares optimization problem that is formulated and solved numerically to ensure accuracy of the stabilized ROM. Numerical studies reveal that the optimization problem is computationally inexpensive to solve, and that the new stabilization approach delivers ROMs that are stable as well as accurate. Summaries of “lessons learned“ and perspectives for future work motivated by this LDRD project are provided at the end of each of the two main chapters.

97 MATHEMATICS AND COMPUTING↗

Bayesian Symbolic Regression: Addressing Challenges in Estimating Fractional Bayes Factors and Application to Fatigue Crack Growth Modeling

This research pioneers advancements in computational mechanics by integrating Bayesian-based uncertainty quantification into symbolic regression, specifically focusing on the critical task of accurately estimating the fractional Bayes factor for selecting arbitrary equations. In our exploration, we rigorously study two prominent methods—sequential Monte Carlo and the Laplace approximation—employed for computing the fractional Bayes factor. Our findings underscore the limitations of the Laplace approximation, revealing its diminished accuracy in nonlinear and multimodal scenarios. Specifically, the Laplace approximation is shown to underpredict fractional Bayes factor on a wide set of equations associated with a symbolic regression benchmark. This comparative analysis sheds light on the nuanced performance of these techniques, guiding researchers toward more informed choices in uncertainty quantification within symbolic regression. Furthermore, we showcase the practical utility of these enhanced symbolic regression tools through their application to a real-world problem in fatigue crack growth modeling, emphasizing their efficacy in capturing the complexities of mechanical systems.

Geoffrey Bomarito↗

Benchmarking derivative-free optimization algorithms.

We propose data profiles as a tool for analyzing the performance of derivative-free optimization solvers when there are constraints on the computational budget. We use performance and data profiles, together with a convergence test that measures the decrease in function value, to analyze the performance of three solvers on sets of smooth, noisy, and piecewise-smooth problems. Our results provide estimates for the performance difference between these solvers, and show that on these problems, the model-based solver tested performs better than the two direct search solvers tested.

97 MATHEMATICS AND COMPUTING↗

Exploring the Random Phase Approximation for Materials and Chemical Physics

In this work we test the performance of the fully nonlocal random phase approximation (RPA) for challenging problems in materials chemistry and physics. In this work we assessed the fully nonlocal random phase approximation (RPA) for the delicate energy differences of interest in materials chemistry and physics. The applications in this proposal are challenges for the simpler approximations of Kohn-Sham density functional theory, which are part of the current “standard model” for quantum chemistry and condensed matter physics. Direct RPA includes the full exact exchange energy and a nonlocal correlation energy from the occupied and unoccupied Kohn-Sham orbitals and orbital energies, with an approximate but universal description of long-range van der Waals attraction. RPA still cannot be a benchmark electronic structure method without a correction for its short-range correlation energy which is too deep. The short-range error of RPA can be corrected by a spatially nonlocal, exchange-only kernel. Such kernels could be a more reliable and “intrinsic” approximation to capture accurate ground-state energy differences than the expensive SOSEX and other beyond-RPA corrections. In this project we revealed the strengths and limitations of some model kernels through some materials problems focusing on structural phase transitions and transition metal chemistry. In addition we demonstrated the accuracy of the Renormalized RPA for total correlation energies of simple solids, and the pressure-induced phase transitions.

36 MATERIALS SCIENCE↗

Assessment of the Lagrange Discrete Ordinates Equations for Three-Dimensional Neutron Transport

The Lagrange Discrete Ordinates (LDO) equations, developed by Ahrens as an alternative to the traditional discrete ordinates formulation, have been implemented in Denovo, a threedimensional radiation transport code developed by Oak Ridge National Laboratory. The LDO equations retain the formal structure of the classical discrete ordinates equations but treat particle scattering in a different way. Solutions of the LDO equations have an interpolatory structure such that the angular flux can be naturally evaluated at directions other than the discrete ordinates used in arriving at the solutions, and the ordinates themselves may be chosen in a strategic way for the problem under consideration. Of particular interest is that the LDO equations have been shown to mitigate ray effects at increased angular resolutions. In this paper we present scalar flux solutions of the LDO equations for a small number of test cases of interest and compare the results against flux solutions generated using standard quadrature types. The LDO equations’ flux solutions were found to be comparable to those resultant from the standard quadrature types in value; results from the LDO equations were also found to be commensurate with those of standard quadrature types when comparing the flux solutions in the context of the experimental benchmark test case examined.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Structural, electronic, vibrational, and elastic properties of graphene/ MoS 2 bilayer heterostructures

Graphene/MoS 2 van der Waals (vdW) heterostructures have promising technological applications due to their unique properties and functionalities. Many experimental and theoretical research groups across the globe have made outstanding contributions to benchmark the properties of graphene/MoS 2 heterostructures. Even though some research groups have modeled the graphene/MoS 2 heterostructures using first-principles calculations, there exist several discrepancies in the results from different theoretical research groups and the experimental findings. In the present work, we revisit this problem by means of first-principles calculations and address the existing discrepancies about the interlayer spacing between graphene and MoS 2 monolayers in graphene/MoS 2 heterostructures and about the location of Dirac points near the Fermi level. We further investigate the electronic, mechanical, and vibrational properties of the optimized graphene/MoS 2 heterostructures created using 5 x 5/4 x 4 and 4 x 4/3 x 3 supercell geometries having different magnitudes of lattice mismatch. The effect of the varying interlayer spacing on the electronic properties of heterostructures is discussed. Our phonon calculations reveal that the interlayer shear and breathing phonon modes, which are very sensitive to the weak vdW interactions, play a vital role in describing the thermal properties of the studied systems. The thermodynamic and elastic properties of heterostructures are further discussed. A systematic comparison between our results and the results reported from other research groups is presented.

74 ATOMIC AND MOLECULAR PHYSICS↗

PeleMP: The Multiphysics Solver for the Combustion Pele Adaptive Mesh Refinement Code Suite

Combustion encompasses multiscale, multiphase reacting flow physics spanning a wide range of scales from the molecular scales, where chemical reactions occur, to the device scales, where the turbulent flow is affected by the geometry of the combustor. This scale disparity and the limited measurement capabilities from experiments make modeling combustion a significant challenge. Recent advancements in high-performance computing (HPC), particularly with the Department of Energy's Exascale Computing Project (ECP), have enabled high-fidelity simulations of practical applications to be performed. The major physics submodels, including chemical reactions, turbulence, sprays, soot, and thermal radiation, exhibit distinctive computational characteristics that need to be examined separately to ensure efficient utilization of computational resources. This paper presents the multiphysics solver for the Pele code suite, called PeleMP, which consists of models for spray, soot, and thermal radiation. Here, the mathematical and algorithmic aspects of the model implementations are described in detail as well as the verification process. The computational performance of these models is benchmarked on multiple supercomputers, including Frontier, an exascale machine. Results are presented from production simulations of a turbulent sooting ethylene flame and a bluff-body swirl stabilized spray flame with sustainable aviation fuels to demonstrate the capability of the Pele codes for modeling practical combustion problems with multiphysics. This work is an important step toward the exascale computing era for high-fidelity combustion simulations providing physical insights and data for predictive modeling of real-world devices.

42 ENGINEERING↗

Benchmarking Adiabatic Quantum Optimization for Complex Network Analysis

We lay the foundation for a benchmarking methodology for assessing current and future quantum computers. We pose and begin addressing fundamental questions about how to fairly compare computational devices at vastly different stages of technological maturity. We critically evaluate and offer our own contributions to current quantum benchmarking efforts, in particular those involving adiabatic quantum computation and the Adiabatic Quantum Optimizers produced by D-Wave Systems, Inc. We find that the performance of D-Wave's Adiabatic Quantum Optimizers scales roughly on par with classical approaches for some hard combinatorial optimization problems; however, architectural limitations of D-Wave devices present a significant hurdle in evaluating real-world applications. In addition to identifying and isolating such limitations, we develop algorithmic tools for circumventing these limitations on future D-Wave devices, assuming they continue to grow and mature at an exponential rate for the next several years.

97 MATHEMATICS AND COMPUTING↗