Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Atomic Orbital Implementation of Extended Symmetry-Adapted Perturbation Theory (XSAPT) and Benchmark Calculations for Large Supramolecular Complexes

We report an implementation of extended symmetry-adapted perturbation theory (XSAPT) in the atomic orbital basis, extending this method to systems where the monomers are large. In our “XSAPT(KS)” approach, monomers are described using range-separated Kohn–Sham (KS) density functional theory (DFT), with correct asymptotic behavior set by tuning the range-separation parameter ω in a monomer-specific way. This is accomplished either by conventional ionization potential (IP)-based tuning, in which ω is adjusted to satisfy the condition ε HOMO (ω) = -IP(ω), or else using a “global density-dependent” (GDD) condition, in which ω is fixed based on the size of the exchange hole. The latter procedure affords better results for both total interaction energies and energy components, when used in conjunction with our third-generation pairwise atom–atom dispersion potential (+aiD 3 ). Three-body (triatomic) dispersion terms are found to be important when the monomers are large, and we incorporate these by means of an Axilrod–Teller–Muto term, E disp,3B ATM , which reduces errors in supramolecular interaction energies by about a factor of 2. The XSAPT(KS) + aiD 3 + E disp,3B ATM (ωGDD) approach affords mean absolute errors as low as 1.2 and 4.2 kcal/mol, respectively, for the L7 and S12L benchmark test sets of large dimers. Such errors are comparable to those afforded by far more expensive methods, such as DFT-SAPT, and the closely related second-order perturbation theory with coupled dispersion (MP2C). We also survey the performance of various other quantum-chemical methods for these data sets and identify several semiempirical and DFT-based approaches whose accuracy approaches that of MP2C, at dramatically reduced cost.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2020

The XtalOpt Evolutionary Algorithm for Crystal Structure Prediction

Significant progress has been made in the field of a priori crystal structure prediction, with a number of recent remarkable success stories. Herein, we briefly outline the methods that have been developed for finding the global minimum structure and interesting local minima without the need for experimental information. Focus is placed on describing the XTALOPT evolutionary algorithm (EA) developed in our group towards this end. XTALOPT is published under well-known open-source licenses, and the EA searches can be analyzed via the AVOGADRO chemical editor and visualizer. We describe new algorithmic developments that have made it possible to predict the structures of ever-more complex crystalline lattices. Benchmark tests, which clearly illustrate how the new developments improve the success rate and accelerate the discovery of the global minimum structure, are carried out. Lastly, we describe how XTALOPT has been employed to predict novel ternary hydrides that have the propensity for high-temperature superconductivity under pressure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Inferring Plant Acclimation and Improving Model Generalizability With Differentiable Physics‐Informed Machine Learning of Photosynthesis

Net photosynthesis (A N ) is a key component of the global carbon cycle influencing climate feedback over decadal scales. Although plant acclimation to environmental changes can modify A N , traditional vegetation models in Earth system models (ESMs) often rely on plant functional type (PFT)-specific parameterizations or simplified acclimation assumptions limiting generalizability across time, space, and PFTs. In this study, we developed a differentiable photosynthesis model to learn the environmental dependencies of V c,max25 (maximum carboxylation rate at 25°C, representing photosynthetic capacity), as this genre of hybrid physics-informed machine learning can seamlessly train neural networks and process-based equations together. Compared to PFT-specific parameterization of V c,max25 , learning the environment dependencies of key photosynthetic parameters improved model spatiotemporal generalizability. Applying environmental acclimation to V c,max25 led to substantial variations in global mean A N indicating the need to address acclimation in ESMs. The model effectively captured multivariate observations (V c,max25 , A N , and stomatal conductance (g s )) simultaneously with multivariate constraints, improving generalization across space and PFTs. It also learned sensible acclimation relationships of V c,max25 to different environmental conditions. The model explained more than 54%, 57%, and 62% of the variance of A N , g s , and V c,max25 , respectively, presenting a first global-scale spatial test benchmark of A N and g s . These results highlight the potential for differentiable modeling to enhance process-based modules in ESMs and effectively leverage information from large, multivariate data sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Electromagnetic levitation containerless processing of metallic materials in microgravity: rapid solidification

Space levitation processing allows researchers to conduct benchmark tests in an effort to understand the physical phenomena involved in rapid solidification processing, including alloy thermodynamics, nucleation and growth, heat and mass transfer, solid/liquid interface dynamics, macro- and microstructural evolution, and defect formation. Supported by ground-based investigations, a major thrust is to develop and refine robust computational tools based on theoretical and applied approaches. This work is accomplished in conjunction with experiments designed for precise model validation with application to a broad range of industrial processes.

42 ENGINEERING↗
DOE OSTI2026

Citation network datasets for benchmarking spiking graph neural networks on experimental neuromorphic hardware

Spiking neural networks (SNNs) running on neuromorphic computers offer an energy-efficient alternative for AI tasks. Recently, spiking graph neural networks (S-GNNs) have been shown to produce encouraging results on benchmark citation network datasets such as Cora, CiteSeer, and PubMed for node classification tasks. These S-GNNs were run on SNN simulators only because they contain up to tens of thousands of neurons and up to millions of synapses, translating poorly to neuromorphic hardware. Therefore, in this paper, we create a suite of benchmark datasets from the CiteSeer dataset that can be accommodated on current neuromorphic hardware platforms. Our contribution consists of a collection of three datasets. First, we have an induced subgraph of CiteSeer, which we call MiniSeer, containing 2110 papers, 3604 binary features, and 6 topics. Second, MicroSeer is a very small dataset consisting of 84 papers, 1227 features, and 6 topics. Lastly, BiteSeer is a collection of 15 binary classification datasets. We present creation of these datasets along with accuracies, running times, and spike counts when simulated. We believe that our results in this paper will be used by the neuromorphic community to benchmark, test, and develop neuromorphic hardware and simulators.

Zhu, Kevin [George Mason University, Virginia]↗
DOE OSTI2010

Collisional damping of zonal flows due to finite Larmor radius effects

The collisional damping of seeded ExB zonal flows on the ion Larmor radius scale is studied using a gyrokinetic model. The focus is on flow damping due to finite Larmor radius effects, which cause a v{sub ||}/v anisotropy of the ion distribution function that is damped by ion-ion collisions. The gyrokinetic equations are solved in a slab geometry with no gradients or curvature, and a gyroaveraged Lorentz collision operator that conserves particle number, momentum, and energy is used. The solution of the gyrokinetic equations explores the dependence of the damping rate on the wavelength of the flows and the impact of the collisions on the ion distribution function. These numerical results can be used as a benchmark test during the implementation of finite Larmor radius effects in the collision operator of gyrokinetic codes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2014

A divide-conquer-recombine algorithmic paradigm for large spatiotemporal quantum molecular dynamics simulations

We introduce an extension of the divide-and-conquer (DC) algorithmic paradigm called divide-conquer-recombine (DCR) to perform large quantum molecular dynamics (QMD) simulations on massively parallel supercomputers, in which interatomic forces are computed quantum mechanically in the framework of density functional theory (DFT). In DCR, the DC phase constructs globally informed, overlapping local-domain solutions, which in the recombine phase are synthesized into a global solution encompassing large spatiotemporal scales. For the DC phase, we design a lean divide-and-conquer (LDC) DFT algorithm, which significantly reduces the prefactor of the O(N) computational cost for N electrons by applying a density-adaptive boundary condition at the peripheries of the DC domains. Our globally scalable and locally efficient solver is based on a hybrid real-reciprocal space approach that combines: (1) a highly scalable real-space multigrid to represent the global charge density; and (2) a numerically efficient plane-wave basis for local electronic wave functions and charge density within each domain. Hybrid space-band decomposition is used to implement the LDC-DFT algorithm on parallel computers. A benchmark test on an IBM Blue Gene/Q computer exhibits an isogranular parallel efficiency of 0.984 on 786 432 cores for a 50.3 × 10{sup 6}-atom SiC system. As a test of production runs, LDC-DFT-based QMD simulation involving 16 661 atoms is performed on the Blue Gene/Q to study on-demand production of hydrogen gas from water using LiAl alloy particles. As an example of the recombine phase, LDC-DFT electronic structures are used as a basis set to describe global photoexcitation dynamics with nonadiabatic QMD (NAQMD) and kinetic Monte Carlo (KMC) methods. The NAQMD simulations are based on the linear response time-dependent density functional theory to describe electronic excited states and a surface-hopping approach to describe transitions between the excited states. A series of techniques are employed for efficiently calculating the long-range exact exchange correction and excited-state forces. The NAQMD trajectories are analyzed to extract the rates of various excitonic processes, which are then used in KMC simulation to study the dynamics of the global exciton flow network. This has allowed the study of large-scale photoexcitation dynamics in 6400-atom amorphous molecular solid, reaching the experimental time scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2015

A hybrid framework of first principles molecular orbital calculations and a three-dimensional integral equation theory for molecular liquids: Multi-center molecular Ornstein–Zernike self-consistent field approach

In this study, we reported the development of a new quantum mechanics/molecular mechanics (QM/MM)-type framework to describe chemical processes in solution by combining standard molecular-orbital calculations with a three-dimensional formalism of integral equation theory for molecular liquids (multi-center molecular Ornstein–Zernike (MC-MOZ) method). The theoretical procedure is very similar to the 3D-reference interaction site model self-consistent field (RISM-SCF) approach. Since the MC-MOZ method is highly parallelized for computation, the present approach has the potential to be one of the most efficient procedures to treat chemical processes in solution. Benchmark tests to check the validity of this approach were performed for two solute (solute water and formaldehyde) systems and a simple S{sub N}2 reaction (Cl{sup −} + CH{sub 3}Cl → ClCH{sub 3} + Cl{sup −}) in aqueous solution. The results for solute molecular properties and solvation structures obtained by the present approach were in reasonable agreement with those obtained by other hybrid frameworks and experiments. In particular, the results of the proposed approach are in excellent agreements with those of 3D-RISM-SCF.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

Machine learning of molecular properties: Locality and active learning

In recent years, the machine learning techniques have shown great potent1ial in various problems from a multitude of disciplines, including materials design and drug discovery. The high computational speed on the one hand and the accuracy comparable to that of density functional theory on another hand make machine learning algorithms efficient for high-throughput screening through chemical and configurational space. However, the machine learning algorithms available in the literature require large training datasets to reach the chemical accuracy and also show large errors for the so-called outliers—the out-of-sample molecules, not well-represented in the training set. In the present paper, we propose a new machine learning algorithm for predicting molecular properties that addresses these two issues: it is based on a local model of interatomic interactions providing high accuracy when trained on relatively small training sets and an active learning algorithm of optimally choosing the training set that significantly reduces the errors for the outliers. We compare our model to the other state-of-the-art algorithms from the literature on the widely used benchmark tests.

Gubaev, Konstantin (ORCID:0000000326128515)↗
DOE OSTI2018

Benchmarking and validation of global model code for negative hydrogen ion sources

Benchmarking and validation are prerequisites for using simulation codes as predictive tools. In this work, we have developed a Global Model for Negative Hydrogen Ion Source (GMNHIS) and performed benchmarking of the GMNHIS against another independently developed code, Global Enhanced Vibrational Kinetic Model (GEVKM). This is the first study to propose a quite comprehensive benchmarking test of this kind for models of negative hydrogen ion sources (NHIS), and excellent agreements have been achieved for collisional energy loss per electron-ion pair created, electron number density, electron temperature, densities of H$^{+}_{3}$ and H$^{+}_{2}$ ions, and densities of H(n = 1–3) atoms. Very small discrepancies in number densities of H - ions and H + ions, as well as the vibrational distribution function of hydrogen molecules, can be attributed to the differences in the chemical reactions datasets. The GEVKM includes additional chemical reactions that are more important at high pressures. Moreover, we validated the GMNHIS against experimental data obtained in an electron cyclotron resonance discharge used for H - production. The model qualitatively (and even quantitatively for certain conditions) reproduces the experimental H - number density. The H - number density as a function of pressure first increases at pressures below 1.6 Pa and then saturates for higher pressures. This dependence was analyzed by evaluating contributions from different reaction pathways to the creation and loss of the H - ions. The developed codes can be used for predicting the H - production, improving the performance of NHIS, and ultimately optimizing the parameters of negative ion beams for fusion reactors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Deep potential generation scheme and simulation protocol for the Li 10 GeP 2 S 12 -type superionic conductors

We report solid-state electrolyte materials with superior lithium ionic conductivities are vital to the next-generation Li-ion batteries. Molecular dynamics could provide atomic scale information to understand the diffusion process of Li-ion in these superionic conductor materials. Here, we implement the deep potential generator to set up an efficient protocol to automatically generate interatomic potentials for Li 10 GeP 2 S 12 -type solid-state electrolyte materials (Li 10 GeP 2 S 12 , Li 10 SiP 2 S 12 , and Li 10 SnP 2 S 12 ). The reliability and accuracy of the fast interatomic potentials are validated. With the potentials, we extend the simulation of the diffusion process to a wide temperature range (300 K–1000 K) and systems with large size (~1000 atoms). Important technical aspects such as the statistical error and size effect are carefully investigated, and benchmark tests including the effect of density functional, thermal expansion, and configurational disorder are performed. The computed data that consider these factors agree well with the experimental results, and we find that the three structures show different behaviors with respect to configurational disorder. Our work paves the way for further research on computation screening of solid-state electrolyte materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Eulerian simulations of electrostatic waves in plasmas with a single sign of charge

An Eulerian, numerical simulation is used to model the launching of plasma waves in a non-neutral plasma that is confined in a Penning–Malmberg trap. The waves are launched by applying an oscillating potential to an electrically isolated sector at one end of the conducting cylinder that bounds the confinement region and are received by another electrically isolated sector at the other end of the cylinder. The launching of both Trivelpiece–Gould waves and electron acoustic waves is investigated. Adopting a stratagem, the simulation captures essential features of the finite length plasma, while retaining the numerical advantages of a simulation employing periodic spatial boundary conditions. As a benchmark test of the simulation, the results for launched Trivelpiece–Gould waves of small amplitude are successfully compared to a linearized analytic solution for these fluctuations.

Physics↗
DOE OSTI2024

Improved deep learning prediction of antigen–antibody interactions

Identifying antibodies that neutralize specific antigens is crucial for developing effective immunotherapies, but this task remains challenging for many target antigens. The rise of deep learning–based computational approaches presents a promising avenue to address this challenge. Here, we assess the performance of a deep learning approach through two benchmark tests aimed at predicting antibodies for the receptor-binding domain of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) spike protein. Three different strategies for constructing input sequence alignments are employed for predicting structural models of antigen–antibody complexes. In our initial testing set, which comprises known experimental structures, these strategies collectively yield a significant top-ranked prediction for 61% of cases and a success rate of 47%. Notably, one strategy that utilizes the sequences of known antigen binders outperforms the other two, achieving a precision of 90% in a subsequent test set of ~1,000 antibodies, balanced between true and control antibodies for the antigen, albeit with a lower recall of 25%. Our results underscore the potential of integrating deep learning methods with single B cell sequencing techniques to enhance the prediction accuracy of antigen–antibody interactions.

Science & Technology - Other Topics↗
DOE OSTI2011

COMPARING NUMERICAL METHODS FOR ISOTHERMAL MAGNETIZED SUPERSONIC TURBULENCE

Many astrophysical applications involve magnetized turbulent flows with shock waves. Ab initio star formation simulations require a robust representation of supersonic turbulence in molecular clouds on a wide range of scales imposing stringent demands on the quality of numerical algorithms. We employ simulations of supersonic super-Alfvenic turbulence decay as a benchmark test problem to assess and compare the performance of nine popular astrophysical MHD methods actively used to model star formation. The set of nine codes includes: ENZO, FLASH, KT-MHD, LL-MHD, PLUTO, PPML, RAMSES, STAGGER, and ZEUS. These applications employ a variety of numerical approaches, including both split and unsplit, finite difference and finite volume, divergence preserving and divergence cleaning, a variety of Riemann solvers, and a range of spatial reconstruction and time integration techniques. We present a comprehensive set of statistical measures designed to quantify the effects of numerical dissipation in these MHD solvers. We compare power spectra for basic fields to determine the effective spectral bandwidth of the methods and rank them based on their relative effective Reynolds numbers. We also compare numerical dissipation for solenoidal and dilatational velocity components to check for possible impacts of the numerics on small-scale density statistics. Finally, we discuss the convergence of various characteristics for the turbulence decay test and the impact of various components of numerical schemes on the accuracy of solutions. The nine codes gave qualitatively the same results, implying that they are all performing reasonably well and are useful for scientific applications. We show that the best performing codes employ a consistently high order of accuracy for spatial reconstruction of the evolved fields, transverse gradient interpolation, conservation law update step, and Lorentz force computation. The best results are achieved with divergence-free evolution of the magnetic field using the constrained transport method and using little to no explicit artificial viscosity. Codes that fall short in one or more of these areas are still useful, but they must compensate for higher numerical dissipation with higher numerical resolution. This paper is the largest, most comprehensive MHD code comparison on an application-like test problem to date. We hope this work will help developers improve their numerical algorithms while helping users to make informed choices about choosing optimal applications for their specific astrophysical problems.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2012

A NEW IMPLEMENTATION OF THE MAGNETOHYDRODYNAMICS-RELAXATION METHOD FOR NONLINEAR FORCE-FREE FIELD EXTRAPOLATION IN THE SOLAR CORONA

The magnetic field in the solar corona is usually extrapolated from a photospheric vector magnetogram using a nonlinear force-free field (NLFFF) model. NLFFF extrapolation needs considerable effort to be devoted to its numerical realization. In this paper, we present a new implementation of the magnetohydrodynamics (MHD) relaxation method for NLFFF extrapolation. The magnetofrictional approach, which is introduced for speeding the relaxation of the MHD system, is realized for the first time by the spacetime conservation-element and solution-element scheme. A magnetic field splitting method is used to further improve the computational accuracy. The bottom boundary condition is prescribed by incrementally changing the transverse field to match the magnetogram, and all other artificial boundaries of the computational box are simply fixed. We examine the code using two types of NLFFF benchmark tests, the Low and Lou semi-analytic force-free solutions and a more realistic solar-like case constructed by van Ballegooijen et al. The results show that our implementation is successful and versatile for extrapolations of either the relatively simple cases or the rather complex cases that need significant rebuilding of the magnetic topology, e.g., a flux rope. We also compute a suite of metrics to quantitatively analyze the results and demonstrate that the performance of our code in extrapolation accuracy basically reaches the same level of the present best-performing code, i.e., that developed by Wiegelmann.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Integrating AlphaFold and deep learning for atomistic interpretation of cryo-EM maps

Abstract Interpretation of cryo-electron microscopy (cryo-EM) maps requires building and fitting 3D atomic models of biological molecules. AlphaFold-predicted models generate initial 3D coordinates; however, model inaccuracy and conformational heterogeneity often necessitate labor-intensive manual model building and fitting into cryo-EM maps. In this work, we designed a protein model-building workflow, which combines a deep-learning cryo-EM map feature enhancement tool, CryoFEM (Cryo-EM Feature Enhancement Model) and AlphaFold. A benchmark test using 36 cryo-EM maps shows that CryoFEM achieves state-of-the-art performance in optimizing the Fourier Shell Correlations between the maps and the ground truth models. Furthermore, in a subset of 17 datasets where the initial AlphaFold predictions are less accurate, the workflow significantly improves their model accuracy. Our work demonstrates that the integration of modern deep learning image enhancement and AlphaFold may lead to automated model building and fitting for the atomistic interpretation of cryo-EM maps.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

CHARMM-GUI Glycan Modeler for modeling and simulation of carbohydrates and glycoconjugates

Characterizing glycans and glycoconjugates in the context of three-dimensional structures is important in understanding their biological roles and developing efficient therapeutic agents. Computational modeling and molecular simulation have become an essential tool complementary to experimental methods. In this work, we present a computational tool, Glycan Modeler for in silico N–/O –glycosylation of the target protein and generation of carbohydrate-only systems. In our previous study, we developed Glycan Reader , a web-based tool for detecting carbohydrate molecules from a PDB structure and generation of simulation system and input files. As integrated into Glycan Reader in CHARMM-GUI, Glycan Modeler (Glycan Reader & Modeler) enables to generate the structures of glycans and glycoconjugates for given glycan sequences and glycosylation sites using PDB glycan template structures from Glycan Fragment Database (http://glycanstructure.org/fragment-db). Our benchmark tests demonstrate the universal applicability of Glycan Reader & Modeler to various glycan sequences and target proteins. We also investigated the structural properties of modeled glycan structures by running 2-μs molecular dynamics simulations of HIV envelope protein. The simulations show that the modeled glycan structures built by Glycan Reader & Modeler have the similar structural features compared to the ones solved by X-ray crystallography. We also describe the representative examples of glycoconjugate modeling with video demos to illustrate the practical applications of Glycan Reader & Modeler . Glycan Reader & Modeler is freely available at http://charmm-gui.org/input/glycan.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Tree-based solvers for adaptive mesh refinement code $\scriptsize{FLASH}$ – IV. An X-ray radiation scheme to couple discrete and diffuse X-ray emission sources to the thermochemistry of the interstellar medium

X-ray radiation, in particular radiation between 0.1 and 10 keV, is evident from both point-like sources, such as compact objects and T-Tauri young stellar objects, and extended emission from hot, cooling gas, such as in supernova remnants. The X-ray radiation is absorbed by nearby gas, providing a source of both heating and ionization. While protoplanetary chemistry models now often include X-ray emission from the central young stellar object, simulations of star-forming regions have yet to include X-ray emission coupled to the chemo-dynamical evolution of the gas. We present an extension of the $\scriptsize{TREERAY}$ reverse ray trace algorithm implemented in the flash magnetohydrodynamic code which enables the inclusion of X-ray radiation from 0.1 keV < E γ < 100 keV, dubbed $\scriptsize{XRAYTHESPOT}$. $\scriptsize{XRAYTHESPOT}$ allows for the use of an arbitrary number of bins, minimum and maximum energies, and both temperature-independent and temperature-dependent user-defined cross-sections, along with the ability to include both point and extended diffuse emission and is coupled to the thermochemical evolution. We demonstrate the method with several multibin benchmarks testing the radiation transfer solution and coupling to the thermochemistry. Finally, we show two example star formation science cases for this module: X-ray emission from protostellar accretion irradiating an accretion disc and simulations of molecular clouds with active chemistry, radiation pressure, and protostellar radiation feedback from infrared to X-ray radiation.

79 ASTRONOMY AND ASTROPHYSICS↗