Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Line coupling effects in the isotropic Raman spectra of N{sub 2}: A quantum calculation at room temperature

We present quantum calculations of the relaxation matrix for the Q branch of N{sub 2} at room temperature using a recently proposed N{sub 2}-N{sub 2} rigid rotor potential. Close coupling calculations were complemented by coupled states studies at high energies and provide about 10 200 two-body state-to state cross sections from which the needed one-body cross-sections may be obtained. For such temperatures, convergence has to be thoroughly analyzed since such conditions are close to the limit of current computational feasibility. This has been done using complementary calculations based on the energy corrected sudden formalism. Agreement of these quantum predictions with experimental data is good, but the main goal of this work is to provide a benchmark relaxation matrix for testing more approximate methods which remain of a great utility for complex molecular systems at room (and higher) temperatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Benchmark between antenna code TOPICA, RAPLICASOL and Petra-M for the ICRH ITER antenna

ITER will be equipped with three plasma heating systems: neutral beam (NB), electron cyclotron (EC), and ion cy-clotron resonance heating (ICRH). The latter consists of two identical ICRH antennas to deliver 20 MW to the plasma (baseline, upgradable to 40 MW). ICRH will play a crucial role in the ignition and sustainment of burning plasmas in ITER. A high fidelity and robust modeling effort to understand the interaction of the IC waves with the scrape-off-layer (SOL) plasma is a very important aspect. Among the main important research topics, we have the assessment of the antenna loading for different plasma scenarios, the role of the lower hybrid resonance in front of the antenna and how to include it in our models, and the RF sheath boundary conditions to evaluate the antenna impurity generation. In this work, we tackle the first of these by reporting on ICRF simulations employing the Petra-M code, which is an electromagnetic simulation tool for modeling RF wave propagation based on MFEM [http://mfem.org] for the ITER ICRH antenna. Moreover, a benchmark between the well tested antenna codes TOPICA, RAPLI-CASOL, which is based on COMSOL [www.comsol.com], and the Petra-M code is also presented. In conclusion, S- and Z-matrices and wave electric field are compared showing an excellent agreement among these codes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Taming the virtual space for incremental full configuration interaction

Incremental full configuration interaction (iFCI) closely approximates the FCI limit with polynomial cost through a many-body expansion of the correlation energy, providing highly accurate total energies within a given basis set. To extend iFCI beyond previous basis set limitations, this work introduces a novel natural orbital (NO) screening approach, incremental NO full configuration interaction (iNO-FCI). By consideration of the importance of virtual orbital selection in the convergence of iFCI, iNO-FCI maximizes the consistency between orbitals selected for each correlated body. iNO-FCI employs a principle of cancellation of errors and ensures that the same set of virtual NOs is used for interdependent terms. Here, this strategy significantly reduces computational cost without compromising precision. Computational savings of up to 95% are demonstrated, allowing access to larger basis sets that were previously computationally prohibitive. iNO-FCI is herein introduced and benchmarked for several difficult test cases involving double-bond dissociation, biradical systems, conjugated π systems, and the spin gap of a Cu-based transition metal complex.

Correlation energy↗

Simulated Stochastic Approximation Annealing for Global Optimization with a Square-Root Cooling Schedule

Simulated annealing has been widely used in the solution of optimization problems. As known by many researchers, the global optima cannot be guaranteed to be located by simulated annealing unless a logarithmic cooling schedule is used. However, the logarithmic cooling schedule is so slow that no one can afford to have such a long CPU time. This paper proposes a new stochastic optimization algorithm, the so-called simulated stochastic approximation annealing algorithm, which is a combination of simulated annealing and the stochastic approximation Monte Carlo algorithm. Under the framework of stochastic approximation Markov chain Monte Carlo, it is shown that the new algorithm can work with a cooling schedule in which the temperature can decrease much faster than in the logarithmic cooling schedule, e.g., a square-root cooling schedule, while guaranteeing the global optima to be reached when the temperature tends to zero. The new algorithm has been tested on a few benchmark optimization problems, including feed-forward neural network training and protein-folding. The numerical results indicate that the new algorithm can significantly outperform simulated annealing and other competitors.

Liang, Faming↗

Combining protein sequences and structures with transformers and equivariant graph neural networks to predict protein function

Abstract Motivation Millions of protein sequences have been generated by numerous genome and transcriptome sequencing projects. However, experimentally determining the function of the proteins is still a time consuming, low-throughput, and expensive process, leading to a large protein sequence-function gap. Therefore, it is important to develop computational methods to accurately predict protein function to fill the gap. Even though many methods have been developed to use protein sequences as input to predict function, much fewer methods leverage protein structures in protein function prediction because there was lack of accurate protein structures for most proteins until recently. Results We developed TransFun—a method using a transformer-based protein language model and 3D-equivariant graph neural networks to distill information from both protein sequences and structures to predict protein function. It extracts feature embeddings from protein sequences using a pre-trained protein language model (ESM) via transfer learning and combines them with 3D structures of proteins predicted by AlphaFold2 through equivariant graph neural networks. Benchmarked on the CAFA3 test dataset and a new test dataset, TransFun outperforms several state-of-the-art methods, indicating that the language model and 3D-equivariant graph neural networks are effective methods to leverage protein sequences and structures to improve protein function prediction. Combining TransFun predictions and sequence similarity-based predictions can further increase prediction accuracy. Availability and implementation The source code of TransFun is available at https://github.com/jianlin-cheng/TransFun.

59 BASIC BIOLOGICAL SCIENCES↗

A general Bayesian algorithm for the autonomous alignment of beamlines

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional expensive-to-sample optimization problem involving the simultaneous treatment of many optical elements with correlated and nonlinear dynamics. Bayesian optimization is a strategy of efficient global optimization that has proved successful in similar regimes in a wide variety of beamline alignment applications, though it has typically been implemented for particular beamlines and optimization tasks. In this paper, we present a basic formulation of Bayesian inference and Gaussian process models as they relate to multi-objective Bayesian optimization, as well as the practical challenges presented by beamline alignment. We show that the same general implementation of Bayesian optimization with special consideration for beamline alignment can quickly learn the dynamics of particular beamlines in an online fashion through hyperparameter fitting with no prior information. We present the implementation of a concise software framework for beamline alignment and test it on four different optimization problems for experiments on X-ray beamlines at the National Synchrotron Light Source II and the Advanced Light Source, and an electron beam at the Accelerator Test Facility, along with benchmarking on a simulated digital twin. We discuss new applications of the framework, and the potential for a unified approach to beamline alignment at synchrotron facilities.

47 OTHER INSTRUMENTATION↗

Coherency-Aware Learning Control of Inverter-Dominated Grids: A Distributed Risk-Constrained Approach

Here, this letter investigates the importance of integrating the coherency knowledge for designing controllers to dampen sustained oscillations in wide-area power networks with significant penetration of inverter-interfaced resources. Coherency is a fundamental property of power systems, where time-scale separation in frequency dynamics leads to clustered behavior among generators of different groups. Large-scale penetration of inverter-driven low inertia resources replacing conventional synchronous generators (SGs) can lead to perturbation in the coherent partitioning; hence, integrating such information is of utmost importance for oscillation control designs. We present the coherency-aware design of a distributed output feedback-based reinforcement learning method that additionally incorporates risk constraints to capture the uncertainties related to net-load fluctuations. The use of domain-aware coherency information has produced improved training and oscillation performance than the coherency-agnostic control design, hence proving to be effective in controller design. Finally, we validated the proposed method with numerical experiments on the benchmark IEEE 68-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

psst: An open-source power system simulation toolbox in Python

This paper is an overview of Power System Simulation Toolbox (psst). psst is an open-source Python application for the simulation and analysis of power system models. psst simulates the wholesale market operation by solving a DC Optimal Power Flow (DCOPF), Security Constrained Unit Commitment (SCUC) and a Security Constrained Economic Dispatch (SCED). psst also includes models for the various entities in a power system such as Generator Companies (GenCos), Load Serving Entities (LSEs) and an Independent System Operator (ISO). psst features an open modular object oriented architecture that will make it useful for researchers to customize, expand, experiment beyond solving traditional problems. psst also includes a web based Graphical User Interface (GUI) that allows for user friendly interaction and for implementation on remote High Performance Computing (HPCs) clusters for parallelized operations. This paper also provides an illustrative application of psst and benchmarks with standard IEEE test cases to show the advanced features and the performance of toolbox.

97 MATHEMATICS AND COMPUTING↗

Enhancing ACPF Analysis: Integrating Newton-Raphson Method with Gradient Descent and Computational Graphs

This paper presents a new method for enhancing Alternating Current Power Flow (ACPF) analysis. The method integrates the Newton-Raphson (NR) method with Enhanced-Gradient Descent (GD) and computational graphs. The integration of renewable energy sources in power systems introduces variability and unpredictability, and this method addresses these challenges. It leverages the robustness of NR for accurate approximations and the flexibility of GD for handling variable conditions, all without requiring Jacobian matrix inversion. Furthermore, computational graphs provide a structured and visual framework that simplifies and systematizes the application of these methods. The goal of this fusion is to overcome the limitations of traditional ACPF methods and improve the resilience, adaptability, and efficiency of modern power grid analyses. We validate the effectiveness of our advanced algorithm through comprehensive testing on established IEEE benchmark systems. Furthermore, our findings demonstrate that our approach not only speeds up the convergence process but also ensures consistent performance across diverse system states, representing a significant advancement in power flow computation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Discontinuous finite element space-angle treatment of the first order linear Boltzmann transport equation with magnetic fields: Application to MRI-guided radiotherapy

Purpose: The advent of magnetic resonance imaging (MRI) guided radiotherapy systems demands the incorporation of the magnetic field into dose calculation algorithms of treatment planning systems. This is due to the fact that the Lorentz force of the magnetic field perturbs the path of the relativistic electrons, hence altering the dose deposited by them. Building on the previous work, the authors have developed a discontinuous finite element space-angle treatment of the linear Boltzmann transport equation to accurately account for the effects of magnetic fields on radiotherapy doses. Methods: The authors present a detailed description of their new formalism and compare its accuracy to GEANT4 Monte Carlo calculations for magnetic fields parallel and perpendicular to the radiation beam at field strengths of 0.5 and 3 T for an inhomogeneous 3D slab geometry phantom comprising water, bone, and air or lung. The accuracy of the authors’ new formalism was determined using a gamma analysis with a 2%/2 mm criterion. Results: Greater than 98.9% of all points analyzed passed the 2%/2 mm gamma criterion for the field strengths and orientations tested. The authors have benchmarked their new formalism against Monte Carlo in a challenging radiation transport problem with a high density material (bone) directly adjacent to a very low density material (dry air at STP) where the effects of the magnetic field dominate collisions. Conclusions: A discontinuous finite element space-angle approach has been proven to be an accurate method for solving the linear Boltzmann transport equation with magnetic fields for cases relevant to MRI guided radiotherapy. The authors have validated the accuracy of this novel technique against GEANT4, even in cases of strong magnetic field strengths and low density air.

61 RADIATION PROTECTION AND DOSIMETRY↗

Implementation of Parallel Adaptive-Krylov Exponential Solvers for Stiff Problems

Recently exponential integrators have been receiving increased attention as a means of solving large stiff systems of ODEs. Preliminary performance analysis demonstrated that exponential integrators hold promise compared to state-of-the-art implicit methods. However, much work remains to be done to understand in detail possible computational advantages these methods may offer in practice. This is particularly true for supercomputer-scale problems as there has been very little work on parallelizing exponential methods. In this paper we describe an implementation of a suite of parallel exponential solvers. Additionally, we present some performance tests on four stiff benchmark problems of a particular adaptive-Krylov exponential propagation iterative Runge--Kutta (EPIRK) method from the suite, and compare efficiency with the Newton--Krylov implicit solver CVODE.

97 MATHEMATICS AND COMPUTING↗

Algebraic Multigrid Benchmark

AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids. It has been derived directly from the BoomerAMG solver in the hypre library, a large linear solvers library that is being developed in the Center for Applied Scientific Computing (CASC) at LLNL and is very similar to the AMG2013 benchmark with additional optimizations. The driver provided in the benchmark can build various test problems. The default problem is a Laplace type problem with a 27-point stencil, which can be scaled up and is designed to solve a very large problem. A second problem simulates a time dependent problem, in which successively various smnllcr systems are solved.

Yang, Ulrike↗

Modeling of Cloud Microphysics: Can We Do Better?

Representation of cloud microphysics is a key aspect of simulating clouds. From the early days of cloud modeling, numerical models have relied on an Eulerian approach for all cloud and thermodynamic and microphysics variables. Over time the sophistication of microphysics schemes has steadily increased, from simple representations of bulk masses of cloud and rain in each grid cell, to including different ice particle types and bulk hydrometeor concentrations, to complex schemes referred to as bin or spectral schemes that explicitly evolve the hydrometeor size distributions within each model grid cell. As computational resources grow, there is a clear trend toward wider use of bin schemes, including their use as benchmarks to develop and test simplified bulk schemes. We argue that continuing on this path brings fundamental challenges difficult to overcome. The Lagrangian particle-based probabilistic approach is a practical alternative in which the myriad of cloud and precipitation particles present in a natural cloud is represented by a judiciously selected ensemble of point particles called superdroplets or superparticles. Here, the advantages of the Lagrangian particle-based approach when compared to the Eulerian bin methodology are explained, and the prospects of applying the method to more comprehensive cloud simulations—for instance, targeting deep convection or frontal cloud systems—are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep-learning-aided forward optical coherence tomography endoscope for percutaneous nephrostomy guidance

Percutaneous renal access is the critical initial step in many medical settings. In order to obtain the best surgical outcome with minimum patient morbidity, an improved method for access to the renal calyx is needed. In our study, we built a forward-view optical coherence tomography (OCT) endoscopic system for percutaneous nephrostomy (PCN) guidance. Porcine kidneys were imaged in our experiment to demonstrate the feasibility of the imaging system. Three tissue types of porcine kidneys (renal cortex, medulla, and calyx) can be clearly distinguished due to the morphological and tissue differences from the OCT endoscopic images. To further improve the guidance efficacy and reduce the learning burden of the clinical doctors, a deep-learning-based computer aided diagnosis platform was developed to automatically classify the OCT images by the renal tissue types. Convolutional neural networks (CNN) were developed with labeled OCT images based on the ResNet34, MobileNetv2 and ResNet50 architectures. Nested cross-validation and testing was used to benchmark the classification performance with uncertainty quantification over 10 kidneys, which demonstrated robust performance over substantial biological variability among kidneys. ResNet50-based CNN models achieved an average classification accuracy of 82.6%±3.0%. The classification precisions were 79%±4% for cortex, 85%±6% for medulla, and 91%±5% for calyx and the classification recalls were 68%±11% for cortex, 91%±4% for medulla, and 89%±3% for calyx. Interpretation of the CNN predictions showed the discriminative characteristics in the OCT images of the three renal tissue types. The results validated the technical feasibility of using this novel imaging platform to automatically recognize the images of renal tissue structures ahead of the PCN needle in PCN surgery.

Wang, Chen↗

Wire-arc Additive Manufacturing Benchmark

This is the dataset associated with the 2022 SRP Additive Manufacturing Prediction Challenge, originally hosted on Github at https://github.com/SRP-AM/SRP_AM_Prediction_Challenge. The benchmark was designed for validating prediction for the temperature history, residual stress, and distortion of an additively manufactured metal part with relatively simple geometry. A calibration problem with the same as-built geometry is provided with measured quantities of interest; including temperature histories at selective locations, post-build residual stress at selective locations, and overall distortion measurements. The challenge problem is presented with a different build sequence (i.e. thermal history). In this dataset, we include the actual recorded calibration and challenge measurements, as well as benchmark template files for testing predictions without incorporating the challenge data. Supplementary files around the materials and setup are available for transparency and reproducibility.

Bachus, Nicholas [UC Davis, Davis, CA]↗

Measurement and Analysis Plan for Investigation of Spent-Fuel Assay Using Lead Slowing-Down Spectroscopy

Under funding from the Department of Energy Office of Nuclear Energy’s Materials, Protection, Accounting, and Control for Transmutation (MPACT) program (formerly the Advanced Fuel Cycle Initiative Safeguards Campaign), Pacific Northwest National Laboratory (PNNL) and Los Alamos National Laboratory (LANL) are collaborating to study the viability of lead slowing-down spectroscopy (LSDS) for spent-fuel assay. Based on the results of previous simulation studies conducted by PNNL and LANL to estimate potential LSDS performance, a more comprehensive study of LSDS viability has been defined. That study includes benchmarking measurements, development and testing of key enabling instrumentation, and continued study of time-spectra analysis methods. This report satisfies the requirements for a PNNL/LANL deliverable that describes the objectives, plans and contributing organizations for a comprehensive three-year study of LSDS for spent-fuel assay. This deliverable was generated largely during the LSDS workshop held on August 25-26, 2009 at Rensselaer Polytechnic Institute (RPI). The workshop itself was a prominent milestone in the FY09 MPACT project and is also described within this report.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Experimental Study and Computational Simulations of Key Pebble Bed Thermo-mechanics Issues for Design and Safety

An experimental and computational study, consisting of modeling and simulation (M&S), of key thermal-mechanical issues affecting the design and safety of pebble-bed (PB) reactors was conducted. The objective was to broaden understanding and experimentally validate thermal-mechanic phenomena of nuclear grade graphite, specifically, spheres in frictional contact as anticipated in the bed under reactor relevant pressures and temperatures. The contact generates graphite dust particulates that can subsequently be transported into the flowing gaseous coolent. Under postulated depressurization transients and with the potential for leaked fission products to be adsorbed onto graphite 'dust', there is the potential for fission products to escape from the primary volume. This is a design safety concern. Furthermore, earlier safety assessment identified the distinct possibility for the dispersed dust to combust in contact with air if sufficient conditions are met. Both of these phenomena were noted as important to design review and containing uncertainty to warrant study. The team designed and conducted two separate effects tests to study and benchmark the potential dust-generation rate, as well as study the conditions under which a dust explosion may occure in a standardized, instrumented explosion chamber.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Ionic Liquids as Multi-Functional Lubricant Additives to Enhance Engine Efficiency (final report NFE-12-03876)

This ORNL-Shell CRADA developed and investigated ionic liquids (ILs) as multifunctional additives for next-generation low-viscosity engine oils. Several groups of oil-miscible ILs were successfully designed and synthesized with high thermal stability, non-corrosiveness, excellent wettability, and most importantly effective anti-scuffing/anti-wear and friction reduction characteristics. Synergistic effects between the common anti-wear additive zinc dialkyldithiophosphate (ZDDP) and a particular group of ILs were discovered with > 30% friction reduction and 70% wear reduction compared with using ZDDP or IL alone. The IL+ZDDP tribofilm distinguishes itself from the IL or ZDDP tribofilms with substantially higher contents of metal phosphates but less metal oxides and sulfur compounds. Notably, it was revealed that the actual concentrations of functional elements on the droplet surface of the oil containing IL+ZDDP are one order magnitude higher than their nominal values. Such significantly increased concentrations of anti-wear agents are presumably expected for the oilsolid interface and believed to be responsible for the superior lubricating performance. A prototype SAE 0W-16 engine oil using a synergistic IL+ZDDP pair as the anti-wear additive has been formulated based on the compatibility between the IL and other additives. Sequence VIE full-scale engine dynamometer tests demonstrated fuel economy improvement (FEI) for this prototype oil and revealed the individual contributions from the lower oil viscosity and reduced boundary friction. The impact of IL and IL+ZDDP on exhaust emission catalyst was investigated using an accelerated small engine aging test and results were benchmarked against ZDDP.

33 ADVANCED PROPULSION SYSTEMS↗