Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Benchmarking collective effects of electron interactions in a wiggler with OPAL-FEL

OPAL-FEL is a recently developed tool for the modeling of particle accelerators containing wigglers or undulators. It extends the well established 3D electrostatic particle-tracking code OPAL, by merging it with the finite-difference time-domain electromagnetic solver MITHRA. We present results of two benchmark cases where OPAL-FEL simulations are compared to experimental results. Both experiments concern electron beamlines where the longitudinal phase space is modulated with a short magnetic wiggler. Good agreement was found in both the space charge and radiation dominated regimes.

43 PARTICLE ACCELERATORS↗

Verification and benchmarking relativistic electron beam transport through a background gas

It is necessary to establish confidence in high-consequence codes containing an extensive suite of physics algorithms in the regimes of interest. Verification problems allow code developers to assess numerical accuracy and increase confidence that specific sets of model physics were implemented correctly in the code. The two main verification techniques are code verification and solution verification. In this work, we present verification problems that can be used in other codes to increase confidence in simulations of relativistic beam transport. Specifically, we use the general plasma code EMPIRE to model and compare with the analytical solution to the evolution of the outer radial envelope of a relativistic charged particle beam. Additionally, we also outline a benchmark test of a relativistic beam propagating through a vacuum and pressurized gas cell, and present the results between EMPIRE and the hybrid code GAZEL. Further, we discuss the subtle errors that were caught with these problems and detail lessons learned.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Decomprolute is a benchmarking platform designed for multiomics-based tumor deconvolution

Tumor deconvolution is a reliable way to disentangle the diverse cell types that comprise solid tumors. To date, however, both the algorithms developed to deconvolve tumor samples, and the gold standard datasets used to assess the algorithms are geared toward the analysis of gene expression (e.g., RNA-seq) rather than protein levels in tumor cells. While gene expression is less expensive to measure, protein levels provide a more accurate view of immune markers. To facilitate the development as well as improve the reproducibility and reusability of multi-omic deconvolution algorithms, we introduce Decomprolute, a Common Workflow Language framework that leverages containerization to compare tumor deconvolution algorithms across multiomic data sets. Decomprolute incorporates the large-scale multiomic data sets produced by the Clinical Proteomic Tumor Analysis Consortium (CPTAC), which include matched mRNA expression and proteomic data from thousands of tumors across multiple cancer types to build a fully open-source, containerized proteogenomic tumor deconvolution benchmarking platform. The platform consists of modular architecture and it comes with well-defined input and output formats at each module. As a result, it is robust and extendable easily with additional algorithms or analyses. The platform is available for access and use at http://pnnl-compbio.github.io/decomprolute.

60 APPLIED LIFE SCIENCES↗

Physics vs structure: A systematic benchmark of learning strategies for multi-zone building thermal dynamics

Recent advances in physics-informed and data-driven machine learning promise improved thermal models for advanced building control, yet there is limited quantitative evidence on when added physics structure and architectural complexity are beneficial. Here, this work presents a systematic benchmark of five representative system identification methods for modeling multi-zone building thermal dynamics: linear state-space models, multi-layer perceptrons, neural state-space models, neural ordinary differential equations, and physically-consistent neural networks. The methods are evaluated across multiple data regimes and zone coupling strategies. Using a high-fidelity multi-zone commercial building emulator, we examine short-term and long-term prediction accuracy, computational efficiency, and ease of development. Our results reveal critical trade-offs between prediction performance, model complexity, and physical consistency. We demonstrate that decoupled, nonlinear black-box models consistently outperform coupled physics-constrained architectures in both predictive accuracy and out-of-distribution robustness in majority of the test cases for the building type considered in the study. Our findings quantify the cost of complexity in building thermal modeling and provide concrete, actionable, scenario-based guidelines for selecting model classes for control-oriented applications.

Building thermal modeling↗

Benchmarking plasma and electrolysis decomposition technologies for ammonia to power generation

Ammonia is a promising energy and hydrogen carrier due to its ease of liquification, high hydrogen content, and potential to be synthesized without carbon feedstocks. Despite its widespread use in agriculture, the utilization of ammonia to deliver hydrogen or for direct power generation is still under development. Sometimes referred to as “cracking”, the standard approach for recovering hydrogen from ammonia relies on harsh reaction conditions that limit its suitability for low-carbon transitions. Here, this work investigates the technology development status and potential cost of plasma and electrolysis-based ammonia decomposition, benchmarks them with thermal-chemical decomposition, and further compares them with direct ammonia-to-power solid oxide fuel cell systems. Results suggest that in order to reach cost parity with cracking technologies, plasma-based decomposition must achieve one order of magnitude improvement in energy efficiency (to 10 kWh/kg or lower), while electrolysis decomposition must achieve enhanced durability using cheap electrolytes.

30 DIRECT ENERGY CONVERSION↗

Benchmark solution of the dynamic response of a spherical shell at finite strain

Our paper describes the development of high fidelity solutions for the study of homogeneous (elastic and inelastic) spherical shells subject to dynamic loading and undergoing finite deformations. The goal of the activity is to provide high accuracy results that can be used as benchmark solutions for the verification of computational physics codes. Furthermore, the equilibrium equations for the geometrically non-linear problem are solved through mode expansion of the displacement field and the boundary conditions are enforced in a strong form. Time integration is performed through high-order implicit Runge–Kutta schemes. Finally, we evaluate accuracy and convergence of the proposed method by means of numerical examples with finite deformations and material non-linearities and inelasticity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CFD-aided benchmark assessment of coal devolatilization one-step models in oxy-coal combustion conditions

Coal devolatilization, as first step in thermochemical processes involving solid fuels, has been targeted in plenty of CFD investigations: despite the variety of models that were developed to define the rate of the process and the amount of volatile matter released, not all of them are suitable for CFD simulations of large-scale coal combustors. Empirical models ensure both simplicity and feasibility, but not full reliability for all coal types and operating conditions. CFD modeling results for coal conversion during devolatilization in an entrained flow reactor and oxy-conditions are presented and compared to experimental data. A benchmark assessment of one-step models on the accuracy of the volatile yield prediction is then performed. It is shown that the heating rate strongly influences the devolatilization process and its modeling, not only in terms of rate but also in terms of yield, which differs significantly from the proximate analysis value. Furthermore, this indicates the need for a model able to predict the variation of coal volatile yield with temperature and heating rate, in addition to the kinetic model.

01 COAL, LIGNITE, AND PEAT↗

Benchmarking impact hydrocodes in the strength regime: Implications for modeling deflection by a kinetic impactor

The Double Asteroid Redirection Test (DART) is a NASA-sponsored mission that will be the first direct test of the kinetic impactor technique for planetary defense. Here, the DART spacecraft will impact into Didymos-B, the moon of the binary system 65803 Didymos and the resulting period change will be measured from Earth. Impact simulations will be used to predict the crater size and momentum enhancement expected from the DART impact. Because the specific material properties (strength, porosity, internal structure) of the Didymos-B target are unknown, a wide variety of numerical simulations must be performed to better understand possible impact outcomes. This simulation campaign will involve a large parameter space being simulated using multiple different shock physics hydrocodes. In order to understand better the behaviors and properties of numerical simulation codes applicable to the DART impact, a benchmarking and validation program using different numerical codes to solve a set of standard problems was designed and implemented.

79 ASTRONOMY AND ASTROPHYSICS↗

Benchmarking CO₂ storage simulations: Results from the 11 th Society of Petroleum Engineers Comparative Solution Project

The 11 th Society of Petroleum Engineers Comparative Solution Project (shortened SPE11 herein) benchmarked simulation tools for geological carbon dioxide (CO 2 ) storage. A total of 45 groups from leading research institutions and industry across the globe signed up to participate, with 18 ultimately contributing valid results that were included in the comparative study reported here. This paper summarizes the SPE11 results. A comprehensive introduction and qualitative discussion of the submitted data are provided, together with an overview of online resources for accessing the full depth of data. A global metric for analyzing the relative distance between submissions is proposed and used to conduct a quantitative analysis of the submissions. This analysis attempts to statistically resolve the key aspects influencing the variability between submissions. The study shows that the major qualitative variation between the submitted results is related to thermal effects, dissolution-driven convective mixing, and resolution of facies discontinuities. Moreover, a strong dependence on grid resolution is observed across all three versions of the SPE11. However, our quantitative analysis suggests that the observed variations are predominantly influenced by factors not documented in the technical responses provided by the participants. We therefore identify that unreported variations due to human choices within the process of setting up, conducting, and reporting on the simulations underlying each SPE11 submission are at least as impactful as the computational choices reported.

Nordbotten, Jan M. [Univ. of Bergen (Norway); Norw↗

Benchmarking blockchain-based gene-drug interaction data sharing methods: A case study from the iDASH 2019 secure genome analysis competition blockchain track

Blockchain distributed ledger technology is just starting to be adopted in genomics and healthcare applications. Despite its increased prevalence in biomedical research applications, skepticism regarding the practicality of blockchain technology for real-world problems is still strong and there are few implementations beyond proof-of-concept. We focus on benchmarking blockchain strategies applied to distributed methods for sharing records of gene-drug interactions. We expect this type of sharing will expedite personalized medicine. We generated gene-drug interaction test datasets using the Clinical Pharmacogenetics Implementation Consortium (CPIC) resource. We developed three blockchain-based methods to share patient records on gene-drug interactions: Query Index, Index Everything, and Dual-Scenario Indexing. We achieved a runtime of about 60 s for importing 4,000 gene-drug interaction records from four sites, and about 0.5 s for a data retrieval query. Our results demonstrated that it is feasible to leverage blockchain as a new platform to share data among institutions.

60 APPLIED LIFE SCIENCES↗

Benchmarking sensor fusion capabilities of an integrated instrumentation package

Quantifying and mitigating environmental risks introduced by marine energy conversion systems requires a variety of sensors (active acoustic, passive acoustic, and optical). The operation of these sensors must satisfy three directives to be effective: (1) do not alter the environment through operation of sensors; (2) capture rare events; and (3) do not accrue unmanageable volumes of low-value data. This requires integrating sensors into a single package, rather than operating them independently. The Adaptable Monitoring Package is an integrated instrumentation package that combines a multibeam sonar, acoustic camera, current profiler, optical cameras, and an array of hydrophones. The capabilities and limitations of the AMP sensors were benchmarked using cooperative targets, and real-time target tracking and detection was used to detect opportunistic targets (e.g., diving birds, seals). During an initial deployment, automatic detection of opportunistic targets achieved a 58% true positive rate and a 99% true negative rate (100% corresponding to an ideal system in both cases). In post-processing, target tracking data were used to evaluate automatic target classification capabilities using a k-nearest neighbor algorithm. Findings suggest that real-time target classification should be possible and enable integrated instrumentation systems to meet the monitoring needs of marine energy deployments.

16 TIDAL AND WAVE POWER↗

Interdisciplinary Clinical Target Volume Generation for Cardiac Radioablation: Multicenter Benchmarking for the RAdiosurgery for VENtricular TAchycardia (RAVENTA) Trial

Cardiac radioablation is a novel treatment option for therapy-refractory ventricular tachycardia (VT) ineligible for catheter ablation. Three-dimensional clinical target volume (CTV) definition is a key step, and this complex interdisciplinary procedure includes VT-substrate identification based on electroanatomical mapping (EAM) and its transfer to the planning computed tomography (PCT). Benchmarking of this process is necessary for multicenter clinical studies such as the RAVENTA trial.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Comprehensive review of photophysical parameters (ε, Φ f , τ s ) of tetraphenylporphyrin (H 2 TPP) and zinc tetraphenylporphyrin (ZnTPP) – Critical benchmark molecules in photochemistry and photosynthesis

Tetraphenylporphyrin (H 2 TPP) and zinc tetraphenylporphyrin (ZnTPP) are widely used benchmark molecules in diverse photochemical studies given facile synthetic access, rich visible-region spectra, and broad structural analogy to chlorophylls. Yet the literature values for each key photophysical parameter – the molar absorption coefficient (ε), fluorescence quantum yield (Φ f ), and also singlet excited-state lifetime (τ S ) – vary over an astonishing range. Here, a comprehensive literature review (~1940–September 2020) encompassing 871 publications is reported for these essential parameters. Each parameter is determined by measurement with distinct instrumentation and suffers idiosyncratic sources of error. The best values for H 2 TPP are ε = 460,000 cm -1 ·M -1 , Φ f = 0.090, and τ S = 12.8 ns in Ar- purged toluene (Φf = 0.070, τS = 9.9 ns in toluene in air); the best values for ZnTPP are ε = 560,000 cm -1 ·M -1 , Φf = 0.030, and τ S = 2.1 ns in Ar-purged toluene (Φ f = 0.029, τ S = 2.0 ns in toluene in air). The choice of values for such parameters has far-reaching consequences in photochemistry ranging from fluorescence (or Förster) resonance energy transfer (FRET) processes to assessments of molecular brightness.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

First benchmarked electron cooling simulations from first principles

We present the first microscopic electron cooling simulations from first principles with accurate prediction of cooling time. These simulations were performed using our previously developed numerical method, PHAD, which is the first efficient large-scale collisional numerical method in beam physics. The simulation results are benchmarked with the experimental data of the low energy bunched electron cooling of ion beams at the storage ring CSRm at the IMP facility in China. Here, we have accurately considered the nonlinear dynamics in the whole accelerator system in addition to the electron cooling section. As a result, our simulations correctly reproduced cooling times of the experiments from first principles and without any tuning or fitting parameters in the code.

43 PARTICLE ACCELERATORS↗

Benchmarking fast-neutron response of 7 Li-enriched C 7 LYC scintillators: Simulations and experiment

New insights into the fast neutron response of 7 Li-enriched C 7 LYC scintillators have been obtained through detailed Geant4 simulations of 35 Cl(n,p) and 35 Cl(n, α) reactions that are primarily responsible for the fast neutron response of C 7 LYC. The light output of a 1” x1” C 7 LYC detector was simulated using the Birks equation for light quenching in scintillators. The simulations were benchmarked against neutron scattering data from a 12 C target obtained with a white neutron beam at the Los Alamos LANSCE facility and fourteen 1”x1” C 7 LYC detectors. Incident neutron energies extracted from time-of-flight measurements, and appropriate recoil corrections for the different detector angles were used to map the response of C 7 LYC to mono-energetic neutrons. Resonances in the 35 Cl(n,p) reaction cross-section below 3 MeV incident neutron energy were directly observed in C 7 LYC. The experimental data and simulations are compared with ENDF databases, as well as recent direct cross-section measurements of neutrons scattered from a 35 Cl target. In conclusion, the results suggest a scrutiny of the 35 Cl(n,p) and 35 Cl(n, α) cross sections at low energy in the ENDF library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Numerical benchmark of transient pressure-driven metallic melt flows

Fluid dynamics simulations of melting and crater formation at the surface of a copper cathode exposed to high plasma heat fluxes and pressure gradients are presented. The predicted deformations of the free surface and the temperature evolution inside the metal are benchmarked against previously published simulations. Despite the physical model being entirely hydrodynamic and ignoring a variety of plasma–surface interaction processes, the results are also shown to be remarkably consistent with the predictions of more advanced models, as well as experimental data. This provides a sound basis for future applications of similar models to studies of transient surface melting and droplet ejection from metallic plasma-facing components after disruptions.

36 MATERIALS SCIENCE↗

Application of Jacobian-free Newton–Krylov method in implicitly solving two-fluid six-equation two-phase flow problems: Implementation, validation and benchmark

This work represents a first-of-its-kind successful application to employ advanced numerical methods in solving realistic two-phase flow problems with two-fluid six-equation two-phase flow model. These advanced numerical methods include high-resolution spatial discretization scheme with staggered grids (high-order) fully implicit time integration schemes, and Jacobian-free Newton–Krylov (JFNK) method as the nonlinear solver. The computer code developed in this work has been extensively validated with existing experimental flow boiling data in vertical pipes and rod bundles, which cover wide ranges of experimental conditions, such as pressure, inlet mass flux, wall heat flux and exit void fraction. Additional code-to-code benchmark with the RELAP5-3D code further verifies the correct code implementation. The combined methods employed in this work exhibit strong robustness in solving two-phase flow problems even when phase appearance (boiling) and realistic discrete flow regimes are considered. Transitional flow regimes used in existing system analysis codes, normally introduced to overcome numerical difficulty, were completely removed in this work. As a result, this in turn provides the possibility to utilize more sophisticated flow regime maps in the future to further improve simulation accuracy.

42 ENGINEERING↗