Search NASA⌕ Search

SEARCH · Search NASA

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

The International Experimental Thermal Hydraulic Systems database – TIETHYS: A new NEA validation tool

Nuclear reactor codes require validation with appropriate data representing the plant for specific scenarios. The thermal-hydraulic data is scattered in different locations and in different formats. Some of the data is in danger of being lost. A relational database is being developed to organize the international thermal hydraulic test data for various reactor concepts and different scenarios. At the reactor system level, that data is organized to include separate effect tests and integral effect tests for specific scenarios and corresponding phenomena. The database relies on the phenomena identification sections of expert developed PIRTs. The database will provide a summary of appropriate data, review of facility information, test description, instrumentation, references for the experimental data and some examples of application of the data for validation. The current database platform includes scenarios for PWR, BWR, VVER, and specific benchmarks for CFD modelling data and is to be expanded to include references for molten salt reactors. There are place holders for high temperature gas cooled reactors, CANDU and liquid metal reactors. This relational database is called The International Experimental Thermal Hydraulic Systems (TIETHYS) database and currently resides at Nuclear Energy Agency (NEA) of the OECD and is freely open to public access. Going forward the database will be extended to include additional links and data as they become available. https://www.oecd-nea.org/tiethysweb/

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

THE ABUNDANCE OF BULLET GROUPS IN ΛCDM

We estimate the expected distribution of displacements between the two dominant dark matter (DM) peaks (DM-DM displacements) and between the DM and gaseous baryon peak (DM-gas displacements) in DM halos with masses larger than 10{sup 13} h {sup –1} M {sub ☉}. As a benchmark, we use the observation of SL2S J08544–0121, which is the lowest mass system (1.0 × 10{sup 14} h {sup –1} M {sub ☉}) observed so far, featuring a bi-modal DM distribution with a dislocated gas component. We find that (50 ± 10)% of the DM halos with circular velocities in the range 300-700 km s{sup –1} (groups) show DM-DM displacements equal to or larger than 186 ± 30 h {sup –1} kpc as observed in SL2S J08544–0121. For DM halos with circular velocities larger than 700 km s{sup –1} (clusters) this fraction rises to (70 ± 10)%. Using the same simulation, we estimate the DM-gas displacements and find that 0.1%-1.0% of the groups should present separations equal to or larger than 87 ± 14 h {sup –1} kpc, corresponding to our observational benchmark; for clusters, this fraction rises to (7 ± 3)%, consistent with previous studies of DM to baryon separations. Considering both constraints on the DM-DM and DM-gas displacements, we find that the number density of groups similar to SL2S J08544–0121 is ∼6.0 × 10{sup –7} Mpc{sup –3}, three times larger than the estimated value for clusters. These results open up the possibility for a new statistical test of ΛCDM by looking for DM-gas displacements in low mass clusters and groups.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation of HEU-Beryllium Benchmark Experiments to Improve Computational Analysis of Space Reactors

An assessment was previously performed to evaluate modeling capabilities and quantify preliminary biases and uncertainties associated with the modeling methods and data utilized in designing a nuclear reactor such as a beryllium-reflected, highly-enriched-uranium (HEU)-O2 fission surface power (FSP) system for space nuclear power. The conclusion of the previous study was that current capabilities could preclude the necessity of a cold critical test of the FSP; however, additional testing would reduce uncertainties in the beryllium and uranium cross-section data and the overall uncertainty in the computational models. A series of critical experiments using HEU metal were performed in the 1960s and 1970s in support of criticality safety operations at the Y-12 Plant. Of the hundreds of experiments, three were identified as fast-fission configurations reflected by beryllium metal. These experiments have been evaluated as benchmarks for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). Further evaluation of the benchmark experiments was performed using the sensitivity and uncertainty analysis capabilities of SCALE 6. The data adjustment methods of SCALE 6 have been employed in the validation of an example FSP design model to reduce the uncertainty due to the beryllium cross section data.

Bess, John↗

A benchmark study of electronic excitation energies, transition moments, and excited-state energy gradients on the nicotine molecule

In this work, we report a comparative study of computed excitation energies, oscillator strengths, and excited-state energy gradients of (S)-nicotine, chosen as a test case, using multireference methods, coupled cluster singles and doubles, and methods based on time-dependent density functional theory. This system was chosen because its apparent simplicity hides a complex electronic structure, as several different types of valence excitations are possible, including n-π{sup *}, π-π{sup *}, and charge-transfer states, and in order to simulate its spectrum it is necessary to describe all of them consistently well by the chosen method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ALTERNATIVES TO HELIUM-3 FOR NEUTRON MULTIPLICITY DETECTORS

Collaboration between the Pacific Northwest National Laboratory (PNNL) and the Los Alamos National Laboratory (LANL) is underway to evaluate neutron detection technologies that might replace the high-pressure helium (3He) tubes currently used in neutron multiplicity counter for safeguards applications. The current stockpile of 3He is diminishing and alternatives are needed for a variety of neutron detection applications including multiplicity counters. The first phase of this investigation uses a series of Monte Carlo calculations to simulate the performance of an existing neutron multiplicity counter configuration by replacing the 3He tubes in a model for that counter with candidate alternative technologies. These alternative technologies are initially placed in approximately the same configuration as the 3He tubes to establish a reference level of performance against the 3He-based system. After these reference-level results are established, the configurations of the alternative models will be further modified for performance optimization. The 3He model for these simulations is the one used by LANL to develop and benchmark the Epithermal Neutron Multiplicity Counter (ENMC) detector, as documented by H.O. Menlove, et al. in the 2004 LANL report LA-14088. The alternative technologies being evaluated are the boron-tri-fluoride-filled proportional tubes, boron-lined tubes, and lithium coated materials previously tested as possible replacements in portal monitor screening applications, as documented by R.T. Kouzes, et al. in the 2010 PNNL report PNNL-72544 and NIM A 623 (2010) 1035–1045. The models and methods used for these comparative calculations will be described and preliminary results shown

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Investigating sol–gel matrix loading capacity toward producing surrogate nuclear explosive debris with realistic composition

Post detonation nuclear forensic materials which resemble the size, color, elemental composition, and radionuclide content of real nuclear debris would be valuable for developing and validating new nuclear forensic techniques. As nuclear fallout types vary significantly, the ability to tailor each of these parameters accurately is desired to produce materials capable of testing analytical methods under a wide array of forensic scenarios. Sol–gel synthesis techniques can provide tunability of size, shape and composition for producing a wide variety of solid nuclear forensics benchmarking materials. Further, the sol–gel process consists of forming a metal oxide material, often silica, through polymerization of a metal-alkoxy precursor. In this work, we characterize the ability to load sol–gel particles with secondary elemental components such as iron, aluminum, and calcium toward producing benchmarking materials approximating the elemental composition of historic nuclear debris from the Nevada National Security Site. We also demonstrate quantitative radionuclide encapsulation toward producing benchmarking materials with controllable radionuclide content. Finally, we employ these techniques to produce nuclear debris benchmarking materials with controllable elemental matrix composition and radionuclide content and compare these samples with the composition of a historic fallout sample previously reported from the Nevada National Security Site.

36 MATERIALS SCIENCE↗

Hydrogen Production System Scaling Using a High-Fidelity Simulation-Optimization Framework

Proton exchange membrane (PEM) electrolyzers are widely used for hydrogen production, yet few validated, high-fidelity tools can reliably guide scale-up. Using measured performance from a 50-hour hardware-in-the-loop pilot test, a physics-based, plant-level model of a 1.25 MW PEM electrolyzer and its balance-of-plant (BoP) subsystems is developed and validated. The model couples electrochemistry and thermal/flow submodels and is calibrated against pilot test data via a genetic algorithm (GA) workflow. Validation yields a mean absolute percentage error (APE) of 0.43% for cell voltage and stack power. Two scale-out strategies are then benchmarked under a common 7-day wind-and-photovoltaic (PV) profile: (i) linear duplication of 1.25 MW blocks and (ii) shared-BoP architectures. Sharing BoP between stacks reduces BoP energy by 27% at 10 MW and 34% at 100 MW (vs. linear duplication) and improves system specific energy consumption (SEC) to 52.9 and 52.6 kWh/kg, respectively (from 54.0 kWh/kg with linear duplication). Partial-load studies (25-100% set-point) show that cumulative hydrogen production remains nearly constant down to 50% load because all cases use the same weekly renewable-energy input. Below 50%, the power cap limits how much energy can be used within 168 h, which reduces hydrogen output. The model further indicates that the practical operating optimum lies between 50% and 85% load, where efficiency gains begin to appear without significant loss in hydrogen output. Moreover, the efficiency gains at lower loads are offset by reduced production. The validated framework supports scenario-based engineering trade-off studies for large configurations (10-100 MW) and for operating policies under variable renewables.

08 HYDROGEN↗

Benchmarking blockchain-based gene-drug interaction data sharing methods: A case study from the iDASH 2019 secure genome analysis competition blockchain track

Blockchain distributed ledger technology is just starting to be adopted in genomics and healthcare applications. Despite its increased prevalence in biomedical research applications, skepticism regarding the practicality of blockchain technology for real-world problems is still strong and there are few implementations beyond proof-of-concept. We focus on benchmarking blockchain strategies applied to distributed methods for sharing records of gene-drug interactions. We expect this type of sharing will expedite personalized medicine. We generated gene-drug interaction test datasets using the Clinical Pharmacogenetics Implementation Consortium (CPIC) resource. We developed three blockchain-based methods to share patient records on gene-drug interactions: Query Index, Index Everything, and Dual-Scenario Indexing. We achieved a runtime of about 60 s for importing 4,000 gene-drug interaction records from four sites, and about 0.5 s for a data retrieval query. Our results demonstrated that it is feasible to leverage blockchain as a new platform to share data among institutions.

60 APPLIED LIFE SCIENCES↗

Accelerated cryo-EM-guided determination of three-dimensional RNA-only structures

The discovery and design of biologically important RNA molecules is outpacing three-dimensional structural characterization. In this work, we demonstrate that cryo-electron microscopy can routinely resolve maps of RNA-only systems and that these maps enable subnanometer-resolution coordinate estimation when complemented with multidimensional chemical mapping and Rosetta DRRAFTER computational modeling. Furthermore ,this hybrid ‘Ribosolve’ pipeline detects and falsifies homologies and conformational rearrangements in 11 previously unknown 119- to 338-nucleotide protein-free RNA structures: full-length Tetrahymena ribozyme, hc16 ligase with and without substrate, full-length Vibrio cholerae and Fusobacterium nucleatum glycine riboswitch aptamers with and without glycine, Mycobacterium SAM-IV riboswitch with and without S-adenosylmethionine, and the computer-designed ATP-TTR-3 aptamer with and without AMP. Simulation benchmarks, blind challenges, compensatory mutagenesis, cross-RNA homologies and internal controls demonstrate that Ribosolve can accurately resolve the global architectures of RNA molecules but does not resolve atomic details. These tests offer guidelines for making inferences in future RNA structural studies with similarly accelerated throughput.

59 BASIC BIOLOGICAL SCIENCES↗

Fast correlation function calculator: A high-performance pair-counting toolkit

A novel high-performance exact pair-counting toolkit called fast correlation function calculator (FCFC) is presented. With the rapid growth of modern cosmological datasets, the evaluation of correlation functions with observational and simulation catalogues has become a challenge. High-efficiency pair-counting codes are thus in great demand. We introduce different data structures and algorithms that can be used for pair-counting problems, and perform comprehensive benchmarks to identify the most efficient algorithms for real-world cosmological applications. We then describe the three levels of parallelisms used by FCFC, SIMD, OpenMP, and MPI, and run extensive tests to investigate the scalabilities. Finally, we compare the efficiency of FCFC with alternative pair-counting codes. The data structures and histogram update algorithms implemented in FCFC are shown to outperform alternative methods. FCFC does not benefit greatly from SIMD because the bottleneck of our histogram update algorithm is mainly cache latency. Nevertheless, the efficiency of FCFC scales well with the numbers of OpenMP threads and MPI processes, even though speedups may be degraded with over a few thousand threads in total. FCFC is found to be faster than most (if not all) other public pair-counting codes for modern cosmological pair-counting applications.

79 ASTRONOMY AND ASTROPHYSICS↗

I/O performance studies of analysis workloads on production and dedicated resources at CERN

The recent evolutions of the analysis frameworks and physics data formats of the LHC experiments provide the opportunity of using central analysis facilities with a strong focus on interactivity and short turnaround times, to complement the more common distributed analysis on the Grid. In order to plan for such facilities, it is essential to know in detail the performance of the combination of a given analysis framework, of a specific analysis and of the installed computing and storage resources. This contribution describes performance studies performed at CERN, using the EOS disk-based storage, either directly or through an XCache instance, from both batch resources and highperformance compute nodes which could be used to build an analysis facility. A variety of benchmarks, both synthetic and based on real-world physics analyses and their corresponding input datasets, are utilized. In particular, the RNTuple format from the ROOT project is put to the test and compared to the latest version of the TTree format, and the impact of caches is assessed. In addition, we assessed the difference in performance between the use of storage system specific protocols, like XRootd, and FUSE. The results of this study are intended to be a valuable input in the design of analysis facilities, at CERN and elsewhere.

Sciabà, Andrea↗

POLARIZED LIGHT REFLECTED AND TRANSMITTED BY THICK RAYLEIGH SCATTERING ATMOSPHERES

Accurate values for the intensity and polarization of light reflected and transmitted by optically thick Rayleigh scattering atmospheres with a Lambert surface underneath are presented. A recently reported new method for solving integral equations describing Chandrasekhar's X- and Y-functions is used. The results have been validated using various tests and techniques, including the doubling-adding method, and are accurate to within one unit in the eighth decimal place. Tables are stored electronically and expected to be useful as benchmark results for the (exo)planetary science and astrophysics communities. Asymptotic expressions to obtain Stokes parameters for a thick layer from those of a semi-infinite atmosphere are also provided.

79 ASTRONOMY AND ASTROPHYSICS↗

Ground-state properties of the Hubbard model in one and two dimensions from the Gutzwiller conjugate gradient minimization theory

We introduce Gutzwiller conjugate gradient minimization (GCGM) theory, an ab initio quantum many-body theory for computing the ground-state properties of infinite systems. GCGM uses the Gutzwiller wave function but does not use the commonly adopted Gutzwiller approximation (GA), which is a major source of inaccuracy. Instead, the theory uses an approximation that is based on the occupation probability of the on-site configurations, rather than approximations that decouple the site-site correlations as used in the GA. We test the theory in the one-dimensional and two-dimensional Hubbard models at various electron densities and find that GCGM reproduces energies and double occupancies in reasonable agreement with benchmark data at a very small computational cost.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Coupling between collective modes in the deformed 98 Zr nucleus: Insights from consistent HFB + QRPA calculations with the Gogny interaction

The zirconium isotopes exhibit structural properties that present multiple challenges to nuclear theory. Investigations of the coupling present within isoscalar modes and within isovector modes are scarce but important for advancing our understanding of the microscopic picture of nuclei. To explore some of these underlying coupling features, and to test the predictive power of a state-of-the-art nuclear structure approach, we provide a detailed analysis of the properties of 90,96,98 Zr . This region includes a benchmarking case and offers insights into nuclear deformation phenomena. Here, to investigate the coupling between collective modes in deformed nuclei, we focused our analysis on the ground and excited-state properties of these isotopes, employing a consistent approach with the axially symmetric deformed Hartree-Fock-Bogoliubov (HFB) and the quasiparticle random phase approximation (QRPA) framework, both using the Gogny D1M force. This approach effectively describes both low-lying and giant-resonance states. We devoted special attention to the deformed 98 Zr nucleus, where we confirm the existence of coupling between monopole and quadrupole excitations through the 𝐾 𝜋 = 0 + QRPA components and demonstrate an analogous dipole-octupole coupling through the 𝐾 𝜋 = 0 − and 𝐾 𝜋 = 1 − components. Intrinsic transition densities and associated radial projections illustrate the coupling. Our work complements and extends earlier studies carried out using density-functional-based methods and notably, we included the complete Coulomb interaction also in the pairing fields, i.e., we treat terms exactly that are approximated in typical calculations that use the Gogny D1 and D2 interaction families.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Fission barriers at the end of the chart of the nuclides

We present calculated fission-barrier heights for 5239 nuclides for all nuclei between the proton and neutron drip lines with 171 ≤ A ≤ 330. The barriers are calculated in the macroscopic-microscopic finite-range liquid-drop (FRLDM) with a 2002 set of macroscopic-model parameters. The saddle-point energies are determined from potential-energy surfaces based on more than five million different shapes, defined by five deformation parameters in the three-quadratic-surface shape parametrization: elongation, neck diameter, left-fragment spheroidal deformation, right-fragment spheroidal deformation, and nascent-fragment mass asymmetry. The energy of the ground state is determined by calculating the lowest-energy configuration in both the Nilsson perturbed-spheroid (ϵ) and the spherical-harmonic (β) parametrizations, including axially asymmetric deformations. The lower of the two results (correcting for zero-point motion) is defined as the ground-state energy. The effect of axial asymmetry on the inner barrier peak is calculated in the (ϵ,γ) parametrization. We have earlier benchmarked our calculated barrier heights to experimentally extracted barrier parameters and found average agreement to about one MeV for known data across the nuclear chart. Here we do additional benchmarks and investigate the qualitative and, when possible, quantitative agreement and/or consistency with data on β-delayed fission, isotope generation along prompt-neutron-capture chains in nuclear-weapons tests, and superheavy-element stability. In addition these studies all indicate that the model is realistic at considerable distances in Z and N from the region of nuclei where its parameters were determined.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Higher representations on the lattice: Numerical simulations, SU(2) with adjoint fermions

We discuss the lattice formulation of gauge theories with fermions in arbitrary representations of the color group and present in detail the implementation of the hybrid Monte Carlo (HMC)/rational HMC algorithm for simulating dynamical fermions. We discuss the validation of the implementation through an extensive set of tests and the stability of simulations by monitoring the distribution of the lowest eigenvalue of the Wilson-Dirac operator. Working with two flavors of Wilson fermions in the adjoint representation, benchmark results for realistic lattice simulations are presented. Runs are performed on different lattice sizes ranging from 4{sup 3}x8 to 24{sup 3}x64 sites. For the two smallest lattices we also report the measured values of benchmark mesonic observables. These results can be used as a baseline for rapid cross-checks of simulations in higher representations. The results presented here are the first steps toward more extensive investigations with controlled systematic errors, aiming at a detailed understanding of the phase structure of these theories, and of their viability as candidates for strong dynamics beyond the standard model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗