A Comprehensive Cross-Model Framework for Benchmarking the Performance of Quantum Hamiltonian Simulations
Not Available
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Summarization and compression at current and future scales requires a framework for developing and benchmarking algorithms. We present a framework created by integrating existing, production-ready projects and provide timings of two particular algorithms that serve as exemplars for summarization: a wavelet-based data reduction filter and a generator for creating image-like databases of extracted features (isocontours in this case). Both support browser-based, post-hoc, interactive visualization of the summary for decision-making. A study of their weak-scaling on a distributed multi-GPU system is included in this article.
Finite element analysis (FEA) was used to investigate the impacts of interfacial bonding efficiency at pellet-pellet and pellet-clad interfaces on spent nuclear fuel (SNF) vibration integrity. The FEA simulation results were validated and benchmarked with ORNL reversal bending fatigue test results on surrogate rods consisting of stainless steel (SS) tubes with alumina-pellet inserts.
This project details re-evaluations of experiments of gas-cooled fast reactor (GCFR) core designs performed in the 1970s at the PROTEUS reactor and create a series of International Reactor Physics Experiment Evaluation Project (IRPhEP) benchmarks. Currently there are no gas-cooled fast reactor (GCFR) experiments available in the International Handbook of Evaluated Reactor Physics Benchmark Experiments (IRPhEP Handbook). These experiments are excellent candidates for reanalysis and development of multiple benchmarks because these experiments provide high-quality integral nuclear data relevant to the validation and refinement of thorium, neptunium, uranium, plutonium, iron, and graphite cross sections. It would be cost prohibitive to reproduce such a comprehensive suite of experimental data to support any future GCFR endeavors.
This report discusses an approach to computing the probability of a conjunction between two space objects in the short-term encounter scenario. A conjunction is defined here as an event where the miss distance between the objects is less than some specified value. The scenario assumptions are that the motion of the objects is linear, their positions are Gaussian distributed, and their velocities are known and constant. Under these assumptions, the squared-miss distance is shown to have the generalized chi-square distribution. An established statistical technique called characteristic function inversion is employed to evaluate the distribution and obtain conjunction probabilities. The method is closely related to a recent approach based on moment generating function inversion, and a qualitative comparison of the approaches is provided. Last, the method is tested on several benchmark test cases where it agrees with numerical integration on the cases with conjunction probabilities above 10 –12 . However, the exact probability in these cases is usually not needed and this probability can be bounded above using an independent Gaussian approximation. Overall, the report shows how to compute conjunction probabilities using a standard statistical method, though numerical integration seems to perform equally well.
The Accelerator Neutrino Neutron Interaction Experiment (ANNIE) is a 26-ton water-based neutrino detector located at Fermilab, approximately 110 m downstream of the Booster Neutrino Beam (BNB). ANNIE utilizes both photomultiplier tubes (PMTs) and advanced photodetectors, specifically Large Area Picosecond Photodetectors (LAPPDs), to detect Cherenkov light emitted by leptons produced in neutrino interactions within ANNIE. LAPPDs are a novel technology designed to detect photons with picosecond-level temporal resolution and sub-millimetre spatial precision. Multiple LAPPDs have been deployed in the ANNIE detector. This is the first use of this technology in a running particle physics experiment and has yielded the first detection of light from neutrino interactions in water with LAPPDs. In this poster, I will showcase the operational performance and functionality of LAPPDs in the ANNIE experiment. Neutrino beam data from the BNB is used to evaluate the timing precision, hit reconstruction performance, and beam response of deployed LAPPDs, demonstrating how this novel picosecond-resolution technology performs in a running neutrino water Cherenkov detector. This work highlights the successful integration of LAPPDs in ANNIE and provides quantitative benchmarks that inform their application in future neutrino experiments requiring high-resolution photon detection.
The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Cargo Vehicle s first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.
The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for exploration beyond Earth orbit in an austere economic climate. This fact drives the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. To arrive at the current SLS plan, government and industry experts carefully analyzed hundreds of architecture options and arrived at the one clear solution to stringent requirements for safety, affordability, and sustainability over the decades that the rocket will be in operation. This paper will explore ways to fit this major development within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017. It will explain the SLS Program s long-range plan to keep the budget within bounds, yet evolve the 70 metric ton (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through a competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface over 4 decades ago. Astronauts train for long-duration voyages on the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. NASA is refining its mission manifest, guided by U.S. Space Policy and the Global Exploration Roadmap. Launching the Orion Multi-Purpose Crew Vehicle s (MPCV s) first autonomous certification flight in 2017, followed by a crewed flight in 2021, the SLS will offer a robust way to transport international crews and the air, water, food, and equipment they need for extended trips to asteroids, Lagrange Points, and Mars. In addition, the SLS will accommodate high-priority science experiments. SLS affordability initiatives include streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture that continually benchmarks its performance against successful ventures. As this paper will explain, the SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration.
The correction of the atmospheric effects on optical satellite images is essential for quantitative and multi-temporal remote sensing applications. In order to study the performance of the state-of-the-art methods in an integrated way, a voluntary and open-access benchmark Atmospheric Correction Inter-comparison eXercise (ACIX) was initiated in 2016 in the frame of Committee on Earth Observation Satellites (CEOS) Working Group on Calibration & Validation (WGCV). The first exercise was extended in a second edition wherein twelve atmospheric correction (AC) processors, a substantially larger testing dataset and additional validation metrics were involved. The sites for the inter-comparison analysis were defined by investigating the full catalogue of the Aerosol Robotic Network (AERONET) sites for coincident measurements with satellites' overpass. Although there were more than one hundred sites for Copernicus Sentinel-2 and Landsat 8 acquisitions, the analysis presented in this paper concerns only the common matchups amongst all processors, reducing the number to 79 and 62 sites respectively. Aerosol Optical Depth (AOD) and Water Vapour (WV) retrievals were consequently validated based on the available AERONET observations. The processors mostly succeeded in retrieving AOD for relatively light to medium aerosol loading (AOD < 0.2) with uncertainties <0.08, while the overall uncertainty values were typically 0.23 ± 0.15. Better performances were observed for WV retrievals with >90% of the results falling within the suggested empirical specifications and with the Root Mean Square Error (RMSE) being mostly <0.25 g/cm2. Regarding Surface Reflectance (SR) validation two main approaches were followed. For the first one, a simulated SR reference dataset was computed over all of the test sites by using the 6SV (Second Simulation of the Satellite Signal in the Solar Spectrum vector code) full radiative transfer modelling (RTM) and AERONET measurements for the required aerosol variables and water vapour content. The performance assessment demonstrated that the retrievals were not biased for most of the bands. The uncertainties ranged from approximately 0.003 to 0.01 (excluding B01) for the best performing processors in both sensors' analyses. For the second one, measurements from the radiometric calibration network RadCalNet over La Crau (France) and Gobabeb (Namibia) were involved in the validation. The performance of the processors was in general consistent across all bands for both sensors and with low standard deviations (<0.04) between on-site and estimated surface reflectance. Overall, our study provides a good insight of AC algorithms' performance to developers and users, pointing out similarities and differences for AOD, WV and SR retrievals. Such validation though still lacks of ground-based measurements of known uncertainty to better assess and characterize the uncertainties in SR retrievals.
The Chlorine Worth Study (CWS) experiments consist of layers of Zero Power Physics Reactor plates moderated by high density polyethylene, polyvinyl chloride, and chlorinated polyvinyl chloride with the goal to produce a thermal critical experiment. A thick high density polyethylene reflector surrounds the experiments. Aluminum fuel trays and frames were used to conduct the intrinsic heat generation of the plutonium plates away from the core and out to the top plate and the platen, both acting as heat sinks. The goal of the CWS experiments was to provide benchmark critical experiments that were sensitive to chlorine and matched the sensitivity of criticality safety applications for aqueous chloride operations at PF-4 at Los Alamos National Laboratory. The specific aqueous chloride PF-4 applications were solutions of 30 g/L plutonium, 300 g/L plutonium, and 600 g/L plutonium. The CWS experiments were designed using prototype methods developed by the ARCHIMEDES and EUCLID projects at Los Alamos National Laboratory. The CWS experiments were performed in December of 2021 at the National Criticality Experiments Research Center at the Nevada Nuclear Security Site on the Planet critical assembly. It is intended that the CWS experiments will be evaluated and submitted to the ICSBEP in the future as criticality safety benchmarks.
A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused keff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.A note of errata prepended to the Godiva-IV delayed-critical benchmark (HEU-MET-FAST- 086) identifies two corrections to be made to the model: The glory hole in the spindle should be made larger, and the height of the safety block should be made smaller (and therefore its density made larger). In addition, the safety block at its full-in position is closer to the inner subassembly plate than was modeled in the benchmark. These changes have been made to HEU-MET-FAST-086 Case 4 in order to estimate the effect on $\kappa$ eff and on the neutron flux spectrum. Using smaller separation, a smaller safety block, and a larger glory hole caused $\kappa$ eff to increase by 453 ± 1 pcm from the benchmark. The latest nuclear data, ENDF/B-VIII.0, have also been used, causing $\kappa$ eff to increase another 37 ± 1 pcm. Flux spectra were compared in a modeled fission foil (near the center of Godiva-IV in the glory hole) and at three external (point) detectors. Within the fission foil, using ENDF/B-VIII.0 induced changes in the flux spectrum similar in size to the changes due to using smaller separation, a smaller safety block, and a larger glory hole. At the detectors, using ENDF/B- VIII.0 induced changes in the flux spectrum much larger than those due to changing the model. In other words, the corrections to the benchmark model cause a large increase in $\kappa$ eff , but the changes to the neutron flux spectrum are small compared to those caused by using the latest nuclear data. This study presents a preview of results expected during the reevaluation of the Godiva IV benchmark, but it is not a substitute for the full reevaluation.
The International Criticality Safety Benchmark Evaluation Project (ICSBEP) was started in 1992 by the United States Department of Energy and later in 1995 became an international project with contributions from 22 countries. The project is now organized by the OECD (Organisation for Economic Co-operation and Development) Nuclear Energy Agency (NEA). In its most recent iteration, the ICSBEP handbook contains over five thousand evaluations of critical, near-critical, and subcritical experiments conducted in facilities all around the world. These benchmarks serve as valuable information for criticality safety engineers who can use them to validate calculation techniques and establish minimum subcritical margins for operations with fissionable materials. The benchmarks in the handbook are categorized by their fissile material composition, material form (oxide, solution, or metal), and fission energy spectra. This is especially useful for those looking for benchmarks similar to a system they are working on to compare methods and identify trends. The ICSBEP Handbook Uncertainty Guide is document outlining recommended practices and methods for determining uncertainties in these benchmarks. Quantifying these uncertainties thoroughly is crucial as it allows a higher degree of confidence that data used from them is valid and relevant. The guide stresses the importance of a thorough and well documented uncertainty analysis when evaluating an experiment. All measured values of a system, whether they be dimensions or material compositions, have a certain amount of uncertainty associated with them and can be analyzed one by one to determine their effects on the system. Many evaluated benchmarks in the handbook present this in detail, however some do not, mostly earlier evaluations performed in the 1990’s and early 2000’s. Recently at Los Alamos National Laboratory (LANL), the Nuclear Criticality Safety Division (NCSD) of LANL has been validating MCNP6.2 ® input files of criticality benchmarks for use by Whisper, a criticality safety code developed at LANL. This effort is also part of the OECD NEA Working Party on International Nuclear Data Evaluation Co-operation (WPEC) Subgroup 45, also known as Validation of Nuclear Data Libraries (VaNDaL). The goal of VaNDaL is to compile a set of validated simulation inputs for use in validating nuclear data and simulation codes. As part of these efforts, one of the benchmarks reviewed was the MIX SOL-THERM-003 ICSBEP benchmark. This paper provides an independent uncertainty analysis of this benchmark experiment.
Polymer exposure during van der Waals heterostructure fabrication is widely regarded as compromising the integrity of the electronic system required for hosting emergent quantum physics. This assumption has persisted largely because electronic benchmarking of heterostructures from polymer-exposed graphene has remained limited to only foundational transport metrics, such as mobility and charge inhomogeneity. Here, we challenge this assumption by establishing that graphene heterostructures produced by polyvinyl alcohol (PVA)-assisted exfoliation and encapsulated in hexagonal boron nitride using elevated-temperature lamination satisfy demanding quantum transport benchmarks. Beyond exhibiting ultra-high mobility and ballistic transport, these heterostructures yield quantum scattering times comparable to the best polymer-free devices. Most demanding of all, moiré superlattices from PVA-exposed graphene exhibit Hofstadter butterfly spectra, confirming spatially uniform interlayer coupling across the device area. These results establish that PVA exposure is compatible with low-disorder electronic systems, relaxing the trade-off between scalable fabrication and low-disorder quantum transport. This study motivates further development of polymer-assisted assembly with engineered residue-removal protocols.
Computational Science is being revolutionized by integrating AI and simulation and, in particular, by deep learning surrogate models that can replace all or part of traditional large‐scale HPC computations. Such surrogates can achieve remarkable performance improvements, as much as several orders of magnitude, and save both compute time and energy. The Surrogate Benchmark Initiative (SBI) project creates a community repository and FAIR (Findable, Accessible, Interoperable, and Reusable) data ecosystem for HPC application surrogate benchmarks. The SBI team comes from Argonne National Laboratory (ANL), Indiana University (IU), Rutgers University, the University of Tennessee, Knoxville (UTK), and the University of Virginia (UVA). SBI repositories include data, code, and all relevant collateral artifacts that the science and engineering community need to use and reuse these data sets and surrogates. SBI repositories generate active research from both the participants in SBI and the broad community of AI and domain scientists. This project develops surrogates that use several different neural nets to learn and quickly infer the results of simulations and data systems and captures them as surrogate benchmarks with a rich set of metadata covering: Data; Model; Metrics specification; Machine specification; and Science, Speed, and Power Results. We research FAIR metadata for these benchmarks. We develop application surrogate examples as benchmarks across many fields (ANL, UTK, IU, UVA). We also study non-Surrogate benchmarks that have many common features and similar issues as regards FAIRness. We work with MLCommons (UVA, UTK), which is a major machine learning benchmarking activity where we get metadata ontologies, software, and benchmarks, Benchmarks have datasets, models, and metadata and they need a technical framework developed by UTK and Rutgers and deployed by UVA. We study features of Surrogates including performance, training set size, and uncertainty quantification (Rutgers, UVA and IU).
A new Rayleigh-Ritz stress analysis methodology that was developed for composite panels containing cutouts is described. The procedure, which makes use of a general assumed displacement field, accommodates circular and elliptical cutouts in biaxially loaded rectangular composite panels. Symmetric integral padups around the cutout can be included in the analysis. Benchmark results are presented to demonstrate the accuracy of the technique. Strength predictions based on the average stress criterion are generated and compared with experimental data. Finally, the stress analysis methodology is integrated into a design procedure for sizing integral padups around circular cutouts, and a sample problem is solved to illustrate its use.
The Department of Energy invests tens of millions of dollars each year to develop the next generation of nuclear engineering modeling & simulation (M&S) tools. These M&S tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers become more powerful, we are able to enhance resolution in our calculations. This improved resolution is taking us to a point where the limitations of simulation capability are in the quality of data, including our ability to quantify the uncertainty and sensitivity of the data. In order to accurately model systems of interest, the industry must improve key nuclear data measurements and our confidence of how well we understand the data. Thus, M&S tools need evaluated and quality-assured experimental data for validation purposes. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles benchmark experiment data in a handbook that can be used by criticality safety engineers to validate computer codes and cross-section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. Figure 1 organizes all the benchmark evaluations that have been performed by the isotope of interest, in this case Pb, and the neutron energy within the system. Compared to other isotopes of interest for nuclear applications, there are few benchmark evaluations for Pb systems. This has caused the latest nuclear cross-section libraries to over/underestimate changes in the neutron population compared to experimental results. Therefore, this evaluation fills an important knowledge gap in benchmark evaluations.
The focus of this project was the ADAsorb™ CO 2 Capture Process, a temperature-swing adsorption process that incorporates a three-stage fluidized bed as the adsorber and a single-stage fluidized bed as the regenerator. ADAsorb™ system was designed, fabricated, and tested under DOE award DEFE0004343. Two amine-based sorbents were evaluated in conjunction with the ADAsorb™ process: “BN”, an ion-exchange resin; and “OJ”, a metal organic framework (MOF) sorbent. Two cross heat exchanger designs were evaluated for use between the adsorber and regenerator: moving bed and fluidized bed. The fluidized bed approach was rejected fairly early in the project because the additional electrical load to power blowers or fans to overcome the pressure drop required for fluidization was estimated to be nominally three times the electrical power that could be generated from the steam saved through the use of the cross heat exchanger. The Energy Research Center at Lehigh University built and utilized a process model of the ADAsorb™ capture process and integrated this model into an existing model of a supercritical PC power plant. The Lehigh models verified that, for the ADAsorb™ system, the largest contributor to parasitic power was lost electrical generation, which was primarily electric power which the host plant could not generate due to the extraction of low pressure (LP) steam for sorbent heating, followed by power for the CO 2 compressor and the blower or fan power required to fluidize the adsorber and regenerator. Sorbent characteristics such as the impacts of moisture uptake, optimized adsorption and regeneration temperature, and sensitivity to changes in pressure were also included in the modeling study. Results indicate that sorbents which adsorb more than 1-2% moisture by weight are unlikely to be cost competitive unless they have an extremely high CO 2 working capacity that well exceeds 15% by weight. Modeling also revealed that reductions in adsorber pressure drop could negatively affect the CO 2 adsorption characteristics for sorbents with certain isobar adsorption characteristics like sorbent BN. Thus, reductions in pressure drop do not provide the efficiency benefits expected. A techno-economic assessment conducted during the project revealed that without heat integration, the a metal organic framework (MOF) sorbent used in conjunction with the ADAsorb™ process provided the opportunity for improved performance over the benchmark MEA process. While the addition of a cross heat exchanger and heat integration was found to significantly improve net unit heat rate, the additional equipment costs required to realize these improvements almost always outweighed the improvement in performance. The exception to this was for a supported amine sorbent and the addition of a moving bed cross heat exchanger alone or in conjunction with waste heat from the compressor used for supplemental regenerator heating. Perhaps one of the most important points to be drawn from the work conducted during this project is the significant influence of sorbent characteristics alone on the projected COE and LCOE associated with the ADAsorb™ process, and the implications associated with future improvements to solid sorbent CO 2 capture. The results from this project suggest that solid sorbent CO 2 capture will continue to see performance gains and lower system costs as further sorbent improvements are realized.
The representation and storage of two-electron integral tensors are vital in large- scale applications of accurate electronic structure methods. Low-rank representation and efficient storage strategy of integral tensors can significantly reduce the numerical overhead and consequently time-to-solution of these methods. In this paper, by combining pivoted incomplete Cholesky decomposition (CD) with a follow-up truncated singular vector decomposition (SVD), we develop a decomposition strategy to approximately represent the two-electron integral tensor in terms of low-rank vectors. A systematic benchmark test on a series of 1-D, 2-D, and 3-D carbon-hydrogen systems demonstrates high efficiency and scalability of the compound two-step decomposition of the two-electron integral tensor in our implementation. For the size of atomic basis set N_b ranging from ~ 100 up to ~ 2, 000, the observed numerical scaling of our implementation shows O(N_b^{2.5~3}) versus O(N_b^{3~4}) of single CD in most of other implementations. More importantly, this decomposition strategy can significantly reduce the storage requirement of the atomic-orbital (AO) two-electron integral tensor from O(N_b^4) to O(N_b^2 log_{10}(N_b)) with moderate decomposition thresholds. The accuracy tests have been performed using ground- and excited-state formulations of coupled- cluster formalism employing single and double excitations (CCSD) on several bench- mark systems including the C_{60} molecule described by nearly 1,400 basis functions. The results show that the decomposition thresholds can be generally set to 10^{-4} to 10^{-3} to give acceptable compromise between efficiency and accuracy.