Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Experimental and CFD Studies of Coolant Flow Mixing within Scaled Models of the Upper and Lower Plenums of NGNP Gas-Cooled Reactors

A 1/16th scaled VHTR experimental model was constructed and the preliminary test was performed in this study. To produce benchmark data for CFD validation in the future, the facility was first run at partial operation with five pipes being heated. PIV was performed to extract the vector velocity field for three adjacent naturally convective jets at statistically steady state. A small recirculation zone was found between the pipes, and the jets entered the merging zone at 3 cm from the pipe outlet but diverged as the flow approached the top of the test geometry. Turbulence analysis shows the turbulence intensity peaked at 41-45% as the jets mixed. A sensitivity analysis confirmed that 1000 frames were sufficient to measure statistically steady state. The results were then validated by extracting the flow rate from the PIV jet velocity profile, and comparing it with an analytic flow rate and ultrasonic flowmeter; all flow rates lie within the uncertainty of the other two methods for Tests 1 and 2. This test facility can be used for further analysis of naturally convective mixing, and eventually produce benchmark data for CFD validation for the VHTR during a PCC or DCC accident scenario. Next, a PTV study of 3000 images (1500 image pairs) were used to quantify the velocity field in the upper plenum. A sensitivity analysis confirmed that 1500 frames were sufficient to precisely estimate the flow. Subsequently, three (3, 9, and 15 cm) Y-lines from the pipe output were extracted to consider the output differences between 50 to 1500 frames. The average velocity field and standard deviation error that accrued in the three different tests were calculated to assess repeatability. The error was varied, from 1 to 14%, depending on Y-elevation. The error decreased as the flow moved farther from the output pipe. In addition, turbulent intensity was calculated and found to be high near the output. Reynolds stresses and turbulent intensity were used to validate the data by comparing it with benchmark data. The experimental data gave the same pattern as the benchmark data. A turbulent single buoyant jet study was performed for the case of LOFC in the upper plenum of scaled VHTR. Time-averaged profiles show that 3,000 frames of images were sufficient for the study up to second-order statistics. Self-similarity is an important feature of jets since the behavior of jets is independent of Reynolds number and a sole function of geometry. Self-similarity profiles were well observed in the axial velocity and velocity magnitude profile regardless of z/D where the radial velocity did not show any similarity pattern. The normal components of Reynolds stresses have self-similarity within the expected range. The study shows that large vortices were observed close to the dome wall, indicating that the geometry of the VHTR has a significant impact on its safety and performance. Near the dome surface, large vortices were shown to inhibit the flows, resulting in reduced axial jet velocity. The vortices that develop subsequently reduce the Reynolds stresses that develop and the impact on the integrity of the VHTR upper plenum surface. Multiple jets study, including two, three and five jets, were investigated.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Are Terrestrial Biosphere Models Fit for Simulating the Global Land Carbon Sink?

The Global Carbon Project estimates that the terrestrial biosphere has absorbed about one-third of anthropogenic CO 2 emissions during the 1959–2019 period. This sink-estimate is produced by an ensemble of terrestrial biosphere models and is consistent with the land uptake inferred from the residual of emissions and ocean uptake. The purpose of our study is to understand how well terrestrial biosphere models reproduce the processes that drive the terrestrial carbon sink. One challenge is to decide what level of agreement between model output and observation-based reference data is adequate considering that reference data are prone to uncertainties. To define such a level of agreement, we compute benchmark scores that quantify the similarity between independently derived reference data sets using multiple statistical metrics. Models are considered to perform well if their model scores reach benchmark scores. Our results show that reference data can differ considerably, causing benchmark scores to be low. Model scores are often of similar magnitude as benchmark scores, implying that model performance is reasonable given how different reference data are. While model performance is encouraging, ample potential for improvements remains, including a reduction in a positive leaf area index bias, improved representations of processes that govern soil organic carbon in high latitudes, and an assessment of causes that drive the inter-model spread of gross primary productivity in boreal regions and humid tropics. The success of future model development will increasingly depend on our capacity to reduce and account for observational uncertainties.

58 GEOSCIENCES↗
DOE OSTI2019

Preliminary Designs for Criticality Safety Benchmarks—Iron/Steel/Chromium Series

The nuclear criticality safety community uses critical benchmarks extensively when analyzing nuclear systems. Having benchmarks sensitive to important materials of interest helps to ensure safety and constrain results. Critical benchmarks are also invaluable to the nuclear data community, which uses these benchmarks as a check and measure of quality of nuclear data libraries. Additionally, integral benchmarks are often used to validate the performance of computational tools for simulating nuclear systems. Many integral benchmarks have been documented in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) handbook, the International Reactor Physics Experiment Evaluation Project (IRPhEP) handbook, and the Shielding Integral Benchmark Archive Database (SINBAD). The National Criticality Experiments Research Center (NCERC), operated by Los Alamos National Laboratory, is the only general purpose critical experiments facility in the United States of America. NCERC regularly designs and executes critical experiments and other measurements useful to a wide variety of fields including nuclear criticality safety, commercial nuclear energy, nonproliferation, and nuclear data. NCERC has recently developed tools to visualize gaps and deficiencies in existing criticality benchmarks – this work is still ongoing. Through this work and other reviews, some high priority deficiencies have been identified. This paper aims to highlight three areas where additional critical benchmarks would be useful to the nuclear criticality safety community and various other groups. Additionally, NCERC is seeking feedback in regard to these proposed measurements to make sure they are as useful to as many communities as possible.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Selected results from full-core hydrogen redistribution asymptotic analysis in YH-moderated heat-pipe cooled microreactor

Yttrium hydride is the main candidate for moderation of high temperature nuclear microreactors . This is due to its high thermal stability and relatively high hydrogen retention at temperatures exceeding 870 C. One of the main issues associated with the use of yttrium hydride is that, when exposed to temperature, stress, or concentration gradients, the hydrogen contained in the metallic matrix tends to redistribute and leak from the moderating elements, potentially leading to reactivity losses and power swings. This paper is focused on presenting selected results from the asymptotic hydrogen redistribution analysis performed on the Simplified Microreactor Benchmark Assessment (SiMBA) problem, a microreactor core conceptual design developed at INL. The analysis is based on full core analysis, relies uniquely on Bison to perform hydrogen redistribution calculations, and discusses the physical causes of the reactivity feedback. It was found that the feedback is negative, but it is one order of magnitude lower than the one found for the empire reactor unit-cell. This is due to the lower axial temperature gradient together with the effect of the reflector.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

Highly Sensitive Bulk Silicon Chemical Sensors with Sub-5 nm Thin Charge Inversion Layers

There is an increasing demand for mass-producible, low-power gas sensors in a wide variety of industrial and consumer applications. In this work, we report chemical-sensitive field-effect-transistors (CS-FETs) based on bulk silicon wafers, wherein an electrostatically confined sub-5 nm thin charge inversion layer is modulated by chemical exposure to achieve a high-sensitivity gas-sensing platform. Using hydrogen sensing as a "litmus" test, we demonstrate large sensor responses (>1000%) to 0.5% H 2 gas, with fast response (<60 s) and recovery times (<120 s) at room temperature and low power (<50 μW). On the basis of these performance metrics as well as standardized benchmarking, we show that bulk silicon CS-FETs offer similar or better sensing performance compared to emerging nanostructures semiconductors while providing a highly scalable and manufacturable platform.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

SNL/JAEA Collaborations on Sodium Fire Benchmarking.

Two sodium spray fire experiments performed by Sandia National Laboratories (SNL) were used for a code - to - code comparison between CONTAIN - LMR and SPHINCS. Both computer codes are used for modeling sodium accidents in sodium fast reactors. The comparison between the two codes provides insights into the ability of both codes to model sodium spray fires. The SNL T3 and T4 experiments are 20 kg sodium spray fires with sodium spray temperature s of 200 deg C and 500 deg C, respe ctively. Given the relatively low sodium temperature in the SNL T3 experiment, the sodium spray experienced a period of non - combustion. The vessel in the SNL T4 experiment experienced a rapid pressurization that caused of the instrumentation ports to fail during the sodium spray. Despite these unforeseen difficulties, both codes were shown in good agreement with the experiment s . The subsequent pool fire that develops from the unburned sodium spray is a significant characteristic of the T3 experiment. SPHIN CS showed better long - term agreement with the SNL T3 experiment than CONTAIN - LMR. The unexpected port failure during the SNL T4 experiment presented modelling challenges. The time at which the port failure occurred is unknown, but is believed to have occur red at about 11 seconds into the sodium spray fire. The sensitivity analysis for the SNL T4 experiment shows that with a port failure, the sodium spray fire can still maintain elevated pressures during the spray.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

GlideinBenchmark: collecting resource information to optimize provisioning

Choosing the right resource can speed up job completion, better utilize the available hardware, and visibly reduce costs, especially when renting computers in the cloud. This was demonstrated in earlier studies on HEPCloud. However, the benchmarking of the resources proved to be a laborious and time-consuming process. This paper presents GlideinBenchmark, a new Web application leveraging the pilot infrastructure of GlideinWMS to benchmark resources, and it shows how to use the data collected and published by GlideinBenchmark to automate the optimal selection of resources. An experiment can select the benchmark or the set of benchmarks that most closely evaluate the performance of its workflows. GlideinBenchmark, with the help of the GlideinWMS Factory, controls the benchmark execution. Finally, a scheduler like HEPCloud's Decision Engine can use the results to optimize resource provisioning.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2016

Assessing the ability of $\mathrm{MODIS}$ $\mathrm{EVI}$ to estimate terrestrial ecosystem gross primary production of multiple land cover types

Terrestrial ecosystem gross primary production (GPP) is the largest component in the global carbon cycle. The enhanced vegetation index (EVI) has been proven to be strongly correlated with annual GPP within several biomes. However, the annual GPP-EVI relationship and associated environmental regulations have not yet been comprehensively investigated across biomes at the global scale. In this report we explored relationships between annual integrated EVI (iEVI) and annual GPP observed at 155 flux sites, where GPP was predicted with a log-log model: 1n(GPP) = a x 1n(iEVI) + b. iEVI was computed from MODIS monthly EVI products following removal of values affected by snow or cold temperature and without calculating growing season duration. Through categorisation of flux sites into 12 land cover types, the ability of iEVI to estimate GPP was considerably improved (R 2 from 0.62 to 0.74, RMSE from 454.7 to 368.2 g C m -2 yr -1 ). The biome-specific GPP-iEVI formulae generally showed a consistent performance in comparison to a global benchmarking dataset (R 2 = 0.79, RMSE = 387.8 g C m -2 yr -1 ). Specifically, iEVI performed better in cropland regions with high productivity but poorer in forests. The ability of iEVI in estimating GPP was better in deciduous biomes (except deciduous broadleaf forest) than in evergreen due to the large seasonal signal in iEVI in deciduous biomes. Likewise, GPP estimated from iEVI was in a closer agreement to global benchmarks at mid and high-latitudes, where deciduous biomes are more common and cloud cover has a smaller effect on remote sensing retrievals. Across biomes, a significant and negative correlation (R 2 = 0.37, p < 0.05) was observed between the strength (R 2 ) of GPP-iEVI relationships and mean annual maximum leaf area index (LAI max ), and the relationship between the strength and mean annual precipitation followed a similar trend. LAI max also revealed a scaling effect on GPP-iEVI relationships. Our results suggest that iEVI provides a very simple but robust approach to estimate spatial patterns of global annual GPP whereas its effect is comparable to various light-use-efficiency and data-driven models. The impact of vegetation structure on accuracy and sensitivity of EVI in estimating spatial GPP provides valuable clues to improve EVI-based models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Effect of Computational Schemes on Coupled Flow and Geo-Mechanical Modeling of CO 2 Leakage through a Compromised Well

Carbon capture, utilization, and storage (CCUS) describes a set of technically viable processes to separate carbon dioxide (CO 2 ) from industrial byproduct streams and inject it into deep geologic formations for long-term storage. Legacy wells located within the spatial domain of new injection and production activities represent potential pathways for fluids (i.e., CO 2 and aqueous phase) to leak through compromised components (e.g., through fractures or micro-annulus pathways). The finite element (FE) method is a well-established numerical approach to simulate the coupling between multi-phase fluid flow and solid phase deformation interactions that occur in a compromised well system. We assumed the spatial domain consists of a three-phases system: a solid, liquid, and gas phase. For flow in the two fluids phases, we considered two sets of primary variables: the first considering capillary pressure and gas pressure (PP) scheme, and the second considering liquid pressure and gas saturation (PS) scheme. Fluid phases were coupled with the solid phase using the full coupling (i.e., monolithic coupling) and iterative coupling (i.e., sequential coupling) approaches. The challenge of achieving numerical stability in the coupled formulation in heterogeneous media was addressed using the mass lumping and the upwinding techniques. Numerical results were compared with three benchmark problems to assess the performance of coupled FE solutions: 1D Terzaghi’s consolidation, Liakopoulos experiments, and the Kueper and Frind experiments. We found good agreement between our results and the three benchmark problems. For the Kueper and Frind test, the PP scheme successfully captured the observed experimental response of the non-aqueous phase infiltration, in contrast to the PS scheme. These exercises demonstrate the importance of fluid phase primary variable selection for heterogeneous porous media. We then applied the developed model to the hypothetical case of leakage along a compromised well representing a heterogeneous media. Considering the mass lumping and the upwinding techniques, both the monotonic and the sequential coupling provided identical results, but mass lumping was needed to avoid numerical instabilities in the sequential coupling. Additionally, in the monolithic coupling, the magnitude of primary variables in the coupled solution without mass lumping and the upwinding is higher, which is essential for the risk-based analyses.

deformation flow↗
DOE OSTI2023

Benchmark Specifications for TREAT Tests M5, M6, and M7

Detailed information describing three TREAT tests performed on metallic fuels has been collected and organized for use as a benchmark in evaluating the performance of metallic fuel models and codes. The tests, designated M5, M6, and M7, subjected EBR-II-irradiated fuel pins to a single type of overpower transient (at prototypical conditions with full coolant flow and an exponential power rise on an 8 second period) in flowing sodium loops. Six fuel pins were tested; five were ternary (U-19Pu-10Zr) alloy fuel clad in D9 with burnup ranging from 0.8 to 9.8 at. %, and one was binary alloy fuel (U-10Zr) clad in HT9 with 2.9 at. % burnup. The information gathered from the test records is expected to be useful for pre-transient characterization of the irradiated fuel pins as well as the transient analysis of the metallic fuel when subjected to severe accident conditions. This report presents benchmark specifications for the M5, M6, and M7 TREAT tests, identifies where primary sources of benchmark-related information can be found, and includes background information to help a user of the data understand their applicability and limitations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

A Benchmark Suite for Evaluating Scientific AI Workloads on GPUs

AI applications have been steadily increasing in the allocation portfolio among leadership computing facilities. These applications depend on deep learning frameworks with hardware acceleration and underlying software systems. With the rapid development of applications, software stacks, and hardware devices, it is essential to evaluate the performance of core operations in AI workloads for direction of optimizations and procurement of next-generation high-performance computing (HPC) infrastructures. Currently, most benchmarks lack scientific AI workloads. So, we present DeepKernelBench and the experimental results of evaluating the benchmark suite for early observations and performance comparisons on datacenter GPUs using representative workloads for scientific AI, including Attentions, General matrix multiplications, Geometrics and Fourier neural operations.

Jin, Zheming [Advanced Micro Devices (AMD)]↗
DOE OSTI2020

Fast-Spectrum Critical Assemblies with a Pb-HEU Core Surrounded by a Copper Reflector

The Department of Energy invests tens of millions of dollars each year to develop the next generation of nuclear engineering modeling & simulation (M&S) tools. These M&S tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers become more powerful, we are able to enhance resolution in our calculations. This improved resolution is taking us to a point where the limitations of simulation capability are in the quality of data, including our ability to quantify the uncertainty and sensitivity of the data. In order to accurately model systems of interest, the industry must improve key nuclear data measurements and our confidence of how well we understand the data. Thus, M&S tools need evaluated and quality-assured experimental data for validation purposes. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles benchmark experiment data in a handbook that can be used by criticality safety engineers to validate computer codes and cross-section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. Figure 1 organizes all the benchmark evaluations that have been performed by the isotope of interest, in this case Pb, and the neutron energy within the system. Compared to other isotopes of interest for nuclear applications, there are few benchmark evaluations for Pb systems. This has caused the latest nuclear cross-section libraries to over/underestimate changes in the neutron population compared to experimental results. Therefore, this evaluation fills an important knowledge gap in benchmark evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Status of HEU-Pb in the International Criticality Safety Benchmark Evaluation Project (ICSBEP) Handbook

The Department of Energy invests tens of millions of dollars each year to develop the next generation of nuclear engineering modeling & simulation (M&S) tools. These tools are used to analyze advanced reactor designs and the safety of current nuclear operations. As computers become more powerful, we are able to enhance resolution in our calculations. This improved resolution is taking us to a point where the limitations of simulation capability are in the quality of data, including our ability to quantify the uncertainty and sensitivity of the data. In order to model systems of interest with increasing accuracy, the industry must improve key nuclear data measurements. Thus, M&S tools need evaluated and quality-assured experimental data for validation purposes. The International Criticality Safety Benchmark Evaluation Project (ICSBEP) compiles and evaluates experiment data in a handbook that can be used by criticality safety engineers and others to validate computer codes and cross-section libraries at nuclear facilities. Both critical and subcritical experiments are included in the handbook. Figure 1 organizes all the benchmark evaluations that have been performed by the isotope of interest, in this case Pb, and the average neutron energy the system. Compared to other isotopes of interest for nuclear applications, there are few benchmark evaluations for Pb systems. The lack of integral measurements to determine errors in Pb cross-section data has caused the latest nuclear cross-section libraries to over/underestimate k eff compared to experimental results. Therefore, this evaluation fills an important knowledge gap in benchmark evaluations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

LCIO

Performance of file systems shift during their life cycles. Evaluating this performance change over time is not trivial. Complexity arises in the interplay between external (i.e. application I/O workloads) and internal (i.e. the filesystem state) factors. Many benchmarks can test how a filesystem performs at the current snapshot state, but to observe the change over time necessitates that the filesystem state mutate (age) between benchmark runs. For a large-scale HPC parallel filesystem, the sheer scale and amount of interacting components during I/O operations magnify these challenges. LCIO addresses the question - how will the filesystem perform at different stages of its life cycle? LCIO is a synthetic benchmark, which provides the file system aging process to increase the amount of information that existing benchmarks like IOR and MDTest yield, as well as provide additional points of data that will be useful to system architects and engineers.

Bachstein, Matthew↗
DOE OSTI2016

Evolution of N-Coordinated Iron–Carbon (FeNC) Catalysts and Their Oxygen Reduction (ORR) Performance in Acidic Media at Various Stages of Catalyst Synthesis: An Attempt at Benchmarking

The objective of this study was to understand the role of iron and the heat treatment steps involved in nitrogen-coordinated iron-carbon (FeNC) catalyst synthesis. We have studied the oxygen reduction reaction (ORR) performance of these catalysts as they evolve from their most crude and inactive form to their most active form. Electrochemical half-cell and fuel cell tests suggest that the presence of Fe was crucial in these samples. The high-temperature heat treatment (once in argon and then in ammonia) at temperatures ≥950 °C were also critical in imparting these catalysts with their highest activity; however, significant loss of activity was observed with cycling and potential hold at 0.5 V for 100 h. In addition, acid-washing after the first or the second pyrolysis steps produced a marked decrease in ORR activity relative to their unwashed counterparts. We also report findings from our efforts towards benchmarking FeNC catalysts for oxygen reduction reaction electrocatalysis. Specifically, we focus on correlating the specific kinetic current (iK) at 0.75 V to electrochemically accessible surface area (EASA) and roughness factor (RF) determined from electrochemical double layer capacitance measurements. 57 Fe Mössbauer spectroscopy was employed to shed light into the nature of active sites in FeNC catalysts and provide insights into their deactivation behavior caused by acid-washing. The results suggest planar FeN 4 doublet (Fe 2+ , low spin) as an active site in these materials, which may be leached away in acid, explaining their decreased activity after acid washing. Results for characterization experiments using X-ray photoelectron spectroscopy, temperature programmed oxidation and X-ray absorption spectroscopy, superconducting quantum interference device magnetometry are also presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Benchmarking large language models for materials synthesis: The case of atomic layer deposition

In this work, we introduce an open-ended question benchmark, ALDbench, to evaluate the performance of large language models (LLMs) in materials synthesis, and, in particular, in the field of atomic layer deposition, a thin film growth technique used in energy applications and microelectronics. Our benchmark comprises questions with a level of difficulty ranging from the graduate level to domain expert current with the state of the art in the field. Human experts reviewed the questions along the criteria of difficulty and specificity, and the model responses along four different criteria: overall quality, specificity, relevance, and accuracy. We ran this benchmark on an instance of OpenAI’s GPT-4o. The responses from the model received a composite quality score of 3.7 on a 1–5 scale, consistent with a passing grade. However, 36% of the questions received at least one below average score. An in-depth analysis of the responses identified at least five instances of suspected hallucination. Finally, we observed statistically significant correlations between the difficulty of the question and the quality of the response, the difficulty of the question and the relevance of the response, the specificity of the question, and the accuracy of the response as graded by the human experts. Furthermore, this emphasizes the need to evaluate LLMs across multiple criteria beyond difficulty or accuracy.

Artificial intelligence↗