Search NASA⌕ Search

SEARCH · Search NASA

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Resolving broadening of ECRH deposition due to edge turbulence in DIII-D by heat deposition measurement

Interaction between microwave power, used for local heating and mode control, and density fluctuations can produce a broadening of the injected beam, as confirmed in experiment and simulation. Increased power deposition width could impact suppression of tearing mode structures on ITER[1]. This work discusses the experimental portion of an effort to understand scattering of injected microwaves by turbulence on the DIII-D tokamak. The corresponding theoretical modeling work can be found in M.B. Thomas et. al.: Submitted to Nuclear Fusion (2017)[Author Note - this paper to be published in same journal]. In a set of perturbative heat transport experiments, tokamak edge millimeter-scale fluctuation levels and microwave heat deposition are measured simultaneously. Beam broadening is separated from heat transport through fitting of modulated fluxes[2]. Electron temperature measurements from a 500 kHz, 48-channel ECE radiometer are Fourier analyzed and used to calculate a deposition-dependent flux[3]. Consistency of this flux with a transport model is evaluated. A diffusive(∝ ∇˜ T e ) and convective(∝ ˜ T e ) transport solution is linearized and compared with energy conservation-derived fluxes. Comparison between these two forms of heat flux is used to evaluate the quality of ECRF deposition profiles, and a Χ 2 minimization finds a significant broadening of 1D equilibrium ray tracing calculations from the benchmarked TORAY-GA ray tracing code[4] is needed. The physical basis, cross-validation, and application of the heat flux method is presented. The method is applied to a range of DIII-D discharges and finds a broadening factor of the deposition profile width which scales linearly with edge density fluctuation level. Furthermore, these experimental results are found to be consistent with the full-wave beam broadening measured by the 3D full wave simulations in the same discharges[5].

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

sKokkos: Enabling Kokkos with Transparent Device Selection on Heterogeneous Systems using OpenACC

This paper presents a new feature to enable Kokkos with transparent device selection. For application developers, it is not easy toidentify which device is the most appropriate to use in a heterogeneous system, since this depends on the characteristics of both the application and the hardware. In Kokkos, a backend is associated with one specific programming model/hardware. Programmers decide which backend to use at compilation time. This new feature implemented on the OpenACC backend eliminates the burden of deciding which device to use, providing a highly productive programming solution for Kokkos applications. This work includes implementation details and a performance study conducted with a set of mini-benchmarks (i.e., AXPY and dot product), kernels (Lattice-Bolzmann method), and two mini-apps (LULESH and miniFE) on two heterogeneous systems with different hardware capabilities. This new Kokkos feature provides high accelerations of up to 35× thanks to automatic and transparent device selection.

Lee, Seyong↗

The Verification and Validation of a Magnetic Plasma Fluid Model Utilizing the MOOSE (Multiphysics Object Oriented Simulation Environment) Framework

As the goal of achieving fusion power on the grid comes closer to fruition, fully coupled multiphysics models of fusion devices will be crucial. Currently, there are two main approaches to developing these platforms: (1) loosely coupled, where one couples existing codes and solvers together through input and output parameters and data, and (2) tightly coupled, where one develops the necessary models within a singular, integrated framework. This work focuses on the latter approach for magnetically confined fusion devices by developing a fluid-based plasma-edge model within the Multiphysics Object Oriented Simulation Environment (MOOSE) Framework. This effort is coordinated with other efforts to develop, test, demonstrate, and deploy fusion relevant multiphysics capabilities including electromagnetics, particle-in-cell plasma, tritium transport, and fusion blanket design. This new model is an expansion of the MOOSE-based plasma application, Zapdos, which was originally formulated to model low-temperature, non-magnetized plasma processes. Verification, benchmarking, and validation studies have been conducted. Verification studies involved utilizing the method of manufactured solutions and comparing the convergence slope of a known solution to the theoretical slope. Benchmarking consists of comparisons to existing edge codes, namely BOUT++ and SOLEDGE3X. Validation efforts focused on comparisons against open-source data from the TCV tokamak.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Bogoliubov dynamics of condensate collisions using the positive-P representation

We formulate the time-dependent Bogoliubov dynamics of colliding Bose-Einstein condensates in terms of a positive-P representation of the Bogoliubov field. We obtain stochastic evolution equations for the field which converge to the full Bogoliubov description as the number of realizations grows. The numerical effort grows linearly with the size of the computational lattice. We benchmark the efficiency and accuracy of our description against Wigner distribution and exact positive-P methods. We consider its regime of applicability, and show that it is the most efficient method in the common situation when the total particle number in the system is insufficient for a truncated Wigner treatment.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

miniGMG

miniGMG is a compact geometric multigrid (MG benchmark designed to proxy the performance characteristics of the solves found in adaptive mesh refinement multigrid (AMR MG) applications. It solves the equation a*alpha*u - b div beta grad u = f on a large cubical domain using cell-centered values and periodic boundaries. a and b are scalar constants, alpha and beta are space varying constants, f is the right hand side, and u is the solution. The cubical domain is divided into cubical subdomains which are distributed across the supercomputer. The righthand side f is generated from a continuous function for u. Thus, one can solve this linear system of equations and verify the error properties of the discrete solution u by comparing to a sampling of the continuous u. miniGMG implements both v- and f- cycles, as well as two constant coeffficient discretications of the equation above (one 27pt 2nd order, and one 13pt 4th order). In both cases, the (embedded) v-cycles are truncated when a subdomain reaces 4^3, 2^3, or 1^3 cells (a u-cycle). The multigrd solver then swtiches to one of seven coarse grid (bottom) solves. relaxation, BiCGStab, CABiCGStab, TelescopingCABiCGStab, CG, or CACG. The code exploits two forms of communication-avoiding. The first is exemplified by the referenced SC'12 paper in which DRAM data movment is avoided when smoothing. The second, described in the IPDPS'14 paper avoids collectives in a bottom solve (the CA bottom solves). There are a number of implementations of the operators for both CPUs and NVIDIA GPUs. The CPUs have been optimized to exploit a wavefront approach to communication-avoiding. The GPU versions include a number of optimized and tunable implementations. The code has been demonstrated to scale to 46K nodes on the BGQ Mira (750K cores), 9K nodes on Edison (111K cores), and 14K GPUs on Titan (37M cuda cores). It thus acts as a scalable testbed for a wide range of computer science and applied math research. Nominally, one invokes the benchmark as ./run b x y z alpha beta gamma Each subdomain is (2^b)^3 cells Each MPI process receives a x-by-y-by-z collection of subdomains. There are alpha*beta*gamma total MPI processes For correctness (a cubical domain), *alpha==y*beta==z*gamma.

Williams, Sameul↗

CFD analysis of pump consortium impeller

Current design of high performance turbopumps for rocket engines requires effective and robust analytical tools to provide design impact in a productive manner. The main goal of this study is to develop a robust and effective computational fluid dynamics (CFD) pump model for general turbopump design and analysis applications. A Navier-Stokes flow solver, FDNS, embedded with the extended k-epsilon turbulence model and with appropriate moving interface boundary conditions, is developed to analyze turbulent flows in the turbomachinery devices. The FDNS code was benchmarked with its numerical predictions of the pump consortium inducer, and provides satisfactory results. In the present study, a CFD analysis of the pump consortium impeller will be conducted with the application of the FDNS code. The pump consortium impeller, with partial blades, is the new design concept of the advanced rocket engine.

Cheng, Gary C.↗

A Subgrid Approach for Modeling Microtopography Effects on Overland Flow

Microtopography, or heterogeneities in the elevation across scales much smaller than the domain of interest, plays a critical role in surface water retention, surface/subsurface interactions, and runoff. Resolving microtopographic influences on flow requires high–resolution simulations, which are computationally demanding even when considering the surface system in isolation and even more so when surface flow is one component in integrated simulations that couple surface flow with unsaturated subsurface flow. There is thus significant motivation for models that allow the effects of subgrid microtopography to be better represented. Subgrid models modify coarsened models to capture the microtopography–induced nonlinear effects on hydrologic processes. We present a subgrid model that alters the water storage and flow terms in the diffusion wave equation for surface flow. Stochastically generated microtopography with strongly contrasting spatial structure, high–resolution digital elevation maps from a polygonal tundra site on the North Slope of Alaska and a hummocky microtopography from a field site in Northern Minnesota are used to assess the accuracy and applicability of the subgrid model to disparate landscapes. Approaches for determining subgrid model parameters are tested and simulation results using the subgrid model are compared to benchmark fine–scale simulations and to coarse simulations that ignore microtopography. Our findings confirm that a properly parameterized subgrid model greatly improves the coarse–scale representation of hydrographs and total water content in the system. Furthermore, using the polygonal tundra example, we propose and test a strategy for moving to application–relevant spatial scales by combining microtopography classification and a few fine–scale simulations on small subdomains.

54 ENVIRONMENTAL SCIENCES↗

Tools for Simulation and Benchmark Generation at Exascale

The path to exascale high-performance computing (HPC) poses several challenges related to power, performance, resilience, productivity, programmability, data movement, and data management. Investigating the performance of parallel applications at scale on future architectures and the performance impact of different architecture choices is an important component of HPC hardware/software co-design. Simulations using models of future HPC systems and communication traces from applications running on existing HPC systems can offer an insight into the performance of future architectures. This work targets technology developed for scalable application tracing of communication events and memory profiles, but can be extended to other areas, such as I/O, control flow, and data flow. It further focuses on extreme-scale simulation of millions of Message Passing Interface (MPI) ranks using a lightweight parallel discrete event simulation (PDES) toolkit for performance evaluation. Instead of simply replaying a trace within a simulation, the approach is to generate a benchmark from it and to run this benchmark within a simulation using models to reflect the performance characteristics of future-generation HPC systems. This provides a number of benefits, such as eliminating the data intensive trace replay and enabling simulations at different scales. The presented work utilizes the ScalaTrace tool to generate scalable trace files, the ScalaBenchGen tool to generate the benchmark, and the xSim tool to run the benchmark within a simulation.

Lagadapati, Mahesh↗

Benchmarking of neutron production of heavy-ion transport codes

Document available in abstract form only, full text of document follows: Accurate prediction of radiation fields generated by heavy ion interactions is important in medical applications, space missions, and in design and operation of rare isotope research facilities. In recent years, several well-established computer codes in widespread use for particle and radiation transport calculations have been equipped with the capability to simulate heavy ion transport and interactions. To assess and validate these capabilities, we performed simulations of a series of benchmark-quality heavy ion experiments with the computer codes FLUKA, MARS15, MCNPX, and PHITS. We focus on the comparisons of secondary neutron production. Results are encouraging; however, further improvements in models and codes and additional benchmarking are required. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reassessing the Origins and Contemporary Relevance of ck Acceptability Parameters: Evolving Perspectives on Similarity

“Sensitivity and Uncertainty Analyses Applied to Criticality Safety Validation,” introduces sensitivity and uncertainty methods to address challenges in defining and extending areas of applicability for criticality safety validation. These areas are traditionally defined by the bounds or limits on key parameters, but establishing valid ranges and managing complex parameter variations remain challenging. NUREG/CR-6655 introduces ck and other integral indices, as well as concepts such as the completeness of benchmark coverage, to better quantify system similarities. The work proposed herein seeks to evaluate these foundational concepts to ensure that the bounds remain effective in guiding the assessment of similarity and applicability in modern applications. The concept of completeness, along with other parameters envisioned within the framework, serves as an example of the foundational ideas that have been established, though their effectiveness in practice may not be fully understood. Advancements in scripting tools, coupled with the speed and efficiency of modern computing and statistical models, now allow for faster and more thorough assessments than previously possible. These advancements also enable the identification of trends within the data, which could provide additional insight into system behavior and further broaden the scope of previously performed benchmarks. By leveraging these capabilities, we will revisit and expand the scope of these foundational methods to determine whether the necessary elements for robust similarity evaluation are already embedded, partially realized, or remain untapped.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Block-structured adaptive mesh refinement - theory, implementation and application

Structured adaptive mesh refinement (SAMR) techniques can enable cutting-edge simulations of problems governed by conservation laws. Focusing on the strictly hyperbolic case, these notes explain all algorithmic and mathematical details of a technically relevant implementation tailored for distributed memory computers. An overview of the background of commonly used finite volume discretizations for gas dynamics is included and typical benchmarks to quantify accuracy and performance of the dynamically adaptive code are discussed. Large-scale simulations of shock-induced realistic combustion in non-Cartesian geometry and shock-driven fluid-structure interaction with fully coupled dynamic boundary motion demonstrate the applicability of the discussed techniques for complex scenarios.

99 GENERAL AND MISCELLANEOUS↗

Simulation, Challenge Testing and Validation of Solutions for Residential and Commercial Occupancy Sensing/Counting and CO2 Sensing (Final Report)

Carbon dioxide sensors used for monitoring and control applications in buildings are known to be sensitive to long term drift and can be affected by variations in temperature, humidity, other gas interferents, pressure and other factors that cannot be corrected through the typical auto-calibration methods often embedded in the sensor electronics. This investigation was part of the Category D defined in the ARPA-E Saving Energy Nationwide in Structures With Occupancy Recognition (SENSOR) Financial Assistance Funding Opportunity Announcement No. DE-FOA-0001737, FFDA No. 81.135, January 18, 2017. The FOA defined target criteria for the evaluation of the Category C commercial CO2 sensors selected for review and development through the ARPA-E SENSOR program and charged the Iowa State Category D team with developing an evaluation methodology for Category C sensors in accordance with these criteria. As part of the work, the Iowa State team chose to engage the standards community in the development of the evaluation methodology. Standard development work in the D22.05 Indoor Air and D22.03 Ambient Atmospheres and Source Emissions subcommittees of ASTM International Committee D22 on Air Quality on the evaluation of low cost sensors and provision of guidance for using indoor carbon dioxide concentrations to evaluate indoor air quality and ventilation is of particular relevance to the Category D efforts. To date, three draft standards with specific input by the Iowa State Category D team have passed the subcommittee balloting stage and are being balloted in December 2022 and January 2023 in the main D22 committee. In addition to the aforementioned standards to which the PI was a contributing author, intellectual property developed in this project pertaining to “An Automated System for Evaluation of the Long Term Performance of Carbon Dioxide Sensors” and “An Automated Ground Truth System for Real-Time Reliability Assessment, Capture of Control Decisions and Energy Savings Measurements for Occupancy Recognition Systems and Other Applications” are the other major deliverables of the project. These standards and the developed intellectual property are expected to benefit the public in a number of ways stemming from their provision of means to benchmark the performance of carbon dioxide and other sensor systems. In particular, there is high interest in techniques to demonstrate the performance of low-cost carbon dioxide sensors which can be used for typical HVAC applications (e.g., demand controlled ventilation, outdoor and indoor air monitoring, estimation of occupancy, etc.).

42 ENGINEERING↗

Status on NGST Mirror Technology

The NGST primary mirror is anticipated to be a segmented deployable optic with segment size being in the range of 1 - 3 m depending on the details of the architecture. The secondary mirror will likely be a monolith similar in size to one of the primary mirror segments. Over the past 4 years the NGST program has initiated and implemented an aggressive lightweight cryogenic mirror technology program. The program was designed to challenge and excite the optical community in reaching a new standard in production of lightweight optics. The goal was to develop optics at less than 15 kg/sq m, operational at approx. 40 K and meeting the overall NGST observatory requirement for diffraction limited performance at 2 microns. In order to meet the NGST needs, technology efforts were initiated to investigate and develop mirrors in a variety of materials, which held promise for the program. The basic technology approaches have initially targeted the production of large mirrors in the 1.2 - 2.0 m diameter range (or side-to-side distance in the case of hexagonal optics). Although this size may not be the final size of an NGST primary mirror segment, it was felt that a 1.2 - 2.0 m optic would be of sufficient size to understand the mirror material and fabrication processes which drive the cost and schedule of mirror production. The ultimate goals of the technology program are both to demonstrate mirrors meeting, the NGST performance requirements, and to establish cost and schedule credibility for producing and implementing the mirrors for the NGST flight system. Establishing cost and schedule credibility is essential to NGST which is a cost capped mission, with past program experience demonstrating that the optics will be a large portion of the total cost of the program. The first two years of the program were dedicated to understanding; the various applicable materials, funding those materials to various levels of maturity and implementing the first large mirror procurement, the NGST Mirror System Demonstrator (NMSD), in order to establish a benchmark for the state-of-the-art in lightweight optics and to establish credibility that the goals of NGST could be achieved. The past two years of the program has seen major steps in the development of several mirror materials, which not only might have NGST applicability but could also support other programs for other customers. Additionally, a second large mirror procurement, the Advanced Mirror System Demonstrator (AMSD), has been implemented providing a focal point to complete the mirror technology development and lead ultimately to the production of mirrors that will fly on NEXUS (the NGST flight experiment- discussed below) and NGST. This talk will focus on the mirror technology developed over the past 4 years on the NGST program.

Jacobson, David↗

Towards Neutron Capture on Exotic Nuclei: Demonstrating ( d , p γ ) as a Surrogate Reaction for ( n , γ )

The neutron-capture reaction plays a critical role in the synthesis of the elements in stars and is important for societal applications including nuclear power generation and stockpile-stewardship science. However, it is difficult—if not impossible—to directly measure neutron capture cross sections for the exotic, short-lived nuclei that participate in these processes. We demonstrate a new technique which can be used to indirectly determine neutron-capture cross sections for exotic systems. This technique makes use of the $(d,p)$ transfer reaction, which has long been used as a tool to study the structure of nuclei. Recent advances in reaction theory, together with data collected using this reaction, enable the determination of neutron-capture cross sections for short-lived nuclei. A benchmark study of the $^{95}\mathrm{Mo}(d,p)$ reaction is presented, which illustrates the approach and provides guidance for future applications of the method with short-lived isotopes produced at rare isotope accelerators.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Use of scaled BWR lower plenum boron mixing tests to qualify the boron transport model used in TRACG

In 2001 GEH applied best estimate methods combined with a statistical methodology to determine upper bound limits for key licensing parameters for anticipated operation occurrence (AOO) transient and anticipated transients without scram (ATWS) overpressure analyses for operating Boiling Water Reactors (BWRs). The methodology was subsequently extended for ESBWR AOO, ATWS, loss of coolant, and stability analyses. GEH is extending the methodology to long-term ATWS analyses for the operating BWRs. A long-term ATWS scenario uses injection of borated water to achieve reactor shutdown. Predicting the mixing and transport of boron is important for calculating the impact on the key licensing parameters. For the many operating BWRs where the denser boron solution is injected into the lower plenum, stratification may occur, delaying boron transport to the core region. CFD modeling can be used to model the stratification and mixing of the boron solution, but such calculations are extremely computer intensive and not cost effective; therefore, a more-empirical approach supported by a theoretical scaling of the dominant phenomena and backed by test data and benchmark calculations is used. The paper presents the TRACG lower plenum boron transport model qualification effort. The scaling basis used to implement the TRACG boron transport model for BWR applications is discussed. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Getting Started with VIBE as a DICE Plug-in Module

The use of the SCALE (Standardized Computer Analysis for Licensing Evaluation) tool VIBE (Validation, Interpretation and Bias Estimation) as a plug-in module to DICE (Database for the International Criticality Safety Benchmark Evaluation Project) to access and interpret sensitivity data is described. In this initial release of VIBE within DICE, VIBE can identify sensitivity data and group collapse the data into a table, where the values can be sorted and filtered to identify experiments that are the most similar to a targeted application system in terms of sensitivity data. VIBE can then retrieve information about the selected experiments from the DICE database to provide the physical characteristics of the benchmarks.

Rearden, Bradley T↗

OECD/NEA EGMPEBV Activities in Multi-Physics Verification and Validation

The Expert Group on Multi-Physics Experimental Data, Benchmarks and Validation (EGMPEBV) was established in 2014 by the Nuclear Energy Agency (NEA) at the Organization for Economic Co-operation and Development (OECD) to establish processes for certification of experimental data and development of benchmark models for validation of Multi-Physics (MP) Modeling and Simulation (M and S) computational systems. The aim of the group is to provide member countries with guidelines and recommendations for validating and improving their novel multi-physics simulations, and with an access to key experimental data. To be used to their full potential, these novel tools will require a more complex suite of validation experiments due to the multiple energy, spatial and temporal scales, as well as the number of physical phenomena being simulated. They will also require accurate measurements of all terms, including coupling terms representing the feedback effects, in situations where the appropriate experimental techniques and facilities might not exist today. However, the ability to conduct validation experiments has for certain applications progressed at a slower pace than for computational methods, or in some cases it has significantly regressed (through shutdown of facilities, or through retirement of experts). In addition, as modelling capabilities are reaching deeper levels in single physics phenomena and in coupled behaviors, appropriate experimental techniques may not yet exist. Validation of multiple physics models requires a wide variety of experimental data, which emphasizes the importance of maximizing the use of historically accumulated data to avoid the significant cost of performing similar experiments today. Moreover, the pedigree and quality of this data as it pertains to modern day simulation methods may be insufficient for rigorous validation of high fidelity modeling and simulation tools. Thus, these data can often exhibit limitations including a lack of measurement accuracy or a lack of knowledge of the measurement uncertainty in the experimental techniques; an absence of measurements for some critical parameters; an obscuring of relationships between individual physics phenomena owing to the output data resolution; or simply an inability to allow for a detailed reinterpretation of the experiments based on the documented information. The organization of the EGMPEBV relies on three Task Forces, focused on 1) Experimental Data Qualification and Benchmark Evaluation; 2) Methods and Standards, and 3) Specific Applications. Task Force 1 is focused on providing better and more accurate experimental datasets, which support validation of high-fidelity multi-physics modelling and simulation (M and S) tools. At the same time it has to consider the incompleteness of past experimental data sets (in terms of data, documentation, or uncertainties) and with the limited number of available multi-physics experimental facilities. Task Force 2 is designed to develop validation methods and guidelines, and uncertainty qualification for the new family of multi-physics, multi-scale codes in the context of emerging demands such as longer fuel cycles and power uprate. Task Force 3 is focused on applications of validation experiments and has the objective to organize multi-physics M and S benchmarks involving validation experiments.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Benchmarking the performance of uncertainty quantification methods for neural network-based interatomic potentials

Machine-learned interatomic potentials (ML-IAPs) continue to gain popularity as accurate, computationally efficient replacements for traditional, physics-based interatomic potentials and expensive ab initio methods. Uncertainty quantification (UQ) of ML-IAPs is a growing area of research as UQ is critical in many applications of IAPs, such as developing curated datasets, active learning-based data augmentation, self-improving models, and estimating the uncertainty of molecular dynamics simulations. In this paper, we construct and benchmark a series of different neural network potentials (NNPs) with varying network architectures to determine the performance of these models with respect to both the mean and uncertainty calibration error. Each NNP method is specifically designed to predict either epistemic or aleatoric uncertainty with particular focus on the differences in behavior between the epistemic and aleatoric uncertainty estimates. We benchmark these methods using multiple datasets common in the ML-IAP literature. The results show that the aleatoric uncertainty from single-shot model architectures is a competitive alternative to ensemble-based epistemic uncertainty predictions in regions of sufficient data-density. However, in regions where the representative data is sparse, aleatoric uncertainty models tend to overpredict and epistemic methods tend to underpredict the actual model error. We conclude that the type of UQ is crucial when discussing performance of probabilistic model results as different methods have different performance characteristics depending on the regime in which they are evaluated. Therefore, the type of UQ method should be carefully evaluated against both the data characteristics and requirements for the intended application.

97 MATHEMATICS AND COMPUTING↗