Search NASA⌕ Search

SEARCH · Search NASA

Results for “application benchmarks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗

ASCEM Pumping Test Capabilities: Benchmarking and Demonstration for UGTA at U-20 WW

The Advanced Simulation Capability for Environmental Management (ASCEM) High Performance Computing (HPC) simulator, Amanzi, was improved to simulate pumping tests in confined and unconfined aquifers. This report documents the testing and then application of those capabilities to simulate the U-20 WW pumping test on Pahute Mesa. Capabilities added to Amanzi include (1) transient Darcy flow with adaptive time stepping; (2) application of the specific yield term in cells representing unconfined conditions at the water table along the top of model and specific storage at other cells; (3) source/sink term; and (4) hydraulic head boundary conditions. These capabilities are benchmarked using an analytical solution and an existing numerical code. Then, they are implemented in a set of demonstration simulations for UGTA's U-20 WW pumping test.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Data Repository for Power system Open models With Evolving Resources (DR POWER) (Final Scientific/Technical Report)

Pacific Northwest National Laboratory (PNNL) and the National Rural Electric Cooperative Association (NRECA) created a Data Repository for Power system Open models With Evolving Resources (DR POWER) to establish, curate, and evolve open-access power grid models and scenarios, and measurements and observations, collectively referred to as datasets. Existing open-access datasets are inadequate (too small and not representative of the complexity of the modern grid, and scattered all over the world wide web) for the investigation and benchmarking of the advanced optimization methods needed for next-generation grids. Open-access datasets are static and inadequate in other aspects: they do not provide format transformation tools; there is missing information needed for advanced applications; hard to cite; no model evolution history; difficult to update current collections; and little to no community involvement and feedback. Overall, the current landscape is hindering model evolution and benchmarking standards needed for transformational approaches to be developed, tested, and accepted by the power modeling community.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Iso-Energy-Efficiency: An Approach to Power Constrained Parallel Computation

Future large scale high performance supercomputer systems require high energy efficiency to achieve exaflops computational power and beyond. Despite the need to understand energy efficiency in high-performance systems, there are few techniques to evaluate energy efficiency at scale. In this paper, we propose a system level iso-energy-efficiency model to analyze, evaluate and predict energy-performance of data intensive parallel applications with various execution patterns running on large scale power-aware clusters. Our analytical model can help users explore the effects of machine and application dependent characteristics on system energy efficiency and isolate efficient ways to scale system parameters (e.g. processor count, CPU power/frequency, workload size and network bandwidth) to balance energy use and performance. We derive our iso-energy-efficiency model and apply it to the NAS Parallel Benchmarks on two power-aware clusters. Our results indicate that the model accurately predicts total system energy consumption within 5% error on average for parallel applications with various execution and communication patterns. We demonstrate effective use of the model for various application contexts and in scalability decision-making.

Song, Shuaiwen↗

Identification of Integral Benchmarks for Nuclear Data Testing Using DICE (Database for the International Handbook of Evaluated Criticality Safety Benchmark Experiments)

Typical users of the International Criticality Safety Evaluation Project (ICSBEP) Handbook have specific criteria to which they desire to find matching experiments. Depending on the application, those criteria may consist of any combination of physical or chemical characteristics and/or various neutronic parameters. The ICSBEP Handbook contains a structured format helping the user narrow the search for experiments of interest. However, with nearly 4300 different experimental configurations and the ever increasing addition of experimental data, the necessity to perform multiple criteria searches have rendered these features insufficient. As a result, a relational database was created with information extracted from the ICSBEP Handbook. A users’ interface was designed by OECD and DOE to allow the interrogation of this database. The database and the corresponding users’ interface are referred to as DICE. DICE currently offers the capability to perform multiple criteria searches that go beyond simple fuel, physical form and spectra and includes expanded general information, fuel form, moderator/coolant, neutron-absorbing material, cladding, reflector, separator, geometry, benchmark results, spectra, and neutron balance parameters. DICE also includes the capability to display graphical representations of neutron spectra, detailed neutron balance, sensitivity coefficients for capture, fission, elastic scattering, inelastic scattering, nu-bar and mu-bar, as well as several other features.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Physics-Based Methods of Failure Analysis and Diagnostics in Human Space Flight

The Integrated Health Management (IHM) for the future aerospace systems requires to interface models of multiple subsystems in an efficient and accurate information environment at the earlier stages of system design. The complexity of modern aeronautic and aircraft systems (including e.g. the power distribution, flight control, solid and liquid motors) dictates employment of hybrid models and high-level reasoners for analysing mixed continuous and discrete information flow involving multiple modes of operation in uncertain environments, unknown state variables, heterogeneous software and hardware components. To provide the information link between key design/performance parameters and high-level reasoners we rely on development of multi-physics performance models, distributed sensors networks, and fault diagnostic and prognostic (FD&P) technologies in close collaboration with system designers. The main challenges of our research are related to the in-flight assessment of the structural stability, engine performance, and trajectory control. The main goal is to develop an intelligent IHM that not only enhances components and system reliability, but also provides a post-flight feedback helping to optimize design of the next generation of aerospace systems. Our efforts are concentrated on several directions of the research. One of the key components of our strategy is an innovative approach to the diagnostics/prognostics based on the real time dynamical inference (DI) technologies extended to encompass hybrid systems with hidden state trajectories. The major investments are into the multiphysics performance modelling that provides an access of the FD&P technologies to the main performance parameters of e.g. solid and liquid rocket motors and composite materials of the nozzle and case. Some of the recent results of our research are discussed in this chapter. We begin by introducing the problem of dynamical inference of stochastic nonlinear models and reviewing earlier results. Next, we present our analytical approach to the solution of this problem based on the path integral formulation. The resulting algorithm does not require an extensive global search for the model parameters, provides optimal compensation for the effects of dynamical noise, and is robust for a broad range of dynamical models. In the following Section the strengths of the algorithm are illustrated illustrated by inferring the parameters of the stochastic Lorenz system and comparing the results with those of earlier research. Next, we discuss a number of recent results in application to the development of the IHM for aerospace system. Firstly, we apply dynamical inference approach to a solution of classical three tank problems with mixed unknown continuous and binary parameters. The problem is considered in the context of ground support system for filling fuel tanks of liquid rocket motors. It is shown that the DI algorithm is well suited for successful solution of a hybrid version of this benchmark problem even in the presence of additional periodic and stochastic perturbation of unknown strength. Secondly, we illustrate our approach by its application to an analysis of the nozzle fault in a solid rocket motor (SRM). The internal ballistics of the SRM is modelled as a set of one-dimensional partial differential equations coupled to the dynamics of the propellant regression. In this example we are specifically focussed on the inference of discrete and continuous parameters of the nozzle blocking fault and on the possibility of an application of the DI algorithm to reducing the probability of "misses" of an on-board FD&P for SRM. In the next section re-contact problem caused by first stage/upper stage separation failure is discussed. The reaction forces imposed on the nozzle of the upper stage during the re-contact and their connection to the nozzle damage and to the thrust vector control (TVC) signal are obtained. It is shown that transient impact induced torquean be modelled as a response of an effective damped oscillator. A possible application of the DI algorithm to the inference of damage parameters and predicting fault dynamics ahead of time using the actuator signal is discussed. Finally, we formulate Bayesian inferential framework for development of the IHM system for in-flight structural health monitoring (SHM) of composite materials. We consider the signal generated by piezoelectric actuator mounted on composite structure generating elastic waves in it. The signal received by the sensor is than compared with the baseline signal. The possibility of damage inference is discussed in the context of development of the SHM.

Smelyanskiy, Vadim N.↗

Standardized benchmarking in the quest for orthologs

Achieving high accuracy in orthology inference is essential for many comparative, evolutionary and functional genomic analyses, yet the true evolutionary history of genes is generally unknown and orthologs are used for very different applications across phyla, requiring different precision–recall trade-offs. As a result, it is difficult to assess the performance of orthology inference methods. Here, we present a community effort to establish standards and an automated web-based service to facilitate orthology benchmarking. Using this service, we characterize 15 well-established inference methods and resources on a battery of 20 different benchmarks. Standardized benchmarking provides a way for users to identify the most effective methods for the problem at hand, sets a minimum requirement for new tools and resources, and guides the development of more accurate orthology inference methods.

59 BASIC BIOLOGICAL SCIENCES↗

Plaster: An Integration, Benchmark and Development Framework for Heterogeneous Metadata Normalization Methods

The recent advances in the automation of metadata normalization and the invention of a unified schema — Brick — alleviate the metadata normalization challenge for deploying portable applications across buildings. Yet, the lack of compatibility between existing metadata normalization methods precludes the possibility of comparing and combining them. While generic machine learning (ML) frameworks, such as MLJAR and OpenML, provide versatile interfaces for standard ML problems, they cannot easily accommodate the metadata normalization tasks for buildings due to the heterogeneity in the inference scope, type of data required as input, evaluation metric, and the building-specific human-in-the-loop learning procedure. We propose Plaster, an open and modular framework that incorporates existing advances in building metadata normalization. It provides unified programming interfaces for various types of learning methods for metadata normalization and defines standardized data models for building metadata and timeseries data. Thus, it enables the integration of different methods via a workflow, benchmarking of different methods via unified interfaces, and rapid prototyping of new algorithms. With Plaster, we 1) show three examples of the workflow integration, delivering better performance than individual algorithms, 2) benchmark/analyze five algorithms over five common buildings, and 3) exemplify the process of developing a new algorithm involving time series features. We believe Plaster will facilitate the development of new algorithms and expedite the adoption of standard metadata schema such as Brick, in order to enable seamless smart building applications in the future.

99 GENERAL AND MISCELLANEOUS↗

Finding a common ground for RCM experiments. Part B: Benchmark study on ethanol ignition

Rapid compression machines (RCMs) are widely used to investigate gas phase reaction kinetics of various kind of fuels at application relevant conditions. In principle, the operation of an RCM is based on the idea of compressing a homogenous pre-mixed fuel-air mixture by a piston. Usually creviced pistons ensure a homogenous adiabatic core in the center of the reaction chamber which permits the assumption of an isentropic relation between the measured pressure and gas temperature. Despite the ideal core gas compression, non-ideal effects such as heat loss, differences in the compression behavior, and ultimately non-standardized design and operation of rapid compression machines lead to different experimental results in different facilities at nominally the same end of compression conditions. In this study ignition delay times of ethanol are investigated at four different conditions in five independent RCMs. As expected, the raw results of the different facilities indeed show notable differences at the same end of compression conditions. However, according to the adiabatic core hypothesis the agreement between kinetic simulations and experiments should be consistent for all facilities provided that the facility effects are correctly accounted for. To elaborate upon this hypothesis, a kinetic mechanism is optimized to reflect the experimental results of all facilities. In the end, the optimized mechanism predicts all experimental data within the expected uncertainty. This confirms the reliability of RCM experiments for kinetic investigations and the validity of the effective volume approach in simulating RCM data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Systematic design of active spaces for multi-reference calculations of singlet–triplet gaps of organic diradicals, with benchmarks against doubly electron-attached coupled-cluster data

Singlet–triplet gaps in diradical organic π-systems are of interest in many applications. In this work, we calculate them in a series of molecules, including cyclobutadiene and its derivatives and cyclopentadienyl cation, by using correlated participating orbitals within the complete active space (CAS) and restricted active space (RAS) self-consistent field frameworks, followed by second-order perturbation theory (CASPT2 and RASPT2). These calculations are evaluated by comparison with the results of doubly electron-attached (DEA) equation-of-motion (EOM) coupled-cluster (CC) calculations with up to 4-particle–2-hole (4p-2h) excitations. Finally, we find active spaces that can accurately reproduce the DEA-EOMCC(4p-2h) data while being small enough to be applicable to larger organic diradicals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Preliminary efforts toward development of data handling and analysis software for unsteady flow measurements: An application for aeroelastic transonic flow configurations

A few years ago the Structural Dynamics Division at LaRC started ambitious experimental research efforts known as the Benchmark Models Program. The primary objective of this program was to provide experimental data that may serve as a calibration source for computational fluid dynamics (CFD) efforts that deal with aeroelastic unsteady flow configurations. It also focuses on the understanding of complex flow phenomenon associated with unsteady flow developments. The overall plan for the program has been described by Bennett, including a presentation of initial test results of flutter of a rigid wing mounted on flexible supports. An example of a test model employed to measure the dynamic response along with corresponding pressure distributions is shown. This model incorporates eighty pressure transducers distributed along two spanwise stations. In addition, the models are equipped with four accelerometers and two strain gages. The data handling system for the Benchmark Model Program is under development. Several interactive computer routines designed for the user interface, dynamic memory allocation, unsteady flow measurements data extraction, and further data processing were developed. To present a few examples of measured data, the unsteady pressure distributions and the wing model dynamic response were plotted.

Finaish, Fathi↗

ASSESSMENT OF MULTIPHASE CFD WITH ZERO CLOSURE MODEL FOR BOILING WATER REACTOR FUEL ASSEMBLIES

Extension of existing boiling closures to the high void fraction conditions of BWRs is one of challenges for M-CFD applications. This paper presents the assessment of an Eulerian M-CFD model with Zero closure model that has been specifically designed for two-phase flow and heat transfer applications in BWR fuel assemblies. The baseline Zero closure aims at including the simplest and most robust representation of the key physical mechanisms, rather than aiming at absolute accuracy of the predictions. The capabilities of M-CFD with Zero were evaluated against the international OECD/NRC BFBT benchmark data through the comparative analyses of local void fraction, sub-channel void fraction error and exit quality. INL high performance computing system has been employed to demonstrate the scalability of the M-CFD application to nuclear reactor fuel assemblies. The M-CFD simulation results show a good agreement with the experimental data for both quantitative and qualitative results, with the highest uncertainty being observed in the prediction of the local void fraction profile at low void fraction condition. This paper presents a recent view of the best practices for M-CFD of BWR fuel assemblies to provide a useful reference to identify and overcome common challenges in the applications of M-CFD tools. We provide recommendations for geometric modeling, mesh generation and solver configurations to optimize the methodology application.

97 MATHEMATICS AND COMPUTING↗

Benchmark microgravity experiments and computations for 3D dendritic-array stability in directional solidification

In this study, we present a comprehensive quantitative analysis of stability bands for dendritic arrays during directional solidification of a transparent succinonitrile-0.46 wt % camphor alloy, spanning a broad range of pulling velocities. Taking advantage of the microgravity environment aboard the International Space Station where most convection effects are suppressed, we obtain unique measurements that quantify the stable primary spacing range of spatially extended three-dimensional dendritic array structures under purely diffusive growth conditions. Through carefully designed velocity jump experiments and detailed examination of sub-grain boundary dynamics, we characterize key instabilities, including elimination and tertiary branching, shedding new light on the mechanisms governing dynamic dendritic spacing selection in extended 3D arrays. Phase field simulations are performed to characterize the stability limits of dendritic array structures for quantitative comparison with the flight experiments. Although the simulations capture general trends, significant deviations are noted at the upper stability boundary, indicating the influence of additional, unexplored factors. These findings contribute to a deeper understanding of dendritic growth dynamics and offer valuable benchmark data that could aid in refining predictive models and improving control of dendritic microstructures in metallurgical applications.

36 MATERIALS SCIENCE↗

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗

On the adiabatic representation of Meyer-Miller electronic-nuclear dynamics

The Meyer-Miller (MM) classical vibronic (electronic + nuclear) Hamiltonian for electronically non-adiabatic dynamics—as used, for example, with the recently developed symmetrical quasiclassical (SQC) windowing model—can be written in either a diabatic or an adiabatic representation of the electronic degrees of freedom, the two being a canonical transformation of each other, thus giving the same dynamics. Although most recent applications of this SQC/MM approach have been carried out in the diabatic representation—because most of the benchmark model problems that have exact quantum results available for comparison are typically defined in a diabatic representation—it will typically be much more convenient to work in the adiabatic representation, e.g., when using Born-Oppenheimer potential energy surfaces (PESs) and derivative couplings that come from electronic structure calculations. The canonical equations of motion (EOMs) (i.e., Hamilton’s equations) that come from the adiabatic MM Hamiltonian, however, in addition to the common first-derivative couplings, also involve second-derivative non-adiabatic coupling terms (as does the quantum Schrödinger equation), and the latter are considerably more difficult to calculate. This paper thus revisits the adiabatic version of the MM Hamiltonian and describes a modification of the classical adiabatic EOMs that are entirely equivalent to Hamilton’s equations but that do not involve the second-derivative couplings. The second-derivative coupling terms have not been neglected; they simply do not appear in these modified adiabatic EOMs. This means that SQC/MM calculations can be carried out in the adiabatic representation, without approximation, needing only the PESs and the first-derivative coupling elements. Here, the results of example SQC/MM calculations are presented, which illustrate this point, and also the fact that simply neglecting the second-derivative couplings in Hamilton’s equations (and presumably also in the Schrödinger equation) can cause very significant errors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗