Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Performance Prediction of Big Data Transfer Through Experimental Analysis and Machine Learning

Big data transfer in next-generation scientific applications is now commonly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) through advance bandwidth reservation. To use HPN resources efficiently, provisioning agents need to carefully schedule data transfer requests and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized by the requesting user, could be simply wasted or cause extra overhead and complexity in management due to exclusive access. This calls for the capability of performance prediction to reserve bandwidth resources that match actual needs. Towards this goal, we employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements, which are collected over a span of several years from a large number of data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated HPN testbeds. We first identify a comprehensive list of attributes involved in a typical big data transfer process, including end host system configurations, network connection properties, and control parameters of data transfer methods. We then conduct an in-depth exploratory analysis of their impacts on application-level throughput, which provides insights into big data transfer performance and motivates the use of machine learning. We also investigate the applicability of machine learning algorithms and derive their general performance bounds for performance prediction of big data transfer in HPNs. Experimental results show that, with appropriate data preprocessing, the proposed machine learning-based approach achieves 95% or higher prediction accuracy in up to 90% of the cases with very noisy real-life performance measurements.

Yun, Daqing↗

SHAD: the Scalable High-performance Algorithms and Data-structures Library

The unprecedented amount of data that needs to be processed in emerging data analytics applications poses novel challenges to industry and academia. Scalability and high performance become more than a desirable feature because, due to the scale and the nature of the problems, they draw the line between what is achievable and what is unfeasible. In this paper, we propose SHAD, the Scalable High-performance Algorithms and Data-structures library. SHAD adopts a modular design that confines low level details and promotes reuse. SHAD's core is built on an Abstract Runtime Interface which enhances portability and identifies the minimal set of features of the underlying system required by the framework. The core library includes common data-structures such as: Array, Vector, Map and Set. These are designed to accommodate significant amount of data which can be accessed in massively parallel environments, and used as building blocks for SHAD extensions, i.e. higher level software libraries. We have validated and evaluated our design with a performance and scalability study of the core components of the library. We have validated the design flexibility by proposing a Graph Library as an example of SHAD extension, which implements two different graph data-structures; we evaluate their performance with a set of graph applications. Experimental results show that the approach is promising in terms of both performance and scalability. On a distributed system with 320 cores, SHAD Arrays are able to sustain a throughput of 65 billion operations per second, while SHAD Maps sustain 1 billion of operations per second. Algorithms implemented using the Graph Library exhibit performance and scalability comparable to a custom solution, but with smaller development effort.

Castellana, Vito G.↗

An Approach to Integrate a Space-Time GIS Data Model with High Performance Computers

In this paper, we describe an approach to integrate a Space-Time GIS data model on a high performance computing platform. The Space-Time GIS data model has been developed on a desktop computing environment. We use the Space-Time GIS data model to generate GIS module, which organizes a series of remote sensing data. We are in the process of porting the GIS module into an HPC environment, in which the GIS modules handle large dataset directly via parallel file system. Although it is an ongoing project, authors hope this effort can inspire further discussions on the integration of GIS on high performance computing platforms.

99 GENERAL AND MISCELLANEOUS↗

PV Field Performance Including Fleet and Bifacial Field Data

This presentation provides a review of two recent presentations - the 2021 PV Fleet Performance Data Initiative covered by the PVRW presentation, and bifacial system performance presented to a February DuraMAT working group. Details include degradation rate distributions from >6000 inverter channels, monthly performance vs expected, bifacial field studies of energy gain and field degradation.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Performance Improvements on SNS and HFIR Instrument Data Reduction Workflows Using Mantid

Performance of data reduction workflows at the High Flux Isotope Reactor (HFIR) and the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL) is mainly determined by the time spent loading raw measurement events stored in large and sparse datasets. This paper describes: (1) our long-term view to leverage SNS and HFIR data management needs with our experience at ORNL’s world-class high performance computing (HPC) facilities, and (2) our short-term efforts to speed up current workflows using Mantid, a data analysis and reduction community framework used across several neutron scattering facilities. We show that minimally invasive short-term improvements in metadata management have a moderate impact in speeding up current production workflows. We propose a more disruptive domain-specific solution: the No Cost Input Output (NCIO) framework, we provide an overview, the risks and challenges in NCIO’s adoption by HFIR and SNS stakeholders.

Godoy, William↗

PtychoShelves , a versatile high-level framework for high-performance analysis of ptychographic data

Over the past decade, ptychography has been proven to be a robust tool for non-destructive high-resolution quantitative electron, X-ray and optical microscopy. It allows for quantitative reconstruction of the specimen's transmissivity, as well as recovery of the illuminating wavefront. Additionally, various algorithms have been developed to account for systematic errors and improved convergence. With fast ptychographic microscopes and more advanced algorithms, both the complexity of the reconstruction task and the data volume increase significantly. PtychoShelves is a software package which combines high-level modularity for easy and fast changes to the data-processing pipeline, and high-performance computing on CPUs and GPUs.

97 MATHEMATICS AND COMPUTING↗

Dark matter vs. astrophysics in the interpretation of AMS-02 electron and positron data

We perform a detailed quantitative analysis of the recent AMS-02 electron and positron data. We investigate the interplay between the emission from primary astrophysical sources, namely Supernova Remnants and Pulsar Wind Nebulae, and the contribution from a dark matter annihilation or decay signal. Our aim is to assess the information that can be derived on dark matter properties when both dark matter and primary astrophysical sources are assumed to jointly contribute to the leptonic observables measured by the AMS-02 experiment. We investigate both the possibility to set robust constraints on the dark matter annihilation/decay rate and the possibility to look for dark matter signals within realistic models that take into account the full complexity of the astrophysical background. Our results show that AMS-02 data enable to probe efficiently vast regions of the dark matter parameter space and, in some cases, to set constraints on the dark matter annihilation/decay rate that are comparable or even stronger than the ones derived from other indirect detection channels.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Coupled-Channel Analysis of the χ c 1 ( 3872 ) Line Shape with BESIII Data

We perform a study of the χ c 1 ( 3872 ) line shape using the data samples of e + e − → γ χ c 1 ( 3872 ) , χ c 1 ( 3872 ) → D 0 D ¯ 0 π 0 , and π + π − J / ψ collected with the BESIII detector. The effects of the coupled channels and the off-shell D * 0 are included in the parametrization of the line shape. The line shape mass parameter is obtained to be M X = ( 3871.63 ± 0.1 3 − 0.05 + 0.06 ) MeV . Two poles are found on the first and second Riemann sheets corresponding to the D * 0 D ¯ 0 branch cut. The pole location on the first sheet is much closer to the D * 0 D ¯ 0 threshold than the other, and is determined to be 7.04 ± 0.1 5 − 0.08 + 0.07 MeV above the D 0 D ¯ 0 π 0 threshold with an imaginary part − 0.19 ± 0.0 8 − 0.19 + 0.14 MeV . Published by the American Physical Society 2024

Physics↗

Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis

The Theory of Bottleneck Structures is a recently-developed framework for studying the performance of data networks. It describes how local perturbations in one part of the network propagate and interact with others. This framework is a powerful analytical tool that allows network operators to make accurate predictions about network behavior and thereby optimize performance. Previous work implemented a software package for bottleneck structure analysis, but applied it only to toy examples. In this work, we introduce the first software package capable of scaling bottleneck structure analysis to production-size networks. Here, we benchmark our system using logs from ESnet, the Department of Energy's high-performance data network that connects research institutions in the U.S. Using the previously published tool as a baseline, we demonstrate that our system achieves vastly improved performance, constructing the bottleneck structure graphs in 0.21 s and calculating link derivatives in 0.09 s on average. We also study the asymptotic complexity of our core algorithms, demonstrating good scaling properties and strong agreement with theoretical bounds. These results indicate that our new software package can maintain its fast performance when applied to even larger networks. They also show that our software is efficient enough to analyze rapidly changing networks in real time. Overall, we demonstrate the feasibility of applying bottleneck structure analysis to solve practical problems in large, real-world data networks.

benchmark↗

Deep learning to estimate permeability using geophysical data

Time-lapse electrical resistivity tomography (ERT) is a popular geophysical method to estimate three-dimensional (3D) permeability fields from electrical potential difference measurements. Traditional inversion and data assimilation methods are used to ingest this ERT data into hydrogeophysical models to estimate permeability. Due to ill-posedness and the curse of dimensionality, existing inversion strategies provide poor estimates and low resolution of the 3D permeability field. Recent advances in deep learning provide us with powerful algorithms to overcome this challenge. This paper presents a deep learning (DL) framework to estimate the 3D subsurface permeability from time-lapse ERT data. To test the feasibility of the proposed framework, we train DL-enabled inverse models on simulation data. Each measurement in both synthetic and field data is standardized by removing the mean and scaling the time-series to unit variance. This pre-processing step is necessary to bring simulation data closer to field observations. Subsurface process models based on hydrogeophysics are used to generate this synthetic data. Training performed on limited simulation data resulted in the DL model over-fitting. An advanced data augmentation based on mixup is implemented to generate additional training samples to overcome this issue. This mixup technique creates weakly labeled (low-fidelity) samples from strongly labeled (high-fidelity) data. The weakly labeled training data is then used to develop DL-enabled inverse models and reduce over-fitting. As both time-lapse ERT (1133048 features/realization) and 3D permeability (585453 features/realization) data samples are from a high-dimensional space, principal component analysis (PCA) is employed to reduce dimensionality. Encoded ERT and encoded permeability are generated using the trained PCA estimators. A deep neural network is then trained to map the encoded ERT to encoded permeability. This mixup training and unsupervised learning allowed us to build a fast and reasonably accurate DL-based inverse model under limited simulation data. Results show that proposed weak supervised learning can capture salient spatial features in the 3D permeability field. Quantitatively, the average mean squared error (in terms of the natural log) on the strongly labeled training, validation, and test datasets is less than 0.5. The R 2 -score (global metric) is greater than 0.75, and the percent error in each cell (local metric) is less than 10%. Finally, an added benefit in terms of computational cost is that the proposed DL-based inverse model is at least O(10 4 ) times faster than running a forward model once it is trained. Data generation, DL model training, and hyperparameter tuning to identify optimal neural network architectures utilized high-performance computing resources while the DL inference is performed on a standard laptop. Approximately, O(10 5 ) processor hours are used for generating data and DL tuning and training. We acknowledge that the data generation and DL model development are expensive. But once a DL model is trained, it can be re-used for inversion rapidly for the given system, with set physics and domain. Note that traditional inversion may require multiple forward model simulations (e.g., in the order of 10 to 1000), which are very expensive. This computational savings ≈ O(10 5 ) – O(10 7 )) makes the proposed DL-based inverse model attractive for subsurface imaging and real-time ERT monitoring applications due to fast and yet reasonably accurate estimations of permeability field.

58 GEOSCIENCES↗

Using Measured Plane-of-Array Data Directly in Photovoltaic Modeling: Methodology and Validation

Measured plane-of-array (POA) irradiance may provide a lower-cost alternative to standard irradiance component data for photovoltaic (PV) system performance modeling without loss of accuracy. Previous work has shown that transposition models typically used by PV models to calculate POA irradiance from horizontal data introduce error into the POA irradiance estimates, and that measured POA data can correlate better to measured performance data. However, popular PV modeling tools historically have not directly used input POA data. This paper introduces a new capability in NREL's System Advisor Model (SAM) to directly use POA data in PV modeling, and compares SAM results from both POA irradiance and irradiance components inputs against measured performance data for eight operating PV systems.

14 SOLAR ENERGY↗

Lidar Buoy Data Analysis: Basic Assessment of Observed Conditions and Instrument Performance Off Virginia and New Jersey

One of the challenges for developing offshore wind energy in the United States has been a lack of long-term observations to characterize the wind resource and design load conditions and to provide validation for the numerical weather prediction models. To address this challenge, the U.S. Department of Energy supported the procurement in 2014 and subsequent deployment of two buoys equipped with motion-compensated lidars and a comprehensive set of supporting meteorological and oceanographic (“metocean”) measurement systems. Each of the systems was deployed off the U.S. East Coast in excess of one year—one each near the coasts of Virginia and New Jersey. One notable observation from both buoys is the dramatic dependence of the wind shear on atmospheric stability as indicated by the air-sea temperature difference. This observation suggests that the commonly used neutral log law will not be a fully suitable representation of wind shear off the U.S. East Coast. This report provides a basic summary of observations at each location from key systems on each of the buoys as well as an assessment of instrument performance. These data are beginning to fill a long-standing observational gap for the wind energy community in the United States.

17 WIND ENERGY↗

Reconstruction Performance Studies with MicroBooNE Data in Support of Summer 2018 Analyses

In this note we present a number of reconstruction performance measurements conducted on MicroBooNE data. Results show good agreement between the data and the predictions from simulation, thus validating the version of the reconstruction used by MicroBooNE analyses, which are presented at 2018 conferences. The observed level of performance shows the high level of resolution obtainable with a large-scale LArTPC imaging detector. Tracking and vertexing resolutions at or below the millimeter scale are obtained for neutrino interaction event reconstruction. Energy reconstruction measurements are presented for tracks and EM showers using multiple Coulomb scattering and calorimetry respectively; in the case of EM showers these represent the first result obtained in a fully-automated reconstruction chain. Nevertheless, the present results are expected to improve with further refinements of the employed reconstruction algorithms. The techniques which are presented here have a broader validity than MicroBooNE and could be applied to other LArTPC detectors as they start taking data in the next months or years.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Methodology for Sensitivity and Uncertainty-Based Criticality Safety Validation

Monte Carlo radiation transport software is used extensively for determining the effective multiplication factor k of fissionable systems towards assessing the criticality safety of operations. Understanding the predictive capability of the Monte Carlo software and nuclear data libraries for calculations of specific applications is vital towards making these assessments. Recently, sensitivity and uncertainty (S/U) methods have been developed for this purpose. A computational tool has been developed that uses the S/U methods with MCNP6 to select critical experiment benchmarks that have similar sources of computational bias, and extreme value theory is then used to determine suitable and conservative calculational margins. The S/U techniques are then used to perform nuclear data adjustments, which are then used to determine a suitable margin of subcriticality from cross section uncertainties. This document gives an overview of the theory of S/U methods used for criticality safety validation. First an overview is given for using the sensitivity coefficients and nuclear co variance data towards determining neutronic similarity factors is then discussed. Next, the extreme value theory (EVT) to determine a calculational margin is given along with how the similarity factors are used in the analysis. Then, the Generalized Linear Least Squares (GLLS) method for performing data adjustment and how that method is used to reject benchmarks and compute adjusted nuclear data uncertainties in k are discussed. Last, a discussion of the margin of subcriticality is given along with how to apply of the GLLS data adjustment methods to quantify the effect of nuclear data variability on k.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Strangeness in the proton from $W+$ charm production and SIDIS data

We perform a global QCD analysis of unpolarized parton distribution functions (PDFs) in the proton, including new 𝑊+⁢ charm production data from 𝑝⁢𝑝 collisions at the LHC and semi-inclusive pion and kaon production data in lepton-nucleon deep-inelastic scattering, both of which have been suggested for constraining the strange quark PDF. Compared with a baseline global fit that does not include these datasets, the new analysis reduces the uncertainty on the strange quark distribution over the range 0.01 < 𝑥 < 0.3, and provides a consistent description of processes sensitive to strangeness in the proton. Including the new datasets, the ratio of strange to nonstrange sea quark distributions is $R_s = (s + \bar{s})/(\bar{u} +\bar{d})$ $=$ {$0.7⁢2^{+0.52}_{−0.34}, 0.4⁢6^{+0.30}_{−0.20}, 0.3⁢2^{+0.23}_{−0.15}$} for 𝑥 ={$0.01, 0.04, 0.1$} at 𝑄 2 $=$ 4 GeV 2 . The data place more stringent constraints on the strange asymmetry $(s - \bar{s})$, which is found to be consistent with zero in this range.

Anderson, Trey [College of William and Mary, Willi↗

Cosmological constraints from DES Y1 cluster abundances and SPT multiwavelength data

We perform a joint analysis of the counts of redMaPPer clusters selected from the Dark Energy Survey (DES) year 1 data and multiwavelength follow-up data collected within the 2500 deg2 South Pole Telescope (SPT) Sunyaev-Zel’dovich (SZ) survey. The SPT follow-up data, calibrating the richness-mass relation of the optically selected redMaPPer catalog, enable the cosmological exploitation of the DES cluster abundance data. To explore possible systematics related to the modeling of projection effects, we consider two calibrations of the observational scatter on richness estimates: a simple Gaussian model which account only for the background contamination (BKG), and a model which further includes contamination and incompleteness due to projection effects (PRJ). Assuming either a ΛCDM+∑mν or wCDM+∑mν cosmology, and for both scatter models, we derive cosmological constraints consistent with multiple cosmological probes of the low and high redshift Universe, and in particular with the SPT cluster abundance data. This result demonstrates that the DES Y1 and SPT cluster counts provide consistent cosmological constraints, if the same mass calibration data set is adopted. It thus supports the conclusion of the DES Y1 cluster cosmology analysis which interprets the tension observed with other cosmological probes in terms of systematics affecting the stacked weak lensing analysis of optically selected low–richness clusters. Finally, we analyze the first combined optically SZ selected cluster catalog obtained by including the SPT sample above the maximum redshift probed by the DES Y1 redMaPPer sample (z=0.65). Besides providing a mild improvement of the cosmological constraints, this data combination serves as a stricter test of our scatter models: the PRJ model, providing scaling relations consistent between the two abundance and multiwavelength follow-up data, is favored over the BKG model.

79 ASTRONOMY AND ASTROPHYSICS↗

Capturing provenance as a diagnostic tool for workflow performance evaluation and optimization

In extreme-scale computing environments such as the DOE Leadership Computing Facilities scientific workflows are routinely used to coordinate software processes for the execution of complex, computational applications that perform in-silico experiments. Monitoring the performance of workflows without also simultaneously tracking provenance is not sufficient to understand variations between runs, configurations, versions of a code, and between changes in an implemented stack, and systems, i.e. the variability of performance metrics data in their historical context. We take a provenance-based approach and demonstrate that provenance is useful as a tool for evaluating and optimizing workflow performance in extreme-scale HPC environments. We present Chimbuko, a framework for the analysis and visualization of the provenance of performance. Chimbuko implements a method for the evaluation of workflow performance from multiple components that enables the exploration of performance metrics data at scale.

97 MATHEMATICS AND COMPUTING↗