Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing. The PRIMA Project

The growing number of cores provided by today’s high-­end computing systems present substantial challenges to application developers in their pursuit of parallel efficiency. To find the most effective optimization strategy, application developers need insight into the runtime behavior of their code. The University of Oregon (UO) and the Juelich Supercomputing Centre of Forschungszentrum Juelich (FZJ) develop the performance analysis tools TAU and Scalasca, respectively, which allow high-­performance computing (HPC) users to collect and analyze relevant performance data – even at very large scales. TAU and Scalasca are considered among the most advanced parallel performance systems available, and are used extensively across HPC centers in the U.S., Germany, and around the world. The TAU and Scalasca groups share a heritage of parallel performance tool research and partnership throughout the past fifteen years. Indeed, the close interactions of the two groups resulted in a cross-­fertilization of tool ideas and technologies that pushed TAU and Scalasca to what they are today. It also produced two performance systems with an increasing degree of functional overlap. While each tool has its specific analysis focus, the tools were implementing measurement infrastructures that were substantially similar. Because each tool provides complementary performance analysis, sharing of measurement results is valuable to provide the user with more facets to understand performance behavior. However, each measurement system was producing performance data in different formats, requiring data interoperability tools to be created. A common measurement and instrumentation system was needed to more closely integrate TAU and Scalasca and to avoid the duplication of development and maintenance effort. The PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis) project was proposed over three years ago as a joint international effort between UO and FZJ to accomplish these objectives: (1) refactor TAU and Scalasca performance system components for core code sharing and (2) integrate TAU and Scalasca functionality through data interfaces, formats, and utilities. As presented in this report, the project has completed these goals. In addition to shared technical advances, the groups have worked to engage with users through application performance engineering and tools training. In this regard, the project benefits from the close interactions the teams have with national laboratories in the United States and Germany. We have also sought to enhance our interactions through joint tutorials and outreach. UO has become a member of the Virtual Institute of High-­Productivity Supercomputing (VI-­HPS) established by the Helmholtz Association of German Research Centres as a center of excellence, focusing on HPC tools for diagnosing programming errors and optimizing performance. UO and FZJ have conducted several VI-­HPS training activities together within the past three years.

97 MATHEMATICS AND COMPUTING↗

HPC application performance and scaling : understanding trends and future challenges with application benchmarks on past, present and future Tri-Lab computing systems.

In this paper HPC architectural characteristics and their impact on application performance and scaling are investigated. Performance data gathered over several generations of very large HPC systems like: ASC Red Storm, ASC Purple, and a large InfiniBand cluster - Red Sky, are analyzed. As the number of cache coherent cores and number of NUMA domains at a compute node keeps increasing, we analyze their impact with a few simple benchmarks and several applications. We present bottlenecks and remedies examining production applications. We conclude with preliminary early-hardware performance data from the ASC Cielo, a petaFLOPS class future capability system.

99 GENERAL AND MISCELLANEOUS↗

Photovoltaic fleet degradation insights

Abstract In the PV Fleet Performance Data Initiative, high‐frequency data from commercial and utility‐scale photovoltaic (PV) systems have been collected to examine performance loss rates (PLRs) at a fleet scale. To date, performance data from more than 7.2‐gigawatt (GW) capacity, 1700 sites and 19,000 inverters—approximately equivalent to 6% to 7% of the entire US PV market—have been collected. An overall PLR of −0.75%/year was found, which is in line with historical and recent findings. Tracked silicon (Si) and cadmium telluride (CdTe) performed comparably with all fixed‐tilt systems. Higher PLRs were found for hotter temperature zones; cooler climates exhibit a median −0.48%/year loss, which increases to −0.88%/year in hotter climates. High‐efficiency module technologies showed median PLRs in line with conventional Si technologies but demonstrated markedly different PLR behavior when filtered only for low‐light conditions <600 W/m 2 . Causes for this technology‐dependent behavior are under investigation.

14 SOLAR ENERGY↗

PRIMA-X - Performance Retargeting of Instrumentation, Measurement, and Analysis Technologies for Exascale Computing

The PRIMA-X (Performance Retargeting of Instrumentation, Measurement, and Analysis Technologies for Exascale Computing) project is the successor of the DOE PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing) project, which addressed the challenge of creating a core measurement infrastructure that would serve as a common platform for both integrating leading parallel performance systems (notably TAU and Scalasca) and developing next-generation scalable performance tools. The PRIMA-X project shifts the focus away from refactorization of robust performance tools towards a re-targeting of the parallel performance measurement and analysis architecture for extreme scales. The massive concurrency, asynchronous execution dynamics, hardware heterogeneity, and multi-objective prerequisites (performance, power, resilience) that identify exascale systems introduce fundamental constraints on the ability to carry forward existing performance methodologies. In particular, there must be a deemphasis of per-thread observation techniques to significantly reduce the otherwise unsustainable flood of redundant performance data. Instead, it will be necessary to assimilate multi-level resource observations into macroscopic performance views, from which resilient performance metrics can be attributed to the computational features of the application. This requires a scalable framework for node-level and system-wide monitoring and runtime analyses of dynamic performance information. Also, the interest in optimizing parallelism parameters with respect to performance and energy drives the integration of tool capabilities in the exascale environment further. Initially, PRIMA-X was a collaborative project between the University of Oregon (lead institution) and the German Research School for Simulation Sciences (GRS). Because Prof. Wolf, the PI at GRS, accepted a position as full professor at Technische Universitaet Darmstadt (TU Darmstadt) starting February 1st, 2015, the work of GRS was continued at TU Darmstadt. This report covers the work at TU Darmstadt after the transition. The first main accomplishment of TU Darmstadt is the development of different techniques to aggregate performance data on the level of threads. TU Darmstadt evaluated different schemes designed at GRS during the first phase of this project and integrated them into Score-P, a widely used performance measurement framework for HPC applications. The second main accomplishment is a substantial increase of Score-P’s scalability, achieved by improving its internal representation of the underlying system. Third, we extended our performance-modeling tool Extra-P to automatically create models with more than one input parameter (e.g., process count and input size), which was previously impossible. These models allow the performance behavior of an application to be extrapolated to larger machines. Specific applications of the new multi-parameter capability realized in this project include modeling the isoefficiency function of task-based applications and a novel co-design methodology. Further extensions of Extra-P comprise online modeling functionality, automatic refinement of the model search space, and segmented performance modeling. Further contributions include new locality metrics for both shared- and distributed-memory applications, a new way of measuring the impact of inter-application inference on the execution time of an application, and finally an automatic method that selects appropriate OpenMP constructs for the parallelization of sequential code and classifies the affected variables based on their sharing semantics.

97 MATHEMATICS AND COMPUTING↗

CSULA Hydrogen Refueling Facility Performance Evaluation and Optimization

Throughout its history, Cal State LA has been in the forefront of advanced energy and transportation technologies. The station is located at the intersection of two major highways in Los Angeles region and has a convenient access. It is capable of producing up to 60 kg/day and can fuel 15-20 vehicles per day. Cal State LA had partnered with DOE to establish a robust station operation and performance data collection program. This consisted of equipping the station with additional instrumentation and collecting fueling performance data for several years. The data was further furnished to NREL for processing and agglomeration with data from other stations. In addition to fueling, maintenance and failure events were shared as well as hydrogen purity reports. The station has also undergone several upgrades in fueling protocols and hardware for improved performance and code compliance.

08 HYDROGEN↗

Threat emulation framework

A method for emulating threats in virtual network computing environment is provided. The method comprises creating a number of virtual machines in the virtual network computing environment. A number of threat actors are emulated, wherein each threat actor comprises a number of threat artifacts that form a sequence of attack steps against the virtual network computing environment. The threat actors are then deployed against the virtual network computing environment. Behavioral data about actions of the threat actors in the virtual network computing environment is collected, as is performance data about the virtual network computing environment in response to the threat actors. The collected behavioral and performance data is then presented to a user via an interface.

Urias, Vincent↗

Initial approaches in benchmarking and round robin testing for proton exchange membrane water electrolyzers

As ever increasing amounts of renewable electricity enter the energy supply mix on a regional, national and international basis, greater emphasis is being placed on energy conversion and storage technologies to deal with the oscillations, excess and lack of electricity. Hydrogen generation via proton exchange membrane water electrolysis (PEMWE) is one technology that offers a pathway to store large amounts of electricity in the form of hydrogen. The challenges to widespread adoption of PEMWE lie in their high capital and operating costs which both need to be reduced through R&D. An evaluation of reported performance data in literature for PEMWE reveals that there are excessive variations of in situ performance results that make it difficult to draw conclusions on the pathway forward to performance optimization and future R&D directions. In order to enable the meaningful comparison of in-situ performance evaluation across laboratories there is an obvious need for standardization of materials and testing protocols. Herein, we address this need by reporting the results of a round robin test effort conducted at the laboratories of five contributors to the IEA electrolysis annex 30. The effort utilized common sets of test articles, materials, test cells, and employed a set of shared test protocols. The maximum observed deviation between laboratories at 1 A cm-2 at cell temperatures of 60 and 80 degrees C, was 27 and 20 mV, respectively. The deviation of the results from laboratory to laboratory was a factor of 2-3 higher than the lowest deviation observed at one single lab and test station. However, the highest deviations observed were 1/10th of those extracted by a literature survey on similar material sets. The biggest takeaways are that cell temperature control appears to be the most significant source of deviation between results, while care must be taken with respect to break in conditions and cell electrical connections for meaningful performance data.

08 HYDROGEN↗

Scale up, Field testing, and Optimization of Nontoxic, Durable, Economical Coatings for Control of Biofouling and Corrosion (Abstract Only)

The objective of this project is the technical maturation and demonstration of a durable, economical, and nontoxic coating, Superhydrophobic Lubricant Infused Composite (SLIC), that will prevent fouling organisms from growing on marine and hydrokinetic (MHK) structures and prevent invasive mussels from growing on hydropower structures. SLIC technology was developed and patented by PNNL. It combines multiple antifouling mechanisms to provide excellent antifouling performance, durability, and low hydrodynamic drag without using toxic materials. Advanced proof-of-concept testing and demonstrations completed during a Phase 1 TCF project attracted industry interest and partnerships for this Phase 2 effort focused on maturation of a commercial product. Specific tasks and tests will shift the development emphasis to optimizing formulations, validating antifouling performance to address specific application needs, explore compatibility with other paint systems, develop a product with useful shelf life (in can), and determine curing times and effective applications methodology. Phase 2 efforts will focus upon technology transfer and commercialization of the technology with the industrial team. Industrial partners now include a coatings development specialist (Lorama), hydrophobic material manufacturer and paint developer (Dry Surface Technologies), nontoxic biodegradable lubricants manufacturer (BioBlend), and aquatic applications specialists (Prometheus Innovations, River Connectivity Systems). Engagement with the MHK device developers, the PNNL Marine and Coastal Research Laboratory (MCRL) test site in Sequim WA, Bureau of Reclamation, and Taylor Shellfish throughout the project will provide topical expertise and field test sites that will deliver crucial real-world performance data. Through this Phase 2 effort, SLIC will transition from a Technical Readiness Level (TRL) 5 to TRL 6 and long-term performance data will be acquired through demonstrations. The field test data will allow optimization of SLIC formulation to enhance performance (e.g., durability) and packaging, which are key de-risking activities for technology transfer and ultimately to the production of a viable commercial product.

13 HYDRO ENERGY↗

Validation of Multiple Tools for Flat Plate Photovoltaic Modeling Against Measured Data

This report expands upon a previous work by the same authors, published in the 40th IEEE Photovoltaic Specialists conference. In this validation study, comprehensive analysis is performed on nine photovoltaic systems for which NREL could obtain detailed performance data and specifications, including three utility-scale systems and six commercial scale systems. Multiple photovoltaic performance modeling tools were used to model these nine systems, and the error of each tool was analyzed compared to quality-controlled measured performance data. This study shows that, excluding identified outliers, all tools achieve annual errors within +/-8% and hourly root mean squared errors less than 7% for all systems. It is further shown using SAM that module model and irradiance input choices can change the annual error with respect to measured data by as much as 6.6% for these nine systems, although all combinations examined still fall within an annual error range of +/-8.5%. Additionally, a seasonal variation in monthly error is shown for all tools. Finally, the effects of irradiance data uncertainty and the use of default loss assumptions on annual error are explored, and two approaches to reduce the error inherent in photovoltaic modeling are proposed.

14 SOLAR ENERGY↗

Prior-based artifact correction (PBAC) in computed tomography

Purpose: Image quality in computed tomography (CT) often suffers from artifacts which may reduce the diagnostic value of the image. In many cases, these artifacts result from missing or corrupt regions in the projection data, e.g., in the case of metal, truncation, and limited angle artifacts. The authors propose a generalized correction method for different kinds of artifacts resulting from missing or corrupt data by making use of available prior knowledge to perform data completion. Methods: The proposed prior-based artifact correction (PBAC) method requires prior knowledge in form of a planning CT of the same patient or in form of a CT scan of a different patient showing the same body region. In both cases, the prior image is registered to the patient image using a deformable transformation. The registered prior is forward projected and data completion of the patient projections is performed using smooth sinogram inpainting. The obtained projection data are used to reconstruct the corrected image. Results: The authors investigate metal and truncation artifacts in patient data sets acquired with a clinical CT and limited angle artifacts in an anthropomorphic head phantom data set acquired with a gantry-based flat detector CT device. In all cases, the corrected images obtained by PBAC are nearly artifact-free. Compared to conventional correction methods, PBAC achieves better artifact suppression while preserving the patient-specific anatomy at the same time. Further, the authors show that prominent anatomical details in the prior image seem to have only minor impact on the correction result. Conclusions: The results show that PBAC has the potential to effectively correct for metal, truncation, and limited angle artifacts if adequate prior data are available. Since the proposed method makes use of a generalized algorithm, PBAC may also be applicable to other artifacts resulting from missing or corrupt data.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Convective-Permitting Hindcast Simulations during the North American Monsoon GPS Transect Experiment 2013: Establishing Baseline Model Performance without Data Assimilation

During the North American monsoon global positioning system (GPS) Transect Experiment 2013, daily convective-permitting WRF simulations are performed in northwestern Mexico and the southern Arizona border region using the operational Global Forecast System (GFS) and North American Mesoscale Forecast System (NAM) models as lateral boundary forcing and initial conditions. Compared to GPS precipitable water vapor (PWV), the WRF simulations display a consistent moist bias in the initial specification of PWV leading to convection beginning 3–6 h early. Given appreciable observed rainfall, days are classified as strongly and weakly forced based only on the presence of an inverted trough (IV); gulf surges did not noticeably impact the development of mesoscale convective systems (MCSs) and related convection in northwestern Mexico. Strongly forced days display higher modeled precipitation forecast skill than weakly forced days in the slopes of the northern Sierra Madre Occidental (SMO) away from the crest, especially toward the west where MCSs account for the greatest proportion of all monsoon-related precipitation. A case study spanning 8–10 July 2013 illustrates two consecutive days when nearly identical MCSs evolved over northern Sonora. Although a salient MCS is simulated on the strongly forced day (9–10 July 2013) when an IV is approaching the core monsoon region, a simulated MCS is basically nonexistent on the weakly forced day (8–9 July 2013) when the IV is farther away. Finally, the greater sensitivity to the initial specification of PWV in the weakly forced day suggests that assimilation of GPS-derived PWV for these types of days may be of greatest value in improving model precipitation forecasts.

54 ENVIRONMENTAL SCIENCES↗

Data Intensive Computing on Amazon Web Services

The Geophysical Monitoring Program (GMP) has spent the past few years building up the capability to perform data intensive computing using what have been referred to as “big data” tools. These big data tools would be used against massive archives of seismic signals (>300 TB) to conduct research not previously possible. Examples of such tools include Hadoop (HDFS, MapReduce), HBase, Hive, Storm, Spark, Solr, and many more by the day. These tools are useful for performing data analytics on datasets that exceed the resources of traditional analytic approaches. To this end, a research big data cluster (“Cluster A”) was set up as a collaboration between GMP and Livermore Computing (LC).

97 MATHEMATICS AND COMPUTING↗

Intuitive Visualizations Through Multi-Domain Projections for Performance Analysis at Scale

Performance analysis of parallel scientific codes is becoming increasingly difficult due to the rapidly growing complexity of applications and architectures. Existing tools fall short in providing intuitive views to reveal the root causes of performance problems. We have developed a new paradigm of projecting and visualizing performance data obtained from one domain onto other domains for faster, more intuitive analysis of applications. We gather performance data in three domains: hardware, application, and communication. For each domain, we define projections that allow the data to be viewed in the other domains. This framework is called the HAC model. The model not only allows us to directly compare the data across domains, but also allows us to use data visualization and analysis tools available in the other domains. Using the methodologies and visualization techniques mentioned above, we have demonstrated the careful unscrambling of otherwise tangled measurements caused by adaptive systems. By attributing performance measurements directly to their causes, we are able to visualize performance measurements in the domains most intuitive to the user, which are not necessarily those in which measurements are collected.

97 MATHEMATICS AND COMPUTING↗

Performance model-directed data sieving for high-performance I/O

Many scientific computing applications and engineering simulations exhibit noncontiguous I/O access patterns. Data sieving is an important technique to improve the performance of noncontiguous I/O accesses by combining small and noncontiguous requests into a large and contiguous request. It has been proven effective even though more data are potentially accessed than demanded. In this study, we propose a new data sieving approach namely performance model-directed data sieving, or PMD data sieving in short. It improves the existing data sieving approach from two aspects: (1) dynamically determines when it is beneficial to perform data sieving; and (2) dynamically determines how to perform data sieving if beneficial. It improves the performance of the existing data sieving approach considerably and reduces the memory consumption as verified by both theoretical analysis and experimental results. Given the importance of supporting noncontiguous accesses effectively and reducing the memory pressure in a large-scale system, the proposed PMD data sieving approach in this research holds a great promise and will have an impact on high-performance I/O systems.

97 MATHEMATICS AND COMPUTING↗

Exploratory analysis and performance prediction of big data transfer in High-performance Networks

Big data transfer in large-scale scientific and business applications is increasingly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) via advance bandwidth reservation. Provisioning agents need to carefully schedule data transfer requests, compute network paths, and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized, could be simply wasted due to the exclusive access during the approved time window, and cause extra overhead and complexity for resource management. This calls for accurate performance prediction to reserve bandwidths that match actual needs and avoid over-provisioning. We employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements collected in the past several years from data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated testbeds. We first analyze the performance patterns in response to a comprehensive list of parameters in end-host systems, network connections, and data transfer applications, which motivate the use of machine learning and also help us identify the effects of latent factors. We then propose threshold- and clustering-based methods to eliminate negative effects of latent factors in data preprocessing and build a robust performance predictor based on customized domain-oriented loss functions. The performance of the proposed methods is verified by extensive experiments using SVR and RFR as well as theoretical analysis of the general performance bound.

97 MATHEMATICS AND COMPUTING↗

On Performance Prediction of Big Data Transfer in High-performance Networks

Big data generated by large-scale scientific and industrial applications need to be transferred between different geographical locations for remote storage, processing, and analysis. High-speed dedicated connections provisioned in High-performance Networks (HPNs) are increasingly utilized to carry out such big data transfer. HPN management highly relies on an important capability of performance (mainly throughput) prediction to reserve sufficient bandwidth and meanwhile avoid over-provisioning that may result in unnecessary resource waste. This capability is critical to improving the resource (mainly bandwidth) utilization of dedicated connections and meeting various user requests for data transfer. Conventional methods conduct performance prediction by fitting prior observed transfer history with predefined loss functions, without considering unobservable latent factors such as competing loads on end hosts. Such latent factors also have a significant impact on the application-level data transfer performance, which may result in an inaccurate prediction model. In this paper, we first investigate the impact of latent factors and propose a clustering-based method to eliminate their negative impact on performance prediction. We then develop a robust machine learning-based performance predictor by: i) incorporating the proposed latent factor elimination method into data preprocessing, and ii) adopting a customized domain guided loss function. Extensive experimental results show that our predictor achieves significantly higher prediction accuracy than several other state-of-the-art methods.

Liu, Wuji↗

Annual Technology Baseline: The 2020 Electricity Update

Consistent cost and performance data for various electricity generation technologies can be difficult to find and may change frequently for certain technologies. With the Annual Technology Baseline (ATB), the National Renewable Energy Laboratory annually provides an organized and centralized set of such cost and performance data. The ATB uses the best information from the Department of Energy national laboratories' renewable energy analysts. The ATB has been reviewed by experts and it includes the following electricity generation technologies: land-based wind, offshore wind, utility-scale solar photovoltaics (PV), commercial-scale solar PV, residential-scale solar PV, concentrating solar power, geothermal power, hydropower, utility-scale battery storage. EIA data for coal, natural gas, nuclear, and conventional biopower are included for reference. This webinar presentation introduces the 2020 update to the ATB Electricity data and documentation.

capacity factor↗

Reducing Interanalyst Variability in Photovoltaic Degradation Rate Assessments

The economic return on investment of a commercial photovoltaic system depends greatly on its performance over the long term and, hence, its degradation rate. Many methods have been proposed for assessing system degradation rates from outdoor performance data. However, comparing reported values from one analyst and research group to another requires a common baseline of performance; consistency between methods and analysts can be a challenge. An interlaboratory study was conducted involving different volunteer analysts reporting on the same photovoltaic performance data using different methodologies. Initial variability of the reported degradation rates was so high that analysts could not come to a consensus whether a system degraded or not. More consistent values are received when written guidance is provided to each analyst. Further improvements in analyst variance was accomplished by using the free open-source software RdTools, allowing a reduction in variance between analysts by more than two orders of magnitude over the first round, where multiple analysis methods are allowed. This article highlights many pitfalls in conducting 'routine' degradation analysis, and it addresses some of the factors that must be considered when comparing degradation results reported by different analysts or methods.

14 SOLAR ENERGY↗