Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

What Kind of Charging Infrastructure Do Chevrolet Volt Drivers in The EV Project Use and When Do They Use It?

This document will present information describing the charging behavior of Chevrolet Volts that were enrolled in the EV Project. It will included aggregated data from more than 1,800 vehicles regarding locations, power levels, and time-of-day of charging events performed by those vehicles. This document will be published to the INL AVTA website.

33 ADVANCED PROPULSION SYSTEMS↗

Capturing the Sun: A Roadmap for Navigating Data-Access Challenges and Auto-Populating Solar Home Sales Listings

Capturing the Sun: A Roadmap for Navigating Data-Access Challenges and Auto-Populating Solar Home Sales Listings supports a vision of solar photovoltaic (PV) advocates and real estate advocates evolving together to make information about solar homes more accessible to home buyers and sellers and to simplify the process when these homes are resold. The Roadmap is based on a concept in the real estate industry known as automatic population of fields. Auto-population (also called auto-pop in the industry) is the technology that allows data aggregated by an outside industry to be matched automatically with home sale listings in a multiple listing service (MLS).

14 SOLAR ENERGY↗

Scalability of Several Asynchronous Many-Task Models for In Situ Statistical Analysis.

This report is a sequel to [PB16], in which we provided a first progress report on research and development towards a scalable, asynchronous many-task, in situ statistical analysis engine using the Legion runtime system. This earlier work included a prototype implementation of a proposed solution, using a proxy mini-application as a surrogate for a full-scale scientific simulation code. The first scalability studies were conducted with the above on modestly-sized experimental clusters. In contrast, in the current work we have integrated our in situ analysis engines with a full-size scientific application (S3D, using the Legion-SPMD model), and have conducted nu- merical tests on the largest computational platform currently available for DOE science ap- plications. We also provide details regarding the design and development of a light-weight asynchronous collectives library. We describe how this library is utilized within our SPMD- Legion S3D workflow, and compare the data aggregation technique deployed herein to the approach taken within our previous work.

97 MATHEMATICS AND COMPUTING↗

The Value of Transparency in Distributed Solar PV Markets

Distributed solar photovoltaic (PV) markets are relatively non-transparent: PV price and product information is not readily available, searching for this information is costly (in terms of time and effort), and customers are mostly unfamiliar with the new technology. Quote aggregation, where third-party companies collect PV quotes on behalf of customers, may be one way to increase PV market transparency. In this paper, quote aggregation data are analyzed to study the value of transparency for distributed solar PV markets. The results suggest that easier access to more quotes results in lower prices. We find that installers tend to offer lower prices in more competitive market environments. We supplement the empirical analysis with key findings from interviews of residential PV installers.

14 SOLAR ENERGY↗

Utilizing Commercial Real Estate Owner and Investor Data to Analyze the Financial Performance of Energy Efficient, High-Performance Office Buildings

Evidence has shown that owning and operating energy-efficient, high-performance, “green” properties results in multiple benefits including lower utility bills, higher rents, improved occupancy, and greater net operating income. However, it is difficult to isolate and control moderating factors to identify the specific drivers behind improved financial performance and value to investors that results from sustainability in real estate. DOE is interested in facilitating deeper investigation of the correlation between energy efficiency and financial performance, reducing data acquisition and matching challenges, and developing a stronger understanding of how sustainable design and energy efficiency impact value. DOE commissioned this pilot study to test the logistical and empirical procedures required to establish a Commercial Real Estate Data Aggregation & Trends Analysis lab, determine the potential benefits available through the lab, and contribute to the existing body of evidence in this field.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A Parallel Graph Environment for Real-World Data Analytics Workflows

Economic competitiveness and national security depend increasingly on the insightful analysis of large data sets. The diversity of real-world data sources and analytic workflows impose challenging hardware and software requirements for parallel graph platforms. The irregular nature of graph methods is not supported well by the deep memory hierarchies of conventional distributed systems, requiring new processor and runtime system designs to tolerate memory and synchronization latencies. Moreover, the efficiency of relational table operations and matrix computations are not attainable when data is stored in common graph data structures. In this paper, we present HAGGLE, a high-performance, scalable data analytics platform. The platform’s hybrid data model supports a variety of distributed, thread-safe data structures, parallel programming constructs, and persistent and streaming data. An abstract runtime layer enables us to map the stack to conventional, distributed computer systems with accelerators. The runtime uses multithreading, active messages, and data aggregation to hide memory and synchronization latencies on large-scale systems.

Graph Analytics↗

Model run output for WM-ABM 2024 HESS Publication

Model output for computational experiments introducing WM-ABM. See associated HESS publication here: https://egusphere.copernicus.org/preprints/2023/egusphere-2023-1604/ all_nldas_cdl_data_v3.txt - Cropland Data Layer data aggregated to 1/8 degree resolution for input into the PMP calibration process. Variables include NLDAS ID, crop type, year, the count of pixels in the grid cell of the crop type, CDL crop ID, and GCAM crop ID. 20230115 ABM runs - WM-ABM model outputs for various scenarios described in HESS publication. If multiple versions exist (e.g., v2, v3, etc.) latest version indicates dataset generated for manuscript. The "baseline" run is the primary run, where as the "memXX" runs indicate sensitivity runs testing different parameters of agent memory. Output files starting with "abm_results_" include groundwater irrigated acres and surface water irrigated acres for each farm/agent combination. Other CSV outputs provide summary statistics of various agent and water shortage outcomes, used for generation of figures in the HESS manuscript.

ABM↗

Integrated GW Farm ABM

This Data Repository includes data used for the integrated groundwater- farm ABM model, raw model output from scenario ensemble, and processed outputs that isolate the groundwater storage depletion outcomes for the 35,000 farm cells. Model Inputs: Farm ABM Inputs: This folder contains the input data used by the integrated groundwater - farm ABM modelling script (Python file) used for the high performance computing (HPC) experiments. The sub-folder "data inputs" contains all of the farm attribute data, while the three files in the folder have the hydrogeological data lookup table (NLDAS Cost Curve Attributes.csv), a lookup table (Theis well function table.csv) for the groundwater cost curve function, and the farm indexes and corresponding NLDAS ids for all of the cells run in this experiment (nldas farms subset final.csv). NLDAS Cost curve hydrogeological data: Hydrogeological data aggregated to 1/8 degree resolution and aligned with the NLDAS grid. Parameters include: water depth below ground surface [meters], subsurface porosity [unitless], aquifer depth from ground surface to aquifer bottom [meters], annual average recharge (USGS: mm, Doll: meters), and three different hydraulic conductivity (K) values (meters/day). The three K values represent the mean value from Gleeson et al. (2018), one standard deviation above the mean from Gleeson et al. (2018), and the de Graaf et al. 2020 modifications to certain lithologies. Additional information about these datasets and their processing are documented in the supplement to Yoon et al. 2025 (in review). Output: Raw outputs: This folder contains a .zip file that has model outputs for the entire scenario ensemble. There is one csv for each farm id, using the format "farm farmid cases.csv". The relationship between the farm id and NLDAS id is defined by the "nldas farms subset final.csv" located in the Farm ABM Inputs folder. Each csv has 625 rows, corresponding to 625 combinations of different scenario parameter values. Each row (scenario) represents the outcome of a 100 year simulation. Columns define scenario settings and summary statistics for each scenario. The first four columns define the scenario settings: "hydro ratio," "econ ratio," "K scenario," and "gamma scenario." The hydro and econ ratios are values passed to the modeling script that influence multipliers for other model parameters, as documented in the supplement to Yoon et al. 2025 (in review). The gamma multiplier is a coefficient multiplier applied to the baseline gamma values (values below 1 represent lower unobserved costs compared to baseline, values above 1 represent higher costs). The K scenario names represent K values of: "low": 0.5 m/d, "int 1": 2.5 m/d, "int 2": 10 m/d, "high": 50 m/d, and "gleeson": mean Gleeson K value. "Perc vol depleted" is the fraction of groundwater depleted at the end of the 100 simulation. Processed Output: Derived depletion outcomes from raw outputs: All of the individual csv files from the Raw outputs were aggregated into a single file that has the scenario settings and fraction depletion "Perc vol depleted" for every farm cell, for every scenario. The other two files define relationships between the farm id, NLDAS id, and local and major aquifer units, used for aquifer-level depletion analysis.

Agent based modeling↗

Use of 2nd and 3rd Level Correlation Analysis for Studying Degradation in Polycrystalline Thin-Film Solar Cells

The correlation of stress-induced changes in the performance of laboratory-made CdTe solar cells with various 2nd and 3rd level metrics is discussed. The overall behavior of aggregated data showing how cell efficiency changes as a function of open-circuit voltage (Voc), short-circuit current density (Jsc), and fill factor (FF) is explained using a two-diode, PSpice model in which degradation is simulated by systematically changing model parameters. FF shows the highest correlation with performance during stress, and is subsequently shown to be most affected by shunt resistance, recombination and in some cases voltage-dependent collection. Large decreases in Jsc as well as increasing rates of Voc degradation are related to voltage-dependent collection effects and catastrophic shunting respectively. Large decreases in Voc in the absence of catastrophic shunting are attributed to increased recombination. The relevance of capacitance-derived data correlated with both Voc and FF is discussed.

14 SOLAR ENERGY↗

Requirements for Predictive Analytics

It is important to have a clear understanding of how traditional Business Intelligence (BI) and analytics are different and how they fit together in optimizing organizational decision making. With tradition BI, activities are focused primarily on providing context to enhance a known set of information through aggregation, data cleansing and delivery mechanisms. As these organizations mature their BI ecosystems, they achieve a clearer picture of the key performance indicators signaling the relative health of their operations. Organizations that embark on activities surrounding predictive analytics and data mining go beyond simply presenting the data in a manner that will allow decisions makers to have a complete context around the information. These organizations generate models based on known information and then apply other organizational data against these models to reveal unknown information.

97 MATHEMATICS AND COMPUTING↗

Conflux – An Asynchronous 2-to-1 Multiplexor for Time-Division Multiplexing and Clock-less, Token-less Readout

This paper describes an independent, self-arbitrating asynchronous two-to-one multiplexor called Conflux. Conflux can be used to implement clock-less and token-less Time-Division Multiplexing between two sources. This capability can then be used to create a clock-less and token-less aggregate data bus which can be used as a complete asynchronous readout architecture for a chip, a part of a chip or an entire multi-chip system. Conflux utilizes a classic, four-phased asynchronous handshake on both of its input ports as well as on its output port. Asynchronous Request is bundled with Data to ensure consistent propagation delay. The Request is also differential to account for propagation delay differences between Logical Ones and Zeros. Arbitration between the two Conflux input streams is accomplished by three Set-Reset latches. Finally, Conflux cells were used successfully to implement the readout architecture of the FCP130 prototype chip. Tests indicate single Conflux stage delays of 1.8ns and a bandwidth of approximately 20 Gbps in 130nm CMOS.

43 PARTICLE ACCELERATORS↗

NLIT 2022 Axonius Presentation

Axonius, a cybersecurity asset management tool used at INL, provides visibility into users, devices, software, and hardware in use at the lab. This visibility, provided by aggregating data on lab entities from many tools' perspectives, makes incident response, configuration management, and IT operations more capable.

42 ENGINEERING↗

Information-Theoretic Approaches for Evaluating Complex Adaptive Social Simulation Systems

In this paper, we propose information-theoretic approaches for comparing and evaluating complex agent-based models. In information theoretic terms, entropy and mutual information are two measures of system complexity. We used entropy as a measure of the regularity of the number of agents in a social class; and mutual information as a measure of information shared by two social classes. Using our approaches, we compared two analogous agent-based (AB) models developed for regional-scale social-simulation system. The first AB model, called ABM-1, is a complex AB built with 10,000 agents on a desktop environment and used aggregate data; the second AB model, ABM-2, was built with 31 million agents on a highperformance computing framework located at Oak Ridge National Laboratory, and fine-resolution data from the LandScan Global Population Database. The initializations were slightly different, with ABM-1 using samples from a probability distribution and ABM-2 using polling data from Gallop for a deterministic initialization. The geographical and temporal domain was present-day Afghanistan, and the end result was the number of agents with one of three behavioral modes (proinsurgent, neutral, and pro-government) corresponding to the population mindshare. The theories embedded in each model were identical, and the test simulations focused on a test of three leadership theories - legitimacy, coercion, and representative, and two social mobilization theories - social influence and repression. The theories are tied together using the Cobb-Douglas utility function. Based on our results, the hypothesis that performance measures can be developed to compare and contrast AB models appears to be supported. Furthermore, we observed significant bias in the two models. Even so, further tests and investigations are required not only with a wider class of theories and AB models, but also with additional observed or simulated data and more comprehensive performance measures.

97 MATHEMATICS AND COMPUTING↗

Irradiation-induced damage in concrete-forming aggregates: revisiting literature data through micromechanics

The radiation-induced volumetric expansion (RIVE) of aggregate-forming minerals causes damage in concrete exposed to high levels of fast neutrons fluence ( \(>\,\sim \,10^{19}\, \hbox {n}\,\hbox {cm}^{-2}\) at kinetics energy above 0.1 MeV). Historical post-irradiation RIVE and Young’s modulus data obtained in test reactors were revisited using a polycrystalline homogenization model (self-consistent scheme) accounting for the aggregates’ minerals content and the formation of voids/cracks during irradiation. It was found that the formation of extra voids/cracks can contribute to the aggregate expansion more substantially than the cumulated expansions of aggregate-forming minerals. Furthermore, the rate of void creation appears to be inversely correlated to the silica content, although aggregates of higher silicate contents exhibit higher RIVEs. The loss of Young’s modulus decreases exponentially with the aggregates’ expansion. At a comparable RIVE level, the relative loss of modulus is more significant in aggregates of higher silica content.

36 MATERIALS SCIENCE↗

A Structure-Based Distance Metric for High-Dimensional Space Exploration with Multi-Dimensional Scaling

Although the Euclidean distance does well in measuring data distances within high-dimensional clusters, it does poorly when it comes to gauging inter-cluster distances. This significantly impacts the quality of global, low-dimensional space embedding procedures such as the popular multi-dimensional scaling (MDS) where one can often observe non-intuitive layouts. We were inspired by the perceptual processes evoked in the method of parallel coordinates which enables users to visually aggregate the data by the patterns the polylines exhibit across the dimension axes. We call the path of such a polyline its structure and suggest a metric that captures this structure directly in high-dimensional space. This allows us to better gauge the distances of spatially distant data constellations and so achieve data aggregations in MDS plots that are more cognizant of existing high-dimensional structure similarities. Our MDS plots also exhibit similar visual relationships as the method of parallel coordinates which is often used alongside to visualize the high-dimensional data in raw form. We then cast our metric into a bi-scale framework which distinguishes far-distances from near-distances. The coarser scale uses the structural similarity metric to separate data aggregates obtained by prior classification or clustering, while the finer scale employs the appropriate Euclidean distance.

Clustering↗

Consolidated Hydropower Data Repository: Value and Opportunities

Hydropower is one of several types of generating assets that provides energy, capacity, and services to electric power systems. It does so under rubrics and objectives—market driven and regulated, internal and external to asset and fleet owners—that address reliability, cost, price, and, increasingly, flexibility of output. The aggregation of data from multiple hydropower units can provide insights into asset operations and maintenance practices and needs and assist in meeting hydropower objectives. This paper examines the concept and potential benefits of aggregating hydropower asset data—primarily supervisory control and data acquisition (SCADA) information—with examples of insights developed from data aggregated by the Hydropower Research Institute (HRI). Data aggregation as discussed herein, and as implemented by the HRI, extends beyond multiple units in a powerhouse and beyond multiple hydropower facilities in an electric utility fleet or river system. Examples of research and analytics from such aggregated datasets range from unit load dependency analyses to modeling sensor measurements to detect and diagnose anomalies in assets. These examples showed the benefits of utilizing the entire dataset for insights into how the sensor layout of a single unit or set of units compares to the hydropower industry overall. Such insights include whether additional sensors are needed to complete analyses or to make decisions. In addition, utilizing multiple sensors of the same kind within a unit can provide an indication of possible current or upcoming problems with equipment. Although other analyses are possible, their use requires the development of complex models and, potentially, access to types of data that are currently not included with the example dataset used in this study. However, the examples studied herein confirmed the value of data aggregation in the fleet and unit contexts, and the value extends beyond multiple units in a powerhouse and beyond multiple hydropower facilities in an electric utility fleet or river system. The assessments also provided insights into potential extensions to the data aggregation concept that could further add to their value to the hydropower community, and these are included in this document as a set of recommendations.

13 HYDRO ENERGY↗

Proactive Data Containers for Scientific Storage (Final Report)

Emerging HPC systems are expected to be deployed with an unprecedented level of complexity, due to a deep system memory/storage hierarchy and heterogeneity of the storage hardware. This hierarchy is expected to range from CPU cache through several levels of volatile memory to nonvolatile memory, traditional hard disks, and tape. Simple and efficient methods of data management and movement through this hierarchy is critical for scientific applications using exascale systems. Existing storage system and I/O (SSIO) technologies face severe challenges in dealing with these requirements. POSIX and MPI I/O standards that are the basis for existing I/O libraries and parallel file systems present fundamental challenges in the areas of scalable metadata operations, semantics-based data movement performance tuning, asynchronous operation, and support for scalable consistency of distributed operations. Moving toward new paradigms for SSIO in the extreme-scale era, we have proposed to investigate novel object-based data abstractions and storage mechanisms that take advantage of the deep storage hierarchy and enable proactive automated performance tuning. In order to achieve these overarching goals, we initiated an effort to develop a fundamental new data abstraction, called Proactive Data Containers (PDC). A PDC is a container within a locus of storage (memory, NVRAM, disk, etc.) that stores science data in an object-centric manner. Managing data as objects enables powerful optimization opportunities for data movement and transformations. The R&D focus of this project are: 1) formulation of object-oriented PDCs and their mapping in different levels of the exascale storage hierarchy; 2) efficient strategies for moving data in deep storage hierarchies using PDCs; 3) techniques for transforming and reorganizing data based on application requirements; and 4) novel analysis paradigms for enabling data transformations and user-defined analysis on data in PDCs. Toward achieving these overarching goals, we designed an object-centric application programing interface (API) for HPC, scalable metadata management for object-centric storage systems, and data movement optimizations such as Data Elevator for moving data between two levels of storage devices and TAPIOCA for efficient aggregation of data on compute nodes. We then implemented several components of the PDC system. They include metadata management, data placement services, remote procedure calls, data aggregation, etc. We have put them together into the overall PDC framework.

97 MATHEMATICS AND COMPUTING↗