Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

DC Fast Charger Usage in the Pacific Northwest

This document will describe the use of a number of Direct Current Fast Charging Stations throughout Washington and Oregon as a part of of the West Coast Electric Highway. It will detail the usage frequency and location of the charging stations INL has data from. It will also include aggregated data from hundreds of privately owned vehicles that were enrolled in the EV Project regarding driving distance when using one of the West Coast Electric Highway fast chargers. This document is a white paper that will be published on the INL AVTA website.

33 ADVANCED PROPULSION SYSTEMS↗

SPRUCE Stability of Peatland Carbon to Rising Temperatures: Supporting Data

This data set reports the results of extensive field measurements and laboratory analyses of samples from the SPRUCE experiment. Results indicate that ecosystem-scale warming of over 2 m of peat exponentially increased CH4 emissions —but not ecosystem respiration of CO2. Multiple lines of evidence, including incubations and in situ analyses of 14C, dissolved gases, and microbial community metabolic potential, indicate that CH4 emissions increased due to surface processes and not degradation of deeper buried carbon. The supporting data provided include the summarized and aggregated data used to generate the six figures in the main text of the paper and the 12 supplementary figures.

54 ENVIRONMENTAL SCIENCES↗

Projections of Hourly Meteorology by Balancing Authority Based on the IM3/HyperFACETS Thermodynamic Global Warming (TGW) Simulations

This dataset contains 40 years (1980-2019) of historical hourly meteorology and 80 years (2020-2099) of projected hourly meteorology for 54 Balancing Authorities (BAs) in the conterminous United States. Details about the scenarios and variables included in this dataset are in the readme.pdf file. This dataset is derived from the IM3/HyperFACETS Thermodynamic Global Warming (TGW) simulations (https://doi.org/10.57931/1885756). More details on the TGW approach can be found at: https://tgw-data.msdlive.org/. If you use this dataset please also cite the raw TGW dataset (Jones, A. D., Rastogi, D., Vahmani, P., Stansfield, A., Reed, K., Thurber, T., Ullrich, P., & Rice, J. S. (2022). IM3/HyperFACETS Thermodynamic Global Warming (TGW) Simulation Datasets (v1.0.0) [Data set]. MSD-LIVE Data Repository. https://doi.org/10.57931/1885756). To go from the TGW data to these BA-level aggregated data we first averaged the raw gridded data by county in the United States. That intermediate data step is also stored in MSD-LIVE (https://doi.org/10.57931/1960548). We then population-weight the county-level hourly data in order to create population-weighted meteorology time series for each BA. Historical populations are from the United States Census Bureau and the evolving future populations are based on Shared Socioeconomic Pathways (SSPs) 3 and 5. The four climate scenarios crossed with the two SSPs yield eight different future projections for each BA: rcp45cooler_ssp3, rcp45cooler_ssp5, rcp45hotter_ssp3, rcp45hotter_ssp5, rcp85cooler_ssp3, rcp85cooler_ssp5, rcp85hotterssp3, rcp85hotterssp5. For the historical period and each of the eight future scenarios the dataset has hourly estimates of the population-weighted average of five meteorological variables: Temperature, specific humidity, shortwave radiation, longwave radiation, and wind speed. All times are in Coordinated Universal Time (UTC). The code to go from the raw TGW data to county-level and then BA-level projections is available at: https://github.com/IMMM-SFA/im3components/tree/main/im3components/wrf_to_tell.

Balancing Authority↗

The New Small Wheel electronics

The increase in luminosity, and consequent higher backgrounds, of the LHC upgrades require improved rejection of fake tracks in the forward region of the ATLAS Muon Spectrometer. The New Small Wheel upgrade of the Muon Spectrometer aims to reduce the large background of fake triggers from track segments that don't originate from the interaction point. The New Small Wheel employs two detector technologies, the resistive strip Micromegas detectors and the “small” Thin Gap Chambers, with a total of 2.45 million electrodes to be sensed. The two technologies require the design of a complex electronics system given that it consists of two different detector technologies and is required to provide both precision readout and a fast trigger. It will operate in a high background radiation region up to about 20 kHz/cm 2 at the expected HL-LHC luminosity of $\mathcal{L}$= 7.5 × 10 34 cm -2 s -1 . The architecture of the system is strongly defined by the GBTx data aggregation ASIC, the newly-introduced FELIX data router and the software based data handler of the ATLAS detector. The electronics complex of this new detector was designed and developed in the last ten years and consists of multiple radiation tolerant Application Specific Integrated Circuits, multiple front-end boards, dense boards with FPGA's and purpose-built Trigger Processor boards within the ATCA standard. The New Small Wheel has been installed in 2021 and is undergoing integration within ATLAS for LHC Run 3. It should operate through the end of Run 4 (December 2032). In this manuscript, the overall design of the New Small Wheel electronics is presented.

47 OTHER INSTRUMENTATION↗

Aggregation bias and its drivers in large‐scale flood loss estimation: A Massachusetts case study

Abstract Large‐scale estimations of flood losses are often based on spatially aggregated inputs. This makes risk assessments vulnerable to aggregation bias, a well‐studied, sometimes substantial outcome in analyses that model fine‐grained spatial phenomena at coarse spatial units. To evaluate this potential in the context of large‐scale flood risk assessments, we use data from a high‐resolution flood hazard model and structure inventory for over 1.3 million properties in Massachusetts and examine how prominent data aggregation approaches affect the magnitude and spatial distribution of flood loss estimates. All considered aggregation approaches rely on aggregate structure inventories but differ in whether flood hazard is also aggregated. We find that aggregating only structure inventories slightly underestimates overall losses (−10% bias), and when flood hazard data is spatially aggregated to even relatively small spatial units (census block), statewide aggregation bias can reach +366%. All aggregation‐based procedures fail to capture the spatial covariation of inputs distributions in the upper tails that disproportionately generate total expected losses. Our findings are robust to several key assumptions, add important context to published risk assessments and highlight opportunities to improve flood loss estimation uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗

Energy Efficiency Finance Programs: Use Case Analysis to Define Data Needs and Guidelines

There are over 200 energy efficiency loan programs—across 49 U.S. states—administered by utilities, state/local government agencies, or private lenders.1 This distributed model has led to significant variation in program design and implementation practices including how data is collected and used. The challenge of consolidating and aggregating data across independently administered programs has been illustrated by a recent pilot of an open source database for energy efficiency financing program data. This project was led by the Environmental Defense Fund (EDF), the Investor Confidence Project, the Clean Energy Finance Center (CEFC), and the University of Chicago. This partnership discussed data collection practices with a number of existing energy efficiency loan programs and identified four programs that were suitable and willing to participate in the pilot database (Diamond 2014).2 The partnership collected information related to ~12,000 loans with an aggregate value of ~$100M across the four programs. Of the 95 data fields collected across the four programs, 30 fields were common between two or more programs and only seven data fields were common across all programs. The results of that pilot study illustrate the inconsistencies in current data definition and collection practices among energy efficiency finance programs and may contribute to certain barriers.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Streak camera based SLR receiver for two color atmospheric measurements

To realize accurate two-color differential measurements, an image digitizing system with variable spatial resolution was designed, built, and integrated to a photon-counting picosecond streak camera, yielding a temporal scan resolution better than 300 femtosecond/pixel. The streak camera is configured to operate with 3 spatial channels; two of these support green (532 nm) and uv (355 nm) while the third accommodates reference pulses (764 nm) for real-time calibration. Critical parameters affecting differential timing accuracy such as pulse width and shape, number of received photons, streak camera/imaging system nonlinearities, dynamic range, and noise characteristics were investigated to optimize the system for accurate differential delay measurements. The streak camera output image consists of three image fields, each field is 1024 pixels along the time axis and 16 pixels across the spatial axis. Each of the image fields may be independently positioned across the spatial axis. Two of the image fields are used for the two wavelengths used in the experiment; the third window measures the temporal separation of a pair of diode laser pulses which verify the streak camera sweep speed for each data frame. The sum of the 16 pixel intensities across each of the 1024 temporal positions for the three data windows is used to extract the three waveforms. The waveform data is processed using an iterative three-point running average filter (10 to 30 iterations are used) to remove high-frequency structure. The pulse pair separations are determined using the half-max and centroid type analysis. Rigorous experimental verification has demonstrated that this simplified process provides the best measurement accuracy. To calibrate the receiver system sweep, two laser pulses with precisely known temporal separation are scanned along the full length of the sweep axis. The experimental measurements are then modeled using polynomial regression to obtain a best fit to the data. Data aggregation using normal point approach has provided accurate data fitting techniques and is found to be much more convenient than using the full rate single shot data. The systematic errors from this model have been found to be less than 3 ps for normal points.

Varghese, Thomas K.↗

Application-specific I/O Optimizations on Petascale Supercomputers

Data-intensive science frontiers and challenges are emerg ing as computer technology has evolved substantially. Large-scale simu lations demand significant I/O workload, and as a result the I/O performance often becomes a bottleneck preventing high performance in scientific applications. In this paper we introduce a variety of I/O optimization techniques developed and imple mented when scaling a seismic application to petascale. These techniques include file system striping, data aggreg ation, reader/writer limit ing and less interleaving of data, collective MPI-IO, and data staging. The optimizations result in nearly perfect scalability of the target applicat ion on some of the most advanced petascale systems. The techniques introduced in this paper are applicab le to other scientific applications facing similar petascale I/O challenges.

97 MATHEMATICS AND COMPUTING↗

The trigger and data acquisition for the NEMO-Phase 2 tower

In the framework of the Phase 2 of the NEMO neutrino telescope project, a tower with 32 optical modules is being operated since march 2013. A new scalable Trigger and Data Acquisition System (TriDAS) has been developed and extensively tested with the data from this tower. Adopting the all-data-to-shore concept, the NEMO TriDAS is optimized to deal with a continuous data-stream from off-shore to on-shore with a large bandwidth. The TriDAS consists of four computing layers: (i) data aggregation of isochronal hits from all optical modules; (ii) data filtering by means of concurrent trigger algorithms; (iii) composition of the filtered events into post-trigger files; (iv) persistent data storage. The TriDAS implementation is reported together with a review of dedicated on-line monitoring tools.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Distributed Intelligent Automated Demand Response Building Management System

The goal of the 2.5 year Distributed Intelligent Automated Demand Response (DIADR) project was to reduce peak electricity load of Sutardja Dai Hall at UC Berkeley by 30% while maintaining a healthy, comfortable, and productive environment for the occupants. We sought to bring together both central and distributed control to provide “deep” demand response1 at the appliance level of the building as well as typical lighting and HVAC applications. This project brought together Siemens Corporate Research and Siemens Building Technology (the building has a Siemens Apogee Building Automation System (BAS)), Lawrence Berkeley National Laboratory (leveraging their Open Automated Demand Response (openADR), Auto-­Demand Response, and building modeling expertise), and UC Berkeley (related demand response research including distributed wireless control, and grid-­to-­building gateway development). Sutardja Dai Hall houses the Center for Information Technology Research in the Interest of Society (CITRIS), which fosters collaboration among industry and faculty and students of four UC campuses (Berkeley, Davis, Merced, and Santa Cruz). The 141,000 square foot building, occupied in 2009, includes typical office spaces and a nanofabrication laboratory. Heating is provided by a district heating system (steam from campus as a byproduct of the campus cogeneration plant); cooling is provided by one of two chillers: a more typical electric centrifugal compressor chiller designed for the cool months (Nov-­ March) and a steam absorption chiller for use in the warm months (April-­October). Lighting in the open office areas is provided by direct-­indirect luminaries with Building Management System-­based scheduling for open areas, and occupancy sensors for private office areas. For the purposes of this project, we focused on the office portion of the building. Annual energy consumption is approximately 8053 MWh; the office portion is estimated as 1924 MWh. The maximum peak load during the study period was 1175 kW. Several new tools facilitated this work, such as the Smart Energy Box, the distributed load controller or Energy Information Gateway, the web-­based DR controller (dubbed the Central Load-­Shed Coordinator or CLSC), and the Demand Response Capacity Assessment & Operation Assistance Tool (DRCAOT). In addition, an innovative data aggregator called sMAP (simple Measurement and Actuation Profile) allowed data from different sources collected in a compact form and facilitated detailed analysis of the building systems operation. A smart phone application (RAP or Rapid Audit Protocol) facilitated an inventory of the building’s plug loads. Carbon dioxide sensors located in conference rooms and classrooms allowed demand controlled ventilation. The extensive submetering and nimble access to this data provided great insight into the details of the building operation as well as quick diagnostics and analyses of tests. For example, students discovered a short-­cycling chiller, a stuck damper, and a leaking cooling coil in the first field tests. For our final field tests, we were able to see how each zone was affected by the DR strategies (e.g., the offices on the 7th floor grew very warm quickly) and fine-­tune the strategies accordingly.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Radio Afterglow Detection and AI-driven Response (RADAR): A Federated Framework for Gravitational-wave Event Follow-up

The landmark detection of both gravitational waves (GWs) and electromagnetic (EM) radiation from the binary neutron star merger GW170817 has spurred efforts to streamline the follow-up of GW alerts in current and future observing runs of ground-based GW detectors. Within this context, the radio band of the EM spectrum presents unique challenges. Sensitive radio facilities capable of detecting the faint radio afterglow seen in GW170817, and with sufficient angular resolution, have small fields of view compared to typical GW localization areas. Additionally, theoretical models predict that the radio emission from binary neutron star mergers can evolve over weeks to years, necessitating long-term monitoring to probe the physics of the various postmerger ejecta components. These constraints, combined with limited radio observing resources, make the development of more coordinated follow-up strategies essential—especially as the next generation of GW detectors promises a dramatic increase in detection rates. Here, we present RADAR, a framework designed to address these challenges by promoting community-driven information sharing, federated data analysis, and system resilience, while integrating AI methods for both GW signal identification and radio data aggregation. We show that it is possible to preserve data rights while sharing models that can help design and/or update follow-up strategies. We demonstrate our approach through a case study of GW170817, and discuss future directions for refinement and broader application.

Gravitational waves↗

Issues in knowledge representation to support maintainability: A case study in scientific data preparation

Scientific data preparation is the process of extracting usable scientific data from raw instrument data. This task involves noise detection (and subsequent noise classification and flagging or removal), extracting data from compressed forms, and construction of derivative or aggregate data (e.g. spectral densities or running averages). A software system called PIPE provides intelligent assistance to users developing scientific data preparation plans using a programming language called Master Plumber. PIPE provides this assistance capability by using a process description to create a dependency model of the scientific data preparation plan. This dependency model can then be used to verify syntactic and semantic constraints on processing steps to perform limited plan validation. PIPE also provides capabilities for using this model to assist in debugging faulty data preparation plans. In this case, the process model is used to focus the developer's attention upon those processing steps and data elements that were used in computing the faulty output values. Finally, the dependency model of a plan can be used to perform plan optimization and runtime estimation. These capabilities allow scientists to spend less time developing data preparation procedures and more time on scientific analysis tasks. Because the scientific data processing modules (called fittings) evolve to match scientists' needs, issues regarding maintainability are of prime importance in PIPE. This paper describes the PIPE system and describes how issues in maintainability affected the knowledge representation used in PIPE to capture knowledge about the behavior of fittings.

Chien, Steve↗

Intelligent assistance in scientific data preparation

Scientific data preparation is the process of extracting usable scientific data from raw instrument data. This task involves noise detection (and subsequent noise classification and flagging or removal), extracting data from compressed forms, and construction of derivative or aggregate data (e.g. spectral densities or running averages). A software system called PIPE provides intelligent assistance to users developing scientific data preparation plans using a programming language called Master Plumber. PIPE provides this assistance capability by using a process description to create a dependency model of the scientific data preparation plan. This dependency model can then be used to verify syntactic and semantic constraints on processing steps to perform limited plan validation. PIPE also provides capabilities for using this model to assist in debugging faulty data preparation plans. In this case, the process model is used to focus the developer's attention upon those processing steps and data elements that were used in computing the faulty output values. Finally, the dependency model of a plan can be used to perform plan optimization and run time estimation. These capabilities allow scientists to spend less time developing data preparation procedures and more time on scientific analysis tasks.

Chien, Steve↗

Medium and Heavy Duty Vehicle Field Evaluations (Presentation)

This presentation discusses field evaluations of medium- and heavy-duty vehicles performed by NREL. The project provides medium-duty (MD) and heavy-duty (HD) test results, aggregated data, and detailed analysis, including 3rd party unbiased data (data that would not normally be shared by industry in an aggregated and detailed manner). Over 5.6 million miles of advanced technology MD and HD truck data have been collected, documented, and analyzed on over 240 different vehicles since 2002. Data, analysis, and reports are shared within DOE, national laboratory partners, and industry for R&D planning and strategy. The results help guide R&D for new technology development, help define intelligent usage of newly developed technology, and help fleets/users understand all aspects of advanced technology.

2014 AMR↗

Scalable Data Management of the Uintah Simulation Framework for Next-Generation Engineering Problems with Radiation

The need to scale next-generation industrial engineering problems to the largest computational platforms presents unique challenges. This paper focuses on data management related problems faced by the Uintah simulation framework at a production scale of 260K processes. Uintah provides a highly scalable asynchronous many-task runtime system, which in this work is used for the modeling of a 1000 megawatt electric (MWe) ultra-supercritical (USC) coal boiler. At 260K processes, we faced both parallel I/O and visualization related challenges, e.g., the default file-per-process I/O approach of Uintah did not scale on Mira. In this paper we present a simple to implement, restructuring based parallel I/O technique. We impose a restructuring step that alters the distribution of data among processes. The goal is to distribute the dataset such that each process holds a larger chunk of data, which is then written to a file independently. This approach finds a middle ground between two of the most common parallel I/O schemes–file per process I/O and shared file I/O–in terms of both the total number of generated files, and the extent of communication involved during the data aggregation phase. To address scalability issues when visualizing the simulation data, we developed a lightweight renderer using OSPRay, which allows scientists to visualize the data interactively at high quality and make production movies. Finally, this work presents a highly efficient and scalable radiation model based on the sweeping method, which significantly outperforms previous approaches in Uintah, like discrete ordinates. The integrated approach allowed the USC boiler problem to run on 260K CPU cores on Mira.

97 MATHEMATICS AND COMPUTING↗

A Mock UF6 Feed and Withdrawal System for Testing Safeguards Monitoring Systems and Strategies Intended for Nuclear Fuel Enrichment and Processing Plants

This report describes an engineering-scale, mock UF6 feed and withdrawal (F&W) system, its operation, and its intended uses. This system has been assembled to provide a test bed for evaluating and demonstrating new methodologies that can be used in remote, unattended, continuous monitoring of nuclear material process operations. These measures are being investigated to provide independent inspectors improved assurance that operations are being conducted within declared parameters, and to increase the overall effectiveness of safeguarding nuclear material. Testing applicable technologies on a mock F&W system, which uses water as a surrogate for UF6, enables thorough and cost-effective investigation of hardware, software, and operational strategies before their direct installation in an industrial nuclear material processing environment. Electronic scales used for continuous load-cell monitoring also are described as part of the basic mock F&W system description. Continuous monitoring components on the mock F&W system are linked to a data aggregation computer by a local network, which also is depicted. Data collection and storage systems are described only briefly in this report. The mock UF{sub 6} F&W system is economical to operate. It uses a simple process involving only a surge tank between feed tanks and product and withdrawal (or waste) tanks. The system uses water as the transfer fluid, thereby avoiding the use of hazardous UF{sub 6}. The system is not tethered to an operating industrial process involving nuclear materials, thereby allowing scenarios (e.g., material diversion) that cannot be conducted otherwise. These features facilitate conducting experiments that yield meaningful results with a minimum of expenditure and quick turnaround time. Technologies demonstrated on the engineering-scale system lead to field trials (described briefly in this report) for determining implementation issues and performance of the monitoring technologies under plant operating conditions. The ultimate use of technologies tested on the engineering-scale test bed is to work with safeguards agencies to install them in operating plants (e.g., enrichment and fuel processing plants), thereby promoting new safeguards measures with minimal impact to operating plants. In addition, this system is useful in identifying features for new plants that can be incorporated as part of 'safeguards by design,' in which load cells and other monitoring technologies are specified to provide outputs for automated monitoring and inspector evaluation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Simple and Scalable Streaming: The GRETA Data Pipeline

The Gamma Ray Energy Tracking Array (GRETA) is a state of the art gamma-ray spectrometer being built at Lawrence Berkeley National Laboratory to be first sited at the Facility for Rare Isotope Beams (FRIB) at Michigan State University. A key design requirement for the spectrometer is to perform gamma-ray tracking in near real time. To meet this requirement we have used an inline, streaming approach to signal processing in the GRETA data acquisition system, using a GPU-equipped computing cluster. The data stream will reach 480 thousand events per second at an aggregate data rate of 4 gigabytes per second at full design capacity. We have been able to simplify the architecture of the streaming system greatly by interfacing the FPGA-based detector electronics with the computing cluster using standard network technology. A set of highperformance software components to implement queuing, flow control, event processing and event building have been developed, all in a streaming environment which matches detector performance. Prototypes of all high-performance components have been completed and meet design specifications.

Cromaz, Mario↗