Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Complexity Reduction Methods for Large-Scale Spatially Explicit Biofuels Network Design

The size and complexity of energy system optimization models have increased significantly in recent years, driven by the availability of high-resolution spatial data. We present complexity reduction and solution methods that enable us to efficiently represent high-resolution spatial data in the network design of large-scale energy systems. We aim to reduce the size and enhance the computational efficiency of network design models without sacrificing solution accuracy. Specifically, we first present how to aggregate highly granular data into larger resolutions without averaging out their specific properties through a composite-curve-based approach and then develop a method to linearly represent these curves. Second, we utilize a general clustering method to determine groups of geographically proximate biomass fields and establish a single transportation arc for all of them, reducing the number of transportation-related variables while maintaining an accurate representation of the system. Finally, we introduce a two-step algorithm that decomposes large-scale network design problems into two smaller, more manageable subproblems. We demonstrate the application of our methods using a case study of switchgrass-to-biofuels network design in the eight states of the U.S. Midwest, using realistic and highly explicit spatial data.

09 BIOMASS FUELS↗

Fuzzy logic model of irradiated aggregates

The worldwide need for nuclear power plant (NPP) lifetime extension to meet future national energy requirements while reducing greenhouse gases raises the question of the condition of concrete structures exposed to ionizing radiation. Although research into the effects of radiation has a long history and the phenomenon of deterioration of concrete due to irradiation is not yet completely understood, the main assumed degradation mode is radiation-induced volumetric expansion of aggregates. There are experimental data on irradiated concrete obtained over decades under different conditions; however, the collection of data exhibits considerable scatter. Fuzzy logic modeling offers an effective tool that can interconnect various data sets obtained by different teams of experts under different conditions. The main goal of this work is to utilize available data on irradiated concrete components such as minerals and aggregates that expand upon irradiation. Furthermore, aggregate radiation-induced volumetric expansion gives an estimate of the change in mechanical properties of aggregate after years of reactor operation. The mechanical properties of irradiated aggregate can then be used for modeling irradiated concrete in the actual NPP structure based on the composition of concrete, the average temperature on the surface of the biological shield structure, and the neutron dose received by biological shield.

36 MATERIALS SCIENCE↗

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the FECM NETL Carbon Management Program Review Meeting 2024.

Creason, Christopher↗

Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses

This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the Geological Society of America Connects 2024 Annual Meeting in Anaheim, California, 22-25 September 2024.

Creason, Christopher↗

Spectroscopic and Theoretical Studies of Fluorescence Effects in 2-Methylamino-5-(2,4-dihydroxyphenyl)-1,3,4-thiadiazole Induced by Molecular Aggregation

The article presents the results of fluorescence analyses of 2-methylamino-5-(2,4-dihydroxyphenyl)-1,3,4-thiadiazole (MDFT) in an aqueous environment. MDFT dissolved in aqueous solutions with a pH value in the range from 1 to 4.5 yielded an interesting effect of two clearly separated fluorescence emissions. In turn, a single fluorescence was observed in MDFT dissolved in water solutions with a pH value from 4.5 to 12. As it was suggested in the previous investigations of other 1,3,4-thiadiazole compounds, these effects may be associated with conformational changes in the structure of the analysed molecule accompanied by aggregation effects. Crystallographic data showed that the effect of the two separated fluorescence emissions occurred in a conformation with the –OH group in the resorcyl ring bound on the side of the sulphur atom from the 1,3,4-thiadiazole ring. The hypothesis of aggregation as the mechanism involved in the change in the spectral properties at low pH is supported by the results of (Time-Dependent) Density Functional Theory calculations. The possibility of rapid analysis of conformational changes with the fluorescence spectroscopy technique may be rather important outcome obtained from the spectroscopic studies presented in this article. Additionally, the presented results seem to be highly important as they can be easily observed in solutions and biologically important samples.

74 ATOMIC AND MOLECULAR PHYSICS↗

Non-equilibrium phenomena and kinetic pathways in self-assembled polyelectrolyte complexes

Polyelectrolyte complexation has been conventionally focused on the thermodynamic states, where assemblies have equilibrated in solutions. Far less attention has been given to complex systems that are kinetically trapped at non-equilibrium states. A combination of time-resolved dynamic light scattering, small angle X-ray scattering (SAXS), and cryogenic transmission electron microscopy (Cryo-TEM) was employed here to investigate the internal structures and morphological evolution of non-equilibrium aggregates forming from a pair of two strong block polyelectrolytes over wide time and length scales. The role of formation pathways of electrostatically driven aggregates was assessed using two processing protocols: direct dissolution and salt annealing. The former led to thermodynamically stable products, while the latter resulted in kinetically trapped transient structures. After adding salt, the metastable structures gradually transformed into stable products. Cryo-TEM images showed the interconnected irregular morphologies of the aggregates, and SAXS data revealed the presence of fuzzy globular complexes with R-g similar to 10 nm within them. A two-step process in the time-dependent structural transformation was found and characterized by a fast breakdown of interconnected transient aggregates followed by a slow redistribution of the incipient individual electrostatic assemblies. Furthermore, the prolonged aggregate disintegration process fitting to a stretched exponential function unveiled the broad relaxation distribution and significant structural heterogeneity in these polyelectrolyte complex nanoaggregates. This work brings new insight into the comprehension of non-equilibrium phenomena in self-assembled electrostatic assemblies and represents a first step toward constructing far-from-equilibrium polyelectrolyte complexes de novo for future applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Distributed wireless sensing for fugitive methane leak detection

Large scale environmental monitoring requires dynamic optimization of data transmission, power management, and distribution of the computational load. In this work, we demonstrate the use of a wireless sensor network for detection of chemical leaks on gas oil well pads. The sensor network consist of chemi-resistive and wind sensors and aggregates all the data and transmits it to the cloud for further analytics processing. The sensor network data is integrated with an inversion model to identify leak location and quantify leak rates. We characterize the sensitivity and accuracy of such system under multiple well controlled methane release experiments. It is demonstrated that even 1 hour measurement with 10 sensors localizes leaks within 1 m and determines leak rate with an accuracy of 40%. This integrated sensing and analytics solution is currently refined to be a robust system for long term remote monitoring of methane leaks, generation of alarms, and tracking regulatory compliance.

04 OIL SHALES AND TAR SANDS↗

Assessing the Impact of Advanced Satellite Observations in the NASA GEOS-5 Forecast System Using the Adjoint Method

The adjoint of a data assimilation system provides a flexible and efficient tool for estimating observation impacts on short-range weather forecasts. The impacts of any or all observations can be estimated simultaneously based on a single execution of the adjoint system. The results can be easily aggregated according to data type, location, channel, etc., making this technique especially attractive for examining the impacts of new hyper-spectral satellite instruments and for conducting regular, even near-real time, monitoring of the entire observing system. In this talk, we present results from the adjoint-based observation impact monitoring tool in NASA's GEOS-5 global atmospheric data assimilation and forecast system. The tool has been running in various off-line configurations for some time, and is scheduled to run as a regular part of the real-time forecast suite beginning in autumn 20 I O. We focus on the impacts of the newest components of the satellite observing system, including AIRS, IASI and GPS. For AIRS and IASI, it is shown that the vast majority of the channels assimilated have systematic positive impacts (of varying magnitudes), although some channels degrade the forecast. Of the latter, most are moisture-sensitive or near-surface channels. The impact of GPS observations in the southern hemisphere is found to be a considerable overall benefit to the system. In addition, the spatial variability of observation impacts reveals coherent patterns of positive and negative impacts that may point to deficiencies in the use of certain observations over, for example, specific surface types. When performed in conjunction with selected observing system experiments (OSEs), the adjoint results reveal both redundancies and dependencies between observing system impacts as observations are added or removed from the assimilation system. Understanding these dependencies appears to pose a major challenge for optimizing the use of the current observational network and defining requirements for future observing systems.

Gelaro, Ron↗

Assessing the Impact of Observations on Numerical Weather Forecasts Using the Adjoint Method

The adjoint of a data assimilation system provides a flexible and efficient tool for estimating observation impacts on short-range weather forecasts. The impacts of any or all observations can be estimated simultaneously based on a single execution of the adjoint system. The results can be easily aggregated according to data type, location, channel, etc., making this technique especially attractive for examining the impacts of new hyper-spectral satellite instruments and for conducting regular, even near-real time, monitoring of the entire observing system. This talk provides a general overview of the adjoint method, including the theoretical basis and practical implementation of the technique. Results are presented from the adjoint-based observation impact monitoring tool in NASA's GEOS-5 global atmospheric data assimilation and forecast system. When performed in conjunction with standard observing system experiments (OSEs), the adjoint results reveal both redundancies and dependencies between observing system impacts as observations are added or removed from the assimilation system. Understanding these dependencies may be important for optimizing the use of the current observational network and defining requirements for future observing systems

Gelaro, Ronald↗

Distributed wireless sensing for methane leak detection technology

Large scale environmental monitoring requires dynamic optimization of data transmission, power management, and distribution of the computational load. In this work, we demonstrate the use of a wireless sensor network for detection of chemical leaks on gas oil well pads. The sensor network consist of chemi-resistive and wind sensors and aggregates all the data and transmits it to the cloud for further analytics processing. The sensor network data is integrated with an inversion model to identify leak location and quantify leak rates. We characterize the sensitivity and accuracy of such system under multiple well controlled methane release experiments. It is demonstrated that even 1 hour measurement with 10 sensors localizes leaks within 1 m and determines leak rate with an accuracy of 40%. This integrated sensing and analytics solution is currently refined to be a robust system for long term remote monitoring of methane leaks, generation of alarms, and tracking regulatory compliance.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A new event builder for CMS Run II

The data acquisition system (DAQ) of the CMS experiment at the CERN Large Hadron Collider (LHC) assembles events at a rate of 100 kHz, transporting event data at an aggregate throughput of 100 GB/s to the high-level trigger (HLT) farm. The DAQ system has been redesigned during the LHC shutdown in 2013/14. The new DAQ architecture is based on state-of-the-art network technologies for the event building. For the data concentration, 10/40 Gbps Ethernet technologies are used together with a reduced TCP/IP protocol implemented in FPGA for a reliable transport between custom electronics and commercial computing hardware. A 56 Gbps Inniband FDR CLOS network has been chosen for the event builder. This paper discusses the software design, protocols, and optimizations for exploiting the hardware capabilities. In conclusion, ee present performance measurements from small-scale prototypes and from the full-scale production system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Changes in the TRMM Version 7 Space/Time Averaged Level 3 Data Products Based on GPROF TMI Swath-Based Precipitation Retrievals

TRMM has three level 3 (space/time averaged) data products that aggregate level 2 TRMM Microwave Imager (TMI) GPROF precipitation retrievals. These three products are TRMM 3A12, which is a monthly accumulation of 2A12 the GPROF swath retrieval product; TRMM 3B31, which is a monthly accumulation of 2A12 and 2B31 the combined retrieval product that uses both Precipitation Radar (PR) and TMI data; and 3G68 and its variants, which provide hourly retrievals for TMI, PR and combined. The 3G68 products are packaged as daily files but provide hourly information at 0.5 deg x 0.5 deg resolution globally, 0.25 deg x 0.25 deg globally, or 0.1 deg x 0.1 deg over Africa, Australia and South America. This paper will present early information of the changes in the v7 TMI GPROF level 2 retrievals that have an impact on the level 3 accumulations. This paper provides an analysis of the effect the 2A12 GPROF changes have on 3G68 products. In addition, it provides a comparison between the TRMM level 3 products that use the TMI GPROF swath retrievals.

Stocker, Erich↗

Multivariate exploration of non-intrusive load monitoring via spatiotemporal pattern network

Non-intrusive load monitoring (NILM) of electrical demand for the purpose of identifying load components has thus far mostly been studied using univariate data, e.g., using only whole building electricity consumption time series to identify a certain type of end-use such as lighting load. However, using additional variables in the form of multivariate time series data may provide more information in terms of extracting distinguishable features in the context of energy disaggregation. In this work, a novel probabilistic graphical modeling approach, namely the spatiotemporal pattern network (STPN) is proposed for energy disaggregation using multivariate time-series data. The STPN framework is shown to be capable of handling diverse types of multivariate time-series to improve the energy disaggregation performance. The technique outperforms the state of the art factorial hidden Markov models (FHMM) and combinatorial optimization (CO) techniques in multiple real-life test cases. Furthermore, based on two homes' aggregate electric consumption data, a similarity metric is defined for the energy disaggregation of one home using a trained model based on the other home (i.e., out-of-sample case). The proposed similarity metric allows us to enhance scalability via learning supervised models for a few homes and deploying such models to many other similar but unmodeled homes with significantly high disaggregation accuracy.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Hybrid electric buses fuel consumption prediction based on real-world driving data

Estimating fuel consumption by hybrid diesel buses is challenging due to its diversified operations and driving cycles. Here, long-term transit bus monitoring data were utilized to empirically compare fuel consumption of diesel and hybrid buses under various driving conditions. Artificial neural network (ANN) based high-fidelity microscopic (1 Hz) and mesoscopic (5–60 min) fuel consumption models were developed for hybrid buses. The microscopic model contained 1 Hz driving, grade, and environment variables. The mesoscopic model aggregated 1 Hz data into 5 to 60-minute traffic pattern factors and predicted average fuel consumption over its duration. The prediction results show mean absolute percentage errors of 1–2% for microscopic models and 5–8% for mesoscopic models. The data were partitioned by different driving speeds, vehicle engine demand, and road grade to investigate their impacts on prediction performance.

33 ADVANCED PROPULSION SYSTEMS↗

File-Based Data Flow in the CMS Filter Farm

During the LHC Long Shutdown 1, the CMS Data Acquisition system underwent a partial redesign to replace obsolete network equipment, use more homogeneous switching technologies, and prepare the ground for future upgrades of the detector front-ends. The software and hardware infrastructure to provide input, execute the High Level Trigger (HLT) algorithms and deal with output data transport and storage has also been redesigned to be completely file- based. This approach provides additional decoupling between the HLT algorithms and the input and output data flow. All the metadata needed for bookkeeping of the data flow and the HLT process lifetimes are also generated in the form of small “documents” using the JSON encoding, by either services in the flow of the HLT execution (for rates etc.) or watchdog processes. These “files” can remain memory-resident or be written to disk if they are to be used in another part of the system (e.g. for aggregation of output data). We discuss how this redesign improves the robustness and flexibility of the CMS DAQ and the performance of the system currently being commissioned for the LHC Run 2.

Andre, J. M.↗

Single-crystal elasticity of (Al,Fe)-bearing bridgmanite up to 82 GPa

Abstract Thermoelastic properties of mantle candidate minerals are essential to our understanding of geophysical phenomena, geochemistry, and geodynamic evolutions of the silicate Earth. However, the lower-mantle mineralogy remains much debated due to the lack of single-crystal elastic moduli (Cij) and aggregate sound velocities of (Al,Fe)-bearing bridgmanite, the most abundant mineral of the planet, at the lower mantle pressure-temperature (P-T) conditions. Here we report single-crystal Cij of (Al,Fe)-bearing bridgmanite, Mg0.88Fe0.1Al0.14Si0.90O3 (Fe10-Al14-Bgm) with Fe3+/ΣFe = ~0.65, up to ~82 GPa using X-ray diffraction (XRD), Brillouin light scattering (BLS), and impulsive stimulated light scattering (ISLS) measurements in diamond-anvil cells (DACs). Two crystal platelets with orientations of (–0.50, 0.05, –0.86) and (0.65, –0.59, 0.48), that are sensitive to deriving all nine Cij, are used for compressional and shear wave velocity (νP and νS) measurements as a function of azimuthal angles over 200° at each experimental pressure. Our results show that all Cij of singe-crystal Fe10-Al14-Bgm increase monotonically with pressure with small uncertainties of 1–2% (±1σ), except C55 and C23, which have uncertainties of 3–4%. Using the third-order Eulerian finite-strain equations to model the elasticity data yields the aggregate adiabatic bulk and shear moduli and respective pressure derivatives at the reference pressure of 25 GPa: KS = 326 ± 4 GPa, µ = 211 ± 2 GPa, KS′ = 3.32 ± 0.04, and µ′ = 1.66 ± 0.02 GPa. The high-pressure aggregate νS and νP of Fe10-Al14-Bgm are 2.6–3.5% and 3.1–4.7% lower than those of MgSiO3 bridgmanite end-member, respectively. These data are used with literature reports on bridgmanite with different Fe and Al contents to quantitatively evaluate pressure and compositional effects on their elastic properties. Comparing with one-dimensional seismic profiles, our modeled velocity profiles of major lower-mantle mineral assemblages at relevant P-T suggest that the lower mantle could likely consist of about 89 vol% (Al,Fe)-bearing bridgmanite. After considering uncertainties, our best-fit model is still indistinguishable from pyrolitic or chondritic models.

Geochemistry & Geophysics↗

Wind direction estimation using SCADA data with consensus-based optimization

Abstract. Wind turbines in a wind farm typically operate individually to maximize their own performance and do not take into account information from nearby turbines. To enable cooperation to achieve farm-level objectives, turbines will need to use information from nearby turbines to optimize performance, ensure resiliency when other sensors fail, and adapt to changing local conditions. A key element of achieving a more efficient wind farm is to develop algorithms that ensure reliable, robust, real-time, and efficient operation of wind turbines in a wind farm using local sensor information that is already being collected, such as supervisory control and data acquisition (SCADA) data, local meteorological stations, and nearby radars/sodars/lidars. This article presents a framework for developing a cooperative wind farm that incorporates information from nearby turbines in real time to better align turbines in a wind farm. SCADA data from multiple turbines can be used to make better estimates of the local inflow conditions at each individual turbine. By incorporating measurements from multiple nearby turbines, a more reliable estimate of the wind direction can be obtained at an individual turbine. The consensus-based approach presented in this paper uses information from nearby turbines to estimate wind direction in an iterative way rather than aggregating all the data in a wind farm at once. Results indicate that this estimate of the wind direction can be used to improve the turbine's knowledge of the wind direction. This estimated wind direction signal has implications for potentially decreasing dynamic yaw misalignment, decreasing the amount of time a turbine spends yawing due to a more reliable input to the yaw controller, increasing resiliency to faulty wind-vane measurements, and increasing the potential for wind farm control strategies such as wake steering.

17 WIND ENERGY↗