SEARCH · Search NASA

Results for “Data compression”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

All sources NASA NTRS DOE OSTI

DOE OSTI2020

ZFP Hardware Implementation

As core counts increase in new HPC systems with comparatively little increase in memory bandwidth, the trend is an effective decrease in memory bandwidth per core. Other bandwidth limitations in HPC systems exist between CPU and GPU memory, between system nodes, and between node memory and storage. Compression of floating-point data has the potential to reduce data movement and pressure across these communication channels. Furthermore, it has the potential to reduce the footprint of floating-point arrays stored in memory. ZFP, implemented in software, is gaining traction as an effective method in floating-point compression; however, performance gains are limited to the spare compute cycles available before reaching the bandwidth limitations of the communication channel. A hardware implementation of ZFP has the potential to raise the bar on performance. From the inception of ZFP, it was designed to accommodate a hardware implementation.

42 ENGINEERING↗

DOE OSTI2022

Leafweb: Dataset in Support of Coupled Modeling of Photophysics, Photochemistry, and Biochemistry of Photosynthesis, December 2022 Release

This data set contains measurements of leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry of light, carbon dioxide (CO2), oxygen (O2), and temperature responses from 26 C3 photosynthetic and four C4 photosynthetic species measured by independent researchers in Canada, China, Finland, Netherlands, and United States in the field, garden, or greenhouse. Data were collected between 1987 and 2021, however data for individual species only provide coverage over a few hours to one year. Species include three lianas, three shrubs, two boreal deciduous trees, two boreal evergreen needle-leaf tree, three temperate deciduous trees, four tropical deciduous trees, three tropical evergreen trees, one C3 grass, three C4 grasses, and six crop varieties. These measurements are conducted according to standard protocols in gas exchange (Long and Bernacchi 2003) and PAM fluorometry (Baker 2008). The Scots pine (Pinus sylvestris) dataset contains one-year continuous fluorometry observations made at intervals of 10 or 30 minutes in the field under natural environments using Walz monitoring PAM. Measurements from all other 29 species include simultaneous PAM fluorometry and gas exchange observations. Among these 29 species, seven species were measured with light response curves only (i.e., light intensity varied systematically with ambient CO2 concentration controlled at a constant level, e.g., 400 ppm). All the other 22 species were measured with both the light response and CO2 response (i.e., ambient CO2 concentration varied systematically with light intensity controlled at a constant level, e.g., 1200 µmolm-2s-1). For most species, measurements were made with temperature controlled at ~ 25 degrees Celsius (C) with the exceptions of Scots pine (natural diurnal and seasonal variations), tomato cultivar Basket Vee (~ 21 degrees C), and cotton which contained temperature stress experiments (9 to 40 degrees C). All measurements were made at ambient O2 concentration except for the tomato cultivar Basket Vee and cotton which used two O2 levels (2 and 21%) and rice and tomato cultivar Growdena which used five O2 levels (2, 10, 21, 35, and 50%). This dataset supports the complete modeling of photosynthesis at the leaf scale, including photophysical, photochemical, and biochemical reactions. It will support research in the applications of remotely sensed solar induced chlorophyll fluorescence and the responses of energy dissipation pathways to environmental variations across species and climates. This dataset contains 260 data files in comma separate (.csv) format contained inside 11 compressed (*.zip) files. Additional metadata are provided: one data dictionary, a species information table, and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format.

air temperature↗

DOE OSTI2022

Apparatus for measuring strength in biaxial compression

We report most measurements of compressive strength of ductile materials have involved Hopkinson–Kolsky bars or Taylor anvils placing samples in uniaxial compression. In these geometries, strain is limited by the tendency of the sample to petal, in analogy to necking in uniaxial tension. Estimation of strength for any other form of the stress tensor requires assuming a shape of the yield surface; because data exist only for uniaxial compression, these assumptions are untested. In an imploding spherical shell, compression is biaxial, the plastic strain may not be small, and the material behavior may be nonlinear as a result of work hardening and heating by plastic work. We outline a method of measuring the strengths of materials in biaxial compression, both quasistatically and dynamically, using the compression of thin spherical shells. We suggest surrounding the shell with an annulus filled with a mixture of H 2 and Cl 2 gases whose homogeneous ignition is initiated by a flash of blue and near-ultraviolet light. Less promising approaches are described in Appendixes A–C .

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Leafweb: Leaf Gas Exchange and Pulse-Amplitude Modulated Fluorometry for C4 Species, June 2026 Release

This dataset contains leaf gas exchange and Pulse-Amplitude Modulated (PAM) fluorometry for 98 C4 species. The C4 photosynthetic pathway employs specialized CO2 concentration mechanisms and Kranz anatomy to enrich CO2 concentration around Rubisco, the enzyme that catalyzes carbon fixation in the Calvin-Benson cycle to suppress photorespiration and increase the use efficiencies of light, nitrogen, and water as compared to the C3 photosynthetic pathways. Large-scale C4 photosynthetic datasets are relatively scarce, which has affected C4 photosynthesis research. To improve C4 photosynthetic data availability, Leafweb organized an effort to systematically collect, compile, standardize, and organize measurements of leaf gas exchange and/or Pulse-Amplitude Modulated (PAM) fluorometry of C4 species. This derived a C4 photosynthetic dataset containing measurements made by independent researchers in multiple countries in various environments (field, garden, or greenhouse). It covers three biochemical subtypes – the nicotinamide adenine dinucleotide phosphate-malic enzyme (NADP-ME), nicotinamide adenine dinucleotide-malic enzyme (NAD-ME), and phosphoenolpyruvate carboxykinase (PEP-CK) subtypes. This dataset is useful for using Artificial Intelligence / Machine Learning and mechanistic models to study C4 photosynthesis and compare across different biochemical subtypes. This dataset contains 3 compressed (*.zip) folders containing 1,892 data files in comma-separate values (*.csv) format. Additional metadata are provided: one data dictionary and a file-level metadata file in comma-separate values (*.csv) format and a user guide in PDF (*.pdf) format.

Zhou, Haoran [Tianjin University, China]↗

DOE OSTI2021

Shear strength measurements and hydrostatic compression of rhenium diboride under high pressures

Shear strength measurements have been carried out on rhenium diboride, ReB 2 , to a pressure of 74 GPa using a Radial X-ray Diffraction (R-XRD) technique in a diamond anvil cell using platinum as an internal x-ray pressure standard. The R-XRD result has provided a unique insight into the deformation of hexagonal crystal lattice under non-hydrostatic compression and variation of shear strength with increasing pressure. From R-XRD data, we have estimated hydrostatic component of compression to determine an equation of state of rhenium diboride yielding a bulk modulus of K 0 = 366 ± 25 GPa with a pressure derivative $K^{'}_{0}$ = 4.3 ± 0.5 in good agreement with hydrostatic density functional theory calculations. Here, the average lower bound of shear strength (τ) from various diffraction planes was then calculated using the measured interplanar d-spacing (d m ) and hydrostatic component of d-spacing (d p ) to be shown to approach 6.7 ± 0.4 GPa at 70 GPa. Our results show that the anisotropic compression effects observed in ReB 2 under hydrostatic compression are correlated to electronic structure changes under compression as predicted by theoretical calculations.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Incorporation of market signals for the optimal design of post combustion carbon capture systems

Recent studies have shown that fossil generators equipped with post-combustion carbon capture (PCC) systems are needed to reduce the cost of deep decarbonization. Such generators need to be flexible and responsive to grid conditions, particularly in a high variable renewable energy (VRE) environment. In this work, we evaluate the net present value (NPV) of retrofitting an existing natural gas combined cycle (NGCC) unit with a flexible PCC system while incorporating market signals from a high VRE grid. We use our industrial partner’s NGCC configuration as representative of existing NGCC units and Svante’s rapid-temperature swing adsorption (TSA) for PCC. Because of its ability to rapidly startup/shutdown and ramp-up/ramp-down, the chosen capture technology is very attractive for load-following operations. For a given set of market signals, we formulate a two-stage stochastic multi-period optimization problem, under the price-taker assumption, to simultaneously optimize the design of the capture system and operation of the entire plant. Rigorous models for the NGCC unit, PCC system, and compression system are developed using commercial process simulators and validated with either plant or vendor data. For computational tractability, we develop surrogate/reduced-order models for use in the optimization problem. The surrogate model for the NGCC plant is constructed by linearizing the rigorous dynamic model at 75% load, while data-driven nonlinear surrogate models for the capture and compression systems are constructed using simulation data from the rigorous models. The optimization problem, formulated as a mixed integer bilinear program, is implemented in the IDAES® integrated platform and solved to global optimality using Gurobi 9.5. Using this formulation, we determine the profitability of retrofitting an existing NGCC unit with the chosen capture system for multiple regions in the U.S. under two scenarios with different carbon prices. Importantly, the results show that the optimal decision strongly depends on the region and on the carbon price, thereby demonstrating the importance of the inclusion of market signals in the design process.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Transition in helium bubble strengthening of copper from quasi-static to dynamic deformation

Damage from low-temperature irradiation and the subsequent degradation of materials performance pose significant challenges for the storage of radioactive materials and for peripheral components in some nuclear reactor designs. Fully understanding the mechanical behavior of such materials requires test data for strain rates in both the quasi-static (< 10/s) and dynamic (>> 10/s) regimes. While dynamic testing has generally been avoided in the past for neutron irradiated (contamination concerns) and ion irradiated (insufficient volume) materials, surface-sensitive Richtmyer-Meshkov instability (RMI) tests were used in the present work to overcome these limitations. Here, nanopillar compression, nanoindentation, and RMI testing data from a helium implanted surface layer (~10 µm thick) were compiled to explore the effects of helium bubbles on the materials strength of high-purity copper at strain rates of 0.001/s – 10 8 /s. While nano-mechanical testing revealed increases in yield strength and hardness with increasing helium dose from 1000 to 4000 appm He, RMI indicated no significant changes in strength as compared to unimplanted copper. Here, this discrepancy in behavior was rationalized through a combination of recent literature and follow-on molecular dynamics (MD) simulations, leading to the conclusion that the nanoscale helium bubbles acting as dispersed barriers to dislocation motion at quasi-static strain rates collapse under shock loading and cease to be effective barriers at high strain rates.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Ultrafast radiographic imaging and tracking: An overview of instruments, methods, data, and applications

Ultrafast radiographic imaging and tracking (U-RadIT) use state-of-the-art ionizing particle and light sources to experimentally study sub-nanosecond transients or dynamic processes in physics, chemistry, biology, geology, materials science and other fields. These processes are fundamental to modern technologies and applications, such as nuclear fusion energy, advanced manufacturing, communication, and green transportation, which often involve one mole or more atoms and elementary particles, and thus are challenging to compute by using the first principles of quantum physics or other forward models. One of the central problems in U-RadIT is to optimize information yield through, e.g. high-luminosity X-ray and particle sources, efficient imaging and tracking detectors, novel methods to collect data, and large-bandwidth online and offline data processing, regulated by the underlying physics, statistics, and computing power. We review and highlight recent progress in: (a.) Detectors such as high-speed complementary metal-oxide semiconductor (CMOS) cameras, hybrid pixelated array detectors integrated with Timepix4 and other application-specific integrated circuits (ASICs), and digital photon detectors; (b.) U-RadIT modalities such as dynamic phase contrast imaging, dynamic diffractive imaging, and four-dimensional (4D) particle tracking; (c.) U-RadIT data and algorithms such as neural networks and machine learning, and (d.) Applications in ultrafast dynamic material science using XFELs, synchrotrons and laser-driven sources. Hardware-centric approaches to U-RadIT optimization are constrained by detector material properties, low signal-to-noise ratio, high cost and long development cycles of critical hardware components such as ASICs. Interpretation of experimental data, including comparisons with forward models, is frequently hindered by sparse measurements, model and measurement uncertainties, and noise. Alternatively, U-RadIT make increasing use of data science and machine learning algorithms, including experimental implementations of compressed sensing. Machine learning and artificial intelligence approaches, refined by physics and materials information, may also contribute significantly to data interpretation, uncertainty quantification and U-RadIT optimization.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2020

Development of an MEMS ultrasonic microphone array system and its application to compressed wavefield imaging of concrete

Abstract Although contactless ultrasonic wavefield imaging shows potential for effective nondestructive inspection of various engineering materials, it has been rarely applied to concrete materials owing to technical challenges including low signal-to-noise ratio (SNR) caused by inherent heterogeneity of concrete. This paper presents development of a multi-channel MEMS ultrasonic microphone array system and its application to compressed wavefield imaging of concrete materials. The developed multi-channel MEMS ultrasonic microphone array system contains eight MEMS ultrasonic microphone elements and a signal conditioning circuit that enables measurements of ultrasonic signals with high SNR. A compressed sensing approach, based on the multiple measurement vector (MMV) concept, is applied to reconstruct a full dense ultrasonic wavefield data from sparsely sampled ultrasonic wavefield data. Experiments are carried out on a laboratory concrete sample to verify the performance of the developed MEMS microphone array system and proposed compressed sensing approach and then large-scale concrete samples to demonstrate practical application. The experimental results demonstrate that the developed MEMS microphone array system provides high-quality (SNR > 20 dB) ultrasonic data collected from concrete elements; furthermore, the proposed compressed sensing approach provides accurate reconstruction of dense wavefield data, as determined by peak signal-to-noise ratio (PSNR), from sparsely measured wavefield data with compression ratios up to 85% and PSNR above 25 dB in data collected form realistic large-scale concrete samples. By combining the MEMS array system and compressed sensing approach, the total ultrasonic data acquisition time needed to produce dense wavefield data can be significantly reduced.

Instruments & Instrumentation↗

DOE OSTI2025

NLR HPC Facility Power Usage Effectiveness (PUE) Data

Timeseries of Energy Systems Integration Facility (ESIF) Data Center Power Usage Effectiveness (PUE) Data provided in Parquet and compressed CSV formats Power Metrics Timeseries Fields: ts: Timestamp cooling_kw: Cooling (kilowatts) - Captures the power used by fans and pipe trace heaters associated with outdoor cooling equipment. The dedicated tower filter pump power is also captured as cooling load. energy_reuse: Energy Reuse Effectiveness hvac_kw: Heating, ventilation, and air conditioning (kilowatts) - Captures fan walls, fan coils that support the data center electrical rooms, and the make-up air unit. it_power_kw: IT equipment (kilowatts) - Captures power used by the IT equipment on the data center floor. plug_and_light_kw: Lights and utility plugs (kilowatts) - Captures power associated with the data center and dedicated mechanical room. The crank-case heater for the emergency standby generator is also captured as light and plug load. pue: Power Usage Effectiveness pump_kw: Pumps (kilowatts) - Captures power from pumps that move water in the data center Energy Recover Water loop and the Tower Water loops, and also captures power used by the boost pumps that circulate water through the fan walls. Note: The tower filter pump runs constantly to filter water from the data center cooling tower system, so 2.67 kilowatts are attributed to this pump and that is not reflected in this data field. day: Day of month Outside Weather Station Timeseries Fields: ts: Timestamp outside_air_humidity: Outside air humidity - Relative humidity percent outside_air_temp: Outside air temperature - Degrees Fahrenheit day: Day of month More detail: High-Performance Computing Data Center Power Usage Effectiveness

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

SPRUCE High-Resolution Minirhizotrons in an Experimentally-Warmed Peatland Provide an Unprecedented Glimpse at Fine Roots and their Fungal Partners: Supporting Data

Images were collected using first of their kind, non-destructive, high-resolution automated minirhizotrons (RhizoSystems, LLC) to assess the response of plant fine-root and fungal mycelium dynamics to elevated temperatures after 4-6 years of whole-ecosystem warming and exposure to elevated carbon dioxide concentrations (e[CO2]) in a peat bog where the SPRUCE (Spruce and Peatland Responses Under Changing Environments) experiment is located. We focused on two SPRUCE experimental plots: Plot 10 has elevated temperature (+9°C) and plot 19 is a control (+0°C). Both have elevated carbon dioxide (e[CO2]). Changes in root and fungal abundance with warming were estimated from a timeseries of landscape-level mosaiced images for each plot by measuring the proportional abundance of five belowground classes: fine roots of vascular plants, ectomycorrhizas, fungal hyphae, fungal rhizomorphs, and fungal sporocarps. To examine root and fungal phenology responses to warming, the length per individual root or fungal structure (except fungal hyphae that did not grow linearly but rather increased in areal coverage) were measured per image area of a set of timeseries patch-level mosaiced images for each plot. The experimental work was conducted in a Picea mariana [black spruce] – Sphagnum spp. bog forest in northern Minnesota, 40 km north of Grand Rapids, in the USDA Forest Service Marcell Experimental Forest (MEF). This ecosystem, which is located at the southern margin of the boreal forest, is considered especially vulnerable to climate change and anticipated to be near its tipping point. These data were used in analyses published in Defrenne et al (2021). This dataset contains 5 data files in comma-separate values (*.csv) format and a compressed folder (*.zip) containing 383 JPEG (*.jpg) images. Data files contain landscape-level assessment of belowground class abundance, patch-level growth phenology, and environmental variables (originally published in Hanson et al., 2016 and Hanson et al 2020). Images were collected with automated minirhizotrons and analyzed for phenology. Additional metadata are provided: 5 data dictionaries and a file-level metadata file in comma-separate values (.csv) format and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

LA-R43S6-L1 Postshot Report [Slides]

The Ranchero LA-R43S6-L1 test (formerly referred to as LA-43S-L1. The R specifically designates it is a Ranchero device and the 6 indicates a 6” high explosive charge diameter in anticipation of using larger diameters in the future.) was conducted on 3/8/17 with good success. The experiment was the first test of a “Swooped” Ranchero flux compression generator (FCG), and the load for the test was an aluminum imploding liner. In addition to the swoop, the stator was anodized to provide an insulating layer instead of one or more layers of polyethylene as had been the case for all earlier Ranchero tests. Using the Firing point TA-39-88 capacitor bank, 3.5 MA was delivered to the FCG for the initial magnetic field, and 36.4 MA were delivered to the load having an initial inductance of 2.5 nH. Implosion speeds over 1.1 cm/us were recorded, which exceeds previous LANL solid liner experimental results. The test was diagnosed with 18 PDV channels, 12 of which recorded liner implosion data, and the other 6 of which tracked the FCG armature during flux compression. These armature expansion data recorded during flux compression are the first of their kind, and it was previously unknown, due to unknown effects of the SF 6 in the flux compression volume, whether or not the expansion could be recorded using the PDV technique. Post shot 2D MHD calculations employed a complete external circuit model, and an improved flux diffusion model not available prior to the test. Results from these simulations show very good agreement with the experimental result. Four PDV channels recorded the liner implosion viewed radially outward from the center of the liner. All four of these probes recorded implosion velocities greater that 1 cm/µs, with the cylindrical center displaced by ~2 mm from actual center. Four PDV channels looked at +10° angles from the CMU wall, and four looked at -10° angles. A glide plane interaction is shown moving toward the center of the liner in MHD calculations, and PDV probes provide confirmation. The high explosive (HE) in the LA-R43S6-L1 test was PBX 9501 which had to be glued together in many pieces, and the test was preceded by a camera test to verify that the PBX 9501 could be assembled with acceptable tolerance in glue joints to prevent severing the armature during expansion. The camera test verified an acceptable armature performance, and results are given in complete detail in a post shot report LA-UR-19-20124, and summarized here. This report provides complete detail of the considerable body of data obtained on the test and in the post shot calculations. It is prepared in Power Point for ease of preparation and future review. Shot documentation available in the LANL on-line library are included as references, and non-referenceable documents will be cited and stored in an LA- R43S6-L1 post shot folder stored on an M-6 shared drive. Fabrication drawings are also maintained in an M-6 shared drive and paper files are available from M-6 personnel. This report will be maintained as a PowerPoint document on the shared drive, as well, since included movies will play and graphs from Excel files retain information in the PowerPoint versions. PDF versions are required for clearance and are not to large to send by e-mail.

42 ENGINEERING↗

DOE OSTI2021

Data from : "Warming promotes loss of subsoil carbon through accelerated degradation of plant-derived organic matter". Blodgett warming experiment

This dataset contains data used for the paper: Warming promotes loss of subsoil carbon through accelerated degradation of plant-derived organic matter. Soil Biology and Biochemistry 156, 108185. doi:10.1016/j.soilbio.2021.108185On April 2018 (after 4.5 years of warming), we collected O-horizon (organic horizon) material and soil core down to 90 cm depth from a whole-soil warming experiment in a mixed-coniferous temperate forest, located at the University of California Blodgett experimental forest in the foothills of the Sierra Nevada, CA USA. The goal was to assess how 4.5 years of +4 °C whole-soil warming affected the quantity and quality of soil organic matter. Cores were collected from 6 experimental plots (three replicated blocks); samples were collected in 10 cm increments from 0 to 90 cm depth.This dataset contains a compressed (.zip) archive of the data used for this manuscript. The dataset includes files in .xlsx format, which can be accessed and processed using MS Excel or R. Carbon and nitrogen concentrations, as well as stable carbon isotope composition ((δ13C) and solvent extractable lipid biomarker (alkanoic acids and alkanes) data are provided as processed data files. Diffuse reflectance infrared Fourier transform (DRIFT) spectroscopy data are provided as raw output and processed data files.The dataset files "Blodgett_warming_Data" and "Blodgett_warming_raw_data.xlsx" were updated on July 7, 2021. The following updates were made: (1) specification of the units of measurements in the dataset (the unit of measurement was missing in some parameters) and (2) the column name "pulled depth" was changed to "pooled depth" in the updated data files.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

The impact of freeze-thaw history on soil carbon response to experimental freeze-thaw cycles

This dataset contains data used for the paper "The impact of freeze-thaw history on soil carbon response to experimental freeze-thaw cycles". The Related References field will be updated with a full citation when available.Freeze-thaw is a disturbance process in cold regions where permafrost soils are becoming vulnerable to temperature fluctuations above 0˚C. Freeze-thaw alters soil physical and biogeochemical properties with implications for carbon persistence and emissions in Arctic landscapes. We examined whether different freeze-thaw histories in two soil systems led to contrasting biogeochemical responses under a laboratory-controlled freeze-thaw incubation. We investigated controls on soil organic matter (SOM) composition through Fourier-transform ion cyclotron resonance mass spectroscopy (FT-ICR-MS) to identify nominal carbon oxidation states and relative abundances of aliphatic-type carbon molecules in both surface and subsurface soils. Soil cores (~ 60 cm-depth) were sampled from two sites in Alaskan permafrost landscapes with different in situ freeze-thaw characteristics: Healy (>40 freeze-thaw cycles annually) and Toolik (<150 freeze-thaw cycles annually). FT-ICR-MS was coupled with in situ temperature data and soil properties (i.e., soil texture, mineralogy) to assess (1) differences in SOM composition associated with previous freeze-thaw history and (2) sensitivity to experimental freeze-thaw in the extracted cores. Control (freeze-only) samples showed greater carbon oxidation in Healy soils compared with Toolik, even in lower mineral horizons where freeze-thaw history was comparable across both sites. Healy showed the most loss of carbon compounds following experimental freeze-thaw in the lower mineral depths, including a decrease in aliphatics. Toolik soils responded more slowly to freeze-thaw as shown by intermediary carbon oxidation distributed across multiple carbon compound classes. Variations in the response of permafrost carbon chemistry to freeze-thaw is an important factor for predicting changes in soil function as permafrost thaws in high northern latitudes.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/Erin-Rooney/FTC-FTICR (DOI 10.5281/zenodo.6533064).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Recursive Dynamic Compressive Sensing in Smart Distribution Systems

With a transition to a smarter grid, we are witnessing a significant growth in smart metering infrastructure and sensor deployment in the distribution system. The underlying communication infrastructure is stressed due to the large volume of data that is generated by the smart meters/sensors. Furthermore, real time operations such as state estimation and control are impaired due to the lack of reliable aggregation of the data. In this paper, we exploit the underlying sparsity in grid data to implement two recursive dynamic compressive sensing (CS) approaches-streaming modified weighted-`1 CS and Kalman filtered CS. These approaches aim to reconstruct the sparse signal using the current underdetermined measurements and the prior information about the sparse signal and its support set. Slow signal and support change is in distribution grid data is validated using Pecan Street data. Both the IEEE 34 node test feeder system and PecanStreet data are considered as two examples to validate the superior performance of the two recursive CS techniques relative to classic CS.

Karimi, Hazhar Sufi↗

DOE OSTI2020

A Hybrid Framework Combining Model-Based and Data-Driven Methods for Hierarchical Decentralized Robust Dynamic State Estimation

This paper combines model-based and data-driven methods to develop a hierarchical, decentralized, robust dynamic state estimator (DSE). A two-level hierarchy is proposed, where the lower level consists of robust, model-based, decentralized DSEs. The state estimates sent from the lower level are received at the upper level, where they are filtered by a robust data-driven DSE after a principled sparse selection. This selection allows us to shrink the dimension of the problem at the upper level and hence significantly speed up the computational time. The proposed hybrid framework does not depend on the centralized infrastructure of the control centers; thus it can be completely embedded into the wide-area measurement systems. This feature will ultimately facilitate the placement of hierarchical decentralized control schemes at the phasor data concentrator locations. Also, the network model is not necessary; thus, a topology processor is not required. Finally, there is no assumption on the dynamics of the electric loads. The proposed framework is tested on the 2,000-bus synthetic Texas system, and shown to be capable of reconstructing the dynamic states of the generators with high accuracy, and of forecasting in the advent of missing data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Towards Feature-Preserving 2D and 3D Vector Field Compression

The objective of this work is to develop error-bounded lossy compression methods to preserve topological features in 2D and 3D vector fields. Specifically, we explore the preservation of critical points in piecewise linear vector fields. We define the preservation of critical points as, without any false positive, false negative, or false type change in the decompressed data, (1) keeping each critical point in its original cell and (2) retaining the type of each critical point (e.g., saddle and attracting node). The key to our method is to adapt a vertex-wise error bound for each grid point and to compress input data together with the error bound field using a modified lossy compressor. Our compression algorithm can be also embarrassingly parallelized for large data handling and in situ processing. We benchmark our method by comparing it with existing lossy compressors in terms of false positive/negative/type rates, compression ratio, and various vector field visualizations with several scientific applications.

critical points↗

DOE OSTI2021

Data for "Soil texture and environmental conditions influence the biogeochemical responses of soils to drought and flooding"

This dataset contains data used for the paper "Soil texture and environmental conditions influence the biogeochemical responses of soils to drought and flooding". The Related References field will be updated with a full citation when available.Climate change is intensifying the global water cycle, with increased frequency of drought and flood. Water is an important driver of soil carbon dynamics, and it is crucial to understand how moisture disturbances will affect carbon availability and fluxes in soils. Here we investigate the role of water in substrate-microbe connectivity and soil carbon cycling under extreme moisture conditions. We collected soils from Alaska, Florida, and Washington USA, and incubated them under Drought and Flood conditions. Drought had a stronger effect on soil respiration, pore-water carbon, and microbial community composition than flooding. Soil response was not consistent across sites, and was influenced by site-level pedological and environmental factors. Soil texture and porosity can influence microbial access to substrates through the pore network, driving the chemical response. Further, the microbial communities are adapted to the historic stress conditions at their sites and therefore show site-specific responses to drought and flood.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv and .txt format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/TES_3Soils_2021 (DOI: 10.5281/zenodo.4792655).

54 ENVIRONMENTAL SCIENCES↗