Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗

A Study on the Potential Applications of Satellite Data in Air Quality Monitoring and Forecasting

In this study we explore the potential applications of MODIS (Moderate Resolution Imaging Spectroradiometer) -like satellite sensors in air quality research for some Asian regions. The MODIS aerosol optical thickness (AOT), NCEP global reanalysis meteorological data, and daily surface PM(sub 10) concentrations over China and Thailand from 2001 to 2009 were analyzed using simple and multiple regression models. The AOT-PM(sub 10) correlation demonstrates substantial seasonal and regional difference, likely reflecting variations in aerosol composition and atmospheric conditions, Meteorological factors, particularly relative humidity, were found to influence the AOT-PM(sub 10) relationship. Their inclusion in regression models leads to more accurate assessment of PM(sub 10) from space borne observations. We further introduced a simple method for employing the satellite data to empirically forecast surface particulate pollution, In general, AOT from the previous day (day 0) is used as a predicator variable, along with the forecasted meteorology for the following day (day 1), to predict the PM(sub 10) level for day 1. The contribution of regional transport is represented by backward trajectories combined with AOT. This method was evaluated through PM(sub 10) hindcasts for 2008-2009, using ohservations from 2005 to 2007 as a training data set to obtain model coefficients. For five big Chinese cities, over 50% of the hindcasts have percentage error less than or equal to 30%. Similar performance was achieved for cities in northern Thailand. The MODIS AOT data are responsible for at least part of the demonstrated forecasting skill. This method can be easily adapted for other regions, but is probably most useful for those having sparse ground monitoring networks or no access to sophisticated deterministic models. We also highlight several existing issues, including some inherent to a regression-based approach as exemplified by a case study for Beijing, Further studies will be necessa1Y before satellite data can see more extensive applications in the operational air quality monitoring and forecasting.

Li, Can↗

Bioenergy Sustainability at the Regional Scale

To meet national goals for biofuels production, there are going to be large increases in acreage planted to dedicated biofuels crops. These acreages may be in perennial grasses, annual crops, short rotation woody crops, or other types of vegetation and may involve use of existing cropland, marginal lands, abandoned lands or conversion of forest land. The establishment of bioenergy crops will affect ecological processes and their interactions and thus have an influence on ecosystem services provided by the lands on which these crops are grown. The regional-scale effects of bioenergy choices on ecosystem services need special attention because they often have been neglected yet can affect the ecological, social and economic aspects of sustainability. A regional-scale perspective provides the opportunity to make more informed choices about crop selection and management, particularly with regard to water quality and quantity issues, and also about other aspects of ecological, social, and economic sustainability. We give special attention to cellulosic feedstocks because of the opportunities they provide. Adopting an adaptive management approach for biofuels feedstock production planning will be possible to a certain extent if there is adequate monitoring data on the effects of changes in land use. Effects on water resources are used as an example and existing understanding of water resource effects are analyzed in detail. Current results indicate that there may be water quality improvements coupled with some decreases in available water for downstream uses.

54 ENVIRONMENTAL SCIENCES↗

Developing time-resolved x-ray diffraction diagnostics at the National Ignition Facility (invited)

As part of a program to measure phase transition timescales in materials under dynamic compression, we have designed new x-ray imaging diagnostics to record multiple x-ray diffraction measurements during a single laser-driven experiment. Our design places several ns-gated hybrid CMOS (hCMOS) sensors within a few cm of a laser-driven target. The sensors must be protected from an extremely harsh environment, including debris, electromagnetic pulses, and unconverted laser light. Another key challenge is reducing the x-ray background relative to the faint diffraction signal. Building on the success of our predecessor (Target Diffraction In Situ), we implemented a staged approach to platform development. First, we built a demonstration diagnostic (Gated Diffraction Development Diagnostic) with two hCMOS sensors to confirm we could adequately protect them from the harsh environment and also acquire acceptable diffraction data. This allowed the team to quickly assess the risks and address the most significant challenges. Here, we also collected scientifically useful data during development. Leveraging what we learned, we recently developed a much more ambitious instrument (Flexible Imaging Diffraction Diagnostic for Laser Experiments) that can field up to eight hCMOS sensors in a flexible geometry and participate in back-to-back shots at the National Ignition Facility (NIF). The design also allows for future iterations, such as faster hCMOS sensors and an embedded x-ray streak camera. The enhanced capabilities of the new instrument required a much more complex design, and the unexpected issues encountered on the first few shots at NIF remind us that complexity has consequences. Our progress in addressing these challenges is described herein, as is our current focus on improving data quality by reducing x-ray background and quantifying the uncertainties of our diffraction measurements.

36 MATERIALS SCIENCE↗

Use of Transmission Electron Microscopy for Analysis of Aerosol Particles and Strategies for Imaging Fragile Particles

For over 25 years, transmission electron microscopy (TEM) has provided a method for the study of aerosol particles with sizes from below the optical diffraction limit to several microns, resolving the particles as well as smaller features. The wide use of this technique to study aerosol particles has contributed important insights about environmental aerosol particle samples and model atmospheric systems. TEM produces an image that is a 2D projection of aerosol particles that have been impacted onto grids and, through associated techniques and spectroscopies, can contribute additional information such as the determination of elemental composition, crystal structure, and 3D particle structures. Soot, mineral dust, and organic/inorganic particles have all been analyzed using TEM and spectroscopic techniques. TEM, however, has limitations that are important to understand when interpreting data including the ability of the electron beam to damage and thereby change the structure and shape of particles, especially in the case of particles composed of organic compounds and salts. In this paper, we concentrate on the breadth of studies that have used TEM as the primary analysis technique. Another focus is on common issues with TEM and cryogenic-TEM. Insights for new users on best practices for fragile particles, that is, particles that are easily susceptible to damage from the electron beam, with this technique are discussed. Tips for readers on interpreting and evaluating the quality and accuracy of TEM data in the literature are also provided and explained.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Here, error-bounded lossy compression has been considered one of the most effective solutions to the above problem. In practice, however, the best-fit compression method often needs to be customized or optimized in particular because of diverse characteristics in different datasets and various user requirements on the compression quality and performance. In this paper, we address this issue with a novel modular, composable compression framework named SZ3. Our contributions are four-folds. (1) We develop SZ3 which features an innovative modular abstraction for the prediction-based compression framework, such that compression modules can be plugged in easily to create new compressors based on characteristics of data and user requirements. (2) We create a new compression pipeline by SZ3 for GAMESS data, which significantly improves the compression ratios over state-of-the-art compressors. (3) We develop an adaptive compression pipeline by SZ3 for APS data with minimal efforts, which leads to the best rate-distortion among all existing error-bounded lossy compressors for any bit-rate. (4) We compare the sustainability of SZ3 with leading error-bounded prediction-based compressors, and then demonstrate the necessity of diverse pipelines by integrating and evaluating several compression pipelines on diverse scientific datasets from multiple disciplines. Experiments show that SZ3 incurs very limited overhead in compressor integration and our customized compression pipelines lead to up to 20% improvement in compression ratios under the same data distortion, when compared with the best existing approach.

97 MATHEMATICS AND COMPUTING↗

Environmental Report 2008

The purposes of the Lawrence Livermore National Laboratory Environmental Report 2008 are to record Lawrence Livermore National Laboratory's (LLNL's) compliance with environmental standards and requirements, describe LLNL's environmental protection and remediation programs, and present the results of environmental monitoring at the two LLNL sites - the Livermore site and Site 300. The report is prepared for the U.S. Department of Energy (DOE) by LLNL's Environmental Protection Department. Submittal of the report satisfies requirements under DOE Order 231.1A, Environmental Safety and Health Reporting, and DOE Order 5400.5, Radiation Protection of the Public and Environment. The report is distributed electronically and is available at https://saer.lln.gov/, the website for the LLNL annual environmental report. Previous LLNL annual environmental reports beginning in 1994 are also on the website. Some references in the electronic report text are underlined, which indicates that they are clickable links. Clicking on one of these links will open the related document, data workbook, or website that it refers to. The report begins with an executive summary, which provides the purpose of the report and an overview of LLNL's compliance and monitoring results. The first three chapters provide background information: Chapter 1 is an overview of the location, meteorology, and hydrogeology of the two LLNL sites; Chapter 2 is a summary of LLNL's compliance with environmental regulations; and Chapter 3 is a description of LLNL's environmental programs with an emphasis on the Environmental Management System including pollution prevention. The majority of the report covers LLNL's environmental monitoring programs and monitoring data for 2008: effluent and ambient air (Chapter 4); waters, including wastewater, storm water runoff, surface water, rain, and groundwater (Chapter 5); and terrestrial, including soil, sediment, vegetation, foodstuff, ambient radiation, and special status wildlife and plants (Chapter 6). Complete monitoring data, which are summarized in the body of the report, are provided in Appendix A. The remaining three chapters discuss the radiological impact on the public from LLNL operations (Chapter 7), LLNL's groundwater remediation program (Chapter 8), and quality assurance for the environmental monitoring programs (Chapter 9). The report uses Systeme International units, consistent with the federal Metric Conversion Act of 1975 and Executive Order 12770, Metric Usage in Federal Government Programs (1991). For ease of comparison to environmental reports issued prior to 1991, dose values and many radiological measurements are given in both metric and U.S. customary units. A conversion table is provided in the glossary. The report is the responsibility of LLNL's Environmental Protection Department. Monitoring data were obtained through the combined efforts of the Environmental Protection Department; Environmental Restoration Department; Physical and Life Sciences Environmental Monitoring Radiation Laboratory; and the Hazards Control Department.

54 ENVIRONMENTAL SCIENCES↗

NASA-Modified Precipitation Products to Improve EPA Nonpoint Source Water Quality Modeling for the Chesapeake Bay

The Environmental Protection Agency (EPA) has estimated that over 20,000 water bodies within the United States do not meet water quality standards. Ninety percent of the impairments are typically caused by nonpoint sources. One of the regulations in the Clean Water Act of 1972 requires States to monitor the Total Maximum Daily Load (TMDL), or the amount of pollution that can be carried by a water body before it is determined to be "polluted", for any watershed in the U.S.. In response to this mandate, the EPA developed Better Assessment Science Integrating Nonpoint Sources (BASINS) as a Decision Support Tool (DST) for assessing pollution and to guide the decision making process for improving water quality. One of the models in BASINS, the Hydrological Simulation Program -- Fortran (HSPF), computes daily stream flow rates and pollutant concentration at each basin outlet. By design, precipitation and other meteorological data from weather stations serve as standard model input. In practice, these stations may be unable to capture the spatial heterogeneity of precipitation events especially if they are few and far between. An attempt was made to resolve this issue by substituting station data with NASA modified/NOAA precipitation data. Using these data within HSPF, stream flow was calculated for seven watersheds in the Chesapeake Bay Basin during low flow periods, convective storm periods, and annual flows. In almost every case, the modeling performance of HSPF increased when using the NASA-modified precipitation data, resulting in better stream flow statistics and, ultimately, in improved water quality assessment.

Nigro, Joseph↗

CMS Experience with Adoption of the Community supported DD4hep Toolkit

DD4hep is an open-source software toolkit that provides comprehensive and complete generic detector descriptions for high energy physics (HEP) detectors. The Compact Muon Solenoid collaboration (CMS) has recently evaluated and adopted DD4hep to replace its custom detector description software. CMS has demanding software requirements as a very large, longrunning experiment that must support legacy geometries and study many possible upgraded detector designs of a constantly evolving detector that will be taking data for many years to come. CMS has chosen DD4hep since it is a high-quality, community-supported solution that will benefit from continuing modernization and maintenance. This presentation will discuss the issues of DD4hep adoption, the advantages and disadvantages of the various design choices, performance results, and the integration of the plugin systems from CMS and Gaudi, another open-source software framework. Recommendations about DD4hep based upon the CMS use cases will also be presented.

Vuosalo, Carl↗

MultispeQ Beta: a tool for large-scale plant phenotyping connected to the open PhotosynQ network

Large-scale high-throughput plant phenotyping (sometimes called phenomics) is becoming increasingly important in plant biology and agriculture and is essential to cutting-edge plant breeding and management approaches needed to meet the food and fuel needs for the next century. Currently, the application of these approaches is severely limited by the availability of appropriate instrumentation and by the ability to communicate experimental protocols, results and analyses. To address these issues, we have developed a low-cost, yet sophisticated open-source scientific instrument designed to enable communities of researchers, plant breeders, educators, farmers and citizen scientists to collect high-quality field data on a large scale. The MultispeQ provides measurements in the field or laboratory of both, environmental conditions (light intensity and quality, temperature, humidity, CO 2 levels, time and location) and useful plant phenotypes, including photosynthetic parameters—photosystem II quantum yield (Φ II ), non-photochemical exciton quenching (NPQ), photosystem II photoinhibition, light-driven proton translocation and thylakoid proton motive force, regulation of the chloroplast ATP synthase and potentially many others—and leaf chlorophyll and other pigments. Plant phenotype data are transmitted from the MultispeQ to mobile devices, laptops or desktop computers together with key metadata that gets saved to the PhotosynQ platform (https://photosynq.org) and provides a suite of web-based tools for sharing, visualization, filtering, dissemination and analyses. We present validation experiments, comparing MultispeQ results with established platforms, and show that it can be usefully deployed in both laboratory and field settings. We present evidence that MultispeQ can be used by communities of researchers to rapidly measure, store and analyse multiple environmental and plant properties, allowing for deeper understanding of the complex interactions between plants and their environment.

47 OTHER INSTRUMENTATION↗

Evaluation of Oak Ridge National Laboratory Health Physics Research Reactor Operation Data for Critical Benchmark Creation [Slides]

During the evaluation of Oak Ridge National Laboratory Health Physics Research Reactor operation data for critical benchmark creation, a detailed, functional SCALE model was built, and experimental data was evaluated for the creation of a critical benchmark. The estimated experimental uncertainty is about 3800 pcm, which is considered very high. The relative difference between expected and calculated keff values is about 1.5 %, also considered very high. It was concluded that a good quality critical benchmark worthy of the ICSBEP standards cannot be created from HPRR data in the present conditions. Locating the HPRR fuel to obtain an uncertainty on the density would aid in solving this issue.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Food Fortification Stability Study

NASA has established the goal of traveling beyond low-Earth orbit and extending manned exploration to Mars. The length of proposed Mars missions and the lack of resupply missions increases the importance of nutritional content in the food system, which will need a five year shelf life. The purpose of this research is to assess the stability of vitamin supplementation in traditionally processed spaceflight foods. It is expected that commercially available fortification nutrients will remain stable through a long duration exploration mission at sufficient levels if compatible formulation, processing, and storage temperatures are achieved. Five vitamins (vitamin E, vitamin K, pantothenic acid, folic acid, and thiamin) were blended into a vitamin premix (DSM, Freeport, TX) such that the vitamin concentration per serving equaled 25% of the recommended daily intake after two years of ambient storage. Four freeze-dried foods (Scrambled Eggs, Italian Vegetables, Potatoes Au Gratin, Noodles and Chicken) and four thermostabilized foods (Curry Sauce with Vegetables, Chicken Noodle Soup, Grilled Pork Chop, Rice with Butter) were produced, with and without the vitamin premix, to assess the impact of the added fortification on color and taste and to determine the stability of supplemental vitamins in spaceflight foods. The addition of fortification to spaceflight foods did not greatly alter the organoleptic properties of most products. In most cases, overall acceptability scores remained above 6.0 (minimum acceptable score) following six months and one year of low-temperature storage. Likewise, the color of fortified products appears to be preserved over one year of storage. The only exception was Grilled pork Chop and Chicken Noodle Soup whose individual components appear to degrade rapidly over one year of storage. Finally, most vitamins appear to be stable during long-term storage. The only exception was thiamin, which degraded rapidly during the first year of storage at 35˚C. It was previously believed that the imprecise method of fortification would prove problematic for nutrient quantification; however this was only an issue in stored samples of Grilled Pork Chop, Italian Vegetables and Curry Sauce with Vegetables. Year two data may further reveal the extent to which this is a problem, as well as identify overall quality changes over time.

Sirmons, T.↗

Food Fortification Stability Study

NASA has established the goal of traveling beyond low-Earth orbit and extending manned exploration to Mars. The length of proposed Mars missions and the lack of resupply missions increases the importance of nutritional content in the food system, which will need a five-year shelf life. The purpose of this research is to assess the stability of vitamin supplementation in traditionally processed spaceflight foods. It is expected that commercially available fortification nutrients will remain stable through a long duration exploration mission at sufficient levels if compatible formulation, processing, and storage temperatures are achieved. Five vitamins (vitamin E, vitamin K, pantothenic acid, folic acid, and thiamin) were blended into a vitamin premix (DSM, Freeport, TX) such that the vitamin concentration per serving equaled 25% of the recommended daily intake after two years of ambient storage. Four freeze-dried foods (Scrambled Eggs, Italian Vegetables, Potatoes Au Gratin, Noodles and Chicken) and four thermo-stabilized foods (Curry Sauce with Vegetables, Chicken Noodle Soup, Grilled Pork Chop, Rice with Butter) were produced, with and without the vitamin premix, to assess the impact of the added fortification on color and taste and to determine the stability of supplemental vitamins in spaceflight foods. The addition of fortification to spaceflight foods did not greatly alter the organoleptic properties of most products. In most cases, overall acceptability scores remained above 6.0 (minimum acceptable score) following six months and one year of low-temperature storage. Likewise, the color of fortified products appears to be preserved over one year of storage. The only exceptions were Grilled pork Chop and Chicken Noodle Soup whose individual components appeareddegrade rapidly over one year of storage. Finally, most vitamins appeared to be stable during long-term storage. The only exception was thiamin, which degraded rapidly during the first year of storage at 35˚C. It was previously believed that the imprecise method of fortification would prove problematic for nutrient quantification; however, this was only an issue in stored samples of Grilled Pork Chop, Italian Vegetables and Curry Sauce with Vegetables. Year two data may further reveal the extent to which this is a problem, as well as identify overall quality changes over time.

Sirmons, T.↗

Limbus Impact on Off-angle Iris Degradation

The accuracy of iris recognition depends on the quality of data capture and is negatively affected by several factors such as angle, occlusion, and dilation. Off-angle iris recognition is a new research focus in biometrics that tries to address several issues including corneal refraction, complex 3D iris texture, and blur. In this paper, we present an additional significant challenge that degrades the performance of the off-angle iris recognition systems, called the limbus effect . The limbus is the region at the border of the cornea where the cornea joins the sclera. The limbus is a semitransparent tissue that occludes a side portion of the iris plane. The amount of occluded iris texture on the side nearest the camera increases as the image acquisition angle increases. Without considering the role of the limbus effect, it is difficult to design an accurate off-angle iris recognition system. To the best of our knowledge, this is the first work that investigates the limbus effect in detail from a biometrics perspective. Based on results from real images and simulated experiments with real iris texture, the limbus effect increases the hamming distance score between frontal and off-angle iris images ranging from 0.05 to 0.2 depending upon the limbus height.

Karakaya, Mahmut↗

Predictive modeling of a subcritical pulverized-coal power plant for optimization: Parameter estimation, validation, and application

As renewable power generation deployment increases, fossil fuel plants are increasingly required to operate more flexibly. Many coal-fired power plants were originally designed to operate at base load and do not operate optimally at partial load. Predictive first-principles plant-wide models can be employed to identify opportunities for flexibility improvements and diagnose low-load operating issues. This paper describes the application of the Institute for the Design of Advanced Energy Systems Integrated Platform (IDAES) to model and optimize flexible power plant operations. The key benefits of using IDAES are that it provides an open-source, fully equation-oriented modeling framework for efficient modular model construction, reuse, and customization, together with a mathematical optimization framework leveraging powerful, state-of-the-art solvers. The process systems engineering workflow from predictive process simulation to parameter estimation, model validation, and plant optimization is applicable to a variety of existing and next-generation energy systems as well as other chemical and environmental processes. Here, to demonstrate this capability, a physics-based, steady-state model was developed to improve full- and part-load performance of the Escalante Generating Station, a 245 MWe (net) subcritical pulverized coal-fired power plant owned and operated by Tri-State Generation and Transmission Association. Specifically, sixty-nine model parameters were simultaneously estimated from several months of operating data enabling prediction of flow rates, temperatures, pressures, and steam quality throughout the plant. The validated model was leveraged by Escalante to reduce the minimum operating load from 90 MW to 50 MW by diagnosing a low-load water-hammer issue, enabling coal usage and emissions reductions during periods of low power demand. Additionally, opportunities for heat rate reduction (i.e., efficiency improvement) through a steeper sliding-pressure approach to load-following and optimization of other boiler operating variables were also identified and quantified. For example, a potential efficiency improvement of 0.7 percentage points was observed at half-load operation.

01 COAL, LIGNITE, AND PEAT↗

Hydropower Infrastructure – LAkes, Reservoirs, and RIvers (HILARRI)

HILARRI is a database of links between major datasets of operational hydropower dams and powerplants, and inland water bodies. These connections are critical for conducting large-scale analysis of hydropower infrastructure and their associated natural and engineered water systems. Features include: – Dams from the National Inventory of Dams (2024) and the Global Reservoir and Dam Database (GRanD v1.3) – Hydropower plants from the Existing Hydropower Assets dataset (EHA 2024) These hydropower infrastructure features are linked to several major datasets that provide hydrologic and hydraulic information relevant for analysis of hydropower systems that includes the integral water resources. That information comes from: – Products from the National Hydrography Dataset (NHD) – NHDPlusV2 Medium Resolution river network flowlines, – NHD waterbodies (limited to lakes and reservoirs), – NHD Watershed Boundary Dataset (HUC12-level for the Conterminous United States (CONUS)) – NHD High Resolution waterbodies – HydroLAKES water bodies (lakes and reservoirs) – LAGOS-US lakes and reservoirs – EPA National Lakes Assessment (2007, 2012, 2017, and 2022) – The Reservoir Sedimentation Database (RESSED) Unique identifiers are used to facilitate joining to the original full datasets. For example, characteristics of NHD flowlines such as estimated average flow rate can be joined from the NHDPlusV2 dataset to a dam or power plant listed in HILARRI based on the ID field, “COMID”, that is common to both datasets. HILARRI only includes basic information about identifiers, location, and data quality or usage notes. It does not contain the attributes or time series data associated with these sites. The HILARRI dataset incorporates information from several datasets to facilitate more effective and accurate analysis of hydropower infrastructure and their associated waterbodies. For example, dams were checked against the most recent American Rivers Dam Removal Database to identify and flag facilities that may no longer exist. Additionally, dams that are listed multiple times in the NID are identified and flagged to avoid double-counting when analyzing and summarizing information. Other quality flags include certainty of operational hydropower (i.e., if one or more datasets indicates hydropower at a particular location), whether an associated water body is accurate or composed of multiple polygons, or whether there is a known issue with reported characteristics in one of the underlying datasets. These additional data flags are designed to increase confidence in data usage for individual to large-scale analyses.

13 HYDRO ENERGY↗

Illustrating the Spatiotemporal Complexity of No2 Columns Using A Multi-Perspective Observing System: Moving Toward Geostationary Product Validation and Applications

As a precursor to secondary pollutants like ozone and PM2.5, nitrogen dioxide (NO2) is crucial to understand when addressing air quality issues. However, due to NO2’s short lifetime during the daytime and complexity of emission sources in urbanized regions, interpreting datasets from ground or satellite perspectives alone are challenged by variance in spatial and temporal resolutions. High resolution airborne mapping (< 1 km) of NO2 column densities across morning, midday, and afternoon add a unique perspective toward interpreting satellite data with respect to ground-measurements. This presentation focuses on the interpretation of spatiotemporal complexity of NO2 columns from the Synergistic TEMPO Air Quality Science Study (STAQS). The mission’s goal is to integrate geostationary observations from Tropospheric Emissions: Monitoring of Pollution (TEMPO) with traditional and enhanced air quality monitoring to improve the understanding of air quality science for increased societal benefit. We will demonstrate the interweaved perspective of NO2 columns from ground-based Pandora spectrometers and satellite-based observations (e.g., TROPOMI) as compared to high spatial resolution airborne observations from the GEOstationary Coastal and Air Pollution Events (GEO-CAPE) Airborne Simulator (GCAS). This includes the evaluation of each dataset through comparison to each other to identify potential biases in data products and the impact of heterogeneity on these comparisons. Airborne data will also be used as a proxy for geostationary observations with morning, midday, and afternoon raster maps collected over four cities (Los Angeles, Chicago, Toronto, and New York City). Finally, recent research outcomes will be presented to demonstrate how airborne and geostationary observations can be used to evaluate emission inventories and air quality models.

Laura Judd↗

Less is More: Bigger Data from Compressive Measurements

Compressive sensing approaches are beginning to take hold in (scanning) transmission electron microscopy (S/TEM) [1,2,3]. Compressive sensing is a mathematical theory about acquiring signals in a compressed form (measurements) and the probability of recovering the original signal by solving an inverse problem [4]. The inverse problem is underdetermined (more unknowns than measurements), so it is not obvious that recovery is possible. Compression is achieved by taking inner products of the signal with measurement weight vectors. Both Gaussian random weights and Bernoulli (0,1) random weights form a large class of measurement vectors for which recovery is possible. The measurements can also be designed through an optimization process. The key insight for electron microscopists is that compressive sensing can be used to increase acquisition speed and reduce dose. Building on work initially developed for optical cameras, this new paradigm will allow electron microscopists to solve more problems in the engineering and life sciences. We will be collecting orders of magnitude more data than previously possible. The reason that we will have more data is because we will have increased temporal/spatial/spectral sampling rates, and we will be able ability to interrogate larger classes of samples that were previously too beam sensitive to survive the experiment. For example consider an in-situ experiment that takes 1 minute. With traditional sensing, we might collect 5 images per second for a total of 300 images. With compressive sensing, each of those 300 images can be expanded into 10 more images, making the collection rate 50 images per second, and the decompressed data a total of 3000 images [3]. But, what are the implications, in terms of data, for this new methodology? Acquisition of compressed data will require downstream reconstruction to be useful. The reconstructed data will be much larger than traditional data, we will need space to store the reconstructions during analysis, and the computational demands for analysis will be higher. Moreover, there will be time costs associated with reconstruction. Deep learning [5] is an approach to address these problems. Deep learning is a hierarchical approach to find useful (for a particular task) representations of data. Each layer of the hierarchy is intended to represent higher levels of abstraction. For example, a deep model of faces might have sinusoids, edges and gradients in the first layer; eyes, noses, and mouths in the second layer, and faces in the third layer. There has been significant effort recently in deep learning algorithms for tasks beyond image classification such as compressive reconstruction [6] and image segmentation [7]. A drawback of deep learning, however, is that training the model requires large datasets and dedicated computational resources (to reduce training time to a few days). A second issue is that deep learning is not user-friendly and the meaning behind the results is usually not interpretable. We have shown it is possible to reduce the data set size while maintaining model quality [8] and developed interpretable models for image classification [9], but the demands are still significant. The key to addressing these problems is to NOT reconstruct the data. Instead, we should design computational sensors that give answers to specific problems. A simple version of this idea is compressive classification [10], where the goal is to classify signal type from a small number of compressed measurements. Classification is a much simpler problem than reconstruction, so 1) much fewer measurements will be necessary, and 2) these measurements will probably not be useful for reconstruction. Other simple examples of computational sensing include determining object volume or the number of objects present in the field of view [11].

Stevens, Andrew↗