Search NASA⌕ Search

SEARCH · Search NASA

Results for “data aggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

MAPSTER: Automated Geospatial Data Sharing – Version 1.4.0

The US Department of Energy’s (DOE) Oak Ridge National Laboratory (ORNL) developed MAPSTER which is a geospatial data management tool that aggregates, organizes, and shares data from dispersed sources such as unmanned aerial systems (UAS). Built specifically for use in environments where communications may be limited, MAPSTER utilizes two key technologies to effectively manage data in the field and enable easy data sharing with authorized partners: Observer and Checkpoint. Observer is a lightweight software package on an edge device, such as a laptop, that automatically detects newly processed UAS data and sends to a central server called Checkpoint. Checkpoint is a centralized server at ORNL that receives and manages data from all Observer instances. Even in a very low bandwidth environment, Observer can still send information about the UAS data product almost instantly as it generates its own metadata package on the size of KB (kilobytes). MAPSTER is not only for UAS data but for any geospatial data collected at the austere edge and dispersed sources.

97 MATHEMATICS AND COMPUTING↗

NREL Price Series Developed for the ARPA-E FLECCS Program

The price data for four regions (CAISO, ERCOT, MISO-W, and PJM-W) are developed using the ReEDS to PLEXOS conversion as described in (Gagnon et al. 2020). The reference ReEDS case chosen is based on the 2020 Standard Scenario Mid-case, which uses the 2020 ReEDS model version (Cole et al. 2020; Ho et al. 2021). All ReEDS model inputs use 2020 Standard Scenarios Mid-case assumptions except for CO2 prices, which are implemented as linearly increasing CO2 price trajectories beginning at $0/tCO2 in 2020 and ending at either $100/tCO2 or $150/tCO2 in 2035 to dive capacity expansion towards a low-carbon system that could support CCS deployment. However, these scenarios also prohibit CCS deployment in this time frame so that resulting price data are not influenced by the deployment and operation of CCS itself. Implementing the ReEDS to PLEXOS conversion tool, PLEXOS is then simulated using the 2035 ReEDS infrastructure for both CO2 price scenarios, with the following model version and setup: PLEXOS Version: 8.2 Solver: Xpress-MP 35.01.01 Mixed integer optimization relative gap 1% System configuration: • Total number of nodes: 134 (consistent with ReEDS balancing areas) • Line losses enforced using piecewise linear approximation • Energy dump was enabled Price data is aggregated to the ISO/RTO level using load-weighted averages. References: Cole, Wesley, Sean Corcoran, Nathaniel Gates, Daniel Mai, Trieu, and Paritosh Das. 2020. “2020 Standard Scenarios Report: A U.S. Electricity Sector Outlook.” NREL/TP-6A20-77442. Golden, CO: National Renewable Energy Laboratory. https://www.nrel.gov/docs/fy21osti/77442.pdf. Gagnon, Pieter, Will Frazier, Elaine Hale, and Wesley Cole. 2020. “Cambium Documentation: Version 2020.” NREL/TP-6A20-78239. National Renewable Energy Lab. (NREL), Golden, CO (United States). https://doi.org/10.2172/1734551. Ho, Jonathan, Jonathon Becker, Maxwell Brown, Patrick Brown, Ilya (ORCID:0000000284917814) Chernyakhovskiy, Stuart Cohen, Wesley (ORCID:000000029194065X) Cole, et al. 2021. “Regional Energy Deployment System (ReEDS) Model Documentation: Version 2020.” NREL/TP-6A20-78195. Golden, CO: National Renewable Energy Laboratory. https://doi.org/10.2172/1788425.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Air Traffic Forecasting at the Port Authority of New York and New Jersey

Procedures for conducting air traffic forecasts with specific application to the Port Authority of New York and New Jersey are discussed. The procedure relates air travel growth to detailed socio-economic and demographic characteristics of the U.S. population rather than to aggregate economic data such as Gross National Product, personal income, and industrial production. Charts are presented to show the relationship between various selected characteristics and the use of air transportation facilities.

Augustine, J. G.↗

Methodology for the comparative assessment of the Satellite Power System (SPS) and alternative technologies

The energy systems concerned are the satellite power system, several coal technologies, geothermal energy, fission, fusion, terrestrial solar systems, and ocean thermal energy conversion. Guidelines are suggested for the characterization of these systems, side-by-side analysis, alternative futures analysis, and integration and aggregation of data. A description of the methods for assessing the technical, economic, environmental, societal, and institutional issues surrounding the development of the selected energy technologies is presented.

Wolsko, T.↗

Three ages of Venus

A central question for any planet is the age of its surface. Based on comparative planetological arguments, Venus should be as young and active as the Earth (Wood and Francis). The detection of probable impact craters in the Venera radar images provides a tool for estimating the age of the surface of Venus. Assuming somewhat different crater production rates, Bazilevskiy et al. derived an age of 1 + or - 0.5 billion years, and Schaber et al. and Wood and Francis estimated an age of 200 to 400 million years. The known impact craters are not randomly distributed, however, thus some area must be older and others younger than this average age. Ages were derived for major geologic units on Venus using the Soviet catalog of impact craters (Bazilevskiy et al.), and the most accessible geologic unit map (Bazilevskiy). The crater counts are presented for (diameters greater than 20 km), areas, and crater densities for the 7 terrain units and coronae. The procedure for examining the distribution of craters is superior to the purely statistical approaches of Bazilevskiy et al. and Plaut and Arvidson because the bins are larger (average size 16 x 10(6) sq km) and geologically significant. Crater densities define three distinct groups: relatively heavily cratered (Lakshmi, mountain belts), moderately cratered (smooth and rolling plains, ridge belts, and tesserae), and essentially uncratered (coronae and domed uplands). Following Schaber et al., Grieve's terrestrial cratering rate of 5.4 + or - 2.7 craters greater than 20 km/10(9) yrs/10(6) sq km was used to calculate ages for the geologic units on Venus. To improve statistics, the data was aggregated into the three crater density groups, deriving the ages. For convenience, the three similar age groups are given informal time stratigraphic unit names, from youngest to oldest: Ulfrunian, Sednaian, Lakshmian.

Wood, Charles A.↗

A TRMM-Calibrated Infrared Technique for Convective and Stratiform Rainfall: Analysis and Validation

A satellite infrared technique with passive microwave calibration has been developed for estimating convective and stratiform. rainfall. The Convective-Stratiform Technique, calibrated by coincident, physically retrieved rain rates from the TRMM Microwave Imager (TMI), has been applied to 30 min interval GOES infrared data and aggregated over seasonal and yearly periods over northern South America. The diurnal cycle of rainfall, as well as the division between convective and stratiform rainfall is presented. For the period Jan-April 1999, analysis revealed significant effects of local circulations (river breeze, land/sea breeze, mountain/valley) on both the total rainfall and it's diurnal cycle. Results compared well (a one-hour lag) with the diurnal cycle derived from TOGA radar-estimated rainfall in Rondonia. The satellite estimates revealed that the convective rain constituted 24% of the rain area while accounting for 67% of the rain volume. Estimates of the diurnal cycle (both total rainfall and convective/stratiform) for an area encompassing the Amazon Basin (3 x 10(exp 6) square km) were in phase with those from the TRMM Precipitation Radar, despite the latter's limited sampling. Results will be presented comparing the yearly (2000) diurnal cycle for large regions (including the Amazon Basin), and an intercomparison of January-March estimates for three years, 1999-2001. We hope to demonstrate the utility of using the TRMM PR observations as verification for infrared estimates of the diurnal cycle, and as verification of the apportionment of rainfall into convective and stratiform components.

Negri, Andrew↗

A TRMM-Calibrated Infrared Technique for Convective and Stratiform Rainfall: Analysis and Validation

A satellite infrared technique with passive microwave calibration has been developed for estimating convective and stratiform rainfall. The Convective-Stratiform Technique, calibrated by coincident, physically retrieved rain rates from the TRMM Microwave Imager (TMI), has been applied to 30 min interval GOES infrared data and aggregated over seasonal and yearly periods over northern South America. The diurnal cycle of rainfall, as well as the division between convective and stratiform rainfall is presented. For the period Jan-April 1999, analysis revealed significant effects of local circulations (river breeze, land/sea breeze, mountain/valley) on both the total rainfall and it's diurnal cycle. Results compared well (a one-hour lag) with the diurnal cycle derived from TOGA radar-estimated rainfall in Rondonia. The satellite estimates revealed that the convective rain constituted 24% of the rain area while accounting for 67% of the rain volume. Estimates of the diurnal cycle (both total rainfall and convective/stratiform) for an area encompassing the Amazon Basin (3 x 10(exp 6) sq km) were in phase with those from the TRMM Precipitation Radar, despite the latter's limited sampling. Results will be presented comparing the yearly (2000) diurnal cycle for large regions (including the Amazon Basin), and an intercomparison of January-March estimates for three years, (1999-2001). We hope to demonstrate the utility of using the TRMM PR observations as verification for infrared estimates of the diurnal cycle, and as verification of the apportionment of rainfall into convective and stratiform components.

Negri, Andrew↗

Fractal fluctuations in cardiac time series

Human heart rate, controlled by complex feedback mechanisms, is a vital index of systematic circulation. However, it has been shown that beat-to-beat values of heart rate fluctuate continually over a wide range of time scales. Herein we use the relative dispersion, the ratio of the standard deviation to the mean, to show, by systematically aggregating the data, that the correlation in the beat-to-beat cardiac time series is a modulated inverse power law. This scaling property indicates the existence of long-time memory in the underlying cardiac control process and supports the conclusion that heart rate variability is a temporal fractal. We argue that the cardiac control system has allometric properties that enable it to respond to a dynamical environment through scaling.

NASA Discipline Cardiopulmonary↗

Improving the Estimates of International Space Station (ISS) Induced K-Factor Failure Rates for On-Orbit Replacement Unit (ORU) Supportability Analyses

This is a case study on revised estimates of induced failure for International Space Station (ISS) on-orbit replacement units (ORUs). We devise a heuristic to leverage operational experience data by aggregating ORU, associated function (vehicle sub -system), and vehicle effective' k-factors using actual failure experience. With this input, we determine a significant failure threshold and minimize the difference between the actual and predicted failure rates. We conclude with a discussion on both qualitative and quantitative improvements the heuristic methods and potential benefits to ISS supportability engineering analysis.

Anderson, Leif F.↗

Igneous Graphite in Enstatite Chondrites

Igneous graphite. a rare constituent in terrestrial mafic and ultramafic rocks. occurs in three EH and one EL enstatite chondrite impact-melt breccias as 2-150 Ilm long euhedrallaths. some with pyramidal terminations. In contrast. graphite in most enstatite chondrites exsolved from metallic Fe-Ni as polygonal. rounded or irregular aggregates. Literature data for five EH chondrites on C combusting at high temperatures show that Abee contains the most homogeneous C isotopes (i.e. delta(sup 13)C = -8.1+/-2.1%); in addition. Abee's mean delta(sup l3)C value is the same as the average high-temperature C value for the set of five EH chondrites. This suggests that Abee scavenged C from a plurality of sources on its parent body and homogenized the C during a large-scale melting event. Whereas igneous graphite in terrestrial rocks typically forms at relatively high pressure and only moderately low oxygen fugacity (e.g., approx. 5 kbar. logfO2, approx. -10 at 1200 C ). igneous graphite in asteroidal meteorites formed at much lower pressures and oxygen fugacities.

Rubin, Alan E.↗

Integration of Earth Remote Sensing into the NOAA/NWS Damage Assessment Toolkit

Following the occurrence of severe weather, NOAA/NWS meteorologists are tasked with performing a storm damage survey to assess the type and severity of the weather event, primarily focused with the confirmation and assessment of tornadoes. This labor‐intensive process requires meteorologists to venture into the affected area, acquire damage indicators through photos, eyewitness accounts, and other documentation, then aggregation of data in order to make a final determination of the tornado path length, width, maximum intensity, and other characteristics. Earth remote sensing from operational, polar‐orbiting satellites can support the damage assessment process by helping to identify portions of damage tracks that are difficult to access due to road limitations or time constraints by applying change detection techniques. In addition, higher resolution commercial imagery can corroborate ground‐based surveys by examining higher‐resolution commercial imagery. As part of an ongoing collaboration, NASA and NOAA are working to integrate near real‐time Earth remote sensing observations into the NOAA/NWS Damage Assessment Toolkit, a handheld application used by meteorologists in the survey process. The team has recently developed a more streamlined approach for delivering data via a web mapping service and menu interface, allowing for caching of imagery before field deployment. Near real‐time products have been developed using MODIS and VIIRS imagery and change detection for preliminary track identification, along with conduits for higher‐resolution Landsat, ASTER, and commercial imagery as they become available. In addition to tornado damage assessments, the team is also investigating the use of near real‐time imagery for identifying hail damage to vegetation, which also results in large swaths of damage, particularly in the central United States during the peak growing season months of June, July, and August. This presentation will present an overview of recent activities, challenges and successes, best practices, and opportunities for future work and collaboration.

Molthan, Andrew↗

Leveraging the Cloud for Robust and Efficient Lunar Image Processing

The Lunar Mapping and Modeling Project (LMMP) is tasked to aggregate lunar data, from the Apollo era to the latest instruments on the LRO spacecraft, into a central repository accessible by scientists and the general public. A critical function of this task is to provide users with the best solution for browsing the vast amounts of imagery available. The image files LMMP manages range from a few gigabytes to hundreds of gigabytes in size with new data arriving every day. Despite this ever-increasing amount of data, LMMP must make the data readily available in a timely manner for users to view and analyze. This is accomplished by tiling large images into smaller images using Hadoop, a distributed computing software platform implementation of the MapReduce framework, running on a small cluster of machines locally. Additionally, the software is implemented to use Amazon's Elastic Compute Cloud (EC2) facility. We also developed a hybrid solution to serve images to users by leveraging cloud storage using Amazon's Simple Storage Service (S3) for public data while keeping private information on our own data servers. By using Cloud Computing, we improve upon our local solution by reducing the need to manage our own hardware and computing infrastructure, thereby reducing costs. Further, by using a hybrid of local and cloud storage, we are able to provide data to our users more efficiently and securely. 12 This paper examines the use of a distributed approach with Hadoop to tile images, an approach that provides significant improvements in image processing time, from hours to minutes. This paper describes the constraints imposed on the solution and the resulting techniques developed for the hybrid solution of a customized Hadoop infrastructure over local and cloud resources in managing this ever-growing data set. It examines the performance trade-offs of using the more plentiful resources of the cloud, such as those provided by S3, against the bandwidth limitations such use encounters with remote resources. As part of this discussion this paper will outline some of the technologies employed, the reasons for their selection, the resulting performance metrics and the direction the project is headed based upon the demonstrated capabilities thus far.

Cloud Computing↗

Visualizations to Aid Decision-Making in the ACCP Value Framework

The Aerosols, Clouds, Convection, and Precipitation Value Framework is used to introduce structure, transparency, and traceability into the decision-making process for a study formulating and assessing potential observing system concepts to respond to the 2017-2027 Decadal Survey for Earth Science and Applications. Within the Value Framework, visualizations play an important role in presenting information and structuring conversations around that information. This paper describes three guiding principles that were applied to the design of the visualizations of the Value Framework, presents examples of visualizations that serve at least one of several functions (structuring communication, facilitating elicitation and aggregation of data, and summarizing complex information), and identifies lessons learned from the development and implementation of those visualizations. The guiding principles and lessons learned have not only contributed to the success of the Value Framework and the ACCP study, but also can be applied in other decision-making activities.

Christopher A. Jones↗

Visualizations to Aid Decision-Making in the ACCP Value Framework

The Aerosols, Clouds, Convection, and Precipitation Value Framework is used to introduce structure, transparency, and traceability into the decision-making process for a study formulating and assessing potential observing system concepts to respond to the 2017-2027 Decadal Survey for Earth Science and Applications. Within the Value Framework, visualizations play an important role in presenting information and structuring conversations around that information. This paper describes three guiding principles that were applied to the design of the visualizations of the Value Framework, presents examples of visualizations that serve at least one of several functions (structuring communication, facilitating elicitation and aggregation of data, and summarizing complex information), and identifies lessons learned from the development and implementation of those visualizations. The guiding principles and lessons learned have not only contributed to the success of the Value Framework and the ACCP study, but also can be applied in other decision-making activities.

Christopher A Jones↗

Amazonia Disasters: Assessing Methods for Gold Mining-related Deforestation Detection in Amazonia Using NASA Earth Observations

Artisanal and small-scale gold mining (ASGM) is responsible for a large fraction of deforestation and disturbance in Amazonia. These activities cause severe impacts on the rainforest ecosystem and socioeconomic state of the region. NASA DEVELOP partnered with the Asociación para la Conservación de la Cuenca Amazónica (ACCA), NASA SERVIR Science Coordination Office, and the Spatial Informatics Group to enhance ASGM-related deforestation detection methods. ACCA currently uses the Omnibus Q-test Change Point Detection Algorithm to identify changes in Synthetic Aperture Radar (SAR) monthly-aggregated temporal data from the Sentinel-1 satellite. The team determined the algorithm's accuracy by comparing a stratified random sample of change points against data from January 2019 to June 2020 identified using PlanetScope and Landsat 8 Operational Land Imager (OLI) Earth observations through Collect Earth Online. Our results indicated a users' accuracy of 55% for temporal change detection and producer's and user's accuracies of 99% and 97%, respectively, for detecting when change did not occur. Of the labeled change points, only 19% were due to mining activity. This research can help our partners have a more accurate understanding of where illegal gold mining may be taking place and inform decisions to remediate this activity.

DEVELOP Project Summary↗

Amazonia Disasters: Assessing Methods for Gold Mining-Related Deforestation Detection in Amazonia Using NASA Earth Observations

Artisanal and small-scale gold mining (ASGM) is responsible for a large fraction of deforestation and disturbance in Amazonia. These activities cause severe impacts on the rainforest ecosystem and socioeconomic state of the region. NASA DEVELOP partnered with the Asociación para la Conservación de la Cuenca Amazónica (ACCA), NASA SERVIR Science Coordination Office, and the Spatial Informatics Group to enhance ASGM-related deforestation detection methods. ACCA currently uses the Omnibus Q-test Change Point Detection Algorithm to identify changes in Synthetic Aperture Radar (SAR) monthly-aggregated temporal data from the Sentinel-1 satellite. The team determined the algorithm's accuracy by comparing a stratified random sample of change points against data from January 2019 to June 2020 identified using PlanetScope and Landsat 8 Operational Land Imager (OLI) Earth observations through Collect Earth Online. Our results indicated a users' accuracy of 55% for temporal change detection and producer's and user's accuracies of 99% and 97%, respectively, for detecting when change did not occur. Of the labeled change points, only 19% were due to mining activity. This research can help our partners have a more accurate understanding of where illegal gold mining may be taking place and inform decisions to remediate this activity.

DEVELOP Tech Paper↗

Vertical structure of biomass burning aerosol transported over the southeast Atlantic Ocean

Biomass burning in southwestern Africa produces smoke plumes that are transported over the Atlantic Ocean and overlie vast regions of stratocumulus clouds. This aerosol layer contributes to direct and indirect radiative forcing of the atmosphere in this region particularly during the months of August, September, and October. There was a multi-year international campaign to study this aerosol and its interactions with clouds. Here, we report on the evolution of aerosol distributions and properties as measured by the airborne high spectral resolution lidar (HSRL-2) during the ORACLES (Observations of Aerosols above Clouds and their intEractionS) campaign in September 2016. The NASA Langley HSRL-2 instrument was flown on the NASA ER-2 aircraft for several days in September 2016. Data were aggregated at two pairs of 2° × 2° grid boxes to examine the evolution of the vertical profile of aerosol properties during transport over the ocean. Results showed that the structure of the profile of aerosol extinction and microphysical properties is maintained over a 1 to 2 d timescale. In the 3–5 km altitude range, 95 % of the aerosol extinction was contributed by particles in the 0.05–0.50 µm radius size range with the aerosol in this size range having an average effective radius of 0.16 µm. This indicates that there is essentially no scavenging or dry deposition at these altitudes. Moreover, there is very little day-to-day variation in these properties, such that time sampling as happens in such campaigns may be representative of longer periods such as monthly means. Below 3 km, there is considerable mixing with larger aerosol, most likely continental source near land. Furthermore, these measurements indicated that there was often a distinct gap between the bottom of the aerosol layer and cloud tops at the selected locations as evidenced by a layer of several hundred meters that contained relatively low aerosol extinction values above the clouds.

lidar↗