Search NASA⌕ Search

SEARCH · Search NASA

Results for “Amazon”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

GC31G-1182: Opennex, a Private-Public Partnership in Support of the National Climate Assessment

The NASA Earth Exchange (NEX) is a collaborative computing platform that has been developed with the objective of bringing scientists together with the software tools, massive global datasets, and supercomputing resources necessary to accelerate research in Earth systems science and global change. NEX is funded as an enabling tool for sustaining the national climate assessment. Over the past five years, researchers have used the NEX platform and produced a number of data sets highly relevant to the National Climate Assessment. These include high-resolution climate projections using different downscaling techniques and trends in historical climate from satellite data. To enable a broader community in exploiting the above datasets, the NEX team partnered with public cloud providers to create the OpenNEX platform. OpenNEX provides ready access to NEX data holdings on a number of public cloud platforms along with pertinent analysis tools and workflows in the form of Machine Images and Docker Containers, lectures and tutorials by experts. We will showcase some of the applications of OpenNEX data and tools by the community on Amazon Web Services, Google Cloud and the NEX Sandbox.

datasets↗

Using Docker Containers to Extend Reproducibility Architecture for the NASA Earth Exchange (NEX)

NASA Earth Exchange (NEX) is a data, supercomputing and knowledge collaboratory that houses NASA satellite, climate and ancillary data where a focused community can come together to address large-scale challenges in Earth sciences. As NEX has been growing into a petabyte-size platform for analysis, experiments and data production, it has been increasingly important to enable users to easily retrace their steps, identify what datasets were produced by which process chains, and give them ability to readily reproduce their results. This can be a tedious and difficult task even for a small project, but is almost impossible on large processing pipelines. We have developed an initial reproducibility and knowledge capture solution for the NEX, however, if users want to move the code to another system, whether it is their home institution cluster, laptop or the cloud, they have to find, build and install all the required dependencies that would run their code. This can be a very tedious and tricky process and is a big impediment to moving code to data and reproducibility outside the original system. The NEX team has tried to assist users who wanted to move their code into OpenNEX on Amazon cloud by creating custom virtual machines with all the software and dependencies installed, but this, while solving some of the issues, creates a new bottleneck that requires the NEX team to be involved with any new request, updates to virtual machines and general maintenance support. In this presentation, we will describe a solution that integrates NEX and Docker to bridge the gap in code-to-data migration. The core of the solution is saemi-automatic conversion of science codes, tools and services that are already tracked and described in the NEX provenance system, to Docker - an open-source Linux container software. Docker is available on most computer platforms, easy to install and capable of seamlessly creating and/or executing any application packaged in the appropriate format. We believe this is an important step towards seamless process deployment in heterogeneous environments that will enhance community access to NASA data and tools in a scalable way, promote software reuse, and improve reproducibility of scientific results.

earth exchange↗

Evaluation of the Sensitivity of the Amazonian Diurnal Cycle to Convective Intensity in Reanalyses

Model parameterizations of tropical deep convection are unable to reproduce the observed diurnal and spatial variability of convection in the Amazon, which contributes to climatological biases in the water cycle and energy budget. Convective intensity regimes are defined using percentiles of daily minimum 3-hourly averaged outgoing longwave radiation (OLR) from Clouds and the Earth's Radiant Energy System (CERES). This study compares the observed spatial variability of convective diurnal cycle statistics for each regime to MERRA-2 and ERA-Interim (ERA) reanalysis data sets. Composite diurnal cycle statistics are computed for daytime hours (06:00-21:00 local time) in the wet season (December-January-February). MERRA-2 matches observations more closely than ERA for domain averaged composite diurnal statistics-specifically precipitation. However, ERA reproduces mesoscale features of OLR and precipitation phase associated with topography and the propagation of the coastal squall line. Both reanalysis models are shown to underestimate extreme convection.

Itterly, Kyle F.↗

Scaling Estimates of Vegetation Structure in Amazonian Tropical Forests Using Multi-Angle MODIS Observations

Detailed knowledge of vegetation structure is required for accurate modelling of terrestrial ecosystems, but direct measurements of the three dimensional distribution of canopy elements, for instance from LiDAR, are not widely available. We investigate the potential for modelling vegetation roughness, a key parameter for climatological models, from directional scattering of visible and near-infrared (NIR) reflectance acquired from NASA's Moderate Resolution Imaging Spectroradiometer (MODIS). We compare our estimates across different tropical forest types to independent measures obtained from: (1) airborne laser scanning (ALS), (2) spaceborne Geoscience Laser Altimeter System (GLAS)/ICESat, and (3) the spaceborne SeaWinds/QSCAT. Our results showed linear correlation between MODIS-derived anisotropy to ALS-derived entropy (r(exp 2)= 0.54, RMSE= 0.11), even in high biomass regions. Significant relationships were also obtained between MODIS-derived anisotropy and GLAS-derived entropy(0.52 less than or equal to r(exp 2) less than or equal to 0.61; p less than 0.05), with similar slopes and offsets found throughout the season, and RMSE between 0.26 and 0.30 (units of entropy). The relationships between the MODIS-derived anisotropy and backscattering measurements (sigma(sup 0)) from SeaWinds/QuikSCAT presented an r(exp 2) of 0.59 and a RMSE of 0.11. We conclude that multi-angular MODIS observations are suitable to extrapolate measures of canopy entropy across different forest types, providing additional estimates of vegetation structure in the Amazon.

MODIS↗

Engineering a Live UHD Program from the International Space Station

The first-ever live downlink of Ultra-High Definition (UHD) video from the International Space Station (ISS) was the highlight of a “Super Session” at the National Association of Broadcasters (NAB) Show in April 2017. Ultra-High Definition is four times the resolution of “full HD” or “1080P” video. Also referred to as “4K”, the Ultra-High Definition video downlink from the ISS all the way to the Las Vegas Convention Center required considerable planning, pushed the limits of conventional video distribution from a space-craft, and was the first use of High Efficiency Video Coding (HEVC) from a space-craft. The live event at NAB will serve as a pathfinder for more routine downlinks of UHD as well as use of HEVC for conventional HD downlinks to save bandwidth. A similar demonstration was conducted in 2006 with the Discovery Channel to demonstrate the ability to stream HDTV from the ISS. This paper will describe the overall work flow and routing of the UHD video, how audio was synchronized even though the video and audio were received many seconds apart from each other, and how the demonstration paves the way for not only more efficient video distribution from the ISS, but also serves as a pathfinder for more complex video distribution from deep space. The paper will also describe how a “live” event was staged when the UHD video coming from the ISS had a latency of 10+ seconds. In addition, the paper will touch on the unique collaboration between the inherently governmental aspects of the ISS, commercial partners Amazon and Elemental, and the National Association of Broadcasters.

Grubbs, Rodney↗

Use of Schema on Read in Earth Science Data Archives

Traditionally, NASA Earth Science data archives have file-based storage using proprietary data file formats, such as HDF and HDF-EOS, which are optimized to support fast and efficient storage of spaceborne and model data as they are generated. The use of file-based storage essentially imposes an indexing strategy based on data dimensions. In most cases, NASA Earth Science data uses time as the primary index, leading to poor performance in accessing data in spatial dimensions. For example, producing a time series for a single spatial grid cell involves accessing a large number of data files. With exponential growth in data volume due to the ever-increasing spatial and temporal resolution of the data, using file-based archives poses significant performance and cost barriers to data discovery and access. Storing and disseminating data in proprietary data formats imposes an additional access barrier for users outside the mainstream research community. At the NASA Goddard Earth Sciences Data Information Services Center (GES DISC), we have evaluated applying the schema-on-read principle to data access and distribution. We used Apache Parquet to store geospatial data, and have exposed data through Amazon Web Services (AWS) Athena, AWS Simple Storage Service (S3), and Apache Spark. Using the schema-on-read approach allows customization of indexing spatially or temporally to suit the data access pattern. The storage of data in open formats such as Apache Parquet has widespread support in popular programming languages. A wide range of solutions for handling big data lowers the access barrier for all users. This presentation will discuss formats used for data storage, frameworks with This presentation will discuss formats used for data storage, frameworks with support for schema-on-read used for data access, and common use cases covering data usage patterns seen in a geospatial data archive.

cloud applications↗

AOD Distributions and Trends of Major Aerosol Species over a Selection of the World's Most Populated Cities Based on the 1st Version of NASA's MERRA Aerosol Reanalysis

NASA recently extended the Modern-Era Retrospective Analysis for Research and Application (MERRA) with an atmospheric aerosol reanalysis which includes five particulate species: sulfate, organic matter, black carbon, mineral dust and sea salt. The MERRA Aerosol Reanalysis (MERRAero) is an innovative tool to study air quality issues around the world for its global and constant coverage and its distinction of aerosol speciation expressed in the form of aerosol optical depth (AOD). The purpose of this manuscript is to apply MERRAero to the study of urban air pollution at the global scale by analyzing the AOD over a period of 13 years (2003-2015) and over a selection of 200 of the world's most populated cities in order to assess the impacts of urbanization, industrialization, air quality regulations and regional transport which affect urban aerosol load. Environmental regulations and the recent global economic recession have helped to decrease the AOD and sulfate aerosols in most cities in North America, Europe and Japan. Rapid industrialization in China over the last two decades resulted in Chinese cities having the highest AOD values in the world. China has nevertheless recently implemented emission control measures which are showing early signs of success in many cities of Southern China where AOD has decreased substantially over the last 13 years. The AOD over South American cities, which is dominated by carbonaceous aerosols, has also decreased over the last decade due to an increase in commodity prices which slowed deforestation activities in the Amazon rainforest. At the opposite, recent urbanization and industrialization in India and Bangladesh resulted in a strong increase of AOD, sulfate and carbonaceous aerosols in most cities of these two countries. The AOD over most cities in Northern Africa and Western Asia changed little over the last decade. Emissions of natural aerosols, which cities in these two regions tend to be mostly composed of, don't tend to fluctuate significantly on an annual basis.

Urban air pollution↗

A Pan-Tropical Cascade of Fire Driven by El Nino/Southern Oscillation

The El Nino/Southern Oscillation (ENSO) has a pronounced influence on year-to-year variations in climate. The response of fires to this forcing is complex and has not been evaluated systematically across different continents. Here we use satellite data to create a climatology of burned-area and fire emissions responses, drawing on six El Nino and six La Nina events during 1997-2016. On average, reductions in precipitation and terrestrial water storage increased fire emissions in pan-tropical forests by 133% during and following El Nino as compared with La Nina. Fires peaked in equatorial Asia early in the ENSO cycle when El Nino was strengthening (Aug-Oct), before moving to southeast Asia and northern South America (Jan-Apr), Central America (Mar-May) and the southern Amazon (Jul-Oct) during the following year. Large decreases in fire occurred across northern Australia during Sep-Oct of the second year from a reduced fuel availability. Satellite observations of aerosols and carbon monoxide provided independent confirmation of the spatiotemporal evolution of fire anomalies. The predictable cascade of fire across different tropical continents described here highlights an important time delay in the Earth system's response to precipitation redistribution. These observations help to explain why the growth rate of atmospheric CO2 increases during El Nino and may contribute to improved seasonal fire forecasts.

Chen, Yang↗

Geonex: A NASA-NOAA Collaboration for Producing Land Surface Products from Geostationary Sensors Using Cloud Computing

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement.Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. We estimate the cost of deploying GEONEX to be $400 - 750 a month for processing data (every 30 minutes) and producing products over the conterminous US. For products such as Fire, latency can be as little as 10 minutes from the time of data acquisition.

Geostationary↗

GEONEX: Webpage to Display NASA-NOAA Collaboration of Producing Land Surface Products from Geostationary Sensors

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement.In order to better introduce the GEONEX products to the science community, we set up a simple webpage (www.geonex.org) to describe the background and the motivation of the project, the algorithms used in deriving the products, and user manuals to the data files. We will also update the status of the data processing, in particular the near-real-time products, on the website and provide links (in text or json files) to the latest datasets.

geostationary↗

Portable, Low-Cost, Column Carbon Dioxide and Methane Measurements for Validating Satellite Observations in Remote Locations

We present a low-cost (~$10K per instrument), portable solution to ground-based validation of satellite observations for difficult to reach locations with precisions of 1 ppm XCO2 and 10 ppb XCH4 for hourly data products. While Total Carbon Column Observing Network (TCCON) is the gold-standard for ground validation, there are locations where a ground column validation data point would be useful but conditions are not conducive to a permanent station. Examples include wetlands, thawing permafrost, the tropics, the Amazon, sub-Saharan Africa, as well as locations without a power grid or with geopolitical conflict. In addition, the low-cost and portability mean a geographical region can be studied in depth with multiple instruments. This passive, sun-pointing instrument is a miniaturized, laser heterodyne radiometer (mini-LHR) that has been under development by our team since 2009. It can be operated either in tandem with AERONET (a global network of 500 instruments that measure aerosol optical depth), or as a stand-alone instrument with a low-cost (~$3K), light-weight sun tracker. One of the main benefits of the mini-LHR is that it can quickly reach remote locations and provide a validation measurement even if there is limited or no infrastructure at the site. The instrument weighs ~10 lbs, fits into a backpack, and is powered by two folding solar panels and a battery pack. In clear conditions, the instrument can be set-up in under an hour. Portability means that mini-LHRs can be easily moved for side-by-side comparisons with other mini-LHRs and with TCCON which simplifies assessing instrument bias as well as accuracy. Like TCCON, the mini-LHR points directly at the sun with a narrow field-of-view and is its insensitivity to cloud and aerosol scattering that is common to nadir-pointing passive satellite approaches. Here we present a collection of sample data sets to demonstrate performance from locations that vary in climate, altitude, solar zenith angle, hours of sun per day, etc., as well as data from side-by-side TCCON comparisons. Retrievals of CO2 and CH4 were completed using the NASA/Goddard's Planetary Spectrum Generator (PSG) that incorporates meteorological inputs from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) data set.

Wilson, Emily W.↗

Understanding Climate-Vegetation Interactions in Global Rainforests Through a GP-Tree Analysis

The tropical rainforests are the largest reserves of terrestrial carbon and, therefore, the future of these rainforests is a question that is of immense importance in the geoscience research community. With the recent severe Amazonian droughts in 2005 and 2010 and on-going drought in the Congo region for more than two decades, there is growing concern that these forests could succumb to precipitation reduction, causing extensive carbon release and feedback to the carbon cycle. However, there is no single ecosystem model that quantifies the relationship between vegetation health in these rainforests and climatic factors. Small scale studies have used statistical correlation measure and simple linear regression to model climate-vegetation interactions, but suffer from the lack of comprehensive data representation as well as simplistic assumptions about dependency of the target on the covariates. In this paper we use genetic programming (GP) based symbolic regression for discovering equations that govern the vegetation climate dynamics in the rainforests. Expecting micro-regions within the rainforests to have unique characteristics compared to the overall general characteristics, we use a modified regression-tree based hierarchical partitioning of the space to build individual models for each partition. The discovery of these equations reveal very interesting characteristics about the Amazon and the Congo rainforests. Our method GP-tree shows that the rainforests exhibit tremendous resiliency in the face of extreme climatic events by adapting to changing conditions.

genetic programming↗

Geonex: Land Surface Monitoring from a New Generation of Geostationary Sensors

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GEONEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GEONEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GEONEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Nemani, Ramakrishna R.↗

Evaluating the Suitability of Commercial Clouds for NASA's High Performance Computing Applications: A Trade Study

NASA’s High-End Computing Capability (HECC) Project is periodically asked if it could be more cost effective through the use of commercial cloud resources. To answer the question, HECC’s Application Performance and Productivity (APP) team undertook a performance and cost evaluation comparing three domains: two commercial cloud providers, Amazon and Penguin, and HECC’s in-house resources—the Pleiades and Electra systems. In the study, the APP team used a combination of the NAS Parallel Benchmarks (NPB) and six full applications from NASA’s workload on Pleiades and Electra to compare performance of nodes based on three different generations of Intel Xeon processors—Haswell, Broadwell, and Skylake. Because of export control limitations, the most heavily used applications on Pleiades and Electra could not be used in the cloud; therefore, only one of the applications, OpenFOAM, represents work from the Aeronautics Research Mission Directorate and the Human and Exploration Mission Directorate. The other five applications are from the Science Mission Directorate.

High Performance↗

Item Retrieval as Utility Estimation

Retrieval systems have greatly improved over the last half century, estimating relevance to a latent user need in a wide variety of areas. One area that has not enjoyed such advancements is searching for items by attribute values, a common activity in e-commerce and science, particularly given numeric values. Existing item retrieval systems assume the user has a firm grasp of their own desires and can formulate a good Boolean or SQL-style query to retrieve items, as one would do with a database. A contrasting approach would be to estimate how well items match the user?s latent desires and return items ranked by this estimation. Towards this end, we present a retrieval model inspired by multi-criteria decision making theory, concentrating on numeric attributes. We evaluate our novel approach, the de-facto standard of Boolean retrieval, and several models proposed in the literature, in two user studies using Amazon Mechanical Turk. We use a competitive game to motivate test subjects and compare methods based on the results of the subjects? initial query and their success in the game. In our experiments, our new method signi cantly outperformed the others, whereas the Boolean approaches had the worst performance.

operations research↗

Earth Observations from Geostationary Satellites

The latest generation of geostationary satellites carry sensors such as the Advanced Baseline Imager (GOES-16/17) and the Advanced Himawari Imager (Himawari-8/9) that closely mimic the spatial and spectral characteristics of MODIS and VIIRS, useful for monitoring land surface conditions. The NASA Earth Exchange (NEX) team at Ames Research Center has embarked on a collaborative effort among scientists from NASA and NOAA exploring the feasibility of producing operational land surface products similar to those from MODIS/VIIRS. The team built a processing pipeline called GeoNEX that is capable of converting raw geostationary data into routine products of Fires, surface reflectances, vegetation indices, LAI/FPAR, ET and GPP/NPP using algorithms adapted from both NASA/EOS and NOAA/GOES-R programs. The GeoNEX pipeline has been deployed on Amazon Web Services cloud platform and it currently leverages near-realtime geostationary data hosted in AWS public datasets under a NOAA-AWS agreement. Initial analyses of various products from ABI/AHI sensors suggest that they are comparable to those from MODIS in representing the spatio-temporal dynamics of land conditions. Cloud computing offers a variety of options for deploying the GeoNEX pipeline including choice CPUs, storage media, and automation. By making the GEONEX pipeline available on the cloud, we hope to engage a broad community of Earth scientists from around the world in utilizing this new source of data for Earth monitoring.

Earth↗

Widespread Increase of Boreal Summer Dry Season Length Over the Congo Rainforest

Dry season length strongly influences tropical rainforest vegetation and is largely determined by precipitation patterns. Over the Amazon, the dry season length has increased since 1979 and severe short-term droughts have occurred. However, similar changes have not been investigated for the world’s second largest rainforest, the Congo Basin, where long-term drying and large-scale declines in forest greenness and canopy water content were reported. Here we present observational evidence for widespread increases in the boreal summer (June–August) dry season length over the Congo Basin since the 1980s, from both hydrological and ecological perspectives. We analyzed both dry season onset and dry season end via multiple independent precipitation and satellite derived vegetation datasets for the period 1979–2015. The dry season length increased by 6.4–10.4 days per decade in the period 1988–2013, primarily attributed to an earlier dry season onset and a delayed dry season end. The earlier dry season onset was caused by long-term droughts due to decreased rainfall in the pre-dry season (April–June). The delayed dry season end resulted from insufficiently replenished soil moisture, which postpones the start of the next wet season and hinders vegetation regrowth. If such changes continue, the enhanced water stress in a warming climate may affect the carbon cycle and alter the composition and structure of evergreen rainforest.

Congo rainforest growing season NDVI SIF↗

Diverse Photosynthetic Capacity of Global Ecosystems Mapped by Satellite Chlorophyll Fluorescence Measurements

Photosynthetic capacity is often quantified by the Rubisco-limited photosynthetic capacity (i.e. maximum carboxylation rate, V(sub cmax)). It is a key plant functional trait that is widely used in Earth System Models for simulation of the global carbon and water cycles. Measuring V(sub cmax) is time-consuming and laborious; therefore, the spatiotemporal distribution of V(sub cmax) is still poorly understood due to limited measurements of V(sub cmax). In this study, we used a data assimilation approach to map the spatial variation of V(sub cmax) for global terrestrial ecosystems from a 11-year-long satellite-observed solar-induced chlorophyll fluorescence (SIF) record. In this SIF-derived V(sub cmax) map, the mean V(sub cmax) value for each plant function type (PFT) is found to be comparable to a widely used N-derived V(sub cmax) dataset by Kattge et al. (2009). The gradient of V(sub cmax) along PFTs is clearly revealed even without land cover information as an input. Large seasonal and spatial variations of V(sub cmax) are found within each PFT, especially for diverse crop rotation systems. The distribution of major crop belts, characterized with high V(sub cmax) values, is highlighted in this V(sub cmax) map. Legume plants are characterized with high V(sub cmax) values. This V(sub cmax) map also clearly illustrates the emerging soybean revolution in South America where V(sub cmax) is the highest among the world. The gradient of V(sub cmax) in Amazon is found to follow the transition of soil types with different soil N and P contents. This study suggests that satellite-observed SIF is powerful in deriving the important plant functional trait, i.e. V(sub cmax), for global climate change studies.

Liming He↗