Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud Service Providers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Developing a Cloud-Based ArcGIS Image Service for TROPOMI Level 2 Data: Preprocessing, Transformation, and Publication

TROPOMI, the Tropospheric Monitoring Instrument aboard the Sentinel-5 Precursor satellite, provides high spatiotemporal resolution atmospheric measurements. It is essential for monitoring air quality, greenhouse gases, and other trace gases. Integrating TROPOMI Level 2 data into an ArcGIS Image Service marks a significant advancement in the accessibility and utility of satellite-derived environmental information for GIS applications. This paper details the methodology for building an ArcGIS Image Service tailored to handle TROPOMI Level 2 data, with a focus on preprocessing, transformation, and cloud-based publication. The workflow utilizes Python and ArcPy for data reformatting, reprojection, and updating, ensuring efficient processing and cloud-based notifications. By establishing a robust pipeline, the ArcGIS Image Service provides real-time access to TROPOMI Level 2 data, enabling users to visualize, analyze, and interpret atmospheric phenomena effectively.

Level 2 Data, ArcGIS, Image Service, ArcPy, OGC↗

Channel Selection for the Advanced Baseline Imager (ABI)

The GOES-R (Geostationary Operational Environmental Satellite-R) Imager will be the fourth generation imaging radiometer flown in 40 years that observes the western hemisphere from geosynchronous orbit. The Imager is an international resource for information about unpredictable short-term mesoscale phenomena such as severe storms, precipitation, clouds and fog, fires and volcanoes. As such, it must provide: (1) continuity of service, (2) valuable new capabilities, and (3) synergy with the companion fleet of imaging radiometers. This combination of requirements lead to a suite of channels evolved from the generations of LEO (low Earth orbit) and GEO- (geosynchronous Earth orbit) and -sounders. To maximize the science and applications payoff from its unique viewpoint, the next generation GOES Imager should concentrate upon regional measurements of the chaotic atmospheric phenomena involving water and the diurnal cycle -- energy potential, moisture transport, phase changes, precipitation, and cloud climatology.

Chesters, Dennis↗

NASA POWER: Providing Present and Future Climate Services Based on NASA Data for the Energy, Agricultural, and Sustainable Buildings Communities

NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the renewable energy, agricultural, and building heating/cooling design industries. POWER packages solar and meteorological data at various temporal levels from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). Data users can access these data either through an intuitive data viewer, image services fully integrable with GIS analysis, connections in the cloud through an Amazon Web Services S3 Bucket, or fully customizable access through an API. Data provided by POWER has been successfully used by decision makers to support actions that address climate change. For example, POWER data has been used to remotely monitor solar array fields and integrated in a sizing tool for off-grid solar and storage systems. POWER data has also been coupled with key building decision tools to support design and retrofitting of building energy systems for energy efficiency and reduction of greenhouse gases. POWER is now developing climate services to provide time series of the projected future evolution of key quantities that interest our users, such as heating/cooling degree days, temperature, wind speed, and downwelling solar flux. We demonstrate the potential of the new climate services by presenting here a range of possible future changes in these quantities at different NASA centers across the continental United States. These data services are based on downscaled climate model data from the NASA Earth Exchange Global Daily Downscaled Projections (NEX-GDDP) data set. We highlight the important insights that new climate services can provide. Our climate services will help our user communities quantify the impacts of climate change to support their key decisions in planning for the future, both inside and outside the Federal Government, especially for decisions in renewable energy and in building heating and cooling.

Bradley Hegyi↗

Harmony: Bringing Data Together by Bringing Services Together

As Earth observation data volume, velocity, and variety continues to accelerate, so do the challenges of working with those data. The computation, storage, and network transfer requirements for multi-petabyte datasets demand solutions that allow users to process, store, and move fewer bytes while still finding the valuable insights they seek. Our cloud-based data transformation framework, Harmony, tackles these challenges by providing consistent, standards-based interface to multiple disparate backend processors collocated with NASA EOSDIS data. It allows data scientists to perform data processing and harmonization activities across many datasets through familiar tooling. Simultaneously, it provides a clear, consistent interface for data providers to expose new or customized backend services for their data. This talk will discuss Harmony, its architecture and interface, and the path forward for cloud-based NASA EOSDIS data harmonization services.

Quinn, Patrick↗

Proto-Examples of Data Access and Visualization Components of a Potential Cloud-Based GEOSS-AI System

Once a research or application problem has been identified, one logical next step is to search for available relevant data products. Thus, an early component of a potential GEOSS-AI system, in the continuum between observations and end point research, applications, and decision making, would be one that enables transparent data discovery and access by users. Such a component might be effected via the systems data agents. Presumably, some kind of data cataloging has already been implemented, e.g., in the GEOSS Common Infrastructure (GCI). Both the agents and cataloging could also leverage existing resources external to the system. The system would have some means to accept and integrate user-contributed agents. The need or desirability for some data format internal to the system should be evaluated. Another early component would be one that facilitates browsing visualization of the data, as well as some basic analyses.Three ongoing projects at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) provide possible proto-examples of potential data access and visualization components of a cloud-based GEOSS-AI system. 1. Reorganizing data archived as time-step arrays to point-time series (data rods), as well as leveraging the NASA Simple Subset Wizard (SSW), to significantly increase the number of data products available, at multiple NASA data centers, for production as on-the-fly (virtual) data rods. SSWs data discovery is based on OpenSearch. Both pre-generated and virtual data rods are accessible via Web services. 2. Developing Web Feature Services to publish the metadata, and expose the locations, of pre-generated and virtual data rods in the GEOSS Portal and enable direct access of the data via Web services. SSW is also leveraged to increase the availability of both NASA and non-NASA data.3.Federating NASA Giovanni (Geospatial Interactive Online Visualization and Analysis Interface), for multi-sensor data exploration, that would allow each cooperating data center, currently the NASA Distributed Active Archive Centers (DAACs), to configure its own Giovanni deployment, while also allowing all the deployments to incorporate each others data. A federated Giovanni comprises Giovanni Virtual Machines, which can be run on local servers or in the cloud.

access↗

An Assessment of and Access to NASA CERES Hourly Solar Irradiance Data Products Using POWER Web Services

The National Aeronautics and Space Administration’s (NASA) Clouds and Earth’s Radiant Energy System (CERES) Mission has been providing surface solar irradiance data products since March 2000. With an emphasis on global climate quality data products, CERES produces a suite of data parameters related to both the inputs and the observed and measured solar irradiance components at the top-of-atmosphere and at the surface. This paper discusses the global CERES SYN1Deg (Synoptic 1x1 degree resolution) solar irradiance data products, shows that the accuracy of the global horizontal irradiance (GHI) at the hourly time scale is <1% for bias and 24% RMS compared to the Baseline Surface Radiation Network (BSRN) measurements. This paper then shows the accuracy of the direct and diffuse components and a proposed “bias” correction based upon the solar zenith angle dependence that provides accuracy useful for solar applications on a global basis for all sunlit conditions. Lastly, a brief description of how to obtain these hourly solar irradiance products based upon SYN1Deg using the NASA’s Prediction of Worldwide Energy Resource (POWER) web services portal is given so users can utilize these estimates for testing and evaluation.

Surface solar irradiance↗

Delta 2 Explosion Plume Analysis Report

A Delta II rocket exploded seconds after liftoff from Cape Canaveral Air Force Station (CCAFS) on 17 January 1997. The cloud produced by the explosion provided an opportunity to evaluate the models which are used to track potentially toxic dispersing plumes and clouds at CCAFS. The primary goal of this project was to conduct a case study of the dispersing cloud and the models used to predict the dispersion resulting from the explosion. The case study was conducted by comparing mesoscale and dispersion model results with available meteorological and plume observations. This study was funded by KSC under Applied Meteorology Unit (AMU) option hours. The models used in the study are part of the Eastern Range Dispersion Assessment System (ERDAS) and include the Regional Atmospheric Modeling System (RAMS), HYbrid Particle And Concentration Transport (HYPACT), and Rocket Exhaust Effluent Dispersion Model (REEDM). The primary observations used for explosion cloud verification of the study were from the National Weather Service's Weather Surveillance Radar 1988-Doppler (WSR-88D). Radar reflectivity measurements of the resulting cloud provided good estimates of the location and dimensions of the cloud over a four-hour period after the explosion. The results indicated that RAMS and HYPACT models performed reasonably well. Future upgrades to ERDAS are recommended.

Evans, Randolph J.↗

Air Quality Satellite Monitoring by TROPOMI on Sentinel-5P

The recently launched Sentinel satellite mission, the Sentinel-5 Precursor (Sentinel-5P), is one of the European Space Agency's (ESA) new mission family – Sentinels. The sole payload on Sentinel-5P is the TROPOspheric Monitoring Instrument (TROPOMI), a nadir-viewing 108⁰ field-of-view push-broom grating hyperspectral spectrometer, covering the wavelengths of ultraviolet-visible (270 nm - 495 nm), near infrared (675 nm - 775 nm), and shortwave infrared (2305 nm - 2385 nm). Sentinel-5P is the first of the Atmospheric Composition Sentinels, and is providing measurements of atmospheric chemistry, aerosols, and clouds at high spatial, temporal, and spectral resolution. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) supports over a thousand data collections in the focus areas of Atmospheric Composition, Water & Energy Cycles, and Climate Variability. Sentinel-5P TROPOMI Level-1B (L1B) and Level-2 (L2) products are curated at the GES DISC. Sentinel-5P data are provided by the European Union and the European Space Agency (ESA) through an agreement between ESA and NASA. Through its convenient and enhanced tools/services, such as OPeNDAP and L2 Subsetting, GES DISC offers the air quality remote sensing user community facile solutions for using complex Earth science data and applications. This presentation will demonstrate up-to-date TROPOMI products including EarthView (EV) radiance, solar irradiance, Aerosol Index, Carbon Monoxide, Total column Ozone, Nitrogen Dioxide, and cloud, as well as easy ways to access, visualize and subset TROPOMI data.

TROPOMI↗

Atmospheric Infrared Sounder Version 7 Near-Real-Time Product and Imagery Released by NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been the home of data processing, archive, and distribution services for data from the Atmospheric Infrared Sounder (AIRS) mission since its launch in 2002. The GES DISC provides service to both AIRS routine and Near Real-Time (NRT) products. The AIRS NRT products are an important element in the Land, Atmosphere Near real-time Capability for EOS (LANCE). In collaboration with AIRS Project, the GES DISC has just released products from the Version 7 algorithm. The new version algorithm provides significant improvements over the previous version. The most substantial advances are: improved consistency between day and night water vapor; improved total column ozone and temperature; improved infrared-only (IR-only) retrievals, especially in high latitude regions; an improved Stochastic Cloud Clearing Neural Network used as a first guess at the initial value in the iterative retrieval process; and removal of ambiguity in surface classification in the IR-only retrieval algorithm. In addition, the GES DISC produces AIRS NRT imagery. The AIRS NRT imagery are generated by mosaicking and mapping the available AIRS 6-minute retrieval granules to a global projection. The images are constantly refreshed when new granules are produced. The AIRS NRT Viewer and LANCE Worldview provide visualization services to online users for AIRS NRT imagery. The data products used to generate this imagery include atmospheric temperature, humidity, precipitation, cloud, Dust Score, CO, and SO2. In this presentation, we will demonstrate visualization of the AIRS NRT imagery from the new Version 7, and demonstrate some improvements over the previous version. Progress on improving the AIRS NRT imagery, a collaboration project with the AIRS Applications Development Team at NASA Jet Propulsion Laboratory (JPL), will also be presented.

Feng Ding↗

Space-Borne Cloud-Native Satellite-Derived Bathymetry (SDB) Models Using ICESat-2 And Sentinel-2

Shallow nearshore coastal waters provide a wealth of societal, economic and ecosystem services, yet their topographic structure is poorly mapped due to a reliance upon expensive and time intensive methods. Space‐borne bathymetric mapping has helped address these issues, but has remained largely dependent upon in situ measurements. Here we fuse ICESat‐2 lidar data with Sentinel‐2 optical imagery, within the Google Earth Engine cloud platform, to create openly available spatially continuous high‐resolution bathymetric maps at regional‐to‐national scales in Florida, Crete and Bermuda. ICESat‐2 bathymetric classified photons are used to train three Satellite Derived Bathymetry (SDB) methods, including Lyzenga, Stumpf and Support Vector Regression algorithms. For each study site the Lyzenga algorithm yielded the lowest RMSE (approx. 10‐15%) when compared with validation data. We demonstrate a means of using ICESat‐2 for both model calibration and validation, thus cementing a pathway for fully space‐borne estimates of nearshore bathymetry in shallow, clear water environments.

N. Thomas↗

Changes in Characteristics of Future Climate Across the U.S.: Time Series Analysis of Climate Model Data by NASA POWER

NASA’s Prediction of Worldwide Energy Resource (POWER) project facilitates the use of NASA Earth Science data holdings within the energy, agricultural, and building heating/cooling design industries. POWER packages solar and meteorological data at various temporal levels from several NASA projects in a user friendly GIS-enabled web services system (https://power.larc.nasa.gov). Data users can access these data either through an intuitive data viewer, image services fully integrable with GIS analysis, connections in the cloud through an Amazon Web Services S3 Bucket, or fully customizable access through an API. Data provided by POWER has been used to remotely monitor solar array fields and integrated in a sizing tool for off-grid solar and storage systems. POWER data has also been coupled with key building decision tools to support design and retrofitting of building energy systems for energy efficiency and reduction of greenhouse gases. POWER is now developing capabilities to provide time series of the projected future evolution of surface quantities important to future energy production and use, such as heating/cooling degree days, temperature, wind speed, and downwelling solar flux. We present here a range of possible future changes in these quantities at locations throughout the continental United States. We show how both average and extreme values of the quantities will evolve from present-day to future climate conditions. We plan to provide these projections for users in the energy and sustainable energy communities.

Bradley M. Hegyi↗

Science Service Status 2019 World Radiocommunication Conference

Science missions such as Earth-exploration and remote sensing thatuse frequencies allocated for Earth Exploration-Satellite Service(EESS) provide valuable information about, for example: (1) Air quality monitoring (2) Soil moisture mapping (3) Sensing sea salinity (4) Weather forecasting and climate models (winds, storms, clouds).Another set of science missions use Space Research Service (SRS)allocations. These space research missions can support: (1) On orbit research that for example can help in the creation of new drugsor the impact of the space environment on satellites (2) Scientific information about the universe – stars, planetary science, solarsystem, and the future evolution of the universe.

Roura, Corali↗

Lost in Cloud

Cloud computing can reduce cost significantly because businesses can share computing resources. In recent years Small and Medium Businesses (SMB) have used Cloud effectively for cost saving and for sharing IT expenses. With the success of SMBs, many perceive that the larger enterprises ought to move into Cloud environment as well. Government agency s stove-piped environments are being considered as candidates for potential use of Cloud either as an enterprise entity or pockets of small communities. Cloud Computing is the delivery of computing as a service rather than as a product, whereby shared resources, software, and information are provided to computers and other devices as a utility over a network. Underneath the offered services, there exists a modern infrastructure cost of which is often spread across its services or its investors. As NASA is considered as an Enterprise class organization, like other enterprises, a shift has been occurring in perceiving its IT services as candidates for Cloud services. This paper discusses market trends in cloud computing from an enterprise angle and then addresses the topic of Cloud Computing for NASA in two possible forms. First, in the form of a public Cloud to support it as an enterprise, as well as to share it with the commercial and public at large. Second, as a private Cloud wherein the infrastructure is operated solely for NASA, whether managed internally or by a third-party and hosted internally or externally. The paper addresses the strengths and weaknesses of both paradigms of public and private Clouds, in both internally and externally operated settings. The content of the paper is from a NASA perspective but is applicable to any large enterprise with thousands of employees and contractors.

Maluf, David A.↗

Leveraging CSPP: Building a cloud based direct broadcast processing system

Reducing the time that it takes to have useful satellite information is very important because timely access allows for more informed decision making. This is especially true in time critical situations like disaster response and financial market analysis. One way to achieve reductions in the overall time between information capture and delivery to use the direct broadcast from weather satellites. In this work, we describe a state driven satellite information system that captures a satellite’s direct broadcast signal and uses cloud-based resources to provide end-user controlled processing. The system takes advantage of the reliability and customizability of Amazon Web Services to provide fast and reliable access to a system that takes the direct broadcast signal and leverages the CSPP software as well as dynamically supplied end-user processing modules to produce a user desired information product. Finally, we describe the development process and how a flexible design allowed for changes as the capabilities of the processing platform evolved and the lessons we learned from the process.

CSPP↗

An Oveview of TROPESS Data Products and Services at the NASA GES DISC

The TRopospheric Ozone and Precursors from Earth System Sounding (TROPESS) project generates Earth System Data Records (ESDRs) of ozone, and other atmospheric constituents (CH4,CO, H2O, HDO, NH3, PAN and temperature) by processing data from multiple satellites through a common retrieval algorithm and ground data system. Satellite Level-1B input data used in generating the TROPESS L2 data products include CrIS NOAA-20 (JPSS-1), CrIS SNPP, AIRS Aqua, OMI Aura, and TROPOMI S5P. The common retrieval framework is known as the MUlti-SpEctra, MUlti-SpEcies, Multi-SEnsors (MUSES) science data processing system (MUSES-SDPS). Several of the TROPESS data products are now available from the NASA Goddard Earth Sciences Data and Information Service Center (GES DISC) for users to download. In this presentation we provide an overview of the various TROPESS data products. These data products can be divided into the following Forward Stream types: Standard Products, Summary Products, and Full-Archival Products. Standard Products are for users that are doing full analysis with avenging kernel and covariance corresponding to retrieved vertical profiles. Summary products have a smaller file size and are more convenient for first-look and rapid analysis, include total and partial columns, as well as column averaging kernels. The Full-Archival Products will contain all information used in creating the data. TROPESS also creates Special Products, provided on an as-needed and as-available basis to support NASA field missions and individual-investigator requests over specific regions. Eventually, TROPESS will also produce and deliver a set of Reanalysis Stream products. Data at the GES DISC are being transitioned into the "Cloud". This will allow users with "Cloud” access to perform data analysis directly on the data without downloading the data to their system. Services, such as subsetting and data visualization, will also be provided for TROPESS data products at the GES DISC.

James Johnson↗

EOSDIS STAC Briefing

The Spatio-Temporal Asset Catalog (STAC) specification provides a common language to describe a range of geospatial information, so it can more easily be indexed and discovered. A 'spatiotemporal asset' is any file that represents information about the earth captured in a certain space and time. STAC provides a standards-based, web and cloud friendly cataloging specification that has seen a large amount of adoption in the cloud geospatial information system space. This presentation will demonstrate how NASA EOSDIS leverages STAC technology to provide value-added features to both our data discovery and transformation services. Finally, we will propose a way to improve our federated discovery capabilities using STAC.

NASA EOSDIS STAC Cloud catalog metadata↗

The Future of NASA Earth Science in the Commercial Cloud: Challenges and Opportunities

NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).

Alexey N Shiklomanov↗

Creating Satellite Data Products in the Cloud: SatCORPS Global Cloud Composites

Real time satellite observations and real time derived cloud products are becoming an important tool for both science as well as business ventures. The SatCORPS group leverages public and private cloud-based sources of satellite observations to create its Global Cloud Composite product in near real-time. This dataset allows others access to cloud information that can be accessed directly from the cloud. In this work, we describe the software algorithms and software infrastructure that we have created to create and distribute this product through our hybrid cloud and on-premises system that leverages the strengths and weaknesses of each platform. We will also describe the GCC product itself in terms of the scientific parameters available, resolution and temporal availability. Finally, we will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global cloud products with very low latency which we see that as filling a rapidly growing need in the research, modelling and business community. We present a detailed description of the SatCORPS GCC product in terms of the capabilities and research benefits as well as the delivery architecture in AWS. We take the discussion further and describe the web tools that the SatCORPS group has developed that allow users to access and use the GIS data that it creates.

Global Cloud Composite SatCORPS SMCE AWS↗