Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud Service Providers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Open-Source Data Engineering at NASA: CCMC's Approach to Managing Petabyte-Scale Heliophysics Data

The Community Coordinated Modeling Center (CCMC) at NASA Goddard Space Flight Center (GSFC) leads heliophysics research by providing open access to numerous models and their outputs. Our resources are available on-demand and continuously updated with real-time data, covering sun-earth interactions across multiple domains. These domains include coronal, heliosphere, inner and global magnetosphere, ionosphere, thermosphere, and lower atmosphere interactions. Operating in a hybrid environment, CCMC utilizes both self-owned hardware and Amazon Web Services (AWS) cloud infrastructure. Managing petabytes of data across multiple locations necessitates robust data engineering solutions. To address this challenge, CCMC has adopted industry-standard and open-source tools. We use Apache Airflow as our primary data engineering platform, Python for scripting and data processing, and GitLab for version control and CI/CD. Additionally, we employ Kubernetes for containerized services, Grafana and Prometheus for metrics and monitoring, and Terraform and Puppet for reproducible infrastructure as code. This presentation will discuss lessons learned from our data engineering experiences, platforms evaluated but found unsuitable for our scientific data requirements, and specific techniques developed to enhance data transfer speed and reliability. By using these technologies effectively, CCMC continues to advance heliophysics research through efficient data management and open-access modeling.

space weather↗
NASA NTRS2015

The Tracking Meteogram, an AWIPS II Tool for Time-Series Analysis

A new tool has been developed for the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS) II through collaboration between NASA's Short‐term Prediction Research and Transition (SPoRT) and the NWS Meteorological Development Laboratory (MDL). Referred to as the "Tracking Meteogram", the tool aids NWS forecasters in assessing meteorological parameters associated with moving phenomena. The tool aids forecasters in severe weather situations by providing valuable satellite and radar derived trends such as cloud top cooling rates, radial velocity couplets, reflectivity, and information from ground‐based lightning networks. The Tracking Meteogram tool also aids in synoptic and mesoscale analysis by tracking parameters such as the deepening of surface low pressure systems, changes in surface or upper air temperature, and other properties. The tool provides a valuable new functionality and demonstrates the flexibility and extensibility of the NWS AWIPS II architecture. In 2014, the operational impact of the tool was formally evaluated through participation in the NOAA/NWS Operations Proving Ground (OPG), a risk reduction activity to assess performance and operational impact of new forecasting concepts, tools, and applications. Performance of the Tracking Meteogram Tool during the OPG assessment confirmed that it will be a valuable asset to the operational forecasters. This presentation reviews development of the Tracking Meteogram tool, performance and feedback acquired during the OPG activity, and future goals for continued support and extension to other application areas.

Burks, Jason Eric↗
NASA NTRS2018

Sentinel-5P/TROPOMI and S-NPP/OMPS Data Support at GES DISC

The TROPspheric Monitoring Instrument (TROPOMI) on the Sentinel-5 Precursor (Sentinel-5P) is the first of the Atmospheric Composition Sentinels by the European Space Agency (ESA) that provides measurements of ozone, NO2, SO2, CH4, CO, formaldehyde, aerosols and cloud at high spatial, temporal and spectral resolutions. The early afternoon orbit of Sentinel-5P mission provides a strong synergy with the U.S. Suomi National Polar-orbiting Partnership (S-NPP) satellite, especially in that the S-NPP Ozone Monitoring and Profiling Suite (OMPS) facilitates high vertically resolved stratospheric and lower mesospheric ozone profiles. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) supports over a thousand data collections in the Focus Areas of Atmospheric Composition, Water & Energy Cycles, and Climate Variability and it is the Distributed Active Archive Center (DAAC) that is curating both offline Sentinel-5P TROPOMI and S-NPP OMPS Level-1B (L1B) and Level-2 (L2) products. Through its convenient and enhanced tools/services such as OPeNDAP and L2 Subsetting, GES DISC offers air quality remote sensing user communities facile solutions for complex Earth science data and applications. This presentation will demonstrate TROPOMI and OMPS products including earthview radiance, solar irradiance, and currently available L2 datasets, as well as easy ways to access, visualize and subset data. The implementation of the End User License Agreement (EULA) between NASA GES DISC and all data users accessing data at GES DISC will be emphasized as well.

TROPOMI↗
NASA NTRS2019

Federated Cloud Challenges in NASA's Earth Science Data Systems (Why So Difficult?)

NASA is presented with a number of opportunities and challenges in federating its Earth Science Data Systems in the burgeoning world of cloud computing. Cloud hosting of Earth Science data provides a new way of bringing data together, at least from a virtual location sense, and is one of the main motives for NASA to host data there. However, NASA is also faced with a Big Data Variety challenge, brought on by the variety of the EO datasets in its archives. This diversity requires many diverse science archives to service the different science communities. As a result, nearly every major function in the Earth Observing System Data and Information System (EOSDIS) must also be federated across its data centers. This pattern is repeated with many of the outside agencies and organizations that EOSDIS federates with, such as the Committee for Earth Observing Satellites, leading to pioneering work on "deep federation" in a joint project with the European Space Agency to develop a Multi-Mission Algorithm and Analysis Platform.

Lynnes, Christopher↗
NASA NTRS2008

Use of VIIRS DNB Data to Monitor Power Outages and Restoration for Significant Weather Events

NASA fs Short-term Prediction Research and Transition (SPoRT) project operates from NASA's Marshall Space Flight Center in Huntsville, Alabama. The team provides unique satellite data to the National Weather Service (NWS) and other agencies and organizations for weather analysis. While much of its work is focused on improving short-term weather forecasting, the SPoRT team supported damage assessment and response to Hurricane Superstorm Sandy by providing imagery that highlighted regions without power. The team used data from the Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi National Polar-orbiting Partnership (Suomi NPP) satellite. The VIIRS low-light sensor, known as the day-night-band (DNB), can detect nighttime light from wildfires, urban and rural communities, and other human activity which emits light. It can also detect moonlight reflected from clouds and surface features. Using real time VIIRS data collected by our collaborative partner at the Space Science and Engineering Center of the University of Wisconsin, the SPoRT team created composite imagery to help detect power outages and restoration. This blackout imagery allowed emergency response teams from a variety of agencies to better plan and marshal resources for recovery efforts. The blackout product identified large-scale outages, offering a comprehensive perspective beyond a patchwork GIS mapping of outages that utility companies provide based on customer complaints. To support the relief efforts, the team provided its imagery to the USGS data portal, which the Federal Emergency Management Agency (FEMA) and other agencies used in their relief efforts. The team fs product helped FEMA, the U.S. Army Corps of Engineers, and U.S. Army monitor regions without power as part of their disaster response activities. Disaster responders used the images to identify possible outages and effectively distribute relief resources. An enhanced product is being developed and integrated into a web mapping service (WMS) for dissemination and use by a broader end user community.

Jedlovec, Gary↗
NASA NTRS2017

AIRS-Only Product in Giovanni for Exploring Up-to-Date AIRS Observation and Comparing with AIRS+AMSU Product

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) has been the home of processing, archiving, and distribution services for the Atmospheric Infrared Sounder (AIRS) mission since its launch in 2002 for global observations of the atmospheric state. Giovanni, a Web-based application developed by the GES DISC, provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download the data. Most important AIRS variables, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases, are available in Giovanni. AIRS is an instrument suite comprised of a hyperspectral infrared instrument (AIRS) and two multichannel microwave instruments, the Advanced Microwave Sounding Unit (AMSU) and the Humidity Sounder for Brazil (HSB). As HSB ceased operation in the very early stages of the AIRS mission, the AIRS project operates two parallel retrieval algorithms: one using both IR and MW measurements (AIRS+AMSU) and the other using only IR measurements (AIRS-only), which covers most of the mission duration. The AIRS+AMSU product is better quality, and the variables in Giovanni are from this product. However, generation of the AIRS+AMSU product has been suspended since the AMSU instrument anomaly occurred in late September 2016. To continue exploring up-to-date AIRS observations, the same set of variables from the AIRS-only product have been added to Giovanni by the GES DSIC. This will also support comparison of AIRS-only with AIRS+AMSU retrievals. In this presentation, we demonstrate the visualization of the AIRS-only product and plots/statistics of comparison with AIRS+AMSU product using Giovanni.

AIRS↗
NASA NTRS1988

Fiji South Pacific Severe Storm Detection and Warning System Project (SPSSD/WS)

In August 1986, a South Pacific Severe Storm Detection and Warning System (SPSSD/WS) was installed by NASA at the Fiji Meteorological Service (FMS) in Nadi, Fiji. The system consists of a 6.1 meter parabolic dish antenna, a satellite ground station, and computer and image processing facilities. The system allows tracking of all South Pacific tropical cyclones with real-time, high resolution reception of visible and infrared cloud images from both the Japanese Geostationary Meteorological Satellite (GMS) and the U.S. Geostationary Operational Environmental Satellite (GOES-WEST). Training was also provided in system usage and operations. In December 1986, the U.S. AID Office of U.S. Foreign Disaster Assistance (OFDA) commissioned an evaluation of the SPSSD/WS. The system was recognized as one of the most advanced of its kind in the Pacific Basin. It has functioned successfully since installation with only minor interruptions, and it has become the prime tool in supporting the FMS' role as the regional tropical cyclone warning center for the Southwest Pacific. However, it was noted that there are needed enhancements to the system.

Vermillion, C.↗
NASA NTRS1993

A technique for deriving column-integrated water content using VAS split-window data

An algorithm is examined that uses VISSR Atmospheric Sounder (VAS) 11- and 12-micron (split-window) data to derive column-integrated water content (IWC) at mesoscale resolution. The algorithm is physically based and derives its first-guess information from radiosonde data. The procedure is applied first to a test case data set and then to the 19 June 1986 study day from the Cooperative Huntsville Meteorological Experiment (COHMEX). Ground truth data for verifying results from the technique include IWC from National Weather Service and COHMEX radiosondes, the Multispectral Atmospheric Mapping Sensor (MAMS), and a special set of VAS soundings (12 channel) using an independent retrieval method. Results from the test case show reasonable accuracy with the rms errors as low as +/- 3.8 mm. On the 19 June case study day IWC analyses depict reasonable gradients and exhibit good spatial and temporal continuity. Furthermore, they provide insight into preferred regions for cumulus cloud and thunderstorm formation. On the average, a mean absolute retrieval error of 2.4 mm (an 8.1 percent error) and a rms error of +/- 2.9 mm are obtained on the case study day. These results compare favorably with those from existing VAS IWC techniques. Overall, the findings indicate that the technique has excellent potential to depict mesoscale moisture variations.

Guillory, Anthony R.↗
NASA NTRS2018

Hosting Hyrax in the Cloud While Preserving the User Experience

Cloud object stores enable data providers to reduce costs and provide uniform data servers across organizational divisions. This talk will address how new capabilities provided by cloud computing can be used with existing software so that users get the benefits provided by cloud technology (access to data at lower cost, e.g.) without disrupting their existing workflow(s). We will address ways to reduce response latency often associated with Cloud object stores and ways to simulate the hierarchy of a POSIX file system using a key-value object store. This work is based an on-going NASA EED2 project to enhance the Hyrax data server for operation in the Amazon Web Services Cloud.

Hyrax server↗
NASA NTRSDate not supplied

Visualization and Analysis of Near Real-Time Global Cloud Composites (GCC): Integration in a Geospatial Web Mapping Application

The NASA Langley Satellite ClOud and Radiation Property retrieval System (SatCORPS) team provides tools for retrieving cloud information from operational and research meteorological imager data. LEO and GEO satellite imagers are used for fusing hourly mosaics which create the Global Cloud Composite (GCC). The GCC provides global cloud products with a low latency which can help satisfy the growing needs of the research, modeling and business communities. The Esri ArcGIS system is used to transform the GCC data into Analysis Ready Data (ARD) which can be utilized for a variety of visualization and analysis activities in support of weather diagnoses/forecasting, Earth Sciences remote sensing applications, and disaster management. Additionally, the data is enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services to be consumed via API within a web mapping application. We will present a preview of the new interactive SatCORPS GCC web mapping application and its capabilities in allowing users to access and use GIS data within it.

Web Mapping Application↗
NASA NTRSDate not supplied

Providing Long-term Solar and Meteorological Resource Information from NASA Research through the GIS-Enabled POWER Web Services Portal

Solar and other renewable energy systems are optimized using geophysical parameters describing information about the solar resource and meteorological environments and how those environments may be changing in time. The Prediction of Worldwide Renewable Energy Resource (POWER) team at the NASA LaRC Research Center deployed its first version of the revitalized POWER geophysical parameter website that employs Esri Geographic Information System (GIS) tools. This web application provides access to both time series and climatological data sets spanning from a few days behind real-time back to the early 1980’s with a spatial resolution of 0.5 x 0.5 degree, thus extending over 30 years. The GIS tools enable, generate and store climatological averages using spatial queries and calculations in a spatial database resulting in greater accessibility to government agencies, industry and individuals. There is an API that provides data through a URL coding and can also invoked inside user software packages. Output data formats now include ASCII, CSV, geoTiff, JSON and .netCDF. Since May 2018, over 10.4 TB of data have been delivered to fulfill over 110 million data requests from 240,000 unique user IPs (https://power.larc.nasa.gov). This presentation provides an overview of this project and the current version of the new POWER web capabilities through to the end usage. Surface solar parameters are adapted from both the NASA/GEWEX (Global and Energy Water Cycle Exchange) SRB (Surface Radiation Budget) project and the CERES (Clouds and Earth’s Radiant Energy System) data products. The meteorological parameters are adapted from NASA’s MERRA-2 (Modern Era Retrospective-analysis for Research and Applications). We review uncertainty of various basic parameters using surface measurements. After the introduction, we specifically discuss various clusters of parameters for equator pointing tilted surfaces that provide for the estimation of optimal tilt angle by month and year. The discussion will emphasize a few examples of how solar and building engineers are using the data products. We will then preview the capabilities of Version 2 featuring examples of hourly solar and meteorological data products, customized user reports and expanded web mapping services from CERES data products. The web services provide a unique, expandable resource for renewable energy systems engineers to design, evaluate and optimize to environments worldwide.

Solar Resource↗
NASA NTRSDate not supplied

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗
NASA NTRS2010

Proposed Use of the NASA Ames Nebula Cloud Computing Platform for Numerical Weather Prediction and the Distribution of High Resolution Satellite Imagery

The development of the Nebula Cloud Computing Platform at NASA Ames Research Center provides an open-source solution for the deployment of scalable computing and storage capabilities relevant to the execution of real-time weather forecasts and the distribution of high resolution satellite data to the operational weather community. Two projects at Marshall Space Flight Center may benefit from use of the Nebula system. The NASA Short-term Prediction Research and Transition (SPoRT) Center facilitates the use of unique NASA satellite data and research capabilities in the operational weather community by providing datasets relevant to numerical weather prediction, and satellite data sets useful in weather analysis. SERVIR provides satellite data products for decision support, emphasizing environmental threats such as wildfires, floods, landslides, and other hazards, with interests in numerical weather prediction in support of disaster response. The Weather Research and Forecast (WRF) model Environmental Modeling System (WRF-EMS) has been configured for Nebula cloud computing use via the creation of a disk image and deployment of repeated instances. Given the available infrastructure within Nebula and the "infrastructure as a service" concept, the system appears well-suited for the rapid deployment of additional forecast models over different domains, in response to real-time research applications or disaster response. Future investigations into Nebula capabilities will focus on the development of a web mapping server and load balancing configuration to support the distribution of high resolution satellite data sets to users within the National Weather Service and international partners of SERVIR.

Limaye, Ashutosh S.↗
NASA NTRS2016

Constructing an AIRS Climatology for Data Visualization and Analysis to Serve the Climate Science and Application Communities

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for NASA sounders: the present Aqua AIRS mission and the succeeding SNPP CrIS mission. The AIRS mission is entering its 15th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. The GES DISC, in collaboration with the AIRS Project, released product from the version 6 algorithm in early 2013. Giovanni, a Web-based application developed by the GES DISC, provides a simple and intuitive way to visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download the data. Most important variables from version 6 AIRS product are available in Giovanni. We are developing a climatology product using 14-year AIRS retrievals. The study can be a good start for the long term climatology from NASA sounders: the AIRS and the succeeding CrIS. This presentation will show the impacts to the climatology product from different aggregation methods. The climatology can serve climate science and application communities in data visualization and analysis, which will be demonstrated using a variety of functions in version 4 Giovanni. The highlights of these functions include user-defined monthly and seasonal climatology, inter annual seasonal time series, anomaly analysis.

AIRS↗
NASA NTRSDate not supplied

Integrating Multi-agency Data Products in a Cloud-based Platform for Streamlined Discovery, Visualization, and Use

Earth science data users almost always have an interest in utilizing geospatial data from multiple agencies. As computing capability and cloud-based infrastructures accelerate the pace at which scientific research can be done, there is a growing need to enable search, discovery, and use of multi-agency geospatial observations relevant for a common use case - without undergoing the search and discovery process in a less efficient, disparate path with each agency. NASA’s Earth Observing System Data and Information System (EOSDIS) and NOAA’s National Environmental Satellite, Data and Information Service (NESDIS) both support a wide range of Earth science disciplines’ research, operations, and applications activities. Presently, however, there are few examples of data discovery frameworks supporting an inquiry of both NASA’s and NOAA’s extensive archives of Earth observations that are equally suitable for a particular science scenario, regardless of the agency that “owns” the data. NASA and NOAA are collaborating on a data expedition platform for exploring fire weather using data products from both agencies. Users will be able to search, discover, and visualize NASA and NOAA products in one interface. Each agency will curate metadata for its respective datasets, providing for a rich search experience. The collaboration will pilot a shared search interface into these metadata datastores. Data products will be stored in the cloud in cloud-optimized format(s). These formats will allow for optimized data access and visualization to support the “data expedition”. Avenues for further development and application of this cloud-based, multi-agency data provisioning platform will also be discussed.

cloud-based technology↗
NASA NTRS2011

Autonomous Flight Rules - A Concept for Self-Separation in U.S. Domestic Airspace

Autonomous Flight Rules (AFR) are proposed as a new set of operating regulations in which aircraft navigate on tracks of their choice while self-separating from traffic and weather. AFR would exist alongside Instrument and Visual Flight Rules (IFR and VFR) as one of three available flight options for any appropriately trained and qualified operator with the necessary certified equipment. Historically, ground-based separation services evolved by necessity as aircraft began operating in the clouds and were unable to see each other. Today, technologies for global navigation, airborne surveillance, and onboard computing enable the functions of traffic conflict management to be fully integrated with navigation procedures onboard the aircraft. By self-separating, aircraft can operate with more flexibility and fewer restrictions than are required when using ground-based separation. The AFR concept is described in detail and provides practical means by which self-separating aircraft could share the same airspace as IFR and VFR aircraft without disrupting the ongoing processes of Air Traffic Control.

Wing, David J.↗
NASA NTRS1985

Preliminary planning for the Satellite Precipitation And Cloud Experiment (SPACE) Field Program

Preliminary planning has been performed to support NASA/Marshall Space Flight Center (MSFC) in the coordination of the field experiment to be conducted in Central Tennessee, Northern Alabama, and Mississippi during the Spring/Summer of 1986. The goal of Satellite Precipitation and Cloud Experiments (SPACE) is to investigate mesoscale cloud/precipitation systems and development of associated satellite remote sensing technology. The field program will incorporate remote sensing observations from aircraft, satellite imagery, radar observations, ground based lightning measurements, rawinsonde observations, and various surface meteorological observations. The coordination of existing and special observation networks will provide a data base for analysis of precipitation events and provide ground truth comparisons for remote sensing capabilities. Existing surface-based observational networks include National Weather Service Meso/Alpha Scale Rawinsonde, radar, and surface measurements; the Tennessee Valley Authority automated and manual precpitation recording stations; and NASA/MSFC lightning measurement stations. Special observational features to be implemented include a meso/beta scale rawinsonde network, a special surface observational network within the rawinsonde network, and the installation of a RADAP II/ICRAD data processing unit on the National Weather Service radar at Nashville, TN. Initial coordination of these observational requirements to accomplish the goals of SPACE have been performed.

Williams, S. F.↗
NASA NTRSDate not supplied

An Update on the Hydrological Land Surface Data and Services at NASA GES DISC

"The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is one of twelve NASA Earth Observing System data centers that document, process, archive and distribute data from Earth science missions and related projects. The GES DISC hosts many hydrological land surface data products including North American Land Data Assimilation System (NLDAS), Global Land Data Assimilation System (GLDAS), the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS), and assimilated-Gravity Recovery and Climate Experiment (GRACE). The Land Surface Model (LSM) products contain model output, including heat fluxes, rain, snow, soil temperature, soil moisture and runoff; and observational forcing data, including surface pressure, temperature, precipitation, downward shortwave and longwave radiation, humidity, and wind. The temporal resolution of the hydrology data at the GES DISC ranges from hourly to monthly and the spatial resolution 0.1 degree to 1.0 degree. The variability of Earth’s water and energy cycles can be characterized with these spatially and temporally consistent, and quality controlled hydrological land surface data. These data could support ongoing modeling activities, and help improve our understanding of land-surface-atmosphere interactions and their impact on climate. Over the years, new data is added, and older data is reprocessed and updated. This presentation provides a summary table of the hydrological data and discusses recent updates to the data and data services at the GES DISC. New data products include (1) GRACE Global Version 3.0 drought indicators and (2) FLDAS monthly global and Central Asia daily data. Reprocessed and updated products include (1) NLDAS Version 2.0 and (2) GRACE United States Version 4.0 drought indicators. Lastly, this presentation will discuss the opportunities for accessing some of our hydrology data from the cloud. As the hydrology land surface data is moved to the cloud, users can expect faster service for longer time series, notably the hydrology data rods time series service."

Ashley Heath↗