Search NASA⌕ Search

Engineering topics

Louis Nguyen

Publications and source records attributed to Louis Nguyen.

16 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) New Observing Strategies (NOS)

NASA's Advanced Information Systems Technology (AIST) Program is one of several Technology programs managed by the Earth Science Technology Office (ESTO) in the Earth Science Division (ESD). The AIST Program focuses on advanced information systems and novel computer science technologies that will be needed by NASA Earth Science in the next 5 to 10 years. New Observing Strategies is one the three main thrusts of the AIST Program. Each year, all the PI's present the technical advancements of their projects during a Grouped Technical Session.

Jacqueline Le Moigne-stewart↗
NASA NTRSDate not supplied

TPSAS-NF1676L-31647-DND

NASA LaRC and research partners are analyzing geostationary satellite observations and products available at up to 30-sec frequency, in combination with ground-based and in situ datasets, to better understand and detect aviation and severe weather hazards.

Kristopher Bedka↗
NASA NTRSDate not supplied

Leveraging CSPP: Building a cloud based direct broadcast processing system

Reducing the time that it takes to have useful satellite information is very important because timely access allows for more informed decision making. This is especially true in time critical situations like disaster response and financial market analysis. One way to achieve reductions in the overall time between information capture and delivery to use the direct broadcast from weather satellites. In this work, we describe a state driven satellite information system that captures a satellite’s direct broadcast signal and uses cloud-based resources to provide end-user controlled processing. The system takes advantage of the reliability and customizability of Amazon Web Services to provide fast and reliable access to a system that takes the direct broadcast signal and leverages the CSPP software as well as dynamically supplied end-user processing modules to produce a user desired information product. Finally, we describe the development process and how a flexible design allowed for changes as the capabilities of the processing platform evolved and the lessons we learned from the process.

CSPP↗
NASA NTRSDate not supplied

Advancing NASA SatCORPS Global Data Products with Cloud Computing and Machine Learning

Operational satellite imager radiances are valuable for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. The use of cloud computing has enabled recent enhancements to process a constellation of geostationary satellites at higher spatiotemporal resolutions than previously possible that meet low latency and near real-time needs. Data taken from Meteosat-8 and -11, Himawari, GOES-16, and -17 are processed and combined with operational polar orbiting satellite data and composited on a 3-km grid to provide global coverage. To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. An update on recent SatCORPS enhancements is presented, highlighting the community benefits achieved with the use of cloud computing and machine learning.

William L Smith↗
NASA NTRSDate not supplied

Transitioning a Flexible and Scalable Satellite Ground Station Observation Network (GSON) Framework to an Operational Environment

Obtaining accurate and timely satellite observations is of paramount importance in fields like disaster management, weather diagnoses/forecasting, and Earth Sciences remote sensing. Stored mission data (SMD), from low Earth orbiting (LEO) satellite sensors, provides important observations for these fields and applications, however data access to SMD can be delayed from one and half hours to three hours from the time the observations were made. This data latency poses a significant impact on data product optimal use. We developed a Ground Station Observation Network (GSON) that utilizes commercial ground station as a service (GSaaS) providers to acquire low latency direct broadcast (DB) data from AQUA, SNPP, and JPSS-1 satellites using antennas located in strategic locations around the world. We will discuss techniques to improve the deployment efficiency and code reliability and quality of the GSON framework. Topics include right-sizing and containerization of the code to facilitate integration and adaptation with continuous delivery (CD) pipeline, locating non-code assets in referenceable repositories separated from code, adaptation of pipelines as code and simplification of CD, intersecting with code quality tests and checks as part of the pipeline execution and deployment, and establishing distributed repositories, registries, and system identities in a way that mitigates compromise to the CD pipeline. These techniques enable deployment of processing systems that are both highly specific but also dynamically modifiable. This new class of system allows for a flexible and scalable deployment while avoiding the “black box” issues that can plague large system deployments.

cluster↗
NASA NTRSDate not supplied

SatCORPS Global Cloud Composite (GCC): the Design and Delivery of A High Quality, High Resolution, Global Cloud Product Available in Near-Real Time

The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) supports the development of an analysis ready and cloud-optimized data transformation pipeline and geospatial service enablement of a global cloud composite (GCC) product derived from global geostationary satellite imagery. This geospatial service will be available at high temporal and spatial resolution via the SatCORPS web mapping application for visualization and analysis as well as direct ingestion to common geospatial software and custom programming. The resulting global cloud composite products from the processing pipeline can then be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. Near real time global observations are created through the composition of five geostationary satellites that provides modelling and forecasting communities with the capability to provide high quality and timely information to start the projection process. The Global Cloud Composite product combines information from geostationary satellites, GOES-16, GOES-17, Himawari-8, Meteosat-11 and Meteosat-9 to create a single global composite netcdf file and images using the different products within the netcdf file. The SatCORPS team, though our Global Cloud Composite (GCC) product and web-based visualization tools including Geographical Information System (GIS) services provide near real time global cloud product information to both automated processes and traditional web users that is timely and high quality derived from geostationary satellites. The Global Cloud Composite product takes advantage of the scalable processing resources provided by the AWS batch service to provide new composites every thirty minutes. Because information from each of the low earth orbiting satellites is available on schedules tuned to the specific satellite, the processing algorithm temporally composites the final dataset as each satellite’s information becomes available. The SatCORPS team has leveraged our experience using Amazon Web Services (AWS) to build a low latency high availability tool that allows end users both human and automated to acquire high quality and high-resolution Geostationary Earth Orbiting (GEO) information at zero cost to the end user. This presentation will describe how we architected and implemented the service as well as lessons learned based on our experiences both developing and operating the system. The lessons learned include how we integrated multiple services including Amazon Batch, Amazon S3 and Amazon Lambda service to create a low cost but high-performance processing system that is capable of identifying and processing the most appropriate satellite overpass information into global cloud composites. We will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global composited cloud research products with very low latency that we see that as filling a rapidly growing need in the research and modelling community with no up-front nor ongoing costs associated with downloading or using the information.

AWS AMCE SMCE GCC SATCORPS GLOBAL CLOUD COMPOSITE ↗
NASA NTRSDate not supplied

Novel Hourly-Resolved Global Cloud Property Composite from Operational Satellites Imagers

Numerous applications in satellite remote sensing of surface properties, atmospheric state, composition, and radiation require accurate knowledge of the location and characteristics of clouds. Operational satellite imager radiances are valuable for cloud detection and for deriving many different physical parameters that can be used for a variety of weather, aviation, and energy applications. The NASA Satellite ClOud and Radiation Property retrieval System (SatCORPS) applies a suite of algorithms to meteorological satellite data to provide cloud properties, radiative fluxes and other parameters on a global scale. This paper describes a new global high-resolution dataset of cloud properties made available for community use that is constructed from analyses of a constellation of meteorological satellite imagers. Data taken from Meteosat-8/9 and -11, Himawari-8/9, GOES-16, and -17/-18, Aqua, Terra, Suomi-NPP and NOAA-20 are processed and composited on a 3-km grid to provide hourly global coverage. A historical multi-year dataset is available to serve various needs including modeling challenges related to cloud evaluations and parameterizations. Near real-time data products are also currently available between 60N and 60S. Efforts are underway to operationalize polar orbiting satellite cloud detection methods for low-latency applications over polar regions. The cloud detection and retrieval algorithms have been developed over many years to support NASA weather and climate programs such as the Clouds and Earth’s Radiant Energy System (CERES). To improve the utility of the data products, machine learning and other innovative methods are applied in various ways to help minimize data product uncertainties under the most challenging conditions and to improve their consistency at all times of day. A brief description of the methods highlighting the unique aspects of the SatCORPS data products will be presented along with information on their status and availability.

SatCORPS↗
NASA NTRSDate not supplied

Creating Satellite Data Products in the Cloud: SatCORPS Global Cloud Composites

Real time satellite observations and real time derived cloud products are becoming an important tool for both science as well as business ventures. The SatCORPS group leverages public and private cloud-based sources of satellite observations to create its Global Cloud Composite product in near real-time. This dataset allows others access to cloud information that can be accessed directly from the cloud. In this work, we describe the software algorithms and software infrastructure that we have created to create and distribute this product through our hybrid cloud and on-premises system that leverages the strengths and weaknesses of each platform. We will also describe the GCC product itself in terms of the scientific parameters available, resolution and temporal availability. Finally, we will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global cloud products with very low latency which we see that as filling a rapidly growing need in the research, modelling and business community. We present a detailed description of the SatCORPS GCC product in terms of the capabilities and research benefits as well as the delivery architecture in AWS. We take the discussion further and describe the web tools that the SatCORPS group has developed that allow users to access and use the GIS data that it creates.

Global Cloud Composite SatCORPS SMCE AWS↗
NASA NTRSDate not supplied

Visualization of Near Real-Time Global Cloud Composites (GCC): Integration in ArcGIS

The NASA Langley Satellite ClOud and Radiation Property retrieval System (SatCORPS) team provides low latency LEO and GEO satellite derived cloud and radiation products to end users for use in near real-time (NRT) applications. Hourly mosaics are fused from LEO (SNPP, JPSS-1, AQUA, MODIS) and GEO Satellite imagers (GOES-West, GOES-East, Metesat-11, Metesat-8, and Himawari-8) to create global cloud composites (GCC). SatCORPS GCC data are integrated into Esri ArcGIS system and transformed into Analysis Rady Data (ARD) to provide more efficient data access to support disaster management, weather diagnoses/forecasting, and Earth Sciences remote sensing applications. GCC data are exposed as RESTful APIs, ArcGIS Image Services, and Open Geospatial Consortium (OGC) Web Mapping Services/Web Coverage Services to provide a variety of end points for integration into user applications. We will preview the new interactive SatCORPS GCC web visualization tool and discuss initial integration of GCC product into NASA Airborne Mission Tool Suite (MTS) to support NASA and NOAA field campaigns.

GIS↗
NASA NTRSDate not supplied

Visualization and Analysis of Near Real-Time Global Cloud Composites (GCC): Integration in a Geospatial Web Mapping Application

The NASA Langley Satellite ClOud and Radiation Property retrieval System (SatCORPS) team provides tools for retrieving cloud information from operational and research meteorological imager data. LEO and GEO satellite imagers are used for fusing hourly mosaics which create the Global Cloud Composite (GCC). The GCC provides global cloud products with a low latency which can help satisfy the growing needs of the research, modeling and business communities. The Esri ArcGIS system is used to transform the GCC data into Analysis Ready Data (ARD) which can be utilized for a variety of visualization and analysis activities in support of weather diagnoses/forecasting, Earth Sciences remote sensing applications, and disaster management. Additionally, the data is enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services to be consumed via API within a web mapping application. We will present a preview of the new interactive SatCORPS GCC web mapping application and its capabilities in allowing users to access and use GIS data within it.

Web Mapping Application↗
NASA NTRSDate not supplied

Creating Near Real-time Hourly VIIRS Radiance Mosaic over Polar Regions from SatCORPS Global Cloud Composite (GCC)

While polar orbiting satellites are essential in providing the needed observations over polar regions for data assimilation, weather diagnoses/forecasting, and flight guidance and situation awareness in airborne field campaigns, there is limited temporal coverage. Often, polar mosaics are created by overlaying multiple satellite imagers on top of each other which can lead to transition lines and discontinuities in the data products. To help ease some of these shortcomings, we utilize the NASA Langley Satellite ClOud and Radiation Property retrieval System (SatCORPS) Mosaic algorithm for optimally fusing and merging selected imager radiances from the Visible Infrared Imaging Radiometer Suite (VIIRS) instrument onboard the Suomi National polar-orbiting Partnership (SNPP), Joint Polar Satellite System (JPSS-1), and JPSS-2 satellites, and the MODerate resolution Imaging Spectroradiometer (MODIS) instruments onboard AQUA and TERRA satellites. Since multiple satellites overpasses and instruments are used in creating hourly 3-km composites over the polar regions, selection of the best satellite data for each 3-km composite pixel is based on aggregated ranking of satellite resolution, time, viewing zenith angle, and distance from terminator. This ranking system provides a smoother transition and improves data discontinuity in the merged output resulting in a more seamless polar region dataset. We will discuss the use of this near real-time dataset to support polar airborne field campaigns and SatCORPS satellite-derived Global Cloud Composite (GCC) generation.

Satellite composites↗