Search NASA⌕ Search

SEARCH · Search NASA

Results for “neural radiance field”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

14 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating Neural Radiance Fields for Commercial Satellite Video

We evaluate neural radiance fields (NeRFs) as a method for reconstructing 3D volumetric scenes from low Earth orbit satellite imagery. We leverage commercial satellite data to reconstruct a scene using existing software tools. In doing so, we identify difficulties in these mapping datasets for NeRF generation. We propose potential applications in geospatial intelligence for context and improved image interpretation.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2023

Neural Radiance Fields for Shadow Removal and Relighting of Satellite Imagery

Multi-view stereo photogrammetric techniques have been conventionally utilized to generate Global Digital Elevation Models (GDEM) of planetary and lunar surfaces. However, these methods, relying on conventional feature detectors, are often subject to inaccuracies caused by changes in lighting conditions, including diffuse reflection and harsh shading. This has limited the ability of these methods to accurately reconstruct shadowed regions in orbital imagery, such as highly shaded urban areas and the permanently shadowed regions (PSRs) located in the lunar surface, which are critical targets for NASA's Artemis program. Neural Radiance Fields (NeRFs) offer a novel solution to these limitations by breaking away from traditional photogrammetric assumptions of ridged, opaque surfaces. NeRFs are capable of reconstructing 3D objects with variably transmissive properties, such as fluids, PSRs, and reflective surfaces. In this work, we demonstrate the robustness of NeRFs in generating high-fidelity 3D models of terrain from highly shaded orbital imagery acquired from small satellites in low earth orbit (LEO). Our results showcase the ability of NeRF to overcome the limitations of traditional photogrammetric methods and provide a promising solution for reconstructing complex scenes in challenging lighting conditions.

Caleb Ashmore Adams↗
DOE OSTI2026

Applications Of Machine Learning to Gas Plume Analysis In Longwave Infrared Hyperspectral Images

Longwave infrared hyperspectral images can be used for gas plume analysis, as many gases exhibit distinct absorption features in this portion of the electromagnetic spectrum. In practice, accurately identifying weak gas signatures is difficult because the observed radiance is dominated by background radiance, which varies with material, temperature, and viewing conditions. Many gas plume analysis pipelines operate on single images, limiting the ability to leverage spatial and multi-view information that could enhance the analysis. The goal of this dissertation is to explore how machine learning and deep learning methods can complement classical approaches to improve gas plume identification in longwave infrared hyperspectral imagery, and to investigate the use of neural radiance fields for hyperspectral scene reconstruction.

3D Scene Reconstruction↗
DOE OSTI2023

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRSDate not supplied

CERES FluxByCldTyp NB2BB Fluxes Improvement based on Deep Neural Network

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Prelimary results show significant LW improvement.

Moguo Sun↗
NASA NTRSDate not supplied

Improving Radiative Fluxes for the CERES FluxByCldTyp Data Product Using Deep Neural Network

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Preliminary results show significant LW improvement.

Sun, Moguo↗
NASA NTRSDate not supplied

Improvement of Radiative Fluxes for the CERES FluxByCldTyp Data Product Based on Machine Learning Technique

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere and surface flux data for climate studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models. The FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate their broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Preliminary results show significant LW improvement.

Sun, Moguo↗
NASA NTRSDate not supplied

Flux Improvement based on Machine Learning for the CERES FluxByCldTyp Data Product

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Prelimary results show significant LW improvement.

Moguo Sun↗
NASA NTRSDate not supplied

Improvement of Radiative Fluxes for the CERES FluxByCldTyp Data Product Based on Machine Learning Technique

The NASA Clouds and the Earth's Radiant Energy System (CERES) product provides over 20 years of accurately observed top-of-the-atmosphere (TOA) and surface flux data record for climate monitoring and diagnostic studies. The interaction between clouds and radiation interaction is a key factor that dominate climate feedbacks but is not well understood. To further advance our understanding of the cloud-radiation interaction, a new CERES FluxByCldTyp (FBCT) product has been developed that contains radiative fluxes by cloud-type, which can provide more stringent constraints when validating models and reveal more insight into the interactions between clouds and climate. For CERES partly cloudy and multiple cloud-type footprints, the FBCT product utilizes Moderate Resolution Imaging Spectroradiometer (MODIS) narrow-band (NB) imager channel radiances partitioned by cloud-type within a CERES footprint to estimate the cloud-type broadband fluxes. The MODIS multi-channel derived broadband fluxes were compared with the CERES observed footprint fluxes and were found to be within 1% and 2.5% for LW and SW, respectively, as well as being mostly free of cloud property dependencies. The FBCT all-sky and clear-sky monthly averaged fluxes were found to be consistent with the CERES SSF1deg product. This study takes advantage of recent progress in machine learning (ML) field by applying deep neural network algorithm to improve fluxes based on MODIS NB radiances. The preliminary study shows ML produce are an improvement over the current FBCT Edition 4 NB2BB algorithm. Furthermore, unlike Ed4 NB2BB, the new ML method convert NB radiances directly to broadband fluxes. For future Ed5, new NB radiances are proposed and used by ML to improve fluxes calculation. Prelimary results show significant LW improvement.

Moguo Sun↗
NASA NTRS2015

A Module for Assimilating Hyperspectral Infrared Retrieved Profiles into the Gridpoint Statistical Interpolation System for Unique Forecasting Applications

Hyperspectral infrared sounder radiance data are assimilated into operational modeling systems however the process is computationally expensive and only approximately 1% of available data are assimilated due to data thinning as well as the fact that radiances are restricted to cloud-free fields of view. In contrast, the number of hyperspectral infrared profiles assimilated is much higher since the retrieved profiles can be assimilated in some partly cloudy scenes due to profile coupling other data, such as microwave or neural networks, as first guesses to the retrieval process. As the operational data assimilation community attempts to assimilate cloud-affected radiances, it is possible that the use of retrieved profiles might offer an alternative methodology that is less complex and more computationally efficient to solve this problem. The NASA Short-term Prediction Research and Transition (SPoRT) Center has assimilated hyperspectral infrared retrieved profiles into Weather Research and Forecasting Model (WRF) simulations using the Gridpoint Statistical Interpolation (GSI) System. Early research at SPoRT demonstrated improved initial conditions when assimilating Atmospheric Infrared Sounder (AIRS) thermodynamic profiles into WRF (using WRF-Var and assigning more appropriate error weighting to the profiles) to improve regional analysis and heavy precipitation forecasts. Successful early work has led to more recent research utilizing WRF and GSI for applications including the assimilation of AIRS profiles to improve WRF forecasts of atmospheric rivers and assimilation of AIRS, Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI) profiles to improve model representation of tropopause folds and associated non-convective wind events. Although more hyperspectral infrared retrieved profiles can be assimilated into model forecasts, one disadvantage is the retrieved profiles have traditionally been assigned the same error values as the rawinsonde observations when assimilated with GSI. Typically, satellitederived profile errors are larger and more difficult to quantify than traditional rawinsonde observations (especially in the boundary layer), so it is important to appropriately assign observation errors within GSI to eliminate potential spurious innovations and analysis increments that can sometimes arise when using retrieved profiles. The goal of this study is to describe modifications to the GSI source code to more appropriately assimilate hyperspectral infrared retrieved profiles and outline preliminary results that show the differences between a model simulation that assimilated the profiles as rawinsonde observations and one that assimilated the profiles in a module with the appropriate error values.

Berndt, Emily↗
NASA NTRS2014

Bias Correction for Assimilation of Retrieved AIRS Profiles of Temperature and Humidity

Atmospheric Infrared Sounder (AIRS) is a hyperspectral radiometer aboard NASA's Aqua satellite designed to measure atmospheric profiles of temperature and humidity. AIRS retrievals are assimilated into the Weather Research and Forecasting (WRF) model over the North Pacific for some cases involving "atmospheric rivers". These events bring a large flux of water vapor to the west coast of North America and often lead to extreme precipitation in the coastal mountain ranges. An advantage of assimilating retrievals rather than radiances is that information in partly cloudy fields of view can be used. Two different Level 2 AIRS retrieval products are compared: the Version 6 AIRS Science Team standard retrievals and a neural net retrieval from MIT. Before assimilation, a bias correction is applied to adjust each layer of retrieved temperature and humidity so the layer mean values agree with a short-term model climatology. WRF runs assimilating each of the products are compared against each other and against a control run with no assimilation. This paper will describe the bias correction technique and results from forecasts evaluated by validation against a Total Precipitable Water (TPW) product from CIRA and against Global Forecast System (GFS) analyses.

Blankenship, Clay↗
NASA NTRS2014

Bias Correction for Assimilation of Retrieved AIRS Profiles of Temperature and Humidity

The Atmospheric Infrared Sounder (AIRS) is a hyperspectral radiometer aboard NASA's Aqua satellite designed to measure atmospheric profiles of temperature and humidity. AIRS retrievals are assimilated into the Weather Research and Forecasting (WRF) model over the North Pacific for some cases involving "atmospheric rivers". These events bring a large flux of water vapor to the west coast of North America and often lead to extreme precipitation in the coastal mountain ranges. An advantage of assimilating retrievals rather than radiances is that information in partly cloudy fields of view can be used. Two different Level 2 AIRS retrieval products are compared: the Version 6 AIRS Science Team standard retrievals and a neural net retrieval from MIT. Before assimilation, a bias correction is applied to adjust each layer of retrieved temperature and humidity so the layer mean values agree with a short‐term model climatology. WRF runs assimilating each of the products are compared against each other and against a control run with no assimilation. Forecasts are against ERA reanalyses.

Blakenship, Clay↗
NASA NTRS2015

Retrieved Products from Simulated Hyperspectral Observations of a Hurricane

Retrievals were run using the AIRS Science Team Version-6 AIRS Only retrieval algorithm, which generates a Neural-Net first guess (T(sub s))(sup 0), (T(p))(sup 0), and (q(p))(sup 0) as a function of observed AIRS radiances. AIRS Science Team Neural-Net coefficients performed very well beneath 300 mb using the simulated radiances. This means the simulated radiances are very realistic. First guess and retrieved values of T(p) above 300 mb were biased cold, but both represented the model spatial structure very well. QC'd T(p) and q(p) retrievals for all experiments had similar accuracies compared to their own truth fields, and were roughly consistent with results obtained using real data. Spatial coverage of retrievals, as well as the representativeness of the spatial structure of the storm, improved dramatically with decreasing size of the instrument's FOV. We sent QC'd values of T(p) and q(p) to Bob Atlas at AOML for use as input to OSSE Data Assimilation experiments.

CrIS ATMS↗
NASA NTRS2011

An Overview of the GEOS-5 Aerosol Reanalysis

GEOS-5 is the latest version of the NASA Global Modeling and Assimilation Office (GMAO) earth system model. GEOS-5 contains components for atmospheric circulation and composition (including data assimilation), ocean circulation and biogeochemistry, and land surface processes. In addition to traditional meteorological parameters, GEOS-5 includes modules representing the atmospheric composition, most notably aerosols and tropospheric/stratospheric chemical constituents, taking explicit account of the impact of these constituents on the radiative processes of the atmosphere. MERRA is a NASA meteorological reanalysis for the satellite era (1979-present) using GEOS-5. This project focuses on historical analyses of the hydrological cycle on a broad range of weather and climate time scales. As a first step towards an integrated Earth System Analysis (IESA), the GMAO is extending MERRA with reanalyses for other components of the earth system: land, ocean, bio-geochemistry and atmospheric constituents. In this talk we will present results from the MERRA-driven aerosol reanalysis covering the Aqua period (2003-present). The assimilation of Aerosol Optical Depth (AOD) in GEOS-5 involves very careful cloud screening and homogenization of the observing system by means of a Neural Net scheme that translates MODIS radiances into AERONET calibrated AOD. These measurements are further quality controlled using an adaptive buddy check scheme, and assimilated using the Local Displacement Ensemble (LDE) methodology. For this reanalysis, GEOS-5 runs at a nominal 50km horizontal resolution with 72 vertical layers (top at approx. 8Skm). GEOS-5 is driven by daily biomass burning emissions derived from MODIS fire radiative power retrievals. We will present a summary of our efforts to validate such dataset. The GEOS-5 assimilated aerosol fields are first validated by comparison to independent in-situ measurements (AERONET and PM2.5 surface concentrations). In order to asses aerosol absorption on a global scale, we perform a detailed radiative transfer calculation to simulate the UV aerosol index, comparing our results to OMI measurements. By simulating aerosol attenuated backscatter, we use CALIPSO measurements to evaluate the vertical structure of our aerosol estimates, in particular in regions where we have larger discrepancies with OMI. Finally, the consistency of our AOD estimates with estimates from MISR, MODIS/Deep Blue, OMI and PARASOL will be briefly discussed.

da Silva, Arlindo↗