Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1985

Multidimensional Modeling of Atmospheric Effects and Surface Heterogeneities on Remote Sensing

The overall goal of this project is to establish a modeling capability that allows a quantitative determination of atmospheric effects on remote sensing including the effects of surface heterogeneities. This includes an improved understanding of aerosol and haze effects in connection with structural, angular, and spatial surface heterogeneities. One important objective of the research is the possible identification of intrinsic surface or canopy characteristics that might be invariant to atmospheric perturbations so that they could be used for scene identification. Conversely, an equally important objective is to find a correction algorithm for atmospheric effects in satellite-sensed surface reflectances. The technical approach is centered around a systematic model and code development effort based on existing, highly advanced computer codes that were originally developed for nuclear radiation shielding applications. Computational techniques for the numerical solution of the radiative transfer equation are adapted on the basis of the discrete-ordinates finite-element method which proved highly successful for one and two-dimensional radiative transfer problems with fully resolved angular representation of the radiation field.

Gerstl, S. A. W.↗
NASA NTRS1980

Microwave remote sensing of snowpacks

The interaction mechanisms responsible for the microwave backscattering and emission behavior of snow were investigated, and models were developed relating the backscattering coefficient (sigma) and apparent temperature (T) to the physical parameters of the snowpack. The microwave responses to snow wetness, snow water equivalent, snow surface roughness, and to diurnal variations were investigated. Snow wetness was shown to have an increasing effect with increasing frequency and angle of incidence for both active and passive cases. Increasing snow wetness was observed to decrease the magnitude sigma and increase T. Snow water equivalent was also observed to exhibit a significant influence sigma and T. Snow surface configuration (roughness) was observed to be significant only for wet snow surface conditions. Diurnal variations were as large as 15 dB for sigma at 35 GHz and 120 K for T at 37 GHz. Simple models for sigma and T of a snowpack scene were developed in terms of the most significant ground-truth parameters. The coefficients for these models were then evaluated; the fits to the sigma and T measurements were generally good. Finally, areas of needed additional observations were outlined and experiments were specified to further the understanding of the microwave-snowpack interaction mechanisms.

Stiles, W. H.↗
NASA NTRS1984

Effects of corn stalk orientation and water content on passive microwave sensing of soil moisture

A field experiment was conducted utilizing artificial arrangements of plant components during the summer of 1982 to examine the effects of corn canopy structure and plant water content on microwave emission. Truck-mounted microwave radiometers at C (5 GHz) and L (1.4 GHz) band sensed vertically and horizontally polarized radiation concurrent with ground observations of soil moisture and vegetation parameters. Results indicate that the orientation of cut stalks and the distribution of their dielectric properties through the canopy layer can influence the microwave emission measured from a vegetation/soil scene. The magnitude of this effect varies with polarization and frequency and with the amount of water in the plant, disappearing at low levels of vegetation water content. Although many of the canopy structures and orientations studied in this experiment are somewhat artificial, they serve to improve understanding of microwave energy interactions within a vegetation canopy and to aid in the development of appropriate physically based vegetation models.

Oneill, P. E.↗
NASA NTRS2000

Processing Motion Signals in Complex Environments

Motion information is critical for human locomotion and scene segmentation. Currently we have excellent neurophysiological models that are able to predict human detection and discrimination of local signals. Local motion signals are insufficient by themselves to guide human locomotion and to provide information about depth, object boundaries and surface structure. My research is aimed at understanding the mechanisms underlying the combination of motion signals across space and time. A target moving on an extended trajectory amidst noise dots in Brownian motion is much more detectable than the sum of signals generated by independent motion energy units responding to the trajectory segments. This result suggests that facilitation occurs between motion units tuned to similar directions, lying along the trajectory path. We investigated whether the interaction between local motion units along the motion direction is mediated by contrast. One possibility is that contrast-driven signals from motion units early in the trajectory sequence are added to signals in subsequent units. If this were the case, then units later in the sequence would have a larger signal than those earlier in the sequence. To test this possibility, we compared contrast discrimination thresholds for the first and third patches of a triplet of sequentially presented Gabor patches, aligned along the motion direction. According to this simple additive model, contrast increment thresholds for the third patch should be higher than thresholds for the first patch.The lack of a measurable effect on contrast thresholds for these various manipulations suggests that the pooling of signals along a trajectory is not mediated by contrast-driven signals. Instead, these results are consistent with models that propose that the facilitation of trajectory signals is achieved by a second-level network that chooses the strongest local motion signals and combines them if they occur in a spatio-temporal sequence consistent with a trajectory. These results parallel the lack of increased apparent contrast along a static contour made up of similarly oriented elements.

Verghese, Preeti↗
NASA NTRS2011

Terra and Aqua MODIS Design, Radiometry, and Geometry in Support of Land Remote Sensing

The NASA Earth Observing System (EOS) mission includes the construction and launch of two nearly identical Moderate Resolution Imaging Spectroradiometer (MODIS) instruments. The MODIS proto-flight model (PFM) is onboard the EOS Terra satellite (formerly EOS AM-1) launched on December 18, 1999 and hereafter referred to as Terra MODIS. Flight model-1 (FM1) is onboard the EOS Aqua satellite (formerly EOS PM-1) launched on May 04, 2002 and referred to as Aqua MODIS. MODIS was developed based on the science community s desire to collect multiyear continuous datasets for monitoring changes in the Earth s land, oceans and atmosphere, and the human contributions to these changes. It was designed to measure discrete spectral bands, which includes many used by a number of heritage sensors, and thus extends the heritage datasets to better understand both long- and short-term changes in the global environment (Barnes and Salomonson 1993; Salomonson et al. 2002; Barnes et al. 2002). The MODIS development, launch, and operation were managed by NASA/Goddard Space Flight Center (GSFC), Greenbelt, Maryland. The sensors were designed, built, and tested by Raytheon/ Santa Barbara Remote Sensing (SBRS), Goleta, California. Each MODIS instrument offers 36 spectral bands, which span the spectral region from the visible (0.41 m) to long-wave infrared (14.4 m). MODIS collects data at three different nadir spatial resolutions: 0.25, 0.5, and 1 km. Key design specifications, such as spectral bandwidths, typical scene radiances, required signal-to-noise ratios (SNR) or noise equivalent temperature differences (NEDT), and primary applications of each MODIS spectral band are summarized in Table 7.1. These parameters were the basis for the MODIS design. More details on the evolution of the NASA EOS and development of the MODIS instruments are provided in Chap. 1. This chapter focuses on the MODIS sensor design, radiometry, and geometry as they apply to land remote sensing. With near-daily coverage of the Earth's surface, MODIS provides comprehensive measurements that enable scientists and policy makers to better understand and effectively manage the natural resources on both regional and global scales. Terra, the first large multisensor EOS satellite, is operated in a 10:30 am (local equatorial crossing time, descending southwards) polar orbit. Aqua, the second multisensor EOS satellite is operated in a 1:30 pm (local equatorial crossing time, ascending northwards) polar orbit. With complementing morning and afternoon observations, the Terra and Aqua MODIS, together with other sensors housed on both satellites, have greatly improved our understanding of the dynamics of the global environmental system.

Xiong, Xiaoxiong↗
DOE OSTI2022

Flexible and Accessible 4D Subsurface Visualization Using a Web-Based Platform

4D subsurface visualization using a web platform can provide improved communication, education and outreach to non-experts and stakeholders. It allows for the improved understanding of complex relationships and interactions that occur in inaccessible locations of which many experimental testbeds exist in. The use of a web-based visualization tool lessens the cognitive impact further by reducing the need of specialized software. Users can define their own exploration of a 3D or 4D scene, adding and removing data as needed and are able to make informed decisions based on accurate model visualizations, while providing a collaborative tool that can be accessed on any platform using a browser window. The tool is also able to point to real time streams to display up-to-the-second data as an experiment is ongoing. This level of latency can also provide operators with essential information that can direct an experiment’s progress. Additionally, this tool can leverage augmented and virtual reality (AR, VR) capabilities of certain mobile devices and head-mounted displays, providing further engaging visualization possibilities.

Pratt, Martin J.↗
NASA NTRS1987

Utilizing remote sensing of thematic mapper data to improve our understanding of estuarine processes and their influence on the productivity of estuarine-dependent fisheries

A stochastic spatial computer model addressing coastal resource problems in Lousiana is being refined and validated using thematic mapper (TM) imagery. The TM images of brackish marsh sites were processed and data were tabulated on spatial parameters from TM images of the salt marsh sites. The Fisheries Image Processing Systems (FIPS) was used to analyze the TM scene. Activities were concentrated on improving the structure of the model and developing a structure and methodology for calibrating the model with spatial-pattern data from the TM imagery.

Browder, Joan A.↗
NASA NTRS2024

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part I: Background and Methods

Radiance observations from Earth-observing satellites have a significant positive impact on numerical weather prediction (NWP) forecasts, but some spectral regions are not fully exploited. Observations from hyperspectral infrared (IR) sounders in the longwave region (650-1100 cm -1 ), for instance, are routinely assimilated in many NWP models, but observations in the shortwave region (2155-2550 cm -1 ) are not. Each of these regions provides information on the temperature structure of the atmosphere, but the shortwave IR (SWIR) region is considered challenging to assimilate due to noise equivalent delta temperature (NEDT) that is highly variable depending on scene brightness temperature and to phenomena that are difficult to model, like non-Local Thermodynamic Equilibrium (NLTE) and solar reflectance. With recent advances in small-satellite technology, SWIR temperature sounders may provide an agile and cost-effective complement to the current constellation of IR sounders. Therefore, a better understanding of the use and impact of SWIR observations in data assimilation for NWP is warranted. In part one of this study, as presented here, the amount of unique information (as determined by Empirical Orthogonal Decomposition (EOD)) made available to a data assimilation system by Cross-track Infrared Sounder (CrIS) SWIR observations is reviewed, recent advancements to the Community Radiative Transfer Model (CRTM) for the simulation of CrIS shortwave radiances are tested, and enhancements to NOAA’s Global Data Assimilation System (GDAS) for the assimilation of CrIS SWIR observations are implemented and evaluated. Part two of this study, which seeks to assess the value of assimilating shortwave IR observations in global NWP, is also introduced.

Erin Jones↗
NASA NTRSDate not supplied

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks↗
DOE OSTI2024

Development of a Full-Scale Connected U-Net for Reflectivity Inpainting in Spaceborne Radar Blind Zones

CloudSat’s Cloud Profiling Radar is a valuable tool for remotely monitoring high-latitude snowfall, but its ability to observe hydrometeor activity near the Earth’s surface is limited by a radar blind zone caused by ground clutter contamination. This study presents the development of a deeply supervised U-Net-style convolutional neural network to predict cold season reflectivity profiles within the blind zone at two Arctic locations. The network learns to predict the presence and intensity of near-surface hydrometeors by coupling latent features encoded in blind zone-aloft clouds with additional context from collocated atmospheric state variables (i.e., temperature, specific humidity, and wind speed). Results show that the U-Net predictions outperform traditional linear extrapolation methods, with low mean absolute error, a 38% higher Sørensen–Dice coefficient, and vertical reflectivity distributions 60% closer to observed values. The U-Net is also able to detect the presence of near-surface cloud with a critical success index (CSI) of 72% and cases of shallow cumuliform snowfall and virga with 18% higher CSI values compared to linear methods. An explainability analysis shows that reflectivity information throughout the scene, especially at cloud edges and at the 1.2-km blind zone threshold, along with atmospheric state variables near the tropopause, are the most significant contributors to model skill. This surface-trained generative inpainting technique has the potential to enhance current and future remote sensing precipitation missions by providing a better understanding of the nonlinear relationship between blind zone reflectivity values and the surrounding atmospheric state.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

Overcoming the Critical Shortage of STEM - Prepared Secondary Students Through Modeling and Simulation

In developing understanding of technological systems - modeling and simulation tools aid significantly in the learning and visualization processes. In design courses we sketch , extrude, shape, refine and animate with virtual tools in 3D. Final designs are built using a 3D printer. Aspiring architects create spaces with realistic materials and lighting schemes rendered on model surfaces to create breathtaking walk-throughs of virtual spaces. Digital Electronics students design systems that address real-world needs. Designs are simulated in virtual circuits to provide proof of concept before physical construction. This vastly increases students' ability to design and build complex systems. We find students using modeling and simulation in the learning process, assimilate information at a much faster pace and engage more deeply in learning. As Pre-Engineering educators within the Career and Technical Education program at our school division's Technology Academy our task is to help learners in their quest to develop deep understanding of complex technological systems in a variety of engineering disciplines. Today's young learners have vast opportunities to learn with tools that many of us only dreamed about a decade or so ago when we were engaged in engineering and other technical studies. Today's learner paints with a virtual brush - scenes that can aid significantly in the learning and visualization processes. Modeling and simulation systems have become the new standard tool set in the technical classroom [1-5]. Modeling and simulation systems are now applied as feedback loops in the learning environment. Much of the study of behavior change through the use of feedback loops can be attributed to Stanford Psychologist Alfred Bandura. "Drawing on several education experiments involving children, Bandura observed that giving individuals a clear goal and a means to evaluate their progress toward that goal greatly increased the likelihood that they would achieve it."

Spencer, Thomas↗
NASA NTRSDate not supplied

Future Lightning Instruments for Weather and Climate Monitoring From LEO

Lightning is not only a natural hazard, but it also holds information about physical processes at work in deep convection and influences atmospheric oxidants that modulate ozone and methane. Hence, spaceborne lightning observations are essential for monitoring extreme events and feedbacks in Earth’s climate system. Low-Earth orbiting (LEO) lightning mapping instruments established a 25-year record of global lightning activity and resulted in a wealth of studies that motivated its designation as an Essential Climate Variable by the World Meteorological Organization. Although geostationary observations of lightning have become increasingly available since 2017, LEO lightning mappers continue to serve critical needs given their unique vantage point and acceptance as a unifying reference for geostationary lightning mapper and ground-based global lightning datasets. At the close of 2023, the Lightning Imaging Sensor (LIS) will cease operations on the International Space Station, which introduces a critical gap in LEO-based monitoring of global lightning activity. To address this need, NASA is developing new lightning mapping technology that enables future LEO-based satellite missions. Existing LEO-based lightning mappers rely on narrowband optical emissions centered on 777.4-nm and detectors that capture 500 images per second to detect lightning both day and night. Lightning can also produce optical emissions in a narrowband centered on 337-nm without any corresponding emissions at the traditionally used near-infrared (NIR) wavelength. These near-ultraviolet (UV) emissions are associated with earlier stage electrical breakdown (e.g., streamers), may frequent intense regions of deep convective storms, and may be a significant source of nitrogen oxide production in the upper atmosphere. A new lightning mapping instrument called the CubeSat Lightning Imaging and Detection Experiment (CLIDE) is being designed at NASA Marshall Space Flight Center to use high-speed, scientific CMOS image sensors capable of detecting lightning’s transient optical emissions in the near-UV and NIR during both daylit and nighttime scenes. This will extend the record of global lightning activity and help pave the way for future small satellite missions that combine radio and optical lightning detectors to obtain novel three-dimensional maps of lightning on a global scale, which can revolutionize the way lightning is used to monitor weather and understand changes in climate.

lightning↗
NASA NTRS1994

High spatial resolution telescopic multispectral imaging and spectroscopy of the Moon. 1: The Serenitatis/Tranquillitatis border region

The region of the moon near the border between Mare Serenitatis and Mare Tranquillitatis is one of the most geologically and compositionally complex areas of the nearside. The geologic history of this region has been shaped by impacts of widely-varying spatial scale and temporal occurrence, by volcanism of variable style and composition with time, and by limited tectonism. We have been studying this region as part of a larger multi remote sensing technique effort to understand the composition, morphology, geology, and stratigraphy of the moon at spatial scales of 2 km or less. The effort has been aided by the proximity of this area to the Apollo 11, 15, and 17 landing sites and by the occurrence of one of the primary lunar spectroscopic 'standard areas' within our scene (MS2). Here, some of the findings from the multispectral imaging and spectroscopy part of this effort are reported.

Bell, James F., III↗
NASA NTRS2021

Nonlinear Detector Response of Aqua MODIS Land Imaging Bands

The detectors in Aqua MODIS reflective solar bands (RSB) are calibrated assuming a linear relationship between the observed top-of-atmosphere radiance and the instrument output response. Any non-linear behavior in the system response can contribute to errors in NASA’s Level 1B MODIS reflectance and radiance products, which are used in a wide variety of Earth science applications. While most RSB detectors continue to have very linear behavior even after more than 18 years of operation, we present evidence that the detectors in Aqua MODIS bands 1 (645 nm) and 2 (858 nm) have deviations from gain linearity that change over the mission by up to 3%. We show a clear divergence between gain measurements made with the on-board solar diffuser (SD) at two different radiance levels, achieved by collecting data both with and without an attenuation screen. Radiance trends from lunar calibrations and typical desert and ocean scenes are also compared. We present a simple method to characterize the response non-linearity using a quadratic function by combining the results of the two sets of SD calibrations. Applying this quadratic calibration algorithm to the desert and lunar data results in improved agreement in their long-term radiance trends. A clear understanding of the magnitude of the gain non-linearity could be useful to help improve the quality of numerous MODIS science products, including the land imaging applications that rely heavily on these bands.

MODIS↗
NASA NTRS2017

Precision Projector Laboratory: Detector Characterization with an Astronomical Emulation Testbed

As astronomical observations benefit from improved sensitivity, the effectiveness of scientific programs is becoming limited by systematics that often originate in poorly understood image sensor behavior. Traditional, bottom-up detector characterization methods provide one way to model underlying detector physics, and generate ever more faithful numerical simulations, but this approach is vulnerable to preconceptions and over-simplification. The alternative top-down approach is laboratory emulation, which enables observation, calibration, and analysis scenarios to be tested without relying on a complete understanding of the underlying physics. This complements detector characterization and simulation efforts by testing their validity. We describe a laboratory facility and experimental testbed that supports the emulation of a wide range of mission concepts such as gravitational weak lensing measurements by WFIRST and high precision spectrophotometry of transiting exoplanets by JWST. An Offner relay projects readily customizable "scenes" (e.g. stars, galaxies, spectra) with very low optical aberration over the full area of a typical optical or near infrared image sensor. f/8 and slower focal ratios may be selected, spanning those of most proposed space missions and approximating the point spread function (PSF) size of seeing limited ground based surveys. Diffraction limited PSFs are projected over a wide field of view and wavelength range to deliver highly predictable image patterns down to sub-pixel scales with stable intensity and fine motion control. The testbed enables realistic validation of detector performance on science-like images, which aids mission design and survey strategy, as well as targeted investigations of various detector effects.

Seshadri, Suresh↗
NASA NTRS2020

The Dark Target Algorithm for Observing the Global Aerosol System: Past, Present and Future

The Dark Target aerosol algorithm was developed to exploit the information content available from the observations of Moderate-Resolution Imaging Spectroradiometers (MODIS), to better characterize the global aerosol system. The algorithm is based on measurements of the light scattered by aerosols toward a space-borne sensor against the backdrop of relatively dark Earth scenes, thus giving rise to the name “Dark Target”. Development required nearly a decade of research that included application of MODIS airborne simulators to provide test beds for proto-algorithms and analysis of existing data to form realistic assumptions to constrain surface reflectance and aerosol optical properties. This research in itself played a significant role in expanding our understanding of aerosol properties, even before Terra MODIS launch. Contributing to that understanding were the observations and retrievals of the growing Aerosol Robotic Network (AERONET) of sun-sky radiometers, which has walked hand-in-hand with MODIS and the development of other aerosol algorithms, providing validation of the satellite-retrieved products after launch. The MODIS Dark Target products prompted advances in Earth science and applications across subdisciplines such as climate, transport of aerosols, air quality, and data assimilation systems. Then, as the Terra and Aqua MODIS sensors aged, the challenge was to monitor the effects of calibration drifts on the aerosol products and to differentiate physical trends in the aerosol system from artefacts introduced by instrument characterization. Our intention is to continue to adapt and apply the well-vetted Dark Target algorithms to new instruments, including both polar-orbiting and geosynchronous sensors. The goal is to produce an uninterrupted time series of an aerosol climate data record that begins at the dawn of the 21st century and continues indefinitely into the future.

Aerosol↗
NASA NTRS1976

Optical guidance vidicon test program

A laboratory and field test program was conducted to quantify the optical navigation parameters of the Mariner vidicons. A scene simulator and a camera were designed and built for vidicon tests under a wide variety of conditions. Laboratory tests characterized error sources important to the optical navigation process and field tests verified star sensitivity and characterized comet optical guidance parameters. The equipment, tests and data reduction techniques used are described. Key test results are listed. A substantial increase in the understanding of the use of selenium vidicons as detectors for spacecraft optical guidance was achieved, indicating a reduction in residual offset errors by a factor of two to four to the single pixel level.

Eiseman, A. R.↗
NASA NTRS1989

Modeling, simulation, and analysis of optical remote sensing systems

Remote Sensing of the Earth's resources from space-based sensors has evolved in the past 20 years from a scientific experiment to a commonly used technological tool. The scientific applications and engineering aspects of remote sensing systems have been studied extensively. However, most of these studies have been aimed at understanding individual aspects of the remote sensing process while relatively few have studied their interrelations. A motivation for studying these interrelationships has arisen with the advent of highly sophisticated configurable sensors as part of the Earth Observing System (EOS) proposed by NASA for the 1990's. Two approaches to investigating remote sensing systems are developed. In one approach, detailed models of the scene, the sensor, and the processing aspects of the system are implemented in a discrete simulation. This approach is useful in creating simulated images with desired characteristics for use in sensor or processing algorithm development. A less complete, but computationally simpler method based on a parametric model of the system is also developed. In this analytical model the various informational classes are parameterized by their spectral mean vector and covariance matrix. These class statistics are modified by models for the atmosphere, the sensor, and processing algorithms and an estimate made of the resulting classification accuracy among the informational classes. Application of these models is made to the study of the proposed High Resolution Imaging Spectrometer (HRIS). The interrelationships among observational conditions, sensor effects, and processing choices are investigated with several interesting results.

Kerekes, John Paul↗