Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stereo cameras”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Stereo Cameras for Clouds (STEREOCAM) Instrument Handbook

The three pairs of stereo camera setups aim to provide synchronized and stereo calibrated time series of images that can be used for 3D cloud mask reconstruction. Each camera pair is positioned at approximately 120 degrees from the other pair, with a 17o-19o pitch angle from the ground, and at 5-6 km distance from the U.S. Department of Energy (DOE) Central Facility at the Atmospheric Radiation Measurement (ARM) Climate Research Facility Southern Great Plains (SGP) observatory to cover the region from northeast, northwest, and southern views. Images from both cameras of the same stereo setup can be paired together to obtain 3D reconstruction by triangulation. 3D reconstructions from the ring of three stereo pairs can be combined together to generate a 3D mask from surrounding views. This handbook delivers all stereo reconstruction parameters of the cameras necessary to make 3D reconstructions from the stereo camera images.

47 OTHER INSTRUMENTATION↗

Stereo Camera Deployment in Support of TRACER (Field Campaign Report)

An improved understanding of the salient environmental controls on cloud formation, evolution, and eventual dissipation is critical to address ongoing challenges with cloud process and parameterization representations in global climate and Earth system models. One goal for the recent U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Tracking Aerosol Convection Interactions Experiment (TRACER) campaign was to collect a comprehensive data set that enabled such convective cloud process studies and key demonstrations for those controls that influenced cloud life cycle (i.e., aerosols, thermodynamics) in the Houston, Texas region. To help accomplish this, ARM instrumentation during TRACER was tasked with tracking a large number of individual, isolated convective cells – and to follow the evolution of these cells at high spatiotemporal resolution to characterize changes in cloud dynamic and microphysical properties. Since Houston experiences a range of convective clouds, it was known that the standard ARM Mobile Facility (AMF) instruments may not be sufficient to completely document initiating, transient, or dissipating low- or shallow-cloud behaviors that were also expected during this campaign (in terms of sensitivity, resolution, and/or operational availability). As one partial solution, a supplemental stereo camera deployment (this sub-campaign) was requested to augment the ARM AMF instrumentation to better address shallow and shallow-to-deep transitional types of cloud process drivers during TRACER (ARM stereo cameras for clouds [STEREOCAM]; Romps and Öktem 2018). The primary scientific focus was the relationships between cloud properties and the ambient conditions, which points to several key TRACER science questions including: ‘What is the relationship between cloud size or updraft intensity to the environmental wind shear and/or humidity?’ Overall, the ARM TRACER stereo camera deployment demonstrated unique effectiveness in observing a wide range of critical shallow, congestus, and transitioning or time-evolving cloud characteristics. The data sets from these cameras include information on the clouds' horizontal dimensions, elevations, and depths, while also enabling potential products for cloud initiation and dissipation rates, and vertical velocities. Stereo cameras simultaneously inform on cloud life cycle stage and spatial properties such as cloud fractional coverage, which should provide complementary information for ARM users when combined with TRACER cloud radars, lidar, and/or other profiling sensors. Moreover, camera products offer large-eddy simulation (LES),-scale-appropriate cloud coverage, depth, and spatial variability estimates, while opening additional avenues to challenge difficult process questions on cloud updrafts/entrainment and their covariability with environmental controls such as wind shear and humidity.

47 OTHER INSTRUMENTATION↗

Summertime Continental Shallow Cumulus Cloud Detection Using GOES-16 Satellite and Ground-Based Stereo Cameras at the DOE ARM Southern Great Plains Site

Summertime continental shallow cumulus clouds (ShCu) are detected using Geostationary Operational Environmental Satellite (GOES)-16 reflectance data, with cross-validation by observations from ground-based stereo cameras at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. A ShCu cloudy pixel is identified when the GOES reflectance exceeds the clear-sky surface reflectance by a reflectance detection threshold of ShCu, ΔR. We firstly construct diurnally varying clear-sky surface reflectance maps and then estimate the ΔR. A GOES simulator is designed, projecting the clouds reconstructed by stereo cameras towards the surface along the satellite’s slanted viewing direction. The dynamic ShCu detection threshold ΔR is determined by making the GOES cloud fraction (CF) equal to the CF from the GOES simulator. Although there are temporal variabilities in ΔR, cloud fractions and cloud size distributions can be well reproduced using a constant ΔR value of 0.045. The method presented in this study enables daytime ShCu detection, which is usually falsely reported as clear sky in the GOES-16 cloud mask data product. Using this method, a new ShCu dataset can be generated to bridge the observational gap in detecting ShCu, which may transition into deep precipitating clouds, and to facilitate further studies on ShCu development over heterogenous land surface.

54 ENVIRONMENTAL SCIENCES↗

Retrieving Point Cloud of Cloud Points (PCCP) Value-Added Product from Stereo Cameras

In this report, we refer to a pair of cameras that capture synchronized pictures with overlapping fields of view (FOV) as a stereo pair. Each stereo pair independently performs a stereo reconstruction of cloud points. Currently, there are three U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility stereo pairs (six cameras in total) positioned around the Southern Great Plains (SGP) observatory’s Central Facility (CF; Romps and Oktem 2017). Time-synchronized pictures from the two cameras in a stereo pair can be paired together to obtain a three-dimensional (3D) reconstruction of feature points by triangulation. This document explains how we use ARM stereo cameras and stereophotogrammetric principles to generate the Point Cloud of Cloud Points (PCCP) Value-Added Product (VAP). The PCCP VAP is essentially a set of 3D positions representing the locations of cloud features in the sky. Thousands of cloud features can be reconstructed instantly in each stereo pair's FOV, which covers an area of tens of square kilometers. Cloud base and cloud top heights can be extracted from the PCCP product.

42 ENGINEERING↗

A Stereo Camera Simulator for Large-Eddy Simulations of Continental Shallow Cumulus Clouds Based on Three-Dimensional Path-Tracing

The complex spatial and temporal structure of cumulus clouds complicates their representation in weather and climate models. Classic meteorological instrumentation struggles to fully capture these features. Networks of multiple high-resolution hemispheric cameras are increasingly used to fill this data gap, and provide information on this missing multi-dimensional spatial information. In this study, a path-tracing algorithm is used to generate virtual camera images of resolved clouds in large-eddy simulations (LES). These images are then used as a camera network simulator, allowing reconstructions of three-dimensional cloud edges from the model output. Because the actual LES cloud field is fully known, the combined path-tracing and reconstruction method can be statistically analyzed. The method is applied to LES realizations of summertime shallow cumulus at the Jülich Observatory for Cloud Evolution (JOYCE), Germany, which also routinely operates a camera network. We find that the path-tracing method allows accurate reconstruction of up to 70% of the visible cloud edges. Additional sensitivity tests show that the method is robust for changes in its hyperparameters. The sensitivity to cloud optical thickness is also investigated, finding a cloud boundary placement error of approximately 182 m. This error can be considered typical for cloud boundary reconstruction using real stereo camera imagery. The results provide proof of principle for future use of the method for evaluating LES clouds against camera network imagery, and for further optimizing the configuration of such camera networks.

54 ENVIRONMENTAL SCIENCES↗

Prediction for cloud spacing confirmed using stereo cameras

Using three years of the Clouds Optically Gridded by Stereo (COGS) product, the mean cloud base, cloud top, cloud width, and cloud spacing are described with respect to their seasonal and/or diurnal evolution at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site. In addition to confirming and extending prior results, the data show that the effective diameter of shallow cumuli are approximately equal to the height above ground of the lifting condensation level (LCL). Furthermore, the cloud spacing is found to closely match a prediction by Thuburn and Efstathiou for the horizontal scale of the largest unstable eddies in an unsheared convective boundary layer.

54 ENVIRONMENTAL SCIENCES↗

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗

Sensing Technology Survey for Obstacle Detection in Vegetation

This study reviews obstacle detection technologies in vegetation for autonomous vehicles or robots. Autonomous vehicles used in agriculture and as lawn mowers face many environmental obstacles that are difficult to recognize for the vehicle sensor. This review provides information on choosing appropriate sensors to detect obstacles through vegetation, based on experiments carried out in different agricultural fields. The experimental setup from the literature consists of sensors placed in front of obstacles, including a thermal camera; red, green, blue (RGB) camera; 360° camera; light detection and ranging (LiDAR); and radar. These sensors were used either in combination or single-handedly on agricultural vehicles to detect objects hidden inside the agricultural field. The thermal camera successfully detected hidden objects, such as barrels, human mannequins, and humans, as did LiDAR in one experiment. The RGB camera and stereo camera were less efficient at detecting hidden objects compared with protruding objects. Radar detects hidden objects easily but lacks resolution. Hyperspectral sensing systems can identify and classify objects, but they consume a lot of storage. To obtain clearer and more robust data of hidden objects in vegetation and extreme weather conditions, further experiments should be performed for various climatic conditions combining active and passive sensors.

33 ADVANCED PROPULSION SYSTEMS↗

Pinned Clouds over Industrial Sources of Heat during TRACER

An analysis of stereo-camera data from the Tracking Aerosol Convection Interactions Experiment (TRACER) campaign in Houston, Texas, reveals the existence of pinned clouds sitting atop industrial heat sources. These are not plumes of vapor and condensate emanating from stacks: The pinned shallow cumuli have cloud bases at about the lifting condensation of near-surface air. On many mornings, the pinned clouds are the only shallow cumuli in the field of view of the stereo cameras, persisting by themselves for at least an hour. On those mornings, the lower atmosphere straddles the boundary between stable and unstable, and the waste heat from industrial facilities is able to pin moist convection overhead. When solar heating of the surface becomes sufficient later in the morning, those mornings transition to having widespread shallow moist convection. Occurring within the field of view of the stereo cameras and other TRACER instruments, these pinned clouds represent steady plume-like moist convection triggered by known heat sources in a well-characterized atmosphere, making them a rich target for further study. Significance Statement This article introduces steady-state cumulus clouds observed during the Tracking Aerosol Convection Interactions Experiment (TRACER) campaign that were pinned to industrial heat sources. These pinned clouds were present in the early morning only when conditions were primed for moist convection, but for which there was not yet enough solar heating to trigger widespread convection. They persist in a statistical steady state and therefore provide a natural setting to explore the mechanisms controlling convective dynamics, which play a central role in Earth’s atmospheric circulation and radiative balance.

Atmosphere↗

cogs.c1

COGS is a four-dimensional (4D) map of cloudiness generated by multiview stereo reconstruction using the ARM stereo camera ring at the Southern Great Plains (SGP) atmospheric observatory. These data are particularly useful for studies of the life cycles and macrophysical attributes of shallow cumulus clouds. COGS covers a 6 km x 6 km x 6 km region at the SGP Central Facility centered at the position of the Doppler lidar.

54 ENVIRONMENTAL SCIENCES↗

Predicting 3D Motions from Single-Camera Optical Test Data

In a typical optical test, a stereo camera pair is required to measure the three-dimensional motion of a test article; one camera typically only measures motions in the image plane of the camera, and measurements in the out-of-plane direction are missing. Finite element expansion techniques provide a path to estimate responses from a test at unmeasured degrees of freedom. Treating the case of a single camera as a measurement with unmeasured degrees of freedom, a finite element model is used to expand to the missing third dimension of the image data, allowing a full-field, three-dimensional measurement to be obtained from a set of images from a single camera. The key to this technique relies on the mapping of finite element deformations to image deformations, creating a set of mode shape images that are used to filter the response in the image into modal responses. These modal responses are then applied to the finite element model to estimate physical responses at all finite element model degrees of freedom. The mapping from finite element model to image is achieved using synthetic images produced by a rendering software. Finally, the technique is applied first to a synthetic deformation image, and then is validated using an experimental set of images.

47 OTHER INSTRUMENTATION↗

Summertime Continental Shallow Cumulus Cloud Detection Using GOES‐16 Satellite and Ground‐Based Ceilometer at North Alabama

Abstract Accurate simulations of boundary layer cloud processes remain challenging in Earth system modeling. Observations are essential to evaluate and improve models of such processes. This study introduces a comprehensive validation framework for a satellite‐based detection algorithm of continental shallow cumulus (ShCu) clouds during the daytime, which was initially developed using ground‐based observations of stereo cameras at the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site (J. Tian et al., 2021, https://doi.org/10.3390/rs13122309 , 2022, https://doi.org/10.1029/2021gl097070 ). To validate this algorithm, the framework employs ground‐based ceilometer measurements from North Alabama (NA) where ShCu populations are prevalent. This study first generates clear‐sky surface reflectance maps at NA and identifies ShCu pixels with a detection threshold using Geostationary Operational Environmental Satellite (GOES) reflectance data. The obtained cloud fractions (CFs) are then compared against CFs from a ground‐based ceilometer, considering factors such as observed area differences, satellite parallax issue, and systematic biases. We found that with a detection threshold (∆R) of 0.05, the ShCu detection algorithm is effective for NA, enabling the reproduction of hourly ShCu CFs using GOES. Our framework is straightforward and easily repeatable to evaluate the effectiveness of a ∆R threshold for detecting ShCu clouds in various geographic regions where ceilometers are deployed. This satellite detection of ShCu provides a crucial regional context for ground‐based measurements, facilitating the tracking of convection initiation and its coupling with land surface conditions. Integrating localized ground‐based and regional satellite data will enhance our ability to conduct thorough studies of cloud morphology and land‐atmosphere interactions in North Alabama.

54 ENVIRONMENTAL SCIENCES↗

On the Life Cycle of a Shallow Cumulus Cloud: Is It a Bubble or Plume, Active or Forced?

Abstract A cloud’s life cycle determines how its mass flux translates into cloud cover, thereby setting Earth’s albedo. Here, an attempt is made to quantify the most basic aspects of the life cycle of a shallow cumulus cloud: the degree to which it is a bubble or a plume, and active or forced. Quantitative measures are proposed for these properties, which are then applied to hundreds of shallow cumulus clouds in Oklahoma using data from stereo cameras, a Doppler lidar, and large-eddy simulations. The observed clouds are intermediate between active and forced, but behave more like bubbles than plumes. The simulated clouds, on the other hand, are more active and plumelike, suggesting room for improvement in the modeling of shallow cumulus.

54 ENVIRONMENTAL SCIENCES↗

Market Survey of Airborne Small Unmanned Aircraft System Sensors February 2020

Sensors continue to decrease in size and power. This report presents results of a market survey conducted in February 2020 for commercial off-the-self sensors with optimal size, weight, and power to be carried onboard a small unmanned aircraft system. For this report, Sandia National Laboratories considered sensors that can detect an object in three dimensions. The sensors that were researched are broken into three categories: radio detection and ranging sensors, stereo camera sensors, and light detection and ranging sensors.

47 OTHER INSTRUMENTATION↗

TEAMER - Field Demonstration of MarineSitu’s Marine Energy Monitoring Tools - CRADA 664 (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER↗

TEAMER – Field Demonstration of MarineSitu’s Marine Energy Monitoring (Abstract)

In order to effectively monitor for marine life around marine energy devices and thus minimize the risk of collision, multiple sensors working in coordination and augmented with around-the-clock automated monitoring algorithms need to be installed in challenging high-energy tidal and wave environments. Such systems are often too expensive for widespread adoption, or lack sufficient sensors or smarts to enable around-the-clock, real-time monitoring without human involvement. MarineSitu has been working to tackle this problem by developing a low-cost, combined sonar and stereo camera sensor array with connected real-time AI-based algorithms for automatically detecting marine life in these marine energy suitable environments. In this TEAMER project with Pacific Northwest National Lab (PNNL), MarineSitu will be testing this novel sensor system for the first time in the high-energy tidal channel environment at PNNL’s Marine and Coastal Research Lab. Throughout this deployment, MarineSitu will be monitoring their system and running analytics on the sensor’s data in real-time. Meanwhile, PNNL Data Scientists and Ocean Engineers, will be evaluating the system’s effectiveness and ease of use both as a tool for plug-and-play environmental monitoring and novel environmental monitoring research. In doing so, the team will improve MarineSitu’s system and software, produce insightful data products, and develop novel visualizations and AI algorithms for combining and analyzing the data produced by systems like MarineSitu’s.

16 TIDAL AND WAVE POWER↗