Search NASA⌕ Search

SEARCH · Search NASA

Results for “stereo camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Stereo Cameras for Clouds (STEREOCAM) Instrument Handbook

The three pairs of stereo camera setups aim to provide synchronized and stereo calibrated time series of images that can be used for 3D cloud mask reconstruction. Each camera pair is positioned at approximately 120 degrees from the other pair, with a 17o-19o pitch angle from the ground, and at 5-6 km distance from the U.S. Department of Energy (DOE) Central Facility at the Atmospheric Radiation Measurement (ARM) Climate Research Facility Southern Great Plains (SGP) observatory to cover the region from northeast, northwest, and southern views. Images from both cameras of the same stereo setup can be paired together to obtain 3D reconstruction by triangulation. 3D reconstructions from the ring of three stereo pairs can be combined together to generate a 3D mask from surrounding views. This handbook delivers all stereo reconstruction parameters of the cameras necessary to make 3D reconstructions from the stereo camera images.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Stereo Camera Deployment in Support of TRACER (Field Campaign Report)

An improved understanding of the salient environmental controls on cloud formation, evolution, and eventual dissipation is critical to address ongoing challenges with cloud process and parameterization representations in global climate and Earth system models. One goal for the recent U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Tracking Aerosol Convection Interactions Experiment (TRACER) campaign was to collect a comprehensive data set that enabled such convective cloud process studies and key demonstrations for those controls that influenced cloud life cycle (i.e., aerosols, thermodynamics) in the Houston, Texas region. To help accomplish this, ARM instrumentation during TRACER was tasked with tracking a large number of individual, isolated convective cells – and to follow the evolution of these cells at high spatiotemporal resolution to characterize changes in cloud dynamic and microphysical properties. Since Houston experiences a range of convective clouds, it was known that the standard ARM Mobile Facility (AMF) instruments may not be sufficient to completely document initiating, transient, or dissipating low- or shallow-cloud behaviors that were also expected during this campaign (in terms of sensitivity, resolution, and/or operational availability). As one partial solution, a supplemental stereo camera deployment (this sub-campaign) was requested to augment the ARM AMF instrumentation to better address shallow and shallow-to-deep transitional types of cloud process drivers during TRACER (ARM stereo cameras for clouds [STEREOCAM]; Romps and Öktem 2018). The primary scientific focus was the relationships between cloud properties and the ambient conditions, which points to several key TRACER science questions including: ‘What is the relationship between cloud size or updraft intensity to the environmental wind shear and/or humidity?’ Overall, the ARM TRACER stereo camera deployment demonstrated unique effectiveness in observing a wide range of critical shallow, congestus, and transitioning or time-evolving cloud characteristics. The data sets from these cameras include information on the clouds' horizontal dimensions, elevations, and depths, while also enabling potential products for cloud initiation and dissipation rates, and vertical velocities. Stereo cameras simultaneously inform on cloud life cycle stage and spatial properties such as cloud fractional coverage, which should provide complementary information for ARM users when combined with TRACER cloud radars, lidar, and/or other profiling sensors. Moreover, camera products offer large-eddy simulation (LES),-scale-appropriate cloud coverage, depth, and spatial variability estimates, while opening additional avenues to challenge difficult process questions on cloud updrafts/entrainment and their covariability with environmental controls such as wind shear and humidity.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Summertime Continental Shallow Cumulus Cloud Detection Using GOES-16 Satellite and Ground-Based Stereo Cameras at the DOE ARM Southern Great Plains Site

Summertime continental shallow cumulus clouds (ShCu) are detected using Geostationary Operational Environmental Satellite (GOES)-16 reflectance data, with cross-validation by observations from ground-based stereo cameras at the Department of Energy Atmospheric Radiation Measurement Southern Great Plains site. A ShCu cloudy pixel is identified when the GOES reflectance exceeds the clear-sky surface reflectance by a reflectance detection threshold of ShCu, ΔR. We firstly construct diurnally varying clear-sky surface reflectance maps and then estimate the ΔR. A GOES simulator is designed, projecting the clouds reconstructed by stereo cameras towards the surface along the satellite’s slanted viewing direction. The dynamic ShCu detection threshold ΔR is determined by making the GOES cloud fraction (CF) equal to the CF from the GOES simulator. Although there are temporal variabilities in ΔR, cloud fractions and cloud size distributions can be well reproduced using a constant ΔR value of 0.045. The method presented in this study enables daytime ShCu detection, which is usually falsely reported as clear sky in the GOES-16 cloud mask data product. Using this method, a new ShCu dataset can be generated to bridge the observational gap in detecting ShCu, which may transition into deep precipitating clouds, and to facilitate further studies on ShCu development over heterogenous land surface.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Retrieving Point Cloud of Cloud Points (PCCP) Value-Added Product from Stereo Cameras

In this report, we refer to a pair of cameras that capture synchronized pictures with overlapping fields of view (FOV) as a stereo pair. Each stereo pair independently performs a stereo reconstruction of cloud points. Currently, there are three U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility stereo pairs (six cameras in total) positioned around the Southern Great Plains (SGP) observatory’s Central Facility (CF; Romps and Oktem 2017). Time-synchronized pictures from the two cameras in a stereo pair can be paired together to obtain a three-dimensional (3D) reconstruction of feature points by triangulation. This document explains how we use ARM stereo cameras and stereophotogrammetric principles to generate the Point Cloud of Cloud Points (PCCP) Value-Added Product (VAP). The PCCP VAP is essentially a set of 3D positions representing the locations of cloud features in the sky. Thousands of cloud features can be reconstructed instantly in each stereo pair's FOV, which covers an area of tens of square kilometers. Cloud base and cloud top heights can be extracted from the PCCP product.

42 ENGINEERING↗
DOE OSTI2024

A Stereo Camera Simulator for Large-Eddy Simulations of Continental Shallow Cumulus Clouds Based on Three-Dimensional Path-Tracing

The complex spatial and temporal structure of cumulus clouds complicates their representation in weather and climate models. Classic meteorological instrumentation struggles to fully capture these features. Networks of multiple high-resolution hemispheric cameras are increasingly used to fill this data gap, and provide information on this missing multi-dimensional spatial information. In this study, a path-tracing algorithm is used to generate virtual camera images of resolved clouds in large-eddy simulations (LES). These images are then used as a camera network simulator, allowing reconstructions of three-dimensional cloud edges from the model output. Because the actual LES cloud field is fully known, the combined path-tracing and reconstruction method can be statistically analyzed. The method is applied to LES realizations of summertime shallow cumulus at the Jülich Observatory for Cloud Evolution (JOYCE), Germany, which also routinely operates a camera network. We find that the path-tracing method allows accurate reconstruction of up to 70% of the visible cloud edges. Additional sensitivity tests show that the method is robust for changes in its hyperparameters. The sensitivity to cloud optical thickness is also investigated, finding a cloud boundary placement error of approximately 182 m. This error can be considered typical for cloud boundary reconstruction using real stereo camera imagery. The results provide proof of principle for future use of the method for evaluating LES clouds against camera network imagery, and for further optimizing the configuration of such camera networks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Prediction for cloud spacing confirmed using stereo cameras

Using three years of the Clouds Optically Gridded by Stereo (COGS) product, the mean cloud base, cloud top, cloud width, and cloud spacing are described with respect to their seasonal and/or diurnal evolution at the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site. In addition to confirming and extending prior results, the data show that the effective diameter of shallow cumuli are approximately equal to the height above ground of the lifting condensation level (LCL). Furthermore, the cloud spacing is found to closely match a prediction by Thuburn and Efstathiou for the horizontal scale of the largest unstable eddies in an unsheared convective boundary layer.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Confronting Large‐Eddy Simulations With Stereo Camera Data by Means of Reconstructed Hemispheric Cloud Size Distributions

High-resolution hemispheric camera images at a meteorological site in western Germany are used to analyze the multi-dimensional spatial characteristics of continental cumulus cloud fields, and to evaluate Large-Eddy Simulations on this aspect. Traditional non-hemispheric cloud-detecting instruments provide additional reference data. The main model-observation comparison focuses on cloud size distributions (CSDs), employing two methods: (a) directly using three-dimensional model fields, direct CSDs, and (b) using rendered hemispheric images of the model fields as produced by a camera simulator based on path-tracing. In the latter method, both the real and rendered images are used to three-dimensionally reconstruct the cloud fields, yielding hemispheric CSDs. Advantages of hemispheric comparisons over more classic approaches include (a) fair comparisons between model and data, and (b) full use of the enhanced resolutions and hemispheric spatial coverage of the camera imagery. Basic evaluation of the simulations demonstrates good agreement on thermodynamic structure and its diurnal cycle. Cloud heights and cloud cover are intercompared between the model, camera data and other instrumentation, providing insight into their structural differences. A consistent alignment is found between the hemispheric CSDs from both the model and the cameras. Power law fits reveal structurally lower exponents in hemispheric CSDs compared to non-hemispheric CSDs, which particularly caution against directly comparing hemispheric CSDs to non-hemispheric distributions. This result is robust for sample size and fitting method. These findings inform future use of hemispheric camera systems for studying cumulus cloud field morphology and model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Point Cloud of Cloud Points PCCP from CACTI Stereo Cameras

The Point Cloud of Cloud Points (PCCP) data set is composed of 3D coordinates describing the position of cloud features and images from which these coordinates are reconstructed. Images are captured in the daytime by two ARM cloud digital cameras (ACDCs) at CACTI S4a and S4b sites, at 20-second intervals. The two cameras are located at 32.1274oS,64.7139oW, and 32.1185oS, 64.7237oW. The 3D positions are detected with respect to the AMF base location at 32.1264oS, 64.7284oW, and 1141 m above sea level. The PCCP data format is the same as explained in PCCP VAP Technical Report.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Sensing Technology Survey for Obstacle Detection in Vegetation

This study reviews obstacle detection technologies in vegetation for autonomous vehicles or robots. Autonomous vehicles used in agriculture and as lawn mowers face many environmental obstacles that are difficult to recognize for the vehicle sensor. This review provides information on choosing appropriate sensors to detect obstacles through vegetation, based on experiments carried out in different agricultural fields. The experimental setup from the literature consists of sensors placed in front of obstacles, including a thermal camera; red, green, blue (RGB) camera; 360° camera; light detection and ranging (LiDAR); and radar. These sensors were used either in combination or single-handedly on agricultural vehicles to detect objects hidden inside the agricultural field. The thermal camera successfully detected hidden objects, such as barrels, human mannequins, and humans, as did LiDAR in one experiment. The RGB camera and stereo camera were less efficient at detecting hidden objects compared with protruding objects. Radar detects hidden objects easily but lacks resolution. Hyperspectral sensing systems can identify and classify objects, but they consume a lot of storage. To obtain clearer and more robust data of hidden objects in vegetation and extreme weather conditions, further experiments should be performed for various climatic conditions combining active and passive sensors.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Pinned Clouds over Industrial Sources of Heat during TRACER

An analysis of stereo-camera data from the Tracking Aerosol Convection Interactions Experiment (TRACER) campaign in Houston, Texas, reveals the existence of pinned clouds sitting atop industrial heat sources. These are not plumes of vapor and condensate emanating from stacks: The pinned shallow cumuli have cloud bases at about the lifting condensation of near-surface air. On many mornings, the pinned clouds are the only shallow cumuli in the field of view of the stereo cameras, persisting by themselves for at least an hour. On those mornings, the lower atmosphere straddles the boundary between stable and unstable, and the waste heat from industrial facilities is able to pin moist convection overhead. When solar heating of the surface becomes sufficient later in the morning, those mornings transition to having widespread shallow moist convection. Occurring within the field of view of the stereo cameras and other TRACER instruments, these pinned clouds represent steady plume-like moist convection triggered by known heat sources in a well-characterized atmosphere, making them a rich target for further study. Significance Statement This article introduces steady-state cumulus clouds observed during the Tracking Aerosol Convection Interactions Experiment (TRACER) campaign that were pinned to industrial heat sources. These pinned clouds were present in the early morning only when conditions were primed for moist convection, but for which there was not yet enough solar heating to trigger widespread convection. They persist in a statistical steady state and therefore provide a natural setting to explore the mechanisms controlling convective dynamics, which play a central role in Earth’s atmospheric circulation and radiative balance.

Atmosphere↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Remote 3D Mapping Sensor Suite

The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. When looking for a sensor that would provide XYZ point cloud data for mapping the decision was between a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The selection between Lidars is detailed. The Hokuyo UTM-30LX-EW shown provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg.. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. The rotating planar scan from the 2D Lidar can be stitched into a 3D scan as shown in the graphic below. Along with XYZ data, the Lidar provides return intensity data in color which can be used to distinguish between different materials within the tunnel. To provide visual feedback a camera system needed to be identified. The common solution for this is a high resolution camera with a small FOV mounted on a pan-tilt system. But, given the critical nature of the visual feedback we looked into solutions without the need for moving parts. Two panospheric cameras give a FOV large enough to get a full 360 deg. view.. Camera color data (RGB) can also be combined with the 3D mapping data from the Lidar and overlaid on the map to give the user the ability to see inside the entire length of the tunnel as if they were inside. Situational awareness is required for the crawler in the tunnel in order for it to be able to register the 3D scans to create a final map. For this we procured a Microstrain 3DM-GX5-25 Inertial Measurement Unit (IMU). To perform the Lidar rotation we have two servos driving the pan and tilt. The servo controls and most data processing will be performed via an onboard computer. The sensor components are to be packaged together using 3D printed mounts into a standalone unit.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

R and DE Robotic Sensor Intern Team: Advanced Sensor Suite Prototype

The Department of Energy (DOE) nuclear complex includes many hazardous and challenging environments that must be inspected remotely and routinely for structural integrity evaluation and long-term planning purposes. The H-Canyon Air Exhaust (HCAEX) Tunnel is an example of such an environment where a biannual inspection is currently performed. Presently inspections are performed by teleoperated robotic crawlers which provide low-res video feedback to the structural engineers. Advanced sensors: including Lidar and panospheric hi-res cameras have the potential to provide additional valuable data in future inspections. The primary goal of the sensor suite is to provide an internal 3D map of the HCAEX tunnel. Possible sensors were a stereo camera, a 3D Lidar, or a 2D Lidar that would need to be spun around. The issues with the stereo camera were that it does not have a large field-of-view and that its depth information was not nearly as accurate as even the baseline Lidars. The Hokuyo UTM-30LX-EW shown below provides a 270 deg. FOV with high accuracy and resolution while the largest FOV on a 3D Lidar is 40 deg. This was the reason a 2D Lidar was chosen over the 3D Lidar. Even though the 2D Lidar requires additional components and software to generate a 3D map, its FOV advantage is too great given that the HCAEX tunnel is a relatively confined space. Along with the Lidar, a camera sensor, IMU sensor, pan-tit unit, and on board computer needed to be identified. The two panospheric cameras allow for full 360 deg. FOV. The IMU will give data on the state of the robot inside the tunnel. The computer is used to gather and process data on board and to control the pan-tilt system. Mounts were designed and 3D printed to build the prototype of the sensor suite. It was designed to have the Lidar on top With its full FOV free while having the camera below and as close to together as possible while still leaving much of their FOV visible. The design also managed the cables such that they were unlikely to be damaged if in tension and so that they did not intrude much on the cameras vision. The sensor tree developed for the H-Canyon tunnel inspection project produces a large quantity of camera and Lidar data. a postprocessing pipeline was created to facilitate the analysis of these data. The pipeline follows the following routine: 1) Registration - Salient local features in subsequent scans are identified and used to align the scans With one another. This allows production of a single cohesive map of the tunnel. 2) Sensor Fusion - RGB camera data is 'painted' onto the depth data created by the Lidar. 3) Segmentation - Individual surfaces from within the scene are segmented out separately for individual analysis. 4) Degradation Analysis - Automatic mapping of local deviation from the plane in position or surface normal is performed, as is detection of exposed rebar using Lidar return intensity. 2) Obstacle Detection - Lidar data is also used in real time to detect obstacles in the environment. This could give feedback to the operator to successfully drive in the tunnel. 6) Graphic User Interface - a custom GUI was created to facilitate customer use of the system. The system provides real-time feedback from both the cameras and Lidar. The Lidar point-cloud data is also used for obstacle detection. As the Lidar spins, various algorithms are run to analyze the current 'slice' and obstacles in the environment are determined and registered on a cost-map. A Graphical User Interface (GUI) was developed to allow the user to easily command the crawler to set the rotational speed of the Lidar, perform a scan, and register and save the 3D generated cloud after a scan is done. For the good of the crawler, a critical aspect of the GUI design is to allow the user to cancel a scan any time after it is commanded and before it is saved. The sensor trees depth accuracy was evaluated in comparison to a high end commercial FARO Terrestrial Laser Scanner (TLS) with specifications for millimeter accuracy at distances above 10 m. For the purposes of these tests, the depth measurements produced by the TLS were taken as ground truth. Example test wall panels were scanned with the TLS and postprocessed with its proprietary software, and subsequently scanned with the sensor tree system. The two scans were manually aligned and for each point in the output cloud from the sensor tree, the distance to the nearest ground truth point in the FARO cloud was determined. 98.7% of all produced points were within the specified target range of 6 mm, with an average deviation of 1.75 mm. The test walls used have an overall in-wall depth variation of around 40 mm.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

cogs.c1

COGS is a four-dimensional (4D) map of cloudiness generated by multiview stereo reconstruction using the ARM stereo camera ring at the Southern Great Plains (SGP) atmospheric observatory. These data are particularly useful for studies of the life cycles and macrophysical attributes of shallow cumulus clouds. COGS covers a 6 km x 6 km x 6 km region at the SGP Central Facility centered at the position of the Doppler lidar.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Southern Great Plains (SGP) Three-Dimensional Observations of Fair-Weather Cumuli Field Campaign Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Southern Great Plains (SGP) Three-Dimensional (3D) Observations of Fair-Weather Cumuli (SGP3DOBS) experiment employed scanning Doppler lidar and the recently installed stereo camera ring to conduct a one-month intensive operational period (IOP) of fair-weather cumuli in a 3D domain at the ARM SGP Central Facility (CF). The SGP3DOBS is part of the Climate Model Development and Validation (CMDV) “Coupling Mechanistically the Convective Motions and Cloud Macrophysics in a Climate Model” (CM4) project and provides advanced observational analyses for improving physical understanding of shallow cumulus and supporting model parameterization evaluation. For the CM4 project, cloud macroscale and dynamical properties are determined using vertically pointing active remote-sensing measurements (e.g., lidar and radar), which provide a 2D view of fair-weather cumuli (FWC). It is critical to evaluate how well the 2D observations represent 3D cloud fields. The objectives of SGP3DOBS include: 1) evaluate the 3D gridded cloud field from stereo photogrammetry with scanning Doppler lidar measurements; 2) retrieve sub-cloud-layer turbulence (vertical velocity and mass flux) in a 3D domain; 3) estimate shallow cumulus lateral entrainment rate and its relation to environment conditions. The SGP3DOBS IOP was held at the SGP Central Facility from August 31 to September 30, 2017, as the fair-weather nonprecipitating shallow cumuli are prevalent during summertime over land (Lamer and Kollias, 2015). A weather forecast team conducted a short-range forecast of weather conditions in the early morning each day to determine whether it was favorable for FWC. For each IOP day, the Doppler lidar at the SGP Central Facility ran under the range height indicator (RHI) scanning mode in the cross-wind direction. Occasionally, plan position indicator (PPI) scanning mode was run for updated wind directions. During each RHI scanning, the Doppler lidar run continuously between 30- and 150-degree elevation angles. The scanning rate was approximately 10 degree/s, corresponding to a transverse resolution of 111 m at 2 km of a typical FWC height. The newly established three pairs of stereo cameras ran concurrently during the IOP.

Southern Great Plains, Doppler lidar, fair-weather↗
DOE OSTI2020

Predicting 3D Motions from Single-Camera Optical Test Data

In a typical optical test, a stereo camera pair is required to measure the three-dimensional motion of a test article; one camera typically only measures motions in the image plane of the camera, and measurements in the out-of-plane direction are missing. Finite element expansion techniques provide a path to estimate responses from a test at unmeasured degrees of freedom. Treating the case of a single camera as a measurement with unmeasured degrees of freedom, a finite element model is used to expand to the missing third dimension of the image data, allowing a full-field, three-dimensional measurement to be obtained from a set of images from a single camera. The key to this technique relies on the mapping of finite element deformations to image deformations, creating a set of mode shape images that are used to filter the response in the image into modal responses. These modal responses are then applied to the finite element model to estimate physical responses at all finite element model degrees of freedom. The mapping from finite element model to image is achieved using synthetic images produced by a rendering software. Finally, the technique is applied first to a synthetic deformation image, and then is validated using an experimental set of images.

47 OTHER INSTRUMENTATION↗
DOE OSTI2018

Observing clouds in 4D with multi-view stereo photogrammetry

We report that newly installed stereo cameras ringing the Southern Great Plains (SGP) Atmospheric Radiation Measurement (ARM) site in Oklahoma are providing a 4D gridded view of shallow clouds. Six digital cameras have been installed in pairs at a distance of 6 kilometers from the site and with a spacing of 500 meters between cameras in a pair. These pairs of cameras provide stereoscopic views of shallow clouds from all sides; when these data are combined, they allow for a complete stereo reconstruction. The result – the Clouds Optically Gridded by Stereo (COGS) product – is a 4D grid of cloudiness covering a 6 km × 6 km × 6 km cube at a spatial resolution of 50 meters and a temporal resolution of 20 seconds. This provides an unprecedented set of data on the sizes, lifetimes, and lifecycles of shallow clouds. Lastly, this type of information is critical for developing cloud macrophysical schemes for the next generation of weather and climate models.

47 OTHER INSTRUMENTATION↗