Search NASA⌕ Search

SEARCH · Search NASA

Results for “digital cameras”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Review of High‐Speed Digital Image Correlation: Advancements and Good Practices

This paper reviews the current state of the art in high‐speed (HS) and ultrahigh‐speed (UHS) digital image correlation (DIC) techniques, emphasizing their critical role in experimental research across various scientific domains. HS and UHS DIC have evolved significantly, driven by advancements in camera systems, image processing algorithms and experimental methodologies. These developments have opened new avenues for capturing and analysing dynamic events with unprecedented temporal and spatial detail, but not without introducing challenges such as optical distortions, motion blur and lighting issues that can affect measurement quality. This review advocates for standardized reporting practices in HS/UHS DIC methodologies to improve reproducibility and reliability across studies, drawing on guidelines from the International Digital Image Correlation Society (iDICs). Through a comprehensive analysis of over 150 articles, this review identifies key advancements in imaging technology and their application in six research domains: material characterization, test development, fracture mechanics, model validation, ballistic and explosive phenomena assessment and measurement uncertainties. Distinctions between two‐dimensional (2D) and stereo‐DIC applications are explored, offering insights into their practical implementation and trade‐offs. Good practices for HS/UHS DIC applications are proposed along with suggestions for future directions for this evolving field, highlighting the indispensable role of technological innovation in expanding the capabilities of optical metrology.

experimental mechanics↗

Infrastructure-Based Cooperative Perception at a Traffic Intersection: Overview and Challenges

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. About one-quarter of traffic fatalities and about one-half of all traffic injuries in the United States happen at traffic intersections . Effective management of these intersections is important to ensure safety and efficiency of all users - vehicles, pedestrians, cyclists, and vulnerable road users (VRUs). With advancements in sensor perception technologies such as radar, light detection and ranging (lidar), and cameras, traffic intersections are developing into dynamic and data-rich environments. By using these data to create a real-time digital twin, we can enable real-time data-driven decision making and a range of applications such as sharing perception information to connected vehicles (CVs) and connected autonomous vehicles (CAVs), safety affirmative signaling, and curb optimizing to improve efficiency and enhance safety.This paper presents an overview of the concept and examines the challenges involved in implementing an infrastructure-based cooperative perception engine at a traffic intersection. In addition to outlining the physical components, this study also addresses important challenges involved in a multi-sensor system. We present results from deploying the National Renewable Energy Laboratory's (NREL's) Infrastructure Perception and Control (IPC) mobile trailer at a traffic intersection in the city of Colorado Springs, Colorado, USA that employed multiple radars and lidars to capture the data. This study provides necessary practical learning for the Cooperative Driving Automation (CDA) and traffic engineering communities for next-generation infrastructure-based cooperative perception that promises improvements in signal control for optimized traffic flow, among other applications, and documents findings for ongoing research and development efforts in other areas.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Regional surrogates for predictive control of digital twins

Digital twins of complex systems must involve a model that is fast, generalizable, and usable for real-time control. For example, high-fidelity nonlinear multiphysics simulations can capture laser-material interactions, but are too slow for optimization or model predictive control (MPC). Reduced-order models, used to accelerate such computation, frequently fail to generalize to unseen inputs or control states. We show theoretically that this failure is intrinsic, i.e., that a learned model is non-unique outside the sampled subspace when its low-rank structure arises from limited excitation and clustered eigenvalues, rather than from a user-imposed truncation alone. Motivated by this result, we propose a control-ready regional surrogate-construction framework for both autonomous and nonautonomous dynamics; it employs Koopman lifting to represent nonlinearities, while preserving spatial locality. We illustrate our approach by constructing a control-ready surrogate for the digital twin of a thermal component of additive-manufacturing process. Our surrogate, localized in space through a von Neumann stencil, is learned from noisy high-fidelity simulations that emulate thermal-camera images collected during the manufacturing. It is linear in thermo-physically augmented states so that MPC reduces to a convex quadratic program. The surrogate requires no online correction, generalizes to unseen scan paths and power profiles of the laser, and is more than three orders of magnitude faster than a finite-difference solver. Furthermore, when the MPC sequence computed on the digital twin is applied to this solver, closed-loop temperature regulation is recovered, showing that the surrogate preserves control-relevant input-output behavior.

Data-driven model↗

Surface elevation, snow depth, vegetation height, and color imagery from multiple UAV surveys from 2018 to 2023 across a watershed near Teller road mile marker 27, Seward Peninsula, Alaska

Multiple photogrammetric surveys using an unoccupied aerial system (UAS) were performed across a watershed along Teller road on the Seward Peninsula (Alaska) to investigate terrain, vegetation and snowpack properties. This work was led by the environmental geophysics team from Lawrence Berkeley National Laboratory as part of the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic). The multiple photogrammetric surveys used mostly a DJI Matrice 210 UAS with a DJI X5S camera, Ground Control Points (GCPs) surveyed with a Real Time Kinematic (RTK)-GPS, and a structure from motion (SfM) technique for photogrammetric reconstruction. Digital Surface elevation Models (DSMs) were inferred at various times of year, including near peak in plant and leaf density (July 19 2017), close to peak in snow depth (April 1 2019 and April 11 2022), and at low plant and leaf density of tall after the first bare-ground date (June 9 2019). Snow and canopy height were obtained by subtracting DSMs from a Digital Terrain Model (DTM) proxy inferred from the June 9 2019 survey. The derived products include ortho-mosaiced RGB map, DSMs, a DTM proxy, snow depth (April 2019 and 2022) and canopy height (July 2017). Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.csv), image (*.jpg), and GeoTiff (*.tif) formats. This metadata document contains a description of the survey and processing steps and the inferred products.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Neural Learning Based Blind Source Separation for Detection of Material Defects in Pulsed Thermography Images

In this paper, we introduce a neural learning-based approach to blind source separation for detection of material flaws in pulsed thermography (PT) images. This approach can be used to detect internal defects (pores) in metallic Additively Manufactured (AM) materials. Such defects occur in high-strength alloys produced with direct laser sintering AM method for nuclear energy applications. Pulsed thermal imaging system utilizes a high intensity flash lamp to rapidly heat surface of sample, a high sensitivity infrared camera to capture data of surface temperature variations. The data cube obtained with PT (stack of surface temperature images at different times) can be analyzed with image processing algorithms to detect material defects. Compared with conventional nondestructive evaluation (NDE) methods, such as digital radiography and ultrasonic testing, the PT pulsed infrared thermal detection technique has advantages of one-sided non-contact measurements, fast processing of large sample areas captured in one image. Detection of small material defects requires finding features in thermal images, which have signal contrast levels approaching sensitivity limit of IR camera. In this study, an optimized Neural Learning based Blind Source Separation (NLBSS) algorithm, including Principal Component Analysis (PCA), and Independent Component Analysis (ICA) is demonstrated to automatically extract principal temporal and spatial features of thermography frames to enhance flaw detection. By using the NLBSS algorithm, material internal defects can be automatically detected. Furthermore, this processing approach compensates for experimental thermal imaging artifacts, such as noise and uneven heating. By merging artificial intelligence with the photothermic, the NDE system detects internal calibrated defects of various sizes and depths in AM nuclear-grade metallic alloys.

Zhang, Xin↗

Optical Imaging for Machine Vision [Slides]

This slide deck is intended for proper specification and procurement of cameras and (thin) lenses for machine vision applications. This will include equations that allow one to calculate image size, field of view, depth of field, and length of extension tubes required to focus the image. This requires knowledge of the camera sensor, lens, distance to imaged object, and visual acuity.

42 ENGINEERING↗

Analyzing the Validity of Brazilian Testing Using Digital Image Correlation and Numerical Simulation Techniques

Characterizing the mechanical behavior of rocks plays a crucial role to optimize the fracturing process in unconventional reservoirs. However, due to the intrinsic anisotropy and heterogeneity in unconventional resources, fracture process prediction remains the most significant challenge for sustainable and economic hydrocarbon production. During the deformation tracking under compression, deploying conventional methods (strain gauge, extensometer, etc.) is insufficient to measure the deformation since the physical attachment of the device is restricted to the size of the sample, monitoring limited point-wise deformation, producing difficulties in data retrieval, and a tendency to lose track in failure points, etc. Where conventional methods are limited, the application of digital image correlation (DIC) provides detailed and additional information of strain evolution and fracture patterns under loading. DIC is an image-based optical method that records an object with a camera and monitors the random contrast speckle pattern painted on the facing surface of the specimen. To overcome the existing limitations, this paper presents numerical modeling of Brazilian disc tests under quasi-static conditions to understand the full-field deformation behaviors and finally, it is validated by DIC. As the direct tensile test has limitations in sample preparation and test execution, the Brazilian testing principle is commonly used to evaluate indirectly the tensile strength of rocks. The two-dimensional numerical model was built to predict the stress distribution and full-field deformation on Brazilian disc under compression based on the assumptions of a homogenous, isotropic and linear elastic material. The uniaxial compression test was conducted using the DIC technique to determine the elastic properties of Spider Berea sandstone, which were used as inputs for the simulation model. The model was verified by the analytical solution and compared with the digital image correlation. The numerical simulation results showed that the solutions matched reasonably with the analytical solutions where the maximum deviation of stress distribution was obtained as 14.59%. The strain evolution (normal and shear strains) and displacements along the central horizontal and vertical planes were investigated in three distinguishable percentages of peak loads (20%, 40%, and 90%) to understand the deformation behaviors in rock. The simulation results demonstrated that the strain evolution contours consistently matched with DIC generated contours with a reasonable agreement. The changes in displacement along the central horizontal and vertical planes showed that numerical simulation and DIC generated experimental results were repeatable and matched closely. In terms of validation, Brazilian testing to measure the indirect tensile strength of rocks is still an issue of debate. The numerical model of fracture propagation supported by digital image correlation from this study can be used to explain the fracturing process in the homogeneous material and can be extended to non-homogeneous cases by incorporating heterogeneity, which is essential for rock mechanics field applications.

58 GEOSCIENCES↗

A gain series method for accurate EMCCD calibration

Abstract Calibration of the gain and digital conversion factor of an EMCCD is necessary for accurate photon counting. We present a new method to quickly calibrate multiple gain settings of an EMCCD camera. Acquiring gain-series calibration data and analyzing the resulting images with the EMCCD noise model more accurately estimates the gain response of the camera. Furthermore, we develop a method to compare the results from different calibration approaches. Gain-series calibration outperforms all other methods in this self-consistency test.

36 MATERIALS SCIENCE↗

Timeseries Photos of a Variably Inundated Stream: Umtanum Creek, Washington, United States

This dataset is associated with a broader study using game camera timeseries photos collected to evaluate stream variable inundation via changes in width (i.e. wet fraction). Four game cameras were deployed along Umtanum Creek (Washington, United States) to track changes in stream inundation over time. Drone imagery was collected at the same location on October 18, 2024 which was used to construct a digital elevation model (DEM) of the streambed topography. The associated paper and data can be found at https://doi.org/10.1016/j.envsoft.2025.106715 (Bao et al., 2025a)) and https://doi.org/10.15485/2589885 (Bao et al., 2025b), respectively. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to this readme, this data package also includes a file-level metadata (FLMD) files that describes each file and a data dictionaries (DD) that describe all column/row headers and variable definitions. This dataset is comprised of (1) file-level metadata; (2) data dictionary; (3) readme; (4) field metadata; (5) field protocol; and (5) folders containing game camera photos. Game camera photos are organized into folders for each camera (CDL, CUL, CDR, CUR; see readme for information on camera naming) by the month photos were collected. All files are .csv, .jpg, or .pdf.

AI image segmentation↗

National Center for Airborne Laser Mapping (NCALM) LiDAR, Imagery, and DEM data from five NGEE Arctic Sites, Seward Peninsula, Alaska, August 2021

From August 8 through August 16 of 2021, airborne remote sensing data was collected by the National Center for Airborne Laser Mapping (NCALM) in collaboration with NGEE Arctic scientists. Data was collected around five NGEE Arctic study sites on the Seward Peninsula of Alaska: Teller mm 27, Teller mm 47, Kougarok mm 64, Kougarok mm 86, and Council mm 71. A Robinson R44 II helicopter with a RIEGL VQ-580 II airborne laser scanner was used to collect the LiDAR point cloud data for each study site. A Phase One iXM-RS100F camera was integrated with the Riegl sensor to collect RGB imagery. This data package contains LiDAR point clouds (.las), RGB imagery (tif), 1 m or 50 cm Digital Elevation Models (.tif) generated from the LiDAR data, and shapefiles of the .las tiling system for each site (.shp). Two supplemental documents are also included in the package: 1) a report describing data collection details, GNSS corrections, and processing steps and 2) a document describing the LiDAR Classification used (.pdf). This survey was conducted towards the end of the summer on the Seward Peninsula, and can be paired with data collected in April of 2022 during the snow-on campaign "National Center for Airborne Laser Mapping (NCALM) LiDAR and DEM data from two NGEE Arctic Sites, Seward Peninsula, Alaska, Winter 2022" (Singhania et.al, 2023) (NGA314). The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Combined thermographic phosphor and digital image correlation (TP + DIC) for simultaneous temperature and strain measurements

We report thermographic phosphors (TP) are combined with stereo digital image correlation (DIC) in a novel diagnostic, TP + DIC, to measure full-field surface strains and temperatures simultaneously. The TP + DIC method is presented, including corrections for nonlinear CMOS camera detectors and generation of pixel-wise calibration curves to relate the known temperature to the ratio of pixel intensities between two distinct wavelength bands. Additionally, DIC is employed not only for strain measurements but also for accurate image registration between the two cameras for the two-colour ratio method approach of phosphoric thermography. TP + DIC is applied to characterize the thermo-mechanical response of 304L stainless steel dog bones during tensile testing at different strain rates. The dog bones are patterned for DIC with Mg 3 F 2 GeO 4 :Mn (MFG) via aerosol deposition through a shadow mask. Temperatures up to 425°K (150°C) and strains up to 1.0 mm/mm are measured in the localized necking region, with conservative noise levels of 10°K and 0.01 mm/mm or less. Finally, TP + DIC is compared to the more established method of combining infrared (IR) thermography with DIC (IR + DIC), with results agreeing favourably. Three topics of continued research are identified, including cracking of the aerosol-deposited phosphor DIC features, incomplete illumination for pixels on the border of the phosphor features, and phosphor emission evolution as a function of applied substrate strain. This work demonstrates the combination of phosphor thermography and DIC and lays the foundation for further development of TP + DIC for testing in combined thermo-mechancial environments.

304L stainless steel↗

Canopy reflectance spectroscopy, thermal images and digital photographs, San Lorenzo, Panama, 2020

This data package comprises reflectance spectra, thermal and visible images of top of canopy tree crowns at the San Lorenzo Protected Area, Panama. Data were collected using the Smithsonian Tropical Research Institute (STRI) canopy access crane, from positions approximately 4 m above the target tree canopy. Canopy reflectance spectra were collected using an HR-1024i full range spectroradiometer (350–2500 nm, SVC, Poughkeepsie, NY, USA) with a 14-degree lens. Canopy thermal images were captured using an 8640-S series USB Calibrated Thermal Camera (ICI International, Beaumont, TX, USA). Visible images were collected using an AW130 waterproof/shockproof camera (Nikon, Tokyo, Japan). Data were collected on three days, on 16 canopies from 10 tree species. On both January 30, 2020, and February 27, 2020, we collected spectra at three time points, in the morning, midday, and afternoon. On February 18, 2020, we collected data around midday only. Due to technical issues, digital photography was collected on 30 January only. This dataset includes unprocessed data only, including spectral data (.sig or .sed), thermal images (.i16), and photographs (.raw), a detailed method description (.pdf), species information (.csv) and ESS-DIVE file-level metadata (FLMD.csv).

54 ENVIRONMENTAL SCIENCES↗

Dynamic Observing and Tiling Strategies for the DESI Legacy Surveys

The Dark Energy Spectroscopic Instrument Legacy Surveys, a combination of three ground-based imaging surveys, have mapped 16,000 deg{sup 2} in three optical bands (g, r, and z) to a depth 1–2 mag deeper than the Sloan Digital Sky Survey. Our work addresses one of the major challenges of wide-field imaging surveys conducted at ground-based observatories: the varying depth that results from varying observing conditions at Earth-bound sites. To mitigate these effects, the Legacy Surveys (the Dark Energy Camera Legacy Survey, or DECaLS; the Mayall z-band Legacy Survey, or MzLS; and the Beiijing-Arizona Sky Survey, or BASS) employed a unique strategy to dynamically adjust the exposure times as rapidly as possible in response to the changing observing conditions. We present the tiling and observing strategies used by the first two of these surveys. We demonstrate that the tiling and dynamic observing strategies jointly result in a more uniform-depth survey that has higher efficiency for a given total observing time compared with the traditional approach of using fixed exposure times.

79 ASTRONOMY AND ASTROPHYSICS↗

Digital Image Correlation as an Experimental Modal Analysis Capability

Digital image correlation (DIC) is an established test technique in several fields including quasi-static displacement measurements. Recently there has been growing interest in using DIC to measure structural dynamic response and even extract modal parameters from that information. Although high-speed cameras have become more ubiquitous, there are no commercial end-to-end packages for modal analysis based on image data, particularly when combined with traditional data acquisition systems. As such, the practitioner is left to develop several key data processing capabilities, hardware interface equipment, and testing practices themselves. This work highlights several practical aspects that have been encountered while establishing DIC as a viable modal testing capability in a laboratory environment.

47 OTHER INSTRUMENTATION↗

Using the red chromatic coordinate to characterize the phenology of forest canopy photosynthesis

Vegetation phenology has received increasing attention in climate change research. Near-surface sensing using digital repeat photography has proven to be useful for ecosystem-scale monitoring of vegetation phenology. However, our understanding of the link between phenological metrics derived from digital repeat photography and the phenology of forest canopy photosynthesis is still incomplete, especially for evergreen plant species. Using 49 site-years of digital images from the PhenoCam Network from eight evergreen needleleaf forest (ENF) and six deciduous broadleaf forest (DBF) sites in North America, we explored the potential of the green chromatic (GCC) and red chromatic coordinates (RCC) in tracking forest canopy photosynthesis by comparing camera-derived start- and end-of-growing season (SOS and EOS, respectively) with corresponding estimates derived from eddy covariance-derived daily gross primary productivity (GPP). We found that for DBF sites, both GCC and RCC performed comparable in capturing SOS and EOS. However, similar to earlier studies, GCC had limited potential in capturing GPP-based SOS or EOS for ENF sites. In contrast, we found RCC was a better predictor of both GPP-based SOS and EOS for ENF sites. Environmental and ecological explanations were both provided that phenological transitions derived from RCC were highly correlated with spring and autumn meteorological conditions, as well as having overall higher correlations with phenology based on LAI, a critical variable for describing canopy development. Our results demonstrate that RCC is an underappreciated metric for tracking vegetation phenology, especially for ENF sites where GCC failed to provide reliable estimates for GPP-based SOS or EOS. Our results improve confidence in using digital repeat photography to characterize the phenology of canopy photosynthesis across forest types.

54 ENVIRONMENTAL SCIENCES↗

Real-time plasma monitoring framework for advanced plasma control and ML-research in DIII-D

Real-time and adaptive plasma control is crucial for robust tokamak operation, requiring sensitivity and tolerance measurements of the plasma state. This paper presents the implementation of an integrated real-time plasma monitoring framework on the DIII-D tokamak to support advanced control approaches, including machine-learning (ML) methods. The system is built on the SHIELD framework, a high-performance modular architecture that provides a unified pipeline for integrating diverse diagnostics. The framework leverages high-bandwidth digitizers, fast numerical processing, and deterministic, low-latency interconnects to stream high-fidelity data from diagnostics such as electron cyclotron emission (ECE), beam emission spectroscopy (BES), CO interferometers, and a visible tangential divertor camera (TangTV). The system’s validity is demonstrated through direct comparisons of real-time and offline data. Furthermore, we present two key applications of the developed plasma monitoring system with ML-based plasma control strategies, including real-time divertor detachment and active Alfvén Eigenmode control. As a result, this work presents a robust and scalable approach for integrating high-frequency, multidimensional diagnostics into advanced control algorithms for future fusion devices.

AI/ML↗

Preliminary proof-of-concept of real-time divertor heat flux control from infrared cameras with nitrogen injection in the DIII-D tokamak

In future tokamak reactors like ITER and the Fusion Pilot Plant (FPP), real-time feedback control of heat flux to the plasma-facing components (PFC) will be critical for steady-state operation. This work presents the first experimental demonstration of real-time divertor heat flux estimation with infrared thermography and feedback control with impurity seeding on the DIII-D tokamak. The flexible infrastructure of the Plasma Control System (PCS) on DIII-D makes this new capability possible. The PCS software runs on a gateway computer system, and five real-time compute nodes. An array of low latency streaming digitizers from D-TACQ Solutions connects to these real-time computers to collect and process data, and send commands to actuators during plasma discharges. This system handles the signal IO from the tokamak and allows the PCS to utilize the diagnostic data necessary to perform control in real-time. Feedback control on heat flux was accomplished by feeding infrared camera data from the “Infrared TV” (IRTV) camera to a custom-developed User Datagram Protocol (UDP) server. This server transmits infrared data to a newly developed PCS algorithm that estimates the heat flux to PFC. Here, a proportional integral derivative (PID) controller minimizes the error between a heat flux reference and the real-time estimate by injecting nitrogen gas into the divertor.

Algorithm development↗