Search NASA⌕ Search

SEARCH · Search NASA

Results for “Event-based imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

13 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Toward memory-efficient melt pool monitoring: a classification framework using event-based imaging and sparse sensing technique

Vision sensors like CMOS and CCD cameras are often used for in-process monitoring of melt pools in laser-based additive and welding processes, but they require transferring large amounts of data and computational processing resources. Event-based neuromorphic imagery, on the other hand, detects only the change in pixel intensity, thus potentially reducing the data amount and latency. With an event imager, this study develops a framework for melt pool condition classification, including image construction, time scale selection, optimal pixel selection, and sparse classification, to achieve a highly memory-efficient scheme. These are based on sparse sensing techniques with singular value decomposition (SVD) and QR pivoting, the two fundamental matrix transformations for linear dimensionality reduction. The framework is then validated by classifying a controlled experiment by exciting various mode shapes of liquid gallium pools of varying depths (3, 6, and 8 mm). At 200 pixels, the classifier can reach overall accuracy of 75%, while at 2000 pixels (0.013% of the total possible pixels), the accuracy is nearly 90% (89.86%). At the same number of pixels, random selection can only achieve 46% and 67%, respectively. The memory savings of the sparsely sampled event data compared to a conventional imager is about 500 times. In addition to performance, implementation and limitations of the framework are also discussed.

42 ENGINEERING↗
DOE OSTI2025

Radiation Imaging with Event Camera

Neuromorphic or event-based imaging is a new, commercially available sensor technology inspired by how the human eye works. Instead of measuring frames at a fixed rate, the camera measures changes in pixel intensity asynchronously. This difference in readout architecture results in a high dynamic range and low latency. Event-based cameras have been used in a variety of applications, including object tracking, navigation, and lidar technologies. However, event-based cameras have not been adequately researched for their ability to image high-energy particles. This report explores the use of an event camera for imaging alpha, beta, and X-rays particles, when coupled with scintillator screens to convert high-energy particles into visible light. Methods to process event data were developed and are presented here, along with the results. The event camera can measure alpha and beta particles with comparable performance to that of a conventional camera. Event cameras can also image higher-activity sources and offer the possibility of discriminating particle interaction types on the basis of timing differences, which typical cameras cannot do. Additionally, event cameras can image objects with an X-ray source when the source strength dynamically changes but does not create a high-contrast image during static X-ray measurement.

47 OTHER INSTRUMENTATION↗
NASA NTRSDate not supplied

Considerations for High-Speed Background-Oriented Schlieren Visualization Capability for Ground Test Facilities

Since its introduction in the year 2000, background-oriented schlieren (BOS) has become a cornerstone technique for visualizing variable-density flows. In this review, we provide a rigorous examination of the optical principles underpinning BOS and related refractive-index-based techniques, complemented by an appendix linking schlieren imaging to Maxwell’s equations. The core sections delve into the practical aspects of BOS, with detailed discussions on image processing algorithms and critical considerations for experimental setups. We then explore recent advancements and innovations, including extensions of BOS with tomography, data assimilation, and event-based imaging. Finally, we present notable applications of BOS in challenging and unconventional environments, showcasing the method’s versatility and offer inspiration for future research directions.

Brett Bathel↗
NASA NTRSDate not supplied

Twenty-Five Years of Background-Oriented Schlieren: Advances and Novel Applications

Since its introduction in the year 2000, background-oriented schlieren (BOS) has become acornerstone technique for visualizing variable-density flows. In this review, we provide a rigorousexamination of the optical principles underpinning BOS and related refractive-index-basedtechniques, complemented by an appendix linking schlieren imaging to Maxwell’s equations.The core sections delve into the practical aspects of BOS, with detailed discussions on imageprocessing algorithms and critical considerations for experimental setups. We then explorerecent advancements and innovations, including extensions of BOS with tomography, dataassimilation, and event-based imaging. Finally, we present notable applications of BOS inchallenging and unconventional environments, showcasing the method’s versatility and offerinspiration for future research directions.

Background-Oriented Schlieren↗
DOE OSTI2024

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗
NASA NTRSDate not supplied

Open-source Techniques for Automated Landslide Inventory Generation for Rapid Response

Manual mapping is the most used method for generating landslide inventories. For rapid response scenario this method becomes tedious and time consuming. The Landslide team at NASA Goddard Space Flight Center has been developing open-source landslide mapping systems for rapid generation of landslide inventories. We have developed a Python-based landslide mapping framework known as the Semi-Automatic Landslide Detection (SALaD) system that uses Object-based Image Analysis and machine learning. For production of event-based inventories, SALaD was modified to include a change detection module (SALaD-CD). Utilizing high-resolution imagery form from Planet and Maxar, we have generated multiple rapid response landslide inventories that have been used by emergency responders on the ground, the NASA Disasters program, and academia. Currently, we are exploiting deep learning frameworks for landslide mapping. We are interested to learn about efficient way to harmonize multi-sensor data for creating a long-term record of landslides, training strategies and ongoing deep learning-based efforts for natural hazard characterization within NASA and UMD.

Pukar Amatya↗
NASA NTRS2015

NASA Space Radiation Program Integrative Risk Model Toolkit

NASA Space Radiation Program Element scientists have been actively involved in development of an integrative risk models toolkit that includes models for acute radiation risk and organ dose projection (ARRBOD), NASA space radiation cancer risk projection (NSCR), hemocyte dose estimation (HemoDose), GCR event-based risk model code (GERMcode), and relativistic ion tracks (RITRACKS), NASA radiation track image (NASARTI), and the On-Line Tool for the Assessment of Radiation in Space (OLTARIS). This session will introduce the components of the risk toolkit with opportunity for hands on demonstrations. The brief descriptions of each tools are: ARRBOD for Organ dose projection and acute radiation risk calculation from exposure to solar particle event; NSCR for Projection of cancer risk from exposure to space radiation; HemoDose for retrospective dose estimation by using multi-type blood cell counts; GERMcode for basic physical and biophysical properties for an ion beam, and biophysical and radiobiological properties for a beam transport to the target in the NASA Space Radiation Laboratory beam line; RITRACKS for simulation of heavy ion and delta-ray track structure, radiation chemistry, DNA structure and DNA damage at the molecular scale; NASARTI for modeling of the effects of space radiation on human cells and tissue by incorporating a physical model of tracks, cell nucleus, and DNA damage foci with image segmentation for the automated count; and OLTARIS, an integrated tool set utilizing HZETRN (High Charge and Energy Transport) intended to help scientists and engineers study the effects of space radiation on shielding materials, electronics, and biological systems.

Kim, Myung-Hee Y.↗
NASA NTRS1996

MCTP Summer Research Internship Program. Research Presentation Day: Experience Mathematics and Science in the Real World

This paper presents the summaries of the MCTP Summer Research Internship Program. Technological areas discussed include: Mathematical curriculum development for real world problems; Rain effects on air-water gas exchange; multi-ring impact basins on mars; developing an interactive multimedia educational cd-rom on remote sensing; a pilot of an activity for for the globe program; fossils in maryland; developing children's programming for the american horticultural society at river farm; children's learning, educational programs of the national park service; a study of climate and student satisfaction in two summer programs for disadvantaged students interested in careers in mathematics and science; the maryland governor's academy, integrating technology into the classroom; stream sampling with the maryland biological stream survey (MBSS); the imaging system inspection software technology, the preparation and detection of nominal and faulted steel ingots; event-based science, the development of real-world science units; correlation between anxiety and past experiences; environmental education through summer nature camp; enhancing learning opportunities at the Salisbury zoo; plant growth experiment, a module for the middle school classroom; the effects of proxisome proliferators in Japanese medaka embryos; development of a chapter on birth control and contraceptive methodologies as part of an interactive computer-based education module on hiv and aids; excretion of gentamicin in toadfish and goldfish; the renaissance summer program; and Are field trips important to the regional math science center?

Source record↗
NASA NTRSDate not supplied

Recent Progress and Development of Self-Aligned Focusing Schlieren

A broad range of developments and applications of self-aligned focusing schlieren (SAFS)systems is presented. The replacement of the Ronchi ruling (RR) with a𝜇LCD was demonstrated with digital SAFS, which provides the ability to modulate the pattern and orientation without physical intervention. Additionally, replacement of the traditional RR with spectral-spatial filters was demonstrated to yield the ability to simultaneously image horizontal and vertical index of refraction gradients using two separate wavelengths. The application of the Scheimpflug principle to SAFS systems enables off-axis imaging and allowed for extended fields-of-view to be captured using a two-camera system. The addition of a plenoptic camera to a baseline SAFS system enables refocusing capabilities, which is demonstrated on two jets offset along the optical axis. Furthermore, application of an event-based camera to SAFS was shown to enable acquisition of sparse, spatio-temporal data. Beyond the listed developments, SAFS was applied to difficult and constraining facilities, such as the National Full-Scale Aerodynamics Complex(NFAC) 80- by 120-ft Wind Tunnel and the Thermal Acoustic Engines (TAE) rig at NASA Ames Research Center and NASA Glenn Research Center, respectively. Behavior of Ronchi rulings, Rochon prisms, and the use of quarter-wave plates versus quarter-wave films are evaluated to provide insight for future experimental design of SAFS-systems.

Self-Aligned Focusing Schlieren↗
NASA NTRSDate not supplied

Recent Progress and Development of Self-Aligned Focusing Schlieren

A broad range of developments and applications of self-aligned focusing schlieren (SAFS)systems is presented. The replacement of the Ronchi ruling (RR) with a𝜇LCD was demonstrated with digital SAFS, which provides the ability to modulate the pattern and orientation without physical intervention. Additionally, replacement of the traditional RR with spectral-spatial filters was demonstrated to yield the ability to simultaneously image horizontal and vertical index of refraction gradients using two separate wavelengths. The application of the Scheimpflug principle to SAFS systems enables off-axis imaging and allowed for extended fields-of-view to be captured using a two-camera system. The addition of a plenoptic camera to a baseline SAFS system enables refocusing capabilities, which is demonstrated on two jets offset along the optical axis. Furthermore, application of an event-based camera to SAFS was shown to enable acquisition of sparse, spatio-temporal data. Beyond the listed developments, SAFS was applied to difficult and constraining facilities, such as the National Full-Scale Aerodynamics Complex(NFAC) 80- by 120-ft Wind Tunnel and the Thermal Acoustic Engines (TAE) rig at NASA Ames Research Center and NASA Glenn Research Center, respectively. Behavior of Ronchi rulings, Rochon prisms, and the use of quarter-wave plates versus quarter-wave films are evaluated to provide insight for future experimental design of SAFS-systems.

Self-Aligned Focusing Schlieren↗
NASA NTRS2022

The Mars 2020 Ground Data System Architecture

The Mars 2020 Mission’s primary objective is to collect 20 geographically unique samples during its prime mission of one and a quarter Martian years, or just over 2 Earth years. Mission planners determined the project needed to develop a system that would enable the operations team to analyze engineering and science data, make science decisions, select viable rover targets at a millimeter resolution and validate an uplink bundle for a car sized rover with more complex science instruments than any previous Mars surface mission. All this had to be done within a five hour time frame. Doing this with a small team would be a challenge, but this had to be accomplished by a large team of engineers and scientists located across North America and Europe. Achieving this level of operational efficiency was unheard of in the prime mission. In addition, the mission had another set of requirements that had nothing to do with surface operations; the Mars 2020 Ground Data System (GDS) was also expected to comply with a new set of security requirements to keep up with the ever changing cybersecurity landscape. The Mars 2020 Ground Data System (GDS) is a re-architected version of the Mars Science Laboratory GDS. The primary goal was to integrate the lessons learned from previous Mars surface missions, accommodate a set of new requirements and capabilities required to ensure mission success, and comply with a new set of cybersecurity controls. The new architecture includes several unique qualities including a data lake, language-agnostic system-wide event-based operations, containerization, automated deployment, network segmentation, infrastructure-as-code, API-driven interfaces, and the first Mars surface GDS to operate primarily in the cloud. The new architecture enabled greater access to the system’s data, tighter integration with the operations team, and a higher level of traceability. The availability of the data also enabled a new set of capabilities previously not possible on surface missions. These new capabilities include an autonomous data to information, pipeline for downlink analysis, horizontal scaling of science data processing capabilities, autonomous round trip data tracking of science and engineering data, integration of flight system state into the tactical planning cycle, high fidelity targeting utilizing kinematic data, and hierarchical image and 3d meshes data representations. This paper will introduce the requirements for the Mars 2020 Mission, the heritage architecture, and the rationale for the changes to achieve the new architecture. The paper will continue to describe the fundamental changes made to the GDS architecture, how these changes enabled a more tightly integrated GDS, and the new capabilities that were enabled by the new architecture. The paper will conclude with the lessons learned from the process of rearchitecting a heritage GDS system and from the first 200 days of operations supporting over 800 users from around the world.

Lopez-Roig, Reynaldo↗
DOE OSTI2025

Accounting for electron-beam-induced warping of molecular nanocrystals in MicroED structure determination

High-energy electrons induce sample damage and motion at the nanoscale to fundamentally limit the determination of molecular structures by electron diffraction. Using a fast event-based electron counting (EBEC) detector, we characterize beam-induced, dynamic, molecular crystal lattice reorientations (BIRs). These changes are sufficiently large to bring reciprocal lattice points entirely in or out of intersection with the sphere of reflection, occur as early events in the decay of diffracted signal due to radiolytic damage, and coincide with beam-induced migrations of crystal bend contours within the same fluence regime and at the same illuminated location on a crystal. These effects are observed in crystals of biotin, a series of amino acid metal chelates, and a six-residue peptide, suggesting that incident electrons inevitably warp molecular lattices. The precise orientation changes experienced by a given microcrystal are unpredictable but are measurable by indexing individual diffraction patterns during beam-induced decay. Reorientations can often tilt a crystal lattice several degrees away from its initial position before irradiation, and for an especially beam-sensitive Zn(II)-methionine chelate, are associated with dramatic crystal quakes prior to 1 e − Å −2 electron beam fluence accumulates. Since BIR coincides with the early stages of beam-induced damage, it echoes the beam-induced motion observed in single-particle cryoEM. As with motion correction for cryoEM imaging experiments, accounting for BIR-induced errors during data processing could improve the accuracy of MicroED data.

Vlahakis, Niko (ORCID:0000000250920265)↗