Search NASA⌕ Search

SEARCH · Search NASA

Results for “Event camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Demonstration of A High-Fidelity Predictive/Preview Display Technique for Telerobotic Servicing in Space

A highly effective predictive/preview display technique for telerobotic servicing in space under several seconds communication time delay has been demonstrated on a large laboratory scale in May, 1993, involving the Jet Propulsion Laboratory as the simulated ground control station and, 2500 miles away, the Goddard Space Flight Center as the simulated satellite servicing set-up. The technique isbased on a high-fidelity calibration procedure that enables a high-fidelity overlay of 3-D graphics robot arm and object models over given 2-D TV camera images of robot arm and objects. Togenerate robot arm motions, the operator can confidently interact in real time with the graphics models of the robot arm and objects overlaid on an actual camera view of the remote work site. The technique also enables the operator to generate high-fidelity synthetic TV camera views showing motion events that are hidden in a given TV camera view or for which no TV camera views are available...

Bejczy, A. K.↗

Dictionary Learning with Accumulator Neurons

The Locally Competitive Algorithm (LCA) uses local competition between non-spiking leaky integrator neurons to infer sparse representations, allowing for potentially real-time execution on massively parallel neuromorphic architectures such as Intel's Loihi processor. Here, we focus on the problem of inferring sparse representations from streaming video using dictionaries of spatiotemporal features optimized in an unsupervised manner for sparse reconstruction. Non-spiking LCA has previously been used to achieve unsupervised learning of spatiotemporal dictionaries composed of convolutional kernels from raw, unlabeled video. We demonstrate how unsupervised dictionary learning with spiking LCA (\hbox{S-LCA}) can be efficiently implemented using accumulator neurons, which combine a conventional leaky-integrate-and-fire (\hbox{LIF}) spike generator with an additional state variable that is used to minimize the difference between the integrated input and the spiking output. We demonstrate dictionary learning across a wide range of dynamical regimes, from graded to intermittent spiking, for inferring sparse representations of both static images drawn from the CIFAR database as well as video frames captured from a DVS camera. On a classification task that requires identification of the suite from a deck of cards being rapidly flipped through as viewed by a DVS camera, we find essentially no degradation in performance as the LCA model used to infer sparse spatiotemporal representations migrates from graded to spiking. We conclude that accumulator neurons are likely to provide a powerful enabling component of future neuromorphic hardware for implementing online unsupervised learning of spatiotemporal dictionaries optimized for sparse reconstruction of streaming video from event based DVS cameras.

artificial intelligence↗

Situational Awareness from a Low-Cost Camera System

A method gathers scene information from a low-cost camera system. Existing surveillance systems using sufficient cameras for continuous coverage of a large field necessarily generate enormous amounts of raw data. Digitizing and channeling that data to a central computer and processing it in real time is difficult when using low-cost, commercially available components. A newly developed system is located on a combined power and data wire to form a string-of-lights camera system. Each camera is accessible through this network interface using standard TCP/IP networking protocols. The cameras more closely resemble cell-phone cameras than traditional security camera systems. Processing capabilities are built directly onto the camera backplane, which helps maintain a low cost. The low power requirements of each camera allow the creation of a single imaging system comprising over 100 cameras. Each camera has built-in processing capabilities to detect events and cooperatively share this information with neighboring cameras. The location of the event is reported to the host computer in Cartesian coordinates computed from data correlation across multiple cameras. In this way, events in the field of view can present low-bandwidth information to the host rather than high-bandwidth bitmap data constantly being generated by the cameras. This approach offers greater flexibility than conventional systems, without compromising performance through using many small, low-cost cameras with overlapping fields of view. This means significant increased viewing without ignoring surveillance areas, which can occur when pan, tilt, and zoom cameras look away. Additionally, due to the sharing of a single cable for power and data, the installation costs are lower. The technology is targeted toward 3D scene extraction and automatic target tracking for military and commercial applications. Security systems and environmental/ vehicular monitoring systems are also potential applications.

Freudinger, Lawrence C.↗

Assessment of the Imaging Properties of Plastic Scintillators at FP60R for Neutron Imaging Applications [Slides]

4mm thick Stilbene gives the brightest signal but at the cost of resolution. 1 and 2 cm BC412 gave the highest resolution images. The HI-LY scintillator is better suited for DD neutrons. Future work includes: measurements this summer using an event-mode imaging camera which promises sub-pixel resolution through center-of-mass techniques, opportunities for DD neutron tests during laser-driven z-pinch experiments at UNR, and assess scatter within scintillator.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Goddard earth models (5 and 6)

A comprehensive earth model has been developed that consists of two complementary gravitational fields and center-of-mass locations for 134 tracking stations on the earth's surface. One gravitational field is derived solely from satellite tracking data. This data on 27 satellite orbits is the most extensive used for such a solution. A second solution uses this data with 13,400 simultaneous events from satellite camera observations and surface gravimetric anomalies. The satellite-only solution as a whole is accurate to about 4.5 milligals as judged by the surface gravity data. The majority of the station coordinates are accurate to better than 10 meters as judged by independent results from geodetic surveys and by Doppler tracking of both distant space probes and near earth orbits.

Lerch, F. J.↗

SPICE Module for the Satellite Orbit Analysis Program (SOAP)

A SPICE module for the Satellite Orbit Analysis Program (SOAP) precisely represents complex motion and maneuvers in an interactive, 3D animated environment with support for user-defined quantitative outputs. (SPICE stands for Spacecraft, Planet, Instrument, Camera-matrix, and Events). This module enables the SOAP software to exploit NASA mission ephemeris represented in the JPL Ancillary Information Facility (NAIF) SPICE formats. Ephemeris types supported include position, velocity, and orientation for spacecraft and planetary bodies including the Sun, planets, natural satellites, comets, and asteroids. Entire missions can now be imported into SOAP for 3D visualization, playback, and analysis. The SOAP analysis and display features can now leverage detailed mission files to offer the analyst both a numerically correct and aesthetically pleasing combination of results that can be varied to study many hypothetical scenarios. The software provides a modeling and simulation environment that can encompass a broad variety of problems using orbital prediction. For example, ground coverage analysis, communications analysis, power and thermal analysis, and 3D visualization that provide the user with insight into complex geometric relations are included. The SOAP SPICE module allows distributed science and engineering teams to share common mission models of known pedigree, which greatly reduces duplication of effort and the potential for error. The use of the software spans all phases of the space system lifecycle, from the study of future concepts to operations and anomaly analysis. It allows SOAP software to correctly position and orient all of the principal bodies of the Solar System within a single simulation session along with multiple spacecraft trajectories and the orientation of mission payloads. In addition to the 3D visualization, the user can define numeric variables and x-y plots to quantitatively assess metrics of interest.

Coggi, John↗

Weapon Physicist Declassifies Rescued Nuclear Test Films

The U.S. conducted 210 atmospheric nuclear tests between 1945 and 1962, with multiple cameras capturing each event at around 2,400 frames per second. But in the decades since, around 10,000 of these films sat idle, scattered across the country in high-security vaults. Not only were they gathering dust, the film material itself was slowly decomposing, bringing the data they contained to the brink of being lost forever. For the past five years, Lawrence Livermore National Laboratory (LLNL) weapon physicist Greg Spriggs and a crack team of film experts, archivists and software developers have been on a mission to hunt down, scan, reanalyze and declassify these decomposing films. The goals are to preserve the films’ content before it’s lost forever, and provide better data to the post-testing-era scientists who use computer codes to help certify that the aging U.S. nuclear deterrent remains safe, secure and effective.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Experimental Photogrammetric Techniques Used on Five Full-Scale Aircraft Crash Tests

Between 2013 and 2015, full-scale crash tests were conducted on five aircraft at the Landing and Impact Research Facility (LandIR) at NASA Langley Research Center (LaRC). Two tests were conducted on CH-46E airframes as part of the Transport Rotorcraft Airframe Crash Testbed (TRACT) project, and three tests were conduced on Cessna 172 aircraft as part of the Emergency Locator Transmitter Survivability and Reliability (ELTSAR) project. Each test served to evaluate a variety of crashworthy systems including: seats, occupants, restraints, composite energy absorbing structures, and Emergency Locator Transmitters. As part of each test, the aircraft were outfitted with a variety of internal and external cameras that were focused on unique aspects of the crash event. A subset of three camera was solely used in the acquisition of photogrammetric test data. Examples of this data range from simple two-dimensional marker tracking for the determination of aircraft impact conditions to entire full-scale airframe deformation to markerless tracking of Anthropomorphic Test Devices (ATDs, a.k.a. crash test dummies) during the crash event. This report describes and discusses the techniques used and implications resulting from the photogrammetric data acquired from each of the five tests.

Littell, Justin D.↗

Holographic Imaging of Evolving Laser-Plasma Structures

In the 1870s, English photographer Eadweard Muybridge captured motion pictures within one cycle of a horse’s gallop, which settled a hotly debated question of his time by showing that the horse became temporarily airborne. In the 1940s, Manhattan project photographer Berlin Brixner captured a nuclear blast at a million frames per second, and resolved a dispute about the explosion’s shape and speed. In this project, we developed methods to capture detailed motion pictures of evolving, light-velocity objects created by a laser pulse propagating through matter. These objects include electron density waves used to accelerate charged particles, laser-induced refractive index changes used for micromachining, and ionization tracks used for atmospheric chemical analysis, guide star creation and ranging. Our “movies”, like Muybridge’s and Brixner’s, are obtained in one shot, since the laser-created objects of interest are insufficiently repeatable for accurate stroboscopic imaging. Our high-speed photographs have begun to resolve controversies about how laser-created objects form and evolve, questions that previously could be addressed only by intensive computer simulations based on estimated initial conditions. Resolving such questions helps develop better tabletop particle accelerators, atmospheric ranging devices and many other applications of laser-matter interactions. Our photographic methods all begin by splitting one or more “probe” pulses from the laser pulse that creates the light-speed object. A probe illuminates the object and obtains information about its structure without altering it. We developed three single-shot visualization methods that differ in how the probes interact with the object of interest or are recorded. (1) Frequency-Domain Holography (FDH). In FDH, there are 2 probes, like “object” and “reference” beams in conventional holography. Our “object” probe surrounds the light-speed object, like a fleas swarming around a sprinting animal. The object modifies the probe, imprinting information about its structure. Meanwhile, our “reference” probe co-propagates ahead of the object, free of its influence. After the interaction, object and reference combine to record a hologram. For technical reasons, our recording device is a spectrometer (a frequency-measuring device), hence the name “frequency-domain” holography. We read the hologram electronically to obtain a “snapshot” of the object’s average structure as it transits the medium. Our published work shows numerous snapshots of electron density waves (“laser wakes”) in ionized gas (“plasma”), analogous to a water wake behind a boat. Such waves are the basis of tabletop particle accelerators, in which charged particles surf on the light-speed wave, gaining energy. Comparing our snapshots to computer simulations deepens understanding of laser wakes. FDH takes snapshots of objects that are quasi-static --- i.e. like Muybridge’s horse standing still on a treadmill. If the object changes shape, FDH images blur, as when a subject moves while a camera shutter is open. Many laser-generated objects of interest do evolve as they propagate. To overcome this limit of FDH, we developed .... (2) Frequency-Domain Tomography (FDT). In FDT, 5 to 10 probe pulses are fired simultaneously across the object’s path at different angles, like a crossfire of bullets. The object imprints a “streaked” record of its evolution on each probe, which we record as in FDH, then recover a multi-frame “movie” of the object’s evolving structure using algorithms of computerized tomography. When propagation distance exceeds a few millimeters, reconstructed FDT images distort. This is because the lenses that image probes to detector have limited depth of field, like cameras that cannot focus simultaneously on both nearby and distant objects. But some laser-generated objects of interest propagate over meters. For these applications we developed … (3) Multi-Object-Plane Phase-Contrast Imaging (MOP-PCI). In MOP-PCI, we image FDT-like probes to the detector from multiple “object planes” --- like recording an event simultaneously with several cameras, some focused on nearby, others on distant, objects. To increase sensitivity, we exploit a phase-contrast imaging technique developed by Dutch Nobel laureate Fritz Zernike in the 1930s. Using MOP-PCI we recorded single-shot movies of laser pulse tracks through more than 10 cm of air. We plan to record images of meter-long tracks of electron bunches propagating through plasma in an experiment at the Stanford Linear Accelerator Center (SLAC). This will help SLAC scientists understand, optimize and scale small plasma-based particle accelerators that have applications in medicine, industry, materials science and high-energy physics.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The International Space Station: A Unique Platform for Remote Sensing of Natural Disasters

Assembly of the International Space Station (ISS) was completed in 2012, and the station is now fully operational as a platform for remote sensing instruments tasked with collecting scientific data about the Earth system. Remote sensing systems are mounted inside the ISS, primarily in the U.S. Destiny Module's Window Observational Research Facility (WORF), or are located on the outside of the ISS on any of several attachment points. While NASA and other space agencies have had remote sensing systems orbiting Earth and collecting publicly available data since the early 1970s, these sensors are carried onboard free-flying, unmanned satellites. These satellites are traditionally placed into Sun-synchronous polar orbits that allow imaging of the entire surface of the Earth to be repeated with approximately the same Sun illumination (typically local solar noon) over specific areas, with set revisit times that allow uniform data to be taken over long time periods and enable straightforward analysis of change over time. In contrast, the ISS has an inclined, Sun-asynchronous orbit (the solar illumination for data collections over any location changes as the orbit precesses) that carries it over locations on the Earth between approximately 52degnorth and 52deg south latitudes (figure 1). The ISS is also unique among NASA orbital platforms in that it has a human crew. The presence of a crew provides options not available to robotic sensors and platforms, such as the ability to collect unscheduled data of an unfolding event using handheld digital cameras as part of the Crew Earth Observations (CEO) facility and on-the-fly assessment of environmental conditions, such as cloud cover, to determine whether conditions are favorable for data collection. The crew can also swap out internal sensor systems installed in the WORF as needed. The ISS orbit covers more than 90 percent of the inhabited surface of the Earth, allowing the ISS to pass over the same ground locations at different times of the day and night. This is important for two reasons: 1) certain surface processes (i.e., development of coastal fog banks) occur at times other than local solar noon, making it difficult to collect relevant data from traditional satellite platforms, and 2) it provides opportunities for the ISS to collect data for short-duration events, such as natural disasters, that polar-orbiting satellites may miss due to their orbital dynamics - in essence, the ISS can be "in the right place at the right time" to collect data. An immediate application of ISS remote sensing data collection is that the data can be used to provide information for humanitarian aid after a natural disaster. This activity contributes directly to the station's Benefits to Humanity mission. The International Charter, Space and Major Disasters (also known as the International Disaster Charter, or IDC) is an agreement between agencies of several countries to provide - on a best-effort basis - remotely sensed data related to natural disasters to requesting countries in support of disaster response. In the United States, the lead agency for interaction with the IDC is the United States Geological Survey (USGS); when an IDC request, or activation, is received, the USGS notifies the science teams for NASA instruments with targeting information for data collection. In the case of the ISS, Earth scientists in the JSC ARES Directorate, in association with the ISS Program Science Office, coordinate targeting and data collection with the USGS. If data is collected, it is passed back to the USGS for posting on its Hazards Data Distribution System and made available for download. The ISS was added to the USGS's list of NASA remote sensing assets that could respond to IDC activations in May 2012. Initially, the NASA ISS sensor systems available to respond to IDC activations included the ISS Agricultural Camera (ISSAC), an internal multispectral visible-near infrared wavelength system mounted in the WORF; CEO, a project that collects imagery through the ISS windows using off-the-shelf handheld digital visible-wavelength cameras; and the Hyperspectral Imager for the Coastal Oceans (HICO), a visible to near-infrared system mounted externally on the Japanese Experiment Module - Exposed Facility. Since May 2012, there have been 37 IDC activations; ISS sensor systems have collected data for 10 of these events.

Stefanov, William L.↗

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗

Deep Impact Extended Mission Challenges for the Validation and Verification Test Program

The Deep Impact Spacecraft was launched on January 12, 2005 as part of NASA's Discovery Program as a radical mission to excavate the interior of a comet. The Spacecraft consisted of two separate entities known as the Flyby and the Impactor, which were commanded to separate prior to comet rendezvous with comet 9P/Tempel 1. The overall mission was deemed a success on July 4, 2005, as the 370-kg Impactor collided with the comet at 10.2 km/s. This event was captured using the camera and infrared spectrometer on the Flyby spacecraft, along with ground-based observatories. Since this event, the Flyby spacecraft has been in hibernation mode and has received only a small amount of maintenance. The Deep Impact Program was managed by the Jet Propulsion Laboratory (JPL), led by Dr. Michael A'Hearn from the University of Maryland in College Park, and built by Ball Aerospace & Technologies Corp. in Boulder, Colorado.

Test Bench↗

A decam search for an optical counterpart to the LIGO gravitational-wave event GW151226

We report the results of a Dark Energy Camera optical follow-up of the gravitational-wave (GW) event GW151226, discovered by the Advanced Laser Interferometer Gravitational-wave Observatory detectors. Our observations cover 28.8 deg{sup 2} of the localization region in the i and z bands (containing 3% of the BAYESTAR localization probability), starting 10 hr after the event was announced and spanning four epochs at 2–24 days after the GW detection. We achieve 5σ point-source limiting magnitudes of i≈21.7 and z≈21.5, with a scatter of 0.4 mag, in our difference images. Given the two-day delay, we search this area for a rapidly declining optical counterpart with ≳3σ significance steady decline between the first and final observations. We recover four sources that pass our selection criteria, of which three are cataloged active galactic nuclei. The fourth source is offset by 5.8 arcsec from the center of a galaxy at a distance of 187 Mpc, exhibits a rapid decline by 0.5 mag over 4 days, and has a red color of i−z≈0.3 mag. These properties could satisfy a set of cuts designed to identify kilonovae. However, this source was detected several times, starting 94 days prior to GW151226, in the Pan-STARRS Survey for Transients (dubbed as PS15cdi) and is therefore unrelated to the GW event. Given its long-term behavior, PS15cdi is likely a Type IIP supernova that transitioned out of its plateau phase during our observations, mimicking a kilonova-like behavior. We comment on the implications of this detection for contamination in future optical follow-up observations.

79 ASTRONOMY AND ASTROPHYSICS↗

Camera assembly design proposal for SRF cavity image collection

This project seeks to collect images from the inside of a superconducting radio frequency (SRF) large grain niobium cavity during vertical testing. These images will provide information on multipacting and other phenomena occurring in the SRF cavity during these tests. Multipacting, a process that involves an electron buildup in the cavity and concurrent loss of RF power, is thought to be occurring near the cathode in the SRF structure. Images of electron emission in the structure will help diagnose the source of multipacting in the cavity. Multipacting sources may be eliminated with an alteration of geometric or resonant conditions in the SRF structure. Other phenomena, including unexplained light emissions previously discovered at SLAC, may be present in the cavity. In order to effectively capture images of these events during testing, a camera assembly needs to be installed to the bottom of the RF structure. The SRF assembly operates under extreme environmental conditions: it is kept in a dewar in a bath of 2K liquid helium during these tests, is pumped down to ultra-high vacuum, and is subjected to RF voltages. Because of this, the camera needs to exist as a separate assembly attached to the bottom of the cavity. The design of the camera is constrained by a number of factors that are discussed.

43 PARTICLE ACCELERATORS↗

Camera Assembly Design Proposal for SRF Cavity Image Collection

This project seeks to collect images from the inside of a superconducting radio frequency (SRF) large grain niobium cavity during vertical testing. These images will provide information on multipacting and other phenomena occurring in the SRF cavity during these tests. Multipacting, a process that involves an electron buildup in the cavity and concurrent loss of RF power, is thought to be occurring near the cathode in the SRF structure (see Figure 1). Images of electron emission in the structure will help diagnose the source of multipacting in the cavity. Multipacting sources may be eliminated with an alteration of geometric or resonant conditions in the SRF structure. Other phenomena, including unexplained light emissions previously discovered at SLAC, may be present in the cavity. In order to effectively capture images of these events during testing, a camera assembly needs to be installed to the bottom of the RF structure. The SRF assembly operates under extreme environmental conditions: it is kept in a dewar in a bath of 2K liquid helium during these tests, is pumped down to ultra-high vacuum, and is subjected to RF voltages. Because of this, the camera needs to exist as a separate assembly attached to the bottom of the cavity. The design of the camera is constrained by a number of factors that are discussed below.

43 PARTICLE ACCELERATORS↗

High Speed Intensified Video Observations of TLEs in Support of PhOCAL

The third observing season of PhOCAL (Physical Origins of Coupling to the upper Atmosphere by Lightning) was conducted over the U.S. High Plains during the late spring and summer of 2013. The goal was to capture using an intensified high-speed camera, a transient luminous event (TLE), especially a sprite, as well as its parent cloud-to-ground (SP+CG) lightning discharge, preferably within the domain of a 3-D lightning mapping array (LMA). The co-capture of sprite and its SP+CG was achieved within useful range of an interferometer operating near Rapid City. Other high-speed sprite video sequences were captured above the West Texas LMA. On several occasions the large mesoscale convective complexes (MCSs) producing the TLE-class lightning were also generating vertically propagating convectively generated gravity waves (CGGWs) at the mesopause which were easily visible using NIR-sensitive color cameras. These were captured concurrent with sprites. These observations were follow-ons to a case on 15 April 2012 in which CGGWs were also imaged by the new Day/Night Band on the Suomi NPP satellite system. The relationship between the CGGW and sprite initiation are being investigated. The past year was notable for a large number of elve+halo+sprite sequences sequences generated by the same parent CG. And on several occasions there appear to be prominent banded modulations of the elves' luminosity imaged at >3000 ips. These stripes appear coincident with the banded CGGW structure, and presumably its density variations. Several elves and a sprite from negative CGs were also noted. New color imaging systems have been tested and found capable of capturing sprites. Two cases of sprites with an aurora as a backdrop were also recorded. High speed imaging was also provided in support of the UPLIGHTS program near Rapid City, SD and the USAFA SPRITES II airborne campaign over the Great Plains.

Lyons, Walter A.↗