Search NASA⌕ Search

SEARCH · Search NASA

Results for “video processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46

Temperature, Humidity, and Time-Lapse Video Data from the East River Watershed, Water Years 2024 and 2025

This dataset contains time-lapse imagery and distributed measurements of air temperature, relative humidity, dew point, and soil temperature across the East River basin from 3 October 2023 to 8 August 2025. Instruments were deployed at 19 sites as part of the DOE Grant: Seasonal Cycles Unravel Mysteries of Missing Mountain Water organized by Jessica Lundquist (University of Washington), Rosemary Carroll (Desert Research Institute), and Ethan Gutmann (National Center for Atmospheric Research). The data are published to support studies of surface climate or hydrologic processes in complex terrain. Measurements were collected with low-cost data loggers installed 2 m high on evergreen trees or buried just below the soil surface. Time-lapse cameras were deployed at three sites. Imagery from sites AP BONUS and AP5 (Avery Picnic) provides insight into large-scale seasonal snow cover variability. Imagery from site EL2 (Emerald Lake) shows smaller-scale snow patterns across a nearby meadow. Dataset files are organized by site and variable (air measurements, ground measurements, or time-lapse video). Air and ground measurements are packaged in LoggerData.zip, and time-lapse imagery is compiled into short videos stored in TimelapseVideos.zip. File-level metadata contains details for each file included in the dataset. A data dictionary provides units and descriptions for column or row names in all files. The locations metadata file describes site characteristics, locations, and associated GPS methods.

54 ENVIRONMENTAL SCIENCES↗

(abstract) Synthesis of Speaker Facial Movements to Match Selected Speech Sequences

We are developing a system for synthesizing image sequences the simulate the facial motion of a speaker. To perform this synthesis, we are pursuing two major areas of effort. We are developing the necessary computer graphics technology to synthesize a realistic image sequence of a person speaking selected speech sequences. Next, we are developing a model that expresses the relation between spoken phonemes and face/mouth shape. A subject is video taped speaking an arbitrary text that contains expression of the full list of desired database phonemes. The subject is video taped from the front speaking normally, recording both audio and video detail simultaneously. Using the audio track, we identify the specific video frames on the tape relating to each spoken phoneme. From this range we digitize the video frame which represents the extreme of mouth motion/shape. Thus, we construct a database of images of face/mouth shape related to spoken phonemes. A selected audio speech sequence is recorded which is the basis for synthesizing a matching video sequence; the speaker need not be the same as used for constructing the database. The audio sequence is analyzed to determine the spoken phoneme sequence and the relative timing of the enunciation of those phonemes. Synthesizing an image sequence corresponding to the spoken phoneme sequence is accomplished using a graphics technique known as morphing. Image sequence keyframes necessary for this processing are based on the spoken phoneme sequence and timing. We have been successful in synthesizing the facial motion of a native English speaker for a small set of arbitrary speech segments. Our future work will focus on advancement of the face shape/phoneme model and independent control of facial features.

graphics audio digitizing morphing enunciation pho↗

STS-49 Endeavour/Compiled Video for Editors

Compiled footage includes shots taken of the rollout of Endeavour at Palmdale, CA, the departure and arrival of Endeavour for Kennedy Space Center (KSC), main engine three installation, solid rocket booster (SRB) segment lift and stack at the Vehicle Assembly Building (VAB), external tank mate to SRB, Intelsat rotation at the Vertical Processing Facility (VPF), Endeavour rollover from the Orbiter Processing Facility (OPF) to VAB, rollout to Pad B, and the flight readiness firing (FRF). The crew is seen during the Terminal Countdown and Demonstration Test (TCDT) training activities, at breakfast, suiting up, and exiting the Operations and Checkout (O&C) Building.

Source record↗

When the Sky Falls: Performing Initial Assessments of Bright Atmospheric Events

The 2013 Chelyabinsk super bolide was the first "significant" impact event to occur in the age of social media and 24 hour news. Scientists, used to taking many days or weeks to analyze fireball events, were hard pressed to meet the immediate demands (within hours) for answers from the media, general public, and government officials. Fulfilling these requests forced many researchers to exploit information available from various Internet sources - videos were downloaded from sites like Youtube, geolocated via Google Street View, and quickly analyzed with improvised software; Twitter and Facebook were scoured for eyewitness accounts of the fireball and reports of meteorites. These data, combined with infrasound analyses, enabled a fairly accurate description of the Chelyabinsk event to be formed within a few hours; in particular, any relationship to 2012 DA14 (which passed near Earth later that same day) was eliminated. Results of these analyses were quickly disseminated to members of the NEO community for press conferences and media interviews. Despite a few minor glitches, the rapid initial assessment of Chelyabinsk was a triumph, permitting the timely conveyance of accurate information to the public and the incorporation of social media into fireball analyses. Beginning in 2008, the NASA Meteoroid Environments Office, working in cooperation with Western's Meteor Physics Group, developed processes and software that permit quick characterization - mass, trajectory, and orbital properties - of fireball events. These tools include automated monitoring of Twitter to establish the time of events (the first tweet is usually no more than a few seconds after the fireball), mining of Youtube and all sky camera web archives to locate videos suitable for analyses, use of Google Earth and Street View to geolocate the video locations, and software to determine the fireball trajectory and object orbital parameters, including generation of animations suitable for popular media and presentations. This presentation will give a short description of the characterization procedure and show applications of the tools, which have become vital to answering the question of "What was that bright light in the sky?" in the post-Chelyabinsk, 24/7 news world.

Cooke, William J.↗

A sequential DNN based Baseline Energy Prediction Framework with Long term Error Mitigation

In this paper,we aim to present a novel sequential framework containing two deep network architectures for baseline energy prediction, applied to a simulated commercial building dataset. We have observed that this sequential framework helps to improve long term prediction accuracy, there by mitigating prediction error accumulation over time. The proposed framework utilizes convolution layers to extract features from the input data space without changing spatial relations between variables. These features are memorized by tensor train based gated recurrent units for an accurate long-term prediction. Although, architecture comprising the amalgamation of convolution layers and memory cell have shown promising results in domains such as social media analysis, language modeling, video frame prediction and image recognition, this paper extends its scope to the context of energy applications. Furthermore, the addition of tensor train based gated recurrent units is motivated by the necessity of computational time reduction during the training process, there by making this framework more suitable for future in-field deployment. Lastly, results show the current framework outperforms other existing machine learning based methods, in both short-term and long-term prediction categories.

Chakraborty, Indrasis↗

Machine-learning-assisted analysis of transition metal dichalcogenide thin-film growth

In situ reflective high-energy electron diffraction (RHEED) is widely used to monitor the surface crystalline state during thin-film growth by molecular beam epitaxy (MBE) and pulsed laser deposition. With the recent development of machine learning (ML), ML-assisted analysis of RHEED videos aids in interpreting the complete RHEED data of oxide thin films. The quantitative analysis of RHEED data allows us to characterize and categorize the growth modes step by step, and extract hidden knowledge of the epitaxial film growth process. In this study, we employed the ML-assisted RHEED analysis method to investigate the growth of 2D thin films of transition metal dichalcogenides (ReSe2) on graphene substrates by MBE. Principal component analysis (PCA) and K-means clustering were used to separate statistically important patterns and visualize the trend of pattern evolution without any notable loss of information. Using the modified PCA, we could monitor the diffraction intensity of solely the ReSe2 layers by filtering out the substrate contribution. These findings demonstrate that ML analysis can be successfully employed to examine and understand the film-growth dynamics of 2D materials. Further, the ML-based method can pave the way for the development of advanced real-time monitoring and autonomous material synthesis techniques.

36 MATERIALS SCIENCE↗

Hybrid vision activities at NASA Johnson Space Center

NASA's Johnson Space Center in Houston, Texas, is active in several aspects of hybrid image processing. (The term hybrid image processing refers to a system that combines digital and photonic processing). The major thrusts are autonomous space operations such as planetary landing, servicing, and rendezvous and docking. By processing images in non-Cartesian geometries to achieve shift invariance to canonical distortions, researchers use certain aspects of the human visual system for machine vision. That technology flow is bidirectional; researchers are investigating the possible utility of video-rate coordinate transformations for human low-vision patients. Man-in-the-loop teleoperations are also supported by the use of video-rate image-coordinate transformations, as researchers plan to use bandwidth compression tailored to the varying spatial acuity of the human operator. Technological elements being developed in the program include upgraded spatial light modulators, real-time coordinate transformations in video imagery, synthetic filters that robustly allow estimation of object pose parameters, convolutionally blurred filters that have continuously selectable invariance to such image changes as magnification and rotation, and optimization of optical correlation done with spatial light modulators that have limited range and couple both phase and amplitude in their response.

Juday, Richard D.↗

Application of modified VICAR/IBIS GIS to analysis of July 1991 Flevoland AIRSAR data

Three overflights of the Flevoland calibration/agricultural site were made by the JPL Airborne Synthetic Aperture Radar (AIRSAR) on 3, 12, and 28 July 1991 as part of MAC-Europe '92. A polygon map was generated at TNO-FEL which overlayed the slant range projected July 3 data set. Each polygon was identified by a sequence of points and a crop label. The polygon map was composed of 452 uniquely identified polygons and 15 different crop types. Analysis of the data was done using our modified Video Image Communication and Retrieval/Image Based Information System Geographic Information System (VICAR/IBIS GIS). This GIS is an extension of the VICAR/IBIS GIS first developed by Bryant in the 1970's which is itself an extension of the VICAR image processing system also developed at JPL.

Norikane, L.↗

Interaction of Burning Metal Particles

Physical characteristics of the combustion of metal particle groups have been addressed in this research. The combustion behavior and interaction effects of multiple metal particles has been studied using a microgravity environment, which presents a unique opportunity to create an "aerosol" consisting of relatively large particles, i.e., 50-300 m diameter. Combustion behavior of such an aerosol could be examined using methods adopted from well-developed single particle combustion research. The experiment included fluidizing relatively large (order of 100 m diameter) uniform metal particles under microgravity and igniting such an "aerosol" using a hot wire igniter. The flame propagation and details of individual particle combustion and particle interaction have been studied using a high speed movie and video-imaging with cameras coupled with microscope lenses to resolve individual particles. Interference filters were used to separate characteristic metal and metal oxide radiation bands from the thermal black body radiation. Recorded flame images were digitized and various image processing techniques including flame position tracking, color separation, and pixel by pixel image comparison were employed to understand the processes occurring in the burning aerosol. The development of individual particle flames, merging or separation, and extinguishment as well as induced particle motion have been analyzed to identify the mechanisms governing these processes. Size distribution, morphology, and elemental compositions of combustion products were characterized and used to link the observed in this project aerosol combustion phenomena with the recently expanded mechanism of single metal particle combustion.

Dreizin, Edward L.↗

STS-107 Flight Day 6 Highlights

This video shows the activities of the STS-107 crew on flight day 6 of the Columbia orbiter's final mission. The crew members include: Rick Husband, Commander; William McCool, Pilot; Kalpana Chawla, David Brown, Michael Anderson, Laurel Clark; Mission Specialists; Ilan Ramon, Payload Specialist. The primary activities of flight day 6 are spaceborne experiments, and a conversation between Israeli Prime Minister Ariel Sharon, accompanied by the Israeli Minister of Education, and Israeli astronaut Ilan Ramon. Both the Israelis and their interpreter are audible on the tape. The video also features a bioreactor used to grow cancer cells in microgravity, and footage taken by the Mediterranean Israeli Dust Experiment (MEIDEX) of sprites, lightning in the lower ionosphere. Mission Specialist Anderson is shown working on the Laminar Soot Processes (LSP-2) experiment. Pilot McCool answers two questions from the public, and a view of Panama is shown.

Source record↗

Light Microscopy Module Imaging Tested and Demonstrated

The Fluids Integrated Rack (FIR), a facility-class payload, and the Light Microscopy Module (LMM), a subrack payload, are integrated research facilities that will fly in the U.S. Laboratory module, Destiny, aboard the International Space Station. Both facilities are being engineered, designed, and developed at the NASA Glenn Research Center by Northrop Grumman Information Technology. The FIR is a modular, multiuser scientific research facility that is one of two racks that make up the Fluids and Combustion Facility (the other being the Combustion Integrated Rack). The FIR has a large volume dedicated for experimental hardware; easily reconfigurable diagnostics, power, and data systems that allow for unique experiment configurations; and customizable software. The FIR will also provide imagers, light sources, power management and control, command and data handling for facility and experiment hardware, and data processing and storage. The first payload in the FIR will be the LMM. The LMM integrated with the FIR is a remotely controllable, automated, on-orbit microscope subrack facility, with key diagnostic capabilities for meeting science requirements--including video microscopy to observe microscopic phenonema and dynamic interactions, interferometry to make thin-film measurements with nanometer resolution, laser tweezers to manipulate micrometer-sized particles, confocal microscopy to provide enhanced three-dimensional visualization of structures, and spectrophotometry to measure the photonic properties of materials. Vibration disturbances were identified early in the LMM development phase as a high risk for contaminating the science microgravity environment. An integrated FIR-LMM test was conducted in Glenn's Acoustics Test Laboratory to assess mechanical sources of vibration and their impact to microscopic imaging. The primary purpose of the test was to characterize the LMM response at the sample location, the x-y stage within the microscope, to vibration emissions from the FIR and LMM support structures.

Gati, Frank↗

Remote Home Energy Score Assessments (Feasibility Study)

The delivery of Home Energy Scores (HES) has been significantly impacted over the last year by the recent pandemic and ongoing limitations to person-to-person interactions. There are also historic challenges in providing HES to more remote geographies where assessor infrastructure is not in place. Alternative approaches to in-person, on-site home energy assessments could help address these current restrictions, while also potentially providing opportunities for the efficient delivery of HES in certain use cases after COVID-related restrictions are lifted. From the program administrator’s perspective, there needs to be confidence that the remote scores closely match what they would have been if the assessment had been performed on-site. The recommendations shown on a report generated from a remote score should closely match those of an onsite assessment. A remote assessment should be an option for all HES Partners and have direction on how to deliver those scores. From the HES partner’s and assessor’s perspective, there needs to be understanding of what level of experience is needed, what system infrastructure is required, the time expenditure of the remote assessment process, and the limitations of a remote assessment. From the homeowner’s perspective, there needs to be an awareness and comfort with the time commitment, the level of knowledge of the home, the equipment needed, and any physical requirements of the remote assessment process. During this study, Earth Advantage assessed methods for delivering Home Energy Score assessments remotely through web-based technology platforms and resident interaction in a diverse array of home types in different geographic locations. Earth Advantage developed remote assessment test protocols and integrated those testing protocols into existing Home Energy Score programs being overseen by USDOE Home Energy Score partners New York State Energy Research & Development Authority (NYSERDA), the Oregon Department of Energy (ODOE), and the City of Portland (PDX). Earth Advantage staff acted as the Remote assessor and gathered HES data remotely during the video sessions with participants. Authorized Home Energy Score assessors performed the onsite assessments that were then used to compare with the remote assessment data. This allowed the research to effectively test the efficacy of various remote assessment approaches in a diverse array of home-types. Earth advantage identified the key components of a remote assessment infrastructure which included Remote Home Energy Score Assessments Page vi processes, tools, services, methods and mechanisms that would better enable remote assessments. This report details methods, results, and findings of the HES remote assessment research. In addition, the report provides recommendations and best practices that could be used as guidance for the Home Energy Score administrator and the HES partners seeking to effectively conduct remote assessments.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Cognitive Modeling of Video Game Player User Experience

This paper argues for the use of cognitive modeling to gain a detailed and dynamic look into user experience during game play. Applying cognitive models to game play data can help researchers understand a player's attentional focus, memory status, learning state, and decision strategies (among other things) as these cognitive processes occurred throughout game play. This is a stark contrast to the common approach of trying to assess the long-term impact of games on cognitive functioning after game play has ended. We describe what cognitive models are, what they can be used for and how game researchers could benefit by adopting these methods. We also provide details of a single model - based on decision field theory - that has been successfUlly applied to data sets from memory, perception, and decision making experiments, and has recently found application in real world scenarios. We examine possibilities for applying this model to game-play data.

Bohil, Corey J.↗

Creep Measurement Video Extensometer

Understanding material behavior under load is critical to the efficient and accurate design of advanced aircraft and spacecraft. Technologies such as the one disclosed here allow accurate creep measurements to be taken automatically, reducing error. The goal was to develop a non-contact, automated system capable of capturing images that could subsequently be processed to obtain the strain characteristics of these materials during deformation, while maintaining adequate resolution to capture the true deformation response of the material. The measurement system comprises a high-resolution digital camera, computer, and software that work collectively to interpret the image.

Jaster, Mark↗

Low-cost information distribution - New directions for technology developments

The use of space satellites for data storage and retrieval is discussed with respect to short-term (1978-1985) and long-term (1985-2000) developments. The present structure, where access to satellite-transmitted data is controlled largely by the Federal Government for its own use, will be gradually replaced by a continually expanding user-community with a broadening scope of needs. Technological improvements in satellite-communication and data-processing will drive down the cost of both transmitting and receiving hardware, making such hardware available to more and more people. By the closing years of the century, personal, direct satellite communication should be available to every American household, providing video, printed, and archivable data over a wide range of subjects, from bank statements to medical records.

Catoe, C. E.↗

Technical and economic feasibility of integrated video service by satellite

The trends and roles of satellite based video services in the year 2010 time frame are examined based on an overall network and service model for that period. Emphasis is placed on point to point and multipoint service, but broadcast could also be accommodated. An estimate of the video traffic is made and the service and general network requirements are identified. User charges are then estimated based on several usage scenarios. In order to accommodate these traffic needs, a 28 spot beam satellite architecture with on-board processing and signal mixing is suggested.

Price, Kent M.↗

Multi-Sensor Testing for Automated Rendezvous and Docking Sensor Testing at the Flight Robotics Laboratory

The Exploration Systems Architecture defines missions that require rendezvous, proximity operations, and docking (RPOD) of two spacecraft both in Low Earth Orbit (LEO) and in Low Lunar Orbit (LLO). Uncrewed spacecraft must perform automated and/or autonomous rendezvous, proximity operations and docking operations (commonly known as AR&D). The crewed missions may also perform rendezvous and docking operations and may require different levels of automation and/or autonomy, and must provide the crew with relative navigation information for manual piloting. The capabilities of the RPOD sensors are critical to the success of the Exploration Program. NASA has the responsibility to determine whether the Crew Exploration Vehicle (CEV) contractor proposed relative navigation sensor suite will meet the requirements. The relatively low technology readiness level of AR&D relative navigation sensors has been carried as one of the CEV Project's top risks. The AR&D Sensor Technology Project seeks to reduce the risk by the testing and analysis of selected relative navigation sensor technologies through hardware-in-the-loop testing and simulation. These activities will provide the CEV Project information to assess the relative navigation sensors maturity as well as demonstrate test methods and capabilities. The first year of this project focused on a series of"pathfinder" testing tasks to develop the test plans, test facility requirements, trajectories, math model architecture, simulation platform, and processes that will be used to evaluate the Contractor-proposed sensors. Four candidate sensors were used in the first phase of the testing. The second phase of testing used four sensors simultaneously: two Marshall Space Flight Center (MSFC) Advanced Video Guidance Sensors (AVGS), a laser-based video sensor that uses retroreflectors attached to the target vehicle, and two commercial laser range finders. The multi-sensor testing was conducted at MSFC's Flight Robotics Laboratory (FRL) using the FRL's 6-DOF gantry system, called the Dynamic Overhead Target System (DOTS). The target vehicle for "docking" in the laboratory was a mockup that was representative of the proposed CEV docking system, with added retroreflectors for the AVGS. The multi-sensor test configuration used 35 open-loop test trajectories covering three major objectives: (1) sensor characterization trajectories designed to test a wide range of performance parameters; (2) CEV-specific trajectories designed to test performance during CEV-like approach and departure profiles; and (3) sensor characterization tests designed for evaluating sensor performance under more extreme conditions as might be induced during a spacecraft failure or during contingency situations. This paper describes the test development, test facility, test preparations, test execution, and test results of the multi-sensor series of trajectories.

Brewster, L.↗

Multi-Sensor Testing for Automated Rendezvous and Docking Sensor Testing at the Flight Robotics Lab

The Exploration Systems Architecture defines missions that require rendezvous, proximity operations, and docking (RPOD) of two spacecraft both in Low Earth Orbit (LEO) and in Low Lunar Orbit (LLO). Uncrewed spacecraft must perform automated and/or autonomous rendezvous, proximity operations and docking operations (commonly known as AR&D). The crewed missions may also perform rendezvous and docking operations and may require different levels of automation and/or autonomy, and must provide the crew with relative navigation information for manual piloting. The capabilities of the RPOD sensors are critical to the success ofthe Exploration Program. NASA has the responsibility to determine whether the Crew Exploration Vehicle (CEV) contractor-proposed relative navigation sensor suite will meet the requirements. The relatively low technology readiness level of AR&D relative navigation sensors has been carried as one of the CEV Project's top risks. The AR&D Sensor Technology Project seeks to reduce the risk by the testing and analysis of selected relative navigation sensor technologies through hardware-in-the-Ioop testing and simulation. These activities will provide the CEV Project information to assess the relative navigation sensors maturity as well as demonstrate test methods and capabilities. The first year of this project focused on a series of "pathfinder" testing tasks to develop the test plans, test facility requirements, trajectories, math model architecture, simulation platform, and processes that will be used to evaluate the Contractor-proposed sensors. Four candidate sensors were used in the first phase of the testing. The second phase of testing used four sensors simultaneously: two Marshall Space Flight Center (MSFC) Advanced Video Guidance Sensors (AVGS), a laser-based video sensor that uses retroreflectors attached to the target vehicle, and two commercial laser range finders. The multi-sensor testing was conducted at MSFC's Flight Robotics Laboratory (FRL) using the FRL's 6-DOF gantry system, called the Dynamic Overhead Target System (DOTS). The target vehicle for "docking" in the laboratory was a mockup that was representative of the proposed CEV docking system, with added retroreflectors for the AVGS.' The multi-sensor test configuration used 35 open-loop test trajectories covering three major objectives: (l) sensor characterization trajectories designed to test a wide range of performance parameters; (2) CEV-specific trajectories designed to test performance during CEV-like approach and departure profiles; and (3) sensor characterization tests designed for evaluating sensor performance under more extreme conditions as might be induced during a spacecraft failure or during contingency situations. This paper describes the test development, test facility, test preparations, test execution, and test results of the multisensor series oftrajectories

Brewster, Linda L.↗