Search NASA⌕ Search

SEARCH · Search NASA

Results for “Streaming video”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

GEMINI Case Study

Sandia's GEMINI-Scout Mine Rescue Robot is an unmanned ground vehicle designed to enter potentially hazardous environments to explore, assess, and evaluate dangerous situations first responders may face when conducting a rescue mission. GEMINI is approximately four feet long and two feet tall, which enables the robot to maneuver through small locations on rough terrains caused by earthquakes, fires, or radiological incidents. GEMINI uses track propulsion to climb stairs, travel through gravel and sand pits, pivot in place, and traverse 45-degree climbs with few problems. Furthermore, the vehicle's dual tracked-chassis design allows it to operate in hostile, dark, muddy, high-temperature, and explosive debris-strewn environments, while maintaining efficient ground mobility. The mobility and modularity of the vehicle allow for easy integration of sensors to conduct gas and temperature sensing and offers pan/tilt, zoom color, and thermal camera video streaming capabilities. The vehicle is also able to carry a payload of about 50 pounds of batteries and can handle an additional 200 pounds of payload, whether for additional diagnostics, supplies, or clothing for those trapped in an effected area. GEMINI is remotely operated through a wireless connection and an onboard computer running a customized embedded control application, which directly communicates to all onboard components except for the audio and video systems. When line of sight is not possible, operators use a shockresistant fiber optic cable to ensure continuous functionality of the vehicle. This allows for direct local control of the vehicle, which streams collected data back to the operator for enhanced situational awareness. In addition, the vehicle incorporates safety features such as explosion proof housing to ensure safe electronic operations in hazardous gas or flooded environments; a four-channel video link and two-way audio to ensure located survivors can communicate with operators; and an MSHA-approved multi-gas sensor to monitor air quality.

42 ENGINEERING↗
DOE OSTI2021

FPV Video Adaptation for UAV Collision Avoidance

First person view (FPV) technology for unmanned aerial vehicles (UAVs) provides an immersive experience for pilots and enables various personal and commercial applications such as aerial photography, drone racing, search and rescue operations, agricultural surveillance, and structural inspection. While real time video streaming from a UAV and vision-based collision avoidance strategies have been studied in literature as separate topics, in this paper we tackle collision avoidance in FPV scenarios, taking into account network delays and real time video parameters. We present a theoretical model for obstacle collisions that considers the current communication channel conditions, the real time video parameters, and the UAV's position relative to the closest obstacle. A video adaptation algorithm is then designed, using this metric, to tune the FPV video resolution, number of re-transmission attempts, and the modulation scheme to maximize the probability of avoiding collisions. This algorithm also takes into account specific latency constraints of the application. This video algorithm was evaluated in various scenarios and its ability to respond to both distances to the obstacle as well as the communication channel conditions was demonstrated. It was found that, for the considered scenarios, the performance of the proposed adaptive algorithm was, on an average, 58.63% higher than the closest non-adaptive one in terms of maximizing the probability of avoiding collision. Such collision avoidance strategies could be used to make UAV FPV applications safer and more reliable.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Edge AI-Enhanced Traffic Monitoring and Anomaly Detection Using Multimodal Large Language Models

This paper addresses the challenge of traffic monitoring and incident detection in remote areas, utilizing multimodal large language models (LLMs) deployed on edge AI devices. The key novelty of the LLM is to convert real-time video streams into descriptive texts, enabling low-bandwidth transmissions and reliable detection of anomalies and incidents in environments of intermittent connectivity. The model is developed based on fine-tuning open-source LLMs and extending it with multi-modal capabilities to analyze video frames. Our work also involves deploying this model on edge devices such as Nvidia IGX Orin and is planned to be tested in realistic environments in future work. The methodology includes data set curation, iterative model fine-tuning and compression, and hardware-based optimization. This approach aims to enhance traffic safety and response speed in remote areas, marking a significant advancement in the application of AI for traffic monitoring and safety management.

Peruski, Ryan [University of Tennessee, Knoxville ↗
NASA NTRS1981

Entropy encoding applied to a video DM bit stream

This paper investigates bandwidth compression of delta modulated video signals using a variety of novel techniques. The video signal is encoded at 16 MHz with an adaptive delta modulator (ADM) using the Song video mode algorithm. One method of achieving bandwidth compression is through the detection and reduction of steady state patterns in the DM bit stream. Further reduction is obtained by deleting the horizontal and vertical drive information. Finally, a modified ADM algorithm is introduced to increase the frequency of steady state patterns. When the modified ADM is combined with entropy coding a 30-50% data compression can be realized.

Barba, J.↗
DOE OSTI2022

A Topological Approach for Motion Track Discrimination

Detecting small targets at range is difficult because there is not enough spatial information present in an image sub-region containing the target to use correlation-based methods to differentiate it from dynamic confusers present in the scene. Moreover, this lack of spatial information also disqualifies the use of most state-of-the-art deep learning image-based classifiers. Here, we use characteristics of target tracks extracted from video sequences as data from which to derive distinguishing topological features that help robustly differentiate targets of interest from confusers. In particular, we calculate persistent homology from time-delayed embeddings of dynamic statistics calculated from motion tracks extracted from a wide field-of-view video stream. In short, we use topological methods to extract features related to target motion dynamics that are useful for classification and disambiguation and show that small targets can be detected at range with high probability.

Emerson, Tegan H.↗
DOE OSTI2024

Segmentation Model Distillation [Poster]

The process of training object detection (OD) or image segmentation model requires both a substantial amount of data and technical knowledge, which often creates challenges in applying these types of models to their full potential. In order to streamline the process of developing these models, we propose a new pipeline where a foundation model assists in the dataset generation. Then this resulting dataset is used to fine-tune a fast light-weight model to perform the custom segmentation or OD. This resulting model is also fit for real-time image segmentation, such as in a video stream.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

RICH (Robotic Interface Control & Handling) System for VULCAN

High flux neutron beam and high efficiency detectors warrant quick turn arounds of neutron diffraction measurements at the engineering materials diffractometer VULCAN. Efficient change and alignment of samples and automatic measurements at VULCAN are desired for better use of neutron beam time by users. In this work, we aim to develop a proof-of-concept Robotic Interactive Control & Handling System (RICH) for sample handling at VULCAN that could assist high throughput experiments and reduce the overhead time significantly. This was realized by a six-axis desktop robot with trained AI models. The trained AI models can recognize and locate samples in various types of positions in a live video stream. In addition, we developed smart algorithms which used our models on multiple cameras to recognize where samples are with respect to multiple point of views, and then using user-inputted parameters, align them to perform complex measurements.

42 ENGINEERING↗
DOE OSTI2025

Vehicular Re-Identification from Uncontrolled Multiple Views

Vehicle re-identification (re-ID) across disparate sensing modalities remains a fundamental challenge for transportation research. In this work, we introduce a deep multi-view vehicle re-ID framework that leverages Siamese networks to compare pairs of vehicle images and produce matching scores, enabling robust association across drastically different viewpoints such as those from UAVs, surveillance cameras, and ground sensors. The model exploits convolutional neural networks to learn features that remain discriminative under changes in angle, distance, and illumination, supporting more generalizable re-ID performance. As part of this effort, we also developed an automated pipeline to synchronize roadside and UAV video streams, producing a multi-perspective dataset that complements preexisting real collections and a synthetic dataset generated in this study. Together, these contributions advance the capability to re-identify vehicles across wide viewing baselines; establish a foundation for scalable, reproducible research in vehicle re-ID; and open pathways for future applications, such as inferring routine behaviors, movement patterns, and daily habits of the individual associated with the vehicle.

convolutional neural networks↗
DOE OSTI2023

Visible Light Communications: A Survey on Recent High-Capacity Demonstrations and Digital Modulation Techniques

In order to deal with the increasing number of mobile devices and with their demand for Internet services, particularly social media platforms, streaming video, and online gaming, Radio-Frequency (RF) wireless networks have been pushed to their capacity limits. In addition to this, 80% of the total data traffic is carried out by users inside buildings. Therefore, new technologies have started to be considered for indoor wireless communications. Visible Light Communications (VLC) can provide both illumination and communications, appearing as an alternative or complement to RF wireless networks. VLC offers high bandwidth and immunity to interference from electromagnetic sources. This manuscript reviews recent high-capacity VLC demonstrations. The main focus of this work is to present digital-signal-processing techniques used in VLC systems. Different modulation formats are analyzed, which can be divided into two large groups, namely single-carrier and multi-carrier modulation schemes. Finally, some recently proposed capacity-achieving strategies are presented. We discuss how to implement these techniques and how they will be useful for the continued development of VLC systems.

Loureiro, Pedro A. (ORCID:0000000283546185)↗
NASA NTRS1975

A CCD image transducer and processor suitable for space flight

A satellite borne extreme ultraviolet solar telescope makes use of CCD area arrays for both image readout and onboard data processing. The instrument is designed to view the inner solar corona in the wavelength band 170 - 630 A, and the output video stream may be selected by ground command to present the coronal scene, or the time-rate-of-change of the scene. Details of the CCD application to onboard image processing are described, and a discussion of the processor's potential for telemetry bandwidth compression is included. Optical coupling methods, data storage requirements, spatial and temporal resolution, and nonsymmetry of resolution (pitch) in the CCD are discussed.

Michels, D. J.↗
NASA NTRS1994

Performance of customized DCT quantization tables on scientific data

We show that it is desirable to use data-specific or customized quantization tables for scaling the spatial frequency coefficients obtained using the Discrete Cosine Transform (DCT). DCT is widely used for image and video compression (MP89, PM93) but applications typically use default quantization matrices. Using actual scientific data gathered from divers sources such as spacecrafts and electron-microscopes, we show that the default compression/quality tradeoffs can be significantly improved upon by using customized tables. We also show that significant improvements are possible for the standard test images Lena and Baboon. This work is part of an effort to develop a practical scheme for optimizing quantization matrices for any given image or video stream, under any given quality or compression constraints.

Ratnakar, Viresh↗
NASA NTRS1998

Aeronautics Learning Laboratory for Science, Technology, and Research (ALLSTAR)

We finished the material development of Level 1, Level 2 and most of Level 3. We created three new galleries, one of streaming videos enabling the user to select his/her appropriate speed of Internet connectivity for better performance. The second gallery on NASA's X-series aircraft and the third is on F-series aircraft. We also completed the placement and activation of all thirteen kiosks. We added one more kiosk over the number suggested in the proposal at Baker Aviation High School - a Dade County Public School for special aviation programs. We felt that the goals of this school matched ALLSTAR's goals and that the placement of the kiosk would better help the local students become interested in the Aviation and Aeronautics field. We continue to work on the development of our "Teacher Resource Guide to ALLSTAR material" in which we tied our material into the national and Florida State standards. We finished the Florida Sunshine State standards, getting positive feedback from local and other educators who use the material on a regular basis. We had another successful workshop on October 29 th, 1997. We introduced the ALLSTAR website and kiosk to about twenty science and history teachers from Dade County Public Schools (DCPS). Most teachers were from middle schools, although we had some from elementary schools also. We provided several demonstrations of the ALLSTAR material to local schools in the Dade County Public Schools (DCPS) system. We used the ALLSTAR material with FIU's summer immersion program for FLAME students. This program includes a high number of minority students interested in science and engineering. We also presented the material at National Science Teachers Association (NSTA) and National Congress on Aviation and Space Education (NCASE) conferences and will be presenting the material at the Southeast Florida Aviation Consortium (SEFAC). We provided two on-site workshops in the NSTA conference with total attended of about 70 teachers. The BBS was converted to an on-line discussion forum with a unique section on Blacks in Aviation, Prime Technologies coordinated with NASA LaRC and the Teacher Resource Centers (TRCs) for scale-up of ALLSTAR and performed live demonstrations of the software in schools and at conventions.

Levy, Cesar↗
NASA NTRS1998

NASA ALLSTAR Project

We finished the material development of Level 1, Level 2 and most of Level 3. We created three new galleries, one of streaming videos enabling the user to select his/her appropriate speed of Internet connectivity for better performance. The second gallery on NASA's X-series aircraft and the third is on F-series aircraft, We also completed the placement and activation of all thirteen kiosks. We added one more kiosk over the number suggested in the proposal at Baker Aviation High School - a Dade County Public School for special aviation programs. We felt that the goals of this school matched ALLSTAR's goals and that the placement of the kiosk would better help the local students become interested in the Aviation and Aeronautics field. We continue to work on the development of our "Teacher Resource Guide to ALLSTAR material" in which we tied our material into the national and Florida State standards. We finished the Florida Sunshine State standards, getting positive feedback from local and other educators who use the material on a regular basis. We had another successful workshop on October 29th, 1997. We introduced the ALLSTAR website and kiosk to about twenty science and history teachers from Dade County Public Schools (DCPS). Most teachers were from middle schools, although we had some from elementary schools also. We provided several demonstrations of the ALLSTAR material to local schools in the Dade County Public Schools (DCPS) system. We used the ALLSTAR material with FIU's summer immersion program for FLAME students. This program includes a high number of minority students interested in science and engineering. We also presented the material at National Science Teachers Association (NSTA) and National Congress on Aviation and Space Education (NCASE) conferences and will be presenting the material at the Southeast Florida Aviation Consortium (SEFAC). We provided two on-site workshops in the NSTA conference with total attended of about 70 teachers. The BBS was converted to an on-line discussion forum with a unique section on Blacks in Aviation, Prime Technologies coordinated with NASA LaRC and the Teacher Resource Centers (TRCS) for scale-up of ALLSTAR and performed live demonstrations of the software in schools and at conventions.

Levy, Cesar↗
NASA NTRS1998

NASA Allstar Project Aeronautics Learning Laboratory for Science,Technology, and Research (Allstar)

We finished the material development of Level 1, Level 2 and most of Level 3. We created three new galleries, one of streaming videos enabling the user to select his/her appropriate speed of Internet connectivity for better performance. The second gallery on NASA's X-series aircraft and the third is on F-series aircraft. We also completed the placement and activation of all thirteen kiosks. We added one more kiosk over the number suggested in the proposal at Baker Aviation High School - a Dade County Public School for special aviation programs. We felt that the goals of this school matched ALLSTAR's goals and that the placement of the kiosk would better help the local students become interested in the Aviation and Aeronautics field. We continue to work on the development of our "Teacher Resource Guide to ALLSTAR material" in which we tied our material into the national and Florida State standards. We finished the Florida Sunshine State standards, getting positive feedback from local and other educators who use the material on a regular basis. We had another successful workshop on October 29', 1997. We introduced the ALLSTAR website and kiosk to about twenty science and history teachers from Dade County Public Schools (DCPS). Most teachers were from middle schools, although we had some from elementary schools also. We provided several demonstrations of the ALLSTAR material to local schools in the Dade County Public Schools (DCPS) system. We used the ALLSTAR material with FIU's summer immersion program for FLAME students. This program includes a high number of minority students interested in science and engineering. We also presented the material at National Science Teachers Association (NSTA) and National Congress on Aviation and Space Education (NCASE) conferences and will be presenting the material at the Southeast Florida Aviation Consortium (SEFAC). We provided two on-site workshops in the NSTA conference with total attended of about 70 teachers. The BBS was converted to an on-line discussion forum with a unique section on Blacks in Aviation. Prime Technologies coordinated with NASA LARC and the Teacher Resource Centers (TRCs) for scale-up of ALLSTAR and performed live demonstrations of the software in schools and at conventions.

Levy, Cesar↗
NASA NTRS2004

Spaceflight Operations Services Grid (SOSG)

In an effort to adapt existing space flight operations services to new emerging Grid technologies we are developing a Grid-based prototype space flight operations Grid. This prototype is based on the operational services being provided to the International Space Station's Payload operations located at the Marshall Space Flight Center, Alabama. The prototype services will be Grid or Web enabled and provided to four user communities through portal technology. Users will have the opportunity to assess the value and feasibility of Grid technologies to their specific areas or disciplines. In this presentation descriptions of the prototype development, User-based services, Grid-based services and status of the project will be presented. Expected benefits, findings and observations (if any) to date will also be discussed. The focus of the presentation will be on the project in general, status to date and future plans. The End-use services to be included in the prototype are voice, video, telemetry, commanding, collaboration tools and visualization among others. Security is addressed throughout the project and is being designed into the Grid technologies and standards development. The project is divided into three phases. Phase One establishes the baseline User-based services required for space flight operations listed above. Phase Two involves applying Gridlweb technologies to the User-based services and development of portals for access by users. Phase Three will allow NASA and end users to evaluate the services and determine the future of the technology as applied to space flight operational services. Although, Phase One, which includes the development of the quasi-operational User-based services of the prototype, development will be completed by March 2004, the application of Grid technologies to these services will have just begun. We will provide status of the Grid technologies to the individual User-based services. This effort will result in an extensible environment that incorporates existing and new spaceflight services into a standards-based framework providing current and future NASA programs with cost savings and new and evolvable methods to conduct science. This project will demonstrate how the use of new programming paradigms such as web and grid services can provide three significant benefits to the cost-effective delivery of spaceflight services. They will enable applications to operate more efficiently by being able to utilize pooled resources. They will also permit the reuse of common services to rapidly construct new and more powerful applications. Finally they will permit easy and secure access to services via a combination of grid and portal technology by a distributed user community consisting of NASA operations centers, scientists, the educational community and even the general population as outreach. The approach will be to deploy existing mission support applications such as the Telescience Resource Kit (TReK) and new applications under development, such as the Grid Video Distribution System (GViDS), together with existing grid applications and services such as high-performance computing and visualization services provided by NASA s Information Power Grid (IPG) in the MSFC s Payload Operations Integration Center (POIC) HOSC Annex. Once the initial applications have been moved to the grid, a process will begin to apply the new programming paradigms to integrate them where possible. For example, with GViDS, instead of viewing the Distribution service as an application that must run on a single node, the new approach is to build it such that it can be dispatched across a pool of resources in response to dynamic loads. To make this a reality, reusable services will be critical, such as a brokering service to locate appropriate resource within the pool. This brokering service can then be used by other applications such as the TReK. To expand further, if the GViDS application is constructed using a services-based mel, then other applications such as the Video Auditorium can then use GViDS as a service to easily incorporate these video streams into a collaborative conference. Finally, as these applications are re-factored into this new services-based paradigm, the construction of portals to integrate them will be a simple process. As a result, portals can be tailored to meet the requirements of specific user communities.

Bradford, Robert N.↗
NASA NTRS2004

Statistical and Prediction modeling of the Ka Band Using Experimental Results from ACTS Propagation Terminals at 20.185 and 27.505 GHZ

With the increase in demand for wireless communication services, most of the operating frequency bands have become very congested. The increase of wireless costumers is only fractional contribution to this phenomenon. The demand for more services such as video streams and internet explorer which require a lot of band width has been a more significant contributor to the congestion in a communication system. One way to increase the amount of information or data per unit of time transmitted with in a wireless communication system is to use a higher radio frequency. However in spite the advantage available in the using higher frequency bands such as, the Ka-band, higher frequencies also implies short wavelengths. And shorter wavelengths are more susceptible to rain attenuation. Until the Advanced Communication Technology Satellite (ACTS) was launched, the Ka- band frequency was virtually unused - the majority of communication satellites operated in lower frequency bands called the C- and Ku- bands. Ka-band is desirable because its higher frequency allows wide bandwidth applications, smaller spacecraft and ground terminal components, and stronger signal strength. Since the Ka-band is a high frequency band, the millimeter wavelengths of the signals are easily degraded by rain. This problem known as rain fade or rain attenuation The Advanced Communication Technology Satellite (ACTS) propagation experiment has collected 5 years of Radio Frequency (RF) attenuation data from December 1993 to November 1997. The objective of my summer work is to help develop the statistics and prediction techniques that will help to better characterize the Ka Frequency band. The statistical analysis consists of seasonal and cumulative five-year attenuation statistics for the 20.2 and 27.5 GHz. The cumulative five-year results give the link outage that occurs for a given link margin. The experiment has seven ground station terminals that can be attributed to a unique rain zone climate. The locations are White Sands, NM, Tampa, Fly Clarksburg, MD, Norman, OK, Ft. Collins, COY Vancouver, BC, and Fairbanks, AK. The analysis will help us to develop and define specific parameters that will help system engineers develop the appropriated instrumentation and structure for a Ka-band wireless communication systems and networks.

Ogunwuyi, Oluwatosin O.↗
NASA NTRS2006

Advanced Visualization of Experimental Data in Real Time Using LiveView3D

LiveView3D is a software application that imports and displays a variety of wind tunnel derived data in an interactive virtual environment in real time. LiveView3D combines the use of streaming video fed into a three-dimensional virtual representation of the test configuration with networked communications to the test facility Data Acquisition System (DAS). This unified approach to real time data visualization provides a unique opportunity to comprehend very large sets of diverse forms of data in a real time situation, as well as in post-test analysis. This paper describes how LiveView3D has been implemented to visualize diverse forms of aerodynamic data gathered during wind tunnel experiments, most notably at the NASA Langley Research Center Unitary Plan Wind Tunnel (UPWT). Planned future developments of the LiveView3D system are also addressed.

Schwartz, Richard J.↗
NASA NTRS2005

Vision Based Localization in Urban Environments

As part of DARPA's MARS2020 program, the Jet Propulsion Laboratory developed a vision-based system for localization in urban environments that requires neither GPS nor active sensors. System hardware consists of a pair of small FireWire cameras and a standard Pentium-based computer. The inputs to the software system consist of: 1) a crude grid-based map describing the positions of buildings, 2) an initial estimate of robot location and 3) the video streams produced by each camera. At each step during the traverse the system: captures new image data, finds image features hypothesized to lie on the outside of a building, computes the range to those features, determines an estimate of the robot's motion since the previous step and combines that data with the map to update a probabilistic representation of the robot's location. This probabilistic representation allows the system to simultaneously represent multiple possible locations, For our testing, we have derived the a priori map manually using non-orthorectified overhead imagery, although this process could be automated. The software system consists of two primary components. The first is the vision system which uses binocular stereo ranging together with a set of heuristics to identify features likely to be part of building exteriors and to compute an estimate of the robot's motion since the previous step. The resulting visual features and the associated range measurements are software component, a particle-filter based localization system. This system uses the map and the then fed to the second primary most recent results from the vision system to update the estimate of the robot's location. This report summarizes the design of both the hardware and software and will include the results of applying the system to the global localization of a robot over an approximately half-kilometer traverse across JPL'S Pasadena campus.

unmanned-ground vehicles↗