Limitations to nighttime visual observations from satellites
Limitations of nighttime visual observations from satellites
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Limitations of nighttime visual observations from satellites
If it were 50 years ago, NASA's contribution to rock and roll could have been more than just the all-astronaut rock band, Max Q, composed of six NASA astronauts, all of whom have flown aboard the Space Shuttle. If it were 50 years ago, a new NASA spinoff technology, Synthetic Vision, would likely have been able to prevent the fateful, small plane crash that killed rock and roll legends Buddy Holly, Ritchie Valens, and The Big Bopper on that stormy night in 1959. Synthetic Vision is a new cockpit display system that helps pilots fly through bad weather, and it has incredible life-saving potential. In 1997, the White House Commission on Aviation Safety and Security created NASA s Aviation Safety and Security Program (AvSSP) with the aim of sounding the depths of NASA s cutting-edge aviation advances and history of successes. The AvSSP decided to use NASA technology to cut the rate of fatal aviation accidents that occur because of lowered visibility and spatial disorientation, common problems that arise in poor weather conditions, in the dark, or with inexperienced pilots.
The next phase of the unmanned ground vehicle development sponsored by OSD calls for intelligent velocity control to support cross-country driving speeds of 10 mph by day and 5 mph by night.
Early research on the development of machine vision algorithms to serve as pilot aids in aircraft flight operations is discussed. The research is useful for synthesizing new cockpit instrumentation that can enhance flight safety and efficiency. With the present work as the basis, future research will produce low-cost instrument by integrating a conventional TV camera together with off-the=shelf digitizing hardware for flight test verification. Initial focus of the research will be on developing pilot aids for clear-night operations. Latter part of the research will examine synthetic vision issues for poor visibility flight operations. Both research efforts will contribute towards the high-speed civil transport aircraft program. It is anticipated that the research reported here will also produce pilot aids for conducting helicopter flight operations during emergency search and rescue. The primary emphasis of the present research effort is on near-term, flight demonstrable technologies. This report discusses pilot aids for night landing and takeoff and synthetic vision as an aid to low visibility landing.
The development of machine vision based pilot aids to help reduce night approach and landing accidents is explored. The techniques developed are motivated by the desire to use the available information sources for navigation such as the airport lighting layout, attitude sensors and Global Positioning System to derive more precise aircraft position and orientation information. The fact that airport lighting geometry is known and that images of airport lighting can be acquired by the camera, has lead to the synthesis of machine vision based algorithms for runway relative aircraft position and orientation estimation. The main contribution of this research is the synthesis of seven navigation algorithms based on two broad families of solutions. The first family of solution methods consists of techniques that reconstruct the airport lighting layout from the camera image and then estimate the aircraft position components by comparing the reconstructed lighting layout geometry with the known model of the airport lighting layout geometry. The second family of methods comprises techniques that synthesize the image of the airport lighting layout using a camera model and estimate the aircraft position and orientation by comparing this image with the actual image of the airport lighting acquired by the camera. Algorithms 1 through 4 belong to the first family of solutions while Algorithms 5 through 7 belong to the second family of solutions. Algorithms 1 and 2 are parameter optimization methods, Algorithms 3 and 4 are feature correspondence methods and Algorithms 5 through 7 are Kalman filter centered algorithms. Results of computer simulation are presented to demonstrate the performance of all the seven algorithms developed.
Command of support robots by the warfighter requires intuitive interfaces to quickly communicate high degree-of-freedom (DOF) information while leaving the hands unencumbered. Stealth operations rule out voice commands and vision-based gesture interpretation techniques, as they often entail silent operations at night or in other low visibility conditions. Targeted at using bio-signal inputs to set navigation and manipulation goals for the robot (say, simply by pointing), we developed a system based on an electromyography (EMG) "BioSleeve", a high density sensor array for robust, practical signal collection from forearm muscles. The EMG sensor array data is fused with inertial measurement unit (IMU) data. This paper describes the BioSleeve system and presents initial results of decoding robot commands from the EMG and IMU data using a BioSleeve prototype with up to sixteen bipolar surface EMG sensors. The BioSleeve is demonstrated on the recognition of static hand positions (e.g. palm facing front, fingers upwards) and on dynamic gestures (e.g. hand wave). In preliminary experiments, over 90% correct recognition was achieved on five static and nine dynamic gestures. We use the BioSleeve to control a team of five LANdroid robots in individual and group/squad behaviors. We define a gesture composition mechanism that allows the specification of complex robot behaviors with only a small vocabulary of gestures/commands, and we illustrate it with a set of complex orders.
ThermalTracker-3D is a stereo-vision solution for evaluating flight tracks of birds and bats around offshore wind turbines. Using a pair of thermal video cameras, the technology remotely senses movement of animals and objects, day and night, near critical assets. It generates motion tracks by collapsing a sequence of video frames from each camera into a single image that contains an entire flight track and then applies stereo-vision processing to transform the flight track into three dimensions. The approach allows tracking in near real time and automatically identifies moving objects based on features from the motion track and object size.
Personal experience with the PVHD indicates that it should have great promise in easing cockpit workload, improving situational awareness, and reducing spatial disorientation. It should not be assumed that the PVHD will automatically cue the pilot to his attitude without some training or exposure. Some measure of attention needs to be devoted to attitude although this can easily be accomplished by the peripheral visual fields without tying up central vision. The PVHD would appear useful in any aircraft that flies in spatially disorienting/misorienting conditions, such as night, weather, or formation. It would appear to be particularly useful in aircraft, that by their design, are especially disorienting in such circumstances.
Advanced Air Mobility (AAM) aircraft have many challenges in landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different guidelines, landmarks, and landing light configurations at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to see landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on a vision-based precision approach and landing (PAL) by comparing ORB SLAM 2, a Vision Simultaneous Localization and Mapping (VSLAM) algorithm, and a novel EKF that combines onboard IMU measurements with coplanar pose from orthography and scaling with iterations (COPOSIT). Conducting unmanned aerial system (UAS) flight tests at NASA Armstrong Flight Research Center (AFRC) with landmarks and fiducials distributed around the landing zone provides a simulated AAM approach and landing data to test vision-based PAL methods to provide Alternative Position, Navigation, and Timing (APNT) solutions for AAM PAL applications. The novel vision-based PAL EKF with IMU and COPOSIT provides accurate state estimation when distributed landmarks and fiducials are in the field of view.
Topics covered include: 3D Endoscope to Boost Safety, Cut Cost of Surgery; Audio App Brings a Better Night's Sleep Liquid Cooling Technology Increases Exercise Efficiency; Algae-Derived Dietary Ingredients Nourish Animals; Space Grant Research Launches Rehabilitation Chair; Vision Trainer Teaches Focusing Techniques at Home; Aircraft Geared Architecture Reduces Fuel Cost and Noise; Ubiquitous Supercritical Wing Design Cuts Billions in Fuel Costs; Flight Controller Software Protects Lightweight Flexible Aircraft; Cabin Pressure Monitors Notify Pilots to Save Lives; Ionospheric Mapping Software Ensures Accuracy of Pilots' GPS; Water Mapping Technology Rebuilds Lives in Arid Regions; Shock Absorbers Save Structures and Lives during Earthquakes; Software Facilitates Sharing of Water Quality Data Worldwide; Underwater Adhesives Retrofit Pipelines with Advanced Sensors; Laser Imaging Video Camera Sees through Fire, Fog, Smoke; 3D Lasers Increase Efficiency, Safety of Moving Machines; Air Revitalization System Enables Excursions to the Stratosphere; Magnetic Fluids Deliver Better Speaker Sound Quality; Bioreactor Yields Extracts for Skin Cream; Private Astronaut Training Prepares Commercial Crews of Tomorrow; Activity Monitors Help Users Get Optimum Sun Exposure; LEDs Illuminate Bulbs for Better Sleep, Wake Cycles; Charged Particles Kill Pathogens and Round Up Dust; Balance Devices Train Golfers for a Consistent Swing; Landsat Imagery Enables Global Studies of Surface Trends; Ruggedized Spectrometers Are Built for Tough Jobs; Gas Conversion Systems Reclaim Fuel for Industry; Remote Sensing Technologies Mitigate Drought; Satellite Data Inform Forecasts of Crop Growth; Probes Measure Gases for Environmental Research; Cloud Computing Technologies Facilitate Earth Research; Software Cuts Homebuilding Costs, Increases Energy Efficiency; Portable Planetariums Teach Science; Schedule Analysis Software Saves Time for Project Planners; Sound Modeling Simplifies Vehicle Noise Management; Custom 3D Printers Revolutionize Space Supply Chain; Improved Calibration Shows Images' True Colors; Micromachined Parts Advance Medicine, Astrophysics, and More; Metalworking Techniques Unlock a Unique Alloy; Low-Cost Sensors Deliver Nanometer-Accurate Measurements; Electrical Monitoring Devices Save on Time and Cost; Dry Lubricant Smooths the Way for Space Travel, Industry; and Compact Vapor Chamber Cools Critical Components.
Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.
The craftsmen in the Roman Empire who constructed the Lycurgus Cup 17 centuries ago probably didn't think their artifact would survive for nearly 2,000 years as a prized possession. And they certainly couldn't have known that the technology they used to make it would eventually become an important part of space exploration. Carved from one solid mass, the cup is one of the few complete glass objects from that period, and the only one made from dichroic glass. Meaning "two-colored" in Greek, dichroic glass was originally created by adding trace amounts of gold and silver to a large volume of glass melt. The resulting medium partially reflects the light passing through it, causing an observer to see different colors depending on the direction of the light source. The Lycurgus Cup, for example, is famous for appearing green in daylight and red when lit at night, symbolic of the ripening grapes used to fill it with wine. NASA revitalized the production of dichroic glass in the 1950s and 1960s as a means of protecting its astronauts. Ordinary clear substances cannot protect human vision from the harsh rays of unfiltered sunlight, and everything from the human body to spacecraft sensors and computers are at risk if left unprotected from the radiation that permeates space. The microscopic amounts of metal present in dichroic glass make it an effective barrier against such harmful radiation. While the ancient manufacturing technique called for adding metals to glass melt, NASA developed a process in which metals are vaporized by electron beams in a vacuum chamber and then applied directly to surfaces in an ultra-thin film. The vapor condenses in the form of crystal structures, and the process is repeated for up to several dozen coatings. The resulting material, still only about 30 millionths of an inch thick, is sufficient to reflect radiation even while the glass, or polycarbonate, as in the case of space suit helmets, remains transparent to the human eye.
Both the effectiveness of pilot training and the safety of flight can be influenced by the distribution of texture in the visual scene, the distance to which the eyes accommodate, and the associated shifts in the apparent size and distance of objects in central and peripheral vision. Studies reviewed and original results presented indicate that these factors are involved in various misjudgments and illusions experienced by pilots: (1) when searching for other airborne traffic or targets, (2) when making approaches to airports over water at night, (3) when breaking out of low clouds on a final approach to a landing by reference to head-up or head-down displays, and (4) when practicing simulated approaches and landings or air-to-surface weapon deliveries by reference to synthetically generated visual systems.
In preparation for the various studies planned for assessing visual capabilities and tasks in order to set vision standards for astronauts, the following pieces of equipment have been assembled and tested: a spectacle obstruction measuring device, a biometric glare susceptibility tester, a variable vergence amplitude testing device, an eye movement recorder, a lunar illumination simulation chamber, a night myopia testing apparatus, and retinal adaption measuring devices.
The Vision for Space Exploration calls for NASA to develop a lunar lander that is capable of delivering humans anywhere on the moon's surface at any time. This presents a significant challenge for thermal engineers, as the lander must be able to survive both the freezing 14-day long lunar night as well as the harsh lunar noon. These problems and potential solutions are presented for each stage of the proposed mission that will return American astronauts to the moon.
To date, perceptual errors occur in determining descent rate from a computer-generated image in flight simulation. Pilots tend to touch down twice as hard in simulation than in flight, and more training time is needed in simulation before reaching steady-state performance. Barnes suggested that recognition of range may be the culprit, and he cited that problems such as collimated objects, binocular vision, and poor resolution lead to poor estimation of the velocity vector. Brown's study essentially ruled out that the lack of binocular vision is the problem. Dorfel added specificity to the problem by showing that pilots underestimated range in simulated scenes by 50% when 800 ft from the runway threshold. Palmer and Petitt showed that pilots are able to distinguish between a 1.7 ft/sec and 2.9 ft/sec sink rate when passively observing sink rates in a night scene. Platform motion also plays a role, as previous research has shown that the addition of substantial platform motion improves pilot estimates of vertical velocity and results in simulated touchdown rates more closely resembling flight. This experiment examined how some specific variations in the visual scene properties affect a pilot's perception of sink rate. It extended another experiment that focused on the visual and motion cues necessary for helicopter autorotations. In that experiment, pilots performed steep approaches to a runway. The visual content of the runway and its surroundings varied in two ways: texture and rectangular grid spacing. Four textures, included a no-texture case, were evaluated. Three grid spacings, including a no-grid case, were evaluated. The results showed that pilot better controlled their vertical descent rates when good texture cues were present. No significant differences were found for the grid manipulation. Using those visual scenes a simple psychophysics, experiment was performed. The purpose was to determine if the variations in the visual scenes allowed pilots to better perceive vertical velocity. To determine that answer, pilots passively viewed a particular visual scene in which the vehicle was descending at two different rates. Pilots had to select which of the two rates they thought was the fastest rate. The difference between the two rates changed using a staircase method, depending on whether or not the pilot was correct, until a minimum threshold between the two descent rates was reached. This process was repeated for all of the visual scenes to decide whether or not the visual scenes did allow pilots to perceive vertical velocity better among them. All of the data have yet to be analyzed; however, neither the effects of grid nor texture revealed any statistically significant trends. On further examination of the staircase method employed, a possibility exists that the lack of an evident trend may be due to the exit criterion used during the study. As such, the experiment will be repeated with an improved exit criterion in February. Results of this study will be presented in the submitted paper.
This paper presents the results of systems-level simulations using Metrosim that were conducted for notional Urban Air Mobility (UAM)-style vehicles analyzed for two different scenarios for New York (NY). UAM is an aviation industry term for passenger or cargo-carrying air transportation services, which are often automated, operating in an urban/city environment. UAM-style vehicles are expected to use vertical takeoff and landing with fixed wing cruise flight. Metrosim is a metroplex-wide route and airport planning tool that can also be used in standalone mode as a simulation tool. The scenarios described and reported in this paper were used to evaluate a fleet noise prediction capability for this tool. The work was a collaborative effort between the National Aeronautics and Space Administration (NASA), Intelligent Automation, Inc (IAI), and the Port Authority of New York and New Jersey (PANYNJ). One scenario was designed to represent an expanded air-taxi operation from existing helipads around Manhattan to the major New York airports. The other case represented a farther term vision case with commuters using personal air vehicles to hub locations just outside New York, with an air-taxi service running frequent connector trips to a few key locations inside Manhattan. For both scenarios, the trajectories created for the entire fleet were passed to the Aircraft Environmental Design Tool (AEDT) to generate Day-Night Level (DNL) noise contours for inspection. Without data for actual UAM vehicles available, surrogate AEDT empirical Noise-Power-Distance (NPD) tables used a similar sized current day helicopter as the Baseline, and a version of that same data linearly scaled as a first guess at possible UAM noise data. Details are provided for each of the two scenario configurations, and the output noise contours are presented for the Baseline and reduced noise DNL cases.
Photography was used to document known defects of the periscopic instrument used to check spacecrews in the descent module of the Soyuz T-4. The screen of the altitude control unit was also photographed and revealed glare in the central field of vision. A light filter was installed in the peripheral window to observe the Sun and horizon of the Earth. Checking attitude control by means of polaroids enabled a 5 further advance (500 km) into the zone of shadow. The attitude control unit was used to check the orbital orientation with respect to the vertical during the night segment of flight. A lens screen was used for the emission glow of the atmosphere at an altitude of about 100 km. Docking of the Soyuz T-4 was observed by means of an onboard display, a television camera, and a sighting device. From a distance of about 5 km, the space station could be seen as a bright dot in the sighting device. Docking occurred in shadow.