SEARCH · Search NASA

Results for “Vision Tests”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRS2006

NASA Utilization of the International Space Station and the Vision for Space Exploration

In response to the U.S. President's Vision for Space Exploration (January 14, 2004), NASA has revised its utilization plans for ISS to focus on (1) research on astronaut health and the development of countermeasures that will protect our crews from the space environment during long duration voyages, (2) ISS as a test bed for research and technology developments that will insure vehicle systems and operational practices are ready for future exploration missions, (3) developing and validating operational practices and procedures for long-duration space missions. In addition, NASA will continue a small amount of fundamental research in life and microgravity sciences. There have been significant research accomplishments that are important for achieving the Exploration Vision. Some of these have been formal research payloads, while others have come from research based on the operation of International Space Station (ISS). We will review a selection of these experiments and results, as well as outline some of ongoing and upcoming research. The ISS represents the only microgravity opportunity to perform on-orbit long-duration studies of human health and performance and technologies relevant for future long-duration missions planned during the next 25 years. Even as NASA focuses on developing the Orion spacecraft and return to the moon (2015-2020), research on and operation of the ISS is fundamental to the success of NASA s Exploration Vision.

Robinson, Julie A.↗

NASA NTRS2007

NASA Utilization of the International Space Station and the Vision for Space Exploration

In response to the U.S. President s Vision for Space Exploration (January 14, 2004), NASA has revised its utilization plans for ISS to focus on (1) research on astronaut health and the development of countermeasures that will protect our crews from the space environment during long duration voyages, (2) ISS as a test bed for research and technology developments that will insure vehicle systems and operational practices are ready for future exploration missions, (3) developing and validating operational practices and procedures for long-duration space missions. In addition, NASA will continue a small amount of fundamental research in life and microgravity sciences. There have been significant research accomplishments that are important for achieving the Exploration Vision. Some of these have been formal research payloads, while others have come from research based on the operation of International Space Station (ISS). We will review a selection of these experiments and results, as well as outline some of ongoing and upcoming research. The ISS represents the only microgravity opportunity to perform on-orbit long-duration studies of human health and performance and technologies relevant for future long-duration missions planned during the next 25 years. Even as NASA focuses on developing the Orion spacecraft and return to the moon (2015-2020), research on and operation of the ISS is fundamental to the success of NASA s Exploration Vision.

Robinson, Julie A.↗

NASA NTRS2005

Vision Based Localization in Urban Environments

As part of DARPA's MARS2020 program, the Jet Propulsion Laboratory developed a vision-based system for localization in urban environments that requires neither GPS nor active sensors. System hardware consists of a pair of small FireWire cameras and a standard Pentium-based computer. The inputs to the software system consist of: 1) a crude grid-based map describing the positions of buildings, 2) an initial estimate of robot location and 3) the video streams produced by each camera. At each step during the traverse the system: captures new image data, finds image features hypothesized to lie on the outside of a building, computes the range to those features, determines an estimate of the robot's motion since the previous step and combines that data with the map to update a probabilistic representation of the robot's location. This probabilistic representation allows the system to simultaneously represent multiple possible locations, For our testing, we have derived the a priori map manually using non-orthorectified overhead imagery, although this process could be automated. The software system consists of two primary components. The first is the vision system which uses binocular stereo ranging together with a set of heuristics to identify features likely to be part of building exteriors and to compute an estimate of the robot's motion since the previous step. The resulting visual features and the associated range measurements are software component, a particle-filter based localization system. This system uses the map and the then fed to the second primary most recent results from the vision system to update the estimate of the robot's location. This report summarizes the design of both the hardware and software and will include the results of applying the system to the global localization of a robot over an approximately half-kilometer traverse across JPL'S Pasadena campus.

unmanned-ground vehicles↗

NASA NTRS2015

Flight Test of a Head-Worn Display as an Equivalent-HUD for Terminal Operations

Research, development, test, and evaluation of flight deck interface technologies is being conducted by NASA to proactively identify, develop, and mature tools, methods, and technologies for improving overall aircraft safety of new and legacy vehicles operating in the Next Generation Air Transportation System (NextGen). Under NASA's Aviation Safety Program, one specific area of research is the use of small Head-Worn Displays (HWDs) as a potential equivalent display to a Head-up Display (HUD). Title 14 of the US CFR 91.175 describes a possible operational credit which can be obtained with airplane equipage of a HUD or an "equivalent"' display combined with Enhanced Vision (EV). A successful HWD implementation may provide the same safety and operational benefits as current HUD-equipped aircraft but for significantly more aircraft in which HUD installation is neither practical nor possible. A flight test was conducted to evaluate if the HWD, coupled with a head-tracker, can provide an equivalent display to a HUD. Approach and taxi testing was performed on-board NASA's experimental King Air aircraft in various visual conditions. Preliminary quantitative results indicate the HWD tested provided equivalent HUD performance, however operational issues were uncovered. The HWD showed significant potential as all of the pilots liked the increased situation awareness attributable to the HWD's unique capability of unlimited field-of-regard.

Shelton, K. J.↗

NASA NTRSDate not supplied

Neuro-Vestibular Examination During and Following Spaceflight (Vestibular Health)

BACKGROUND Adaptation to microgravity during spaceflight causes neurological disturbances that are either directly or indirectly mediated by the vestibular system. These disturbances can include space motion sickness, spatial disorientation, and cognitive impairment, as well as changes in head-eye coordination, vestibulo-ocular reflexes, and control of posture and locomotion. Otolith-mediated reflex gains appear to adapt rapidly during spaceflight and after landing. However, animal studies have shown that structural modifications of the vestibular sensory apparatus develop during long-duration spaceflight. To date, no studies have characterized the severity of vestibular syndromes experienced by astronauts as a function of the duration of spaceflight or whether the effects are caused by changes at the peripheral end organs, midbrain, cerebellum, or vestibular cortex. OBJECTIVES We will investigate temporal vestibular changes in crewmembers of short, 6-month, and one-year missions to identify trends in adaptation of vestibular health and performance in orbit and after landing. We will also determine whether the vestibular organs and/or the central vestibular system undergo structural changes during long-duration exposure to microgravity, which could cause vestibular disorders when transitioning to a different gravitational environment. METHODS Recordings of eye, head, and body movements, as well as subjective reports of perception of motion, will be used to determine the presence of abnormal eye movements, dysmetria, motion sickness symptoms, and illusions of motion during head or body movements. This includes characterization of temporal trends in central compensation for vestibular (otolith) asymmetry. Pre-flight data will be collected 90 days before launch. In-flight examinations will be performed early in the mission (Flight Days 1 and 30) and once every two or three months thereafter. Post-flight examinations will be performed on the following days after return (R) from the mission: R+0, R+4, R+9, and R+30. Ground-based control tests have been performed on healthy volunteers in the laboratory to estimate mean normative responses. RESULTS Data collection for this study is ongoing. Data processing techniques are being refined. Our eye tracking method for measuring three-dimensional eye movement takes advantage of modern computer vision software (OpenCV) and advances in the field of iris recognition to improve measurement of ocular-counterolling. RELEVANCE If the observed symptoms in crewmembers are more deleterious after the year-long missions than those documented after 6-month missions, then relevant countermeasures will be required to maintain the health and operational performance of astronauts during longer missions. Depending on the etiology of the vestibular syndrome revealed by these tests, countermeasures will be proposed based on vestibular rehabilitation therapies currently used in patients with vestibular disorders, such as habituation, gaze stabilization, and/or balance training exercises.

T R Macaulay↗

NASA NTRS2013

Robotic Technology Development at Ames: The Intelligent Robotics Group and Surface Telerobotics

Future human missions to the Moon, Mars, and other destinations offer many new opportunities for exploration. But, astronaut time will always be limited and some work will not be feasible for humans to do manually. Robots, however, can complement human explorers, performing work autonomously or under remote supervision from Earth. Since 2004, the Intelligent Robotics Group has been working to make human-robot interaction efficient and effective for space exploration. A central focus of our research has been to develop and field test robots that benefit human exploration. Our approach is inspired by lessons learned from the Mars Exploration Rovers, as well as human spaceflight programs, including Apollo, the Space Shuttle, and the International Space Station. We conduct applied research in computer vision, geospatial data systems, human-robot interaction, planetary mapping and robot software. In planning for future exploration missions, architecture and study teams have made numerous assumptions about how crew can be telepresent on a planetary surface by remotely operating surface robots from space (i.e. from a flight vehicle or deep space habitat). These assumptions include estimates of technology maturity, existing technology gaps, and likely operational and functional risks. These assumptions, however, are not grounded by actual experimental data. Moreover, no crew-controlled surface telerobotic system has yet been fully tested, or rigorously validated, through flight testing. During Summer 2013, we conducted a series of tests to examine how astronauts in the International Space Station (ISS) can remotely operate a planetary rover across short time delays. The tests simulated portions of a proposed human-robotic Lunar Waypoint mission, in which astronauts in lunar orbit remotely operate a planetary rover on the lunar Farside to deploy a radio telescope array. We used these tests to obtain baseline-engineering data.

robotics↗

NASA NTRS2005

Evaluation of a Compression-Loaded-Stitched-Multi-Bay Fuselage Panel With Barely Visible Impact Damage

The experimental results from a stitched VaRTM carbon-epoxy composite panel tested under uni-axial compression loading are presented along with nonlinear finite element analysis prediction of the response. The curved panel is divided by frames and stringers into six bays with a column of three bays along the compressive loading direction. The frames are supported at the frame ends to resist out-of-plane translation. Back-to-back strain gages are used to record the strain and displacement transducers were used to record the out-of-plane displacements. In addition a full-field-displacement measurement technique that utilizes a camera-based-stereo-vision system was used to record the displacements. The panel was loaded to 1.5 times the predicted initial buckling load (1st bay buckling load, P(sub er) from the nonlinear finite element analysis and then was removed from the test machine for impact testing. After impacting with 20 ft-lbs of energy using a spherical impactor to produce barely visible damage the panel was loaded in compression until failure. The buckling load of the first bay to buckle was 97% of the buckling load before impact. The stitching constrained the impact damage from growing during the loading to failure. Impact damage had very little overall effect on panel stiffness. Panel stiffness measured by the full-field-displacement technique indicated a 13% loss in stiffness after impact. The panel failed at 1.64 times the first panel buckling load. The barely visible impact damage did not grow noticeably as the panel failed by global instability due to stringer-web terminations at the frame locations. The predictions from the nonlinear analysis of the finite element modeling of the entire specimen were very effective in the capture of the initial buckling and global behavior of the panel. In addition, the prediction highlighted the weakness of the panel under compression due to stringer web terminations. Both the test results and the nonlinear predictions serve to reinforce the severe penalty in structural integrity caused by the low cost manufacturing technique to terminate the stringer webs, and demonstrates the importance of this type of sub-component testing and high fidelity failure analysis in the design of a composite fuselage.

Baker, Donald J.↗

NASA NTRS1987

A technique for 3-D robot vision for space applications

An extension of the MIAG algorithm for recognition and motion parameter determination of general 3-D polyhedral objects based on model matching techniques and using Moment Invariants as features of object representation is discussed. Results of tests conducted on the algorithm under conditions simulating space conditions are presented.

Markandey, V.↗

NASA NTRS1999

Airbreathing Hypersonic Technology Vision Vehicles and Development Dreams

Significant advancements in hypersonic airbreathing vehicle technology have been made in the country's research centers and industry over the past 40 years. Some of that technology is being validated with the X-43 flight tests. This paper presents an overview of hypersonic airbreathing technology status within the US, and a hypersonic technology development plan. This plan builds on the nation's large investment in hypersonics. This affordable, incremental plan focuses technology development on hypersonic systems, which could be operating by the 2020's.

McClinton, C. R.↗

DOE OSTI2024

Microscopy modality transfer of steel microstructures: Inferring scanning electron micrographs from optical microscopy using generative AI

Scanning electron microscopy (SEM) is resource intensive, which limits its throughput in some applications. As an alternative, we propose applying computer vision and machine learning to generate high-quality synthetic SEM micrographs from micrographs obtained using light optical microscopy (LOM). Working with a correlated LOM/SEM dataset of dual-phase steel images, we test generative models of various architectures, including encoder-decoder networks, generative adversarial networks (GANs), and diffusion-based models. We find that the diffusion models significantly outperform other methods on both qualitative and quantitative assessments, while preserving key metallurgical meaning. This work establishes diffusion as the state-of-the-art for microscopy modality transfer and demonstrates the potential of AI-powered microscopy to enhance LOM with micron scale structural recreation.

Computer vision↗

NASA NTRS2020

A ROS-based Simulator for Testing the Enhanced Autonomous Navigation of the Mars 2020 Rover

In order to achieve the ambitious objectives of the Mars 2020 (M2020) mission, in particular the ability to autonomously traverse more challenging terrains more efficiently, new surface mobility software was developed for Enhanced Navigation (ENav). That decision was made early in the project, before most of the new surface flight software (FSW) existed, which created a need for a separate framework where the new navigation algorithms could be quickly prototyped and tested, before more realistic FSW-based testbeds became available. The JPL robotics team chose the Robot Operating System [1] (ROS) as the environment in which to test the new ENav algorithms. This made it possible to write the algorithms in the C language required by the FSW, so they could be directly ported over to the flight module later on, while leveraging all the C++ libraries and tools provided by ROS for simulation and testing. The ENav algorithms were developed as a separate C library, and stubs were used to replace any FSW-specific code, such as Event Reporting (EVRs) and data products (DPs). A ROS simulator was developed to generate a rich set of varied 3D terrains representative of the candidate Mars landing sites and simulate the physics of the rover motion, the point cloud perceived by the rover’s stereo vision system, and the new thinking-while-driving (TWD) navigation logic which directs the rover to drive autonomously to user-specified waypoints. To simulate the rover motion and perception, a ROS node was developed that uses a software library called HyperDrive Sim (HDSim), which is a wrapper for the Rover Sequencing and Visualization Program [2] (RSVP). That library provides roverterrain settling, realistic slip modelling, and camera rendering capability based on the rover’s NavCam machine vision models. To simulate the navigation logic, a ROS node was created that initializes and runs the ENav algorithms in a way that mimics the FSW execution, while also providing the capability to load and replay data products, including re-running the recorded inputs through the ENav algorithms for testing. An engineering Graphical User Interface (GUI) was also developed to visualize various elements, such as the rover pose during the drive, the simulated and perceived terrain, the selected local and global paths to the goal, the evaluated candidate paths and the reasons why they were rejected, the keep-in and keep-out zones (KIOZs), etc. Finally, an advanced Monte Carlo (MC) framework that can run many simulations in parallel on the Cloud and automatically generate reports that capture the key ENav performance metrics was developed to evaluate the system in a statisticallymeaningful way. This paper provides an overview of the ROSbased simulator used for testing the M2020 ENav algorithms.

Toupet, Olivier↗

NASA NTRS2005

Electromagnetic Interference to Flight Navigation and Communication Systems: New Strategies in the Age of Wireless

Electromagnetic interference (EMI) promises to be an ever-evolving concern for flight electronic systems. This paper introduces EMI and identifies its impact upon civil aviation radio systems. New wireless services, like mobile phones, text messaging, email, web browsing, radio frequency identification (RFID), and mobile audio/video services are now being introduced into passenger airplanes. FCC and FAA rules governing the use of mobile phones and other portable electronic devices (PEDs) on board airplanes are presented along with a perspective of how these rules are now being rewritten to better facilitate in-flight wireless services. This paper provides a comprehensive overview of NASA cooperative research with the FAA, RTCA, airlines and universities to obtain laboratory radiated emission data for numerous PED types, aircraft radio frequency (RF) coupling measurements, estimated aircraft radio interference thresholds, and direct-effects EMI testing. These elements are combined together to provide high-confidence answers regarding the EMI potential of new wireless products being used on passenger airplanes. This paper presents a vision for harmonizing new wireless services with aeronautical radio services by detecting, assessing, controlling and mitigating the effects of EMI.

Ely, Jay J.↗

NASA NTRSDate not supplied

A Framework for the Analysis of Deep Neural Networks in Autonomous Aerospace Applications using Bayesian Statistics

Deep Neural Networks (DNNs) are considered to be key components in many autonomous systems. Applications range from vision-based obstacle avoidance to intelligent/learning control and planning. Safety-critical applications as found in the aerospace domain require that the behavior of the DNN is validated and tested rigorously for safety of the autonomous system (AUS). In this paper, we present a framework to support testing of DNNs and the analysis of the network structure. Our framework employs techniques from statistical modeling and active learning to effectively generate test cases for DNN safety testing and performance analysis. We will present results of a case study on a physics-based Deep recurrent residual neural network (DR-RNN), which has been trained to emulate the aerodynamics behavior of a fixed-wing aircraft.

Deep Neural networks↗

NASA NTRSDate not supplied

Statistical learning framework for safety and failure analysis of a DNN-based autonomous aircraft system

Deep Neural Networks (DNNs) and Machine Learning technology is increasingly used for safety-critical applications in the Aerospace domain. To ensure safe operations, the DNN and the system must undergo rigorous verification and validation, including advanced statistical analyses. Performance and safety of the DNN and system behavior must not only be analyzed for the nominal case, but under numerous off-nominal and failure cases. In this paper we will describe how our statistical learning framework SYSAI can efficiently perform such analyses using the tool’s unique combination of advanced learning modeling and statistical analysis techniques. SYSAI can effectively explore the high-dimensional state and failure space of the system under test; geometrical shape detection of safety regions and boundaries support explainability of the results to the designer. In this paper, we report experiments and results obtained with a vision-based DNN control system (ACT) that is capable of autonomously steering an aircraft down a runway.

Yuning He↗

NASA NTRS2017

Open-Loop Flight Testing of COBALT GN&C Technologies for Precise Soft Landing

A terrestrial, open-loop (OL) flight test campaign of the NASA COBALT (CoOperative Blending of Autonomous Landing Technologies) platform was conducted onboard the Masten Xodiac suborbital rocket testbed, with support through the NASA Advanced Exploration Systems (AES), Game Changing Development (GCD), and Flight Opportunities (FO) Programs. The COBALT platform integrates NASA Guidance, Navigation and Control (GN&C) sensing technologies for autonomous, precise soft landing, including the Navigation Doppler Lidar (NDL) velocity and range sensor and the Lander Vision System (LVS) Terrain Relative Navigation (TRN) system. A specialized navigation filter running onboard COBALT fuzes the NDL and LVS data in real time to produce a precise navigation solution that is independent of the Global Positioning System (GPS) and suitable for future, autonomous planetary landing systems. The OL campaign tested COBALT as a passive payload, with COBALT data collection and filter execution, but with the Xodiac vehicle Guidance and Control (G&C) loops closed on a Masten GPS-based navigation solution. The OL test was performed as a risk reduction activity in preparation for an upcoming 2017 closed-loop (CL) flight campaign in which Xodiac G&C will act on the COBALT navigation solution and the GPS-based navigation will serve only as a backup monitor.

Carson, John M., III↗

NASA NTRS1987

Demonstration of a 3D vision algorithm for space applications

This paper reports an extension of the MIAG algorithm for recognition and motion parameter determination of general 3-D polyhedral objects based on model matching techniques and using movement invariants as features of object representation. Results of tests conducted on the algorithm under conditions simulating space conditions are presented.

Defigueiredo, Rui J. P.↗

NASA NTRS2004

A 3-Dimensional Cockpit Display with Traffic and Terrain Information for the Small Aircraft Transportation System

The report discusses the architecture and the flight test results of a 3-Dimensional Cockpit Display of Traffic and terrain Information (3D-CDTI). The presented 3D-CDTI is a perspective display format that combines existing Synthetic Vision System (SVS) research and Automatic Dependent Surveillance-Broadcast (ADS-B) technology to improve the pilot's situational awareness. The goal of the 3D-CDTI is to contribute to the development of new display concepts for NASA's Small Aircraft Transportation System research program. Papers were presented at the PLANS 2002 meeting and the ION-GPS 2002 meeting. The contents of this report are derived from the results discussed in those papers.

UijtdeHaag, Maarten↗

NASA NTRS2005

What Sensing Tells Us: Towards a Formal Theory of Testing for Dynamical Systems

Just as actions can have indirect effects on the state of the world, so too can sensing actions have indirect effects on an agent's state of knowledge. In this paper, we investigate "what sensing actions tell us", i.e., what an agent comes to know indirectly from the outcome of a sensing action, given knowledge of its actions and state constraints that hold in the world. To this end, we propose a formalization of the notion of testing within a dialect of the situation calculus that includes knowledge and sensing actions. Realizing this formalization requires addressing the ramification problem for sensing actions. We formalize simple tests as sensing actions. Complex tests are expressed in the logic programming language Golog. We examine what it means to perform a test, and how the outcome of a test affects an agent's state of knowledge. Finally, we propose automated reasoning techniques for test generation and complex-test verification, under certain restrictions. The work presented in this paper is relevant to a number of application domains including diagnostic problem solving, natural language understanding, plan recognition, and active vision.

McIlraith, Sheila↗