SEARCH · Search NASA

Results for “Pattern vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS1990

Sparse distributed memory overview

The Sparse Distributed Memory (SDM) project is investigating the theory and applications of massively parallel computing architecture, called sparse distributed memory, that will support the storage and retrieval of sensory and motor patterns characteristic of autonomous systems. The immediate objectives of the project are centered in studies of the memory itself and in the use of the memory to solve problems in speech, vision, and robotics. Investigation of methods for encoding sensory data is an important part of the research. Examples of NASA missions that may benefit from this work are Space Station, planetary rovers, and solar exploration. Sparse distributed memory offers promising technology for systems that must learn through experience and be capable of adapting to new circumstances, and for operating any large complex system requiring automatic monitoring and control. Sparse distributed memory is a massively parallel architecture motivated by efforts to understand how the human brain works. Sparse distributed memory is an associative memory, able to retrieve information from cues that only partially match patterns stored in the memory. It is able to store long temporal sequences derived from the behavior of a complex system, such as progressive records of the system's sensory data and correlated records of the system's motor controls.

Raugh, Mike↗

NASA NTRS2004

Passing the Baton: Lessons in Regret

I have led six major defense acquisition programs during my civil service career. For most of those, I was the first leader the program had and did not have to adjust to someone else's legacy. This was both good and bad. The obvious good was that I was able, for the most part, to fashion things as I wanted them. These included patterns of interaction inside and outside the project office. I chose who would be in leadership positions. I developed the managerial philosophy and leadership vision. I decided my role vis-a-vis others in the office. I created the expectations and goals. The bad part was that all the while I was doing this I never considered what I might be leaving my successor to deal with. My reasoning was simple: I never intended to leave. I should have known better.

Little, Terry↗

NASA NTRSDate not supplied

VSLAM and Coplanar POSIT for Advanced Air Mobility Approach and Landing

Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.

Evan Kawamura↗

NASA NTRS2007

NASA Tech Briefs, September 2007

Topics covered include; Rapid Fabrication of Carbide Matrix/Carbon Fiber Composites; Coating Thermoelectric Devices To Suppress Sublimation; Ultrahigh-Temperature Ceramics; Improved C/SiC Ceramic Composites Made Using PIP; Coating Carbon Fibers With Platinum; Two-Band, Low-Loss Microwave Window; MCM Polarimetric Radiometers for Planar Arrays; Aperture-Coupled Thin-Membrane L-Band Antenna; WGM-Based Photonic Local Oscillators and Modulators; Focal-Plane Arrays of Quantum-Dot Infrared Photodetectors; Laser Range and Bearing Finder With No Moving Parts; Microrectenna: A Terahertz Antenna and Rectifier on a Chip; Miniature L-Band Radar Transceiver; Robotic Vision-Based Localization in an Urban Environment; Programs for Testing an SSME-Monitoring System; Cathodoluminescent Source of Intense White Light; Displaying and Analyzing Antenna Radiation Patterns; Payload Operations Support Team Tools; Space-Shuttle Emulator Software; Soft Real-Time PID Control on a VME Computer; Analyzing Radio-Frequency Coverage for the ISS; Nanorod-Based Fast-Response Pressure-Sensitive Paints; Capacitors Would Help Protect Against Hypervelocity Impacts; Diaphragm Pump With Resonant Piezoelectric Drive; Improved Quick-Release Pin Mechanism; Designing Rolling-Element Bearings; Reverse-Tangent Injection in a Centrifugal Compressor; Inertial Measurements for Aero-assisted Navigation (IMAN); Analysis of Complex Valve and Feed Systems; Improved Path Planning Onboard the Mars Exploration Rovers; Robust, Flexible Motion Control for the Mars Explorer Rovers; Solar Sail Spaceflight Simulation; Fluorine-Based DRIE of Fused Silica; Mechanical Alloying for Making Thermoelectric Compounds; Process for High-Rate Fabrication of Alumina Nanotemplates; Electroform/Plasma-Spray Laminates for X-Ray Optics; An Automated Flying-Insect Detection System; Calligraphic Poling of Ferroelectric Material; Blackbody Cavity for Calibrations at 200 to 273 K; KML Super Overlay to WMS Translator; High-Performance Tiled WMS and KML Web Server; Modeling of Radiative Transfer in Protostellar Disks; Composite Pulse Tube; Photometric Calibration of Consumer Video Cameras; Criterion for Identifying Vortices in High- Pressure Flows; Amplified Thermionic Cooling Using Arrays of Nanowires; Delamination-Indicating Thermal Barrier Coatings; Preventing Raman Lasing in High-Q WGM Resonators; Procedures for Tuning a Multiresonator Photonic Filter; Robust Mapping of Incoherent Fiber-Optic Bundles; Extended-Range Ultrarefractive 1D Photonic Crystal Prisms; Rapid Analysis of Mass Distribution of Radiation Shielding; Modeling Magnetic Properties in EZTB; Deep Space Network Antenna Logic Controller; Modeling Carbon and Hydrocarbon Molecular Structures in EZTB; BigView Image Viewing on Tiled Displays; and Imaging Sensor Flight and Test Equipment Software.

Source record↗

DOE OSTI2024

Employing artificial intelligence to steer exascale workflows with colmena

Computational workflows are a common class of application on supercomputers, yet the loosely coupled and heterogeneous nature of workflows often fails to take full advantage of their capabilities. We created Colmena to leverage the massive parallelism of a supercomputer by using Artificial Intelligence (AI) to learn from and adapt a workflow as it executes. Colmena allows scientists to define how their application should respond to events (e.g., task completion) as a series of cooperative agents. In this paper, we describe the design of Colmena, the challenges we overcame while deploying applications on exascale systems, and the science workflows we have enhanced through interweaving AI. The scaling challenges we discuss include developing steering strategies that maximize node utilization, introducing data fabrics that reduce communication overhead of data-intensive tasks, and implementing workflow tasks that cache costly operations between invocations. These innovations coupled with a variety of application patterns accessible through our agent-based steering model have enabled science advances in chemistry, biophysics, and materials science using different types of AI. In conclusion, our vision is that Colmena will spur creative solutions that harness AI across many domains of scientific computing.

Workflows↗

NASA NTRS2017

Detection of Hail Storms in Radar Imagery Using Deep Learning

In 2016, hail was responsible for 3.5 billion and 23 million dollars in damage to property and crops, respectively, making it the second costliest weather phenomenon in the United States. In an effort to improve hail-prediction techniques and reduce the societal impacts associated with hail storms, we propose a deep learning technique that leverages radar imagery for automatic detection of hail storms. The technique is applied to radar imagery from 2011 to 2016 for the contiguous United States and achieved a precision of 0.848. Hail storms are primarily detected through the visual interpretation of radar imagery (Mrozet al., 2017). With radars providing data every two minutes, the detection of hail storms has become a big data task. As a result, scientists have turned to neural networks that employ computer vision to identify hail-bearing storms (Marzbanet al., 2001). In this study, we propose a deep Convolutional Neural Network (ConvNet) to understand the spatial features and patterns of radar echoes for detecting hailstorms.

natural hazard↗

NASA NTRS2014

General Aviation Flight Test of Advanced Operations Enabled by Synthetic Vision

A flight test was performed to compare the use of three advanced primary flight and navigation display concepts to a baseline, round-dial concept to assess the potential for advanced operations. The displays were evaluated during visual and instrument approach procedures including an advanced instrument approach resembling a visual airport traffic pattern. Nineteen pilots from three pilot groups, reflecting the diverse piloting skills of the General Aviation pilot population, served as evaluation subjects. The experiment had two thrusts: 1) an examination of the capabilities of low-time (i.e., <400 hours), non-instrument-rated pilots to perform nominal instrument approaches, and 2) an exploration of potential advanced Visual Meteorological Conditions (VMC)-like approaches in Instrument Meteorological Conditions (IMC). Within this context, advanced display concepts are considered to include integrated navigation and primary flight displays with either aircraft attitude flight directors or Highway In The Sky (HITS) guidance with and without a synthetic depiction of the external visuals (i.e., synthetic vision). Relative to the first thrust, the results indicate that using an advanced display concept, as tested herein, low-time, non-instrument-rated pilots can exhibit flight-technical performance, subjective workload and situation awareness ratings as good as or better than high-time Instrument Flight Rules (IFR)-rated pilots using Baseline Round Dials for a nominal IMC approach. For the second thrust, the results indicate advanced VMC-like approaches are feasible in IMC, for all pilot groups tested for only the Synthetic Vision System (SVS) advanced display concept.

Glaab, Louis J.↗

NASA NTRS1994

Vision based object pose estimation for mobile robots

Mobile robot navigation using visual sensors requires that a robot be able to detect landmarks and obtain pose information from a camera image. This paper presents a vision system for finding man-made markers of known size and calculating the pose of these markers. The algorithm detects and identifies the markers using a weighted pattern matching template. Geometric constraints are then used to calculate the position of the markers relative to the robot. The selection of geometric constraints comes from the typical pose of most man-made signs, such as the sign standing vertical and the dimensions of known size. This system has been tested successfully on a wide range of real images. Marker detection is reliable, even in cluttered environments, and under certain marker orientations, estimation of the orientation has proven accurate to within 2 degrees, and distance estimation to within 0.3 meters.

Wu, Annie↗

NASA NTRS2000

Smallest Nanoelectronic with Atomic Devices with Precise Structures

Since its invention in 1948, the transistor has revolutionized our everyday life - transistor radios and TV's appeared in the early 1960s, personal computers came into widespread use in the mid-1980s, and cellular phones, laptops, and palm-sized organizers dominated the 1990s. The electronics revolution is based upon transistor miniaturization; smaller transistors are faster, and denser circuitry has more functionality. Transistors in current generation chips are 0.25 micron or 250 nanometers in size, and the electronics industry has completed development of 0.18 micron transistors which will enter production within the next few years. Industry researchers are now working to reduce transistor size down to 0.13 micron - a thousandth of the width of a human hair. However, studies indicate that the miniaturization of silicon transistors will soon reach its limit. For further progress in microelectronics, scientists have turned to nanotechnology to advance the science. Rather than continuing to miniaturize transistors to a point where they become unreliable, nanotechnology offers the new approach of building devices on the atomic scale [see sidebar]. One vision for the next generation of miniature electronics is atomic chain electronics, where devices are composed of atoms aligned on top of a substrate surface in a regular pattern. The Atomic Chain Electronics Project (ACEP) - part of the Semiconductor Device Modeling and Nanotechnology group, Integrated Product Team at the NAS Facility has been developing the theory of understanding atomic chain devices, and the author's patent for atomic chain electronics is now pending.

Yamada, Toshishige↗

NASA NTRS1994

Synthetic vision display evaluation studies

The goal of this research was to help us understand the display requirements for a synthetic vision system for the High Speed Civil Transport (HSCT). Four experiments were conducted to examine the effects of different levels of perceptual cue complexity in displays used by pilots in a flare and landing task. Increased levels of texture mapping of terrain and runway produced mixed results, including harder but shorter landings and a lower flare initiation altitude. Under higher workload conditions, increased texture resulted in an improvement in performance. An increase in familiar size cues did not result in improved performance. Only a small difference was found between displays using two patterns of high resolution texture mapping. The effects of increased perceptual cue complexity on performance was not as strong as would be predicted from the pilot's subjective reports or from related literature. A description of the role of a synthetic vision system in the High Speed Civil Transport is provide along with a literature review covering applied research related to perceptual cue usage in aircraft displays.

Regal, David M.↗

NASA NTRS1986

A multifunction recognition operator for telerobotic vision

Research on developing an operator capable of performing the various subtasks required of a telerobot's vision sensor is reported. The operator uses a goal-driven matching technique which is an application of a linear programming method that readily adapts to the elastic template matching approach to pattern recognition. Four applications of the operator are discussed: (1) three-space location of an isolated object; (2) shape determination of isolated planar figures; (3) image compression/restoration; and (4) shape decomposition.

Goode, P. W., IV↗

NASA NTRS2018

Observations from Exploration of VTOL Urban Air Mobility Designs

NASA is exploring rotorcraft designs for VTOL air taxi operations, also known as urban air mobility (UAM) or on-demand mobility (ODM) applications. Several concept vehicles have been developed, intended to focus and guide NASA research activities in support of aircraft development for this emerging market. This paper summarizes the work conducted to date. To initially explore the broad design trade-space, three concept vehicles were designed: a quadrotor with electric propulsion; a side-by-side helicopter with hybrid propulsion; and a tiltwing with turbo-electric propulsion. Next a specific UAM mission was developed, accounting for the existing geography, population patterns, infrastructure, and weather in twenty-eight markets across the United States of America. Then in order to quantify the tradeoffs and performance targets necessary for practical implementation of the UAM vision, aircraft were designed to perform this mission, considering a range of aircraft types and propulsion system architectures: quadrotor aircraft, with turboshaft and all-electric propulsion; side-by-side aircraft, with turboshaft and all-electric propulsion; and lift+cruise aircraft with all-electric and turbo-electric propulsion. In examining these vehicles, performance targets and recurring technology themes emerged, which can guide investments in research and development within NASA, other government agencies, academia, and industry. In addition, results from the designs support observations about the trade-offs and key design decisions.

Observations from Exploration↗

NASA NTRS2016

Fluid Shifts

NASA is focusing on long-duration missions on the International Space Station (ISS) and future exploration-class missions beyond low-Earth orbit. Visual acuity changes observed after short-duration missions were largely transient, but more than 50% of ISS astronauts experienced more profound, chronic changes with objective structural and functional findings such as papilledema and choroidal folds. Globe flattening, optic nerve sheath dilation, and optic nerve tortuosity also are apparent. This pattern is referred to as the visual impairment and intracranial pressure (VIIP) syndrome. VIIP signs and symptoms, as well as postflight lumbar puncture data, suggest that elevated intracranial pressure (ICP) may be associated with the spaceflight-induced cephalad fluid shifts, but this hypothesis has not been tested. The purpose of this study is to characterize fluid distribution and compartmentalization associated with long-duration spaceflight, and to correlate these findings with vision changes and other elements of the VIIP syndrome. We also seek to determine whether the magnitude of fluid shifts during spaceflight, as well as the VIIP-related effects of those shifts, is predicted by the crewmember's preflight conditions and responses to acute hemodynamic manipulations (such as head-down tilt). Lastly, we will evaluate the patterns of fluid distribution in ISS astronauts during acute reversal of fluid shifts through application of lower body negative pressure (LBNP) interventions to characterize and explain general and individual responses. METHODS: We will examine a variety of physiologic variables in 10 long-duration ISS crewmembers using the test conditions and timeline presented in the Figure below. Measures include: (1) fluid compartmentalization (total body water by D2O, extracellular fluid by NaBr, intracellular fluid by calculation, plasma volume by CO rebreathe, interstitial fluid by calculation); (2) forehead/eyelids, tibia, calcaneus tissue thickness (by ultrasound); (3) vascular dimensions by ultrasound (jugular veins, cerebral and carotid arteries, vertebral arteries and veins, portal vein); (4) vascular dynamics by MRI (head/neck blood flow, cerebrospinal fluid pulsatility); (5) ocular measures (optical coherence tomography, intraocular pressure, 2-dimensional ultrasound including optic nerve sheath diameter, globe flattening, and retina-choroid thickness, Doppler ultrasound of ophthalmic and retinal arteries, and veins); (6) cardiac variables by ultrasound (inferior vena cava, tricuspid flow and tissue Doppler, pulmonic valve, stroke volume, right heart dimensions and function, four-chamber views); and (7) ICP measures (tympanic membrane displacement, distortion-product otoacoustic emissions, and ICP calculated by MRI). On the ground, acute head-down tilt will induce cephalad fluid shifts, whereas LBNP will oppose these shifts. Controlled Mueller maneuvers will manipulate cardiovascular variables. Through interventions applied before, during, and after flight, we intend to fully evaluate the relationship between fluid shifts and the VIIP syndrome.

Stenger, M.↗

NASA NTRS1984

The Representation of Action Plans in Long Term Memory

A sequence of experiments conducted on a two hand chord typewriter, to compare the efficiency of different coding principles employed to associate letters with their chord productions is described. This keyboard represents an effort to identify effective alternatives to the existing typewriter. It consists of two seperate 5-key panels (one for each hand), and letters are entered by typing chords composed of one to five fingers. Each panel is capable of producing the full alphabet. One group of experiments was designed to separate between perceptual and motor factors in the acivation of single letter chords. The results underline the importance of perceptual factors in the activation of motor plans. The complexity of the patterns employed to represent letters was shown to account for 50 percent of variance in the typing speeds of single letters. The theoretical implications of these results are discussed in relation to a vision based theory of action plans.

Fussfeld, G. N.↗

NASA NTRS2014

Fluid Shifts

NASA is focusing on long-duration missions on the International Space Station (ISS) and future exploration-class missions beyond low Earth orbit. Visual acuity changes observed after short-duration missions were largely transient, but more than 30% of ISS astronauts experience more profound, chronic changes with objective structural and functional findings such as papilledema and choroidal folds. Globe flattening, optic nerve sheath dilation, and optic nerve tortuosity also are apparent. This pattern is referred to as the visual impairment and intracranial pressure (VIIP) syndrome. VIIP signs and symptoms, as well as postflight lumbar puncture data, suggest that elevated intracranial pressure (ICP) may be associated with the space flight-induced cephalad fluid shifts, but this hypothesis has not been tested. The purpose of this study is to characterize fluid distribution and compartmentalization associated with long-duration space flight, and to correlate these findings with vision changes and other elements of the VIIP syndrome. We also seek to determine whether the magnitude of fluid shifts during space flight, as well as the VIIP-related effects of those shifts, is predicted by the crewmember's pre-flight condition and responses to acute hemodynamic manipulations (such as head-down tilt). Lastly, we will evaluate the patterns of fluid distribution in ISS astronauts during acute reversal of fluid shifts through application of lower body negative pressure (LBNP) interventions to characterize and explain general and individual responses. We will examine a variety of physiologic variables in 10 long-duration ISS crewmembers using the test conditions and timeline presented in the Figure below. Measures include: (1) fluid compartmentalization (total body water by D2O, extracellular fluid by NaBr, intracellular fluid by calculation, plasma volume by CO rebreathe, interstitial fluid by calculation); (2) forehead/eyelids, tibia, calcaneus tissue thickness (by ultrasound); (3) vascular dimensions by ultrasound (jugular veins, cerebral and carotid arteries, vertebral arteries and veins, portal vein); (4) vascular dynamics by MRI (head/neck blood flow, cerebrospinal fluid pulsatility); (5) ocular measures (optical coherence tomography, intraocular pressure, 2-dimensional ultrasound including optic nerve sheath diameter, globe flattening, and retina-choroid thickness, Doppler ultrasound of ophthalmic and retinal arteries, and veins); (6) cardiac variables by ultrasound (inferior vena cava, tricuspid flow and tissue Doppler, pulmonic valve, stroke volume, right heart dimensions and function, four-chamber views); and (7) ICP measures (tympanic membrane displacement, distortion-product otoacoustic emissions, and ICP calculated by MRI). On the ground, acute head-down tilt will induce cephalad fluid shifts, whereas LBNP will oppose these shifts. Controlled Mueller maneuvers will manipulate cardiovascular variables. Through interventions applied before, during, and after flight, we intend to fully evaluate the relationship between fluid shifts and the VIIP syndrome. This study has been selected for flight implementation and is one of the candidate investigations being considered for the one year mission.

Stenger, Michael↗

NASA NTRS2006

Sensing Super-position: Visual Instrument Sensor Replacement

Maluf, David A.↗

NASA NTRS2007

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.↗

DOE OSTI2025

Automated Programmable Logic Controller Memory Forensics Using RGB Image Analysis and Deep Learning

The introduction of Industry 4.0 and Internet-based technologies has enhanced industrial control system operations but have inadvertently increased their vulnerabilities to cyber attacks. When an industrial control system is compromised, security analysts need to identify the root cause quickly to start the recovery process and develop mitigation strategies. Memory forensics is critical in the incident analysis process to ascertain what occurred. Approaches for analyzing the persistent memory in industrial control devices are limited and almost nonexistent for volatile memory. This chapter proposes an automated methodology for programmable logic controller memory dump analysis using computer vision and deep learning techniques. The methodology converts the sequences of bytes in a programmable logic controller memory dump to red-green-blue pixels and employs a deep learning model that learns the underlying patterns and features of pre-labeled forensic artifacts in images and segments them into distinct regions. The trained model is employed to automatically segment new memory images and identify forensic artifacts. Evaluation of the methodology on a Schneider Electric Modicon M221 programmable logic controller under code injection and code modification attacks demonstrates its ability to detect attack artifacts in memory dumps.

Asmar Awad, Rima [ORNL] (ORCID:0000000233407742)↗