Search NASA⌕ Search

SEARCH · Search NASA

Results for “Processing maps”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Satellite snowcover and runoff monitoring in central Arizona

The author has identified the following significant results. Although the very high resolution experimental LANDSAT imagery permits rapid snow cover mapping at low cost, only one observation is available very 9 days. In contrast, low resolution operational imagery acquired by the ITOS and SMS/GOES satellites provide the daily synoptic observations necessary to monitor the rapid changes in snow covered areas in the entire Salt-Verde watershed. Geometric distortions in meteorological satellite imagery require specialized optical equipment or digital image processing for snow cover mapping.

Schumann, H. H.↗

Techniques For Topographical Mapping Via Interferometric SAR

Two techniques for processing data acquired by airborne interferometric synthetic-aperture-radar (SAR) system yield terrain-height maps. Predicated on availability of accurate navigational system that yields data on motion and orientation of airplane that carries SAR system and, also effectively gives orientation of baseline between two radar antennas of system. Three-dimensional coordinates of target point on terrain determined from (1) position and orientation of airplane as given by navigational system and (2) slant range gamma and phase shift phase as measured by SAR system.

Madsen, Soren N.↗

Finite Element Modeling Used to Study Stress Distribution on the Foot

A method to study the stress distribution inside the forefoot during walking was developed at the Cleveland Clinic Foundation by a researcher from the NASA Glenn Research Center. In this method, a semiautomated process was outlined to create a three-dimensional, patient-specific, finite element model (FEM) of the forefoot using magnetic resonance images (MRI). The images were processed in Matlab using the k-nearest neighbor (k-NN) classification algorithm and Sobel edge detection to separate the different tissue types: bone, skin, fat, and muscle. This information was used to create curves and surfaces that were exported to an FEM preprocessor known as Truegrid. In Truegrid, eight-noded or brick elements were created by using surface mapping. The FEM was processed and postprocessed in Abaqus. Material properties of the models were obtained from past experiments such as fat pad confined compression, skin axial and biaxial tests, muscle in vivo compressive tests, and reference literature (bone properties). Nonlinear (hyperelastic) material models were used for the skin (epidermis and dermis), fat, and muscles; and a linear elastic model was used for the bones. Muscle activation during walking yielded uncertainties in the muscle material model since contracted muscles are stiffer than relaxed muscles. These uncertainties were resolved by performing a sensitivity analysis of the muscle material properties. The original properties were multiplied by arbitrary factors of 2, 3, 0.5, and 0.33. The strain and stress distributions, as well as the locations of peak values, were similar in all cases. The peak contact pressure P obtained for each case varied with respect to the applied factor f as follows:

Morales, Nelson↗

Avoiding Stair-Step Artifacts in Image Registration for GOES-R Navigation and Registration Assessment

In developing software for independent verification and validation (IVV) of the Image Navigation and Registration (INR) capability for the Geostationary Operational Environmental Satellite R Series (GOES-R) Advanced Baseline Imager (ABI), we have encountered an image registration artifact which limits the accuracy of image offset estimation at the subpixel scale using image correlation. Where the two images to be registered have the same pixel size, subpixel image registration preferentially selects registration values where the image pixel boundaries are close to lined up. Because of the shape of a curve plotting input displacement to estimated offset, we call this a stair-step artifact. When one image is at a higher resolution than the other, the stair-step artifact is minimized by correlating at the higher resolution. For validating ABI image navigation, GOES-R images are correlated with Landsat-based ground truth maps. To create the ground truth map, the Landsat image is first transformed to the perspective seen from the GOES-R satellite, and then is scaled to an appropriate pixel size. Minimizing processing time motivates choosing the map pixels to be the same size as the GOES-R pixels. At this pixel size image processing of the shift estimate is efficient, but the stair-step artifact is present. If the map pixel is very small, stair-step is not a problem, but image correlation is computation-intensive. This paper describes simulation-based selection of the scale for truth maps for registering GOES-R ABI images.

stair-step artifact↗

Avoiding Stair-Step Artifacts in Image Registration for GOES-R Navigation and Registration Assessment

In developing software for independent verification and validation (IVV) of the Image Navigation and Registration (INR) capability for the Geostationary Operational Environmental Satellite R Series (GOES-R) Advanced Baseline Imager (ABI), we have encountered an image registration artifact which limits the accuracy of image offset estimation at the subpixel scale using image correlation. Where the two images to be registered have the same pixel size, subpixel image registration preferentially selects registration values where the image pixel boundaries are close to lined up. Because of the shape of a curve plotting input displacement to estimated offset, we call this a stair-step artifact. When one image is at a higher resolution than the other, the stair-step artifact is minimized by correlating at the higher resolution. For validating ABI image navigation, GOES-R images are correlated with Landsat-based ground truth maps. To create the ground truth map, the Landsat image is first transformed to the perspective seen from the GOES-R satellite, and then is scaled to an appropriate pixel size. Minimizing processing time motivates choosing the map pixels to be the same size as the GOES-R pixels. At this pixel size image processing of the shift estimate is efficient, but the stair-step artifact is present. If the map pixel is very small, stair-step is not a problem, but image correlation is computation-intensive. This paper describes simulation-based selection of the scale for truth maps for registering GOES-R ABI images.

image registration↗

Discovery of Probabilistic Dirichlet-to-Neumann Maps on Graphs

Dirichlet-to-Neumann maps enable the coupling of multiphysics simulations across computational subdomains by ensuring continuity of state variables and fluxes at artificial interfaces. We present a novel method for learning Dirichlet-to-Neumann maps on graphs using Gaussian processes, specifically for problems where the data obey a conservation law arising from an underlying partial differential equation. Our approach combines discrete exterior calculus and nonlinear optimal recovery to infer relationships between vertex and edge values. This framework yields data-driven predictions with uncertainty quantification across the entire graph, even when observations are limited to a subset of vertices and edges. By minimizing the reproducing kernel Hilbert space norm while penalizing kernel complexity through maximum likelihood estimation, our method ensures that the resulting surrogate strictly enforces conservation laws without overfitting. We demonstrate our method on two representative applications: subsurface flow in fracture networks and arterial blood flow. Finally, the results demonstrate that the method maintains high accuracy and well-calibrated uncertainty estimates even under severe data scarcity, highlighting its potential for scientific applications where limited data and reliable uncertainty quantification are critical.

Dirichlet-to-Neumann map↗

The Effects of Realistic Impact-processed Asteroid Topology on Atmospheric Airbursts

When small asteroids (∼10–200 m) enter Earth’s atmosphere they can break up before hitting the ground, releasing a considerable amount of energy in what is known as an atmospheric airburst. To date, numerous studies have examined how an asteroid’s strength, size, shape, and entry characteristics affect the breakup process; but few have assessed the effects of heterogenous internal topologies. We present a two-step high-fidelity simulation approach, which we use to model the atmospheric breakup of asteroids with realistic impact-processed internal topologies and their associated ground effects. In the first step, we model the asteroid as it is impacted to generate an “impact-processed” topology. We then map the resulting fractures (i.e., damage field) from that simulation to the initial state of an atmospheric breakup simulation. For both phases, we use the smoothed particle hydrodynamics code Spheral++. As a demonstrative example, we apply our new simulation pipeline to a Tunguska-scale impactor (50 m diameter, 20 km s −1 entry velocity, and 45° angle) in a case study comparing impact-processed and fully intact asteroids in both planar 2D and full 3D. For sufficiently strong asteroids, we find that impact processing generally causes the asteroid to break up at higher altitudes. We also observe that impact-processed asteroids break up into smaller fragments than objects with equivalent properties that have not been impact-processed.

Astronomy and AstroPhysics↗

The Ionosphere and Ocean Altimetry

The accuracy of satellite-based single-frequency radar ocean altimeters benefits from calibration of the total electron content (TEC) of the ionosphere below the satellite. Data from the global network of Global Positioning System (GPS) receivers provides timely, continuous, and globally well-distributed measurements of ionospheric electron content. We have created a daily automated process called Daily Global Ionospheric Map (Daily-GIM) whose primary purpose is to use global GPS data to provide ionospheric calibration data for the Geosat Follow-On (GFO) ocean altimeter. This process also produces an hourly time-series of global maps of the electron content of the ionosphere. This system is designed to deliver "quick-look" ionospheric calibrations within 24 hours with 90+% reliability and with a root-mean-square accuracy of 2 cm at 13.6 GHz. In addition we produce a second product within 72 hours which takes advantage of additional GPS data which were not available in time for the first process. The diagram shows an example of a comparison between TEC data from the Topographic Experiment (TOPEX) ocean altimeter and Daily-GIM. TEC are displayed in TEC units, TECU, where 5 TECU is 1 cm at 13.6 GHz. Data from a single TOPEX track is shown. Also shown is the Bent climatological model TEC for the track. Although the GFO satellite is not yet in its operational mode, we have been running Daily-GIM reliably (much better than 90%) with better than 2-cm accuracy (based on comparisons against TOPEX) for several months. When timely ephemeris files for the European Remote Sensing Satellite 2 (ERS-2) are available, daily ERS-2 altimeter ionospheric calibration files are produced. When GFO ephemeris files are made available to us, we produce GFO ionosphere calibration files. Users of these GFO ionosphere calibration files find they are a great improvement over the alternative International Reference Ionosphere 1995 (IRI-95) climatological model. In addition, the TOPEX orbit determination team at JPL has been using the global ionospheric maps to calibrate the single frequency GPS data from the TOPEX receiver, and report highly significant improvements in the ephemeris. The global ionospheric maps are delivered daily to the International GPS Service (IGS), making them available to the scientific community. Additional information is contained in the original.

Lindqwister, Ulf J.↗

Applicability of Micro X-Ray Fluorescence Spectroscopy to Astromaterials Curation and Research

Introduction: The Astromaterials Acquisition and Curation Office at NASA’s Johnson Space Center (JSC) curates NASA’s astromaterial sample collections which includes: Apollo samples, Luna samples, Ant-arctic meteorites, cosmic dust particles, microparticle impacts into space-flown materials, Genesis solar wind atoms, Stardust comet Wild-2 particles, Stardust inter-stellar particles, Hayabusa asteroid Itokawa particles, Hayabusa 2 asteroid Ryugu particles, and future OSIRIS-Rex asteroid Bennu particles (landing in Sep-tember, 2023) [1–3]. To enhance JSC’s advanced cu-ration capabilities, we have recently installed a high-performance micro-X-ray fluorescence (µXRF) spec-trometer to assist in sample characterization through rapid, non-destructive, in-situ elemental analyses that do not require the sample preparation protocols (i.e., polishing and carbon-coating) commonly needed for electron beam analyses. With this new instrument, we are capable of detecting all elements down to carbon in a variable-pressure or He-purged chamber for anal-ysis of a wide range of sample types. Here we describe the instrumental set-up, capabilities, and applicability of µXRF analysis to astromaterials curation and re-search. Instrumentation and Methodology: The X-ray fluorescence and computed tomography lab (X-FaCT) lab at JSC is now equipped with a Bruker M4 Tornado Plus µXRF (Fig. 1). This system is an energy-dispersive x-ray spectrometer equipped with two 60 mm2 silicon drift detectors (SDD) that are able to be used simulta-neously for output count rates ~500,000 cps. New light element windows allow detecting and analyzing the entire elemental range from carbon to americium. Two x-ray tubes (micro-focus Rh with polycapillary lenses and W with collimators of 0.5, 1.0, 2.0, and 4.5 mm) with max excitation parameters of 50 kV, 30 W and 50 kV, 40 W, respectively, allow for more flexibility of the analysis of high energy lines. The motorized X-Y-Z stage has a mapping range of 190 x 160 mm and can support samples up to 7 kg (~15.5 lbs) and a height of 120 mm [4]. Analytical modes include elemental analysis (down to ~20 µm spot size) via point, line, or area of bulk materials (rock surfaces, thin sections, thick sections, etc.) as well as coating analysis (determination of thickness and composition) of samples. This system has a variable vacuum chamber (1 mbar to 1 atm) that is also equipped with a He-purge system which accommodates vacuum sensitive samples while still allowing detection of light elements at atmospheric pressure. Utility and Applicability of µXRF in Astro-materials research and exploration science (ARES): Elemental analysis using µXRF is commonly em-ployed for both terrestrial and planetary geological science disciplines [5]. It is especially useful for analy-sis of astromaterials given the limited sample prepara-tion required, which is not feasible for certain materi-als. Here we show select applications of µXRF anal-yses of astromaterials that can, have, and will be done at JSC’s X-FaCT lab. Point analysis: In-situ spot analyses (~20 µm spot size) on a cut slab of Martian meteorite NWA 10922 allowed for the discovery, qualitative elemental analy-sis and determination of different feldspar minerals [6]. These point analyses served as an effective prelim-inary step for subsequent quantitative analyses. Ana-lytical standards can be employed for more accurate quantification of µXRF spot analyses. Area analysis: This analytical mode measures all detectable elements (from C to Am) at each pixel (>5 µm pixel size) in a user-defined area. The results are shown as elemental maps which can be extracted as 16-bit TIFF’s for further data processing. In Fig. 2. we show elemental distribution maps of the high-Ti basalt 73001,531 that have been processed using ImageJ software. From these maps you can accurately and quickly (this map took ~50 mins.) identify mineral components, such as pyroxene, plagioclase, oxides, and phosphates, compositional zoning, and mineral textures. Detection of high-Z phases: µXRF techniques are es-pecially effective at analyzing trace minerals with high-atomic-number (high-Z) elements because the high-energy characteristic X-rays used (relative to SEM EDS) allow for mapping of K lines in elements up to La (typically SEM maps use L X-ray lines for elements >Zn, and these can often have interferences). Thus, µXRF is especially suited for identifying minerals like zircon, baddeleyite, REE-rich phosphates, Fe-rich met-als, oxides, sulfides, and phosphides [4]. In Fig. 3 we show elemental distribution maps for 73001,530 where we are able to correlate the original video image with, Zr, Si, Y and Hf elemental maps together identi-fying the location of a zircon. In this location you would expect lower Si compared to surrounding mate-rial, as well as higher Zr, Y, and Hf content compared to surrounding material, all of which is confirmed by our XRF ele-mental distribution maps (Figure 2.) Conclusions: The new M4 Tornado Plus µXRF within the Astromaterials Acquisition and Curation office at NASA JSC allows for rapid and non-destructive elemental analysis of astromaterials with limited or no sample preparation. µXRF analyses pro-vide crucial compositional knowledge for the prelimi-nary examination and curation of astromaterials. This instrument enhances the advanced curation capabili-ties in the X-FaCT laboratory at JSC by allowing pro-ductive, cohesive, and non-destructive multi-modal x-ray analyses on astromaterial samples, which is neces-sary for the comprehensive curation and study of our current and future astromaterial collections. Addition-ally, µXRF can provide complimentary information to researchers for studies on astromaterials. References: [1] Allen, C. et al., (2011). Chemie De Erde Geochemistry, 71, 1-20. [2] McCubbin, F. M. et al., (2016) 47th LPSC, abstract #2668 [3] Zeigler, R. A. et al., (2017) 48th LPSC, abstract #2772 [4] Bruker User Manual [5] Young et al., (2016) Appl. Geochemistry, 72, 77-87 [6] Mor-ris, R. V. et al., (2023) 54th LPSC.

E W O'Neal↗

The Building Adapter: Automatic Mapping of Commercial Buildings for Scalable Building Analytics

This project creates new solutions for the manual metadata mapping problem: the costly process of creating a match between a building’s sensor data streams and the inputs of a building analytics engine. This goal is achieved by creating and improving techniques for metadata inference: automatically constructing new contextual information for sensing and control points based on the sensor point names and the raw time series values. The objective is to enable vendors to apply building analytics to 90% of buildings with no manual mapping, and to 10% of buildings with a 90% reduction in manual mapping. These targets are set for all types of metadata required by current analytics engines, including type, location, equipment type, and other relationships. The outcome of this project is a suite of solutions to the manual mapping problem collectively called the Building Adapter that allows vendors to apply analytics engines to new buildings at a significantly reduced cost.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Multi-crop area estimation and mapping on a microprocessor/mainframe network

The data processing system is outlined for a 1985 test aimed at determining the performance characteristics of area estimation and mapping procedures connected with the California Cooperative Remote Sensing Project. The project is a joint effort of the USDA Statistical Reporting Service-Remote Sensing Branch, the California Department of Water Resources, NASA-Ames Research Center, and the University of California Remote Sensing Research Program. One objective of the program was to study performance when data processing is done on a microprocessor/mainframe network under operational conditions. The 1985 test covered the hardware, software, and network specifications and the integration of these three components. Plans for the year - including planned completion of PEDITOR software, testing of software on MIDAS, and accomplishment of data processing on the MIDAS-VAX-CRAY network - are discussed briefly.

Sheffner, E.↗

A PC-based multispectral scanner data evaluation workstation: Application to Daedalus scanners

In late 1989, a personal computer (PC)-based data evaluation workstation was developed to support post flight processing of Multispectral Atmospheric Mapping Sensor (MAMS) data. The MAMS Quick View System (QVS) is an image analysis and display system designed to provide the capability to evaluate Daedalus scanner data immediately after an aircraft flight. Even in its original form, the QVS offered the portability of a personal computer with the advanced analysis and display features of a mainframe image analysis system. It was recognized, however, that the original QVS had its limitations, both in speed and processing of MAMS data. Recent efforts are presented that focus on overcoming earlier limitations and adapting the system to a new data tape structure. In doing so, the enhanced Quick View System (QVS2) will accommodate data from any of the four spectrometers used with the Daedalus scanner on the NASA ER2 platform. The QVS2 is designed around the AST 486/33 MHz CPU personal computer and comes with 10 EISA expansion slots, keyboard, and 4.0 mbytes of memory. Specialized PC-McIDAS software provides the main image analysis and display capability for the system. Image analysis and display of the digital scanner data is accomplished with PC-McIDAS software.

Jedlovec, Gary J.↗

Machine learning for endoleak detection after endovascular aortic repair

Diagnosis of endoleak following endovascular aortic repair (EVAR) relies on manual review of multi-slice CT angiography (CTA) by physicians which is a tedious and time-consuming process that is susceptible to error. We evaluate the use of a deep neural network for the detection of endoleak on CTA for post-EVAR patients using a novel data efficient training approach. 50 CTAs and 20 CTAs with and without endoleak respectively were identified based on gold standard interpretation by a cardiovascular subspecialty radiologist. The Endoleak Augmentor, a custom designed augmentation method, provided robust training for the machine learning (ML) model. Predicted segmentation maps underwent post-processing to determine the presence of endoleak. The model was tested against 3 blinded general radiologists and 1 blinded subspecialist using a held-out subset (10 positive endoleak CTAs, 10 control CTAs). Model accuracy, precision and recall for endoleak diagnosis were 95%, 90% and 100% relative to reference subspecialist interpretation (AUC = 0.99). Accuracy, precision and recall was 70/70/70% for generalist1, 50/50/90% for generalist2, and 90/83/100% for generalist3. The blinded subspecialist had concordant interpretations for all test cases compared with the reference. In conclusion, our ML-based approach has similar performance for endoleak diagnosis relative to subspecialists and superior performance compared with generalists.

60 APPLIED LIFE SCIENCES↗

Interdisciplinary research on the application of ERTS-1 data to the regional land use planning process.

Although the degree to which ERTS-1 imagery can satisfy regional land use planning data needs is not yet known, it appears to offer means by which the data acquisition process can be immeasurably improved. This paper documents the initial experiences of an interdisciplinary group attempting to formulate ways of analyzing the effectiveness of ERTS-1 imagery as a base for environmental monitoring and the resolution of regional land allocation problems. Because of the need to describe and depict regional resource complexity in an interrelatable state, certain resources within the geographical regions have been inventoried and stored in a two-dimensional computer-based map form. Computer oriented processes were developed to provide for the economical storage, analysis and spatial display of natural and cultural data for regional land use planning purposes. Statistical programs have been developed that correlate interpreted data with stored data, both spatially and numerically.

Clapp, J. L.↗

Machine Learning Applied to Zeolite Synthesis: The Missing Link for Realizing High-Throughput Discovery

Zeolites are microporous crystalline materials with well-defined cavities and pores, which can be prepared under different pore topologies and chemical compositions. Their preparation is typically defined by multiple interconnected variables (e.g., reagent sources, molar ratios, aging treatments, reaction time and temperature, among others), but unfortunately their distinctive influence, particularly on the nucleation and crystallization processes, is still far from being understood. Thus, the discovery and/or optimization of specific zeolites is closely related to the exploration of the parametric space through trial-and-error methods, generally by studying the influence of each parameter individually. In the past decade, machine learning (ML) methods have rapidly evolved to address complex problems involving highly nonlinear or massively combinatorial processes that conventional approaches cannot solve. Considering the vast and interconnected multiparametric space in zeolite synthesis, coupled with our poor understanding of the mechanisms involved in their nucleation and crystallization, the use of ML is especially timely for improving zeolite synthesis. Indeed, the complex space of zeolite synthesis requires drawing inferences from incomplete and imperfect information, for which ML methods are very well-suited to replace the intuition-based approaches traditionally used to guide experimentation. In this Account, we contend that both existing and new ML approaches can provide the “missing link” needed to complete the traditional zeolite synthesis workflow used in our quest to rationalize zeolite synthesis. Within this context, we have made important efforts on developing ML tools in different critical areas, such as (1) data-mining tools to process the large amount of data generated using high-throughput platforms; (2) novel complex algorithms to predict the formation of energetically stable hypothetical zeolites and guide the synthesis of new zeolite structures; (3) new “ab initio” organic structure directing agent predictions to direct the synthesis of hypothetical or known zeolites; (4) an automated tool for nonsupervised data extraction and classification from published research articles. ML has already revolutionized many areas in materials science by enhancing our ability to map intricate behavior to process variables, especially in the absence of well-understood mechanisms. Undoubtedly, ML is a burgeoning field with many future opportunities for further breakthroughs to advance the design of molecular sieves. For this reason, this Account includes an outlook of future research directions based on current challenges and opportunities. We envision this Account will become a hallmark reference for both well-established and new researchers in the field of zeolite synthesis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhanced LANDSAT images of Antarctica and planetary exploration

Since early in the LANDSAT program, black-and-white paper prints of band 7 (near infrared) of the LANDSAT multispectral scanner have been used extensively to prepare semicontrolled maps of Antarctica. Image-processing techniques are now employed to enhance fine detail and to make controlled image-mosaic maps in color. LANDSAT multispectral images of Antarctica help to expand our knowledge of extraterrestrial bodies by showing bare-ice areas as bright blue patches; on such patches meteorites tend to be concentrated and are collected. Many subtle flow features in Antarctic ice streams resemble features at the mouths of Martian outflow channels, which suggests that the channels also contained ice. Furthermore, flow lines in Antarctic ice sheets that merge with ice shelves resemble Martian flow features associated with dissected terrain along the Martian northern highland margin, and support the concept that ice was involved in the transport of material from the southern highlands to the northern lowland plains. In Antarctica, as on Mars, the virtual absence of fluvial activity over millions of years has permitted the growth of glacial and eolian features to unusually large sizes.

Lucchitta, B. K.↗

Quantum process identification: a method for characterizing non-markovian quantum dynamics

Established methods for characterizing quantum information processes do not capture non-Markovian (history-dependent) behaviors that occur in real systems. These methods model a quantum process as a fixed map on the state space of a predefined system of interest. Such a map averages over the system's environment, which may retain some effect of its past interactions with the system and thus have a history-dependent influence on the system. Although the theory of non-Markovian quantum dynamics is currently an active area of research, a systematic characterization method based on a general representation of non-Markovian dynamics has been lacking. In this article we present a systematic method for experimentally characterizing the dynamics of open quantum systems. Our method, which we call quantum process identification (QPI), is based on a general theoretical framework which relates the (non-Markovian) evolution of a system over an extended period of time to a time-local (Markovian) process involving the system and an effective environment. In practical terms, QPI uses time-resolved tomographic measurements of a quantum system to construct a dynamical model with as many dynamical variables as are necessary to reproduce the evolution of the system. Through numerical simulations, we demonstrate that QPI can be used to characterize qubit operations with non-Markovian errors arising from realistic dynamics including control drift, coherent leakage, and coherent interaction with material impurities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Sensing Super-position: Visual Instrument Sensor Replacement

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This project addresses the technical feasibility of augmenting human vision through Sensing Super-position using a Visual Instrument Sensory Organ Replacement (VISOR). The current implementation of the VISOR device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of the human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system.

Maluf, David A.↗