Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

62 records · Page 4

Multimodal Neuroelectric Interface Development

This project aims to improve performance of NASA missions by developing multimodal neuroelectric technologies for augmented human-system interaction. Neuroelectric technologies will add completely new modes of interaction that operate in parallel with keyboards, speech, or other manual controls, thereby increasing the bandwidth of human-system interaction. We recently demonstrated the feasibility of real-time electromyographic (EMG) pattern recognition for a direct neuroelectric human-computer interface. We recorded EMG signals from an elastic sleeve with dry electrodes, while a human subject performed a range of discrete gestures. A machine-teaming algorithm was trained to recognize the EMG patterns associated with the gestures and map them to control signals. Successful applications now include piloting two Class 4 aircraft simulations (F-15 and 757) and entering data with a "virtual" numeric keyboard. Current research focuses on on-line adaptation of EMG sensing and processing and recognition of continuous gestures. We are also extending this on-line pattern recognition methodology to electroencephalographic (EEG) signals. This will allow us to bypass muscle activity and draw control signals directly from the human brain. Our system can reliably detect P-rhythm (a periodic EEG signal from motor cortex in the 10 Hz range) with a lightweight headset containing saline-soaked sponge electrodes. The data show that EEG p-rhythm can be modulated by real and imaginary motions. Current research focuses on using biofeedback to train of human subjects to modulate EEG rhythms on demand, and to examine interactions of EEG-based control with EMG-based and manual control. Viewgraphs on these neuroelectric technologies are also included.

Trejo, Leonard J.↗

Computational Modeling of Semiconductor Dynamics at Femtosecond Time Scales

The main objective of the Joint-Research Interchange NCC2-5149 was to develop computer codes for accurate simulation of femtosecond pulse propagation in semiconductor lasers and semiconductor amplifiers [I]. The code should take into account all relevant processes such as the interband and intraband carrier relaxation mechanisms and the many-body effects arising from the Coulomb interaction among charge carriers [2]. This objective was fully accomplished. We made use of a previously developed algorithm developed at NASA Ames [3]-[5]. The new algorithm was tested on several problems of practical importance. One such problem was related to the amplification of femtosecond optical pulses in semiconductors. These results were presented in several international conferences over a period of three years. With the help of a postdoctoral fellow, we also investigated the origin of instabilities that can lead to the formation of femtosecond pulses in different kinds of lasers. We analyzed the occurrence of absolute instabilities in lasers that contain a dispersive host material with third-order nonlinearities. Starting from the Maxwell-Bloch equations, we derived general multimode equations to distinguish between convective and absolute instabilities. We find that both self-phase modulation and intensity-dependent absorption can dramatically affect the absolute stability of such lasers. In particular, the self-pulsing threshold (the so-called second laser threshold) can occur at few times the first laser threshold even in good-cavity lasers for which no self-pulsing occurs in the absence of intensity-dependent absorption. These results were presented in an international conference and published in the form of two papers.

Agrawal, Govind P.↗

Multimodality instrument for tissue characterization

A system with multimodality instrument for tissue identification includes a computer-controlled motor driven heuristic probe with a multisensory tip. For neurosurgical applications, the instrument is mounted on a stereotactic frame for the probe to penetrate the brain in a precisely controlled fashion. The resistance of the brain tissue being penetrated is continually monitored by a miniaturized strain gauge attached to the probe tip. Other modality sensors may be mounted near the probe tip to provide real-time tissue characterizations and the ability to detect the proximity of blood vessels, thus eliminating errors normally associated with registration of pre-operative scans, tissue swelling, elastic tissue deformation, human judgement, etc., and rendering surgical procedures safer, more accurate, and efficient. A neural network program adaptively learns the information on resistance and other characteristic features of normal brain tissue during the surgery and provides near real-time modeling. A fuzzy logic interface to the neural network program incorporates expert medical knowledge in the learning process. Identification of abnormal brain tissue is determined by the detection of change and comparison with previously learned models of abnormal brain tissues. The operation of the instrument is controlled through a user friendly graphical interface. Patient data is presented in a 3D stereographics display. Acoustic feedback of selected information may optionally be provided. Upon detection of the close proximity to blood vessels or abnormal brain tissue, the computer-controlled motor immediately stops probe penetration. The use of this system will make surgical procedures safer, more accurate, and more efficient. Other applications of this system include the detection, prognosis and treatment of breast cancer, prostate cancer, spinal diseases, and use in general exploratory surgery.

Mah, Robert W.↗

Multimodality Instrument for Tissue Characterization

A system with multimodality instrument for tissue identification includes a computer-controlled motor driven heuristic probe with a multisensory tip is discussed. For neurosurgical applications, the instrument is mounted on a stereotactic frame for the probe to penetrate the brain in a precisely controlled fashion. The resistance of the brain tissue being penetrated is continually monitored by a miniaturized strain gauge attached to the probe tip. Other modality sensors may be mounted near the probe tip to provide real-time tissue characterizations and the ability to detect the proximity of blood vessels, thus eliminating errors normally associated with registration of pre-operative scans, tissue swelling, elastic tissue deformation, human judgement, etc., and rendering surgical procedures safer, more accurate, and efficient. A neural network, program adaptively learns the information on resistance and other characteristic features of normal brain tissue during the surgery and provides near real-time modeling. A fuzzy logic interface to the neural network program incorporates expert medical knowledge in the learning process. Identification of abnormal brain tissue is determined by the detection of change and comparison with previously learned models of abnormal brain tissues. The operation of the instrument is controlled through a user friendly graphical interface. Patient data is presented in a 3D stereographics display. Acoustic feedback of selected information may optionally be provided. Upon detection of the close proximity to blood vessels or abnormal brain tissue, the computer-controlled motor immediately stops probe penetration.

Mah, Robert W.↗

Multimodal Platform Control for Robotic Planetary Exploration Missions

Planetary exploration missions pose unique problems for astronauts seeking to coordinate and control exploration vehicles. These include working in an environment filled with abrasive dust (e.g., regolith compositions), a desire to have effective hands-free communication, and a desire to have effective analog control of robotic platforms or end effectors. Requirements to operate in pressurized suits are particularly problematic due to the increased bulk and stiffness of gloves. As a result, researchers are considering alternative methods to perform fine movement control, for example capitalizing on higher-order voice actuation commands to perform control tasks. This paper presents current research at NASA s Neuro Engineering Laboratory that explores one method-direct bioelectric interpretation-for handling some of these problems. In this type of control system, electromyographic (EMG) signals are used both to facilitate understanding of acoustic speech in pressure-regulated suits 2nd to provide smooth analog control of a robotic platform, all without requiring fine-gained hand movement. This is accomplished through the use of non-invasive silver silver-chloride electrodes located on the forearm, throat, and lower chin, positioned so as to receive electrical activity originating from the muscles during contraction. For direct analog platform control, a small Personal Exploration Rover (PER) built by Carnegie Mellon University Robotics is controlled using forearm contraction duration and magnitudes, measured using several EMG channels. Signal processing is used to translate these signals into directional platform rotation rates and translational velocities. higher order commands were generated by differential contraction patterns called "clench codes."

Jorgensen, Charles↗

Experimental performance of a microwave cavity plasma disk ion source

The detailed description and performance characteristics of a microwave ion source are presented. This ion source utilizes an internally tuned, single-mode (or selective multimode) cylindrical cavity applicator to focus and match microwave energy into a disk-shaped discharge zone. The combination of mode focus control and variable, internal cavity matching allows the efficient operation and beam extraction over a wide range of pressures, powers and gaseous inputs. Experimental measurements of ion beam current versus accelerating voltage and input microwave power in xenon and oxygen gas are presented. Ion source specific energy and mass utilization versus experimental variables are also determined. The experimental performance demonstrates the ability of this ion source to extract an ion beam with a well matched, stable, and continuous operation over a wide range of input gases, low pressures, and over input gas flow rates in excess of 100 to a few sccm. Double Langmuir probe measurements in xenon gas indicate high degrees of ionization, and electron and ion concentrations in excess of 100 critical densities in the microwave discharge zone. This ion source has many potential uses such as spacecraft electric propulsion, material ion beam processing, and neutral beam ion sources.

Root, J.↗

Continuous-Flow System Produces Medical-Grade Water

A continuous-flow system utilizes microwave heating to sterilize water and to thermally inactivate endotoxins produced in the sterilization process. The system is designed for use in converting potable water to medical-grade water. Systems like this one could be used for efficient, small-scale production of medical- grade water in laboratories, clinics, and hospitals. This system could be adapted to use in selective sterilization of connections in ultra-pure-water-producing equipment and other equipment into which intrusion by microorganisms cannot be tolerated. Lightweight, port - able systems based on the design of this system could be rapidly deployed to remote locations (e.g., military field hospitals) or in response to emergencies in which the normal infrastructure for providing medical-grade water is disrupted. Larger systems based on the design of this system could be useful for industrial production of medical-grade water. The basic microwave-heating principle of this system is the same as that of a microwave oven: An item to be heated, made of a lossy dielectric material (in this case, flowing water) is irradiated with microwaves in a multimode microwave cavity. The heating is rapid and efficient because it results from absorption of microwave power throughout the volume of the lossy dielectric material. In this system, a copper tube having a length of 49.5 cm and a diameter of 2.25 cm serves as both the microwave cavity and the sterilization chamber. Microwave power is fed via a coaxial cable to an antenna mounted inside the tube at mid-length (see figure). Efficient power transfer occurs due to the shift in wavelength associated with the high permittivity of water combined with the strong coupling of 2.45-GHz microwaves with rotational-vibrational transitions of the dipolar water molecule.

Akse, James R.↗

National Campaign (NC)-1 Strategic Conflict Management Simulation (X4) Community Based Rules

Projected demand for transportation services in the urban environment has led to the development of several Concepts of Operation for Urban Air Mobility, or UAM. UAM is a concept for the transportation of people and goods in the metropolitan environment using small, efficient aircraft over short distances as part of an expanding multimodal transportation network. UAM will leverage emerging technologies including electric Vertical Takeoff and Landing (eVTOL) aircraft, increasing levels of automation and a new operational paradigm in dense airspace where a set of agreed-upon rules govern the procedures and interactions defining a cooperative environment in which operators are entrusted with a range of functions typically conducted by Air Traffic Control (ATC). These rules, proposed in the FAA NextGen Office’s UAM Concept of Operations [1], were originally termed Community Based Rules or Community Business Rules (CBRs), and will in the future termed Cooperative Operating Practices (COPs); this document uses the original term, CBR. CBRs are a set of rules, developed by the UAM community and (where necessary) approved by the FAA that govern the interactions between UAM entities and limit the need for ATC services including, but not limited to, separation control by ATC, addressing a fundamental challenge to scaling UAM operations. UAM community development of CBRs is anticipated to accelerate the adoption of new practices while retaining the regulatory authority of the FAA within required domains (e.g., NAS safety, security and equal access). However, there currently exists no agreed industry forum or defined procedures for CBR development. Investigation of best practices for the development of UAM CBRs was identified by NASA and the FAA NextGen Office as a research need. In collaboration with seven industry partners, NASA participated in a series of simulations that investigated elements of the envisioned UAM operations, with a primary focus on Strategic Conflict Management (SCM). The development and conduct of cooperative UAM simulations with seven industry partners provided a unique opportunity to investigate CBR development practices. Development of CBRs for the UAM SCM simulations was conducted in parallel with simulation capability development and was closely related to requirements definition for the simulations. As such, the CBR development effort presented herein had two objectives: explore CBR development practices in collaboration with the industry partners and develop an initial set of UAM CBRs to support simulation requirements definition and development. Consensus was achieved among NASA and the industry partners on 24 CBRs that were developed to support the cooperative simulation operations across five topic areas: General (related to test requirements), Operational Intent, Conformance Monitoring, Demand Capacity Balancing, and Airspace Constraint Management. Additional topic areas and CBRs were discussed but were deemed outside the scope of the simulation; these are included in the appendices. A collaborative, iterative process was employed for developing the CBRs engaging both NASA and Industry; because CBR development is envisioned to be community-driven, opportunities were sought that provided industry partners leadership roles in developing CBRs. The following key observations and recommendations may aid the UAM industry in future CBR development efforts: - The lack of a defined process proved challenging initially. Stakeholder engagement in the early stages of CBR development was intermittent and may have been due to the lack of a clear definition of roles and responsibilities of those involved in the effort. - Industry leadership of CBR topic areas proved successful. Discussions in these topic areas were engaging, with alternate viewpoints freely discussed and detailed CBRs resulting. This points to the importance of identifying the best-suited leadership in technical areas for CBR development. - Discussions within a CBR topic area were typically dominated by only a few participants. Whereas all industry partners contributed to CBR development, within each topic area, technical leadership was evident even when not formally established. This observation may indicate that smaller, focused groups may be more effective in initial CBR development than an open forum or large standards development effort (although both maybe required prior to FAA review and approval for some CBRs). - Identifying suitable forums for initial UAM CBR development and identifying the most effective industry participants and leadership will be crucial for successful CBR development. Although the operational need for UAM CBRs may not be immediate, establishing the forums and leadership to define the processes for CBR development is a prudent early step to UAM realization.

Community Based Rules↗