Search NASA⌕ Search

SEARCH · Search NASA

Results for “action recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Flight problem evaluation for Space Shuttle Orbiter

The flight problems experienced with the reusable Space Shuttle Orbiter have decreased during subsequent flights of each vehicle. By comparison to first flights of previous vehicles, the problems encountered on the initial flight of each new vehicle entering the fleet decreased. This improvement in turn has reduced the turnaround time between flights significantly and thus greatly enhanced the increased Space Shuttle launch frequency. The reusable manned space vehicle concept necessitated the development of a flight problem recognition and resolution system which would enable a thorough and timely vehicle turnaround flow. Flight evaluation, testing, and repair of manned spacecraft to enhance reliability and to ensure mission success is a unique activity. Real-time recognition of the flight problem, prompt isolation of the cause, and timely implementation of the corrective action are the keys to maintaining an operational fleet. Examples of flight problems that have been encountered as well as the corrective actions implemented during the first 24 Space Shuttle missions are presented. The corrective actions taken to preclude problem recurrence include modifications of hardware designs, manufacturing processes, flight software, test methods, and operational procedures.

Mechelay, Joseph E.↗

Study to determine potential flight applications and human factors design guidelines for voice recognition and synthesis systems

A study was conducted to determine potential commercial aircraft flight deck applications and implementation guidelines for voice recognition and synthesis. At first, a survey of voice recognition and synthesis technology was undertaken to develop a working knowledge base. Then, numerous potential aircraft and simulator flight deck voice applications were identified and each proposed application was rated on a number of criteria in order to achieve an overall payoff rating. The potential voice recognition applications fell into five general categories: programming, interrogation, data entry, switch and mode selection, and continuous/time-critical action control. The ratings of the first three categories showed the most promise of being beneficial to flight deck operations. Possible applications of voice synthesis systems were categorized as automatic or pilot selectable and many were rated as being potentially beneficial. In addition, voice system implementation guidelines and pertinent performance criteria are proposed. Finally, the findings of this study are compared with those made in a recent NASA study of a 1995 transport concept.

White, R. W.↗

South Louisiana remote-sensing environmental information system

Satellite gathered remote sensor data were used to update a basic environmental atlas of southern Louisiana to reflect recent dynamic geological changes, such as erosion by wave action along the coast and active delta building in the lower part of the Mississippi Basin. Standard pattern recognition programs were utilized to update LANDSAT pictures for three categories (generalized land use, ecological zones and vegetation) to obtain a simulated color photomap for LANDSAT frames for further rectification by a table lookup program.

Gordon, J. P.↗

How far away is plug 'n' play? Assessing the near-term potential of sonification and auditory display

The commercial music industry offers a broad range of plug 'n' play hardware and software scaled to music professionals and scaled to a broad consumer market. The principles of sound synthesis utilized in these products are relevant to application in virtual environments (VE). However, the closed architectures used in commercial music synthesizers are prohibitive to low-level control during real-time rendering, and the algorithms and sounds themselves are not standardized from product to product. To bring sound into VE requires a new generation of open architectures designed for human-controlled performance from interfaces embedded in immersive environments. This presentation addresses the state of the sonic arts in scientific computing and VE, analyzes research challenges facing sound computation, and offers suggestions regarding tools we might expect to become available during the next few years. A list of classes of audio functionality in VE includes sonification -- the use of sound to represent data from numerical models; 3D auditory display (spatialization and localization, also called externalization); navigation cues for positional orientation and for finding items or regions inside large spaces; voice recognition for controlling the computer; external communications between users in different spaces; and feedback to the user concerning his own actions or the state of the application interface. To effectively convey this considerable variety of signals, we apply principles of acoustic design to ensure the messages are neither confusing nor competing. We approach the design of auditory experience through a comprehensive structure for messages, and message interplay we refer to as an Automated Sound Environment. Our research addresses real-time sound synthesis, real-time signal processing and localization, interactive control of high-dimensional systems, and synchronization of sound and graphics.

Bargar, Robin↗

NASA Space Missions to Asteroids: Protecting the Earth from NEO Impacts

There is now a general recognition of the hazard of impacts on Earth by comets and asteroids, but there is yet no consensus concerning international actions that should be taken to protect the planet from such impacts. An essential step in the analysis of the situation involves estimating the relative hazard posed by comets and asteroids of different sizes and orbits. All recent studies agree that the larger impacts pose the greater danger, and that our primary concern from the perspective of total risk should be on impacts that are large enough to cause global ecological catastrophe. These global catastrophes are also of special interest, since they (alone among natural disasters) have the potential to destroy civilization. Studies of the sensitivity of the Earth's environment suggest that the energy threshold energy for causing a global catastrophe is at about 1 million megatons, corresponding to impactor diameters of 1.5 to 2 km. This information leads naturally to a strategy of concentrating on the larger NEOs, say those 1 km or more in diameter. This is the rationale for the Spaceguard Survey, which must be the highest priority in mitigation efforts. The second question concerns the value of developing standing defensive systems that could deflect or destroy an incoming NEO. In the case of the asteroids larger than 1 km in diameter, no such system is needed, since there will be ample time (at least several decades) between the discovery of the threatening object by Spaceguard and the requirement to take action against it. In the case of objects smaller than 1 km diameter, development of defensive systems is not cost-effective; there are many greater dangers to persons and property that are much more urgent. Only in the case of large long-period comets is there a rationale for standing defense systems. The question is also raised whether the risks inherent in developing and maintaining a defense system might be greater than the impact risks it is intended to guard against. These and related issues are the focus of much current international debate on defense of the planet against NEO impacts. Meanwhile, the most critical issue remains the expansion of the telescopic search for NEOs.

Morrison, David↗

Machine Learning Pattern Recognition Algorithm With Applications to Coherent Laser Combination

Herein we analyze a new kind of machine learning algorithm designed to feedback stabilize coherently combined lasers. This algorithm learns differential, rather than absolute, values of action in phase space, in order to facilitate learning on initially unstable systems. Experiments have shown that this approach can control small-scale spatial beam combination with high stability. In this paper we analyze the algorithm's performance and limitations in depth, showing that it can continuously learn during operation in order to track changes. Using simulation, we extend the application to temporal combination, and show that it scales to more complex instances by combining 81 beams.

97 MATHEMATICS AND COMPUTING↗

The adult literacy evaluator: An intelligent computer-aided training system for diagnosing adult illiterates

An important part of NASA's mission involves the secondary application of its technologies in the public and private sectors. One current application being developed is The Adult Literacy Evaluator, a simulation-based diagnostic tool designed to assess the operant literacy abilities of adults having difficulties in learning to read and write. Using ICAT system technology in addition to speech recognition, closed-captioned television (CCTV), live video and other state-of-the art graphics and storage capabilities, this project attempts to overcome the negative effects of adult literacy assessment by allowing the client to interact with an intelligent computer system which simulates real-life literacy activities and materials and which measures literacy performance in the actual context of its use. The specific objectives of the project are as follows: (1) To develop a simulation-based diagnostic tool to assess adults' prior knowledge about reading and writing processes in actual contexts of application; (2) to provide a profile of readers' strengths and weaknesses; and (3) to suggest instructional strategies and materials which can be used as a beginning point for remediation. In the first and developmental phase of the project, descriptions of literacy events and environments are being written and functional literacy documents analyzed for their components. Examples of literacy events and situations being considered included interactions with environmental print (e.g., billboards, street signs, commercial marquees, storefront logos, etc.), functional literacy materials (e.g., newspapers, magazines, telephone books, bills, receipts, etc.) and employment related communication (i.e., job descriptions, application forms, technical manuals, memorandums, newsletters, etc.). Each of these situations and materials is being analyzed for its literacy requirements in terms of written display (i.e., knowledge of printed forms and conventions), meaning demands (i.e., comprehension and word knowledge) and social situation. From these descriptions, scripts are being generated which define the interaction between the student, an on-screen guide and the simulated literacy environment. The proposed outcome of the Evaluator is a diagnostic profile which will present broad classifications of literacy behaviors across the major areas of metacognitive abilities, word recognition, vocabulary knowledge, comprehension and writing. From these classifications, suggestions for materials and strategies for instruction with which to begin corrective action will be made. The focus of the Literacy Evaluator will be essentially to provide an expert diagnosis and an interpretation of that assessment which then can be used by a human tutor to further design and individualize a remedial program as needed through the use of an authoring system.

Yaden, David B., Jr.↗

A vision architecture for the extravehicular activity retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools, equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This report documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios will be discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

A vision system planner for increasing the autonomy of the Extravehicular Activity Helper/Retriever

The Extravehicular Activity Retriever (EVAR) is a robotic device currently being developed by the Automation and Robotics Division at the NASA Johnson Space Center to support activities in the neighborhood of the Space Shuttle or Space Station Freedom. As the name implies, the Retriever's primary function will be to provide the capability to retrieve tools and equipment or other objects which have become detached from the spacecraft, but it will also be able to rescue a crew member who may have become inadvertently de-tethered. Later goals will include cooperative operations between a crew member and the Retriever such as fetching a tool that is required for servicing or maintenance operations. This paper documents a preliminary design for a Vision System Planner (VSP) for the EVAR that is capable of achieving visual objectives provided to it by a high level task planner. Typical commands which the task planner might issue to the VSP relate to object recognition, object location determination, and obstacle detection. Upon receiving a command from the task planner, the VSP then plans a sequence of actions to achieve the specified objective using a model-based reasoning approach. This sequence may involve choosing an appropriate sensor, selecting an algorithm to process the data, reorienting the sensor, adjusting the effective resolution of the image using lens zooming capability, and/or requesting the task planner to reposition the EVAR to obtain a different view of the object. An initial version of the Vision System Planner which realizes the above capabilities using simulated images has been implemented and tested. The remaining sections describe the architecture and capabilities of the VSP and its relationship to the high level task planner. In addition, typical plans that are generated to achieve visual goals for various scenarios are discussed. Specific topics to be addressed will include object search strategies, repositioning of the EVAR to improve the quality of information obtained from the sensors, and complementary usage of the sensors and redundant capabilities.

Magee, Michael↗

Acting to gain information

This report is concerned with agents that act to gain information. In previous work, we developed agent models combining qualitative modeling with real-time control. That work, however, focused primarily on actions that affect physical states of the environment. The current study extends that work by explicitly considering problems of active information-gathering and by exploring specialized aspects of information-gathering in computational perception, learning, and language. In our theoretical investigations, we analyzed agents into their perceptual and action components and identified these with elements of a state-machine model of control. The mathematical properties of each was developed in isolation and interactions were then studied. We considered the complexity dimension and the uncertainty dimension and related these to intelligent-agent design issues. We also explored active information gathering in visual processing. Working within the active vision paradigm, we developed a concept of 'minimal meaningful measurements' suitable for demand-driven vision. We then developed and tested an architecture for ongoing recognition and interpretation of visual information. In the area of information gathering through learning, we explored techniques for coping with combinatorial complexity. We also explored information gathering through explicit linguistic action by considering the nature of conversational rules, coordination, and situated communication behavior.

Rosenchein, Stanley J.↗

Beagle 2: Mission to Mars - Current Status

Beagle 2 is a 72 kg probe (with a 32 kg lander) developed in the United Kingdom for inclusion on the European Space Agency's 2003 Mars Express. Beagle 2 was launched on June 2, 2003 with Mars Express on a Soyuz-Fregat rocket from the Baikonur Cosmodrome in Kazakhstan. Beagle 2 landed on Mars on December 25th, 2003 in Isidis Planitia (approx. 10.7 N and 268.6 W), a large sedimentary basin that overlies the boundary between ancient highlands and northern plains. Isidis Planitia, the third largest impact basin on Mars, which is possibly filled with sediment deposited at the bottom of long-standing lakes or seas, offers an ideal environment for preserving traces of life. The team is awaiting signals from the Beagle 2 lander at the time when this abstract was written. Current status of the mission will be reported. Beagle 2 was developed to search for organic material and other volatiles on and below the surface of Mars in addition to the study of the inorganic chemistry and mineralogy. Several fundamental properties can be used to determine the existence of an active or past biology on any planet, Earth or Mars. Beagle 2's targets for investigation included: (a) The presence of water, or the existence of minerals deposited from water to show that water was present, even if only transiently; (b) The detection of carbonaceous debris, the remains of organisms that might have lived in water or were washed to a final resting place by the action of water; (c) The structure of organic matter, to demonstrate that it might have been synthesized for a biological purpose; (d) The recognition of isotopic fractionation between carbonaceous phases (organic vs inorganic carbon phases), a condition which on Earth suggests that life emerged nearly 4 billion years ago.

Gibson, E. K., Jr.↗

A contextual sensor system for non-intrusive machine status and energy monitoring

Event-driven contexts in manufacturing occur pervasively as a result of interactions among involved entities such as machines, workers, materials, and environment. One of the primary tasks in smart manufacturing is to derive a context-aware system conveniently incorporating worker knowledge for generating timely actionable intelligence for workers on factory floor and supervisors to respond. In this paper, we propose to design a human-and-machine interaction recognition framework by using a causality concept to collect contextual data for classifications of normal and abnormal machine operations. The causes and effects are between workers and machines for this initial research. To apply the causality to recognize worker interactions, initially a reliable way to identify the states of machines is necessary. The proposed contextual sensor system, consisting of a power meter for measuring machine operation conditions, a visual camera for capturing worker and machine interactions via a finite state machine model, and an algorithm for determining power signatures of individual components via energy disaggregation is implemented on semiconductor fabrication machines (manual or PLC controlled) each with multiple components. The experiment results demonstrate its context extraction capability such as components states and their corresponding energy usage in real time as well as its ability to identify anomalous operation conditions.

47 OTHER INSTRUMENTATION↗

Chloroplast SRP43 autonomously protects chlorophyll biosynthesis proteins against heat shock

The assembly of light-harvesting chlorophyll-binding proteins (LHCPs) is coordinated with chlorophyll biosynthesis during chloroplast development. The ATP-independent chaperone known as chloroplast signal recognition particle 43 (cpSRP43) mediates post-translational LHCP targeting to the thylakoid membrane and also participates in tetrapyrrole biosynthesis (TBS). How these distinct actions of cpSRP43 are controlled has remained unclear. Here, we demonstrate that cpSRP43 effectively protects several TBS proteins from heat-induced aggregation and enhances their stability during leaf greening and heat shock. While the substrate-binding domain of cpSRP43 is sufficient for chaperoning LHCPs, the stabilization of TBS clients requires the chromodomain 2 of the protein. Strikingly, cpSRP54—which activates cpSRP43’s LHCP-targeted function—inhibits the chaperone activity of cpSRP43 towards TBS proteins. High temperature weakens the interaction of cpSRP54 with cpSRP43, thus freeing cpSRP43 to interact with and protect the integrity of TBS proteins. Our data indicate that the temperature sensitivity of the cpSRP43–cpSRP54 complex enables cpSRP43 to serve as an autonomous chaperone for the thermoprotection of TBS proteins.

09 BIOMASS FUELS↗

A commentary on perception-action relationships in spatial display instruments

Transfer of information across disciplines is promoted, while basic and applied researchers are cautioned about the danger of assuming simple relationships between stimulus information, perceptual impressions, and performance including pattern recognition and sensorimotor skills. A theoretical and empirical foundation was developed predicting those relationships.

Shebilske, Wayne L.↗

Molecular Architecture of Early Dissemination and Massive Second Wave of the SARS-CoV-2 Virus in a Major Metropolitan Area

We sequenced the genomes of 5,085 severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) strains causing two coronavirus disease 2019 (COVID-19) disease waves in metropolitan Houston, TX, an ethnically diverse region with 7 million residents. The genomes were from viruses recovered in the earliest recognized phase of the pandemic in Houston and from viruses recovered in an ongoing massive second wave of infections. The virus was originally introduced into Houston many times independently. Virtually all strains in the second wave have a Gly614 amino acid replacement in the spike protein, a polymorphism that has been linked to increased transmission and infectivity. Patients infected with the Gly614 variant strains had significantly higher virus loads in the nasopharynx on initial diagnosis. We found little evidence of a significant relationship between virus genotype and altered virulence, stressing the linkage between disease severity, underlying medical conditions, and host genetics. Some regions of the spike protein—the primary target of global vaccine efforts—are replete with amino acid replacements, perhaps indicating the action of selection. We exploited the genomic data to generate defined single amino acid replacements in the receptor binding domain of spike protein that, importantly, produced decreased recognition by the neutralizing monoclonal antibody CR3022. Our report represents the first analysis of the molecular architecture of SARS-CoV-2 in two infection waves in a major metropolitan region. The findings will help us to understand the origin, composition, and trajectory of future infection waves and the potential effect of the host immune response and therapeutic maneuvers on SARS-CoV-2 evolution.

59 BASIC BIOLOGICAL SCIENCES↗

Advancing representations of equity and justice in climate mitigation futures

THIS PAPER WAS PRIMARILY COMPLETED PRIOR TO THE AUTHOR JOINING PNNL AND NO DOE FUNDING WAS USED FOR THIS PAPER. In this work, we review how equity and justice issues in global climate mitigation scenarios are addressed within Integrated Assessment Models (IAMs) and propose a new research agenda to strengthen their integration in model development and application. We begin by examining prominent concerns at the science-policy interface. We introduce a typology of equity and justice limitations in climate mitigation scenarios, distinguishing among structural, methodological, and epistemological biases that shape what integrated assessment models can reveal at policy-relevant scales. Reflecting on these concerns, we propose a research agenda that describes new avenues of work and draws together distinct emerging initiatives. This agenda is based on the feasibility and depth of required interventions, from incremental improvements to structural reforms and alternative participatory approaches. Drawing on reflexive insights from integrated assessment practitioners, it addresses the operational challenges of translating justice concepts into metrics, including risks of reductionism, tokenism, and narrow definitions. Underlying this research agenda is a recognition that modeling communities must engage more critically with implicit assumptions in model design and use that have equity and justice implications. Achieving equitable climate futures will require transformative actions that integrate diverse justice concerns, advance sustainable development goals, and confront systemic inequities across both human and ecological dimensions. Although models will never capture all these aspects, they can be significantly enhanced to support more informed discussion and practical application. Our contribution proposes a way forward to achieving this goal.

Pachauri, Shonali↗

Comparison of human poly-N-acetyl-lactosamine synthase structure with GT-A fold glycosyltransferases supports a modular assembly of catalytic subsites

Poly-N-acetyl-lactosamine (poly-LacNAc) structures are composed of repeating [-Galβ(1,4)-GlcNAcβ(1,3)-]n glycan extensions. They are found on both N- and O-glycoproteins and glycolipids and play an important role in development, immune function, and human disease. The majority of mammalian poly-LacNAc is synthesized by the alternating iterative action of β1,3-N-acetylglucosaminyltransferase 2 (B3GNT2) and β1,4-galactosyltransferases. B3GNT2 is in the largest mammalian glycosyltransferase family, GT31, but little is known about the structure, substrate recognition, or catalysis by family members. Here we report the structures of human B3GNT2 in complex with UDP:Mg 2+ and in complex with both UDP:Mg 2+ and a glycan acceptor, lacto-N-neotetraose. The B3GNT2 structure conserves the GT-A fold and the DxD motif that coordinates a Mg 2+ ion for binding the UDP-GlcNAc sugar donor. The acceptor complex shows interactions with only the terminal Galβ(1,4)-GlcNAcβ(1,3)- disaccharide unit, which likely explains the specificity for both N- and O-glycan acceptors. Modeling of the UDP-GlcNAc donor supports a direct displacement inverting catalytic mechanism. Comparative structural analysis indicates that nucleotide sugar donors for GT-A fold glycosyltransferases bind in similar positions and conformations without conserving interacting residues, even for enzymes that use the same donor substrate. In contrast, the B3GNT2 acceptor binding site is consistent with prior models suggesting that the evolution of acceptor specificity involves loops inserted into the stable GT-A fold. These observations support the hypothesis that GT-A fold glycosyltransferases employ coevolving donor, acceptor, and catalytic subsite modules as templates to achieve the complex diversity of glycan linkages in biological systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Variant terminology

A system called Variant Terminology Switching (VTS) is set forth that is intended to provide computer-assisted spellings for terms that have American and British versions. VTS is based on the use of brackets, parentheses, and other symbols in conjunction with letters that distinguish American and British spellings. The symbols are used in the systems as indicators of actions such as deleting, adding, and replacing letters as well as replacing entire words and concepts. The system is shown to be useful for the intended purpose and also for the recognition of misspellings and for the standardization of computerized input/output. The VTS system is of interest to the development of international retrieval systems for aerospace and other technical databases that enhance the use by the global scientific community.

Buchan, Ronald L.↗