SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
The objectives are to examine recent trends in the reduction of size, weight, and power (SWaP) requirements of sensor systems for environmental perception and to explore new technology that may overcome limitations in current systems. Improving perception systems to facilitate situation awareness is critical in the move to introduce increasing autonomy in aerial systems. Whether the autonomy is in the current state-of-the-art of increasing automation or is enabling cognitive decisions that facilitate adaptive behavior, collection of environmental information and fusion of that information into knowledge that can direct actuation is imperative to decisions resulting in appropriate behavior. Artificial sensory systems such as cameras, radar, LIDAR, and acoustic sensors have been in use on aircraft for many years but, due to the large size and weight of the airplane and electrical power made available through powerful engines, the SWaP requirements of these sensors was inconsequential. With the proliferation of Remote Piloted Vehicles (RPV), the trend is in significant reduction in SWaP of the vehicles. This requires at least an equivalent reduction in SWaP for the sensory systems. A survey of some currently available sensor systems and changing technology will reveal the trend toward reduction of SWaP of these systems and will predict future reductions. A new technology will be introduced that provides an example of a desirable new trend. A new device replaces multiple conventional sensory devices facilitating synchronization, localization, altimetry, collision avoidance, terrain mapping, and data communication in a single integrated, small form-factor, extremely lightweight, and low power device that it is practical for integration into small autonomous vehicles and can facilitate cooperative behavior. The technology is based on Ultra WideBand (UWB) radio using short pulses of energy rather than continuous sine waves. The characteristics of UWB yield several desirable characteristics to facilitate integration of perception for autonomous activities. The capabilities of this device and its limitations will be assessed.
The most difficult phase of small Unmanned Aerial System (sUAS) deployment is autonomous operations below the notional 50 ft in urban landscapes. Understanding the feasibility of safely flying sUAS autonomously below 50 ft is a game changer for many civilian applications. This paper outlines three areas of research currently underway which address key challenges for flight in the urban landscape. These are: (1) Off-line and On-board wind estimation and accommodation; (2) Real-time trajectory planning via characterization of obstacles using a LIDAR; (3) On-board information fusion for real-time decision-making and safe trajectory generation.
Data fusion and sensor management approaches have largely been implemented with centralized and hierarchical architectures. Numerical and statistical methods are the most common data fusion methods found in these systems. Given the proliferation and low cost of processing power, there is now an emphasis on designing distributed and decentralized systems. These systems use analytical/quantitative techniques or qualitative reasoning methods for date fusion.Based on other work by the author, a sensor may be treated as a highly autonomous (decentralized) unit. Each highly autonomous sensor (HAS) is capable of extracting qualitative behaviours from its data. For example, it detects spikes, disturbances, noise levels, off-limit excursions, step changes, drift, and other typical measured trends. In this context, this paper describes a distributed sensor fusion paradigm and theory where each sensor in the system is a HAS. Hence, given the reach qualitative information from each HAS, a paradigm and formal definitions are given so that sensors and processes can reason and make decisions at the qualitative level. This approach to sensor fusion makes it possible the implementation of intuitive (effective) methods to monitor, diagnose, and compensate processes/systems and their sensors. This paradigm facilitates a balanced distribution of intelligence (code and/or hardware) to the sensor level, the process/system level, and a higher controller level. The primary application of interest is in intelligent health management of rocket engine test stands.
A system for automated fusion and interpretation of image data from multiple sensors, including multispectral data from an imaging spectrometer is being developed. Classical artificial intelligence techniques and artificial neural networks are employed to make real time decision based on current input and known scientific goals. Emphasis is placed on identifying minerals which could indicate past life activity or an environment supportive of life. Multispectral data can be used for geological analysis because different minerals have characteristic spectral reflectance in the visible and near infrared range. Classification of each spectrum into a broad class, based on overall spectral shape and locations of absorption bands is possible in real time using artificial neural networks. The goal of the system is twofold: multisensor and multispectral data must be interpreted in real time so that potentially interesting sites can be flagged and investigated in more detail while the rover is near those sites; and the sensed data must be reduced to the most compact form possible without loss of crucial information. Autonomous decision making will allow a rover to achieve maximum scientific benefit from a mission. Both a classical rule based approach and a decision neural network for making real time choices are being considered. Neural nets may work well for adaptive decision making. A neural net can be trained to work in two steps. First, the actual input state is mapped to the closest of a number of memorized states. After weighing the importance of various input parameters, the net produces an output decision based on the matched memory state. Real time, autonomous image data analysis and decision making capabilities are required for achieving maximum scientific benefit from a rover mission. The system under development will enhance the chances of identifying fossils or environments capable of supporting life on Mars
Situation Management is a rapidly developing science combining new techniques for data collection with advanced methods of data fusion to facilitate the process leading to correct decisions prescribing action. Current research focuses on reducing increasing amounts of diverse data to knowledge used by decision makers and on reducing time between observations, decisions and actions. No new technology is more promising for increasing the diversity and fidelity of observations than sensor networks. However, current research on sensor networks concentrates on a centralized network architecture. We believe this trend will not realize the full potential of situation management. We propose a new architecture modeled after biological ecosystems where motes are autonomous and intelligent, yet cooperate with local neighborhoods. Providing a layered approach, they sense and act independently when possible, and cooperate with neighborhoods when necessary. The combination of their local actions results in global effects. While situation management research is currently dominated by military applications, advances envisioned for industrial and business applications have similar requirements. NASA has requirements for intelligent and autonomous systems in future missions that can benefit from advances in situation management. We describe requirements for the Integrated Vehicle Health Management program where our biology-inspired architecture provides a layered approach and decisions can be made at the proper level to improve safety, reduce costs, and improve efficiency in making diagnostic and prognostic assessments of the structural integrity, aerodynamic characteristics, and operation of aircraft.
Many information sources can support air quality assessment and forecasting, including atmospheric chemistry model outputs, satellite retrievals of column chemical and aerosol constituents, and surface-based air quality monitoring data from both regulatory and low-cost instruments. Systematic integration of these data sources provides a major opportunity to improve understanding and management of air quality, but also presents technical barriers, especially in resource- and data-constrained settings in the Global South. This presentation describes a data fusion system, currently under development using the Google Earth Engine platform, which aims to integrate the information sources listed above to support comprehensive sub-city-scale assessment and management of air quality. Furthermore, the data fusion framework includes provisions for the quantification of uncertainties in the resulting fused estimates based on the variability of and among the input data sources. These capabilities will allow air quality managers to better understand their local air quality situation, including relative confidence in the fused estimates for different constituents, locations, and times, leading to better informed air quality management decisions. This presentation covers the underlying methodology of the data fusion and uncertainty quantification approaches, provides an update on the status of its implementation, and presents early qualitative and quantitative results.
Integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System. Addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers, is essential for realizing the vision. The proposal, if accepted, will discuss safety management system challenges and how the concept of In-time Aviation Safety Management Systems addresses the need. It will also discuss human factors challenges involved in future integrated safety management, including trust, over-reliance, human-optimized data visualization, human-autonomy teaming, training, communication and dissemination of data, situation awareness, task load, and accountability.
In-time integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System (NAS). The path for realizing the vision includes addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers. The paper describes safety management systems and its’ challenges, and how the concept of In-time Aviation Safety Management Systems addresses the need to ensure an adaptable and resilient future safety system in the envisioned transformed NAS. Finally, it discusses potential human factors challenges, including new human roles and responsibilities, new information and cognitive requirements, new intelligent technologies that change human-system interaction and coordination, and new design paradigms for human system integration and teaming.
In-time integrated safety management will be paramount for safely enabling the envisioned transformations of the future National Airspace System (NAS). The path for realizing the vision includes addressing the increasing need for advanced data analytics and fusion of aviation safety data, managed by human decision-makers. The paper describes safety management systems and its’ challenges, and how the concept of In-time Aviation Safety Management Systems addresses the need to ensure an adaptable and resilient future safety system in the envisioned transformed NAS. Finally, it discusses potential human factors challenges, including new human roles and responsibilities, new information and cognitive requirements, new intelligent technologies that change human-system interaction and coordination, and new design paradigms for human system integration and teaming.
CRUX is a modular suite of geophysical and borehole instruments combined with display and decision support system (MapperDSS) tools to characterize regolith resources, surface conditions, and geotechnical properties. CRUX is a NASA-funded Technology Maturation Program effort to provide enabling technology for Lunar and Planetary Surface Operations (LPSO). The MapperDSS uses data fusion methods with CRUX instruments, and other available data and models, to provide regolith properties information needed for LPSO that cannot be determined otherwise. We demonstrate the data fusion method by showing how it might be applied to characterize the distribution and form of hydrogen using a selection of CRUX instruments: Borehole Neutron Probe and Thermal Evolved Gas Analyzer data as a function of depth help interpret Surface Neutron Probe data to generate 3D information. Secondary information from other instruments along with physical models improves the hydrogen distribution characterization, enabling information products for operational decision-making.
This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.
There are a number of reasons why it is important to increase the density of data acquisition functions. Sensor fusion seeks to integrate large numbers of sensors into a decision network. Addition of health monitoring functions may incur additional sensor requirements. But at the same time, it is important to reduce the per-channel costs of data acquisition systems. Often the most significant cost is the management of data acquisition networks, which incurs substantial costs associated with transducer installation, configuration, calibration, and maintenance. Alternatives that lower the cost of the transducer system and reduce the data acquisition system channel count will directly impact initial system costs. Other techniques that affect maintenance and operating costs will contribute to reducing life cycle costs. This paper describes work undertaken to explore alternative architectures for lowering the cost per transducer function using a MEMS-based accelerometer as the model.
On March 9-11, 2022, NASA’s System-Wide Safety Wildland Firefighting Operations Workshop engaged the broader wildland firefighting management ecosystem in a safety-oriented discussion via a virtual platform. This enabled a better understanding of how NASA and community expertise can be leveraged in the safe development of current and future firefighting systems and operations. The goals of the workshop were to: (1) identify and prioritize the top safety-oriented risks, gaps in capabilities, and emerging technologies to enhance wildland firefighting for both near-term and far-term concepts, with a specific focus on aviation operations and (2) engage the stakeholder community in defining emergent safety-oriented scope, roles, responsibilities, and procedures for agents undergoing increasingly complex wildland firefighting operations in information-rich, but uncertain environments. Workshop participants were solicited from wildland firefighting stakeholders across government, industry, and academia. All levels of government were engaged, as NASA sought attendees from federal, state, local, and tribal government agencies. Industry participants from traditional wildland firefighting domains such as data visualization and equipment manufacturers were invited, and corporate attendees from novel application domains such as aerial robotics and autonomous systems were present as well. The top three findings were as follows: (1) Enhancing situation awareness is a safety priority, especially in the use of aerial assets; (2) Timely access to information along with data fusion and integrated displays will enhance safety-critical decision-making both inside and outside aviation contexts; and (3) Tailorable standards and common operating pictures in the field will enhance inter-agency cooperation in the wildland firefighting lifecycle and enable the optimal use of limited resources such as aerial assets. The workshop helped inform NASA of the relevant safety-related wildland firefighting concerns and aided the broader ecosystem in understanding the potential safety-oriented role NASA might play in this community. Increased engagement with crucial governmental stakeholders (e.g., U.S. Forest Service, CAL FIRE, etc.) along with industry partners in cutting- edge information -centric domains is a fundamental next step. Additionally, the workshop findings will help define the first of a series of operationally challenging demonstrations, held in concert with strategic ecosystem partners, known as the Safety Demonstrator Series for NASA’s System-Wide Safety project. The first demonstration is set in the wildland firefighting application domain and will: (1) examine high risk operational scenarios to reduce their overall risk via services, functions or capabilities that act as risk mitigators (or transfer that risk to automated systems better able to tolerate it) and (2) explore novel tools and technologies that will enhance safety margins by enabling non-traditional or neoteric operational paradigms.
The Advanced Capabilities for Emergency Response Operations (ACERO) project is expected to develop, integrate, demonstrate, and transition to operations, evolving aviation technologies from NASA and industry to identify, monitor, and suppress wildland fires as a means to enhance safety, improve operational efficiency, and prevent economic loss. Some of the concepts ACERO explores are: wildfire airspace mangement to improve safety and resource utilization during a disaster, applying new aviation technologies to improve safety and demonstrate new mission-support capabilities, second-shift operations to enable progress towards 24/7 aerial response, and the integration of capabilities across NASA's Aeronautics Research, Science, and Space Technology mission directorates to enable expanded and scalable operations. Realizing this vision is expected to bring positive impact to such areas as: consistency of technology adoption through a unified concept of operations, airspace coordination and deconfliction that integrates portable solutions and enables diverse operations, remote sensing and data fusion for modeling and predictions that support in-time decision making, aircraft technologies for hazard avoidance and state management, and increased response capabilities through persistent communications and surveillance. ACERO continues the research begun under the Scalable Traffic Management for Emergency Response Operations (STEReO) activity, which brings together several technologies in Unmanned Aircraft Systems (UAS) Traffic Management (UTM), Autonomy, Communications, Human Factors, and Domain Expertise & Tools, aimed at providing scalability and flexibility, as well as operational resiliency to dynamic changes during a disaster event. Some of the concepts STEReO explores are: collaborative tools to ingest remote sensing information and distribute a common mission operating picture, apply ad-hoc communication networks to facilitate timely information sharing and communication of changes, vehicle-to-vehicle and onboard autonomy technologies ensure the safety and resiliency of operations, and apply NASA’s UAS traffic management system (UTM) as a public safety UAS Service Supplier (USS) to access and coordinate use of the airspace by both manned and unmanned operations. The potential benefits of STEReO include: standardized, cross-platform communication means increased interoperability and ease of cooperation/collaboration, increased situation awareness and common operating picture allow for earlier detection and decision making, and scalable to size and complexity of environment, operations, and mission objectives. This presentation gives an informational overview of the ACERO and STEReO projects to the Council of Western State Foresters (CWSF) Western State Fire Managers (WSFM) Committee.
Helicopter Health Usage Monitoring Systems (HUMS) must provide reliable, real-time performance monitoring of helicopter operating parameters to prevent damage of flight critical components. Helicopter transmission diagnostics are an important part of a helicopter HUMS. In order to improve the reliability of transmission diagnostics, many researchers propose combining two technologies, vibration and oil monitoring, using data fusion and intelligent systems. Some benefits of combining multiple sensors to make decisions include improved detection capabilities and increased probability the event is detected. However, if the sensors are inaccurate, or the features extracted from the sensors are poor predictors of transmission health, integration of these sensors will decrease the accuracy of damage prediction. For this reason, one must verify the individual integrity of vibration and oil analysis methods prior to integrating the two technologies. This research focuses on comparing the capability of two vibration algorithms, FM4 and NA4, and a commercially available on-line oil debris monitor to detect pitting damage on spur gears in the NASA Glenn Research Center Spur Gear Fatigue Test Rig. Results from this research indicate that the rate of change of debris mass measured by the oil debris monitor is comparable to the vibration algorithms in detecting gear pitting damage.
The Construction Resource Utilization Explorer (CRUX) is a technology maturation project for the U.S. National Aeronautics and Space Administration to provide enabling technology for lunar and planetary surface operations (LPSO). The CRUX will have 10 instruments, a data handling function (Mapper - with features of data subscription, fusion, interpretation, and publication through geographical information system [GIs] displays), and a decision support system DSS) to provide information needed to plan and conduct LPSO. Six CRUX instruments are associated with an instrumented drill to directly measure regolith properties (thermal, electrical, mechanical, and textural) and to determine the presence of water and other hydrogen sources to a depth of about 2 m (Prospector). CRUX surface and geophysical instruments (Surveyor) are designed to determine the presence of hydrogen, delineate near subsurface properties, stratigraphy, and buried objects over a broad area through the use of neutron and seismic probes, and ground penetrating radar. Techniques to receive data from existing space qualified stereo pair cameras to determine surface topography will also be part of the CRUX. The Mapper will ingest information from CRUX instruments and other lunar and planetary data sources, and provide data handling and display features for DSS output. CRUX operation will be semi-autonomous and near real-time to allow its use for either planning or operations purposes.
NASA is investigating revolutionary crew-vehicle interface technologies that strive to proactively overcome aircraft safety barriers that would otherwise constrain the full realization of the next-generation air transportation system. A fixed-based piloted simulation experiment was conducted to evaluate the complementary use of Synthetic and Enhanced Vision technologies. Specific focus was placed on new techniques for integration and/or fusion of Enhanced and Synthetic Vision and its impact within a two-crew flight deck on the crew's decision-making process during low-visibility approach and landing operations. Overall, the experimental data showed that significant improvements in situation awareness, without concomitant increases in workload and display clutter, could be provided by the integration and/or fusion of synthetic and enhanced vision technologies for the pilot-flying and the pilot-not-flying. During non-normal operations, the ability of the crew to handle substantial navigational errors and runway incursions were neither improved nor adversely impacted by the display concepts. The addition of Enhanced Vision may not, unto itself, provide an improvement in runway incursion detection without being specifically tailored for this application. Existing enhanced vision system procedures were effectively used in the crew decision-making process during approach and missed approach operations but having to forcibly transition from an excellent FLIR image to natural vision by 100 ft above field level was awkward for the pilot-flying.