Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensor augmentation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Data Visualization: Augmented Reality

In recent years, there has been an increasing interest in developing new technologies for automated characterization and visualization of condition monitoring data. Augmented Reality (AR) is a technology that is being developed to improve such data visualization. Augmented reality has been defined as a technology that merges virtual and physical components in real-time, and in three dimensions. Wearable, commercially-available AR devices allow onsite engineers and technicians to perform inspection tasks with significantly more available information such as comparisons of past and present sensor and imager data, onsite data analysis and result displays, and various forms of metadata including technical drawings, previous inspection reports and maintenance histories, operation manuals, codes and standards, and holograms representing data analysis results superimposed onto the in situ monitored system.

42 ENGINEERING↗

Artificial intelligence for Space Station automation: Crew safety, productivity, autonomy, augmented capability

Artificial intelligence (AI) R&D projects for the successful and efficient operation of the Space Station are described. The book explores the most advanced AI-based technologies, reviews the results of concept design studies to determine required AI capabilities, details demonstrations that would indicate the existence of these capabilities, and develops an R&D plan leading to such demonstrations. Particular attention is given to teleoperation and robotics, sensors, expert systems, computers, planning, and man-machine interface.

Firschein, O.↗

Convectively Induced Turbulence Encountered During NASA's Fall-2000 Flight Experiments

Aircraft encounters with atmospheric turbulence are a leading cause of in-flight injuries aboard commercial airliners and cost the airlines millions of dollars each year. Most of these injuries are due to encounters with turbulence in and around convection. In a recent study of 44 turbulence accident reports between 1990 and 1996, 82% of the cases were found to be near or within convective activity (Kaplan et al. 1999). According to NTSB accident reports, pilots' descriptions of these turbulence encounters include 'abrupt', 'in Instrument Meteorological Conditions (IMC)', 'saw nothing on the weather radar', and 'the encounter occurred while deviating around' convective activity. Though the FAA has provided guidelines for aircraft operating in convective environments, turbulence detection capability could decrease the number of injuries by alerting pilots of a potential encounter. The National Aeronautics and Space Administration, through its Aviation Safety Program, is addressing turbulence hazards through research, flight experiments, and data analysis. Primary focus of this program element is the characterization of turbulence and its environment, as well as the development and testing of hazard estimation algorithms for both radar and in situ detection. The ultimate goal is to operationally test sensors that will provide ample warning prior to hazardous turbulence encounters. In order to collect data for support of these activities, NASA-Langley's B-757 research aircraft was directed into regions favorable for convectively induced turbulence (CIT). On these flights, the airborne predictive wind shear (PWS) radar, augmented with algorithms designed for turbulence detection, was operated in real time to test this capability. In this paper, we present the results of two research flights when turbulence was encountered. Described is an overview of the flights, the general radar performance, and details of four encounters with severe turbulence.

Hamilton, David W.↗

Intelligent Process Visualization through Nuclear Operation Process Modeling, Reasoning, and Object Detection from Field Videos (Final Report)

This report is a deliverable for the “Final Report” task of DOE NEET Project 19-16790, "Context-Aware Safety Information Display for Nuclear Field Workers." This project's overall goal is to test the hypothesis that integrating computer vision and process reasoning methods will enable proactive visualization of the safe operation and maintenance processes of Nuclear Power Plants (NPP) for field workers. Augmented Reality (AR) glasses adopting such proactive safety information visualization techniques can significantly increase personnel safety and reduce the NPP’s operating costs. The current practice of monitoring NPPs requires workers to switch between digital models, data, and physical workspaces in identifying relevant but potentially occluded objects and in assessing the risks of operation and maintenance processes. On the other hand, frequently changed field conditions require field workers to report to supervisors for real-time guidance. Such guidance is essential to ensure that changing conditions will not invalidate or endanger the work order and other ongoing processes that may jeopardize NPP operations. Additionally, incorrect recognition of equipment objects can result in communication errors and safety problems. AR techniques can assist engineers in viewing the physical workspaces with objects labeled with detailed operation procedures and safety reminders during field operations. The project team developed an “Intelligent Context-Aware Safety Information Display” (ICAD) for supporting Nuclear Power Plant (NPP) field workers in achieving safe and efficient execution of a series of operational tasks in uncertain and changing workspaces of an NPP. Before designing the ICAD-AR prototype, the project team synthesized NPP operational knowledge models through literature review studies, surveys, interviews with domain experts, and knowledge modeling. The project team conducted an extensive study of the operational procedures of various NPPs, and digital technologies that can support the safe and efficient execution of those procedures in different NPP operational contexts. This literature review helped the project team conduct surveys and interviews with nuclear engineers and field workers to identify three categories of information. The NPP knowledge modeling efforts reveal that the three categories of information identified have different levels of importance in a typical procedure of carrying out a series of tasks to achieve a specific NPP operation goal (e.g., shutdown, mode changes). These three categories of information include 1) Workspace dynamics – the changing spatial arrangements of workspaces, tools, protection equipment, and supporting materials, 2) Workflow prognostics – the dynamic dependencies between different parts of an NPP that functionally support and influence each other in terms of safety and efficiency, and 3) Hazards – objects and spaces that contain hazardous materials or physical conditions that can pose risks to workers or mechanical systems. The project team has profiled the importance levels of these categories of information into a knowledge model. This knowledge model specifies what types of information are more critical for a given task in a given workspace so that computers can automatically identify critical objects and sensors in a scene for delivering context-ware safety information to field workers through AR devices. Significant research development of this project results in technical research outcomes and a prototyping system that illustrates the technical feasibility of establishing an ICAD-AR system supporting the proactive safety information display for nuclear field workers. This final report summarizes the project team’s technological achievements in the past three years. Overall, the project team completed the development and integration of five techniques into a prototype ICAD Augmented Reality (ICAD-AR) system and demonstrated the developed system’s real-time execution in a mechanical room. The project team completed the analysis of using this prototype in other types of workspaces based on 3D image data and digital design models collected from two additional workspaces (a water treatment plant and a flow loop training facility). The integrated techniques include 1) Natural Language Processing (NLP) algorithms supporting the generation and updates of nuclear fieldwork process models based on text analysis of work packages and operation manuals; 2) sensor log analysis for predicting control actions in given sensor reading contexts; 3) computer vision algorithms for automatic localization and navigation of workers; 4) object detection algorithms for identifying task-related objects and correlated sensors for safety checking; 5) AR technique as a platform for supporting the integration. The testing results of these five techniques have shown that 1) the sensor log analysis model can predict the next control action with an accuracy of 0.883; 2) the trained natural language processing model can extract more than 80% of the critical information from paper-based procedures (PBPs); 3) the navigation algorithm with the integration of Visual Inertial Odometry (VIO) and Non-Recursive Bayesian Filter methods make operator’s trajectory estimation resilient to drift error; 4) the computer vision algorithm can detect task-specific and safety-critical objects with an average accuracy of 95.3%. The project team used work procedures collected from a flow loop training facility and two datasets collected from two mechanical rooms simulating the workspaces of NPPs to demonstrate the technical capabilities of the developed ICAD-AR prototype. The demonstration validated the technical feasibility of establishing the ICAD-AR system for nuclear field workers and identified the challenges in 1) automatic text analysis of work packages; 2) use of limited samples of sensor logs for predicting the proper timings of control actions; 3) reliably tracking workers and their task progress in mechanical rooms with many similar objects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Machine Learning-Based Method to Estimate Transformer Primary-Side Voltages with Limited Customer-Side AMI Measurements

Distribution control applications such as volt/var optimization, network reconfiguration, and distribution automation require accurate knowledge of the distribution system state. The lack of sufficient sensors on the primary side of distribution networks often limits the accuracy of the control decisions by these applications. The deployment of advanced metering infrastructure (AMI) provides utilities an opportunity to translate the AMI data on the secondary onto the primary so that it can be used as pseudo-measurements to augment the limited existing measurements on the primary. This paper develops a machine learning based approach for estimating service transformer primary-side voltages by using limited secondary-side AMI measurement. The machine learning model is developed by using random forest algorithm. The estimated primary-side voltages can be used by utilities as pseudo-measurements for distribution control applications. The detailed secondary model topology, which is an essential input data for many existing algorithms, is not required for the proposed method. The performance of the proposed method is validated by using AMI measurements from the field and an actual distribution feeder model of San Diego Gas & Electric Company.

advanced metering infrastructure↗

A Machine Learning-Based Method to Estimate Transformer Primary-Side Voltages with Limited Customer-Side AMI Measurements

Distribution control applications such as volt/var optimization, network reconfiguration, and distribution automation require accurate knowledge of the distribution system state. The lack of sufficient sensors on the primary side of distribution networks often limits the accuracy of the control decisions by these applications. The deployment of advanced metering infrastructure (AMI) provides utilities an opportunity to translate the AMI data on the secondary onto the primary so that it can be used as pseudo-measurements to augment the limited existing measurements on the primary. This paper develops an approach for estimating service transformer primary-side voltages by using limited secondary-side AMI measurements. The estimated primary-side voltages can be used by utilities as pseudo-measurements for distribution control applications. The detailed secondary model topology, which is an essential input data for many existing algorithms, is not required for the proposed method. The performance of the proposed method is validated by using AMI measurements from the field and an actual distribution feeder model of San Diego Gas & Electric Company.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Machine Learning-Based Method to Estimate Transformer Primary-Side Voltages with Limited Customer-Side AMI Measurements: Preprint

Distribution control applications such as volt/var optimization, network reconfiguration, and distribution automation require accurate knowledge of the distribution system state. The lack of sufficient sensors on the primary side of distribution networks often limits the accuracy of the control decisions by these applications. The deployment of advanced metering infrastructure (AMI) provides utilities an opportunity to translate the AMI data on the secondary onto the primary so that it can be used as pseudo-measurements to augment the limited existing measurements on the primary. This paper develops an approach for estimating service transformer primary-side voltages by using limited secondary-side AMI measurements. The estimated primary-side voltages can be used by utilities as pseudo-measurements for distribution control applications. The detailed secondary model topology, which is an essential input data for many existing algorithms, is not required for the proposed method. The performance of the proposed method is validated by using AMI measurements from the field and an actual distribution feeder model of San Diego Gas & Electric Company.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Empirical Refinement of the GADRAS Detector Response Function

The Gamma Detector Response and Analysis Software (GADRAS) was augmented to enable empirical refinement of the Detector Response Function (DRF) for gamma-ray detectors. This capability is included in GADRAS starting with Version 18.8.2, which was released in February 2019 Empirical refinement enables improved computational accuracy for gamma-ray spectra when detectors exhibit characteristics that are essentially unique to a particular sensor. This report discusses how to perform the empirical refinement, and examples are presented for the following scenarios where empirical refinement is appropriate: Large plastic scintillators, which are generally composed of polyvinyl toluene (PVT), often exhibit low-energy peaks that are not associated with incident gamma rays. Regardless of whether they are artifacts produced by poor light collection or pulse processing methods, accurate spectral synthesis requires replication of these features; Some detectors, particularly those using Silicon Photomultipliers (SiPM), exhibit energy shifts of Compton edges and escape peaks relative to the same scintillator material attached to a photomultiplier tube. Empirical refinement compensates for these effects, which derive from nonlinearities in the detector response; The change in the DRF as a function of displacement of the source relative to the detector axis cannot always be replicated adequately using only the few shielding parameters that are used by the response function. Empirical refinement enables improved accuracy for computation of spectra during linear transits or when the detector is close to a large radiation source. This is a particularly important consideration for collimated detectors; and, Gamma-ray imagers exhibit complex relationships between spectral response and spatial locations. Empirical refinement enables substantial improvement of the DRF accuracy for imagers.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Adaptive Control for Microgravity Vibration Isolation System

Most active vibration isolation systems that try to a provide quiescent acceleration environment for space science experiments have utilized linear design methods. In this paper, we address adaptive control augmentation of an existing classical controller that employs a high-gain acceleration feedback together with a low-gain position feedback to center the isolated platform. The control design feature includes parametric and dynamic uncertainties because the hardware of the isolation system is built as a payload-level isolator, and the acceleration Sensor exhibits a significant bias. A neural network is incorporated to adaptively compensate for the system uncertainties, and a high-pass filter is introduced to mitigate the effect of the measurement bias. Simulations show that the adaptive control improves the performance of the existing acceleration controller and keep the level of the isolated platform deviation to that of the existing control system.

Yang, Bong-Jun↗

Integrated System Health Management (ISHM) for Test Stand and J-2X Engine: Core Implementation

ISHM capability enables a system to detect anomalies, determine causes and effects, predict future anomalies, and provides an integrated awareness of the health of the system to users (operators, customers, management, etc.). NASA Stennis Space Center, NASA Ames Research Center, and Pratt & Whitney Rocketdyne have implemented a core ISHM capability that encompasses the A1 Test Stand and the J-2X Engine. The implementation incorporates all aspects of ISHM; from anomaly detection (e.g. leaks) to root-cause-analysis based on failure mode and effects analysis (FMEA), to a user interface for an integrated visualization of the health of the system (Test Stand and Engine). The implementation provides a low functional capability level (FCL) in that it is populated with few algorithms and approaches for anomaly detection, and root-cause trees from a limited FMEA effort. However, it is a demonstration of a credible ISHM capability, and it is inherently designed for continuous and systematic augmentation of the capability. The ISHM capability is grounded on an integrating software environment used to create an ISHM model of the system. The ISHM model follows an object-oriented approach: includes all elements of the system (from schematics) and provides for compartmentalized storage of information associated with each element. For instance, a sensor object contains a transducer electronic data sheet (TEDS) with information that might be used by algorithms and approaches for anomaly detection, diagnostics, etc. Similarly, a component, such as a tank, contains a Component Electronic Data Sheet (CEDS). Each element also includes a Health Electronic Data Sheet (HEDS) that contains health-related information such as anomalies and health state. Some practical aspects of the implementation include: (1) near real-time data flow from the test stand data acquisition system through the ISHM model, for near real-time detection of anomalies and diagnostics, (2) insertion of the J-2X predictive model providing predicted sensor values for comparison with measured values and use in anomaly detection and diagnostics, and (3) insertion of third-party anomaly detection algorithms into the integrated ISHM model.

Figueroa, Jorge F.↗

Separate surfaces for automatic flight controls.

The purpose of this paper is to describe an investigation of separate surface stability augmentation systems for general aviation aircraft. The program objective were twofold: first, a wind tunnel program to determine control effectiveness of separate surfaces in the presence of main surfaces, and hinge moment feedback from separate surfaces via the main surfaces to the pilot; second, a theoretical study to determine the minimum performance of actuators and sensors that can be tolerated, the best slaving gains to be used with separate surfaces, and control authority needed for proper operation under direct pilot control, under autopilot control, and in failure situations. On the basis of the results obtained, it has been concluded that separate surface systems are feasible and advantageous for use in general aviation aircraft.

Roskam, J.↗

A Natural Interaction Interface for UAVs Using Intuitive Gesture Recognition

The popularity of unmanned aerial vehicles (UAVs) is increasing as technological advancements boost their favorability for a broad range of applications. One application is science data collection. In fields like Earth and atmospheric science, researchers are seeking to use UAVs to augment their current portfolio of platforms and increase their accessibility to geographic areas of interest. By increasing the number of data collection platforms UAVs will significantly improve system robustness and allow for more sophisticated studies. Scientists would like be able to deploy an available fleet of UAVs to fly a desired flight path and collect sensor data without needing to understand the complex low-level controls required to describe and coordinate such a mission. A natural interaction interface for a Ground Control System (GCS) using gesture recognition is developed to allow non-expert users (e.g., scientists) to define a complex flight path for a UAV using intuitive hand gesture inputs from the constructed gesture library. The GCS calculates the combined trajectory on-line, verifies the trajectory with the user, and sends it to the UAV controller to be flown.

Chandarana, Meghan↗

Using Desis and EO-1 Hyperion Reflectance Time Series for the Assessment of Vegetation Traits and Gross Primary Production (GPP)

This study evaluates the potential of the DLR Earth Sensing Imaging Spectrometer (DESIS) visible through near-infrared (VNIR) surface reflectance to augment the EO-1 Hyperion full spectrum (400-2400 nm) reflectance collection over vegetated flux sites to extend the reflectance time series up to the present. We compared DESIS and Hyperion surface reflectance magnitude and variability at a pseudo-invariant site (PICS) and a vegetated flux site (VFS). VNIR reflectance magnitudes between the two sensors did not significantly differ at the PICS. However, DESIS variability was higher, likely due to differences in the data acquisition time and observation geometry. Using empirical and biophysical models, both DESIS and Hyperion datasets captured the seasonal variations in gross primary production (GPP) and canopy bio-physical parameters such as chlorophyll content, leaf area index (LAI), and senescent material at the VFS. Differences in the magnitudes of the bio-physical parameters were observed, likely due to the differences in the sensors spectral range and resolution. Using VNIR reflectance from EO-1 Hyperion with DESIS convolved to Hyperion spectral resolution to estimate canopy chlorophyll and GPP, we demonstrate that combining historic and current space-based reflectance data in a common multi-sensor approach is feasible. This is of importance for extending the reflectance record established with EO-1 Hyperion to provide continuity with the current orbital instruments (e.g., DESIS/ISS, PRISMA/ASI) and the forthcoming NASA Surface Biology and Geology (SBG), ESA CHIME and DLR EnMAP satellite missions, which is of key importance for comparisons of current and past trends in the seasonal dynamics of vegetation traits and photosynthetic function.

DESIS↗

Structural Health Monitoring of Microreactor Safety Systems Using Convolutional Neural Networks

Microreactors, a class of modular reactors with net power output of less than 20 MWth, have innovative applications in nuclear and nonnuclear industries due to their portability, reliability, resilience, and high capacity factors. In order to operate microreactors on a wider scale, it is essential to bring down maintenance life-cycle costs while ensuring the integrity of operating such systems. Autonomous operations in microreactors using augmented digital-twin (DT) technology can serve as a cost-effective solution by increasing awareness about the system’s health. Structural health monitoring (SHM) is a key component of nuclear DT frameworks. Artificial neural networks can be beneficial to detect degradation in the nuclear safety systems, such as piping equipment systems, by monitoring the sensor data obtained from the plant and its corresponding structures, systems and components. In this report, an SHM methodology is presented which uses convolutional neural networks to determine degraded locations and their corresponding degradation-severity levels at various locations of nuclear piping equipment systems. A simple pipe system, subjected to seismic loads, is selected to design the post-hazard SHM framework. The effectiveness of the proposed SHM methodology is demonstrated by obtaining high accuracy in detecting degraded locations as well as the severity levels.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Optimizing Individualized Treatment Planning for Parkinson’s Disease Using Deep Reinforcement Learning

More than one million people currently live with Parkinson's Disease (PD) in the U.S. alone. Medications, such as levodopa, can help manage PD symptoms. However, medication treatment planning is generally based on patient history and limited interaction between physicians and patients during office visits. This limits the extent of benefit that may be derived from the treatment as disease/patient characteristics are generally non-stationary. Wearable sensors that provide continuous monitoring of various symptoms, such as bradykinesia and dyskinesia, can enhance symptom management. However, using such data to overhaul the current static medication treatment planning approach and prescribe personalized medication timing and dosage that accounts for patient/care-giver/physician feedback/preferences remains an open question. We develop a model to prescribe timing and dosage of medications, given the motor fluctuation data collected using wearable sensors in real-time. We solve the resulting model using deep reinforcement learning (DRL). The prescribed policy determines the optimal treatment plan that minimizes patient's symptoms. Our results show that the model-prescribed policy outperforms the static a priori treatment plan in improving patients' symptoms, providing a proof-of-concept that DRL can augment medical decision making for treatment planning of chronic disease patients.

Watts, Jeremy↗

Sea ice motions in the central arctic ice central arctic pack ice as inferred from AVHRR imagery

Synoptic observations of ice motion in the Arctic Basin are currently limited to those acquired by drifting buoys and, more recently, radar data from ERS-1. Buoys are not uniformly distributed throughout the Arctic, and SAR coverage is limited regionally and temporally due to the data volume, swath width, processing requirements, and power needs of the SAR. Additional ice-motion observations that can map ice responses simultaneously over large portions of the Arctic on daily to weekly time intervals are thus needed to augment the SAR and buoy data and to provide an intermediate-scale measure of ice drift suitable for climatological analyses and ice modeling. Merging the remotely-sensed ice motions with SAR, AVHRR, OLS, and SSM/I imagery permits studies of ice processes over a range of space and time scales. A medium-resolution passive microwave sensor might be ideal for this purpose, but no such satellite will be available in the near future. Combinations of existing data types are thus likely to be our best bet for generating motion fields with a coverage and resolution best suited to climate studies. Principal objectives of this project are to: (1) demonstrate whether sufficient ice features and ice motion existed within the consolidated ice pack to permit motion tracking using AVHRR imagery; (2) determine the limits imposed on AVHRR mapping by cloud cover; and (3) test the applicability of AVHRR-derived motions in studies of ice-atmosphere interactions.

Emery, William↗

Global Assimilation of Multi-Sensor Snow Observations for Improved Characterization of Snow Processes

Snow conditions on the land surface are recognized to be key components of the global hydrological cycle as they play a critical role in the determination of local and regional climate. In many mid-latitude and high-latitude regions, the seasonal water storage and associated spring snowmelt dominate the local hydrology. The contribution to the runoff and moisture conditions from snow is vital in supporting agriculture and in determining water resources management practices. Consequently, accurate characterization of snow properties becomes important for both end-use applications and weather and climate research. Recently a joint effort between the u.S. Air Force and NASA has enabled a blended, multi-sensor snow product known as the AFWA NASA Snow Algorithm (ANSA). This global snow dataset has been generated by utilizing the Earth Observation System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Microwave Scanning Radiometer for EOS (AMSR-E) datasets. ANSA product includes estimates of snow cover extent, snow water equivalent (SWE) and SWE-derived snow depth fields. The MODIS-based products enable snow cover mappings under cloud-free conditions whereas the passive microwave data from AMSR-E provides measurements under cloudy conditions. These remotely-sensed snow observations are further augmented with the information from ground-based snow measurements through data fusion techniques. The resulting ANSA products are employed in the NASA Land Information System (LIS) data assimilation framework, which provides a comprehensive environment for integrating community land surface models, ground and satellite-based observations, and ensemble-based data assimilation tools. LIS incorporates the multisensor ANSA snow retrievals with the land surface model estimates to generate spatially and temporally continuous estimates of snow states, through data assimilation. A suite of experiments to assimilate ANSA snow cover, SWE and snow depth estimates with different land surface models in LIS are conducted and the resulting estimates of snow conditions are evaluated against a number of in-situ observational datasets, over several regions of the world. These evaluations are used to compare and contrast the advantages and disadvantages of these multi-sensor snow observations.

Kumar, Sujay↗

Parallel Architectures for Planetary Exploration Requirements (PAPER)

The Parallel Architectures for Planetary Exploration Requirements (PAPER) project is essentially research oriented towards technology insertion issues for NASA's unmanned planetary probes. It was initiated to complement and augment the long-term efforts for space exploration with particular reference to NASA/LaRC's (NASA Langley Research Center) research needs for planetary exploration missions of the mid and late 1990s. The requirements for space missions as given in the somewhat dated Advanced Information Processing Systems (AIPS) requirements document are contrasted with the new requirements from JPL/Caltech involving sensor data capture and scene analysis. It is shown that more stringent requirements have arisen as a result of technological advancements. Two possible architectures, the AIPS Proof of Concept (POC) configuration and the MAX Fault-tolerant dataflow multiprocessor, were evaluated. The main observation was that the AIPS design is biased towards fault tolerance and may not be an ideal architecture for planetary and deep space probes due to high cost and complexity. The MAX concepts appears to be a promising candidate, except that more detailed information is required. The feasibility for adding neural computation capability to this architecture needs to be studied. Key impact issues for architectural design of computing systems meant for planetary missions were also identified.

Cezzar, Ruknet↗