Search NASA⌕ Search

SEARCH · Search NASA

Results for “quality monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2012

Pacific Northwest National Laboratory Site Environmental Report for Calendar Year 2011

The PNNL Site Environmental Report for Calendar Year 2011 was prepared pursuant to the requirements of Department of Energy (DOE) Order 231.1B, "Environment, Safety and Health Reporting" to provide a synopsis of calendar year 2011 information related to environmental management performance and compliance efforts. It summarizes site compliance with federal, state, and local environmental laws, regulations, policies, directives, permits, and orders and environmental managemePacific Northwest National Laboratory (PNNL), one of 10 national laboratories supporting the U.S. Department of Energy (DOE) Office of Science, provides innovative science and technology development in the areas of energy and the environment, fundamental and computational science, and national security. DOE’s Pacific Northwest Site Office (PNSO) is responsible for PNNL oversight in Richland, Washington, as well as facilities in Sequim, Seattle, and North Bonneville, Washington, and Portland, Oregon. This site environmental report provides a synopsis of ongoing environmental management performance and compliance activities conducted during 2011. The report addresses the operations occurring on PNNL’s Richland campus, which includes PNSO’s PNNL Site facilities and Battelle-owned and -leased facilities. The report includes a description of the PNSO Site and setting; addresses compliance with all applicable DOE, federal, state, and local regulations; documents environmental monitoring efforts and status; presents potential radiation doses to staff and the public in the surrounding area; and data quality assurance methodsnt performance.

air quality↗
DOE OSTI2017

Research on the DESI Experiment at Southern Methodist University

The SMU observational cosmology group in 2017-2019 continued its work in preparing DESI for operations slated to start in 2020. There are three major developments: a) a real-time spectroscopic data reduction and monitoring software needed for DESI Operations, b) components of spectroscopic simulation needed to support DESI science, and c) techniques and procedures to estimate spectroscopic observational systematics on BAO measurements for emission line galaxies (ELGs). We successfully developed a fast, flexible spectroscopic pipeline incorporating a comprehensive set of data quality algorithms. This included substantial development of data reduction algorithms, as well as the infrastructure to build pipelines for different data types necessary for calibration and science. Effort on data quality included supporting real-time monitoring during operations and long-term data quality needs for analysis. During this period, the SMU team contributed to development of DESI’s 1D spectroscopic simulation solutions, with a flexible pipeline that also mimicked the impact of the offline pipeline. Further work to upgrade the fast, parametric simulation, QuickCat, was also performed. We have also developed an initial methodology for the forward modeling of spectroscopic systematic uncertainties on ELG BAO measurements resulting from observing conditions. Kehoe also contributed to commissioning and science requirements documents, and served in difference service roles during the reporting period.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2022

An Examination of the Recent Stability of Ozonesonde Global Network Data

The recent Assessment of Standard Operating Procedures for OzoneSondes (ASOPOS 2.0; WMO/GAW Report #268) addressed questions of homogeneity and long-term stability in global electrochemical concentration cell (ECC) ozone sounding network time series. Among its recommendations was adoption of a standard for evaluating data quality in ozonesonde time series. Total column ozone (TCO) derived from the sondes compared to TCO from Aura’s Ozone Monitoring Instrument (OMI) is a primary quality indicator. Comparisons of sonde ozone with Aura’s Microwave Limb Sounder (MLS) are used to assess the stability of stratospheric ozone. This paper provides a comprehensive examination of global ozonesonde network data stability and accuracy since 2004 in light of the sudden post-2013 TCO “dropoff” of ~3-4% that was reported previously at select stations (Stauffer et al., 2020). Comparisons with Aura OMI TCO averaged across the network of 60 stations are stable within about ±2% over the past 18 years. Sonde TCO has similar stability compared to three other TCO satellite instruments, and the stratospheric ozone measurements average to within ±5% of MLS from 50 to 10 hPa. Thus, sonde data are reliable for trends, but with a caveat applied for a subset of dropoff stations in the tropics and subtropics. The dropoff is associated with only one of two major ECC instrument types. A detailed examination of ECC serial numbers pinpoints the timing of the dropoff. However, we find that overall, ozonesonde data are stable and accurate compared to independent measurements over the past two decades.

Ryan M. Stauffer↗
DOE OSTI2017

Research and Development Toward Massive Liquid Argon Time Projection Chambers for Neutrino Detection

Liquid argon (LAr) time projection chambers (TPC) have rapidly increased in importance as particle detectors throughout the past four decades. While much research has been completed, there are still many areas which require further development to build and operate the next generation LAr TPC experiment, such as the Deep Underground Neutrino Experiment (DUNE). These include high voltage breakdown, argon purification and purity monitoring, and vacuum ultraviolet (VUV) scintillation light measurement. Visual monitoring of high voltage breakdown is helpful in allowing assessment of the performance of high voltage component design. Thus, a system of cryogenic cameras, the first of its kind, was developed for use in a large LAr cryostat, without the need for additional electronics heating. The system functioned without problem for 50 days at cryogenic temperature, with some degradation of image quality, and provided a useful monitor for the DUNE 35-ton cryogenics systems. The system did not observe any high voltage breakdowns during the run. Further development of the concept is ongoing for future installation in other experiments. The monitoring of LAr purity using TPC data is a fundamental study for LAr TPC experiments. However, the study has not been performed for a large LAr TPC in the presence of high electronic noise. Custom software was developed and validated for the accurate reconstruction of signals in noisy TPC data. The results of the reconstruction were used to successfully measure the LAr electron lifetime with an uncertainty comparable to alternate methods of measurement. The electron lifetime of the 35-ton Phase II run is determined to be 4.12 ± 0.17 (stat.) ±0.40 (syst.) ms. For general purpose research and development of high purity LAr as a particle detection medium, a dedicated test stand was designed, constructed, and commissioned. The system is used to test the gaseous photomultiplier (GPM) performance at cryogenic temperatures. The GPM functions with photoelectron multiplication at 77 K, at a reduced gain. Further study is required to show the detector’s direct sensitivity to LAr VUV scintillation light.

Thiesse, Matthew↗
NASA NTRSDate not supplied

Accelerating TEMPO Air Quality Science Through STAQS

Soon after the launch of Tropospheric Emissions: Monitoring of Pollution (TEMPO) mission, NASA is supporting the Synergistic TEMPO Air Quality Science field study (STAQS) in summer 2023. This study’s main objective is to accelerate science with geostationary air quality observations from TEMPO to better understand its use in air pollution research and applications. Science objectives include, but are not limited to, TEMPO L2 product evaluation, the interpretation of the spatiotemporal evolution of TEMPO data during air quality events, assessment of anthropogenic emissions, contributions to chemical transport modeling, and environmental justice applications. These objectives can be accomplished through the integration of satellite data with systematically repeated high-resolution aircraft- and ground-based measurements in multiple urban environments. The primary urban cities considered include Los Angeles, New York City, and Chicago in June-August 2023. Measurements consist of airborne remote sensing observations of air quality constituents of nitrogen dioxide (NO2), formaldehyde (HCHO), ozone, and aerosols using the GeoCape Airborne Simulator and High-Spectral Resolution Lidar 2/Differential Absorption Lidar (HSRL2/DIAL) on the NASA JSC G-V aircraft, greenhouse gas observations from Airborne Visible InfraRed Imaging Spectrometer - Next Generation (AVIRIS-NG) and High Altitude Lidar Observatory (HALO) on the NASA LaRC G-III aircraft, and ground-based remote sensing and in situ observations of ozone, NO2, and HCHO from the Tropospheric Ozone Lidar Network (TOLNet), Pandora spectrometers, and ground-based monitoring networks. Key partnership studies providing in situ airborne observations include the NOAA Atmospheric Emissions and Reactions Observed from Megacities to Marine Areas (AEROMMA) field study on the NASA DC-8 in the same primary target areas as STAQS and Greater New York Oxidant, Tropospheric Halogens, and Aerosol Measurements and Modeling (GOTHAMM) field study on the NSF C-130 near New York City. This presentation will include a current status update of the STAQS mission and an overview of its measurement strategies and science objectives with the goal of promoting continued discussions for building and strengthening collaborations prior to the mission.

Laura Judd↗
DOE OSTI2024

Practical procedures for sensor quality assessment

Sensors are increasingly deployed for process monitoring and control. These produce on-line measurements at a high frequency, in parallel with low-frequency laboratory measurements. Compared to laboratory practices, sensor data quality assessment and control practices are far less structured at most utilities. This leads to inaccurate sensor data with unknown uncertainty factors.This chapter shows how to establish standard operating procedures (SOPs) to support sensor data quality assessment and control and subsequent maintenance actions by producing relevant sensor metadata. Furthermore, SOPs are provided for the most commonly used wastewater quality sensors, inspired by utility and academic best practices. This chapter builds on definitions provided in Chapter 3 and provides additional definitions specifically related to sensors maintenance. Chapter 6 complements the methods in this chapter, which are based on reference measurements, with data-analytical techniques.

Alferes, Janelcy↗
DOE OSTI2019

SRNL Report on Vendor Solicitation and Selective Ion-Electrode Testing

Effective operation of the Hanford Tank Waste Treatment and Immobilization Plant (WTP) will require information collected from sampling and/or monitoring to maintain environmental compliance, product quality, and operating efficiency. The U.S. Department of Energy (DOE) – Office of River Protection (ORP) recognizes the potential long-term benefit of developing real-time, in-line monitoring (RTIM) at the WTP to improve the current strategy of collecting tens of thousands of samples and analyzing them. In-line monitoring can decrease processing time associated with waiting for sample analysis, reduce workers’ exposure to radiation and chemical hazards, decrease secondary waste volumes, potentially improve product quality, and provide production support and enhance overall operational control. The Assistant Manager, WTP chartered an Integrated Technical Team (ITT), which includes personnel from the Savannah River National Laboratory (SRNL), Bechtel National, Inc., and DOE-ORP, to evaluate the capability and potential benefits of replacing routine sample collection requirements with real-time, in-line monitoring. The initial focus of the ITT is the Direct Feed Low Activity Waste (DFLAW) Program. This work scope is being performed in multiple phases. Phase 1 is Requirements and Opportunities Analysis, Phase 2 is Applications and Benefits Determination, and Phase 3 is Qualification and Demonstration. Phase 1 included 6 tasks and was completed by SRNL in 2017. The tasks in Phase 1 were: (1) determining the functional requirements for determining analytes and properties of streams, (2) determining the technical basis for process control, (3) determining the sampling points within the Low Activity Waste (LAW) facility and Effluent Management Facility (EMF), (4) data quality and management, (5) process control challenges, and (6) preparing a Preliminary Analysis Plan. DOE-ORP was briefed on the findings from the Phase 1 tasks and requested that Phase 2 work focus on establishing a basis for a materials balance approach that minimized process sampling. The Phase 2 work scope contains tasks to evaluate a materials balance only approach as well as continuing scoping evaluations for instruments that could be used for RTIM. The Phase 2 work scope was completed by both SRNL and Pacific Northwest National Laboratory (PNNL). The tasks performed in Phase 2 were: 1. Overall program administration and technical oversight 2. Evaluation of a Material Balance Approach, a. Evaluation of uncertainty of this approach compared to uncertainty of current methods b. Evaluation of automating the material balance within the framework of existing control software, c. Development of the methodology to obtain and evaluate data during cold commissioning to support a material balance approach, and d. Development of a framework to utilize during presentation of the revised approach to stakeholders and regulators. 3. Screening Evaluations of Instruments to Supplement the Material Balance Approach, a. AP-105 melter condensate evaluations, and b. Screening testing with simulants. 4. Evaluation of the current DFLAW feed qualification program to identify analytes that could be eliminated, a. Inorganic analytes, b. Radionuclides, and c. Organic analytes. This report describes the results of Task 3b, Screening testing with simulants. The Savannah River National Laboratory requested demonstrations of commercially available analytical instruments by the vendors or laboratory demonstration. The techniques tested included: Raman spectroscopy, Infrared spectroscopy (IR), laser induced breakdown spectroscopy (LIBS), X-Ray Fluorescence Spectroscopy (XRF), and ion-selective electrochemical probes. Additionally, the instrumentation would need to be durable enough to withstand the environment of the plant, preferably with little to no maintenance. The insertion point of the instrument would be dependent upon the instrumentation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Characterization of Non-Science Grade DESI CCDs and Creating Additional ICARUS Monitoring Metrics

DESI, otherwise known as the Dark Energy Spectroscopic Instrument, is a tool to measure optical spectra from the effects of dark energy on the universe and has been running for 3 years. My work delves into the data taking/analysis side of the DESI CCDs which will help in swapping out broken CCDs on the instrument. Additionally, I worked on making new metrics for ICARUS, Imaging Cosmic and Rare Underground Signals for their monitoring of run data. This paper will talk about the types of characterizations done for DESI and some metrics for data quality and tools used for ICARUS monitoring.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRSDate not supplied

Hawaii Water Resources: Monitoring the Impact of Land-Based Sources of Pollution on Water Quality Along the Coast of West Maui, Hawai'i, to Assess Coral Reef Condition

West Maui is at risk of losing ecosystem services provided by coral reefs due to land-based sources of pollution (LBSP). In 2011, the US Coral Reef Task Force (USCRTF) identified the West Maui watershed as a priority watershed (along with its sub-watersheds of Wahikuli, Honokōwai, Kahana, Honokahua, and Honolua) after decades of coral decline, giving rise to the multi-agency West Maui Ridge to Reef (R2R) Initiative. The DEVELOP Hawai’i Water Resources team partnered with the R2R Initiative and the Hawai’i Department of Land and Natural Resources Division of Aquatic Resources (DLNR-DAR) to address the need for better watershed management practices. The team provided the partners with a Google Earth Engine tool that displays land use and land cover changes (LULCC) in the five watersheds and detects near-shore turbidity, chlorophyll-a (chl-a), and sea surface temperature using Landsat 4 Thematic Mapper (TM), Landsat 5 TM, Landsat 7 Enhanced Thematic Mapper Plus (ETM+), Landsat 8 Operational Land Imager (OLI), Terra Moderate Resolution Imaging Spectroradiometer (MODIS), and Aqua MODIS. Team members used ancillary data provided by the R2R Initiative and the USGS Pacific Coastal and Marine Science Center (PCMSC) to validate satellite parameter values. The land cover analysis captured a general trend of increasing impervious cover and decreasing vegetated cover from 1989 to 2019; however, the extent of this change varied between each watershed. This analysis, coupled with the tool, can help project partners continually monitor terrestrial and marine patterns associated with coral decline.

Water Resources↗
NASA NTRSDate not supplied

ASTM International Conference on Additive Manufacturing – 2022

The In-Situ Project: Correlating In-situ monitoring data and Non-Destructive Evaluation (NDE) methods to characterize defect populations in Laser Powder Bed Fusion (L-PBF) material NDE is critical to enable the safe use of additive manufactured (AM) parts in aerospace applications. However, traditional NDE methods are not fully adaptable to complex AM geometries to appropriately screen for critical defects, and L-PBF processes inherently generate defects. In-situ monitoring techniques can give information about the quality of the build process and indicate process variations that could potentially create defects. Proven, causal correlations between in-situ monitoring indications and resulting defects are needed to inform about the final quality of the part. Thus, the development of a new approach is necessary. NASA started a two-phase study that would investigate techniques for characterizing defect populations in L-PBF material, first in material with induced defects, then in a nominal L-PBF process, by correlating in-situ, NDE, and serial sectioning data. Objectives also include the evaluation of seeded defect methodologies for realistic defect creation, creating a baseline of defect populations in a Qualified Material Process (QMP), characterizing the effect of heat treatment, and correlating defect populations with tensile and fatigue properties. By comparing computed tomography images, in-situ monitoring images, and metallography images, the team has been able to draw preliminary conclusions. They include a better understanding of the limitation of the NDE tools, learning about the “healing” of the samples observed during layer building and a comparison study on different laser power variation samples. Those preliminary conclusions will help dictate the follow-up work that will be presented at the conference.

additive manufacturing↗
DOE OSTI2023

Impact of Flow Configurations on Response Time and Data Quality in Real-Time, In-Line Fourier Transform Infrared (FTIR) Monitoring of Viscous Flows

The real-time, in-line monitoring of continuous flow concentrations is widely conducted via infrared (IR) spectrometry by using a flow cell connected to a reactive flow stream. For protective purposes, the IR sensor tip is typically offset from the flow. This offset can cause the formation of a stagnant boundary layer above the sensor, especially when dealing with high-viscosity fluids. As a result, the IR signal response time is often controlled by the slow diffusional exchange of fluid in the boundary layer, as confirmed via 2D computational fluid dynamics (CFD) simulations. We evaluated several flow configuration modifications in a typical IR flow cell in order to identify the changes to the flow dynamics that enable improved response times with minimal changes to the cell configuration: the use of (i) vertical flow, where the standard horizontal flow over the sensor is redirected to contact vertically with the sensor, (ii) a static mixer to create radial flow momentum above the IR sensor, and (iii) horizontal or vertical nozzles to direct the flow toward the IR sensor. The vertical flow configuration did not show any significant improvement over the standard horizontal flow configuration. However, the static mixer, horizontal nozzle, and vertical nozzle configurations all resulted in markedly improved response times and signal quality, albeit at the expense of a higher pressure drop across the flow cell. These results point toward straightforward, user-accessible modifications of in-line IR flow cells that result in significant improvements in signal stability and acquisition times.

42 ENGINEERING↗
NASA NTRS2000

Monitoring Geothermal Features in Yellowstone National Park with ATLAS Multispectral Imagery

The National Park Service (NPS) must produce an Environmental Impact Statement for each proposed development in the vicinity of known geothermal resource areas (KGRAs) in Yellowstone National Park. In addition, the NPS monitors indicator KGRAs for environmental quality and is still in the process of mapping many geothermal areas. The NPS currently maps geothermal features with field survey techniques. High resolution aerial multispectral remote sensing in the visible, NIR, SWIR, and thermal spectral regions could enable YNP geothermal features to be mapped more quickly and in greater detail In response, Yellowstone Ecosystems Studies, in partnership with NASA's Commercial Remote Sensing Program, is conducting a study on the use of Airborne Terrestrial Applications Sensor (ATLAS) multispectral data for monitoring geothermal features in the Upper Geyser Basin. ATLAS data were acquired at 2.5 meter resolution on August 17, 2000. These data were processed into land cover classifications and relative temperature maps. For sufficiently large features, the ATLAS data can map geothermal areas in terms of geyser pools and hot springs, plus multiple categories of geothermal runoff that are apparently indicative of temperature gradients and microbial matting communities. In addition, the ATLAS maps clearly identify geyserite areas. The thermal bands contributed to classification success and to the computation of relative temperature. With masking techniques, one can assess the influence of geothermal features on the Firehole River. Preliminary results appear to confirm ATLAS data utility for mapping and monitoring geothermal features. Future work will include classification refinement and additional validation.

Spruce, Joseph↗
NASA NTRS1981

The 1979 Southeastern Virginia Urban Plume Study. Volume 1: Description of experiments and selected aircraft data

The Southeastern Virginia Urban Plume Study (SEV-UPS) utilizes remote sensors and satellite platforms to monitor the Earth's environment and resources. SEV-UPS focuses on the application of specific remote sensors to the monitoring and study of specific air quality problems. The 1979 SEV-UPS field program was conducted with specific objectives: (1) to provide correlative data to evaluate the Laser Absorption spectrometer ozone remote sensors; (2) to demonstrate the utility of the sensor for the study of urban ozone problems; (3) to provide additional insights into air quality phenomena occuring in Southeastern Virginia; and (4) to compare measurement results of various in situ measurement platforms. The field program included monitoring from 12 surface stations, 4 aircraft, 2 tethered balloons, 2 radiosonde release sites, and numerous surface meteorological observation sites. The aircraft monitored 03, NO, NOX, Bscat, temperature, and dewpoint temperature.

Gregory, G. L.↗
NASA NTRSDate not supplied

An Approach to Identifying Aspects of Positive Pilot Behavior within the Aviation Safety Reporting System

The National Airspace System (NAS) is constantly evolving as air traffic continues to ramp up to pre-pandemic numbers and projected to grow to unprecedented levels in the coming years. As well as increasing demand to the current system, emerging operations such as Unmanned Autonomous Systems are also expected to add to complexity in the airspace. To address these issues, the industry and government agencies supporting the NAS will need to rely upon additional automation and new technologies to address future operational requirements, while continuing to be a world-leading safe transportation system. As these new technologies are implemented, the system continues to rely on human pilots and controllers in the loop to monitor the system and intervene in situations the automation cannot handle. The goal of proactively addressing safety is of foremost concern to ensure passenger confidence. The industry has implemented various Safety Monitoring Systems to identify safety risks and proactively address them before they result in a serious incident or accident. One such program is the Aviation Safety Reporting System (ASRS). ASRS is a long-established system where pilots and controllers voluntarily and anonymously report safety incidents they experienced and observed during line operations by providing rich text narratives describing the events, the environment, and conditions leading to the safety event of concern. These narratives provide insight and context around events of interest and can be used to identify emerging problems. They can trigger investigations within Flight Operational Quality Assurance or Flight Data Monitoring programs. However, this process typically focuses on the adverse events and the unsafe aspects of the operations surrounding the reported or detected events. This perspective of investigating factors that went wrong around an adverse event is commonly referred to as Safety I. Alternatively, characterizing successful actions that operators perform every day under varying conditions that keep the system within safe operating bounds is a concept referred to as Safety II. The benefit of the Safety II view is that the scope is much larger than that of Safety I since a vast majority of the operations result in successful flights. Many of the successful techniques used to manage operational threats are not documented in standard operating procedures or taught during training. They are typically acquired over time by working with experienced pilots during line operations or in many cases after experiencing a problem for the first time and reacting to it in situ, drawing from years of experience to manage the threat. In an attempt to quantify these positive actions, we are proposing an approach to extracting key behaviors within ASRS reports that can support the Safety II concept. Our analysis assumes that ASRS reports contain some descriptions of corrective actions that operators performed to prevent a situation from leading to an accident. Leveraging recent advances in Natural Language Process modeling, we have developed an approach to extract positive sentiment from reports, embed these positive statements in a vector space where they can be numerically analyzed, and clustering these statements into similar contextual categories. From these contextualized categories we can attempt to summarized and distilled aspects of the positive behavior. The goal is to identify categories of behavior that describe consistent operator techniques that supports the Safety II concept. With this information, airlines may enable learning from these positive actions, or address procedures that need to be changed to avoid having pilots implement a workaround. These insights can provide a lens into what is “going right” in the operations that may otherwise not be known widely within the community. It is envisioned that this approach can be extended to other narrative programs such as Line Operation Safety Audit or Learning Improvement Team reports where similar observed behavior can be analyzed to extract positive actions and inform the overall operations.

NLP↗
NASA NTRSDate not supplied

An Approach to Identifying Aspects of Positive Pilot Behavior within the Aviation Safety Reporting System

The National Airspace System (NAS) is constantly evolving as air traffic continues to ramp up to pre-pandemic numbers and projected to grow to unprecedented levels in the coming years. As well as increasing demand to the current system, emerging operations such as Unmanned Autonomous Systems are also expected to add to complexity in the airspace. To address these issues, the industry and government agencies supporting the NAS will need to rely upon additional automation and new technologies to address future operational requirements, while continuing to be a world-leading safe transportation system. As these new technologies are implemented, the system continues to rely on human pilots and controllers in the loop to monitor the system and intervene in situations the automation cannot handle. The goal of proactively addressing safety is of foremost concern to ensure passenger confidence. The industry has implemented various Safety Monitoring Systems to identify safety risks and proactively address them before they result in a serious incident or accident. One such program is the Aviation Safety Reporting System (ASRS). ASRS is a long-established system where pilots and controllers voluntarily and anonymously report safety incidents they experienced and observed during line operations by providing rich text narratives describing the events, the environment, and conditions leading to the safety event of concern. These narratives provide insight and context around events of interest and can be used to identify emerging problems. They can trigger investigations within Flight Operational Quality Assurance or Flight Data Monitoring programs. However, this process typically focuses on the adverse events and the unsafe aspects of the operations surrounding the reported or detected events. This perspective of investigating factors that went wrong around an adverse event is commonly referred to as Safety I. Alternatively, characterizing successful actions that operators perform every day under varying conditions that keep the system within safe operating bounds is a concept referred to as Safety II. The benefit of the Safety II view is that the scope is much larger than that of Safety I since a vast majority of the operations result in successful flights. Many of the successful techniques used to manage operational threats are not documented in standard operating procedures or taught during training. They are typically acquired over time by working with experienced pilots during line operations or in many cases after experiencing a problem for the first time and reacting to it in situ, drawing from years of experience to manage the threat. In an attempt to quantify these positive actions, we are proposing an approach to extracting key behaviors within ASRS reports that can support the Safety II concept. Our analysis assumes that ASRS reports contain some descriptions of corrective actions that operators performed to prevent a situation from leading to an accident. Leveraging recent advances in Natural Language Process modeling, we have developed an approach to extract positive sentiment from reports, embed these positive statements in a vector space where they can be numerically analyzed, and clustering these statements into similar contextual categories. From these contextualized categories we can attempt to summarized and distilled aspects of the positive behavior. The goal is to identify categories of behavior that describe consistent operator techniques that supports the Safety II concept. With this information, airlines may enable learning from these positive actions, or address procedures that need to be changed to avoid having pilots implement a workaround. These insights can provide a lens into what is “going right” in the operations that may otherwise not be known widely within the community. It is envisioned that this approach can be extended to other narrative programs such as Line Operation Safety Audit or Learning Improvement Team reports where similar observed behavior can be analyzed to extract positive actions and inform the overall operations.

NLP↗
NASA NTRSDate not supplied

An Approach to Identifying Aspects of Positive Pilot Behavior within the Aviation Safety Reporting System

The National Airspace System (NAS) is constantly evolving as air traffic continues to ramp up to pre-pandemic numbers and projected to grow to unprecedented levels in the coming years. As well as increasing demand to the current system, emerging operations such as Unmanned Autonomous Systems are also expected to add to complexity in the airspace. To address these issues, the industry and government agencies supporting the NAS will need to rely upon additional automation and new technologies to address future operational requirements, while continuing to be a world-leading safe transportation system. As these new technologies are implemented, the system continues to rely on human pilots and controllers in the loop to monitor the system and intervene in situations the automation cannot handle. The goal of proactively addressing safety is of foremost concern to ensure passenger confidence. The industry has implemented various Safety Monitoring Systems to identify safety risks and proactively address them before they result in a serious incident or accident. One such program is the Aviation Safety Reporting System (ASRS). ASRS is a long-established system where pilots and controllers voluntarily and anonymously report safety incidents they experienced and observed during line operations by providing rich text narratives describing the events, the environment, and conditions leading to the safety event of concern. These narratives provide insight and context around events of interest and can be used to identify emerging problems. They can trigger investigations within Flight Operational Quality Assurance or Flight Data Monitoring programs. However, this process typically focuses on the adverse events and the unsafe aspects of the operations surrounding the reported or detected events. This perspective of investigating factors that went wrong around an adverse event is commonly referred to as Safety I. Alternatively, characterizing successful actions that operators perform every day under varying conditions that keep the system within safe operating bounds is a concept referred to as Safety II. The benefit of the Safety II view is that the scope is much larger than that of Safety I since a vast majority of the operations result in successful flights. Many of the successful techniques used to manage operational threats are not documented in standard operating procedures or taught during training. They are typically acquired over time by working with experienced pilots during line operations or in many cases after experiencing a problem for the first time and reacting to it in situ, drawing from years of experience to manage the threat. In an attempt to quantify these positive actions, we are proposing an approach to extracting key behaviors within ASRS reports that can support the Safety II concept. Our analysis assumes that ASRS reports contain some descriptions of corrective actions that operators performed to prevent a situation from leading to an accident. Leveraging recent advances in Natural Language Process modeling, we have developed an approach to extract positive sentiment from reports, embed these positive statements in a vector space where they can be numerically analyzed, and clustering these statements into similar contextual categories. From these contextualized categories we can attempt to summarized and distilled aspects of the positive behavior. The goal is to identify categories of behavior that describe consistent operator techniques that supports the Safety II concept. With this information, airlines may enable learning from these positive actions, or address procedures that need to be changed to avoid having pilots implement a workaround. These insights can provide a lens into what is “going right” in the operations that may otherwise not be known widely within the community. It is envisioned that this approach can be extended to other narrative programs such as Line Operation Safety Audit or Learning Improvement Team reports where similar observed behavior can be analyzed to extract positive actions and inform the overall operations.

NLP↗
DOE OSTI2013

Use of treatment log files in spot scanning proton therapy as part of patient-specific quality assurance

Purpose: The purpose of this work was to assess the monitor unit (MU) values and position accuracy of spot scanning proton beams as recorded by the daily treatment logs of the treatment control system, and furthermore establish the feasibility of using the delivered spot positions and MU values to calculate and evaluate delivered doses to patients. Methods: To validate the accuracy of the recorded spot positions, the authors generated and executed a test treatment plan containing nine spot positions, to which the authors delivered ten MU each. The spot positions were measured with radiographic films and Matrixx 2D ion-chambers array placed at the isocenter plane and compared for displacements from the planned and recorded positions. Treatment logs for 14 patients were then used to determine the spot MU values and position accuracy of the scanning proton beam delivery system. Univariate analysis was used to detect any systematic error or large variation between patients, treatment dates, proton energies, gantry angles, and planned spot positions. The recorded patient spot positions and MU values were then used to replace the spot positions and MU values in the plan, and the treatment planning system was used to calculate the delivered doses to patients. The results were compared with the treatment plan. Results: Within a treatment session, spot positions were reproducible within {+-}0.2 mm. The spot positions measured by film agreed with the planned positions within {+-}1 mm and with the recorded positions within {+-}0.5 mm. The maximum day-to-day variation for any given spot position was within {+-}1 mm. For all 14 patients, with {approx}1 500 000 spots recorded, the total MU accuracy was within 0.1% of the planned MU values, the mean (x, y) spot displacement from the planned value was (-0.03 mm, -0.01 mm), the maximum (x, y) displacement was (1.68 mm, 2.27 mm), and the (x, y) standard deviation was (0.26 mm, 0.42 mm). The maximum dose difference between calculated dose to the patient based on the plan and recorded data was within 2%. Conclusions: The authors have shown that the treatment log file in a spot scanning proton beam delivery system is precise enough to serve as a quality assurance tool to monitor variation in spot position and MU value, as well as the delivered dose uncertainty from the treatment delivery system. The analysis tool developed here could be useful for assessing spot position uncertainty and thus dose uncertainty for any patient receiving spot scanning proton beam therapy.

60 APPLIED LIFE SCIENCES↗