Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

CASL Validation Data: An Initial Review

The study aims to establish a comprehensive view of “data” needed for supporting implementation of the Consortium of Advanced Simulation of LWRs (CASL). Insights from this review (and its continual refinement), together with other elements developed in CASL, should provide the foundation for developing the CASL Validation Data Plan (VDP). VDP is instrumental to the development and assessment of CASL simulation tools as predictive capability. Most importantly, to be useful for CASL, the VDP must be devised (and agreed upon by all participating stakeholders) with appropriate account for nature of nuclear engineering applications, the availability, types and quality of CASL-related data, and novelty of CASL goals and its approach to the selected challenge problems. The initial review (summarized on the January 2011 report version) discusses a broad range of methodological issues in data review and Validation Data Plan. Such a top-down emphasis in data review is both needed to see a big picture on CASL data and appropriate when the actual data are not available for detailed scrutiny. As the data become available later in 2011, a revision of data review (and regular update) should be performed. It is expected that the basic framework for review laid out in this report will help streamline the CASL data review in a way that most pertinent to CASL VDP.

97 MATHEMATICS AND COMPUTING↗

An expert system to advise astronauts during experiments

Work being done on an expert system designed to improve the quality of space experimentation in vestibular physiology is described. Emphasis is given to two of the several modules of which the system architecture is composed: the Protocol Manager and the Interesting Data Filter. Some engineering issues related to human factors and to data acquisition and monitoring are also addressed.

Young, Laurence R.↗

Computational support of the X-29A Advanced Technology Demonstrator flight experiment

Issues and questions associated with the forward swept wing and closely coupled canard are addressed. The primary focus will be on research questions which must be addressed to obtain high quality ground and flight test data. These data will be used in conjunction with computational predictions to complement the analyses required to comprehensively understand the interacting technologies.

Waggoner, E. G.↗

Facilitating Data Collection of Maintenance Events to Populate the Hydrogen Component Reliability Database (HyCReD)

The Hydrogen Component Reliability Database (HyCReD) is a collaborative project between the National Renewable Energy Laboratory, the University of Maryland, and hydrogen stakeholders to improve safety and reliability for hydrogen facilities by implementing component reliability data taxonomies that support hydrogen infrastructure failure rate analysis. The project aims to quantify failure rates of hydrogen components through high-quality data collection and analysis on root causes and maintenance needed. HyCReD provides a common database for cataloging hydrogen component failures which exists for reliability research in many other mature industries [2]. The database fills a gap for the hydrogen community by providing a scientifically rigorous approach to quantitative risk assessment (QRA), prognostic health management (PHM), and reliability-centered maintenance (RCM) analysis. High level results will be aggregated and anonymized to protect company sensitive information; detailed results will be used to help address issues of hydrogen components. These advanced analytics will support accelerated deployment of hydrogen infrastructure by enabling better: design and safety of projects (safety codes and standards development), infrastructure reliability and cost (component failure rates, maintenance protocols), and component R&D needs (robust supply chain). A key to a successful HyCReD implementation is facilitating the ease of reporting and data quality in the database that can be used for analysis. Maintenance data was a previously identified gap in initial efforts to populate and validate the database taxonomies [3]. Collection of maintenance data will be instrumental in identifying failure modes and rates, identifying incipient component failures or reduced performance, cataloging best practices for maintenance routines and methods for prognostic health management, and quantifying the risk and effect of different failure modes. Several key priorities are identified for streamlined data collection to achieve quality and detailed failure data: Applicability, Ease of Use, Accessibility, and Information Security. The HyCReD team has now begun deployment of the database to several companies and groups that have signed non-disclosure agreements to facilitate the data collection of failures in industry hydrogen refueling station infrastructure. This paper will provide an update into the process of HyCReD deployment including the development of a coding guide for facility personnel to reference and ensure data quality and consistency from one station to another as well as implementation of contextually dependent data fields of system taxonomy and formatted entries to provide ease of use. The goal is to communicate the lessons learned from the roll-out to technicians and engineers in the field, and the addition of need for high level of security to protect all stakeholders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Monitoring radiation use in cardiac fluoroscopy imaging procedures

Purpose: Timely identification of systematic changes in radiation delivery of an imaging system can lead to a reduction in risk for the patients involved. However, existing quality assurance programs involving the routine testing of equipment performance using phantoms are limited in their ability to effectively carry out this task. To address this issue, the authors propose the implementation of an ongoing monitoring process that utilizes procedural data to identify unexpected large or small radiation exposures for individual patients, as well as to detect persistent changes in the radiation output of imaging platforms. Methods: Data used in this study were obtained from records routinely collected during procedures performed in the cardiac catheterization imaging facility at St. Andrew's War Memorial Hospital, Brisbane, Australia, over the period January 2008-March 2010. A two stage monitoring process employing individual and exponentially weighted moving average (EWMA) control charts was developed and used to identify unexpectedly high or low radiation exposure levels for individual patients, as well as detect persistent changes in the radiation output delivered by the imaging systems. To increase sensitivity of the charts, we account for variation in dose area product (DAP) values due to other measured factors (patient weight, fluoroscopy time, and digital acquisition frame count) using multiple linear regression. Control charts are then constructed using the residual values from this linear regression. The proposed monitoring process was evaluated using simulation to model the performance of the process under known conditions. Results: Retrospective application of this technique to actual clinical data identified a number of cases in which the DAP result could be considered unexpected. Most of these, upon review, were attributed to data entry errors. The charts monitoring the overall system radiation output trends demonstrated changes in equipment performance associated with relocation of the equipment to a new department. When tested under simulated conditions, the EWMA chart was capable of detecting a sustained 15% increase in average radiation output within 60 cases (<1 month of operation), while a 33% increase would be signaled within 20 cases. Conclusions: This technique offers a valuable enhancement to existing quality assurance programs in radiology that rely upon the testing of equipment radiation output at discrete time frames to ensure performance security.

60 APPLIED LIFE SCIENCES↗

GeoThermalCloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are identifying hidden geothermal resources in the USA and designing profitable enhanced geothermal systems (EGS). Many non-obvious processes and parameters could characterize geothermal resources and could control the ultimate energy potential of geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize geothermal resources, but this data is sparse and multi-scale that has hindered attempts to leverage the datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) give promise to overcome these issues. Modern ML methods and tools can (1) analyze large datasets, (2) assimilate model ensembles that include a multitude of inputs and outputs, (3) process sparse datasets, (4) perform transfer learning between sites with different data quality, (5) extract hidden geothermal signatures from field and simulation data, (6) label geothermal resources and processes, (7) identify highvalue data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies.

58 GEOSCIENCES↗

Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are identifying hidden geothermal resources in the USA and designing profitable enhanced geothermal systems (EGS). Many non-obvious processes and parameters could characterize geothermal resources and could control the ultimate energy potential of geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize geothermal resources, but this data is sparse and multi-scale. This has hindered attempts to leverage the datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) give promise to overcome these issues. Modern ML methods and tools can (1) analyze large datasets, (2) assimilate model ensembles that include a multitude of inputs and outputs, (3) process sparse datasets, (4) perform transfer learning between sites with different data quality, (5) extract hidden geothermal signatures from field and simulation data, (6) label geothermal resources and processes, (7) identify high-value data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies. In this work, we implement ML-based geothermal exploration and an enhanced geothermal systems (EGS) design tool to achieve the above goals. Our exploration tool is GeoThermalCloud (GTC) EGS design tool is GeoDT-ML. GTC (github.com/SmartTensors/GeoThermalCloud.jl) utilizes a LANL unsupervised ML platform called SmartTensors (https://tensors.lanl.gov/) to automate data analyses and interpretations by extracting hidden signatures to identify geothermal prospects. It enables the identification of critical measurements needed to identify geothermal resource signatures. GeoDT-ML (github.com/SmartTensors/GeoThermalCloud.jl/tree/master/) adds coupling to GeoDT (https://github.com/GeoDesignTool/GeoDT.git) for stochastic EGS design optimization and performance prediction. GeoDT-ML leverages recent advances in deep learning and high-performance computing. Contributors to this effort include LANL, PNNL, Google, Stanford, and Julia Computing.

15 GEOTHERMAL ENERGY↗

Integrating Light Curve and Atmospheric Modeling of Transiting Exoplanets

Spectral retrieval techniques are currently our best tool to interpret the observed exoplanet atmospheric data. Said techniques retrieve the optimal atmospheric components and parameters by identifying the best fit to an observed transmission/emission spectrum. Over the past decade, our understanding of remote worlds in our galaxy has flourished thanks to the use of increasingly sophisticated spectral retrieval techniques and the collective effort of the community working on exoplanet atmospheric models. A new generation of instruments in space and from the ground is expected to deliver higher quality data in the next decade; it is therefore paramount to upgrade current models and improve their reliability, their completeness, and the numerical speed with which they can be run. In this paper, we address the issue of reliability of the results provided by retrieval models in the presence of systematics of unknown origin. More specifically, we demonstrate that if we fit directly individual light curves at different wavelengths (L-retrieval), instead of fitting transit or eclipse depths, as it is currently done (S-retrieval), the said methodology is more sensitive against astrophysical and instrumental noise. This new approach is tested, in particular, when discrepant simulated observations from Hubble Space Telescope/Wide Field Camera 3 and Spitzer/IRAC are combined. We find that while S-retrievals converge to an incorrect solution without any warning, L-retrievals are able to flag potential discrepancies between the data sets.

79 ASTRONOMY AND ASTROPHYSICS↗

Comprehensive Design Reliability Activities for Aerospace Propulsion Systems

This technical publication describes the methodology, model, software tool, input data, and analysis result that support aerospace design reliability studies. The focus of these activities is on propulsion systems mechanical design reliability. The goal of these activities is to support design from a reliability perspective. Paralleling performance analyses in schedule and method, this requires the proper use of metrics in a validated reliability model useful for design, sensitivity, and trade studies. Design reliability analysis in this view is one of several critical design functions. A design reliability method is detailed and two example analyses are provided-one qualitative and the other quantitative. The use of aerospace and commercial data sources for quantification is discussed and sources listed. A tool that was developed to support both types of analyses is presented. Finally, special topics discussed include the development of design criteria, issues of reliability quantification, quality control, and reliability verification.

Christenson, R. L.↗

Assessment of NPP VIIRS Ocean Color Data Products: Hope and Risk

For several years, the NASA/Goddard Space Flight Center (GSFC) NPP VIIRS Ocean Science Team (VOST) provided substantial scientific input to the NPP project regarding the use of Visible Infrared Imaging Radiometer Suite (VIIRS) to create science quality ocean color data products. This work has culminated into an assessment of the NPP project and the VIIRS instrument's capability to produce science quality Ocean Color data products. The VOST concluded that many characteristics were similar to earlier instruments, including SeaWiFS or MODIS Aqua. Though instrument performance and calibration risks do exist, it was concluded that programmatic and algorithm issues dominate concerns. Keywords: NPP, VIIRS, Ocean Color, satellite remote sensing, climate data record.

Turpie, Kevin R.↗

The TRMM Multi-Satellite Precipitation Analysis (TMPA)

The Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA) is intended to provide a "best" estimate of quasi-global precipitation from the wide variety of modern satellite-borne precipitation-related sensors. Estimates are provided at relatively fine scales (0.25 deg x 0.25 deg. 3-h) in both real and post-real time to accommodate a wide range of researchers. However, the errors inherent in the finest scale estimates are large. The most successful use of the TMPA data is when the analysis takes advantage of the fine-scale data to create time/space averages appropriate to the user fs application. We review the conceptual basis for the TMPA, summarize the processing sequence, and focus on two new activities. First, a recent upgrade for the real-time version incorporates several additional satellite data sources and employs monthly climatological adjustments to approximate the bias characteristics of the research quality post-real-time product. Second, an upgrade for the research quality post-real-time TMPA from Versions 6 to 7 (in beta test at press time) is designed to provide a variety of improvements that increase the list of input data sets and correct several issues. Future enhancements for the TMPA will include improved error estimation, extension to higher latitudes, and a shift to a Lagrangian time interpolation scheme.

Huffman, George J.↗

Deep Learning for In-Situ Layer Quality Monitoring during Laser-Based Directed Energy Deposition (LB-DED) Additive Manufacturing Process

Defects are a leading issue for the rejection of parts manufactured through the Directed Energy Deposition (DED) Additive Manufacturing (AM) process. In an attempt to illuminate and advance in situ quality monitoring and control of workpieces, we present an innovative data-driven method that synchronously collects sensing data and AM process parameters with a low sampling rate during the DED process. The proposed data-driven technique determines the important influences that individual printing parameters and sensing features have on prediction at the inter-layer qualification to perform feature selection. Three Machine Learning (ML) algorithms including Random Forest (RF), Support Vector Machine (SVM), and Convolutional Neural Network (CNN) are used. During post-production, a threshold is applied to detect low-density occurrences such as porosity sizes and quantities from CT scans that render individual layers acceptable or unacceptable. This information is fed to the ML models for training. Training/testing are completed offline on samples deemed “high-quality” and “low-quality”, utilizing only features recorded from the build process. CNN results show that the classification of acceptable/unacceptable layers can reach between 90% accuracy while training/testing on a “high-quality” sample and dip to 65% accuracy when trained/tested on “low-quality”/“high-quality” (respectively), indicating over-fitting but showing CNN as a promising inter-layer classifier.

36 MATERIALS SCIENCE↗

The TRMM Multi-Satellite Precipitation Analysis (TMPA)

The Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA) is intended to provide a "best" estimate of quasi-global precipitation from the wide variety of modern satellite-borne precipitation-related sensors. Estimates are provided at relatively fine scales (0.25degx0.25deg, 3-hourly) in both real and post-real time to accommodate a wide range of researchers. However, the errors inherent in the finest scale estimates are large. The most successful use of the TMPA data is when the analysis takes advantage of the fine-scale data to create time/space averages appropriate to the user s application. We review the conceptual basis for the TMPA, summarize the processing sequence, and focus on two new activities. First, a recent upgrade to the real-time version incorporates several additional satellite data sources and employs monthly climatological adjustments to approximate the bias characteristics of the research quality post-real-time product. Second, an upgrade of the research quality post-real-time TMPA from Version 6 to Version 7 (in beta test at press time) is designed to provide a variety of improvements that increase the list of input data sets and correct several issues. Future enhancements for the TMPA will include improved error estimation, extension to higher latitudes, and a shift to a Lagrangian time interpolation scheme.

Huffman, George J.↗

Eight Year Climatologies from Observational (AIRS) and Model (MERRA) Data

We examine climatologies derived from eight years of temperature, water vapor, cloud, and trace gas observations made by the Atmospheric Infrared Sounder (AIRS) instrument flying on the Aqua satellite and compare them to similar climatologies constructed with data from a global assimilation model, the Modern Era Retrospective-Analysis for Research and Applications (MERRA). We use the AIRS climatologies to examine anomalies and trends in the AIRS data record. Since sampling can be an issue for infrared satellites in low earth orbit, we also use the MERRA data to examine the AIRS sampling biases. By sampling the MERRA data at the AIRS space-time locations both with and without the AIRS quality control we estimate the sampling bias of the AIRS climatology and the atmospheric conditions where AIRS has a lower sampling rate. While the AIRS temperature and water vapor sampling biases are small at low latitudes, they can be more than a few degrees in temperature or 10 percent in water vapor at higher latitudes. The largest sampling biases are over desert. The AIRS and MERRA data are available from the Goddard Earth Sciences Data and Information Services Center (GES DISC). The AIRS climatologies we used are available for analysis with the GIOVANNI data exploration tool. (see, http://disc.gsfc.nasa.gov).

Hearty, Thomas↗

Intercomparison of Desert Dust Optical Depth from Satellite Measurements

This work provides a comparison of satellite retrievals of Saharan desert dust aerosol optical depth (AOD) during a strong dust event through March 2006. In this event, a large dust plume was transported over desert, vegetated, and ocean surfaces. The aim is to identify the differences between current datasets. The satellite instruments considered are AATSR, AIRS, MERIS, MISR, MODIS, OMI, POLDER, and SEVIRI. An interesting aspect is that the different algorithms make use of different instrument characteristics to obtain retrievals over bright surfaces. These include multi-angle approaches (MISR, AATSR), polarisation measurements (POLDER), single-view approaches using solar wavelengths (OMI, MODIS), and the thermal infrared spectral region (SEVIRI, AIRS). Differences between instruments, together with the comparison of different retrieval algorithms applied to measurements from the same instrument, provide a unique insight into the performance and characteristics of the various techniques employed. As well as the intercomparison between different satellite products, the AODs have also been compared to co-located AERONET data. Despite the fact that the agreement between satellite and AERONET AODs is reasonably good for all of the datasets, there are significant differences between them when compared to each other, especially over land. These differences are partially due to differences in the algorithms, such as assumptions about aerosol model and surface properties. However, in this comparison of spatially and temporally averaged data, it is important to note that differences in sampling, related to the actual footprint of each instrument on the heterogeneous aerosol field, cloud identification and the quality control flags of each dataset can be an important issue.

desert dust↗

A method for crystallographic mapping of an alpha-beta titanium alloy with nanometre resolution using scanning precession electron diffraction and open-source software libraries

An approach for the crystallographic mapping of two-phase alloys on the nanoscale using a combination of scanned precession electron diffraction and open-source python libraries is introduced in this paper. This method is demonstrated using the example of a two-phase α/β titanium alloy. The data were recorded using a direct electron detector to collect the patterns, and recently developed algorithms to perform automated indexing and analyse the crystallography from the results. Very high-quality mapping is achieved at a 3 nm step size. The results show the expected Burgers orientation relationships between the α laths and β matrix, as well as the expected misorientations between α laths. A minor issue was found that one area was affected by 180° ambiguities in indexing occur due to this area being aligned too close to a zone axis of the α with twofold projection symmetry (not present in 3D) in the zero-order Laue Zone, and this should be avoided in data acquisition in the future. Nevertheless, this study demonstrates a good workflow for the analysis of nanocrystalline two- or multi-phase materials, which will be of widespread use in analysing two-phase titanium and other systems and how they evolve as a function of thermomechanical treatments.

36 MATERIALS SCIENCE↗

Growth of Three Lettuce Cultivars in NASA's HDU PEM During the 2010 DRATS Test

NASA's 2010 Desert Research and Technology Studies (DRATS) of the VEGGIE Food Production System in the Habitat Demonstration Unit (HDU) Pressurized Excursion Module (PEM) was the first operational evaluation of salad crop production technology in a NASA analog test. Rooting media and slow release fertilizers were evaluated for three lettuce cultivars that had shown promise as candidates for a surface based food production system. These tests involved comparing growth, color and quality of the lettuce cultivars grown under VEGGIE LED array (Orbitec, Madison, WI) or Biomass Production System for Education ((BSEe), Orbitec, Madison, WI) compact fluorescent lamps using a gravity feed water delivery system. Mission relevant conditions of CO2, temperature and RH were maintained using controlled environment chambers (EGC, Chagrin Falls, OH). Growth data was obtained for the two red leaf lettuce cultivars, Outredgeous and Firecracker, and the green Bibb lettuce cultivar, Flandria. Growth and quality was evaluated using different concentrations (7.5 g/L and 15 g/L) of commercial slow release fertilizer (Osmocote Plus 15-9-12, Scotts, Maryville, OH) and Nutricote 18-6-8 (Florikan, Sarasota, FL) in either a peat/vermiculite media (sunshine LP5 MiX, Sungro, Bellview, WA) or calcined montmorillonite clay [(arcillite,)Turface Proleague, Profile LLC, Buffalo Grove, IL]. The commercial peat/vermiculite mix generally resulted in larger plants than those grown in arcillite. Increasing the concentration of Osmocote from 7.5 to 15 g/L increased the height, dry mass, and leaf area of lettuce cultivars. In contrast, there was a decrease in growth parameters when concentration of Nutricote was increased from 7.5 to 15 g/L. The best growth was obtained with the 7.5 g/L Nutricote using a commercial peat/vermiculite mixture. This media was used for field testing VEGGIE plant system in the 2010 DRAT test. The VEGGIE nutrient delivery system worked well, was able to be maintained by multiple operators with a minimum of training, and supported excellent lettuce growth for the duration of the 14-day test. The operational DRAT field testing in the HDU identified light quality issues related to morphology and pigment development that will need to be addressed through additional testing. Feedback from the crew, ground support personnel, and human factors leads was uniformly positive on the psychological value of having the crop production system in the pressurized excursion module. Data are being used to design a plant atrium with LED lighting to evaluate salad crop growth during NASA's 2011 DRATS test.

Stutte, Gary W.↗

Challenging Issues for On-orbit Calibration in the VIS and NIR

On-orbit calibration of Earth-observing sensors in the VIS and NIR spectral regions is usually performed using the sensors on-board devices such as internal lamp(s) or solar diffuser plate(s) to provide calibration parameters. For sensors with no (or with less reliable) on-board calibrators, lunar calibration or ground validation approaches are often used. Each of these has its own set of problems that need to be fully addressed in order to support high quality on-orbit calibration and characterization. Some science products, such as Ocean color, may impose more stringent requirements that demand greater calibration precision. This paper uses MODIS as an example to illustrate challenging issues involved in VIS and NIR on-orbit calibration. It focuses on the solar diffuser (SD) calibration approach, including the effects due to SD BRF, SD attenuation screen(s), and earthshine. The impact of optics (solar diffuser and scan mirror) on-orbit degradation, including changes in the sensor s response versus scan angle (RVS), on the calibration and subsequent data quality is also discussed.

Xiong, X.↗