Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Vertical Climb Testing of the Model 699 Proprotor on the Tiltrotor Test Rig

The Tiltrotor Test Rig (TTR) is a new NASA asset for testing full-scale proprotors. The first test campaign in the National Full-Scale Aerodynamics Facility (NFAC) concluded in November 2018. The wind-tunnel test included vertical climb conditions simulated by axial flow at low airspeeds (true hover is not possible in the NFAC). The rotor tested was the Bell Model 699, an AW609 rotor modified specifically for wind-tunnel testing. The rotor was tested under a variety of NFAC configurations, some unprecedented and unique to vertical climb. This paper presents results for all test configurations applicable to vertical climb, including assessments of data quality. Comparisons with earlier tests of a similar rotor, the 0.656-scale Joint Vertical Experimental (JVX) rotor, are included to provide additional insights into rotor and wind tunnel behavior.

Vertical Climb↗

NSCOR for Evaluating Risk Factors and Biomarkers for Adaptation and Resilience to Spaceflight: Emotional Valence and Social Processes in ICC/ICE Environments

Space exploration class missions, such as a mission to Mars, will require optimization of human performance, adaptability, and resilience. This NASA Specialized Center of Research (NSCOR) utilizes the NIMH Research Domain Criteria (RDoC) framework to identify biological and behavioral markers of individual social adaptation and emotional resilience (as well as vulnerability) to spaceflight-relevant stressors such as living in extended isolation. The overarching goal of this NSCOR is to obtain novel information to help identify biomarkers of individuals who are resilient and/or adaptable to the stressors of isolated, confined, and controlled (ICC) and isolated, confined, and extreme (ICE) environments.A total of N=90 healthy adult astronaut surrogates are being studied in three spaceflight-analog environments: (1) n=40 healthy adults in the Isolation and Confinement Analog Research Unit (ICARUS), an ICC at the University of Pennsylvania, during 7-day missions, for a target total of 280 subject days; (2) n=32 healthy adult astronaut surrogates studied in NASA’s Human Exploration Research Analog (HERA), an ICC at Johnson Space Center during 45-day missions, for a target total of 2,112 subject days; and (3) n=18 healthy adults in the Alfred-Wegener-Institute’s Neumayer Station III, an ICE in Antarctica, during 14-month missions, for a target total of 7,560 subject days. Dr. Nindl’s Laboratory at the University of Pittsburgh is analyzing a priori selected protein biomarkers in blood, saliva, and urine. Complementary rodent models of exposure to early life stressors, confinement, and isolation are being evaluated at Dr. Hensch’s Laboratory to further validate the neurobehavioral and biological findings from the human studies.Given the inconsistency and varied definition of resilience/adaptation in the scientific literature, the NSCOR team developed a composite resilience/adaptation measure that reflects the most relevant outcomes to resilience/adaptation across psychosocial and neurobehavioral functions, as well as neurocognitive and spaceflight-relevant operational performance. To achieve this, group consensus was attained from subject matter experts to produce a rank-order of importance for each input variable. The final resilience/adaptation score included 36 variables that were collected across spaceflight analogs. As of 10/1/2021, the NSCOR project acquired data on n=27 subjects at ICARUS, n=16 at HERA, and n=18 at Neumayer. The COVID-19 pandemic delayed data acquisition at ICARUS and HERA.Among subjects studied to date, 99% of neural and neurobehavioral data (e.g., neuroimaging for structure and function, behavioral measures) as well as blood, saliva, and urine for biochemical assays have been acquired. For rodent models, Dr. Hensch’s laboratory has established biochemical and behavioral parameters reflecting confinement stress in social networks of mice for comparison to stress responses in the human spaceflight analog environments.Group social behaviors were measured with a Social Network Analysis (SNA) approach to define objective parameters associated with sociability and its plasticity by sex. This analytic approach may help identify a network of individuals who are more effective teammates or more likely to generate new social relationships. Data acquisition, biomarker assessment, and data quality control will continue through September 2022.

D F Dinges↗

ICESat-2 Mission: Status, Outlook, and Contributions to Polar Science

The Ice, Cloud and land Elevation Satellite-2 (ICESat-2) mission carries the Advanced Topographic Laser Altimeter System (ATLAS) lidar to measure the changing height of Earth surface. After more than 3 years of science data collection, ATLAS has emitted well over a trillion laser pulses and continues to operate nominally. The ICESat-2 data products were initially released in May 2019, and have been used in over 150 peer-reviewed publications to date. Recent community white papers have noted the importance of ice elevation measurements for the coming decades, and as CryoSat-2 has entered it’s second decade and future missions are uncertain, ICESat-2 will be a critical part of the Earth System Observatory for the 2020s. In the polar regions, ICESat-2 has enabled year-round sea ice freeboard measurements as well as ice sheet elevation changes on seasonal, annual, and decadal time scales when combined with other missions. These data enable measurement of change at fine spatial and temporal scales to help understand or characterize the processes driving these observations. As of this presentation, Release 005 is the current version of the along-track data products, including surface-specific products for sea ice, land ice, ground and canopy height, ocean, and inland water heights. In addition, first versions of gridded data products for land ice, sea ice, and ocean are all available. Data spans the start of the mission (14 October 2018) through early 2022. The ICESat-2 project has also begun to produce and distribute QuickLook products with a nominal 3-day latency (as opposed to the ~45-day latency of the final data products). Initial versions of these QuickLook products have elevation accuracy of ~3 meters, and geolocation accuracy of ~50 meters. All products are available through the National Snow and Ice Data Center (nsidc.org). This presentation will summarize the current state and health of the observatory, current state of the ICESat-2 data products, data product quality assessment, and outlook for the future.

ICESat-2↗

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗

Perspectives on Citizen Science Data Quality

Information about data quality helps potential data users to determine whether and how data can be used and enables the analysis and interpretation of such data. Providing data quality information improves opportunities for data reuse by increasing the trustworthiness of the data. Recognizing the need for improving the quality of citizen science data, we describe quality assessment and quality control (QA/QC) issues for these data and offer perspectives on aspects of improving or ensuring citizen science data quality and for conducting research on related issues.

54 ENVIRONMENTAL SCIENCES↗

Cloud Screening and Quality Control Algorithm for Star Photometer Data: Assessment with Lidar Measurements and with All-sky Images

This paper presents the development and set up of a cloud screening and data quality control algorithm for a star photometer based on CCD camera as detector. These algorithms are necessary for passive remote sensing techniques to retrieve the columnar aerosol optical depth, delta Ae(lambda), and precipitable water vapor content, W, at nighttime. This cloud screening procedure consists of calculating moving averages of delta Ae() and W under different time-windows combined with a procedure for detecting outliers. Additionally, to avoid undesirable Ae(lambda) and W fluctuations caused by the atmospheric turbulence, the data are averaged on 30 min. The algorithm is applied to the star photometer deployed in the city of Granada (37.16 N, 3.60 W, 680 ma.s.l.; South-East of Spain) for the measurements acquired between March 2007 and September 2009. The algorithm is evaluated with correlative measurements registered by a lidar system and also with all-sky images obtained at the sunset and sunrise of the previous and following days. Promising results are obtained detecting cloud-affected data. Additionally, the cloud screening algorithm has been evaluated under different aerosol conditions including Saharan dust intrusion, biomass burning and pollution events.

data quality control algorithm↗

Deliverable 6.7-Final Technical Report: Development Summary and Evaluation of the Solar Uncertainty Integrator (SUNI) Software

The Data Quality and Uncertainty Integration Project was a three-year effort to address stakeholder needs for assessing solar radiation resource data quality based on existing tools for estimating radiometer measurement uncertainties and assessing post-measurement data quality. The annual research objectives for the project addressed a logical progression of effort needed to achieve the ultimate project goal of developing the Solar Uncertainty Integrator (SUNI) software. This final technical report summarizes the development process for achieving these key research objectives and addresses the outreach and code development efforts in the final year of the project to develop a new solar irradiance data uncertainty integration software package.

14 SOLAR ENERGY↗

An Approach for Setting Priorities for Experimental Studies in Support of Safety Assessments - 19393

Many experiments have been conducted, in both academia and industry, to support the understanding of the disposal of radioactive waste. For the disposal of low-level radioactive waste (LLW) into radioactive waste repositories, it is important to develop an approach to tackle which datasets are able to directly underpin safety assessments, and what future research experiments could address the gaps in this understanding. In this paper, we present an approach to identify which future experiments should be considered to underpin safety assessments for disposals of LLW in a near-surface repository. The approach involves 6-steps: define the disposal problem (e.g. the disposal of LLW in engineered vaults); determine what key processes may affect the disposal of the waste; establish the assumptions underpinning the key processes; determine how sensitive the key process parameters are to variation; determine whether key data are available and assess the quality of that data with respect to the disposal problem; and determine attributes for experiments needed to supply missing key data. We show, in this paper, how this approach can be used to develop a better understanding of C-14 gas generation, under varying degrees of groundwater saturation, for the disposal of LLW into engineered vaults, in the near-surface. Furthermore, we have developed an approach that identifies the types of experiments and their attributes to aid researchers to help select appropriate types of experiments to underpin safety assessments. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of a Display Tool to Quality Control Weather Balloon Data for Space Launch Vehicles Using Python

Continuous atmospheric data analysis is an important factor for space launch vehicle design and operations. The balloon quality control tool was developed by NASA’s Marshall Space Flight Center (MSFC) Natural Environments Branch (NEB) for monitoring quality control processes and verifying the automated flags created on the balloon data sets analyzed. The data sets currently analyzed are comprised of high-resolution and low-resolution balloon data from NASA Kennedy Space Center (KSC), co-located on the United States Air Force’s Eastern range (ER) at the Cape Canaveral Air Force Station. The NEB was tasked to perform a quality assessment of these data sets and needed a tool to confirm the quality control (QC) flags produced from an automated process and add additional QC flags if necessary. This Graphical User Interface (GUI) was developed to visualize all of the data from these balloon sets, display any flags from the automated QC process, and add additional flags to variables if necessary. The GUI was developed in Python 3.6 utilizing different packages available such as pandas for data analysis and manipulation, NumPy for high-performance multidimensional array and tools to compute with and manipulate arrays, Matplotlib for plotting data and Tkinter to build the GUI.

Jessica K Headley↗

Development of a Display Tool to Quality Control Weather Balloon Data for Space Launch Vehicles

Continuous atmospheric data analysis is an important factor for space launch vehicle design and operations. The balloon quality control tool was developed by NASA’s Marshall Space Flight Center (MSFC) Natural Environments Branch (NEB) for monitoring quality control processes and verifying the automated flags created on the balloon data sets analyzed. The data sets currently analyzed are comprised of high-resolution and low-resolution balloon data from NASA Kennedy Space Center (KSC), co-located on the United States Air Force’s Eastern range (ER) at the Cape Canaveral Air Force Station. The NEB was tasked to perform a quality assessment of these data sets and needed a tool to confirm the quality control (QC) flags produced from an automated process and add additional QC flags if necessary. This Graphical User Interface (GUI) was developed to visualize all of the data from these balloon sets, display any flags from the automated QC process, and add additional flags to variables if necessary. The GUI was developed in Python 3.6 utilizing different packages available such as pandas for data analysis and manipulation, NumPy for high-performance multidimensional array and tools to compute with and manipulate arrays, Matplotlib for plotting data and Tkinter to build the GUI.

Jessica K Headley↗

Evolution of the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) flight and ground data processing system

The modifications made to both the AVIRIS instrument and the data processing facility since the instrument made its initial flight in the summer of 1987 are described. Historical development of the data system is discussed and attention is given to enhancements to instrument stability and noise performance. AVIRIS data facility objectives include rapid and automated decommutation and archiving of data, the ability to assess the quality of the data and health of the instrument, and the provision of an automated procedure for applying radiometric corrections to the data and providing responsive processing of data requests from investigators. The modifications described have resulted in an overall radiometric stability of better than 10 percent, with stability of only a few percent during a single flight.

Porter, Wallace M.↗

Science Quality Assessment in Support of EOS MISR Data

The Multi-angle Imaging SpectroRadiometer (MISR) instrument, scheduled to fly on board the first Earth Observing System (EOS) spacecraft, will have a data stream that produces over 100 GB of data per day, once in full operation, of information about the Earth's atmosphere, clouds, and surface.

remote sensing Multi-angle Imaging SpectroRadiomet↗

Road Extraction from AVIRIS Using Spectral Mixture and Q-Tree Filter Techniques

Accurate road location and condition information are of primary importance in road infrastructure management. Additionally, spatially accurate and up-to-date road networks are essential in ambulance and rescue dispatch in emergency situations. However, accurate road infrastructure databases do not exist for vast areas, particularly in areas with rapid expansion. Currently, the US Department of Transportation (USDOT) extends great effort in field Global Positioning System (GPS) mapping and condition assessment to meet these informational needs. This methodology, though effective, is both time-consuming and costly, because every road within a DOT's jurisdiction must be field-visited to obtain accurate information. Therefore, the USDOT is interested in identifying new technologies that could help meet road infrastructure informational needs more effectively. Remote sensing provides one means by which large areas may be mapped with a high standard of accuracy and is a technology with great potential in infrastructure mapping. The goal of our research is to develop accurate road extraction techniques using high spatial resolution, fine spectral resolution imagery. Additionally, our research will explore the use of hyperspectral data in assessing road quality. Finally, this research aims to define the spatial and spectral requirements for remote sensing data to be used successfully for road feature extraction and road quality mapping. Our findings will facilitate the USDOT in assessing remote sensing as a new resource in infrastructure studies.

Gardner, Margaret E.↗