Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

MY EXES and EDM for Automated Remediation Data Quality Assessments - 19053

MY Electronic data exchange and Evaluation System (EXES) is a new web-based technology providing external admin access and full control to the Web-based EXES tool developed by GD for EPA for automated environmental remediation data quality assessments. EXES replaces most manual assessment processes, reducing remediation data review time and costs and ensuring that data are of known and documented quality. This tool is available from EPA to federal agencies and remediation firms and has successfully been used to support over 190 site investigations, 105 Remedial investigations and over 20 compliance monitoring efforts. The new MY EXES functionality has been developed for project managers and decision makers to setup projects, track receipt of environmental remediation monitoring data, assess data quality, and manage data. It is designed to be flexible and configurable to meet any government agency's data review and data management needs. It is accessible 24/7 through a secure portal. MY EXES efficiently evaluates analytical data regardless of the underlying method and data reporting requirements. It is a centralized project and data assessment tool that is scalable, flexible and configurable; improving data quality while reducing cost through the following: - Provides users with the ability to create a project and to specify the analytical methods corresponding to the data that will be submitted for that project. A project can be modified and managed anytime during the project's life cycle. - Allows users to manage a library of analytical methods that can be made available for association to their projects. - Users can specify the automated tests and assessment that needs to be performed on the analytical data deliverables based on specific requirements in the project's Quality Assurance Project Plan (QAPP). - Users specify: - The format of the incoming data deliverables from the laboratory; - The type and level of review services to be performed; - The assessment deliverables to be generated - output spreadsheets and reports; - Project owner sets up system access and permissions for members of the project team. - A faster (600%) and less expensive (85%) process than the traditional data usability/validation. The EXES Data Manager application (EDM) provides a centralized data repository to view and retrieve generated reports, spreadsheets, and other data deliverables as defined by the client, eliminating the need for data transfer between project team members. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Data Quality Assessment Process for Real-Time Data-Driven Traffic Microsimulation of Smart Corridor

Smart corridor digital twins are often created for the development and evaluation of emerging intelligent transportation systems and Connected and Autonomous Vehicle (CAV) technologies. However, limited guidance exists for data quality assessment for digital twin development. To address this, this paper discusses the data quality assessment utilized to develop data-driven real-time microscopic simulation models, i.e., digital twins, for two separate smart corridors: the North Avenue Smart Corridor in Atlanta, GA, and the Martin Luther King Smart Corridor in Chattanooga, Tennessee. This paper provides a summary of the author’s investigations of data requirements and data characteristics for the given smart corridor digital twin development efforts. With a focus on data, this summary includes a description of the data investigation process, key data issues observed, and strategies to address observed issues. Discussion is provided to help expand the lessons from these studies to other digital twin development efforts.

Saroj, Abhilasha [ORNL] (ORCID:0000000191178063)↗
DOE OSTI2026

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

A Refined Method to Translate Solar Data Quality Assessment Flags to Estimated Measurement Uncertainty

Integrating solar resource uncertainties due to radiometer measurement performance and operational data quality assessment can provide improved estimates of economic bankability, system design performance, and compliance of solar energy conversion systems. Estimating radiometer measurement uncertainty is an established procedure consistent with recognized best practices and international guidelines. SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report, the fourth of six for the Data Quality and Uncertainty Integration Project, presents a refined algorithm description for software to translate solar resource data quality assessment results into estimated uncertainty values in a Solar Resource Operational Uncertainty Integrator (SROUI) application. This algorithm requires three-component solar irradiance measurements - global horizontal irradiance, direct normal irradiance, and diffuse horizontal irradiance - collected at 1- to 60-minute intervals, as described in the previous deliverables. The development of this report as Deliverable 6.4 was an iterative process that included reviews and feedback from the project team on initial drafts designed to refine how the new software could best support determining solar resource data uncertainty. The results of this effort will contribute to the final software system development by National Renewable Energy Laboratory staff.

14 SOLAR ENERGY↗
DOE OSTI2025

Data Quality Assessment of Optiwatt Vehicle Telematics Data

In October 2024, the Idaho National Laboratory (INL) received data from Optiwatt (Compass Global, Inc.) describing the driving and charging behavior of electric vehicle (EV) drivers. The data shared had been collected from approximately 10,000 vehicles and included vehicle specifications, driving information like odometer readings at the beginning and end of origin-destination pairs (i.e., trips with identification of home for trip start and end for Tesla vehicles), and charging information such as charging energy consumed per charge session and if the charge occurred at home. The vehicle data were provided from 9 EV makes and 18 EV models, with production years ranging from 2012–2024, but more than 9,500 of the vehicles were Tesla EVs. The data includes more than six million trips and more than three million charging events that occurred between June 2023 to Aug 2024 and collected from California and the Eastern United States. The purpose of this report is to review the quality of the data received from Optiwatt and the feedback INL received from Optiwatt after data concerns were shared with them.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Analytical methods for online data quality assessment

This chapter provides a comprehensive overview of the main steps for algorithmic sensor signal quality assessment, which can enhance the decision-making process for water resource recovery facility (WRRF) operation and optimization. It introduces the concept of redundancy as the basis for data quality assessment. It also explains the typical data processing pipeline, which consists of preliminary analysis, data pre-processing, and specific algorithmic approaches. Each of these processes is presented and discussed in three separate sections. Importantly, this chapter introduces the main approaches for data quality assessment, provides guidelines for selecting the most suitable one and the key performance indicators to evaluate them and explains how to collect metadata through such an algorithmic approach.

Aguado, Daniel↗
NASA NTRS1998

Data Quality Assessment Methods for the Eastern Range 915 MHz Wind Profiler Network

The Eastern Range installed a network of five 915 MHz Doppler Radar Wind Profilers with Radio Acoustic Sounding Systems in the Cape Canaveral Air Station/Kennedy Space Center area to provide three-dimensional wind speed and direction and virtual temperature estimates in the boundary layer. The Applied Meteorology Unit, staffed by ENSCO, Inc., was tasked by the 45th Weather Squadron, the Spaceflight Meteorology Group, and the National Weather Service in Melbourne, Florida to investigate methods which will help forecasters assess profiler network data quality when developing forecasts and warnings for critical ground, launch and landing operations. Four routines were evaluated in this study: a consensus time period check a precipitation contamination check, a median filter, and the Weber-Wuertz (WW) algorithm. No routine was able to effectively flag suspect data when used by itself. Therefore, the routines were used in different combinations. An evaluation of all possible combinations revealed two that provided the best results. The precipitation contamination and consensus time routines were used in both combinations. The median filter or WW was used as the final routine in the combinations to flag all other suspect data points.

Lambert, Winifred C.↗
DOE OSTI2022

Waveform Data Quality Assessment

Healthy seismoacoustic sensors and accurate metadata are critical to all the science objectives of both the Source Physics Experiment (SPE) Rock Valley Direct Comparison (RV/DC) and LowYield Physics Experiment-1 (LYNM PE-1). Both projects share similar seismoacoustic stations. We provide a plan on how to move forward with waveform data quality assessments (QA) to the working groups. The identification of stations with instrument response errors will be useful to researchers using amplitudes to study source effects and Earth attenuation. The data QA can also be useful for field technicians to help identify and correct problem sites.

47 OTHER INSTRUMENTATION↗
NASA NTRS2010

Ares I-X Launch Vehicle Modal Test Measurements and Data Quality Assessments

The Ares I-X modal test program consisted of three modal tests conducted at the Vehicle Assembly Building at NASA s Kennedy Space Center. The first test was performed on the 71-foot 53,000-pound top segment of the Ares I-X launch vehicle known as Super Stack 5 and the second test was performed on the 66-foot 146,000- pound middle segment known as Super Stack 1. For these tests, two 250 lb-peak electro-dynamic shakers were used to excite bending and shell modes with the test articles resting on the floor. The third modal test was performed on the 327-foot 1,800,000-pound Ares I-X launch vehicle mounted to the Mobile Launcher Platform. The excitation for this test consisted of four 1000+ lb-peak hydraulic shakers arranged to excite the vehicle s cantilevered bending modes. Because the frequencies of interest for these modal tests ranged from 0.02 to 30 Hz, high sensitivity capacitive accelerometers were used. Excitation techniques included impact, burst random, pure random, and force controlled sine sweep. This paper provides the test details for the companion papers covering the Ares I-X finite element model calibration process. Topics to be discussed include test setups, procedures, measurements, data quality assessments, and consistency of modal parameter estimates.

Templeton, Justin D.↗
NASA NTRSDate not supplied

Artemis I Flight Instrumentation Data Quality Assessment and Processing

This paper is in support of the SciTech 2024 Space Launch System Aerosciences Special Sessions being organized by Brent Pomeroy and Jeremy Pinier. On November 16th, 2022, NASA launched the inaugural test flight of the Space Launch System (SLS) carrying the Orion capsule into a high orbit far beyond the Moon. The launch vehicle was instrumented with over three thousand flight instrumentation sensors, which monitored aerodynamic, acoustic, structural, and thermal environments. These data are intended to validate experimental and numerical tools used to predict the design environments which the vehicle experiences during launch and ascent. Prior to launch, tests were performed at the SLS Systems Integration Laboratory (SIL) using flight-like avionics and on the integrated flight hardware of Artemis I at the Vehicle Assembly Building (VAB). The purpose of these tests was to characterize the data acquisition units (DAUs) used to record and telemeter flight data to ground stations in order to assure that flight test objectives can be achieved and to quantify the expected quality of the flight data. In addition, pre-flight assessment and development of tools and methods used to process and disseminate flight data at the Huntsville Operations Support Center (HOSC) were conducted and adjustments made with respect to DAU time-synchronization prior to and after the flight. This paper summarizes these tests and some aspects of the post processing of data are discussed.

Developmental Flight Instrumentation↗
DOE OSTI2023

Towards Integrating Data Quality Assessments and Radiometer Uncertainty for Determining the Expanded Uncertainty of Three-Component Solar Radiation Measurements

Accurate solar irradiance data are fundamental for determining the design and performance characteristics of photovoltaic systems. The uncertainty of solar irradiance measurements depends on many factors including radiometer design, calibration, installation, maintenance, and operational environment. The key contributors to this uncertainty can be classified as the measurement uncertainty of a particular radiometer and the operational uncertainty determined for the time of measurement. Radiometer measurement uncertainty estimates (U R ) can be based on well-established methods used as part of the radiometer calibration process. Estimates of operational uncertainties (U o ) require consideration of additional site-specific factors that affect data quality. A method is needed for establishing the accuracy of solar irradiance data by integrating an existing data quality process and measurement uncertainty estimates for specific radiometers. An algorithm has been developed to integrate data quality analyses and measurement uncertainty estimates for three-component solar irradiance data: global horizontal (total hemispheric) irradiance, direct normal (beam) irradiance, and diffuse horizontal (sky) irradiance collected at one- to 60-minute intervals. The algorithm has been tested using one-minute irradiance measurements. The goal of the project is to distribute a user-friendly software package based on the new algorithm.

data integrity↗
NASA NTRSDate not supplied

Artemis I Flight Instrumentation Data Quality Assessment and Processing

This paper is in support of the SciTech 2024 Space Launch System Aerosciences Special Sessions being organized by Brent Pomeroy and Jeremy Pinier. On November 16th, 2022, NASA launched an inaugural test flight of the Space Launch System (SLS) carrying the Orion capsule around the moon. The vehicle was instrumented with thousands of Developmental Flight Instrumentation (DFI) sensors, which monitored aerodynamic, acoustic, structural, and thermal environments. These data are used to validate experimental and numerical tools used to predict conditions the vehicle experiences during ascent. Prior to launch, a set of tests were performed to quantify the expected quality of the DFI flight data. These included testing of individual components, such as data acquisition units, at the Systems Integration Laboratory (SIL) and testing of integrated vehicle components at the Vehicle Assembly Building (VAB). This paper summarizes these tests. Some aspects of post processing of data are also discussed.

Developmental Flight Instrumentation↗
NASA NTRS1989

Rain attenuation measurements: Variability and data quality assessment

Year to year variations in the cumulative distributions of rain rate or rain attenuation are evident in any of the published measurements for a single propagation path that span a period of several years of observation. These variations must be described by models for the prediction of rain attenuation statistics. Now that a large measurement data base has been assembled by the International Radio Consultative Committee, the information needed to assess variability is available. On the basis of 252 sample cumulative distribution functions for the occurrence of attenuation by rain, the expected year to year variation in attenuation at a fixed probability level in the 0.1 to 0.001 percent of a year range is estimated to be 27 percent. The expected deviation from an attenuation model prediction for a single year of observations is estimated to exceed 33 percent when any of the available global rain climate model are employed to estimate the rain rate statistics. The probability distribution for the variation in attenuation or rain rate at a fixed fraction of a year is lognormal. The lognormal behavior of the variate was used to compile the statistics for variability.

Crane, Robert K.↗
DOE OSTI2024

Sensor Data Analytics and Data Quality Assessment Software

The proposed framework derives a set of quality metrics to provide critical insights into and tracking of grid operations, sensor performance, sensor longevity, and event statistics. Power grid engineers can utilize this information to identify problems with existing sensor locations and problematic power grid assets including generators, transmission lines, load centers, and substations. This information can also be used to identify unexpected/abnormal behavior of power grid components, improve power grid observability, and operational monitoring, and thus enhance real-time decision-making support system. Power grid planners can utilize this information to augment existing sensing architecture with new sensors and improve the observability of the network.

Mahapatra, Kaveri↗