Water quality data from estuarine variable hydrologic flow regimes during frequent drought
Explore the source record for details and available documents.
Bhanu Paudel↗
SEARCH · Search NASA
Results for “data quality”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Effect of small‐scale ionospheric variability on GNSS radio occultation data quality
Explore the source record for details and available documents.
O. P. Verkhoglyadova↗
Principal Investigator-in-a-Box
Human performance in orbit is currently limited by several factors beyond the intrinsic awkwardness of motor control in weightlessness. Cognitive functioning can be affected by such factors as cumulative sleep loss, stress and the psychological effects of long-duration small-group isolation. When an astronaut operates a scientific experiment, the performance decrement associated with such factors can lead to lost or poor quality data and even the total loss of a scientific objective, at great cost to the sponsors and to the dismay of the Principal Investigator. In long-duration flights, as anticipated on the International Space Station and on any planetary exploration, the experimental model is further complicated by long delays between training and experiment, and the large number of experiments each crew member must perform. Although no documented studies have been published on the subject, astronauts report that an unusually large number of simple errors are made in space. Whether a result of the effects of microgravity, accumulated fatigue, stress or other factors, this pattern of increased error supports the need for a computerized decision-making aid for astronauts performing experiments. Artificial intelligence and expert systems might serve as powerful tools for assisting experiments in space. Those conducting space experiments typically need assistance exactly when the planned checklist does not apply. Expert systems, which use bits of human knowledge and human methods to respond appropriately to unusual situations, have a flexibility that is highly desirable in circumstances where an invariably predictable course of action/response does not exist. Frequently the human expert on the ground is unavailable, lacking the latest information, or not consulted by the astronaut conducting the experiment. In response to these issues, we have developed "Principal Investigator-in-a-Box," or [PI], to capture the reasoning process of the real expert, the Principal Investigator, and combine that with real-time data available in space in order to advise the astronaut about how to proceed in real time. [PI] advises the astronaut during the progress of an experiment in much the same way a real Principal Investigator might do while looking over the astronaut's shoulder. In its original application, [PI] mimicked several of the tasks of the Principal Investigator, including data quality monitoring, troubleshooting, prescheduling, protocol management and "interesting data" detection. The proposed research focuses on the efficacy of this technique as applied to the data quality monitoring and troubleshooting aspects of [PI].
Young, Laurence R.↗
The INSTEP Monitoring Network: Merging High-and-Low Cost Measurements to Characterize California Wildfires
Despite challenges with data quality and scope, low-cost sensor networks have skyrocketed in popularity over the last 15 years, making air quality data available on refined spatial scales. More recently, studies have leveraged both high and low-quality instruments to create stronger “hybrid” models, with most studies focusing on particulate matter. Low-cost measurements typically represent ground-level emissions only, providing context for human health issues from climate change-driven events such as wildfires. Since low-cost sensors’ capabilities are localized, daily events and microclimates tend to dominate the data rather than larger regional or atmospheric trends. Likewise, their low cost explains their high uncertainty. In contrast, some regulatory-grade instruments produce column measurements as well, providing reliable information on a broader scope. To bridge this gap while expanding into gas-phase measurements, we deployed 12 air quality sensor packages in California, USA during the 2022 wildfire season. These INSTEP (Inexpensive Network Sensor Technology Exploring Pollution) monitors measure carbon monoxide (CO), carbon dioxide (CO2), ozone (O3), nitrogen dioxide (NO2), and several hydrocarbons including methane (CH4) and formaldehyde (HCHO). Half of the monitors were co-located with remote sensing spectrometers: NASA Pandora and Total Column Carbon Observing Network (TCCON). The overlap in pollutants includes NO2, O3, and HCHO between the INSTEP monitors and the Pandora column measurements. TCCON covers column CO, CO2, and CH4, rounding out our comparison. Most of the monitors were distributed throughout the San Francisco Bay area, and an additional three were located within 100 km of Los Angeles. The sites ranged in geographic and population characteristics, including desert, mountainous, coastal, and urban locations. Since varying environmental conditions such as temperature and pressure are known to challenge sensor performance, we will apply newer sensor “calibration” techniques meant to combat this. We will normalize our sensor signals by z-scoring them prior to applying a single calibration model in the form of multivariate linear regression or an artificial neural network. While this technique has been validated for the hydrocarbon and ozone sensor types (metal oxide), it has not yet been tested on electrochemical and non-dispersive infrared sensors, which are also used in the INSTEP monitors. This will serve as a test to see if this normalization technique – or another – is most effective in accounting for environmental differences among sensors. Related data analysis efforts have found success with a variety of geospatial analysis techniques, including weighted network models in which high-quality instruments are given higher weights than their low-cost counterparts. Our preliminary analysis will focus on kriging, which uses a Gaussian algorithm to assign weights, providing estimated pollution levels at locations between monitors. Smoke trajectory and evolution will also be considered using both measurement types. We also aim to baseline subtract our emission estimates from each region to determine which portion of emissions are regional and local, further characterizing burn differences in northern and southern California fires. Future directions include using INSTEP jointly with TEMPO satellite data, and mobile deployments on aircraft and uncrewed aerial vehicles (UAV).
Low-cost sensors↗
Optimal Scheduling of a Multi-User, Multi-Tasking Automatic Robotic Telescope
An algorithm is introduced to generate the optimal schedule of observations for a multi-user, multi-tasking automatic robotic telescope. The schedule is optimal m that it will take the highest possible quality data, perform the largest number of tasks, and fairly serve multiple users in terms of data quality, allocated telescope time, and observation priorities. In addition, the algorithm addresses problems due to overloading and underloading the telescope. The algorithm, which employs dynamic-programming-based decision theory, is analytically proven to produce the optimal schedule using set theory. Simulations conducted using actual astronomical data are presented which show significant improvement over existing scheduling techniques. Once completed the new scheduling algorithm will be tested on the Tennessee State University/Harvard-Smithsonian Center for Astrophysics 32-inch automatic Photoelectric Telescope at Fairborn Observatory, Arizona.
Tantaris, R. N.↗
Investigation of radiometric properties of the LANDSAT-4 multispectral scanner
The radiometric data quality of the LANDSAT 4 multispectral scanner (MSS) was examined using several LANDSAT 4 frames. It was found that LANDSAT 4 MSS produces high-quality data of the caliber experienced with previous LANDSATS. For example, the detector equalization procedure worked well, leaving a residual banding effect of about 0.3 digital counts RMS, close to the theoretical minimum value of quantization error. Nevertheless, artifacts of the data were found, two of which were not experienced in previous MSS data. A low-level coherent noise effect was observed in all bands, with a magnitude of about 0.5 digital counts and a frequency of approximately 28 KHz (representing a wavelength of about 3.6 pixels); a substantial increase in processing complexity would be required to reduce this artifact in the data. Also, a substantial scan-length variation (of up to six pixels) was noted in MSS data when the TM sensor was operating; the LANDSAT 4 correction algorithms being applied routinely by the EROS Data Center to produce a p-type data should remove most of this variation. Between-satellite calibrations were examined in paired LANDSAT 3 and LANDSAT 4 MSS data sets, which were closely matched in acquisition time and place. Radiometric comparisons showed that all bands were highly linear in digital counts, and a well-determined linear transformation between the MSS's was established.
Malila, W. A.↗
Fast Plasma Instrument for MMS: Data Compression Simulation Results
Magnetospheric Multiscale (MMS) mission will study small-scale reconnection structures and their rapid motions from closely spaced platforms using instruments capable of high angular, energy, and time resolution measurements. To meet these requirements, the Fast Plasma Instrument (FPI) consists of eight (8) identical half top-hat electron sensors and eights (8) identical ion sensors and an Instrument Data Processing Unit (IDPU). The sensors (electron or ion) are grouped into pairs whose 6 deg x 180 deg fields-of-view (FOV) are set 90 deg apart. Each sensor is equipped with electrostatic aperture steering to allow the sensor to scan a 45 deg x 180 deg fan about its nominal viewing (0 deg deflection) direction. Each pair of sensors, known as the Dual Electron Spectrometer (DES) and the Dual Ion Spectrometer (DIS), occupies a quadrant on the MMS spacecraft and the combination of the eight electron/ion sensors, employing aperture steering, image the full-sky every 30-ms (electrons) and 150-ms (ions), respectively. To probe the results in the DES complement of a given spacecraft generating 6.5-Mbs(exp -1) of electron data while the DIS generates 1.1-Mbs(exp -1) of ion data yielding an FPI total data rate of 6.6-MBs(exp -1). The FPI electron/ion data is collected by the IDPU then transmitted to the Central Data Instrument Processor (CIDP) on the spacecraft for science interest ranking. Only data sequences that contain the greatest amount of temporal/spatial structure will be intelligently down-linked by the spacecraft. Currently, the FPI data rate allocation to the CIDP is 1.5-Mbs(exp -1). Consequently, the FPI-IDPU must employ data/image compression to meet this CIDP telemetry allocation. Here, we present simulations of the CCSDS 122.0-B-1 algorithm-based compression of the FPI-DES electron data. Compression analysis is based upon a seed of re-processed Cluster/PEACE electron measurements. Topics to be discussed include: review of compression algorithm; data quality; data formatting/organization; and, implications for data/matrix pruning. To conclude a presentation of the base-lined FPI data compression approach is provided.
Barrie, A.↗
NASA Extreme Environment Mission Operations: Science Operations Development for Human Exploration
The purpose of NASA Extreme Environment Mission Operations (NEEMO) mission 16 in 2012 was to evaluate and compare the performance of a defined series of representative near-Earth asteroid (NEA) extravehicular activity (EVA) tasks under different conditions and combinations of work systems, constraints, and assumptions considered for future human NEA exploration missions. NEEMO 16 followed NASA's 2011 Desert Research and Technology Studies (D-RATS), the primary focus of which was understanding the implications of communication latency, crew size, and work system combinations with respect to scientific data quality, data management, crew workload, and crew/mission control interactions. The 1-g environment precluded meaningful evaluation of NEA EVA translation, worksite stabilization, sampling, or instrument deployment techniques. Thus, NEEMO missions were designed to provide an opportunity to perform a preliminary evaluation of these important factors for each of the conditions being considered. NEEMO 15 also took place in 2011 and provided a first look at many of the factors, but the mission was cut short due to a hurricane threat before all objectives were completed. ARES Directorate (KX) personnel consulted with JSC engineers to ensure that high-fidelity planetary science protocols were incorporated into NEEMO mission architectures. ARES has been collaborating with NEEMO mission planners since NEEMO 9 in 2006, successively building upon previous developments to refine science operations concepts within engineering constraints; it is expected to continue the collaboration as NASA's human exploration mission plans evolve.
Bell, Mary S.↗
Camera Setup for Unsteady Pressure Sensitive Paint at NASA Ames Research Center
The unsteady Pressure-Sensitive Paint Development Team at NASA Ames Research Center is conducting a Launch Vehicle Demo Test in the Unitary Plan Wind Tunnel’s 11-ft Transonic Wind Tunnel in the first half of 2024 to showcase improvements made to unsteady Pressure-Sensitive Paint technology. The unsteady Pressure-Sensitive Paint setup has upgraded from a four-camera system to an eight-camera system, prompting analysis to maximize the system performance and overall data quality. Additional analysis was performed to maximize the system resolving power when subject to test constraints such as model size and model tunnel positions. These analyses have uncovered new opportunities to improve the unsteady Pressure-Sensitive Paint technology and will allow the system to collect higher quality data with simple changes to the setup procedure.
Camera Calibration↗
Curating AI-Ready Datasets for Equity and Environmental Justice: A Data-Centric AI Case Study
An equitable and environmentally just community is essentialin order to avoid disproportionate burden borne by vulnerablecommunities. This need becomes pressing in the aftermathof an extreme event such as disaster or hazard when it is diffi-cult for the governing bodies to implement resource allocationas per the need. Artificial Intelligence (AI) algorithms canhelp surface Equity and Environmental Justice (EEJ) issueswhen trained on EEJ datasets. However, curating AI-readyEEJ training datasets is challenging due to differences in fac-tors such as heterogeneity, resolution, modality, and level ofexpertise in labeling. Additionally, EEJ issues involve sensi-tive information where uncertainties and errors could degradethe performance of AI algorithms. For eg. Error in seasonalcrop yield information can highly affect the prediction of an-nual crop yield. To address these challenges, Data-centricAI (DCAI) methods are employed, which enhance AI algo-rithm performance even with limited training samples. DCAIprioritizes data quality, thereby reducing the adverse effectsof uncertainties and errors during the model training process.This research proposes a novel dataset and benchmark for an-alyzing the effect of the Maui Wildfire of 2023 for Equityand Environmental Justice (EEJ) issues. The proposed datasetaligns with the concepts of DCAI such as annotation quality,data preprocessing, privacy, feature engineering, governanceand provenance. We firmly believe that the proposed datasetwould lay a foundation to implement robust and reliable mod-ern AI algorithms for addressing EEJ issues.
Paridhi Parajuli↗
Geography of cretaceous extinctions: Data base development
Data bases built from the source literature are plagued by problems of data quality. Unless the data acquisition is done by experts, working slowly, the data base may contain so much garbage that true signals and patterns cannot be detected. On the other hand, high quality data bases develop so slowly that satisfactory statistical analysis may never be possible due to the small sample sizes. Results of a test are presented of the opposite strategy: rapid data acquisition by non-experts with minimal control on data quality. A published list of 186 species and genera of fossil invertibrates of the latest Cretaceous Age (Maestrichtian) were located through a random search of the paleobiological and geological literature. The geographic location for each faunal list was then transformed electronically to Maestrichtian latitude and longitude and the lists were further digested to identify the genera occurring in each ten-degree, latitude-longitude block. The geographical lists were clustered using the Otsuka similarity coefficient and a standard unweight-pair-group method. The resulting clusters are remarkably consistent geographically, indicating that a strong biogeographic signal is visible despite low-quality data. A further test evaluated the geographic pattern of end-Cretaceaous extinctions. All genera in the data base were compared with Sepkoski's compendium of time ranges of genera to determine which of the reported genera survived the Cretaceous mass extinction. In turn, extinction rates for the ten-degree, latitude-longitude blocks were mapped. The resulting distribution is readily interpretable as a robust pattern of the geography of the mass extinction. The study demonstrates that a low-quality data base, built rapidly, can provide a basis for meaningful analysis of past biotic events.
Raup, D. M.↗
Making Dataset Quality Information FAIR: Supporting Open-Source Science and Enhancing (Re)Use and Trustworthiness of Scientific Data
- Quality information should be documented and readily shared within and across domains. - Sharing of dataset quality information supports open science and trustworthiness of scientific data. - Dataset quality is more than data quality. - Quality tends to be domain-specific and context-dependent. - Community guidelines provide practical steps towards FAIR dataset quality information.
Ge Peng↗
Quality control in the processing of telemetry data
Quality control in processing of telemetry data
DATA PROCESSING↗
Data Fusion for Urban Air Quality Assessment & Forecasting
This presentation provides an overview for our funded project with NASA's Health and Air Quality Applied Sciences Program. The project will expand an existing air quality data fusion tool implemented in Google Earth Engine (GEE) by our project team members at Sonoma Technology, Inc. (STI), a private air quality data company. We will expand the capabilities of this tool using new methods developed by the NASA GMAO which will give it the capability of providing sub-city scale resolution and hourly frequency estimates and forecasts of three key air quality indicators: surface-level particulate matter (PM2.5), nitrogen dioxide (NO2), and ozone (O3). We will combine a variety of Earth Observations including satellite data, global air quality forecasts, and local data from regulatory-grade monitors and/or low cost sensors. We will implement the new data fusion capabilities into the existing GEE tool in consultation with our end-users to best address their needs for sub-city scale air quality estimates and forecasts.
K Emma Knowland↗
Data Mining Methods Applied to Flight Operations Quality Assurance Data: A Comparison to Standard Statistical Methods
In a previous study, multiple regression techniques were applied to Flight Operations Quality Assurance-derived data to develop parsimonious model(s) for fuel consumption on the Boeing 757 airplane. The present study examined several data mining algorithms, including neural networks, on the fuel consumption problem and compared them to the multiple regression results obtained earlier. Using regression methods, parsimonious models were obtained that explained approximately 85% of the variation in fuel flow. In general data mining methods were more effective in predicting fuel consumption. Classification and Regression Tree methods reported correlation coefficients of .91 to .92, and General Linear Models and Multilayer Perceptron neural networks reported correlation coefficients of about .99. These data mining models show great promise for use in further examining large FOQA databases for operational and safety improvements.
Stolzer, Alan J.↗
Capturing, Harmonizing and Delivering Data and Quality Provenance
Satellite remote sensing data have proven to be vital for various scientific and applications needs. However, the usability of these data depends not only on the data values but also on the ability of data users to assess and understand the quality of these data for various applications and for comparison or inter-usage of data from different sensors and models. In this paper, we describe some aspects of capturing, harmonizing and delivering this information to users in the framework of distributed web-based data tools.
Leptoukh, Gregory↗
Needs Assessment for the Use of NASA Remote Sensing Data for Regulatory Water Quality
This slide presentation reviews the assessment of the needs that NASA can use for the remote sensing of water quality. The goal of this project is to provide information for decision-making activities (water quality standards) using remotely sensed/satellite based water quality data from MODIS and Landsat data.
Spiering, Bruce↗
ESIP Information Quality Cluster (IQC)
The Information Quality Cluster (IQC) within the Federation of Earth Science Information Partners (ESIP) was initially formed in 2011 and has evolved significantly over time. The current objectives of the IQC are to: 1. Actively evaluate community data quality best practices and standards; 2. Improve capture, description, discovery, and usability of information about data quality in Earth science data products; 3. Ensure producers of data products are aware of standards and best practices for conveying data quality, and data providers distributors intermediaries establish, improve and evolve mechanisms to assist users in discovering and understanding data quality information; and 4. Consistently provide guidance to data managers and stewards on how best to implement data quality standards and best practices to ensure and improve maturity of their data products. The activities of the IQC include: 1. Identification of additional needs for consistently capturing, describing, and conveying quality information through use case studies with broad and diverse applications; 2. Establishing and providing community-wide guidance on roles and responsibilities of key players and stakeholders including users and management; 3. Prototyping of conveying quality information to users in a more consistent, transparent, and digestible manner; 4. Establishing a baseline of standards and best practices for data quality; 5. Evaluating recommendations from NASA's DQWG in a broader context and proposing possible implementations; and 6. Engaging data providers, data managers, and data user communities as resources to improve our standards and best practices. Following the principles of openness of the ESIP Federation, IQC invites all individuals interested in improving capture, description, discovery, and usability of information about data quality in Earth science data products to participate in its activities.
data products↗