Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality issues”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Status of the MODIS Level 1B Algorithms and Calibration Tables

The Moderate Resolution Imaging Spectroradiometer (MODIS) makes observations using 36 spectral bands with wavelengths from 0.41 to 14.4 m and nadir spatial resolutions of 0.25km, 0.5km, and 1km. It is currently operating onboard the NASA Earth Observing System (EOS) Terra and Aqua satellites, launched in December 1999 and May 2002, respectively. The MODIS Level 1B (L1B) program converts the sensor's on-orbit responses in digital numbers to radiometrically calibrated and geo-located data products for the duration of each mission. Its primary data products are top of the atmosphere (TOA) reflectance factors for the sensor's reflective solar bands (RSB) and TOA spectral radiances for the thermal emissive bands (TEB). The L1B algorithms perform the TEB calibration on a scan-by-scan basis using the sensor's response to the on-board blackbody (BB) and other parameters which are stored in Lookup Tables (LUTs). The RSB calibration coefficients are processed offline and regularly updated through LUTs. In this paper we provide a brief description of the MODIS L1B calibration algorithms and associated LUTs with emphasis on their recent improvements and updates developed for the MODIS collection 5 processing. We will also discuss sensor on-orbit calibration and performance issues that are critical to maintaining L1B data product quality, such as changes in the sensor's response versus scan-angle.

MODIS LEVEL 1B ALGORITHMS↗

Data Sharing in Astrobiology: The Astrobiology Habitable Environments Database (AHED)

Astrobiology is a multidisciplinary area of scientific research focused on studying the origins of life on Earth and the conditions under which life might have emerged elsewhere in the universe. NASA uses the results of Astrobiology research to help define targets for future missions that are searching for life elsewhere in the universe. The understanding of complex questions in Astrobiology requires integration and analysis of data spanning a range of disciplines including biology, chemistry, geology, astronomy and planetary science. However, the lack of a centralized repository makes it difficult for Astrobiology teams to share data and benefit from resultant synergies. Moreover, in recent years, federal agencies are requiring that results of any federally funded scientific research must be available and useful for the public and the science community. The Astrobiology Habitable Environments Database (AHED), developed with a consolidated group of astrobiologists from different active research teams at NASA Ames Research Center, is designed to help to address these issues. AHED is a central, high-quality, long-term data repository for mineralogical, textural, morphological, inorganic and organic chemical, isotopic and other information pertinent to the advancement of the field of Astrobiology.

Define targets for futire missions↗

Data Sharing in Astrobiology: the Astrobiology Habitable Environments Database (AHED)

Astrobiology is a multidisciplinary area of scientific research focused on studying the origins of life on Earth and the conditions under which life might have emerged elsewhere in the universe. NASA uses the results of Astrobiology research to help define targets for future missions that are searching for life elsewhere in the universe. The understanding of complex questions in Astrobiology requires integration and analysis of data spanning a range of disciplines including biology, chemistry, geology, astronomy and planetary science. However, the lack of a centralized repository makes it difficult for Astrobiology teams to share data and benefit from resultant synergies. Moreover, in recent years, federal agencies are requiring that results of any federally funded scientific research must be available and useful for the public and the science community. The Astrobiology Habitable Environments Database (AHED), developed with a consolidated group of astrobiologists from different active research teams at NASA Ames Research Center, is designed to help to address these issues. AHED is a central, high-quality, long-term data repository for mineralogical, textural, morphological, inorganic and organic chemical, isotopic and other information pertinent to the advancement of the field of Astrobiology.

Bristow, Thomas↗

Data Sharing in Astrobiology: The Astrobiology Habitable Environments Database (AHED)

Astrobiology is a multidisciplinary area of scientific research focused on studying the origins of life on Earth and the conditions under which life might have emerged elsewhere in the universe. NASA uses the results of Astrobiology research to help define targets for future missions that are searching for life elsewhere in the universe. The understanding of complex questions in Astrobiology requires integration and analysis of data spanning a range of disciplines including biology, chemistry, geology, astronomy and planetary science. However, the lack of a centralized repository makes it difficult for Astrobiology teams to share data and benefit from resultant synergies. Moreover, in recent years, federal agencies are requiring that results of any federally funded scientific research must be available and useful for the public and the science community. The Astrobiology Habitable Environments Database (AHED), developed with a consolidated group of astrobiologists from different active research teams at NASA Ames Research Center, is designed to help to address these issues. AHED is a central, high-quality, long-term data repository for mineralogical, textural, morphological, inorganic and organic chemical, isotopic and other information pertinent to the advancement of the field of Astrobiology.

Origins of life on Earth↗

Curved grating fabrication techniques for concentric-circle grating, surface-emitting semiconductor lasers

We describe the fabrication and operational characteristics of a novel, surface-emitting semiconductor laser that makes use of a concentric-circle grating to both define its resonant cavity and to provide surface emission. A properly fabricated circular grating causes the laser to operate in radially inward- and outward-going circular waves in the waveguide, thus, introducing the circular symmetry needed for the laser to emit a beam with a circular cross-section. The basic circular-grating-resonator concept can be implemented in any materials system; an AlGaAs/GaAs graded-index, separate confinement heterostructure (GRINSCH), single-quantum-well (SQW) semiconductor laser, grown by molecular beam epitaxy (MBE), was used for the experiments discussed here. Each concentric-circle grating was fabricated on the surface of the AlGaAs/GaAs semiconductor laser. The circular pattern was first defined by electron-beam (e-beam) lithography in a layer of polymethylmethacrylate (PMMA) and subsequently etched into the semiconductor surface using chemically-assisted (chlorine) ion-beam etching (CAIBE). We consider issues that affect the fabrication and quality of the gratings. These issues include grating design requirements, data representation of the grating pattern, and e-beam scan method. We provide examples of how these techniques can be implemented and their impact on the resulting laser performance. A comparison is made of the results obtained using two fundamentally different electron-beam writing systems. Circular gratings with period lambda = 0.25 microns and overall diameters ranging from 80 microns to 500 microns were fabricated. We also report our successful demonstration of an optically pumped, concentric-circle grating, semiconductor laser that emits a beam with a far-field divergence angle that is less than one degree. The emission spectrum is quite narrow (less than 0.1 nm) and is centered at wavelength lambda = 0.8175 microns.

Jordan, Rebecca H.↗

Ares I-X Range Safety Trajectory Analyses Overview and Independent Validation and Verification

All Flight Analysis data products were successfully generated and delivered to the 45SW in time to support the launch. The IV&V effort allowed data generators to work through issues early. Data consistency proved through the IV&V process provided confidence that the delivered data was of high quality. Flight plan approval was granted for the launch. The test flight was successful and had no safety related issues. The flight occurred within the predicted flight envelopes. Post flight reconstruction results verified the simulations accurately predicted the FTV trajectory.

Tarpley, Ashley F.↗

Evolution in Metadata Quality: Common Metadata Repository's Role in NASA Curation Efforts

Metadata Quality is one of the chief drivers of discovery and use of NASA EOSDIS (Earth Observing System Data and Information System) data. Issues with metadata such as lack of completeness, inconsistency, and use of legacy terms directly hinder data use. As the central metadata repository for NASA Earth Science data, the Common Metadata Repository (CMR) has a responsibility to its users to ensure the quality of CMR search results. This poster covers how we use humanizers, a technique for dealing with the symptoms of metadata issues, as well as our plans for future metadata validation enhancements. The CMR currently indexes 35K collections and 300M granules.

metadata quality↗

Tropical Cyclones Feed More Heavy Rain in a Warmer Climate

The possible linkage of tropical cyclones (TC) to global warming is a hotly debated scientific topic, with immense societal impacts. Most of the debate has been focused on the issue of uncertainty in the use of non-research quality data for long-term trend analyses, especially with regard to TC intensity provided by TC forecasting centers. On the other hand, it is well known that TCs are associated with heavy rain during the processes of genesis and intensification, and that there are growing evidences that rainfall characteristics (not total rainfall) are most likely to be affected by global warming. Yet, satellite rainfall data have not been exploited in any recent studies of linkage between tropical cyclones (TC) and global warming. This is mostly due to the large uncertainties associated with detection of long-term trend in satellite rainfall estimates over the ocean. This problem, as we demonstrate in this paper, can be alleviated by examining rainfall distribution, rather than rainfall total. This paper is the first to use research-quality, satellite-derived rainfall from TRMM and GPCP over the tropical oceans to estimate shift in rainfall distribution during the TC season, and its relationships with TCs, and sea surface temperature (SST) in the two major ocean basins, the northern Atlantic and the northern Pacific for 1979-2005. From the rainfall distribution, we derive the TC contributions to rainfall in various extreme rainfall categories as a function to time. Our results show a definitive trend indicating that TCs are contributing increasingly to heavier rain events, i.e., intense TC's are more frequent in the last 27 years. The TC contribution to top 5% heavy rain has nearly doubled in the last two decades in the North Atlantic, and has increased by about 10% in the North Pacific. The different rate of increase in TC contribution to heavy rain may be related to the different rates of different rate of expansion of the warm pool (SST >2S0 C) area in the two oceans.

Lau, K.-M.↗

Using SCOR as a Supply Chain Management Framework for Government Agency Contract Requirements

Enterprise Supply Chain Management consists of: Specifying suppliers to support inter-program and inter-agency efforts. Optimizing inventory levels and locations throughout the supply chain. Executing corrective actions to improve quality and lead time issues throughout the supply chain. Processing reported data to calculate and make visible supply chain performance (provide information for decisions and actions). Ensuring the right hardware and information is provided at the right time and in the right place. Monitoring the industrial base while developing, producing, operating and retiring a system. Seeing performance deep in the supply chain that could indicate issues affecting system availability and readiness.

Paxton, Joe↗

15 Years of Aqua MODIS On-Orbit Operation, Calibration, and Performance

Since launch on May 04, 2002, Aqua MODIS has successfully operated for 15 years and continuously produced from its observations many data products in support of a broad range of scientific research activities and applications. Its overall mission success has relied heavily on the dedicated efforts to operate and calibrate the instrument and to track and correct on-orbit changes in sensor responses. This paper provides an overview of Aqua MODIS instrument operation and calibration activities, algorithm improvements, and look-up-table (LUT) updates. Results derived from various on-orbit calibration targets are presented to demonstrate sensor long-term performance. Also discussed in this paper are challenging issues identified and future efforts to maintain instrument calibration and data quality.

Xiong, X.↗

TPSAS-NF1676L-20321-DND

NASA has conducted airborne tropospheric chemistry studies for about three decades. These field campaigns have generated a great wealth of observations, including a wide range of the trace gases and aerosol properties. Even though the spatial and temporal coverage is limited, the aircraft data offer high resolution and comprehensive simultaneous coverage of many variables, e.g. ozone precursors, intermediate photochemical species, and photochemical products. The recent NASA Earth Venture Program has generated an unprecedented amount of aircraft observations in terms of the sheer number of measurements and data volume. The ASDC Toolset for Airborne Data (TAD) is being designed to meet the user community needs for aircraft data for scientific research on climate change and air quality relevant issues.

Aubrey Beach↗

CoSMIR Performance During the GPM Olympex Campaign

The airborne Conical Scanning Millimeter-wave Imaging Radiometer (CoSMIR) participated in the Global Precipitation Measurement (GPM) Olympic Mountains Experiment (OLYMPEX) from November to December 2015 with great success. With similar channels as the GPM Microwave Imager (GMI) at 89-183 GHz, CoSMIR served as a proxy for GMI by flying onboard the DC-8 aircraft for a total of 17 science flights, collecting over 72 hours of observations. The high-quality, calibrated brightness temperature dataset is the result of several improvements made to CoSMIR prior to OLYMPEX to make the instrument more reliable. This paper describes these improvements and gives a detailed summary of the CoSMIR measurements obtained from OLYMPEX. CoSMIR experienced minor performance issues during the campaign, most of which were not excessive and only resulted in a loss of approximately four hours of data for the entire campaign. Performance issues are discussed and shown how they were mitigated to achieve a quality dataset. Comparisons of CoSMIR and GMI observations are presented to show that the CoSMIR measurements agree well with GMI. The CoSMIR dataset is publicly available as part of the OLYMPEX data suite and can reliably be used in GPM algorithm development and related studies.

Airborne radiometer↗

Regional Assimilation of NASA Atmospheric Infrared Sounder (AIRS) Data

The NASA Short-term Prediction Research and Transition (SPORT) Center seeks to accelerate the infusion of NASA Earth Science Enterprise (ESE) observations, data assimilation and modeling research into NW S forecast operations and decision-making. The Atmospheric Infrared Sounder (AIRS), is expected to advance climate research and weather prediction into the 21 st century. It is one of six instruments onboard Aqua, a satellite that is part of NASA s Earth Observing System. AIRS, along with two partner microwave sounding instruments, represents the most advanced atmospheric sounding system ever deployed in space. The system is capable of measuring the atmospheric temperature in the troposphere with radiosonde accuracies of 1 K over 1 km-thick layers under both clear and cloudy conditions, while the accuracy of the derived moisture profiles will exceed that obtained by radiosondes. It is imperative that the scientific community is prepared to take full advantage of next-generation satellite data that will become available within the next decade. The purpose of this paper is to describe a procedure designed to optimally assimilate AIRS data at high spatial resolution over both land and ocean. The assimilation system used in this study is the Local Analysis and Prediction System (LAPS) developed at the Forecast System Laboratory used extensively around the globe. Results will focus on quality control issues associated with AIRS, optimal assimilation strategies, and the impact of the AIRS data on subsequent numerical forecasts at 12 km produced by the next generation Weather Research and Forecast (WRF) model.

Chou, Shih-Hung↗

A vehicle health monitoring system for the Space Shuttle Reaction Control System during reentry

A general two tier framework for vehicle health monitoring of Guidance Navigation and Control (GN&C) system actuators, effectors, and propulsion devices is presented. In this context, a top level monitor that estimates jet thrust is designed for the Space Shuttle Reaction Control System (RCS) during the reentry phase of flight. Issues of importance for the use of estimation technologies in vehicle health monitoring are investigated and quantified for the Shuttle RCS demonstration application. These issues include rate of convergence, robustness to unmodeled dynamics, sensor quality, sensor data rates, and information recording objectives. Closed loop simulations indicate that a Kalman filter design is sensitive to modeling error and robust estimators may reduce this sensitivity. Jet plume interaction with the aerodynamic flowfield is shown to be a significant effect adversely impacting the ability to accurately estimate thrust.

Rosello, Anthony David↗

MERRA-2 Input Observations: Summary and Assessment

The Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) is an atmospheric reanalysis, spanning 1980 through near-realtime, that uses state-of-the-art processing of observations from the continually evolving global observing system. The effectiveness of any reanalysis is a function not only of the input observations themselves, but also of how the observations are handled in the assimilation procedure. Relevant issues to consider include, but are not limited to, data selection, data preprocessing, quality control, bias correction procedures, and blacklisting. As the assimilation algorithm and earth system models are fundamentally fixed in a reanalysis, it is often a change in the character of the observations, and their feedbacks on the system, that cause changes in the character of the reanalysis. It is therefore important to provide documentation of the observing system so that its discontinuities and transitions can be readily linked to discontinuities seen in the gridded atmospheric fields of the reanalysis. With this in mind, this document provides an exhaustive list of the input observations, the context under which they are assimilated, and an initial assessment of selected core observations fundamental to the reanalysis.

Satellite Observations↗

Evaluation of Machine Learning and Deep Learning Algorithms for Fire Prediction in Southeast Asia

Vegetation fires are prevalent in South/Southeast Asian countries, making fire prediction crucial due to their potential environmental, economic, and social impacts. Accurate predictions of fires facilitate timely interventions, helping to mitigate uncontrolled fires that can lead to biodiversity loss and air quality issues. In this study, we utilize VIIRS satellite-derived fire data alongside six machine learning and deep learning models—Simple Persistence, Multi-Layer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), CNN-LSTM, and ConvLSTM—to determine the most effective fire prediction model, using Root Mean Square Error (RMSE) as the metric. Our results indicate that the CNN model is the most reliable in regions with spatial dependencies, such as Brunei, Indonesia, Malaysia, the Philippines, Timor-Leste, and Thailand. Conversely, the ConvLSTM model excels in countries with complex spatiotemporal dynamics like Laos, Myanmar, and Vietnam. The CNN-LSTM hybrid model also performed well in Cambodia, suggesting a need for a balanced approach in areas requiring both spatial and temporal feature extraction. Furthermore, simpler models like Persistence and MLP showed limitations in capturing dynamic patterns and temporal dependencies. Our findings highlight the importance of evaluating models before implementing any decision support systems (DSS) in fire management. By tailoring models to specific regional fire data, we can enhance prediction accuracy and responsiveness, ultimately improving fire risk management in Southeast Asia and beyond.

Deep learning↗

Provenance in Data Interoperability for Multi-Sensor Intercomparison

As our inventory of Earth science data sets grows, the ability to compare, merge and fuse multiple datasets grows in importance. This requires a deeper data interoperability than we have now. Efforts such as Open Geospatial Consortium and OPeNDAP (Open-source Project for a Network Data Access Protocol) have broken down format barriers to interoperability; the next challenge is the semantic aspects of the data. Consider the issues when satellite data are merged, cross-calibrated, validated, inter-compared and fused. We must match up data sets that are related, yet different in significant ways: the phenomenon being measured, measurement technique, location in space-time or quality of the measurements. If subtle distinctions between similar measurements are not clear to the user, results can be meaningless or lead to an incorrect interpretation of the data. Most of these distinctions trace to how the data came to be: sensors, processing and quality assessment. For example, monthly averages of satellite-based aerosol measurements often show significant discrepancies, which might be due to differences in spatio- temporal aggregation, sampling issues, sensor biases, algorithm differences or calibration issues. Provenance information must be captured in a semantic framework that allows data inter-use tools to incorporate it and aid in the intervention of comparison or merged products. Semantic web technology allows us to encode our knowledge of measurement characteristics, phenomena measured, space-time representation, and data quality attributes in a well-structured, machine-readable ontology and rulesets. An analysis tool can use this knowledge to show users the provenance-related distrintions between two variables, advising on options for further data processing and analysis. An additional problem for workflows distributed across heterogeneous systems is retrieval and transport of provenance. Provenance may be either embedded within the data payload, or transmitted from server to client in an out-of-band mechanism. The out of band mechanism is more flexible in the richness of provenance information that can be accomodated, but it relies on a persistent framework and can be difficult for legacy clients to use. We are prototyping the embedded model, incorporating provenance within metadata objects in the data payload. Thus, it always remains with the data. The downside is a limit to the size of provenance metadata that we can include, an issue that will eventually need resolution to encompass the richness of provenance information required for daata intercomparison and merging.

Lynnes, Chris↗

Information Quality Cluster and Usability

The Information Quality Cluster (IQC) of the Federation of Earth Science Information Partners (ESIP) has been active since 2014 with membership from multiple organizations including NASA and NOAA. The purpose of this presentation is to foster collaboration between the IQC and the ESIP Usability Cluster. The IQC's activities are motivated partly by the guidelines on information quality from several federal agencies. The agencies developed the guidelines complying with a request in 2002 from the Office of Management and Budget (OMB). The OMB request resulted from a congressional mandate, namely, Section 515 of the Treasury and General Government Appropriations Act for Fiscal Year 2001 (Public Law 106-554; H.R. 5658). NASA's guidelines, for example, emphasize the need for high information quality indicating the various types of public users of information from NASA's missions and programs. The IQC's vision is to become an authoritative and responsive resource of information and guidance to data providers on how best to implement data quality standards and best practices, so that the implementations comply with the various agencies' guidelines, as well as provide users with the best quality of information possible. The IQC interacts with various national and international organizations and encourages collaboration for exchange of information. The IQC considers four aspects of information quality: Scientific Quality, Product Quality, Stewardship Quality and Service Quality. The IQC has considered several use cases to identify issues in capturing, describing, providing access to, and enabling use of information on quality. Several of these use cases point to issues about the usability of information. Collaboration between the IQC and Usability Cluster will be beneficial for arriving at solutions to such issues.

Remote Sensing; Data Systems; Information Quality;↗