Search NASA⌕ Search

SEARCH · Search NASA

Results for “quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Bayesian Revision of Residual Detection Power

This paper addresses some issues with quality assessment and quality assurance in response surface modeling experiments executed in wind tunnels. The role of data volume on quality assurance for response surface models is reviewed. Specific wind tunnel response surface modeling experiments are considered for which apparent discrepancies exist between fit quality expectations based on implemented quality assurance tactics, and the actual fit quality achieved in those experiments. These discrepancies are resolved by using Bayesian inference to account for certain imperfections in the assessment methodology. Estimates of the fraction of out-of-tolerance model predictions based on traditional frequentist methods are revised to account for uncertainty in the residual assessment process. The number of sites in the design space for which residuals are out of tolerance is seen to exceed the number of sites where the model actually fails to fit the data. A method is presented to estimate how much of the design space in inadequately modeled by low-order polynomial approximations to the true but unknown underlying response function.

DeLoach, Richard↗
NASA NTRS2010

Evaluation of the VIIRS Land Algorithms at Land PEATE

The Land Product Evaluation and Algorithm Testing Element (Land PEATE), a component of the Science Data Segment of the National Polar-orbiting Operational Environmental Satellite System (NPOESS) Preparatory Project (NPP), is being developed at the NASA Goddard Space Flight Center (GSFC). The primary task of the Land PEATE is to assess the quality of the Visible Infrared Imaging Radiometer Suite (VIIRS) Land data products made by the Interface Data Processing System (IDPS) using the Operational (OPS) Code during the NPP era and to recommend improvements to the algorithms in the IDPS OPS code. The Land PEATE uses a version of the MODIS Adaptive Processing System (MODAPS), NPPDAPS, that has been modified to produce products from the IDPS OPS code and software provided by the VIIRS Science Team, and uses the MODIS Land Data Operational Product Evaluation (LDOPE) team for evaluation of the data records generated by the NPPDAPS. Land PEATE evaluates the algorithms by comparing data products generated using different versions of the algorithm and also by comparing to heritage products generated from different instrument such as MODIS using various quality assessment tools developed at LDOPE. This paper describes the Land PEATE system and some of the approaches used by the Land PEATE for evaluating the VIIRS Land algorithms during the pre-launch period of the NPP mission and the proposed plan for long term monitoring of the quality of the VIIRS Land products post-launch.

Wolfe, Robert E.↗
NASA NTRS2008

The NPOESS Preparatory Project (NPP) Science Data Segment (SDS) Data Depository and Distribution Element (SD3E) System Architecture

The National Polar-orbiting Operational Environmental Satellite System (NPOESS), the U.S. Government's future low-Earth orbiting satellite system, will monitor global weather and environmental conditions. Serving as a risk reduction for NPOESS, the NPOESS Preparatory Project (NPP) will provide remotely sensed atmospheric, land, ocean, ozone, and sounder data that will serve the meteorological and global climate change scientific communities. The National Aeronautics and Space Administration (NASA) NPP Science Data Segment's (SDS) primary role is to independently assess the quality of the NPP science and environmental data records for their ability to support climate research. The SDS is composed of nine elements; an input element that receives data from the operational agencies and acts as a buffer, a calibration analysis element, five elements devoted to measurement based quality assessment, an element used to test algorithmic improvements, and an element that provides overall science direction. Each element requires a set of sensor specific science data products for their evaluation. There are four NPP sensors that will be flown on the NPP observatory. They are the Visible Infrared Imagining Radiometer Suite (VIIRS), the Advanced Technology Microwave Sounder (ATMS), the Cross-Track Infrared Sounder (CrIS), and the Ozone Mapper/Profiler Suite (OMPS). It is estimated that these four sensors combined will make daily data requests for approximately six terabytes of NPP science products from the operational data providers. As a result, issues associated with duplicate data requests, data transfers of large volumes of diverse products, and data transfer failures raised concerns with respect to the network traffic and bandwidth consumption. Therefore, a central data broker system for receiving and buffering data requests and data products for the SDS was developed. The data element for this system is called the SDS Data Depository and Distribution Element (SD3E). It supports science mission data assessment by assuring the timely and validated acquisition and subsequent transfer of the NPP Science Mission data to the SDS Elements and NPP Science Team. The six science elements that interface with the SD3E span across the NASA Goddard Space Flight Center (GSFC), the NASA Jet Propulsion Laboratory (JPL), and the University of Wisconsin. As the primary communication vehicle for the science elements and science team, the SD3E has an interface to the operational data providers: National Environment Satellite, Data, and Information Service (NESDIS) Interface Data Processing System (IDPS) and the National Oceanic Atmospheric Administration's (NOAA) Comprehensive Large Array-data Stewardship system (CLASS) Archive Data System (ADS), that are responsible for product generation and archive and distribution respectively. The SD3E is designed to be a semi-customizable and semi-automated system. This system is designed to provide flexibility and ease of use for the science users in accessing the latest data products by creating a rolling data cache that temporarily stores the products locally before transferring the data to the SDS Measurement based elements for the land, ocean, atmosphere, sounder, and ozone. This paper describes the design and architecture of one of the nine SDS elements, the SD3E, and how this system has provided a mechanism for efficient data exchange, how it has helped in alleviating some of the network traffic and usage, and how it has contributed to reducing operational costs.

Ho, Evelyn L.↗
NASA NTRSDate not supplied

Automated Metadata Scoring Approaches for Earth Observation Data

The Common Metadata Repository (CMR) contains metadata records describing NASA’s Earth observation data products which are archived across 12 data centers also known as Distributed Active Archive Centers (DAACs). To ensure that NASA’s data is discoverable, accessible, and usable, the Analysis and Review of CMR (ARC) Team, located at Marshall Space Flight Center, assesses the quality of these metadata records. The ARC team currently uses a combination of automated and manual methods to check metadata records for quality dimensions such as completeness, correctness, and consistency. In addition to these quality assessments, the team is currently exploring various metadata scoring methods in order to provide normalized results across the twelve DAACs. This method is conducted by using automated methods to assess metadata fields and then provide a numeric score, or grade, based on the analysis. To implement this process, two different approaches have been theorized and are currently being explored by the ARC team. This presentation will describe ARC's two proposed methodologies in more detail, and the pros and cons to using these metadata scoring methods.

Jenny Wood↗
NASA NTRS2024

San Joaquin Valley Health & Air Quality II: Assessing Urban Heat Island Distribution and its Intersections with Air Quality to Understand Converging Vulnerabilities

The city of Stockton, California, located within the San Joaquin Valley (SJV), is a major hub for agricultural production and has endured the continuous threat to community health from nitrogen dioxide (NO 2 ) and increasing temperatures. The convergence of these issues occurs within historically segregated communities that are disproportionately facing health risks related to heat and air quality. Little Manila Rising (LMR), a social and environmental justice (EJ) advocacy non-profit, partnered with NASA DEVELOP for a second term project to evaluate county wide urban heat islands, sociodemographic vulnerability, landcover classification, and the convergence of these variables. We utilized Landsat 8 Thermal Infrared Sensor (TIRS) and Operational Land Imager (OLI) data to produce a land surface temperature (LST) and Normalized Difference Vegetation Index map. They added Centers for Disease Control (CDC) socioeconomic data from 2020 to identify which communities in Stockton were more susceptible to these environmental factors. Additionally, we used NAIP imagery to create a landcover map differentiating developed infrastructure from tree canopy cover. We discovered that south Stockton, where LMR resides, had the worst convergence of heat, air pollution, low canopy coverage and sociodemographic vulnerability compared to northern and rural parts of the city. This was further substantiated by statistical analysis showing a strong positive relationship between areas of high LST and low vegetation. The results provided LMR with compelling evidence to use in their EJ advocacy, and in their efforts to inform state officials of the discriminatory issues they face.

Urban Heat Islands↗
NASA NTRS1983

A conceptual study of automatic and semi-automatic quality assurance techniques for round image processing

This report summarizes the results of a study conducted by Engineering and Economics Research (EER), Inc. under NASA Contract Number NAS5-27513. The study involved the development of preliminary concepts for automatic and semiautomatic quality assurance (QA) techniques for ground image processing. A distinction is made between quality assessment and the more comprehensive quality assurance which includes decision making and system feedback control in response to quality assessment.

Source record↗
NASA NTRS2010

Development of an Uncertainty Model for the National Transonic Facility

This paper introduces an uncertainty model being developed for the National Transonic Facility (NTF). The model uses a Monte Carlo technique to propagate standard uncertainties of measured values through the NTF data reduction equations to calculate the combined uncertainties of the key aerodynamic force and moment coefficients and freestream properties. The uncertainty propagation approach to assessing data variability is compared with ongoing data quality assessment activities at the NTF, notably check standard testing using statistical process control (SPC) techniques. It is shown that the two approaches are complementary and both are necessary tools for data quality assessment and improvement activities. The SPC approach is the final arbiter of variability in a facility. Its result encompasses variation due to people, processes, test equipment, and test article. The uncertainty propagation approach is limited mainly to the data reduction process. However, it is useful because it helps to assess the causes of variability seen in the data and consequently provides a basis for improvement. For example, it is shown that Mach number random uncertainty is dominated by static pressure variation over most of the dynamic pressure range tested. However, the random uncertainty in the drag coefficient is generally dominated by axial and normal force uncertainty with much less contribution from freestream conditions.

Walter, Joel A.↗
NASA NTRS1986

Space Shuttle flying qualities criteria assessment. Phase 5: Data acquistion and analysis

The development of flying qualities experiments (OFQ) as a part of the Orbiter Experiments Program (OEX) was continued. The data base was extended to use the ground based cinetheodolite measurements of orbiter approach and landing. Onboard the cinetheodolite data were analyzed from flights STS 2 through 7 to identify the effective augmented vehicle dynamics, the control strategy employed by the pilot during preflare, shallow glide, and final flare segments of the landing, and the key approach and touchdown performance measures. A plan for an OFQ flying qualities data archive and processing is presented.

Myers, T. T.↗
NASA NTRS2000

A Method for Assessing the Quality of Model-Based Estimates of Ground Temperature and Atmospheric Moisture Using Satellite Data

A method is developed for validating model-based estimates of atmospheric moisture and ground temperature using satellite data. The approach relates errors in estimates of clear-sky longwave fluxes at the top of the Earth-atmosphere system to errors in geophysical parameters. The fluxes include clear-sky outgoing longwave radiation (CLR) and radiative flux in the window region between 8 and 12 microns (RadWn). The approach capitalizes on the availability of satellite estimates of CLR and RadWn and other auxiliary satellite data, and multiple global four-dimensional data assimilation (4-DDA) products. The basic methodology employs off-line forward radiative transfer calculations to generate synthetic clear-sky longwave fluxes from two different 4-DDA data sets. Simple linear regression is used to relate the clear-sky longwave flux discrepancies to discrepancies in ground temperature ((delta)T(sub g)) and broad-layer integrated atmospheric precipitable water ((delta)pw). The slopes of the regression lines define sensitivity parameters which can be exploited to help interpret mismatches between satellite observations and model-based estimates of clear-sky longwave fluxes. For illustration we analyze the discrepancies in the clear-sky longwave fluxes between an early implementation of the Goddard Earth Observing System Data Assimilation System (GEOS2) and a recent operational version of the European Centre for Medium-Range Weather Forecasts data assimilation system. The analysis of the synthetic clear-sky flux data shows that simple linear regression employing (delta)T(sub g)) and broad layer (delta)pw provides a good approximation to the full radiative transfer calculations, typically explaining more thin 90% of the 6 hourly variance in the flux differences. These simple regression relations can be inverted to "retrieve" the errors in the geophysical parameters, Uncertainties (normalized by standard deviation) in the monthly mean retrieved parameters range from 7% for (delta)T(sub g) to approx. 20% for the lower tropospheric moisture between 500 hPa and surface. The regression relationships developed from the synthetic flux data, together with CLR and RadWn observed with the Clouds and Earth Radiant Energy System instrument, ire used to assess the quality of the GEOS2 T(sub g) and pw. Results showed that the GEOS2 T(sub g) is too cold over land, and pw in upper layers is too high over the tropical oceans and too low in the lower atmosphere.

Wu, Man Li C.↗
NASA NTRS1977

Technical assessment for quality control of resins

Survey visits to companies involved in the manufacture and use of graphite-epoxy prepregs were conducted to assess the factors which may contribute to variability in the mechanical properties of graphite-epoxy composites. In particular, the purpose was to assess the contributions of the epoxy resins to variability. Companies represented three segments of the composites industry - aircraft manufacturers, prepreg manufacturers, and epoxy resin manufacturers. Several important sources of performance variability were identified from among the complete spectrum of potential sources which ranged from raw materials to composite test data interpretation.

Gosnell, R. B.↗
NASA NTRS1999

Reference H Cycle 3 Stability, Control, and Flying Qualities Batch Assessments

This work is an update of the assessment completed in February of 1996, when a preliminary assessment report was issued for the Cycle 2B simulation model. The primary purpose of the final assessment was to re-evaluate each assessment against the flight control system (FCS) requirements document using the updated model. Only a limited number of final assessments were completed due to the close proximity of the release of the Langley model and the assessment deliverable date. The assessment used the nonlinear Cycle 3 simulation model because it combines nonlinear aeroelastic (quasi-static) aerodynamic with hinge moment and rate limited control surface deflections. Both Configuration Aerodynamics (Task 32) and Flight Controls (Task 36) were funded in 1996 to conduct the final stability and control assessments of the unaugmented Reference H configuration in FY96. Because the two tasks had similar output requirements, the work was divided such that Flight Controls would be responsible for the implementation and checkout of the simulation model and Configuration Aerodynamics for writing Madab "script' files, conducting the batch assessments and writing the assessment report. Additionally, Flight Controls was to investigate control surface allocations schemes different from the baseline Reference H in an effort to fulfill flying qualities criteria.

Henderson, Dennis K.↗
NASA NTRS1982

Assessing the quality of curvilinear coordinate meshes by decomposing the Jacobian matrix

An algebraic decomposition of the Jacobian matrix which relates physical and computational variables is presented. This invertible decomposition parameterizes the mesh by the physically intuitive qualities of cell orientation, cell orthogonality, cell volume, and cell aspect ratio. The decomposition can be used to analyze numerically generated curvilinear coordinate meshes and to assess the contribution of the mesh to the truncation error for any specific differential operator and algorithm. This is worked out in detail for Laplace's equation in nonconservative and conservative forms. The analysis is applied to the solution of the full potential code TAIR, showing grid plots, carpet plots, and truncation error for a NACA 0012 airfoil.

Kerlick, G. D.↗
NASA NTRS2007

Generating a Long-Term Land Data Record from the AVHRR and MODIS Instruments

The goal of NASA's Land Long Term Iiata Record (LTDR) project is to produce a consistent long term data set from the AVHRR and MODIS instruments for land climate studies. The project will create daily surface reflectance and normalized difference vegetation index (NDVI) products at a resolution of 0.05 deg., which is identical to the Climate Modeling Grid (CMG) used for MODIS products from EOS Terra and Aqua. Higher order products such as burned area, land surface temperature, albedo, bidirectional reflectance distribution function (BRDF) correction, leaf area index (LAI), and fraction of photosyntheticalIy active radiation absorbed by vegetation (fPAR), will be created. The LTDR project will reprocess Global Area Coverage (GAC) data from AVHRR sensors onboard NOAA satellites by applying the preprocessing improvements identified in the AVHRR Pathfinder Il project and atmospheric and BRDF corrections used in MODIS processing. The preprocessing improvements include radiometric in-flight vicarious calibration for the visible and near infrared channels and inverse navigation to relate an Earth location to each sensor instantaneous field of view (IFOV). Atmospheric corrections for Rayleigh scattering, ozone, and water vapor are undertaken, with aerosol correction being implemented. The LTDR also produces a surface reflectance product for channel 3 (3.75 micrometers). Quality assessment (QA) is an integral part of the LTDR production system, which is monitoring temporal trands in the AVHRR products using time-series approaches developed for MODIS land product quality assessment. The land surface reflectance products have been evaluated at AERONET sites. The AVHRR data record from LTDR is also being compared to products from the PAL (Pathfinder AVHRR Land) and GIMMS (Global Inventory Modeling and Mapping Studies) systems to assess the relative merits of this reprocessing vis-a-vis these existing data products. The LTDR products and associated information can be found at http://ltdr.nascom.nasa.gov/ltdr/ltdr.html.

Pedelty, Jeffrey↗
NASA NTRS1984

Space shuttle flying qualities criteria assessment, phase 3

The crucial flight data measurement and reduction techniques required for the experimental approach are explored. An overview of available flight data is presented, identification of the effective augmented vehicle and pilot models determined, a summary of flight data problems compiled, and further recommendations for the Orbiter Flying Qualities (OFQ) experiment provided.

Myers, T. T.↗
NASA NTRSDate not supplied

QuARC: Development of a Service to Enable FAIR-er Metadata

The ARC Project: The ARC Team located at NASA’s Marshall Space Flight Center conducts quality assessments of metadata records that catalog NASA’s collection of over 9,000 Earth observation data products, stored in a centralized database called the Common Metadata Repository (CMR). The ARC Team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency with the goal of making NASA’s data products more discoverable, accessible, and usable. ARC = Analysis and Review of the CMR

Earth Science Informatics↗
NASA NTRS2024

Big Cypress Water Resources: Using Earth Observations to Assess Water Quality in Big Cypress Reservation, FL

Upstream agricultural development and runoff are driving harmful algal blooms in the Big Cypress Reservation. The Seminole Tribe of Florida Environmental Resource Management Department monitors water quality in the Big Cypress Reservation, located on the north end of Big Cypress National Preserve. The Environmental Resource Management Department aims to incorporate Earth observations into its investigative approach, which consists of Geographic Information Systems and in situ water sampling. We assessed the feasibility of using Earth observations to measure harmful algal blooms over time and identify vulnerable areas. We analyzed data from multiple remote sensing platforms and sensors, including Landsat 8 Thermal Infrared Spectrometer(TIRS), Landsat 9 TIRS-2, Landsat 9 Operational Land Imager 2, Sentinel-2 MultiSpectral Instrument, and Sentinel-3 Ocean and Land Color Instrument. We determined that it was challenging to use Sentinel-3, Landsat 8, and Landsat 9 imagery for monitoring the canals within the Reservation, and that Sentinel-2 was the most capable platform for the study area. Using Sentinel-2, we created spectral indices for the detection of algal blooms. We used these indices to measure algal blooms at 8 stations across the Big Cypress Reservation. We then created time series and seasonal decompositions of in situ water sample data and indices to visualize relationships between datasets, along with correlation matrices. Our correlations were not conclusive. However, we found that the spectral indices have the potential to detect algal blooms. Lastly, we evaluated Maxar WorldView-3 imagery and found that using data from sensors with higher spatial resolutions would improve results.

Remote sensing↗
DOE OSTI2025

Descriptor: High Temporal Resolution Meteorological Data at Oak Ridge Reservation (ORR-HiResMet)

Access to continuous, quality assessed meteorological data is critical for understanding the climatology and atmospheric dynamics of a region. Research facilities like Oak Ridge National Laboratory (ORNL) rely on such data to assess site-specific climatology, model potential emissions, establish safety baselines, and prepare for emergency scenarios. To meet these needs, on-site towers at ORNL collect meteorological data at 15-minute and hourly intervals. However, data measurements from meteorological towers are affected by sensor sensitivity, degradation, lightning strikes, power fluctuations, glitching, and sensor failures, all of which can affect data quality. To address these challenges, we conducted a comprehensive quality assessment and processing of five years of meteorological data collected from ORNL at 15-minute intervals, including measurements of temperature, pressure, humidity, wind, and solar radiation. The time series of each variable was pre-processed and gap-filled using established meteorological data collection and cleaning techniques, i.e., the time series were subjected to structural standardization, data integrity testing, automated and manual outlier detection, and gap-filling. The data product and highly generalizable processing workflow developed in Python Jupyter notebooks are publicly accessible online. As a key contribution of this study, the evaluated 5-year data will be used to train atmospheric dispersion models that simulate dispersion dynamics across the complex ridge-and-valley topography of the Oak Ridge Reservation in East Tennessee.

Steckler, Morgan R. [Oak Ridge National Laboratory↗
NASA NTRSDate not supplied

A Pipeline for Assessing the Quality of Rna-Seq Datasets in GeneLab

Transcriptome profiling by RNA sequencing (RNA-seq) is a powerful approach to identify gene expression changes in organisms exposed to unique environments such as spaceflight. One of the challenges of evaluating RNA-seq data both within and across different space-relevant studies is the ability to control for technical differences, including the use of different library preparation kits, sequencing platforms, RNA yield, and person-to-person variation. To help address this issue, the National Institute of Standards and Technology (NIST, nist.gov) initiated a consortium, at the request of industry and academia, to develop a set of controls for gene expression measurements. The result was a set of 92 unlabeled, polyadenylated transcripts that range from 250 – 2,000 nucleotides in length to mimic natural eukaryotic mRNAs. These External RNA Controls Consortium (ERCC) genes can be used in any RNA-seq experiment, by adding known concentrations of the ERCC genes to samples after RNA extraction, to offer a standard measurement for data comparison. At NASA GeneLab, we employ these controls as part of our standard operating procedures for every in-house RNA-seq study to assess the limit of detection, dynamic range, and power of differential expression analysis both within and across experiments. Here we will discuss the use, benefits, and limitations of ERCC genes and other types of controls, such as universal RNA references, to generate quality control information for RNA-seq studies conducted at GeneLab.

GeneLab↗