Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

SECARB-USA: Data Quality Methodology

SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no-go decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects.

54 ENVIRONMENTAL SCIENCES↗

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗

Development of a Miniaturized Mobile Mapping System for In-Row, Under-Canopy Phenotyping

This paper focuses on the development of a miniaturized mobile mapping platform with advantages over current agricultural phenotyping systems in terms of acquiring data that facilitate under-canopy plant trait extraction. The system is based on an unmanned ground vehicle (UGV) for in-row, under-canopy data acquisition to deliver accurately georeferenced 2D and 3D products. The paper addresses three main aspects pertaining to the UGV development: (a) architecture of the UGV mobile mapping system (MMS), (b) quality assessment of acquired data in terms of georeferencing information as well as derived 3D point cloud, and (c) ability to derive phenotypic plant traits using data acquired by the UGV MMS. The experimental results from this study demonstrate the ability of the UGV MMS to acquire dense and accurate data over agricultural fields that would facilitate highly accurate plant phenotyping (better than above-canopy platforms such as unmanned aerial systems and high-clearance tractors). Plant centers and plant count with an accuracy in the 90% range have been achieved.

54 ENVIRONMENTAL SCIENCES↗

Commercial Smallsat Data Acquisition Program: Airbus U.S. Synthetic Aperture Radar Quality Assessment Summary

Quality assessment of the Airbus X-band Synthetic Aperture Radar (SAR) satellite products was conducted by the Commercial Smallsat Data Acquisition (CSDA) program’s radar subject matter experts, following the Joint NASA/ESA (European Space Agency) assessment draft guidelines. All three Airbus SAR spacecraft (TerraSAR-X, TanDEM-X, and PAZ) are based on the TerraSAR-X platform, and each have an active phased array antenna that is 4.8 x 0.7 m in the along-track and cross-track dimensions, respectively. TerraSAR-X and TanDEM-X are in a helical orbit, creating a bistatic imaging geometry, in addition to being capable of independent monostatic observations. The PAZ mission follows TerraSAR-X and TanDEM-X in the same 11-day orbit with a 5.5-day lag. TerraSAR-X and TanDEM-X are designed, developed, and operated through a Public-Private Partnership, while PAZ is a dual-use mission (civil and defense agencies), funded and owned by the Spanish Ministry of Defense and managed by Hisdesat (Hisdesat Servicios Estratégicos, S.A.), a Spanish private communications company. The assessment presented in this document is divided into two main parts: documentation review and the assessment of test datasets. The documentation review in sections 2.1 through 2.4 includes the assessment of the Airbus documentation provided to the CSDA evaluation team. The grading of these documents is given in columns 1-4 of the maturity matrix shown in section 1.1. Section 2.5 summarizes the evaluation performed by NASA using the data purchased through the CSDA program. The grading for this is given in the last column of the maturity matrix. Section 3 provides more detailed explanations on the methods and the results of the data analysis performed by NASA. Only the documents provided by Airbus for the evaluation were considered for the review. Additional documentation with more detailed description of the calibration and validation procedures may be available online but were not considered for this evaluation. The product information provided in the available documentation (RD-1, RD-2) and the product metadata together provided adequate information to work with the data. The product details in the metadata included the required information to work with the data in the common XML file format. Metrological traceability documentation was not provided to CSDA. All relevant characterization of the SAR system and data were provided, and the metadata include all relevant ancillary information. Documentation provided to CSDA included limited pre-flight and post-launch calibration information.

Batuhan Osmanoglu↗

Capturing, Harmonizing and Delivering Data and Quality Provenance

Satellite remote sensing data have proven to be vital for various scientific and applications needs. However, the usability of these data depends not only on the data values but also on the ability of data users to assess and understand the quality of these data for various applications and for comparison or inter-usage of data from different sensors and models. In this paper, we describe some aspects of capturing, harmonizing and delivering this information to users in the framework of distributed web-based data tools.

Leptoukh, Gregory↗

Comparative assessment of LANDSAT-D MSS and TM data quality for mapping applications in the Southeast

Rectifications of multispectral scanner and thematic mapper data sets for full and subscene areas, analyses of planimetric errors, assessments of the number and distribution of ground control points required to minimize errors, and factors contributing to error residual are examined. Other investigations include the generation of three dimensional terrain models and the effects of spatial resolution on digital classification accuracies.

Source record↗

SU-FF-T-469: Energy Spectra Reconstruction From Beta Emitters: A Study of the Sr-90/Y-90 Case

Purpose: Reconstruction of the energy spectrum of a 90Sr/90Yradioactive source for low dose (~1Gy) radiation biology experiments. Method and Materials:Electrons originated from a 25 {micro}Ci 90Sr/90Yradioactive source were recently used in radio-biology experiments to study the response of cancer cells to low dose irradiation (~1Gy). The beam was separated into individual energies using a dipole magnet, the number of exited electronsmeasured by a scintillating fiber based detector and the dose obtained using double-layered EBT films. The dipole was constructed from two 5.08 x 5.08 x 2.54 cm{sup 3}permanent magnets separated by a distance of 2 cm and having a maximum field of about 5 kG at the center. The beam entered the magnet through a 1 cm diameter, 0.5 cm thick leaded glass collimator. The detector was an array of 16 blue shifted 1 mm thick scintillating fibers. A realistic Geant4 simulation was used to account for the energy loss while electrons propagate throughout the system. The incident energy spectrum was generated from the NIST-logft calculation. Results: The data was first compared with measurements using a pancake frisker detector for an overall general assessment of the data quality, giving an agreement to within 15%. The average deviation of the data/simulation ratio is {+-}2.5%. A comparison between the measured and simulated mean energies gives an agreement to within 1{sigma} (less than 0.3%). Conclusion: The simple system developed for this work can serve as a mean for an efficient way to accurately reconstruct the energy distribution of charged particle emitters as well as to assess expected dose delivery to biological systems. Such data can also be used to benchmark low energy physics processes implemented in simulation tools for medical physics purpose.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Genetic characterization of a Sorghum bicolor multiparent mapping population emphasizing carbon-partitioning dynamics

Sorghum bicolor, a photosynthetically efficient C4 grass, represents an important source of grain, forage, fermentable sugars, and cellulosic fibers that can be utilized in myriad applications ranging from bioenergy to bioindustrial feedstocks. Sorghum’s efficient fixation of carbon per unit time per unit area per unit input has led to its classification as a preferred biomass crop highlighted by its designation as an advanced biofuel by the U.S. Department of Energy. Due to its extensive genetic diversity and worldwide colonization, sorghum has considerable diversity for a range of phenotypes influencing productivity, composition, and sink/source dynamics. To dissect the genetic basis of these key traits, we present a sorghum carbon-partitioning nested association mapping (NAM) population generated by crossing 11 diverse founder lines with Grassl as the single recurrent female. By exploiting existing variation among cellulosic, forage, sweet, and grain sorghum carbon partitioning regimes, the sorghum carbon-partitioning NAM population will allow the identification of important biomass-associated traits, elucidate the genetic architecture underlying carbon partitioning and improve our understanding of the genetic determinants affecting unique phenotypes within Poaceae. We contrast this NAM population with an existing grain population generated using Tx430 as the recurrent female. Genotypic data are assessed for quality by examining variant density, nucleotide diversity, linkage decay, and are validated using pericarp and testa phenotypes to map known genes affecting these phenotypes. We release the 11-family NAM population along with corresponding genomic data for use in genetic, genomic, and agronomic studies with a focus on carbon-partitioning regimes.

multiparental populations↗

TransFit: Finite element analysis data fitting software

The Advanced X-Ray Astrophysics Facility (AXAF) mission support team has made extensive use of geometric ray tracing to analyze the performance of AXAF developmental and flight optics. One important aspect of this performance modeling is the incorporation of finite element analysis (FEA) data into the surface deformations of the optical elements. TransFit is software designed for the fitting of FEA data of Wolter I optical surface distortions with a continuous surface description which can then be used by SAO's analytic ray tracing software, currently OSAC (Optical Surface Analysis Code). The improved capabilities of Transfit over previous methods include bicubic spline fitting of FEA data to accommodate higher spatial frequency distortions, fitted data visualization for assessing the quality of fit, the ability to accommodate input data from three FEA codes plus other standard formats, and options for alignment of the model coordinate system with the ray trace coordinate system. TransFit uses the AnswerGarden graphical user interface (GUI) to edit input parameters and then access routines written in PV-WAVE, C, and FORTRAN to allow the user to interactively create, evaluate, and modify the fit. The topics covered include an introduction to TransFit: requirements, designs philosophy, and implementation; design specifics: modules, parameters, fitting algorithms, and data displays; a procedural example; verification of performance; future work; and appendices on online help and ray trace results of the verification section.

Freeman, Mark↗

Data Fusion With Uncertainty Quantification for Sub-City-Scale Air Quality Assessment and Forecasting

Many information sources can support air quality assessment and forecasting, including atmospheric chemistry model outputs, satellite retrievals of column chemical and aerosol constituents, and surface-based air quality monitoring data from both regulatory and low-cost instruments. Systematic integration of these data sources provides a major opportunity to improve understanding and management of air quality, but also presents technical barriers, especially in resource- and data-constrained settings in the Global South. This presentation describes a data fusion system, currently under development using the Google Earth Engine platform, which aims to integrate the information sources listed above to support comprehensive sub-city-scale assessment and management of air quality. Furthermore, the data fusion framework includes provisions for the quantification of uncertainties in the resulting fused estimates based on the variability of and among the input data sources. These capabilities will allow air quality managers to better understand their local air quality situation, including relative confidence in the fused estimates for different constituents, locations, and times, leading to better informed air quality management decisions. This presentation covers the underlying methodology of the data fusion and uncertainty quantification approaches, provides an update on the status of its implementation, and presents early qualitative and quantitative results.

Carl Malings↗

Pretest Computational Assessment of Boundary Layer Transition in the NASA Juncture Flow Model with an NACA 0015-Based Wing

The first two phases of the NASA Juncture Flow experiment were carried out on a DLR-F6 swept-wing model and were designed to provide “CFD validation-quality” data toward the assessment and improvement of existing CFD turbulence models in predicting onset and extent of three-dimensional separated flow near the wing-juncture trailing-edge region. The next phase of experiments will involve an NACA 0015-based swept wing, as prior risk reduction experiments had indicated that this wing shape resulted in reduced separation near the juncture region than the DLR-F6 wing, thus providing a better option to evaluate the ability of CFD models to predict incipient turbulent separation. The NACA 0015 measurements will also include IR thermography to infer the variation of transition front with respect to an increasing angle of attack. The primary objective of this work is to computationally make a preliminary assessment of the transition front on both surfaces of the NACA 0015 wing at a crank-chord-based Reynolds number of 2.4 x 106 for four different angles of attack, (0°, 2.5°, 5°, and 7.5°) and to determine the dominant mechanisms responsible for transition. This assessment includes both RANS-based transition models from NASA’s OVERFLOW 2.3b flow solver and linear parabolized stability equations (PSE) stability analysis based on the Langley Stability and Transition Analysis code, LASTRAC. Linear PSE results indicate that the upper surface of the wing is dominated by Tollmien- Schlichting (TS) instabilities, and that the laminar flow region shrinks from about 50% chord to a very small region just downstream of the attachment line as the angle of attack is increased from 0° to 7.5°. Consequently, the transition fronts predicted by the Spalart- Allmaras-based amplification factor transport (AFT-2017b) equation model (which accounts for the TS instabilities alone) and the Menter’s shear-stress transport equation (SST2003)- based Langtry-Menter transition model with ability to account for both TS and crossflow effects (LM2015) compare well with those predicted using linear PSE. On the lower surface of the wing, stationary crossflow (CF) instabilities begin to appear on the inboard portion of the wing in addition to the TS-instabilities for the larger angles of attack (5° and 7.5°), further reducing the laminar flow extent within the inboard region. The LM2015 model that accounts for CF effects is able to replicate this trend but appears to predict a slightly earlier transition. The outcome of this effort will inform the experiment and, when the actual experimental data become available, provide further opportunity to assess and improve the various transition models.

CFD modeling↗

Pretest Computational Assessment of Boundary Layer Transition in the NASA Juncture Flow Model with an NACA 0015-Based Wing

The first two phases of the NASA Juncture Flow experiment were carried out on a DLR-F6 swept-wing model and were designed to provide “CFD validation-quality” data toward the assessment and improvement of existing CFD turbulence models in predicting onset and extent of three-dimensional separated flow near the wing-juncture trailing-edge region. The next phase of experiments will involve an NACA 0015-based swept wing, as prior risk reduction experiments had indicated that this wing shape resulted in reduced separation near the juncture region than the DLR-F6 wing, thus providing a better option to evaluate the ability of CFD models to predict incipient turbulent separation. The NACA 0015 measurements will also include IR thermography to infer the variation of transition front with respect to an increasing angle of attack. The primary objective of this work is to computationally make a preliminary assessment of the transition front on both surfaces of the NACA 0015 wing at a crank-chord-based Reynolds number of 2.4 x 106 for four different angles of attack, (0°, 2.5°, 5°, and 7.5°) and to determine the dominant mechanisms responsible for transition. This assessment includes both RANS-based transition models from NASA’s OVERFLOW 2.3b flow solver and linear parabolized stability equations (PSE) stability analysis based on the Langley Stability and Transition Analysis code, LASTRAC. Linear PSE results indicate that the upper surface of the wing is dominated by Tollmien- Schlichting (TS) instabilities, and that the laminar flow region shrinks from about 50% chord to a very small region just downstream of the attachment line as the angle of attack is increased from 0° to 7.5°. Consequently, the transition fronts predicted by the Spalart- Allmaras-based amplification factor transport (AFT-2017b) equation model (which accounts for the TS instabilities alone) and the Menter’s shear-stress transport equation (SST2003)- based Langtry-Menter transition model with ability to account for both TS and crossflow effects (LM2015) compare well with those predicted using linear PSE. On the lower surface of the wing, stationary crossflow (CF) instabilities begin to appear on the inboard portion of the wing in addition to the TS-instabilities for the larger angles of attack (5° and 7.5°), further reducing the laminar flow extent within the inboard region. The LM2015 model that accounts for CF effects is able to replicate this trend but appears to predict a slightly earlier transition. The outcome of this effort will inform the experiment and, when the actual experimental data become available, provide further opportunity to assess and improve the various transition models.

CFD modeling↗

Southeast Regional CO 2 Utilization and Storage Acceleration Partnership (SECARB-USA): Data Quality Methodology (4.2.1)

SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects. All of the data needs to evaluate a site are somewhat interconnected. We used criterion (2) above to determine if the data collection design would have to be modified to meet the need; if this was commonly true a linkage was shown. The application of this cross index to sites in the subsequent tasks will demonstrate that the demand for data types varies site-to-site and project-to-project. Examples of factors to be considered are the complexity of the geology, the injection goals such as rate and duration of the injection, and the types of risk and risk tolerance of key stakeholders. In future tasks the team will compare the demand for data with existing data availability. This will, in turn, determine when data needs to be acquired to support project development. For example, in a project area with complex structure, 3-D seismic data may be needed earlier and more urgently than in an area with simple rock body geometries. In some locations, a 3-D seismic survey has already been collected and can be purchased. In other locations the project developer will need to collect these data. For another example, a project near an urban area or near to a park may generate earlier and more substantive public concern than a site that is developed in mined lands. A calculation using the derivative from table 1 will show the different investment needs. Project cost will vary corresponding to data criticality and data availability.

42 ENGINEERING↗

Assessment of the quality of Gate area rainfall data from a Nimbus-5 radiometer

The quality of rainfall intensity estimates derived from passive microwave measurements by the electrically scanned microwave radiometer (ESMR-5) aboard the Nimbus 5 satellite are evaluated. The microwave measurements used are those coincident with the global atmospheric research program Atlantic tropical experiment (GATE). The ESMR 5 derived rainfall intensity estimates are compared with hourly averaged GATE radar rainfall measurements. It is determined from the transfer curves derived using the radar measurements as ground truth, that the ESMR 5 derived data consistently over estimates rainfall by a factor of approximately 1.4.

Knox, N.↗

Assessment of the quality of GATE area rainfall data from a Nimbus-5 radiometer

The quality of rainfall intensity estimates derived from passive microwave measurements by the Electrically Scanned Microwave Radiometer (ESMR-5) aboard the NIMBUS-5 satellite was evaluated. The microwave measurements used are those coincident with the GARP (Global Atmospheric Research Program) Atlantic Tropical Experiment (GATE). ESMR-5 derived rainfall intensity estimates are compared with hourly averaged GATE radar rainfall measurements. Using the radar measurements as ground truth it is determined that with the transfer curve derived herein the ratio (ESMR-5 derived rain rate)/radar measured rain rate has a mean of approximately 0.62.

Knox, N.↗

Comparative assessment of LANDSAT-4 MSS and TM data quality for mapping applications in the southeast

The initial objectives of analyses of the MSS data are two-fold: (1) to evaluate the geodetic accuracy of CCT-P data of the test sites; and (2) to improve the geodetic accuracy by additional processing if the original data either do not meet pre-launch specifications or mapping requirements. The location of 45 ground control points (GCP) digitized from 35 U.S. Geological Survey 1:24,000 scale quadrangles (UTM coordinates) were identified in terms of pixel and scan line values. These 46 points are used to establish UTM position error vector distributions in the scene. As an initial check on the geometric reliability of the MSS data, 28 well-distributed GCPs were input to a program which compares the scaled image distances between all possible point pairs with the corresponding map distances and computes the distance differences; that is, the relative positional errors. The relative errors obtained from initial computations averaged about +/- 200 m. These errors could result from a number of sources, including misidentification of GCP locations, UTM coordinate errors introduced by the map digitizing process or errors resulting from data acquisition and geometric processing.

Welch, R.↗

Use of Thematic Mapper for water quality assessment

The evaluation of simulated TM data obtained on an ER-2 aircraft at twenty-five predesignated sample sites for mapping water quality factors such as conductivity, pH, suspended solids, turbidity, temperature, and depth, is discussed. Using a multiple regression for the seven TM bands, an equation is developed for the suspended solids. TM bands 1, 2, 3, 4, and 6 are used with logarithm conductivity in a multiple regression. The assessment of regression equations for a high coefficient of determination (R-squared) and statistical significance is considered. Confidence intervals about the mean regression point are calculated in order to assess the robustness of the regressions used for mapping conductivity, turbidity, and suspended solids, and by regressing random subsamples of sites and comparing the resultant range of R-squared, cross validation is conducted.

Horn, E. M.↗