Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Spatial Growth Modeling and High Resolution Remote Sensing Data Coupled with Air Quality Modeling to Assess the Impact of Atlanta, Georgia on the Local and Regional Environment

The growth of cities, both in population and areal extent, appears as an inexorable process. Urbanization continues at a rapid rate, and it is estimated that by the year 2025, 60 percent of the world s population will live in cities. Urban expansion has profound impacts on a host of biophysical, environmental, and atmospheric processes within an urban ecosystems perspective. A reduction in air quality over cities is a major result of these impacts. Because of its complexity, the urban landscape is not adequately captured in air quality models such as the Community Multiscale Air Quality (CMAQ) model that is used to assess whether urban areas are in attainment of EPA air quality standards, primarily for ground level ozone. This inadequacy of the CMAQ model to sufficiently respond to the heterogeneous nature of the urban landscape can impact how well the model predicts ozone levels over metropolitan areas and ultimately, whether cities exceed EPA ozone air quality standards. We are exploring the utility of high-resolution remote sensing data and urban spatial growth modeling (SGM) projections as improved inputs to a meteorological/air quality modeling system focusing on the Atlanta, Georgia metropolitan area as a case study. These growth projections include business as usual and smart growth scenarios out to 2030. The growth projections illustrate the effects of employing urban heat island mitigation strategies, such as increasing tree canopy and albedo across the Atlanta metro area, which in turn, are used to model how air temperature can potentially be moderated as impacts on elevating ground-level ozone, as opposed to not utilizing heat island mitigation strategies. The National Land Cover Dataset at 30m resolution is being used as the land use/land cover input and aggregated to the 4km scale for the MM5 mesoscale meteorological model and the CMAQ modeling schemes. Use of these data has been found to better characterize low density/suburban development as compared with USGS lkm land use/land cover data that have traditionally been used in modeling. Air quality prediction for future scenarios to 2030 is being facilitated by land use projections using a spatial growth model. Land use projections were developed using the 2030 Regional Transportation Plan developed by the Atlanta Regional Commission, the regional planning agency for the area. This allows the Georgia Environmental Protection Division to evaluate how these transportation plans will affect future air quality. The coupled SGM and air quality modeling approach provides insight on what the impacts of Atlanta s growth will be on the local and regional environment and exists as a mechanism that can be used by policy makers to make rational decisions on urban growth and sustainability for the metropolitan area in the future.

Quattrochi, Dale A.↗

Quantitative Microstructure Characterization of a NMC Electrode

Performance of lithium-ion batteries (LIBs) is strongly influenced by the porous microstructure of their electrodes. In this work, 3D microstructures of calendared and un-calendared positive electrode LiNi1/3Mn1/3Co1/3O2 (NMC) have been investigated in order to extract relevant properties useful for battery modeling. Transport (volume fraction, connectivity, particle size and tortuosity) and electrochemical (specific surface area) properties have been calculated for the pore and the active material. Special attention has been paid to determine the size of the so-called representative volume element (RVE) required to be statistically representative of the heterogeneous medium. Several parameters have been calculated using a panel of different numerical methods in order to compare their results. Besides, the image level of detail has been evaluated (using original criteria based upon edge detection) to assess the overall data quality available for the study.

30 DIRECT ENERGY CONVERSION↗

An assessment of remote sensor imagery in the determination of housing quality data

Selected census tracts in the metropolitan Washington area were examined using varying scales of aerial photography. Observable characteristics of housing and neighborhoods were assessed to determine feasibility of providing data on housing stock and quality and neighborhood condition from the imagery. Small scale imagery is shown to be of relatively marginal value in providing much of the data in the detail required, but can be useful for general survey purposes.

Mallon, H. J.↗

Photonuclear Reaction Types Map to ENDF Reaction Type Numbers MT

In the ENDF format, photonuclear cross secCons are stored in File = 3 under the NSUB = 0 sub-library. The type of reacCon data and the products resulCng from that reacCon are idenCfied by an integer number from 1 to 999, called MT number. However, the ENDF manual is wriPen with a strong focus on neutron induced reacCons and the meaning of MT numbers in the context of photonuclear reacCons can be at Cmes confusing and the assessment of evaluated photonuclear data may require summing various MT numbers to obtain the desired cross secCons to compare with experimental data. An important step in assessing the quality of evaluated data for photonuclear cross secCons is therefore to clarify the mapping between MT numbers and the nomenclature used to describe photonuclear reacCons in the literature. The intent of this document is to provide such a map.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessment of SAGE Version 6.1 Ozone Data Quality

The SAGE-II V6.1 ozone retrievals are shown to be of better precision at all levels and to be much more accurate than previous retrievals in the lower stratosphere below 20 km altitude. A filtering procedure for removing anomalous ozone profiles associated with volcanic aerosol/cloud effects and other identified artifacts in V6.1 ozone is described. The agreement between SAGE and ozonesondes in the mean is shown to be approximately 10% down to the tropopause. Relative to the sondes SAGE tends to slightly overestimate ozone (less than 5%) between 15 and 20 km altitude, and systematically underestimates ozone in the troposphere by approximately 30% in the regions between 8 km altitude and 2 km below the tropopause. The precisions (random errors) of SAGE ozone retrievals above 25 km altitude are estimated to be 4% or better; they are a factor of ten worse below 16 km altitude. Linear trends in the differences between coincident SAGE and ozonesondes measurement are generally less than 0.3 %/year and not significantly different from zero in 95% confidence intervals. Compared to V5.96 retrievals, ozone trend differences between 20 and 50 km altitude are approximately 0. 1 %/year, below 20 km altitude the SAGE II trends are more positive by approximately 0.2 %/year. For the 1984-1999 period the SAGE-II shows a localized ozone loss of -0.4(+/- 0.25) %/year (2gigma) in the tropics at 20 km altitude. In the lower stratosphere between 16 and 22 km altitudes, the SAGE shows significant ozone losses in the mid-latitudes in both Hemispheres during the 1979-1999 periods. The ozone trends range from -0.24(+/- 0.18) to -0.77(+/- 0.46) (2sigma)%/year. However in the 1984-1999 period, the downward trends are smaller (-0.07 to - 0.25 %/year) in this altitude range, and the trends in the integrated column from 12 to 17 km altitude in mid-latitudes (35 deg - 60 deg) are not significantly different from zero (0.1 +?- 0.6 (2sigma)%/year). Averaged over the tropics (20 deg S to 20 deg N) the ozone column above 15 km altitude exhibit a trend of -0.12 +/- 0.08 (2sigma)%/year.

Wang, Hsiang J.↗

Commercial Smallsat Data Acquisition Program On-ramp #2 Airbus U.S. Synthetic Aperture Radar (SAR) Evaluation Report

In 2017, NASA’s Earth Science Division (ESD) launched the Private-Sector Small Constellation Satellite Data Product Pilot, now referred to as the Commercial Smallsat Data Acquisition (CSDA) program. The objective of CSDA is to identify, evaluate, and acquire commercial remote sensing data that support NASA’s Earth science research and application activities. The Pilot successfully concluded in early 2020, when CSDA transitioned into a sustained program with on-ramping opportunities for new vendors as the industry emerges with new candidates and capabilities. In October 2019, a Request for Information (RFI) seeking capability statements from parties interested in providing data from spaceborne platforms was released for the CSDA on-ramp #2 evaluations. To be responsive to the RFI, the commercial satellite constellations had to consist of three or more operating spacecraft actively collecting data in a non-geostationary orbit with full latitudinal coverage and be U.S. companies. Two vendors responded to the RFI and were evaluated by a committee composed of NASA ESD leadership, program managers, and scientists. Both vendors satisfied the RFI requirements and were asked to respond to a Request for Proposal (RFP). After review of the proposals, NASA entered into a Blanket Purchase Agreement (BPA) with Airbus Defense and Space GEO, Inc. (Airbus) U.S. in September 2021 and with BlackSky Geospatial Solutions, Inc. (BlackSky) in November 2021. In this report, CSDA provides an evaluation of the usefulness of data provided by the Airbus U.S. Synthetic Aperture Radar (SAR) satellite constellation, consisting of TerraSAR-X (launched in 2007), TanDEM-X (launched in 2010), and PAZ (launched in 2018), for advancing NASA’s Earth system science research and applications. The evaluation of the BlackSky commercial data will be provided in a separate report. To conduct the Airbus evaluation, NASA’s ESD augmented 13 existing research projects that could potentially benefit from, and had the expertise to evaluate, the commercial data being considered for longer-term purchase. Investigators from NASA’s Research and Analysis Program science focus areas and from NASA’s Applied Sciences Program elements participated in the evaluation. A summary of the research areas evaluated by the Principal Investigator (PI) teams is presented in Figure 3. CSDA also funded a dedicated activity to evaluate the satellite data quality (calibration and geolocation) independently by assessing the accuracy of data from Airbus. Evaluation activities were carried out by the selected PIs from December 7, 2022, to December 7, 2023. Delivery of datasets requested by the researchers began in January 2023. The vendors were evaluated on the accessibility of data, accuracy and completeness of metadata, and promptness and quality of user support services. Datasets purchased during the evaluation have been archived by NASA and will be made available to current and future government-funded researchers in accordance with the End User License Agreement (EULA). This synthesis report distills and integrates the findings of research reports commissioned by NASA for the Airbus evaluation. This report also includes recommendations that inform the way ahead for the program. The scientific results from the evaluations demonstrated that the commercial data from Airbus were able to advance NASA research and applications. However, the PIs encountered limitations that diminished the usefulness of the data due to the amount of effort that was required to access, preprocess, and analyze these data. One significant issue encountered was the limited spatial and temporal coverage of the data in the Airbus archive that could be used to conduct time series analyses or assessments over large spatial scales. Overall, however, the utility and the quality of the evaluated data outweighed the difficulties encountered, and NASA has concluded that the Airbus SAR data would complement NASA’s existing Earth observation capabilities and Airbus U.S. would qualify to participate in the sustained phase of the program.

Batuhan Osmanoglu↗

SU-E-I-71: Quality Assessment of Surrogate Metrics in Multi-Atlas-Based Image Segmentation

Purpose: With the ever-growing data of heterogeneous quality, relevance assessment of atlases becomes increasingly critical for multi-atlas-based image segmentation. However, there is no universally recognized best relevance metric and even a standard to compare amongst candidates remains elusive. This study, for the first time, designs a quantification to assess relevance metrics’ quality, based on a novel perspective of the metric as surrogate for inferring the inaccessible oracle geometric agreement. Methods: We first develop an inference model to relate surrogate metrics in image space to the underlying oracle relevance metric in segmentation label space, with a monotonically non-decreasing function subject to random perturbations. Subsequently, we investigate model parameters to reveal key contributing factors to surrogates’ ability in prognosticating the oracle relevance value, for the specific task of atlas selection. Finally, we design an effective contract-to-noise ratio (eCNR) to quantify surrogates’ quality based on insights from these analyses and empirical observations. Results: The inference model was specialized to a linear function with normally distributed perturbations, with surrogate metric exemplified by several widely-used image similarity metrics, i.e., MSD/NCC/(N)MI. Surrogates’ behaviors in selecting the most relevant atlases were assessed under varying eCNR, showing that surrogates with high eCNR dominated those with low eCNR in retaining the most relevant atlases. In an end-to-end validation, NCC/(N)MI with eCNR of 0.12 compared to MSD with eCNR of 0.10 resulted in statistically better segmentation with mean DSC of about 0.85 and the first and third quartiles of (0.83, 0.89), compared to MSD with mean DSC of 0.84 and the first and third quartiles of (0.81, 0.89). Conclusion: The designed eCNR is capable of characterizing surrogate metrics’ quality in prognosticating the oracle relevance value. It has been demonstrated to be correlated with the performance of relevant atlas selection and ultimate label fusion.

60 APPLIED LIFE SCIENCES↗

Investigating the Use of Machine Learning (ML) to Assess Tropospheric Doppler Radar Wind Profiler (TDRWP) Data Quality

Manual Quality Control (MQC) of Tropospheric Doppler Radar Wind Profiler (TDRWP) data is essential for defining an accurate climatology for downstream aerospace vehicle assessments. MQC traditionally takes around 30.5 hours per year of radar data. The Marshall Space Flight Center Natural Environments Branch (MSFC NE) used machine learning (ML) to test the feasibility of automating the MQC process, showing a potential to reduce labor by 300%. However, analysis of the model showed some false positives. We compared a neural network to the model to validate it and develop a process for assessing comparable solutions in the future.

Corey Walker↗

Incomplete tumor capsule on preoperative imaging reveals microvascular invasion in hepatocellular carcinoma: a systematic review and meta-analysis

Purpose: Microvascular invasion (MVI), which is difficult to diagnose before surgery, is a major factor affecting postoperative recurrence in patients with hepatocellular carcinoma (HCC). The relationship between the radiological tumor capsule and MVI is controversial. This study aimed to evaluate the association between the tumor capsule and MVI. Methods: We searched Medline (by PubMed) and Embase (by OvidSP). Two review authors independently screened titles and abstracts, selected studies about MVI prediction with radiologic tumor capsule and studies with enough data for extracted, assessed the methodological quality and collected data. Summary results were presented as the diagnostic odds ratio (DOR), sensitivity, specificity, and 95% confidence interval. Results: Fifteen studies with 2038 patients were included; fourteen studies, including 1331 patients, with no significant heterogeneity indicated no relationship between absent tumor capsule and MVI [DOR = 0.90 (0.64, 1.26)]. Six studies, including 541 patients, with no significant heterogeneity showed incomplete capsule could be used to predict MVI of HCC preoperatively [DOR = 1.85 (1.13, 3.04)]. The overall sensitivity and specificity estimate were 0.50 (0.37, 0.64) and 0.64 (0.53, 0.74), respectively. Eight studies, including 1349 patients, with highly significant heterogeneity revealed that complete capsule could be a protective factor for MVI [DOR = 1.97 (1.01, 3.86)]. Conclusions: For MVI of HCC, incomplete tumor capsule is a risk factor, while a complete tumor capsule might be a protective factor. However, absent capsule doesn’t show significant relationship with MVI. This might be due to combination of the risk and protective effects of present capsule in MVI.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers, and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Carl Malings↗

Flexible Data Fusion for Air Quality Estimation and Forecasting in Google Earth Engine to support Global Health Management Needs

The assessment and forecasting of air quality around the world at high spatial and temporal resolution can be enhanced by integrating data from multiple sources including models, satellites, regulatory monitors, and low-cost sensors. Such integration is subject to numerous technical challenges, however, including heterogeneous data resolution and formatting, different levels of data availability and reliability, and computational and capacity challenges to developing data fusion tools and platforms. This presentation will provide an overview of a NASA-funded effort to develop a data fusion system within the Google Earth Engine platform which integrates these air quality data sources to produce comprehensive assessments and forecasts of key air pollutants at sub-daily and sub-city scales. The system is being developed in collaboration with city- and regional-level air quality managers and will provide them with information to the assess and anticipate the health impacts of poor air quality, track local changes in air quality due to ongoing transportation and land use changes, and identify potential gaps in their current air quality monitoring strategies. The presentation will report advances achieved through the project, including bringing local air quality monitoring data into Google Earth Engine, quantifying uncertainties in air quality estimates and forecasts, and tailored communications tools providing integration into end-user processes to meet their needs.

Nathan R. Pavlovic↗

Assessing the Hydrologic Performance of the EPA's Nonpoint Source Water Quality Assessment Decision Support Tool Using North American Land Data Assimilation System (Products)

The accuracy of streamflow predictions in the EPA's BASINS (Better Assessment Science Integrating Point and Nonpoint Sources) decision support tool is affected by the sparse meteorological data contained in BASINS. The North American Land Data Assimilation System (NLDAS) data with high spatial and temporal resolutions provide an alternative to the NOAA National Climatic Data Center (NCDC)'s station data. This study assessed the improvement of streamflow prediction of the Hydrological Simulation Program-FORTRAN (HSPF) model contained within BASINS using the NLDAS 118 degree hourly precipitation and evapotranspiration estimates in seven watersheds of the Chesapeake Bay region. Our results demonstrated consistent improvements of daily streamflow predictions in five of the seven watersheds when NLDAS precipitation and evapotranspiration data was incorporated into BASINS. The improvement of using the NLDAS data is significant when watershed's meteorological station is either far away or not in a similar climatic region. When the station is nearby, using the NLDAS data produces similar results. The correlation coefficients of the analyses using the NLDAS data were greater than 0.8, the Nash-Sutcliffe (NS) model fit efficiency greater than 0.6, and the error in the water balance was less than 5%. Our analyses also showed that the streamflow improvements were mainly contributed by the NLDAS's precipitation data and that the improvement from using NLDAS's evapotranspiration data was not significant; partially due to the constraints of current BASINS-HSPF settings. However, NLDAS's evapotranspiration data did improve the baseflow prediction. This study demonstrates the NLDAS data has the potential to improve stream flow predictions, thus aid the water quality assessment in the EPA nonpoint water quality assessment decision tool.

Lee, S.↗

Polar microwave brightness temperatures from Nimbus-7 SMMR: Time series of daily and monthly maps from 1978 to 1987

A time series of daily brightness temperature gridded maps (October 25, 1978 through August 15, 1987) were generated from all ten channels of the Nimbus-7 Scanning Multichannel Microwave Radiometer orbital data. This unique data set can be utilized in a wide range of applications including heat flux, ocean circulation, ice edge productivity, and climate studies. Two sets of data in polar stereographic format are created for the Arctic region: one with a grid size of about 30 km on a 293 by 293 array similar to that previously utilized for the Nimbus-5 Electrically Scanning Microwave Radiometer, while the other has a grid size of about 25 km on a 448 by 304 array identical to what is now being used for the DMSP Scanning Multichannel Microwave Imager. Data generated for the Antaractic region are mapped using the 293 by 293 grid only. The general technique for mapping, and a quality assessment of the data set are presented. Monthly and yearly averages are also generated from the daily data and sample geophysical ice images and products derived from the data are given. Contour plots of monthly ice concentrations derived from the data for October 1978 through August 1987 are presented to demonstrate spatial and temporal detail which this data set can offer, and to show potential research applications.

Comiso, Josefino C.↗

A general-purpose method for Pareto optimal placement of flow rate and concentration sensors in networked systems – With application to wastewater treatment plants

The advent of affordable computing, low-cost sensor hardware, and high-speed and reliable communications have spurred installation of ubiquitous sensors in complex engineered systems. However, ensuring reliable data quality remains a challenge. Exploitation of redundancy among sensor signals can help improving the precision of measured variables, detecting the presence of gross errors, and identifying faulty sensors. The cost of sensor ownership, maintenance efforts in particular, can still be cost-prohibitive however. Maximizing the ability to assess and control data quality while minimizing the cost of ownership thus requires a careful sensor placement. To solve this challenge, in this work we develop a generally applicable method to solve the multi-objective sensor placement problem in systems governed by linear and bilinear balance equations. Importantly, the method computes all Pareto-optimal sensor layouts with conventional computational resources and requires no information about the expected sensor quality.

42 ENGINEERING↗

RS-88 Pad Abort Demonstrator Thrust Chamber Assembly Testing at NASA Marshall Space Flight Center

This paper documents the effort conducted to collect hot-tire dynamic and acoustics environments data during 50,000-lb thrust lox-ethanol hot-fire rocket testing at NASA Marshall Space Flight Center (MSFC) in November-December 2003. This test program was conducted during development testing of the Boeing Rocketdyne RS-88 development engine thrust chamber assembly (TCA) in support of the Orbital Space Plane (OSP) Crew Escape System Propulsion (CESP) Program Pad Abort Demonstrator (PAD). In addition to numerous internal TCA and nozzle measurements, induced acoustics environments data were also collected. Provided here is an overview of test parameters, a discussion of the measurements, test facility systems and test operations, and a quality assessment of the data collected during this test program.

Farr, Rebecca A.↗

SECARB-USA: Data Quality Methodology

SECARB-USA Deliverable 4.2.1 utilizes the outputs from the Needs Assessment (Subtask 2.1) to develop a data quality methodology. Many types of data are needed to evaluate a site for technical and financial viability. Several inventories of data types have been produced (for example NETL, 2010). The objective here is to organize the data types so that the needs met are specified. From this cross index (Table 1 in the Appendix), it will be possible in future tasks to (1) determine, on a site-specific basis, how much of each data type is required at each stage of a project to meet the need, and conversely (2) to further specify and define the data collection methods applied such that the data are tailored to fit that need. Derivative tables can then be developed to semi-quantitively evaluate the extent to which need is critical for early go/no-go decision points, or if it is more important than average, requiring faster or larger capitalization and spend to meet the need. In an additional step, the current availability of data for a site can be semi-quantitively assessed. From the table of data criticality and the table of data availability, site-specific cost for meeting the data needs can be determined, and allow a pre-permit spend estimated for a portfolio of projects.

54 ENVIRONMENTAL SCIENCES↗

A framework for assessment of predictive capability maturity and its application in nuclear thermal hydraulics

Here this work presents a formalized and computerized framework for the assessment of decision regarding the adequacy of a simulation tool for a nuclear reactor application. The decision regarding a code’s adequacy for an application is dependent on the assessment of different attributes that govern verification, validation, and uncertainty quantification of the code. In this work, the focus is on code validation. Therefore, the framework is developed and illustrated from the perspective of decision regarding the validation assessment of a code. Code validation assessment is performed based on the validation test results, data applicability, and process quality assurance factors. The process quality assurance factors warrant the trustworthiness of the evidence and help in checking people and process compliance with respect to the standard requirements. The proposed framework is developed using an argument modeling technique called Goal Structuring Notation (GSN). Goal structuring notation facilitates structural knowledge representation, information abstraction, evidence incorporation, and provides a skeletal structure for quantitative maturity assessment. The decision schema for the development of the decision model is based on the Predictive Capability Maturity Model (PCMM) and Analytic Hierarchy Process (AHP) and formalized using Goal structuring notation. Each decision attribute is formulated as a claim, where the degree of validity of the claim (attribute’s assessment) is expressed using different maturity levels. The GSN representation of the decision model is transformed into a confidence network to provide evidence-based quantitative maturity assessment using the Bayesian network. A metric based on the expected utility of maturity levels, called expected distance metric, is proposed to measure the distance between target maturity and achieved maturity on a scale of zero to one. Expected distance metric helps in comparing the assessment of different attributes and identification of major areas of concern in terms of modeling capability, data needs, and quality of assessment process. The practical application of the framework is demonstrated by a case study on validation assessment of a thermal-hydraulic code for a challenge problem called Departure from Nucleate Boiling (DNB).

42 ENGINEERING↗