Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Evaluation of normalization strategies for mass spectrometry-based multi-omics datasets

Introduction Data normalization is crucial for multi-omics integration, reducing systematic errors and maximizing the likelihood of discovering true biological variation. Most studies assess normalization for a single omics type or use datasets from separate experiments. Few address time-course data, where normalization might bias temporal differentiation. In this study, we compared common normalization methods and a machine learning approach, Systematical Error Removal using Random Forest (SERRF), using multi-omics datasets generated from the same experiment—even from the same cell lysate. Objectives To develop a straightforward process to assess normalization effects and identify the most robust methods across multi-omics datasets. Methods We analyzed metabolomics, lipidomics, and proteomics datasets from primary human cardiomyocytes and motor neurons exposed to acetylcholine-active compounds over time. Normalization effectiveness was evaluated based on improvement in QC features consistency and observing the change in treatment and time-related variance. Results Probabilistic Quotient Normalization (PQN) and Locally Estimated Scatterplot Smoothing (LOESS) QC were identified as optimal for metabolomics and lipidomics, while PQN, Median, and LOESS normalization excelled for proteomics. These methods consistently enhanced QC feature consistency in metabolomics and lipidomics, and preserved time-related variance or treatment-related variance in proteomics, demonstrating their effectiveness and robustness. SERRF normalization, applied only to metabolomics in this study, outperformed other methods in some datasets but inadvertently masked treatment-related variance in others. Conclusion Our evaluation identified PQN and LoessQC as the top methods for metabolomics and lipidomics, and PQN, Median, and Loess normalization for proteomics, in multi-omics integration in a temporal study.

60 APPLIED LIFE SCIENCES↗

Groundwater Recharge Estimated by Land Surface Models: An Evaluation in the Conterminous U.S.

Estimating diffuse recharge of precipitation is fundamental to assessing groundwater sustainability. Diffuse recharge is also the process through which climate and climate change directly affect groundwater. In this study, we evaluated diffuse recharge over the conterminous U.S. simulated by a suite of land surface models (LSMs) that were forced using a common set of meteorological input data. Simulated annual recharge exhibited spatial patterns that were similar among the LSMs, with the highest values in the eastern U.S. and Pacific Northwest. However, the magnitudes of annual recharge varied significantly among the models and were associated with differences in simulated ET, runoff and snow. Evaluation against two independent datasets did not answer the question of whether the ensemble mean performs the best, due to inconsistency between those datasets. The amplitude and timing of seasonal maximum recharge differed among the models, influenced strongly by model physics governing deep soil moisture drainage rates and, in cold regions, snowmelt. Evaluation using in situ soil moisture observations suggested that true recharge peaks 1-3 months later than simulated recharge, indicating systematic biases in simulating deep soil moisture. However, recharge from lateral flows and through preferential flows cannot be inferred from soil moisture data, and the seasonal cycle of simulated groundwater storage actually compared well with in situ groundwater observations. Long-term trends in recharge were not consistently correlated with either precipitation trends or temperature trends. This study highlights the need to employ dynamic flow models in LSMs, among other improvements, to enable more accurate simulation of recharge.

snowmelt↗

Aerosol indirect effects – general circulation model intercomparison and evaluation with satellite data

Aerosol indirect effects continue to constitute one of the most important uncertainties for anthropogenic climate perturbations. Within the international AEROCOM initiative, the representation of aerosol-cloud-radiation interactions in ten different general circulation models (GCMs) is evaluated in the present study using three satellite datasets. The satellite datasets are taken as reference bearing in mind that cloud and aerosol retrievals include uncertainties. We compute statistical relationships between aerosol optical depth (τa) and various cloud and radiation quantities consistently in models and satellite data. It is found that the model-simulated influence of aerosols on cloud droplet number concentration (Nd) compares relatively well to the satellite data at least over oceans. The relationship between τa and liquid water path is simulated much too strongly by the models. It is shown that this is partly related to rep¬resentation of the second aerosol indirect effect in terms of autoconversion. A positive re¬lationship between total cloud fraction (fcld) and τa as found in the satellite data is simulated by the majority of the models, albeit less strongly in most of them. In a discussion of the hypo¬theses proposed in the literature to explain the satellite-derived strong fcld – τa relation¬ship, we find that none is unequivocally confirmed by our results. Relationships similar to the ones found in satellite data between τa and cloud top tem¬perature and outgoing long-wave radiation (OLR) are simulated by only a few GCMs. The GCMs that simulate a negative OLR - τa relationship show a strong positive cor¬relation between τa and cloud fraction. The short-wave total aerosol radiative forcing as simulated by the GCMs is strongly influenced by the simulated anthropogenic fraction of τa, and parameterisation assumptions such as a lower bound on Nd. Nevertheless, the strengths of the statistical relationships are good predictors for the short-wave total aerosol forcings in the models. An estimate of the total short-wave aerosol forcing inferred from the combination of these predictors for the modelled forcings with the satellite-derived statistical relationships yields a global annual mean value of -1.5±0.5 Wm-2. An alternative estim¬ate obtained by scaling the simulated clear- and cloudy-sky forcings with estimates of anthropogenic τa and satellite-retrieved Nd – τa regression slopes, respectively, yields a global annual mean clear-sky (aerosol direct effect) es¬timate of -0.4±0.2 Wm-2 and a cloudy-sky (aerosol indirect effect) estimate of -0.7±0.5 Wm-2, with a total estimate of -1.2±0.4 Wm-2.

54 ENVIRONMENTAL SCIENCES↗

Minutes of the CD-ROM Workshop

The workshop described in this document had two goals: (1) to establish guidelines for the CD-ROM as a tool to distribute datasets; and (2) to evaluate current scientific CD-ROM projects as an archive. Workshop attendees were urged to coordinate with European groups to develop CD-ROM, which is already available at low cost in the U.S., as a distribution medium for astronomical datasets. It was noted that NASA has made the CD Publisher at the National Space Science Data Center (NSSDC) available to the scientific community when the Publisher is not needed for NASA work. NSSDC's goal is to provide the Publisher's user with the hardware and software tools needed to design a user's dataset for distribution. This includes producing a master CD and copies. The prerequisite premastering process is described, as well as guidelines for CD-ROM construction. The production of discs was evaluated. CD-ROM projects, guidelines, and problems of the technology were discussed.

King, Joseph H.↗

The Application of Remotely Sensed Data and Models to Benefit Conservation and Restoration Along the Northern Gulf of Mexico Coast

New data, tools, and capabilities for decision making are significant needs in the northern Gulf of Mexico and other coastal areas. The goal of this project is to support NASA s Earth Science Mission Directorate and its Applied Science Program and the Gulf of Mexico Alliance by producing and providing NASA data and products that will benefit decision making by coastal resource managers and other end users in the Gulf region. Data and research products are being developed to assist coastal resource managers adapt and plan for changing conditions by evaluating how climate changes and urban expansion will impact land cover/land use (LCLU), hydrodynamics, water properties, and shallow water habitats; to identify priority areas for conservation and restoration; and to distribute datasets to end-users and facilitating user interaction with models. The proposed host sites for data products are NOAA s National Coastal Data Development Center Regional Ecosystem Data Management, and Mississippi-Alabama Habitat Database. Tools will be available on the Gulf of Mexico Regional Collaborative website with links to data portals to enable end users to employ models and datasets to develop and evaluate LCLU and climate scenarios of particular interest. These data will benefit the Mobile Bay National Estuary Program in ongoing efforts to protect and restore the Fish River watershed and around Weeks Bay National Estuarine Research Reserve. The usefulness of data products and tools will be demonstrated at an end-user workshop.

Quattrochi, Dale↗

Quantum-assisted associative adversarial network: applying quantum annealing in deep learning

Abstract Generative models have the capacity to model and generate new examples from a dataset and have an increasingly diverse set of applications driven by commercial and academic interest. In this work, we present an algorithm for learning a latent variable generative model via generative adversarial learning where the canonical uniform noise input is replaced by samples from a graphical model. This graphical model is learned by a Boltzmann machine which learns low-dimensional feature representation of data extracted by the discriminator. A quantum processor can be used to sample from the model to train the Boltzmann machine. This novel hybrid quantum-classical algorithm joins a growing family of algorithms that use a quantum processor sampling subroutine in deep learning, and provides a scalable framework to test the advantages of quantum-assisted learning. For the latent space model, fully connected, symmetric bipartite and Chimera graph topologies are compared on a reduced stochastically binarized MNIST dataset, for both classical and quantum sampling methods. The quantum-assisted associative adversarial network successfully learns a generative model of the MNIST dataset for all topologies. Evaluated using the Fréchet inception distance and inception score, the quantum and classical versions of the algorithm are found to have equivalent performance for learning an implicit generative model of the MNIST dataset. Classical sampling is used to demonstrate the algorithm on the LSUN bedrooms dataset, indicating scalability to larger and color datasets. Though the quantum processor used here is a quantum annealer, the algorithm is general enough such that any quantum processor, such as gate model quantum computers, may be substituted as a sampler.

Wilson, Max (ORCID:0000000207983391)↗

Evaluation of Global Monsoon Precipitation Changes based on Five Reanalysis Datasets

With the motivation to identify whether or not a reasonably simulated atmospheric circulation would necessarily lead to a successful reproduction of monsoon precipitation, the performances of five sets of reanalysis data (NCEP2, ERA40, JRA25, ERA-Interim and MERRA) in reproducing the climatology, interannual variation and long-term trend of global monsoon (GM) precipitation are comprehensively evaluated. In order to better understand the variability and long-term trend of GM precipitation, we also examined the major components of water budget, including evaporation, water vapor convergence and the change in local water vapor storage, based on five reanalysis datasets. The results show that all five reanalysis data reasonably reproduce the climatology of GM precipitation. The ERA-Interim (NCEP2) shows the highest (lowest) skill among the five datasets. The observed GM precipitation shows an increasing tendency during 1979-2001 along with a strong interannual variability, which is reasonably reproduced by the five sets of reanalysis data. The observed increasing trend of GM precipitation is dominated by the contribution from the North African, North American and Australian monsoons. All five data fail in reproducing the increasing tendency of North African monsoon precipitation. The wind convergence term in water budget equation dominate the GM precipitation variation, indicating a consistency between the GM precipitation and the seasonal change of prevailing wind.

Climate↗

Evaluation of daily gridded climate products using in situ FLUXNET data and tree growth modeling

Gridded climate data products have facilitated research in climate and ecology by providing meteorological data continuously across large spatial scales. However, the sensitivity of scientific outcomes to dataset choice remains poorly understood, and evaluation using station-based records can favor datasets built heavily on weather stations. Here, we evaluate seven high-resolution daily gridded datasets covering the contiguous United States using independent meteorology from the FLUXNET2015 dataset, with a focus on the implications of dataset choice for process-based tree growth modeling. We find that gridded products tend to capture temperature accurately while consistently overestimating the magnitude and frequency of precipitation and its extremes. Moreover, datasets vary in how they define a ‘day,’ which significantly affects temporal alignment with FLUXNET2015 observations. Despite differences among the datasets, the interannual variability in tree ring simulations is insensitive to dataset choice, likely because daily-scale biases are averaged out through accumulated growth across several months. However, inaccuracies in temperature and precipitation can significantly bias modeled xylem cell production, with systematically higher annual precipitation in the gridded datasets leading to greater xylem production compared to simulations using in situ data. Our results suggest that model applications, especially those that integrate to time scales longer than one day, are likely insensitive to climate dataset choice, but applications that are sensitive to daily climate variations or to absolute climate values need to carefully consider biases in gridded climate products.

54 ENVIRONMENTAL SCIENCES↗

Cone-beam Computed Tomography-guided Stereotactic Liver Punctures: A Phantom Study

Purpose: Images from computed tomography (CT), combined with navigation systems, improve the outcomes of local thermal therapies that are dependent on accurate probe placement. Although the usage of CT is desired, its availability for time-consuming radiological interventions is limited. Alternatively, three-dimensional images from C-arm cone-beam CT (CBCT) can be used. The goal of this study was to evaluate the accuracy of navigated CBCT-guided needle punctures, controlled with CT scans. Methods: Five series of five navigated punctures were performed on a nonrigid phantom using a liver specific navigation system and CBCT volumetric dataset for planning and navigation. To mimic targets, five titanium screws were fixed to the phantom. Target positioning accuracy (TPE{sub CBCT}) was computed from control CT scans and divided into lateral and longitudinal components. Additionally, CBCT-CT guidance accuracy was deducted by performing CBCT-to-CT image coregistration and measuring TPE{sub CBCT-CT} from fused datasets. Image coregistration was evaluated using fiducial registration error (FRE{sub CBCT-CT}) and target registration error (TRE{sub CBCT-CT}). Results: Positioning accuracies in lateral directions pertaining to CBCT (TPE{sub CBCT} = 2.1 {+-} 1.0 mm) were found to be better to those achieved from previous study using CT (TPE{sub CT} = 2.3 {+-} 1.3 mm). Image coregistration error was 0.3 {+-} 0.1 mm, resulting in an average TRE of 2.1 {+-} 0.7 mm (N = 5 targets) and average Euclidean TPE{sub CBCT-CT} of 3.1 {+-} 1.3 mm. Conclusions: Stereotactic needle punctures might be planned and performed on volumetric CBCT images and controlled with multidetector CT with positioning accuracy higher or similar to those performed using CT scanners.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A Publicly Available, Annotated Dataset for Naturalistic Driving Study and Computer Vision Algorithm Development

Oak Ridge National Laboratory developed and implemented a data collection effort to create a dataset for use in evaluating and testing algorithms for analyzing driver behavior under controlled settings for support of the Federal Highway Administration’s Exploratory Advanced Research Program. This collection is called the ORNL Naturalistic Driving Study Sample (ONDSS). The dataset is designed to emulate aspects of the Second Strategic Highway Research Project (SHRP2), which contained a massive naturalistic driving study (NDS) with over 3000 drivers between 2010 and 2013 using their personal vehicles, with over 4300 person-years of data collected [HANKEY].

42 ENGINEERING↗

Automated identification of local contamination in remote atmospheric composition time series

Abstract. Atmospheric observations in remote locations offer a possibility of exploring trace gas and particle concentrations in pristine environments. However, data from remote areas are often contaminated by pollution from local sources. Detecting this contamination is thus a central and frequently encountered issue. Consequently, many different methods exist today to identify local contamination in atmospheric composition measurement time series, but no single method has been widely accepted. In this study, we present a new method to identify primary pollution in remote atmospheric datasets, e.g., from ship campaigns or stations with a low background signal compared to the contaminated signal. The pollution detection algorithm (PDA) identifies and flags periods of polluted data in five steps. The first and most important step identifies polluted periods based on the derivative (time derivative) of a concentration over time. If this derivative exceeds a given threshold, data are flagged as polluted. Further pollution identification steps are a simple concentration threshold filter, a neighboring points filter (optional), a median, and a sparse data filter (optional). The PDA only relies on the target dataset itself and is independent of ancillary datasets such as meteorological variables. All parameters of each step are adjustable so that the PDA can be “tuned” to be more or less stringent (e.g., flag more or fewer data points as contaminated). The PDA was developed and tested with a particle number concentration dataset collected during the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition in the central Arctic. Using strict settings, we identified 62 % of the data as influenced by local contamination. Using a second independent particle number concentration dataset also collected during MOSAiC, we evaluated the performance of the PDA against the same dataset cleaned by visual inspection. The two methods agreed in 94 % of the cases. Additionally, the PDA was successfully applied to a trace gas dataset (CO2), also collected during MOSAiC, and to another particle number concentration dataset, collected at the high-altitude background station Jungfraujoch, Switzerland. Thus, the PDA proves to be a useful and flexible tool to identify periods affected by local contamination in atmospheric composition datasets without the need for ancillary measurements. It is best applied to data representing primary pollution. The user-friendly and open-access code enables reproducible application to a wide suite of different datasets. It is available at https://doi.org/10.5281/zenodo.5761101 (Beck et al., 2021).

54 ENVIRONMENTAL SCIENCES↗

WE-G-207-06: 3D Fluoroscopic Image Generation From Patient-Specific 4DCBCT-Based Motion Models Derived From Physical Phantom and Clinical Patient Images

Purpose: Respiratory-correlated cone-beam CT (4DCBCT) images acquired immediately prior to treatment have the potential to represent patient motion patterns and anatomy during treatment, including both intra- and inter-fractional changes. We develop a method to generate patient-specific motion models based on 4DCBCT images acquired with existing clinical equipment and used to generate time varying volumetric images (3D fluoroscopic images) representing motion during treatment delivery. Methods: Motion models are derived by deformably registering each 4DCBCT phase to a reference phase, and performing principal component analysis (PCA) on the resulting displacement vector fields. 3D fluoroscopic images are estimated by optimizing the resulting PCA coefficients iteratively through comparison of the cone-beam projections simulating kV treatment imaging and digitally reconstructed radiographs generated from the motion model. Patient and physical phantom datasets are used to evaluate the method in terms of tumor localization error compared to manually defined ground truth positions. Results: 4DCBCT-based motion models were derived and used to generate 3D fluoroscopic images at treatment time. For the patient datasets, the average tumor localization error and the 95th percentile were 1.57 and 3.13 respectively in subsets of four patient datasets. For the physical phantom datasets, the average tumor localization error and the 95th percentile were 1.14 and 2.78 respectively in two datasets. 4DCBCT motion models are shown to perform well in the context of generating 3D fluoroscopic images due to their ability to reproduce anatomical changes at treatment time. Conclusion: This study showed the feasibility of deriving 4DCBCT-based motion models and using them to generate 3D fluoroscopic images at treatment time in real clinical settings. 4DCBCT-based motion models were found to account for the 3D non-rigid motion of the patient anatomy during treatment and have the potential to localize tumor and other patient anatomical structures at treatment time even when inter-fractional changes occur. This project was supported, in part, through a Master Research Agreement with Varian Medical Systems, Inc., Palo Alto, CA. The project was also supported, in part, by Award Number R21CA156068 from the National Cancer Institute.

60 APPLIED LIFE SCIENCES↗

Evaluation of a Regional Crop Model Implementation for Sub-National Yield Assessments in Kenya

CONTEXT: Cropping system models can be used to both assess regional food security and to monitor and predict agricultural drought. Agriculture in Kenya is extremely important to both the economy and food security of the country. OBJECTIVE: This study evaluated a regional implementation of a widely used crop model, the Decision Support System for Agrotechnology Transfer (DSSAT), within a coupled modeling framework, the Regional Hydrologic Extremes Assessment System (RHEAS), over Kenya. The goal of this study was to assess the ability of RHEAS to simulate the annual variability of maize yields at the county level and evaluate the uncertainty inherent in the model and inputs. METHODS: The RHEAS system implements a stochastic ensemble approach to account for field scale variabilities in crop management practices and underlying soil and weather conditions. Satellite-derived datasets were used to evaluate the land surface component of the system and seasonally disaggregated yield for 5 years was used to assess the performance of the cropping system model. RESULTS AND CONCLUSIONS: The median correlation between RHEAS and satellite-derived soil moisture and evapotranspiration estimates were 0.78, and 0.51, respectively, indicating that the model is able to capture the key drivers of the hydrological budget. Overall, RHEAS simulated yearly yield variations with a median correlation of 0.7 with reported yields, with the best performance in the short rains season. However, across both seasons, the RHEAS model was positively biased on the order of ~1.6 MT/ha. The overall median unbiased RMSE was 0.66 MT/ha. The RHEAS system shows skill at simulating extreme departures in anomalies, and a majority of the time (62.5%) the reported yields fall within the interquartile range of the simulations. SIGNIFICANCE: One of the most important areas of improvement for the next generation of agricultural data and models is to better understand and communicate the inherent uncertainties. This is especially critical in data-limited regions. Here we present a modeling system and its implementation that begins to address these concerns. We demonstrate the ability to simulate broad trends in yields at the county level for sub-annual yields with skills that commensurate previous national/annual level studies.

Crop model↗

Spatially and Temporally Detailed Water and Carbon Footprints of U.S. Electricity Generation and Use

Electricity generation in the United States entails significant water usage and greenhouse gas emissions. However, accurately estimating these impacts is complex due to the intricate nature of the electric grid and the dynamic electricity mix. Existing methods to estimate the environmental consequences of electricity use often generalize across large regions, neglecting spatial and temporal variations in water usage and emissions. Consequently, electric grid dynamics, such as temporal fluctuations in renewable energy resources, are often overlooked in efforts to mitigate environmental impacts. The U.S. Department of Energy (DOE) has initiated the development of resilient energyshed management systems, requiring detailed information on the local electricity mix and its environmental impacts. This study supports DOE's goal by incorporating geographic and temporal variations in the electricity mix of the local electric grid to better understand the environmental impacts of electricity end users. We offer hourly estimates of the U.S. electricity mix, detailing fuel types, water withdrawal intensity, and water consumption intensity for each grid balancing authority through our publicly accessible tool, the Water Integrated Mapping of Power and Carbon Tracker (Water IMPACT). While our primary focus is on evaluating water intensity factors, our dataset and programming scripts for historical and real-time analysis also include evaluations of carbon dioxide (equivalence) intensity within the same modeling framework. This integrated approach offers a comprehensive understanding of the environmental footprint associated with electricity generation and use, enabling informed decision-making to effectively reduce Scope 2 water usage and emissions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A robust approach to Gaussian process implementation

Abstract. Gaussian process (GP) regression is a flexible modeling technique used to predict outputs and to capture uncertainty in the predictions. However, the GP regression process becomes computationally intensive when the training spatial dataset has a large number of observations. To address this challenge, we introduce a scalable GP algorithm, termed MuyGPs, which incorporates nearest-neighbor and leave-one-out cross-validation during training. This approach enables the evaluation of large spatial datasets with state-of-the-art accuracy and speed in certain spatial problems. Despite these advantages, conventional quadratic loss functions used in the MuyGPs optimization, such as root mean squared error (RMSE), are highly influenced by outliers. We explore the behavior of MuyGPs in cases involving outlying observations and, subsequently, develop a robust approach to handle and mitigate their impact. Specifically, we introduce a novel leave-one-out loss function based on the pseudo-Huber function (LOOPH) that effectively accounts for outliers in large spatial datasets within the MuyGPs framework. Our simulation study shows that the LOOPH loss method maintains accuracy despite outlying observations, establishing MuyGPs as a powerful tool for mitigating unusual observation impacts in the large data regime. In the analysis of US ozone data, MuyGPs provides accurate predictions and uncertainty quantification, demonstrating its utility in managing data anomalies. Through these efforts, we advance the understanding of GP regression in spatial contexts.

Mukangango, Juliette↗

A synthesis dataset of permafrost-affected soil thermal conditions for Alaska, USA

Recent observations of near-surface soil temperatures over the circumpolar Arctic show accelerated warming of permafrost-affected soils. The availability of a comprehensive near-surface permafrost and active layer dataset is critical to better understanding climate impacts and to constraining permafrost thermal conditions and its spatial distribution in land system models. We compiled a soil temperature dataset from 72 monitoring stations in Alaska using data collected by the U.S. Geological Survey, the National Park Service, and the University of Alaska Fairbanks permafrost monitoring networks. The array of monitoring stations spans a large range of latitudes from 60.9 to 71.3°N and elevations from near sea level to ~1300 m, comprising tundra and boreal forest regions. This dataset consists of monthly ground temperatures at depths up to 1 m, volumetric soil water content, snow depth, and air temperature during 1997–2016. These data have been quality controlled in collection and processing. Meanwhile, we implemented data harmonization evaluation for the processed dataset. The final product (PF-AK, v0.1) is available at the Arctic Data Center (https://doi.org/10.18739/A2KG55).

58 GEOSCIENCES↗