Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Recharge estimation from discrete water-table datasets in a coastal shallow aquifer in a humid subtropical climate

A time-series approach to the estimation of recharge rate in unconfined aquifers of highly variable water level is proposed. The approach, which is based on the water-table fluctuation method (WTF), utilizes discrete water-level measurements. Other similar techniques require continuous measurements, which makes them impossible to apply in cases where no data from automatic loggers are available. The procedure is deployed at the Ressacada Farm site, southern Brazil, on a coastal shallow aquifer located in a humid subtropical climate where diurnal water-level variations of up to 1 m can follow a precipitation event. The effect of tidal fluctuations on the groundwater levels is analyzed using a harmonic component builder, while a time-variable drainage term is evaluated through an independent analysis and included in the assessment. The estimated recharge values are compared with those obtained from the continuous measurements showing a good agreement with the approaches for discrete dataset intervals of up to 15 days. Subsequently, the estimated recharge rates are incorporated into a transient groundwater-flow model and the water levels are compared showing a good match. Henceforth, the approach extends the applicability of WTF to noncontinuous water-level datasets in groundwater recharge studies.

58 GEOSCIENCES↗

EC-Bench: A Benchmark for Enzyme Commission Number Prediction

Enzymes are proteins that catalyze specific biochemical reactions in cells. Enzyme Commission (EC) numbers are used to annotate enzymes in a four-level hierarchy that classifies enzymes based on the specific chemical reactions they catalyze. Accurate EC number prediction is essential for understanding enzyme functions. Despite the availability of numerous methods for predicting EC numbers from protein sequences, there is no unified framework for evaluating and studying such methods systematically. This gap limits the ability of the community to identify the most effective approaches for enzyme annotation. We introduce EC-Bench, a benchmark for EC number prediction, consisting of 1) an initial representative set of existing methods (including homology-based, deep learning, contrastive learning, and language model methods), 2) existing and novel accuracy and efficiency performance metrics, and 3) selected datasets to allow for comprehensive comparative study. EC-Bench is open-source and provides a framework for researchers to not only compare among existing methods objectively under uniform conditions, but also to introduce and effectively evaluate performance of new methods in a comparative framework. To demonstrate the utility of EC-Bench, we perform extensive experimentation to compare the existing EC number prediction methods and establish their advantages and disadvantages in a variety of prediction tasks, namely “exact EC number prediction”, “EC number completion” and (partial or additional) “EC number recommendation”. We find wide variation in the performance of different methods, but also subtle but potentially useful differences in the performance of different methods across tasks and for different parts of the EC hierarchy.

59 BASIC BIOLOGICAL SCIENCES↗

Linking groundwater variability to ecosystem carbon and water use efficiencies across India

Carbon use efficiency (CUE) and water use efficiency (WUE) are important indicators of ecosystem health, reflecting the balance between carbon uptake and allocation, and the relationship between carbon assimilation and water loss. Although India shows large spatiotemporal variation in water table depth (WTD), and increasing groundwater stress, the influence of WTD on ecosystem functioning remains underexplored. This study uses satellite-based, modeled, and in-situ datasets to (1) quantify variations in CUE and WUE under shallow (SWTD) and deep (DWTD) WTD conditions across six homogeneous meteorological regions (HMRs), (2) evaluate temporal roles of gross primary productivity (GPP), net primary productivity (NPP), and evapotranspiration (ET) in driving these efficiencies, and (3) examine temporal responses to WTD shifts. SWTD regions generally showed 12 to 18 % higher GPP, 10 to 15 % higher NPP, and 10 to 20 % higher ET than DWTD zones, especially in semi-arid croplands and forests, leading to 8 to 12 % higher CUE and WUE. However, in humid and heavily irrigated regions such as northeastern and hilly India, CUE was up to 10 % higher in DWTD zones, possibly due to reduced respiration and better soil aeration compared to SWTD areas affected by waterlogging. During the Kharif (wet) season, DWTD croplands in humid zones had higher efficiencies, while in the Rabi (dry) season, SWTD croplands in northern India benefited from irrigation and cooler temperatures. These results highlight strong influence of WTD on carbon and water use processes and support the need for region-specific groundwater strategies.

Carbon use efficiency↗

A temperature threshold to identify the driving climate forces of the respiratory process in terrestrial ecosystems

Terrestrial ecosystem respiration (R e ) is the second largest carbon flux between the biosphere and atmosphere. Therefore, climate-driven changes of Re greatly impact on future atmospheric CO 2 concentration. The aim of this study was to derive an air temperature threshold to identify the driving climate forces of the respiratory process in terrestrial ecosystems within different temperature zones. A global dataset of 647 site-years of ecosystem flux data and related variables were collected at 152 sites. The quantile regression was applied to evaluate relationships between the maximum realizable Re rates and mean annual air temperature (MAT) as well as other micrometeorological factors (i.e., atmospheric CO 2 concentration, atmospheric water content, soil heat flux, sensible heat flux, latent heat flux, precipitation, relative humidity, and soil water content). Our analysis revealed an ecosystem threshold of MAT of 11 ± 2.3 °C. In ecosystems with MATs lower than the threshold, the maximum R e rates were primarily dependent on temperature and respiration was mainly a temperature-driven process. In ecosystems with MATs higher than the threshold, besides MAT, other factors, such as water availability and surface heat flux, became significant driving forces of the maximum Re rates and respiration was a multi-factor-driven process. Temperature played the key role in generation of the maximum R e rates in the terrestrial ecosystems, while other driving forces reduce the maximum R e rates and the temperature sensitivity of the respiratory process. According to a regression tree analysis, MAT was also the most influencing factor of mean R e rates among the climate forces. The information from this study should be useful to predict the respiratory process in terrestrial ecosystems with different temperatures under the climate change.

54 ENVIRONMENTAL SCIENCES↗

Aridity-Dependent Land Surface Skin Temperature Biases in CMIP5/6

Land surface skin temperature, a critical indicator of climate change, connects the water and energy cycles between the land and the atmosphere. Here, in this study, we evaluate the simulations of land surface skin temperature from the Coupled Model Intercomparison Project Phase 5 (CMIP5) and CMIP6 models with satellite-based datasets and reanalysis. We find systematic cold skin temperature biases over arid regions in CMIP5/CMIP6 simulations. Over arid and semi-arid regions, latent heat biases drive skin temperature biases by evaporative cooling. Over humid regions, surface downward shortwave and albedo biases are relatively more critical. Spatial patterns of biases remain similar in the latest CMIP6 simulations, suggesting systematic biases in land-atmosphere interactions. These biases need to be corrected or considered while using models for future projections.

54 ENVIRONMENTAL SCIENCES↗

Towards accurate prediction of configurational disorder properties in materials using graph neural networks

Abstract The prediction of configurational disorder properties, such as configurational entropy and order-disorder phase transition temperature, of compound materials relies on efficient and accurate evaluations of configurational energies. Previous cluster expansion methods are not applicable to configurationally-complex material systems, including those with atomic distortions and long-range orders. In this work, we propose to leverage the versatile expressive capabilities of graph neural networks (GNNs) for efficient evaluations of configurational energies and present a workflow combining attention-based GNNs and Monte Carlo simulations to calculate the disorder properties. Using the dataset of face-centered tetragonal gold copper without and with local atomic distortions as an example, we demonstrate that the proposed data-driven framework enables the prediction of phase transition temperatures close to experimental values. We also elucidate that the variance of the energy deviations among configurations controls the prediction accuracy of disorder properties and can be used as the target loss function when training and selecting the GNN models. The work serves as a fundamental step toward a data-driven paradigm for the accelerated design of configurationally-complex functional material systems.

Chemistry↗

A comparison of machine learning methods to classify radioactive elements using prompt-gamma-ray neutron activation data

The detection of illicit radiological materials is critical to establishing a robust second line of defence in nuclear security. Neutron-capture prompt-gamma activation analysis (PGAA) can be used to detect multiple radioactive materials across the entire Periodic Table. However, long detection times and a high rate of false positives pose a significant hindrance in the deployment of PGAA-based systems to identify the presence of illicit substances in nuclear forensics. In the present work, six different machine-learning algorithms were developed to classify radioactive elements based on the PGAA energy spectra. The model performance was evaluated using standard classification metrics and trend curves with an emphasis on comparing the effectiveness of algorithms that are best suited for classifying imbalanced datasets. We analyse the classification performance based on Precision, Recall, F1-score, Specificity, Confusion matrix, ROC-AUC curves, and Geometric Mean Score (GMS) measures. The tree-based algorithms (Decision Trees, Random Forest and AdaBoost) have consistently outperformed Support Vector Machine and K-Nearest Neighbours. Based on the results presented, AdaBoost is the preferred classifier to analyse data containing PGAA spectral information due to the high recall and minimal false negatives reported in the minority class.

97 MATHEMATICS AND COMPUTING↗

Elucidating the photodissociation fingerprint and quantifying the determination of organic hydroperoxides in gas-phase autoxidation

Hydroperoxides are formed in the atmospheric oxidation of volatile organic compounds, in the combustion autoxidation of fuel, in the cold environment of the interstellar medium, and also in some catalytic reactions. They play crucial roles in the formation and aging of secondary organic aerosols and in fuel autoignition. However, the concentration of organic hydroperoxides is seldom measured, and typical estimates have large uncertainties. In this work, we developed a mild and environmental-friendly method for the synthesis of alkyl hydroperoxides (ROOH) with various structures, and we systematically measured the absolute photoionization cross-sections (PICSs) of the ROOHs using synchrotron vacuum ultraviolet-photoionization mass spectrometry (SVUV-PIMS). A chemical titration method was combined with an SVUV-PIMS measurement to obtain the PICS of 4-hydroperoxy-2-pentanone, a typical molecule for combustion and atmospheric autoxidation ketohydroperoxides (KHPs). We found that organic hydroperoxide cations are largely dissociated by loss of OOH. This fingerprint was used for the identification and accurate quantification of the organic peroxides, and it can therefore be used to improve models for autoxidation chemistry. The synthesis method and photoionization dataset for organic hydroperoxides are useful for studying the chemistry of hydroperoxides and the reaction kinetics of the hydroperoxy radicals and for developing and evaluating kinetic models for the atmospheric autoxidation and combustion autoxidation of the organic compounds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Seasonal representation of extreme precipitation indices over the United States in CMIP6 present-day simulations

Realistically representing the present-day characteristics of extreme precipitation has been a challenge for global climate models, which is due in part to deficiencies in model resolution and physics, but is also due to a lack of consistency in gridded observations. In this study, we use three observation datasets, including gridded rain gauge and satellite data, to assess historical simulations from sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models. We separately evaluate summer and winter precipitation over the United States (US) with a comprehensive set of extreme precipitation indices, including an assessment of precipitation frequency, intensity and spatial structure. The observations exhibit significant differences in their estimates of area-average intensity distributions and spatial patterns of the mean and extremes of precipitation over the US. In general, the CMIP6 multi-model mean performs better than most individual models at capturing daily precipitation distributions and extreme precipitation indices, particularly in comparison to gauge-based data. Also, the representation of the extreme precipitation indices by the CMIP6 models is better in the summer than winter. Although the ‘standard’ horizontal-resolution can vary significantly across CMIP6 models, from ~0.7° to ~2.8°, we find that resolution is not a good indicator of model performance. Overall, our results highlight common biases in CMIP6 models and demonstrate that no single model is consistently the most reliable across all indices.

54 ENVIRONMENTAL SCIENCES↗

Quantifying and Zoning Urban Heat Island Effects Using Unsupervised Machine Learning

This work explores the Urban Heat Island (UHI) effects in Maricopa County, Arizona, employing a simulation-based approach that combines large-scale building energy modeling with advanced spatial analysis. Utilizing the Automatic Building Energy Modeling (AutoBEM) software suite, we simulated the energy consumption for approximately 1.35 million buildings based on the Model America version 1.0 (MAv1) dataset. Our methodology incorporated spatial analysis at multiple scales, including individual buildings, clusters of zones determined by K-means clustering, and geographical level evaluation based on Zip codes. The results revealed significant variations in energy consumption and heat emissions across different building types and urban zones. High-emission hotspots identified through clustering pointed to areas most contributing to the UHI effects. Zip code-based area analysis further contextualized these findings, offering an urban context-based perspective on emission distribution and informing potential urban energy policies for mitigating UHI effects.

Chowdhury, Shovan [ORNL]↗

SU-F-T-407: Artifact Reduction with Dual Energy Or IMAR: Who’s Winning?

Purpose: The purpose of this abstract was to evaluate the performance of commercial strategies for artifact reduction in radiation oncology settings. The iterative metal artifact reduction (Siemens iMAR) algorithm and monoenergetic virtual datasets reconstructed from dual energy scans are compared side-by-side in their ability to image in the presence of metal inserts. Methods: A CIRS ATOM Dosimetry Verification Phantom was scanned with and without a metal insert on a SOMATOM Definition AS dual energy scanner. Images with the metal insert were reconstructed with (a) a tradition single energy CT scan with the iMAR option implemented, using different artifact reduction settings and (b) a monoenergetic scan calculated from dual energy scans by recovering differences in the energy-dependence of the attenuation coefficients of different materials and then creating a virtual monoenergetic scan from these coefficients. The iMAR and monoenergetic scans were then compared with the metal-free scan to assess changes in HU numbers and noise within a region around the metal insert. Results: Both the iMAR and dual energy scans reduced artifacts produced by the metal insert. However the iMAR results are dependent of the selected algorithm settings, with a mean HU difference ranging from 0.65 to 90.40 for different options. The mean differences without the iMAR correction were 38.74. When using the dual energy scan, the mean differences were 4.53, that is however attributed to increased noise and not artifacts, as the dual energy scan had the lowest skewness (2.52) compared to the iMAR scans (ranging from 3.90 to 4.88) and the lowest kurtosis (5.72 for dual energy, range of 18.19 to 27.36 for iMAR). Conclusion: Both approaches accurately recovered HU numbers, however the dual energy method provided smaller residual artifacts.

60 APPLIED LIFE SCIENCES↗

Retrospective Analysis and Bayesian Model Averaging of CMIP6 Precipitation in the Nile River Basin

The Nile River basin is one of the global hotspots vulnerable to climate change impacts because of a fast-growing population and geopolitical tensions. Previous studies demonstrated that general circulation models (GCMs) frequently show disagreement in the sign of change in annual precipitation projections. Here, we first evaluate the performance of 20 GCMs from phase six of the Coupled Model Intercomparison Project (CMIP6) benchmarked against a high-spatial-resolution precipitation dataset dating back to 1983 from Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Climate Data Record (PERSIANN-CDR). Next, a Bayesian model averaging (BMA) approach is adopted to derive probability distributions of precipitation projections in the Nile basin. Retrospective analysis reveals that most GCMs exhibit considerable (up to 64% of mean annual precipitation) and spatially heterogenous bias in simulating annual precipitation. Moreover, it is shown that all GCMs underestimate interannual variability; thus, the ensemble range is underdispersive and is a poor indicator of uncertainty. The projected changes from the BMA model show that the value and sign of change vary considerably across the Nile basin. Specifically, it is found that projected changes in the two headwaters basins, namely, the Blue Nile and Upper White Nile, are 0.03% and -1.65%, respectively; both are statistically insignificant at α = 0.05. The uncertainty range estimated from the BMA model shows that the probability of a precipitation decrease is much higher in the Upper White Nile basin whereas projected change in the Blue Nile is highly uncertain both in magnitude and sign of change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Removing cosmic spikes using a hyperspectral upper-bound spectrum method

Cosmic ray spikes are especially problematic for hyperspectral imaging, due to the large number of spikes often present and their negative effects upon subsequent chemometric analysis. Fortunately, while the large number of spectra acquired in a hyperspectral imaging data set increases the probability and number of cosmic spikes observed, the multitude of spectra can also aid in the effective recognition and removal of the cosmic spikes. Dongmao Zhang and Dor Ben-Amotz were perhaps the first to leverage the additional spatial dimension of hyperspectral data matrices (DM). They integrated principal component analysis (PCA) into the upper bound spectrum method (UBS), resulting in a hybrid method (UBS-DM) for hyperspectral images. Here, we expand upon their use of PCA, recognizing that principal components primarily present in only a few pixels most likely correspond to cosmic spikes. Eliminating the contribution of those principal components in those pixels improves the cosmic spike removal. Both simulated and experimental hyperspectral Raman image data sets are used to test the newly developed UBS-DM-hyperspectral (UBS-DM-HS) method which extends the UBS-DM method by leveraging characteristics of hyperspectral datasets. Lastly, a comparison is provided between the performance of the UBS-DM-HS method and other methods suitable for despiking hyperspectral images, evaluating both their ability to remove cosmic ray spikes and the extent to which they introduce spectral bias.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparison of threshold selection methods for microarray gene co-expression matrices

Background: Network and clustering analyses of microarray co-expression correlation data often require application of a threshold to discard small correlations, thus reducing computational demands and decreasing the number of uninformative correlations. This study investigated threshold selection in the context of combinatorial network analysis of transcriptome data. Findings: Six conceptually diverse methods - based on number of maximal cliques, correlation of control spots with expressed genes, top 1% of correlations, spectral graph clustering, Bonferroni correction of p-values, and statistical power - were used to estimate a correlation threshold for three time-series microarray datasets. The validity of thresholds was tested by comparison to thresholds derived from Gene Ontology information. Stability and reliability of the best methods were evaluated with block bootstrapping. Two threshold methods, number of maximal cliques and spectral graph, used information in the correlation matrix structure and performed well in terms of stability. Comparison to Gene Ontology found thresholds from number of maximal cliques extracted from a co-expression matrix were the most biologically valid. Approaches to improve both methods were suggested. Conclusion: Threshold selection approaches based on network structure of gene relationships gave thresholds with greater relevance to curated biological relationships than approaches based on statistical pair-wise relationships.

59 BASIC BIOLOGICAL SCIENCES↗

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗

Seismic monitoring of underground vibration: database of seismic data and ground truth

Seismic waves provide valuable insights into underground activities, serving as an essential tool for monitoring anomalies that could signal containment breaches in geological repositories. We aim to test and refine underground detection and geolocation techniques to identify anomalous vibration signals indicative of potential breaches, thereby strengthening georepository safeguards. We evaluate the effectiveness of two distinct, low-maintenance sensing technologies (surface geophones and underground distributed acoustic sensing (DAS) fiber optic cable) leveraging existing datasets. This report details the experimental designs, instrumentation, and data characteristics for both seismic and DAS arrays. Additionally, we provide a ground truth database documenting relevant operational activities for each experiment.

58 GEOSCIENCES↗

Data for: Miscanthus × giganteus changes soil structure and increases maximum water holding capacity

The data provided include results from a comparative study evaluating the impact of Miscanthus × giganteus (miscanthus) versus maize on soil structural properties and maximum water holding capacity (MWHC) across two Iowa sites. The dataset includes MWHC values determined using the Funnel Filter Paper Drainage (FFPD) method, as well as additional measurements of MWHC following structural disruption of the soil to isolate the effect of aggregation. It also contains three-dimensional micro-computed tomography (microCT) data used to quantify total porosity and pore size distribution (PSD) of soil aggregates at a 5 µm resolution. All data are provided as raw replicate-level measurements, organized by site, crop, and depth, along with processed summary files in table form in CSV (.csv) format to support reproducibility and downstream analysis.

Misanthus x giganteus↗

Developing predictive models for µ opioid receptor binding using machine learning and deep learning techniques

Opioids exert their analgesic effect by binding to the µ opioid receptor (MOR), which initiates a downstream signaling pathway, eventually inhibiting pain transmission in the spinal cord. However, current opioids are addictive, often leading to overdose contributing to the opioid crisis in the United States. Therefore, understanding the structure-activity relationship between MOR and its ligands is essential for predicting MOR binding of chemicals, which could assist in the development of non-addictive or less-addictive opioid analgesics. This study aimed to develop machine learning and deep learning models for predicting MOR binding activity of chemicals. Chemicals with MOR binding activity data were first curated from public databases and the literature. Molecular descriptors of the curated chemicals were calculated using software Mold2. The chemicals were then split into training and external validation datasets. Random forest, k-nearest neighbors, support vector machine, multi-layer perceptron, and long short-term memory models were developed and evaluated using 5-fold cross-validations and external validations, resulting in Matthews correlation coefficients of 0.528–0.654 and 0.408, respectively. Furthermore, prediction confidence and applicability domain analyses highlighted their importance to the models’ applicability. Our results suggest that the developed models could be useful for identifying MOR binders, potentially aiding in the development of non-addictive or less-addictive drugs targeting MOR.

Research & Experimental Medicine↗