Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

GLORIA - A Globally Representative Hyperspectral In Situ Dataset for Optical Sensing of Water Quality

The development of algorithms for remote sensing of water quality (RSWQ) requires a large amount of in situ data to account for the bio-geo-optical diversity of inland and coastal waters. The GLObal Reflectance community dataset for Imaging and optical sensing of Aquatic environments (GLORIA) includes 7,572 curated hyperspectral remote sensing reflectance measurements at 1 nm intervals within the 350 to 900 nm wavelength range. In addition, at least one co-located water quality measurement of chlorophyll a , total suspended solids, absorption by dissolved substances, and Secchi depth, is provided. The data were contributed by researchers affiliated with 59 institutions worldwide and come from 450 different water bodies, making GLORIA the de-facto state of knowledge of in situ coastal and inland aquatic optical diversity. Each measurement is documented with comprehensive methodological details, allowing users to evaluate fitness-for-purpose, and providing a reference for practitioners planning similar measurements. We provide open and free access to this dataset with the goal of enabling scientific and technological advancement towards operational regional and global RSWQ monitoring.

remote sensing of water quality↗

Characterization of Precipitation-Strengthening Heat-Resistant Austenitic Stainless Steels for Life-Prediction Modeling

In this study, the role of minor alloying additions in 347H stainless steels (UNS34709, ASTM A240/240M) on creep-rupture properties at 650-750°C and microstructure evolution during isothermal exposure at 750°C has been investigated, aiming to provide the experimental dataset as boundary conditions of physics-based modeling for material/component life prediction. Four different 347H heats containing various amounts of boron and nitrogen additions were prepared and evaluated. The combined additions of B and N are found to stabilize the strengthening secondary M23C6 carbides and retarding the transition from M23C6 to sigma phase precipitates during thermal exposure. The observed kinetics of microstructure evolution reasonably explains the improvement of creep-rupture properties of 347H stainless steels with the B and N additions.

Yamamoto, Yukinori↗

Comparison of 2D and 3D gamma analyses

Purpose: As clinics begin to use 3D metrics for intensity-modulated radiation therapy (IMRT) quality assurance, it must be noted that these metrics will often produce results different from those produced by their 2D counterparts. 3D and 2D gamma analyses would be expected to produce different values, in part because of the different search space available. In the present investigation, the authors compared the results of 2D and 3D gamma analysis (where both datasets were generated in the same manner) for clinical treatment plans. Methods: Fifty IMRT plans were selected from the authors’ clinical database, and recalculated using Monte Carlo. Treatment planning system-calculated (“evaluated dose distributions”) and Monte Carlo-recalculated (“reference dose distributions”) dose distributions were compared using 2D and 3D gamma analysis. This analysis was performed using a variety of dose-difference (5%, 3%, 2%, and 1%) and distance-to-agreement (5, 3, 2, and 1 mm) acceptance criteria, low-dose thresholds (5%, 10%, and 15% of the prescription dose), and data grid sizes (1.0, 1.5, and 3.0 mm). Each comparison was evaluated to determine the average 2D and 3D gamma, lower 95th percentile gamma value, and percentage of pixels passing gamma. Results: The average gamma, lower 95th percentile gamma value, and percentage of passing pixels for each acceptance criterion demonstrated better agreement for 3D than for 2D analysis for every plan comparison. The average difference in the percentage of passing pixels between the 2D and 3D analyses with no low-dose threshold ranged from 0.9% to 2.1%. Similarly, using a low-dose threshold resulted in a difference between the mean 2D and 3D results, ranging from 0.8% to 1.5%. The authors observed no appreciable differences in gamma with changes in the data density (constant difference: 0.8% for 2D vs 3D). Conclusions: The authors found that 3D gamma analysis resulted in up to 2.9% more pixels passing than 2D analysis. It must be noted that clinical 2D versus 3D datasets may have additional differences—for example, if 2D measurements are made with a different dosimeter than 3D measurements. Factors such as inherent dosimeter differences may be an important additional consideration to the extra dimension of available data that was evaluated in this study.

61 RADIATION PROTECTION AND DOSIMETRY↗

SU-F-T-491: Photon Beam Matching Analysis at Multiple Sites Up to Twelve Years Post Installation

Purpose: To determine if the photon beams associated with several models of accelerators are matched with ‘Golden Beam’ data (VGBD) to assess treatment planning modeling and delivery. Methods: Six accelerators’ photon beams were evaluated to determine if they matched the manufacturer’s (Varian Medical Systems, Inc.) VGBD. Additional direct comparisons of the 6X and 18X beams using the manufacturer’s specification of Basic and Fine beam matching were also performed. The Cseries accelerator models were 21 EX (3), IX (2), and a IX Trilogy, ranging from three to twelve years post installation. Computerized beam scanning was performed (IBA Blue Phantom 2) with 2 CC13 ion chambers in water at 100 cm SSD. Dmax (10 cm2 field size), percentage depth dose (6 cm2, 10 cm2, 20 cm2, and 30 cm2 field sizes) and beam uniformity (10 cm2, 30 cm2 and 40 cm2 field sizes) were evaluated. Results: When comparing the beams with VGBD using the ‘Basic’ matching criteria, all beams were within the specifications ( 1.5mm at dmax, 1% PDD, and 2% Profiles). When considering the “Fine” matching criteria ( 1.5mm at dmax, 0.5% PDD, and 2% Profiles), only three of six 6MV beams and two of six high energy (five 18MV & one 15MV) beams passed. Direct comparisons between accelerators using the Clinac IX (installed 2012) as the reference beam datasets resulted in all 6 MV and 18MV beams meeting both the “Basic” and “Fine” criterion with the exception of two accelerators. Conclusion: Linear accelerators installed up to nine years apart are capable of meeting the manufacturers beam matching criteria for “Basic” matching. Without any adjustments most beams, when evaluated, may meet the “Fine” match criteria. The use of a single dataset (VGBD or designated accelerator reference data) for treatment planning commissioning is acceptable and can provide quality treatment delivery.

61 RADIATION PROTECTION AND DOSIMETRY↗

Optimizing de novo genome assembly from PCR-amplified metagenomes

Background. Metagenomics has transformed our understanding of microbial diversity across ecosystems, with recent advances enabling de novo assembly of genomes from metagenomes. These metagenome-assembled genomes are critical to provide ecological, evolutionary, and metabolic context for all the microbes and viruses yet to be cultivated. Metagenomes can now be generated from nanogram to subnanogram amounts of DNA. However, these libraries require several rounds of PCR amplification before sequencing, and recent data suggest these typically yield smaller and more fragmented assemblies than regular metagenomes. Methods. Here we evaluate de novo assembly methods of 169 PCR-amplified metagenomes, including 25 for which an unamplified counterpart is available, to optimize specific assembly approaches for PCR-amplified libraries. We first evaluated coverage bias by mapping reads from PCR-amplified metagenomes onto reference contigs obtained from unamplified metagenomes of the same samples. Then, we compared different assembly pipelines in terms of assembly size (number of bp in contigs ≥ 10kb) and error rates to evaluate which are the best suited for PCR-amplified metagenomes. Results. Read mapping analyses revealed that the depth of coverage within individual genomes is significantly more uneven in PCR-amplified datasets versus unamplified metagenomes, with regions of high depth of coverage enriched in short inserts. This enrichment scales with the number of PCR cycles performed, and is presumably due to preferential amplification of short inserts. Standard assembly pipelines are confounded by this type of coverage unevenness, so we evaluated other assembly options to mitigate these issues. We found that a pipeline combining read deduplication and an assembly algorithm originally designed to recover genomes from libraries generated after whole genome amplification (single-cell SPAdes) frequently improved assembly of contigs ≥ 10kb by 10 to 100-fold for low input metagenomes. Conclusions. PCR-amplified metagenomes have enabled scientists to explore communities traditionally challenging to describe, including some with extremely low biomass or from which DNA is particularly difficult to extract. Here we show that a modified assembly pipeline can lead to an improved de novo genome assembly from PCR-amplified datasets, and enables a better genome recovery from low input metagenomes.

Roux, Simon↗

Optimizing de novo genome assembly from PCR-amplified metagenomes

Background: Metagenomics has transformed our understanding of microbial diversity across ecosystems, with recent advances enabling de novo assembly of genomes from metagenomes. These metagenome-assembled genomes are critical to provide ecological, evolutionary, and metabolic context for all the microbes and viruses yet to be cultivated. Metagenomes can now be generated from nanogram to subnanogram amounts of DNA. However, these libraries require several rounds of PCR amplification before sequencing, and recent data suggest these typically yield smaller and more fragmented assemblies than regular metagenomes. Methods: Here we evaluate de novo assembly methods of 169 PCR-amplified metagenomes, including 25 for which an unamplified counterpart is available, to optimize specific assembly approaches for PCR-amplified libraries. We first evaluated coverage bias by mapping reads from PCR-amplified metagenomes onto reference contigs obtained from unamplified metagenomes of the same samples. Then, we compared different assembly pipelines in terms of assembly size (number of bp in contigs ≥ 10kb) and error rates to evaluate which are the best suited for PCR-amplified metagenomes. Results: . Read mapping analyses revealed that the depth of coverage within individual genomes is significantly more uneven in PCR-amplified datasets versus unamplified metagenomes, with regions of high depth of coverage enriched in short inserts. This enrichment scales with the number of PCR cycles performed, and is presumably due to preferential amplification of short inserts. Standard assembly pipelines are confounded by this type of coverage unevenness, so we evaluated other assembly options to mitigate these issues. We found that a pipeline combining read deduplication and an assembly algorithm originally designed to recover genomes from libraries generated after whole genome amplification (single-cell SPAdes) frequently improved assembly of contigs ≥ 10kb by 10 to 100-fold for low input metagenomes. Conclusions: PCR-amplified metagenomes have enabled scientists to explore communities traditionally challenging to describe, including some with extremely low biomass or from which DNA is particularly difficult to extract. Here we show that a modified assembly pipeline can lead to an improved de novo genome assembly from PCR-amplified datasets, and enables a better genome recovery from low input metagenomes.

Roux, Simon↗

Optimizing de novo genome assembly from PCR-amplified metagenomes

Background. Metagenomics has transformed our understanding of microbial diversity across ecosystems, with recent advances enabling de novo assembly of genomes from metagenomes. These metagenome-assembled genomes are critical to provide ecological, evolutionary, and metabolic context for all the microbes and viruses yet to be cultivated. Metagenomes can now be generated from nanogram to subnanogram amounts of DNA. However, these libraries require several rounds of PCR amplification before sequencing, and recent data suggest these typically yield smaller and more fragmented assemblies than regular metagenomes. Methods. Here we evaluate de novo assembly methods of 169 PCR-amplified metagenomes, including 25 for which an unamplified counterpart is available, to optimize specific assembly approaches for PCR-amplified libraries. We first evaluated coverage bias by mapping reads from PCR-amplified metagenomes onto reference contigs obtained from unamplified metagenomes of the same samples. Then, we compared different assembly pipelines in terms of assembly size (number of bp in contigs ≥ 10 kb) and error rates to evaluate which are the best suited for PCR-amplified metagenomes. Results. Read mapping analyses revealed that the depth of coverage within individual genomes is significantly more uneven in PCR-amplified datasets versus unamplified metagenomes, with regions of high depth of coverage enriched in short inserts. This enrichment scales with the number of PCR cycles performed, and is presumably due to preferential amplification of short inserts. Standard assembly pipelines are confounded by this type of coverage unevenness, so we evaluated other assembly options to mitigate these issues. We found that a pipeline combining read deduplication and an assembly algorithm originally designed to recover genomes from libraries generated after whole genome amplification (single-cell SPAdes) frequently improved assembly of contigs ≥10 kb by 10 to 100-fold for low input metagenomes. Conclusions. PCR-amplified metagenomes have enabled scientists to explore communities traditionally challenging to describe, including some with extremely low biomass or from which DNA is particularly difficult to extract. Here we show that a modified assembly pipeline can lead to an improved de novo genome assembly from PCR-amplified datasets, and enables a better genome recovery from low input metagenomes.

59 BASIC BIOLOGICAL SCIENCES↗

Speed vs Accuracy: Effect on Ligand Pose Accuracy of Varying Box Size and Exhaustiveness in AutoDock Vina

Abstract Structure‐based virtual high‐throughput screening involves docking chemical libraries to targets of interest. A parameter pertinent to the accuracy of the resulting pose is the root mean square deviation (RMSD) from a known crystallographic structure, i. e., the ‘docking power’. Here, using a popular algorithm, Autodock Vina, as a model program, we evaluate the effects of varying two common docking parameters: the box size (the size of docking search space) and the exhaustiveness of the global search (the number of independent runs starting from random ligand conformations) on the RMSD from the PDBbind v2017 refined dataset of experimental protein‐ligand complexes. Although it is clear that exhaustiveness is an important parameter, there is wide variation in the values used, with variation between 1 and >100. We, therefore, evaluated a combination of cubic boxes of different sizes and five exhaustiveness values (1, 8, 25, 50, 75, 100) within the range of those commonly adopted. The results show that the default exhaustiveness value of 8 performs well overall for most box sizes. In contrast, for all box sizes, but particularly for large boxes, an exhaustiveness value of 1 led to significantly higher median RMSD (mRMSD) values. The docking power was slightly improved with an exhaustiveness of 25, but the mRMSD changes little with values higher than 25. Therefore, although low exhaustiveness is computationally faster, the results are more likely to be far from reality, and, conversely, values >25 led to little improvement at the expense of computational resources. Overall, we recommend users to use at least the default exhaustiveness value of 8 for virtual screening calculations.

Agarwal, Rupesh↗

Spatial Variability in Column CO2 Inferred from High Resolution GEOS-5 Global Model Simulations: Implications for Remote Sensing and Inversions

Column CO2 observations from current and future remote sensing missions represent a major advancement in our understanding of the carbon cycle and are expected to help constrain source and sink distributions. However, data assimilation and inversion methods are challenged by the difference in scale of models and observations. OCO-2 footprints represent an area of several square kilometers while NASA s future ASCENDS lidar mission is likely to have an even smaller footprint. In contrast, the resolution of models used in global inversions are typically hundreds of kilometers wide and often cover areas that include combinations of land, ocean and coastal areas and areas of significant topographic, land cover, and population density variations. To improve understanding of scales of atmospheric CO2 variability and representativeness of satellite observations, we will present results from a global, 10-km simulation of meteorology and atmospheric CO2 distributions performed using NASA s GEOS-5 general circulation model. This resolution, typical of mesoscale atmospheric models, represents an order of magnitude increase in resolution over typical global simulations of atmospheric composition allowing new insight into small scale CO2 variations across a wide range of surface flux and meteorological conditions. The simulation includes high resolution flux datasets provided by NASA s Carbon Monitoring System Flux Pilot Project at half degree resolution that have been down-scaled to 10-km using remote sensing datasets. Probability distribution functions are calculated over larger areas more typical of global models (100-400 km) to characterize subgrid-scale variability in these models. Particular emphasis is placed on coastal regions and regions containing megacities and fires to evaluate the ability of coarse resolution models to represent these small scale features. Additionally, model output are sampled using averaging kernels characteristic of OCO-2 and ASCENDS measurement concepts to create realistic pseudo-datasets. Pseudo-data are averaged over coarse model grid cell areas to better understand the ability of measurements to characterize CO2 distributions and spatial gradients on both short (daily to weekly) and long (monthly to seasonal) time scales

Ott, L.↗

A novel improved model for building energy consumption prediction based on model integration

Building energy consumption prediction plays an irreplaceable role in energy planning, management, and conservation. Constantly improving the performance of prediction models is the key to ensuring the efficient operation of energy systems. Moreover, accuracy is no longer the only factor in revealing model performance, it is more important to evaluate the model from multiple perspectives, considering the characteristics of engineering applications. Based on the idea of model integration, this paper proposes a novel improved integration model (stacking model) that can be used to forecast building energy consumption. The stacking model combines advantages of various base prediction algorithms and forms them into “meta-features” to ensure that the final model can observe datasets from different spatial and structural angles. Two cases are used to demonstrate practical engineering applications of the stacking model. A comparative analysis is performed to evaluate the prediction performance of the stacking model in contrast with existing well-known prediction models including Random Forest, Gradient Boosted Decision Tree, Extreme Gradient Boosting, Support Vector Machine, and K-Nearest Neighbor. The results indicate that the stacking method achieves better performance than other models, regarding accuracy (improvement of 9.5%–31.6% for Case A and 16.2%–49.4% for Case B), generalization (improvement of 6.7%–29.5% for Case A and 7.1%-34.6% for Case B), and robustness (improvement of 1.5%–34.1% for Case A and 1.8%–19.3% for Case B). The proposed model enriches the diversity of algorithm libraries of empirical models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Structure–activity relationship-based chemical classification of highly imbalanced Tox21 datasets

Abstract The specificity of toxicant-target biomolecule interactions lends to the very imbalanced nature of many toxicity datasets, causing poor performance in Structure–Activity Relationship (SAR)-based chemical classification. Undersampling and oversampling are representative techniques for handling such an imbalance challenge. However, removing inactive chemical compound instances from the majority class using an undersampling technique can result in information loss, whereas increasing active toxicant instances in the minority class by interpolation tends to introduce artificial minority instances that often cross into the majority class space, giving rise to class overlapping and a higher false prediction rate. In this study, in order to improve the prediction accuracy of imbalanced learning, we employed SMOTEENN, a combination of Synthetic Minority Over-sampling Technique (SMOTE) and Edited Nearest Neighbor (ENN) algorithms, to oversample the minority class by creating synthetic samples, followed by cleaning the mislabeled instances. We chose the highly imbalanced Tox21 dataset, which consisted of 12 in vitro bioassays for > 10,000 chemicals that were distributed unevenly between binary classes. With Random Forest (RF) as the base classifier and bagging as the ensemble strategy, we applied four hybrid learning methods, i.e., RF without imbalance handling (RF), RF with Random Undersampling (RUS), RF with SMOTE (SMO), and RF with SMOTEENN (SMN). The performance of the four learning methods was compared using nine evaluation metrics, among which F 1 score, Matthews correlation coefficient and Brier score provided a more consistent assessment of the overall performance across the 12 datasets. The Friedman’s aligned ranks test and the subsequent Bergmann-Hommel post hoc test showed that SMN significantly outperformed the other three methods. We also found that a strong negative correlation existed between the prediction accuracy and the imbalance ratio (IR), which is defined as the number of inactive compounds divided by the number of active compounds. SMN became less effective when IR exceeded a certain threshold (e.g., > 28). The ability to separate the few active compounds from the vast amounts of inactive ones is of great importance in computational toxicology. This work demonstrates that the performance of SAR-based, imbalanced chemical toxicity classification can be significantly improved through the use of data rebalancing.

Idakwo, Gabriel↗

Biological particles and aerosol-cloud interactions in the Southern Great Plains (Final Report)

The United States Southern Great Plains (SGP) is the genesis for much of the warm season precipitation in the central and eastern United States. While atmospheric thermodynamics and large-scale dynamics play an important role in formation of precipitation, precipitation mechanisms are also sensitive to aerosols. Aerosols can suppress precipitation as cloud condensation nuclei (CCN) or act as ice nucleating particles (INP) in deep convective clouds. This project focused on understanding the role of primary biological aerosol particles (PBAP) in the region and its influence on cloud formation. Specifically, we focused on biological aerosol in the form of pollen, one type of PBAP that is emitted in large yet variable quantities from vegetation in the mid latitudes. Field observations provide evidence of pollen in the planetary boundary layer and pollen components in cloud droplets and fine particulate matter. Further, pollen grains can easily rupture when wet, forming smaller, sub pollen particles with sizes less than one micron. We evaluated the potential for PBAP events at the Department of Energy (DoE) SGP Atmospheric Radiation Measurement (ARM) research facility due to the rich dataset available. We also developed model simulations that accounted for pollen emission and the generation of sub pollen particles, which have been shown to be both cloud condensation nuclei and ice nucleating particles. The proposed work was designed to address the following questions: 1. What are the physical and chemical signatures of biological aerosol such as pollen in SGP ARM measurements? 2. What is the role of pollen-derived particles on deep convection and precipitation in the Central US? Using measurements from the DoE SGP ARM site and recent airborne campaigns, we evaluated the signatures of pollen and pollen-derived aerosols on optical properties, cloud properties and precipitation (Subba et al., 2021). We identified pollen-driven events over the data record and used the Weather Research and Forecasting Model with fully coupled chemistry (WRF-Chem) to conduct chemically realistic simulations of aerosols during and summer mesoscale convective events in the Southern Great Plains (Subba et al., in review). This work improved our understanding of the role of biological aerosol on clouds and precipitation in the Central United States and placed these results in context with anthropogenically-driven processes.

54 ENVIRONMENTAL SCIENCES↗

Biological particles and aerosol-cloud interactions in the Southern Great Plains

The United States Southern Great Plains (SGP) is the genesis for much of the warm season precipitation in the central and eastern United States. While atmospheric thermodynamics and large-scale dynamics play an important role in formation of precipitation, precipitation mechanisms are also sensitive to aerosols. Aerosols can suppress precipitation as cloud condensation nuclei (CCN) or act as ice nucleating particles (INP) in deep convective clouds. This project focused on understanding the role of primary biological aerosol particles (PBAP) in the region and its influence on cloud formation. Specifically, we focused on biological aerosol in the form of pollen, one type of PBAP that is emitted in large yet variable quantities from vegetation in the mid latitudes. Field observations provide evidence of pollen in the planetary boundary layer and pollen components in cloud droplets and fine particulate matter. Further, pollen grains can easily rupture when wet, forming smaller, sub pollen particles with sizes less than one micron. We evaluated the potential for PBAP events at the Department of Energy (DoE) SGP Atmospheric Radiation Measurement (ARM) research facility due to the rich dataset available. We also developed model simulations that accounted for pollen emission and the generation of sub pollen particles, which have been shown to be both cloud condensation nuclei and ice nucleating particles. The proposed work was designed to address the following questions: 1. What are the physical and chemical signatures of biological aerosol such as pollen in SGP ARM measurements? 2. What is the role of pollen-derived particles on deep convection and precipitation in the Central US? Using measurements from the DoE SGP ARM site and recent airborne campaigns, we evaluated the signatures of pollen and pollen-derived aerosols on optical properties, cloud properties and precipitation (Subba et al., 2021). We identified pollen-driven events over the data record and used the Weather Research and Forecasting Model with fully coupled chemistry (WRF-Chem) to conduct chemically realistic simulations of aerosols during and summer mesoscale convective events in the Southern Great Plains (Subba et al., in review). This work improved our understanding of the role of biological aerosol on clouds and precipitation in the Central United States and placed these results in context with anthropogenically-driven processes.

54 ENVIRONMENTAL SCIENCES↗

Land Surface Verification Toolkit (LVT) - A Generalized Framework for Land Surface Model Evaluation

Model evaluation and verification are key in improving the usage and applicability of simulation models for real-world applications. In this article, the development and capabilities of a formal system for land surface model evaluation called the Land surface Verification Toolkit (LVT) is described. LVT is designed to provide an integrated environment for systematic land model evaluation and facilitates a range of verification approaches and analysis capabilities. LVT operates across multiple temporal and spatial scales and employs a large suite of in-situ, remotely sensed and other model and reanalysis datasets in their native formats. In addition to the traditional accuracy-based measures, LVT also includes uncertainty and ensemble diagnostics, information theory measures, spatial similarity metrics and scale decomposition techniques that provide novel ways for performing diagnostic model evaluations. Though LVT was originally designed to support the land surface modeling and data assimilation framework known as the Land Information System (LIS), it also supports hydrological data products from other, non-LIS environments. In addition, the analysis of diagnostics from various computational subsystems of LIS including data assimilation, optimization and uncertainty estimation are supported within LVT. Together, LIS and LVT provide a robust end-to-end environment for enabling the concepts of model data fusion for hydrological applications. The evolving capabilities of LVT framework are expected to facilitate rapid model evaluation efforts and aid the definition and refinement of formal evaluation procedures for the land surface modeling community.

Kumar, Sujay V.↗

A cross-dimensional analysis of data-driven short-term load forecasting methods with large-scale smart meter data

Electricity load forecasting is essential to utility operation and power grid stability. A wide spectrum of data-driven methods, ranging from linear regression models to more recent deep learning models have been adopted to forecast electric load over the years. However, there still lacks a holistic evaluation of the applicability of conventional statistical and machine learning based algorithms with respect to different temporal and spatial scopes, computational requirements, and sensitivity of model-tuning. Enabled by a large-scale electricity load profile dataset of over 40,000 residential customers in a utility region, we conducted a cross-dimensional analysis of data-driven load forecasting methods. Three regression-based and seven deep learning algorithms with different model configurations were evaluated in terms of their overall and peak load prediction accuracy, and training burdens, across spatial aggregation levels ranging from the transformer, feeder, substation, to neighborhood. We found, first, the load forecasting accuracy is constrained by a predictability boundary, influenced by the forecasting horizon and spatial aggregation level. Specifically, RandomForest, XGBoost, TFT, TSMixer, and TiDE models achieved less than 10 % prediction error for up to 96-h ahead forecasting for district, substation, and feeder levels, while other models struggle at long-horizon predictions; Second, for winter and summer peak load dates, most models were able to predict the peak demand timing within ± 1 h, but the prediction percentage error varied by models, with TFT and TiDE models being the top performers; Third, models with similar prediction accuracy can differ in training burden by an order of magnitude. Therefore, choosing model configurations that balance prediction performance and computational resource is an important practical consideration for large-scale deployment of the machine learning based load forecasting. The outcome of this study can guide researchers and practitioners to choose the proper load forecasting algorithms based on their problem scope, required accuracy, and available resources. The predictability boundary can serve as a benchmark for electricity load forecasting problems with new algorithms and datasets.

Li, Han↗

A dose point kernel database using GATE Monte Carlo simulation toolkit for nuclear medicine applications: Comparison with other Monte Carlo codes

Purpose: GATE is a Monte Carlo simulation toolkit based on the Geant4 package, widely used for many medical physics applications, including SPECT and PET image simulation and more recently CT image simulation and patient dosimetry. The purpose of the current study was to calculate dose point kernels (DPKs) using GATE, compare them against reference data, and finally produce a complete dataset of the total DPKs for the most commonly used radionuclides in nuclear medicine. Methods: Patient-specific absorbed dose calculations can be carried out using Monte Carlo simulations. The latest version of GATE extends its applications to Radiotherapy and Dosimetry. Comparison of the proposed method for the generation of DPKs was performed for (a) monoenergetic electron sources, with energies ranging from 10 keV to 10 MeV, (b) beta emitting isotopes, e.g., {sup 177}Lu, {sup 90}Y, and {sup 32}P, and (c) gamma emitting isotopes, e.g., {sup 111}In, {sup 131}I, {sup 125}I, and {sup 99m}Tc. Point isotropic sources were simulated at the center of a sphere phantom, and the absorbed dose was stored in concentric spherical shells around the source. Evaluation was performed with already published studies for different Monte Carlo codes namely MCNP, EGS, FLUKA, ETRAN, GEPTS, and PENELOPE. A complete dataset of total DPKs was generated for water (equivalent to soft tissue), bone, and lung. This dataset takes into account all the major components of radiation interactions for the selected isotopes, including the absorbed dose from emitted electrons, photons, and all secondary particles generated from the electromagnetic interactions. Results: GATE comparison provided reliable results in all cases (monoenergetic electrons, beta emitting isotopes, and photon emitting isotopes). The observed differences between GATE and other codes are less than 10% and comparable to the discrepancies observed among other packages. The produced DPKs are in very good agreement with the already published data, which allowed us to produce a unique DPKs dataset using GATE. The dataset contains the total DPKs for {sup 67}Ga, {sup 68}Ga, {sup 90}Y, {sup 99m}Tc, {sup 111}In, {sup 123}I, {sup 124}I, {sup 125}I, {sup 131}I, {sup 153}Sm, {sup 177}Lu {sup 186}Re, and {sup 188}Re generated in water, bone, and lung. Conclusions: In this study, the authors have checked GATE's reliability for absorbed dose calculation when transporting different kind of particles, which indicates its robustness for dosimetry applications. A novel dataset of DPKs is provided, which can be applied in patient-specific dosimetry using analytical point kernel convolution algorithms.

61 RADIATION PROTECTION AND DOSIMETRY↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

An Evaluation and Qualification of U.S.-Based Research Reactors for Irradiation Capabilities Supporting Advanced Nuclear Systems

Irradiation experiments are a prerequisite for evaluating nuclear reactor system designs, analyzing the performance of these systems, and obtaining licenses. Likewise, irradiation facilities are necessary for producing the radioisotopes used in industrial and medical applications. Recent developments in modeling and simulation capabilities and advancements in computational resources have further enabled the design of irradiation experiments for evaluating radiation-induced phenomena and determining nuclear fuel, material, and system design and safety criteria pertaining to both normal and accident scenarios. These computational tools and models require comprehensive experimental datasets acquired under prototypic radiation conditions—for exploring material and system performance under the uniquely harsh environments found in nuclear reactors—to enable verification and validation for qualification and licensing purposes. However, qualification of irradiation experimental facilities, primarily research and test reactors (RTRs), necessitates that their performance be evaluated based on the irradiation environment (e.g. flux, power, testing capabilities) using an appropriate scoring matrix. Although many university campus RTRs are available for research and development (R&D) activities and initiatives, this study focuses on evaluating and qualifying the irradiation facilities (mostly RTRs) within the United States that are suitable for advanced nuclear fuel, material, and system irradiation experiments aimed at establishing operational-performance limits and informing component and fuel designs so as to improve operational efficiencies and mitigate proliferation vulnerabilities, as well as for radioisotope production aimed at multipurpose applications. As a result, the findings of the present study support the acceleration of nuclear fuel and material qualifications, thus hastening new and advanced nuclear energy system demonstrations and radioisotope production efforts by using extended R&D.

irradiation experiment↗