Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

OECD/NEA EGMPEBV Activities in Multi-Physics Verification and Validation

The Expert Group on Multi-Physics Experimental Data, Benchmarks and Validation (EGMPEBV) was established in 2014 by the Nuclear Energy Agency (NEA) at the Organization for Economic Co-operation and Development (OECD) to establish processes for certification of experimental data and development of benchmark models for validation of Multi-Physics (MP) Modeling and Simulation (M and S) computational systems. The aim of the group is to provide member countries with guidelines and recommendations for validating and improving their novel multi-physics simulations, and with an access to key experimental data. To be used to their full potential, these novel tools will require a more complex suite of validation experiments due to the multiple energy, spatial and temporal scales, as well as the number of physical phenomena being simulated. They will also require accurate measurements of all terms, including coupling terms representing the feedback effects, in situations where the appropriate experimental techniques and facilities might not exist today. However, the ability to conduct validation experiments has for certain applications progressed at a slower pace than for computational methods, or in some cases it has significantly regressed (through shutdown of facilities, or through retirement of experts). In addition, as modelling capabilities are reaching deeper levels in single physics phenomena and in coupled behaviors, appropriate experimental techniques may not yet exist. Validation of multiple physics models requires a wide variety of experimental data, which emphasizes the importance of maximizing the use of historically accumulated data to avoid the significant cost of performing similar experiments today. Moreover, the pedigree and quality of this data as it pertains to modern day simulation methods may be insufficient for rigorous validation of high fidelity modeling and simulation tools. Thus, these data can often exhibit limitations including a lack of measurement accuracy or a lack of knowledge of the measurement uncertainty in the experimental techniques; an absence of measurements for some critical parameters; an obscuring of relationships between individual physics phenomena owing to the output data resolution; or simply an inability to allow for a detailed reinterpretation of the experiments based on the documented information. The organization of the EGMPEBV relies on three Task Forces, focused on 1) Experimental Data Qualification and Benchmark Evaluation; 2) Methods and Standards, and 3) Specific Applications. Task Force 1 is focused on providing better and more accurate experimental datasets, which support validation of high-fidelity multi-physics modelling and simulation (M and S) tools. At the same time it has to consider the incompleteness of past experimental data sets (in terms of data, documentation, or uncertainties) and with the limited number of available multi-physics experimental facilities. Task Force 2 is designed to develop validation methods and guidelines, and uncertainty qualification for the new family of multi-physics, multi-scale codes in the context of emerging demands such as longer fuel cycles and power uprate. Task Force 3 is focused on applications of validation experiments and has the objective to organize multi-physics M and S benchmarks involving validation experiments.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Sewage Treatment Plant #1 Area, SWMU 117 Per- and Polyfluoroalkyl Substances (PFAS) Site Assessment Progress Report

This Per- and Polyfluoroalkyl Substances (PFAS) Site Assessment (SA) Progress Report (SAPR) discusses the investigation activities and findings for the Sewage Treatment Plant #1 (STP1) Area located at Kennedy Space Center (KSC), Florida (Figure 1-1). This site has been designated Solid Waste Management Unit (SWMU) 117 under KSC’s Resource Conservation and Recovery Act (RCRA) Corrective Action Program, as the sewage treatment plant and associated areas were identified as a potential source of PFAS to the environment. This PFAS SAPR was prepared by Tetra Tech, Inc., for the National Aeronautics and Space Administration (NASA) under Indefinite Delivery Indefinite Quantity Contract 80KSC019D0011-80KSC019F0070. This is the first progress report to document on-going SA activities; supplemental progress reports will be provided as additional data is collected. PFAS SA activities were conducted between April 2020 and March 2022 to collect additional data to supplement the existing datasets to better understand the extent of PFAS impacts to the environment in the STP1 Area. The SA for the STP1 Area covers an approximately 130-acre investigation area with multiple structures and buildings. The focus of the SA is the STP1 Complex and associated structures, including the former Polishing Pond, former Sludge Disposal8 Area, and former Spray Field. The STP1 Complex is located in the KSC Industrial Area, at the southwest corner of 4th Street SE and C Avenue SE. The STP1 Complex is located approximately ¼-mile south and downgradient of the Fire Station #1 site (SWMU 116), which is also currently undergoing a PFAS SA because of potential releases of PFAS-containing aqueous film-forming foam (AFFF). During the SA, a total of seven soil, 131 groundwater direct push technology (DPT), 24 groundwater monitoring well, and 11 surface water samples were collected between April 2020 and March 2022. Monitoring well samples were analyzed for 18 PFAS compounds, with all other samples analyzed for 28 PFAS compounds. The SA sample results were used along with historical results to evaluate the extent of PFAS impacts to the environment in the STP1 Area. Data generated to date and prior results were screened against the United States Environmental Protection Agency (USEPA) May 2022 Tap Water Regional Screening Levels (RSL) for groundwater and residential RSLs for soil (hazard quotient of 0.1). Surface water results were screened against the State of Florida Human Health Surface Water Screening Levels (SWSLs). Results from the SA showed exceedances of the applicable screening criteria for groundwater and surface water. Considering the current and historical dataset, PFOS is the prevalent PFAS compound. Based on these results, additional groundwater DPT and surface water sampling should be considered for PFAS analysis, focused on evaluating surface water bodies in the southeast portion of the Industrial Area, which discharge into the Banana River. Additionally, installation of monitoring wells should be considered to evaluate the interaction between the groundwater and surface water at the site. Collection of additional samples for TOC analysis should also be considered from representative groundwater (saturated soils) and surface water locations to further evaluate potential correlations between PFAS and TOC to provide a more comprehensive dataset to assist in fate and transport analyses.

Sewage Treatment Plant↗

Predicting nepheline precipitation in waste glasses using ternary submixture model and machine learning

Nepheline precipitation in nuclear waste glasses during vitrification can be detrimental due to its negative effect on chemical durability. Developing models to accurately predict nepheline precipitation from compositions is important to increase waste loading since existing models can be overly conservative. In this study, an expanded dataset containing 955 glasses was compiled from literature data, where 355 glasses are for high-level waste (HLW). Previously developed submixture models were refitted using the new dataset, where a misclassification rate of 7.8% was achieved. Nine machine learning (ML) algorithms (e.g., k-nearest neighbor, Gaussian process regression, artificial neural network, support vector machine, decision tree, etc.) were applied to evaluate their ability of predicting nepheline precipitation from compositions. Model accuracy, precision, recall/sensitivity, and F1 score were systemically compared between different ML algorithms and modeling protocols. Good model prediction with an accuracy ~0.9 (misclassification rate of ~10%) was observed with different algorithms under certain protocol. This study evaluated various ML models to predict nepheline precipitations in waste glasses, highlighting the importance of data preparation, modeling protocol, and their effect on model stability and reproducibility. The results provide insights into applying ML to predict glass properties and suggest areas for future research on modeling nepheline precipitations.

Lu, Xiaonan↗

Reference Shapefiles and Pre-trained Random Forest Classification Models for Detecting Aufeis on the North Slope of Alaska in Landsat Imagery

This dataset provides shapefiles and trained machine learning models used for aufeis detection at four sites on the North Slope of Alaska. It includes reference data for evaluating Landsat-based detection methods, supporting research on remote sensing approaches for identifying aufeis. The ReferenceData folder contains ArcGIS shapefiles of semi-automated land cover classifications for 217 Landsat Collection 2 images, categorizing pixels into six classes: aufeis, snow, ground, none, water, and cloud. The SiteBuffers.zip file includes 10-kilometer buffer shapefiles defining regions of interest around four aufeis fields (Canning21, FH1, Firth, and Kuparuk), used to test three detection techniques. Additionally, the TrainedRFModels folder contains six pre-trained Scikit-Learn Random Forest classifiers (100 trees, max depth = 30) designed to predict aufeis presence in Landsat Collection 2 Surface Reflectance images using Red, Blue, SWIR2, NDVI, and NDWI bands. This dataset supports the development and validation of remote sensing methods for mapping aufeis in Arctic environments.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Stereotactic Ablative Radiation Therapy for Subcentimeter Lung Tumors: Clinical, Dosimetric, and Image Guidance Considerations

Purpose: Use of stereotactic ablative radiation therapy (SABR) for subcentimeter lung tumors is controversial. We report our outcomes for tumors with diameter ≤1 cm and their visibility on cone beam computed tomography (CBCT) scans and retrospectively evaluate the planned dose using a deterministic dose calculation algorithm (Acuros XB [AXB]). Methods and Materials: We identified subcentimeter tumors from our institutional SABR database. Tumor size was remeasured on an artifact-free phase of the planning 4-dimensional (4D)-CT. Clinical plan doses were generated using either a pencil beam convolution or an anisotropic analytic algorithm (AAA). All AAA plans were recalculated using AXB, and differences among D95 and mean dose for internal target volume (ITV) and planning target volume (PTV) on the average intensity CT dataset, as well as for gross tumor volume (GTV) on the end respiratory phases were reported. For all AAA patients, CBCT scans acquired during each treatment fraction were evaluated for target visibility. Progression-free and overall survival rates were calculated using the Kaplan-Meier method. Results: Thirty-five patients with 37 subcentimeter tumors were eligible for analysis. For the 22 AAA plans recalculated using AXB, Mean D95 ± SD values were 2.2 ± 4.4% (ITV) and 2.5 ± 4.8% (PTV) lower using AXB; whereas mean doses were 2.9 ± 4.9% (ITV) and 3.7 ± 5.1% (PTV) lower. Calculated AXB doses were significantly lower in one patient (difference in mean ITV and PTV doses, as well as in mean ITV and PTV D95 ranged from 22%-24%). However, the end respiratory phase GTV received at least 95% of the prescription dose. Review of 92 CBCT scans from all AAA patients revealed that the tumor was visualized in 82 images, and its position could be inferred in other images. The 2-year local progression-free survival was 100%. Conclusions: Patients with subcentimeter lung tumors are good candidates for SABR, given the dosimetry, ability to localize tumors with image guidance, and excellent local control.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Verified, Archived, Library of Inputs and Data (VALID) Supporting Files

This dataset contains input, output, and sensitivity data files for computational simulations with the SCALE code system as part of the Verified, Archived Library of Inputs and Data (VALID). The simulations cover critical benchmark experiments from the International Criticality Safety Benchmark Evaluation Project. The files are to be housed in a public directory for distribution. The information contained in the files have been approved for release by the Organisation for Economic Co-operation and Development Nuclear Energy Agency (NEA). Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases.

keff↗

A validated tumor control probability model based on a meta-analysis of low, intermediate, and high-risk prostate cancer patients treated by photon, proton, or carbon-ion radiotherapy

Purpose: A fully heterogeneous population averaged mechanistic tumor control probability (TCP) model is appropriate for the analysis of external beam radiotherapy (EBRT). This has been accomplished for EBRT photon treatment of intermediate-risk prostate cancer. Extending the TCP model for low and high-risk patients would be beneficial in terms of overall decision making. Furthermore, different radiation treatment modalities such as protons and carbon-ions are becoming increasingly available. Consequently, there is a need for a complete TCP model. Methods: A TCP model was fitted and validated to a primary endpoint of 5-year biological no evidence of disease clinical outcome data obtained from a review of the literature for low, intermediate, and high-risk prostate cancer patients (5218 patients fitted, 1088 patients validated), treated by photons, protons, or carbon-ions. The review followed the preferred reporting item for systematic reviews and meta-analyses statement. Treatment regimens include standard fractionation and hypofractionation treatments. Residual analysis and goodness of fit statistics were applied. Results: The TCP model achieves a good level of fit overall, linear regression results in a p-value of <0.000 01 with an adjusted-weighted-R{sup 2} value of 0.77 and a weighted root mean squared error (wRMSE) of 1.2%, to the fitted clinical outcome data. Validation of the model utilizing three independent datasets obtained from the literature resulted in an adjusted-weighted-R{sup 2} value of 0.78 and a wRMSE of less than 1.8%, to the validation clinical outcome data. The weighted mean absolute residual across the entire dataset is found to be 5.4%. Conclusions: This TCP model fitted and validated to clinical outcome data, appears to be an appropriate model for the inclusion of all clinical prostate cancer risk categories, and allows evaluation of current EBRT modalities with regard to tumor control prediction.

61 RADIATION PROTECTION AND DOSIMETRY↗

Integrated Hourly Meteorological Database of 20 Meteorological Stations (1981-2022) for Watershed Function SFA Hydrological Modeling

This dataset contains (a) a script “R_met_integrated_for_modeling.R”, and (b) associated input CSV files: 3 CSV files per location to create a 5-variable integrated meteorological dataset file (air temperature, precipitation, wind speed, relative humidity, and solar radiation) for 19 meteorological stations and 1 location within Trail Creek from the modeling team within the East River Community Observatory as part of the Watershed Function Scientific Focus Area (SFA). As meteorological forcings varied across the watershed, a high-frequency database is needed to ensure consistency in the data analysis and modeling. We evaluated several data sources, including gridded meteorological products and field data from meteorological stations. We determined that our modeling efforts required multiple data sources to meet all their needs. As output, this dataset contains (c) a single CSV data file (*_1981-2022.csv) for each location (20 CSV output files total) containing hourly time series data for 1981 to 2022 and (d) five PNG files of time series and density plots for each variable per location (100 PNG files). Detailed location metadata is contained within the Integrated_Met_Database_Locations.csv file for each point location included within this dataset, obtained from Varadharajan et al., 2023 doi:10.15485/1660962. This dataset also includes (e) a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata and (f) a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type. Review the (g) ReadMe_Integrated_Met_Database.pdf file for additional details on the script, methods, and structure of the dataset.The script integrates Northwest Alliance for Computational Science and Engineering’s PRISM gridded data product, National Oceanic and Atmospheric Administration’s NCEP-NCAR Reanalysis 1 gridded data product (through the `RCNEP` R package, Kemp et al., doi:10.32614/CRAN.package.RNCEP), and analytical-based calculations. Further, this script downscales the input data into hourly frequency, which is necessary for the modeling efforts.

54 ENVIRONMENTAL SCIENCES↗

Renewable Energy Potential Model: Priority Geothermal Leasing Areas ReEDs Results

This dataset contains the results of a study conducted by the National Renewable Energy Laboratory (NREL) to identify potential future priority geothermal leasing areas on Bureau of Land Management (BLM) and United States Forest Service (USFS) lands. The analysis uses the Regional Energy Deployment System (ReEDS) model to evaluate geothermal resource potential under different scenarios of resource depth and technology combinations through the year 2050. The study considers geothermal resource potential, natural resource conflicts, and transmission access to categorize areas into near, mid, and far deployment priorities. The dataset includes outputs from the ReEDS model, such as geothermal capacity, generation, system costs, and emissions under various economic and technical scenarios. Favorability site data with geographic coordinates and site-specific attributes (e.g., resource favorability, land type) are also provided. Supporting resources include a technical report detailing methodologies and assumptions, along with a link to the ReEDS model GitHub repository, which requires GAMS and Python software for execution.

15 GEOTHERMAL ENERGY↗

Uncertainty in land carbon budget simulated by terrestrial biosphere models: the role of atmospheric forcing

Global estimates of the land carbon sink are often based on simulations by terrestrial biosphere models (TBMs). The use of a large number of models that differ in their underlying hypotheses, structure and parameters is one way to assess the uncertainty in the historical land carbon sink. Here we show that the atmospheric forcing datasets used to drive these TBMs represent a significant source of uncertainty that is currently not systematically accounted for in land carbon cycle evaluations. We present results from three TBMs each forced with three different historical atmospheric forcing reconstructions over the period 1850–2015. We perform an analysis of variance to quantify the relative uncertainty in carbon fluxes arising from the models themselves, atmospheric forcing, and model-forcing interactions. We find that atmospheric forcing in this set of simulations plays a dominant role on uncertainties in global gross primary productivity (GPP) (75% of variability) and autotrophic respiration (90%), and a significant but reduced role on net primary productivity and heterotrophic respiration (30%). Atmospheric forcing is the dominant driver (52%) of variability for the net ecosystem exchange flux, defined as the difference between GPP and respiration (both autotrophic and heterotrophic respiration). In contrast, for wildfire-driven carbon emissions model uncertainties dominate and, as a result, model uncertainties dominate for net ecosystem productivity. At regional scales, the contribution of atmospheric forcing to uncertainty shows a very heterogeneous pattern and is smaller on average than at the global scale. We find that this difference in the relative importance of forcing uncertainty between global and regional scales is related to large differences in regional model flux estimates, which partially offset each other when integrated globally, while the flux differences driven by forcing are mainly consistent across the world and therefore add up to a larger fractional contribution to global uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with a high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗

Radiometric Assessment of the First Three Years of the NOAA-20 VIIRS Reflective Solar Bands Calibration

NASA’s Clouds and the Earth’s Radiant Energy System (CERES) SYN1deg Ed4.1 product utilizes geostationary (GEO) satellite measured radiances and retrieved cloud properties to account for the regional diurnal fluctuations in the Earth’s radiant broadband fluxes for times between the CERES measurements gathered from the Aqua (1:30 PM) and Terra (10:30 AM) sun-synchronous satellites. In CERES Edition 4 products, a global uniformity in the cloud properties and computed surface fluxes across the GEO satellite domains is maintained by scaling the radiance observations from more than twenty GEO visible imagers in the CERES record to a common radiometric reference scale, i.e., Aqua-MODIS. With the new-generation GEO (Himawari-8/9 and GOES-16/17) imagers having multiple reflective solar bands (RSB) that are spectrally similar to those of VIIRS, the CERES Imager and Geostationary Calibration Group (IGCG) is preparing to use NOAA-20 VIIRS as the reference imager for maintaining the radiometric uniformity across the GEO imager constellation. Given the recent Aqua satellite anomaly, this transition may happen sooner than the projected date of Aqua’s de-orbit. This paper presents an independent performance evaluation of the first three years of the NOAA-20 VIIRS RSB calibration in the NASA VIIRS Land Science Investigator-led Processing System (Land SIPS) L1b Collection 2 dataset. The temporal radiometric stability is assessed using multiple invariant Earth targets, including tropical deep convective clouds and the Saharan desert. The invariant target anisotropic reflectance at the top of the atmosphere was modeled using five years of stable satellite observations acquired from the previous VIIRS instrument onboard the Suomi National Polar-orbiting Partnership (S-NPP) satellite. The anisotropic corrections are essential for detecting temporal trends with high statistical confidence. In addition, the radiometric consistency between the RSB of the two VIIRS instruments will be evaluated.

Rajendra Bhatt↗

Methods, software and datasets to verify DVH calculations against analytical values: Twenty years late(r)

Purpose: The authors designed data, methods, and metrics that can serve as a standard, independent of any software package, to evaluate dose-volume histogram (DVH) calculation accuracy and detect limitations. The authors use simple geometrical objects at different orientations combined with dose grids of varying spatial resolution with linear 1D dose gradients; when combined, ground truth DVH curves can be calculated analytically in closed form to serve as the absolute standards. Methods: DICOM RT structure sets containing a small sphere, cylinder, and cone were created programmatically with axial plane spacing varying from 0.2 to 3 mm. Cylinders and cones were modeled in two different orientations with respect to the IEC 1217 Y axis. The contours were designed to stringently but methodically test voxelation methods required for DVH. Synthetic RT dose files were generated with 1D linear dose gradient and with grid resolution varying from 0.4 to 3 mm. Two commercial DVH algorithms—PINNACLE (Philips Radiation Oncology Systems) and PlanIQ (Sun Nuclear Corp.)—were tested against analytical values using custom, noncommercial analysis software. In Test 1, axial contour spacing was constant at 0.2 mm while dose grid resolution varied. In Tests 2 and 3, the dose grid resolution was matched to varying subsampled axial contours with spacing of 1, 2, and 3 mm, and difference analysis and metrics were employed: (1) histograms of the accuracy of various DVH parameters (total volume, D{sub max}, D{sub min}, and doses to % volume: D99, D95, D5, D1, D0.03 cm{sup 3}) and (2) volume errors extracted along the DVH curves were generated and summarized in tabular and graphical forms. Results: In Test 1, PINNACLE produced 52 deviations (15%) while PlanIQ produced 5 (1.5%). In Test 2, PINNACLE and PlanIQ differed from analytical by >3% in 93 (36%) and 18 (7%) times, respectively. Excluding D{sub min} and D{sub max} as least clinically relevant would result in 32 (15%) vs 5 (2%) scored deviations for PINNACLE vs PlanIQ in Test 1, while Test 2 would yield 53 (25%) vs 17 (8%). In Test 3, statistical analyses of volume errors extracted continuously along the curves show PINNACLE to have more errors and higher variability (relative to PlanIQ), primarily due to PINNACLE’s lack of sufficient 3D grid supersampling. Another major driver for PINNACLE errors is an inconsistency in implementation of the “end-capping”; the additional volume resulting from expanding superior and inferior contours halfway to the next slice is included in the total volume calculation, but dose voxels in this expanded volume are excluded from the DVH. PlanIQ had fewer deviations, and most were associated with a rotated cylinder modeled by rectangular axial contours; for coarser axial spacing, the limited number of cross-sectional rectangles hinders the ability to render the true structure volume. Conclusions: The method is applicable to any DVH-calculating software capable of importing DICOM RT structure set and dose objects (the authors’ examples are available for download). It includes a collection of tests that probe the design of the DVH algorithm, measure its accuracy, and identify failure modes. Merits and applicability of each test are discussed.

60 APPLIED LIFE SCIENCES↗

Design, Detection, and Countermeasure of Frequency Spectrum Attack and Its Impact on Long Short-Term Memory Load Forecasting and Microgrid Energy Management

This paper introduces a frequency-domain false data injection attack called Frequency Spectrum Attack (FSA) and explores its effects on load forecasting and the energy management system (EMS) in a microgrid. The FSA analyzes time-series signals in the frequency domain to identify patterns in their frequency spectrum. It learns the distribution of dominant frequencies in a dataset of healthy signals. Subsequently, it manipulates the amplitudes of dominant frequencies within this healthy distribution, ensuring a stealthy attack against statistical analysis of the signal spectrum. We evaluated the performance of FSA on LSTM, a state-of-the-art network for load forecasting. The results show that FSA can triple the Mean Absolute Error (MAE) of predictions compared to the normal case and increase it by 70% compared to noise injection attacks. Furthermore, FSA indirectly enhances battery utilization in the EMS by 45%. We then proposed a detection method that combines statistical analysis and machine-learning-based classification techniques with features. The model effectively distinguishes FSA from healthy and noisy signals, achieving an accuracy of 98.7% and an F1-score of 98.1% on a load dataset, covering healthy, FSA, and noisy load data. Finally, a countermeasure was introduced based on the statistical analysis of the frequency spectrum of healthy signals to mitigate the impact of FSA. This countermeasure successfully reduces the MAE of the attacked model from 0.135 to 0.053, validating its effectiveness in mitigating FSA.

Nazeri, Amirhossein↗

Analyzing the Impact of Future Weather Data on Energy Consumption in Weatherization Assistant

This study supports the mission of the U.S. Department of Energy’s Weatherization Assistance Program (WAP), which aims to increase the energy efficiency of dwellings and reduce their total residential expenditures. Specifically, we examine how projected future climate conditions may affect residential building energy performance by integrating future weather data into the National Energy Audit Tool (NEAT). Since WAP evaluates the cost-effectiveness of retrofit measures over lifespans of up to 30 years, accounting for evolving climate conditions is increasingly important. To reflect future household energy demands, this study replaces historically based Typical Meteorological Year (TMY3) weather inputs with Future Typical Meteorological Year (fTMY) datasets derived from global climate model (GCM) projections. A simulation-based framework was established to enable NEAT analysis under future weather conditions. This workflow involves converting EPW-format weather files into JSON inputs compatible with NEAT and generating degree-hour metrics needed for load calculations. The fTMY dataset used in this study was developed by Oak Ridge National Laboratory through downscaling of six GCMs under different emission scenarios and covers the period from 2020 to 2100. In contrast, the TMY3 dataset is based on historical weather data from 1961 to 1990. Simulations were conducted for benchmark single-family prototype buildings across ASHRAE climate zones 1–7, which cover all regions of the U.S. except the subarctic Zone 8 in northern Alaska, evaluating both heating and cooling loads under TMY3 and fTMY conditions. Four foundation types were tested, while heating systems were standardized, as NEAT does not differentiate thermal energy load by HVAC system type in its load calculations. Results show that fTMY weather input consistently yield lower heating loads and higher cooling loads across most locations, aligning with expected climate warming trends. Notably, colder regions such as zones 6A, 6B, and 7 experience marked reductions in heating load, while warmer and transitional zones, such as 2A (Lufkin, TX) and 3C (San Francisco, CA), have substantial increases in cooling loads. Although this study does not directly assess the performance of retrofit measures under future climate conditions, it provides a critical foundation for doing so. By quantifying shifts in baseline (i.e., pre-retrofit case) energy loads between historical and future weather files, the study highlights the importance of integrating climate-responsive data into audit tools. These findings will inform future efforts to evaluate the long-term effectiveness and cost-effectiveness of weatherization measures under changing climate conditions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Surrogate Model Selection for Design Space Approximation And Surrogatebased Optimization

Surrogate models are used to map input data to output data when the actual relationship between the two is unknown or computationally expensive to evaluate for sensitivity analysis, uncertainty propagation and surrogate based optimization. This work evaluates the performance of eight surrogate modeling techniques for design space approximation and surrogate based optimization applications over a set of generated datasets with known characteristics. With this work, we aim to provide general rules for selecting an appropriate surrogate model form solely based on the characteristics of the data being modeled. Furthermore, the computational experiments revealed that, in general, multivariate adaptive regression spline models (MARS) and single hidden layer feed forward neural networks (ANN) yielded the most accurate predictions over the design space while Random Forest (RF) models most reliably identified the locations of the optimums when used for surrogate-based optimization.

97 MATHEMATICS AND COMPUTING↗

What are the effects of Agro-Ecological Zones and land use region boundaries on land resource projection using the Global Change Assessment Model?

Understanding the potential impacts of climate change is complicated by mismatched spatial representations between gridded Earth System Models (ESMs) and Integrated Assessment Models (IAMs), whose regions are typically larger and defined by geopolitical and biophysical criteria. In this study we address uncertainty stemming from the construction of land use regions in an IAM, the Global Change Assessment Model (GCAM), whose regions are currently based on historical climatic conditions (1961-1990). We re-define GCAM’s regions according to projected climatic conditions (2070-2099), and investigate how this changes model outcomes for land use, agriculture, and forestry. By 2100, we find potentially large differences in projected global and regional area of biomass energy crops, fodder crops, harvested forest, and intensive pasture. These land area differences correspond with changes in agricultural commodity prices and production. These results have broader implications for understanding policy scenarios and potential impacts, and for evaluating and comparing IAM and ESM simulations.

54 ENVIRONMENTAL SCIENCES↗