Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2021

Assessing the Energy Resilience of Office Buildings: Development and Testing of a Simplified Metric for Real Estate Stakeholders

Increasing concern over higher frequency extreme weather events is driving a push towards a more resilient built environment. In recent years there has been growing interest in understanding how to evaluate, measure, and improve building energy resilience, i.e., the ability of a building to provide energy-related services in the event of a local or regional power outage. In addition to human health and safety, many stakeholders are keenly interested in the ability of a building to allow continuity of operations and minimize business disruption. Office buildings are subject to significant economic losses when building operations are disrupted due to a power outage. We propose “occupant hours lost” (OHL) as a means to measure the business productivity lost as the result of a power outage in office buildings. OHL is determined based on indoor conditions in each space for each hour during a power outage, and then aggregated spatially and temporally to determine the whole building OHL. We used quasi-Monte Carlo parametric energy simulations to demonstrate how the OHL metric varies due to different building characteristics across different climate zones and seasons. The simulation dataset was then used to develop simple regression models for assessing the impact of ten key building characteristics on OHL. The most impactful were window-to-wall ratio and window characteristics. The regression models show promise as a simple means to assess and screen for resilience using basic building characteristics, especially for non-critical facilities where it may not be viable to conduct detailed engineering analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Can Simple Metrics Identify the Process(es) Driving Extreme Precipitation?

This work seeks an automatic algorithm to determine the primary meteorological cause(s) of individual extreme precipitation events. Such determinations have been made before, but required a by-hand analysis of each separate event. This is very time-consuming and the field would benefit from an automatic process. This is especially relevant when comparing different datasets to determine which ones most closely hew towards reality. This paper tests three simple metrics over the continental United States using the European Center for Medium-Range Weather Forecasting’s (ECMWF) atmospheric reanalysis (ERA5). The metrics tested measure and compare the strength of three meteorological processes associated with extreme precipitation: fronts, convection, and cyclones. A multivariate statistical technique as well as individual case studies show evidence that the three meteorological processes of interest cannot be isolated from one another using these simple physical metrics. This shows the difficulty in finding “pure” cases of these precipitation-generating processes and suggests approaching these processes with an eye toward mixed-type events.

Swenson, Leif M. (ORCID:0000000199708735)↗
DOE OSTI2023

Exploring pressure-dependent inelastic deformation and failure in bonded granular composites: An energetic materials perspective

In polymer-filled granular composites, damage may develop in mechanical loading prior to material failure. Damage mechanisms such as microcracking or plastic deformation in the binder phase can substantially alter the material’s mesostructure. For energetic materials, such as solid propellants and plastic bonded explosives, these mesostructural changes can have far reaching effects including degraded mechanical properties, potentially increased sensitivity to further insults, and changes in expected performance. Unfortunately, predicting damage is nontrivial due to the complex nature of these composites and the entangled interactions between inelastic mechanisms. In this work, we assess the current literature of experimental knowledge, focusing on the pressure-dependent shear response, and propose a simple simulation framework of bonded particles to study four limiting-case material formulations at both meso- and macro-scales. Further, to construct the four cases, we systematically vary the relative interfacial strength between the polymer binder and granular filler phase and also vary the polymer’s glass transition temperature relative to operating temperature which determines how much the binder can plastically deform. These simulations identify key trends in global mechanical response, such as the emergence of strain hardening or softening regimes with increasing pressure which qualitatively resemble experimental results. By quantifying the activation of different inelastic mechanisms, such as bonds breaking and plastically straining, we identify when each mechanism becomes relevant and provide insight into potential origins for changes in mechanical responses. The locations of broken bonds are also used to define larger, mesoscopic cracks to test various metrics of damage. We primarily focus on triaxial compression, but also test the opposite case of triaxial extension to highlight the impact of Lode angle on mechanical behavior.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Superposed metric for spinning black hole binaries approaching merger

Here, we construct an approximate metric that represents the spacetime of spinning binary black holes (BBH) approaching merger. We build the metric as an analytical superposition of two Kerr metrics in harmonic coordinates, where we transform each black hole term with time-dependent boosts describing an inspiral trajectory. The velocities and trajectories of the boost are obtained by solving the post-Newtonian (PN) equations of motion at 3.5 PN order. We analyze the spacetime scalars of the new metric and we show that it is an accurate approximation of Einstein’s field equations in vacuum for a BBH system in the inspiral regime. Furthermore, to prove the effectiveness of our approach, we test the metric in the context of a 3D general relativistic magnetohydrodynamical (GRMHD) simulation of accreting minidisks around the black holes. We compare our results with a previous well-tested spacetime construction based on the asymptotic matching method. We conclude that our new spacetime is well-suited for long-term GRMHD simulations of spinning binary black holes on their way to the merger.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

A call to standardize metrics for monitoring baleen whales near marine construction activities

Effective monitoring is necessary to protect marine mammal species during the construction of offshore infrastructure. The tools for detecting or monitoring marine mammals span traditional (e.g., visual observers, optical cameras), to newer (e.g., passive acoustic monitoring, infrared cameras, tags), and emerging (e.g., satellite imagery, environmental DNA, dimethyl sulfide concentration) technologies. Some are better suited for use during offshore development; however, peer-reviewed literature does not typically evaluate and report on the performance of these various technologies. We define a minimum set of metrics related to efficacy (i.e., confusion matrix, precision and recall, probability of missed mitigation), detection range (i.e., maximum and reliable detection range, spatial resolution), and data delivery (i.e., detection latency, system reliability, temporal resolution) that we recommend are needed to assess the utility of monitoring technologies for this purpose. Following a literature review of relevant studies, we highlight which publications reported these metrics and used multiple technologies to compare relative performance. We also emphasize the benefits of multi-modal approaches and recommend performance assessments through modeling or large-scale collaborative field testing. These metrics will standardize data collection, reporting, and analysis; promote consistent and comparable results; and foster collaboration among developers, regulatory agencies, and scientists. This may lead to the co-development of technology that achieves multiple goals, has greater application, and can answer research questions while collecting data to fulfill permitting requirements. These metrics may also inform decisions on what systems regulatory agencies might consider using and reduce monitoring costs, which is critical to support the marine sector's rapid growth alongside marine mammal conservation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Statistical Tests for Diagnosing Fission Source Convergence and Undersampling in Monte Carlo Criticality Calculations [Slides]

There is a very strong need for statistical testing to determine fission source convergence in Monte Carlo criticality calculations. Automation of such tests will greatly streamline and support the work carried out by NCS practitioners. Recent R&D work has shown that no single statistical test for convergence is sufficiently reliable, robust, and “guaranteed.” However, a combination of several standard statistical tests for the similarity of distributions, coupled with a high-fidelity estimate of the fission-matrix source is sufficiently robust, reliable, and repeatable that convergence can be “guaranteed.” During the course of the EG-AMCT studies, a number of statistical metrics and tests were proposed for diagnosing clustering and undersampling. None of these was robust and reliable enough for practical use in production codes. However, the expert group efforts came close. Some recent R&D work stemming from those past efforts has been very successful and promising. This Sub-Group will provide international input and collaboration on the development and implementation of statistical tests for convergence, with the primary goal of having the MC codes automatically detect convergence (or lack thereof). Newly proposed statistical tests to detect undersampling (after convergence) will also be reviewed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Data-Driven Understanding of Low-to-Moderate Income Customers’ Adoption and Financial Qualification in Community Solar (Final Technical Report)

When Solstice began working in the community solar industry, it quickly became clear that there was a wide disparity along race and class lines in terms of what kind of household traditional solar offerings benefited. Solstice is an organization that aligns itself to the principles of a Just Transition, or the concept that a transition to a green economy should benefit and prioritize historically marginalized groups of people. Given that low-income communities are disproportionately burdened by our current polluting fossil fuel economy, Solstice set out to investigate the root causes of the exclusion of low to moderate income (LMI) households in the community solar market. As we worked more and more with financiers, developers, and LMI households, we recognized that significant barriers to entry in a developer-owned project were credit threshold requirements. A FICO score of 750 and higher discriminates against LMI households that are not financially stable enough to take on multiple lines of credit (or who may not have been deemed credit worthy enough to access a line of credit) yet who may have been reliable utility customers. As Solstice began looking further into preliminary data and speaking to community-based organizations (CBOs) that serve LMI households, we found our hypothesis to be worth investigating; there was indeed a subset of LMI households with poor FICO scores (or no FICO score at all) that had perfect bill payment history. Though initially Solstice was intent on gathering a body of data to prove or disprove this hypothesis, we were also concerned that all this proof of a financially stable and reliable customer was not being incorporated into FICO, and wondered if such a score would be possible. After preliminary research into the existence of alternative scores, Solstice realized that many mission-driven lending institutions rely on alternative metrics that are formulated for their specific industry. However, we also realized that community solar did not have an alternative credit underwriting mechanism, though there was great need from solar financiers for one. We anticipated that the creation of an EnergyScore would contribute to financiers’ need to qualify more people, as these entities are desperately looking for ways to lower the cost of customer acquisition. FICO turns away nearly 50% of potential customers (according to our own acquisition experience), and much of the community solar industry is realizing that FICO is not the perfect qualifying mechanism. Additionally, with a grounding in energy justice, just transitions, and climate justice, Solstice recognizes the need for a solution that addresses a more urgent need for LMI households to access renewable energy savings and relieve energy burdens. With funding from the Department of Energy, we gathered the data necessary to build the EnergyScore, reached out to mission-driven developers willing to test the metric, and secured several demonstration projects to pilot the EnergyScore. After acquiring customers for these demo projects using the EnergyScore, we will be continuously collecting customer payment behavior data. Though it goes beyond the scope of this project, we plan to disseminate this de-identified data with the wider community solar industry, which includes not only financiers and developers, but other mission-driven nonprofits, solar cooperatives, community-based organizations, environmental justice activists, and academics. While we intend to disprove the notion that LMI households cannot be included in projects without acutely increasing the risk to project finances, we also hope the data can be used to negotiate better pricing of systems and terms of ownership for community groups seeking to build inclusive projects.

14 SOLAR ENERGY↗
DOE OSTI2025

MPEX AI Digital Twins

All magnetically confined plasma fusion power plant concepts (Tokamak, Spherical Tokamak, Stellarator, Mirror, ...) must exhaust the heat and plasma from the core confinement region to the material walls. The primary channel for this exhaust is through a plasma divertor which directs plasma along open magnetic field lines to a material target. The Material Plasma Exposure eXperiment (MPEX) illustrated in Figure 1, is a high-power, steady-state linear plasma device designed to produce the plasma material interaction (PMI) conditions of the divertor of future magnetic confinement fusion power plants: energy flux 20MW/m 2 , ion fluence 1031/m 2 , pulse duration 106 sec. These goals of plasma exposure in MPEX are well beyond those achieved in magnetic fusion experimental devices. Successfully achieving these high power steady state conditions for long pulses requires operational control of the heating and particle sources and the plasma flux to the walls and target. The MPEX AI Hot Spot Controller, proposed in this project, will help achieve the operational milestones of MPEX. The MPEX device will begin commissioning at the end of FY26. A smaller proto-MPEX was operated for 14,666 plasma discharges and will resume operation in September of 2025 as proto-MPEX-lite, with reduced capability, to test a new window for the Helicon plasma source. The proto-MPEX data has undergone surrogate modeling with machine learning methods (R. Archibald, 2022 IEEE International Conference on Big Data). This proto-MPEX data will be used to begin development of the AI digital twins described in this white paper. The scientific mission of MPEX is to qualify materials of different composition for use in the high energy and plasma flux conditions of a fusion power plant. The materials exposed in MPEX will in some cases be exposed to high neutron fluxes at other ORNL facilities to measure the changes to their PMI properties. The targets exposed in MPEX will be transported under vacuum to a Surface Analysis Station (SAS). The SAS will be equipped with the following diagnostics: Focused Ion Beam (FIB) for trench milling, 100-400 angstrom resolution scanning electron microscope (SEM), surface mapping x-ray spectrometer, high resolution camera, and a future upgrade to a laser induced breakdown spectroscopy quadruple mass spectrometer (LIBS-QMS). The MPEX experiments will generate diverse pre- and post-exposure measurement data of detailed material properties down to the crystal grain level in 3D for post-exposure assessment of PMI damage (e.g. cracking, melting, erosion and redeposition of the material). Physics models for the PMI, and how the material composition and manufacturing impact its performance under high energy plasma exposure, need to be validated with MPEX data to guide the selection of new candidate materials. Our vision for the MPEX AI Digital Twins project is to supply experimental and physics model simulation data to train Artificial Intelligence (AI) models for data processing, analysis, operational control, PMI and materials simulation to maximize the scientific output of the MPEX device. Ultimately, an AI digital twin of MPEX material assessment metrics for tested and synthetic material types with simulated PMI will be trained by the AI Modeling Teams on the experimental and physics simulation data submitted to the American Science Cloud by this project. A purely empirical search for the best material is inefficient given the finite number of samples that can be tested on MPEX. In order to expand the material properties database for training the MPEX Material Assessment AI Digital Twin, and to gain physics understanding of the PMI processes, physics models of the material properties and PMI processes are required. The physics simulations provide detailed simulation data, like impact angles for plasma ions, sputtering yields, transport of the ionized sputtered target material in the plasma, and redeposition locations. This simulation data expands the measurement data for deeper physics understanding. The experimental data is essential to validate the PMI and material structure simulation models. The validated models can then be used to generate new simulation data of MPEX material assessments for synthetic material compositions that have not been exposed in MPEX. These predictive simulations, plus the whole experimental dataset, will be used to train the MPEX Material Assessment AI Digital Twin allowing a rapid generative AI search for new materials with reduced PMI damage by interpolating the domain of the training set. These new optimum materials can be simulated with the physics codes and/or tested in MPEX. The ability of AI neural networks to interpolate multi-dimensional parameter spaces and generate virtual data is exploited for a more efficient search for optimum materials. The advent of the Transformational AI Models Consortium (TAIMC) is an opportunity to engage with state of the art private and public AI developers to achieve the goals of the AI digital twins and AI accelerated physics models proposed in this project. Our partners at ORNL from the Advance Scientific Computing Research (ASCR) organization will collaborate in accelerating the integrated plasma material interaction simulation framework. This simulation framework will provide a platform for generating simulation data across a range of physical fidelities, including hybrid methods that produce multi-fidelity results. This data will be leveraged for AI model development, both for generation of surrogates and the automation of simulation campaigns. A part of the research below will include collaborative efforts with the TAIMC to (i) adapt data storage approaches to ensure AI-readiness, (ii) provide a protypical exemplar to inform and exercise constructed workflows, and (iii) generate and share data, using the TAIMC unified AI data standard, for foundational models that will be trained from multiple sources across the DOE complex. We will also collaborate with the TAIMC, as well as the planned AI modeling teams, to develop approaches for reducing the cost of data generation. These include tailored multi-fidelity approaches as well as fine-tuning strategies to augment general, large-scale foundational models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

A new spatially distributed added value index for regional climate models: the EURO-CORDEX and the CORDEX-CORE highest resolution ensembles

The added value of using regional climate models (RCMs) to downscale data from general circulation models (GCMs) has often been questioned and researched. Although several studies have used different methods to identify (and in some cases quantify) the added value, there is still a need to find a general metric that quantifies the added value of any variable. This paper builds on past studies to propose a new metric of added value in the simulation of present-day climate which measures the difference in the probability density functions (PDFs) at each grid-cell between a model and an observation source, and then compares the results of the RCM and GCM in order to spatially compute the added value index. The same method is also adapted to quantify the climate change downscaling signal in a way that is consistent with the present-day metric. These new metrics are tested on the daily precipitation output from the EURO-CORDEX and CORDEX-CORE projection ensembles and reveal an overall positive added value of RCMs, especially at the tail-end of the distribution. Higher added value is obtained in areas of complex topography and coast-lines, as well as in tropical regions. Areas with large added value in present-day climate are consistent with areas of significant climate change downscaling signal in the RCP 8.5 far future simulations, and when the analysis is repeated at a low-resolution. The use of different resolution observations shows that the added value tends to decrease when models are compared to low-resolution observation datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Proactive demand-side participation: Centralized versus transactive demand-Supply coordination

The active participation of demand-side flexible resources in the wholesale market price formation and load dispatch process is crucial to encouraging demand-side participation. This calls for a joint supply-demand coordination mechanism to fully take advantage of the flexible resources in distribution systems, including distributed energy resources (DERs) and responsive loads (RLs). Here this paper aims at comparing and evaluating the centralized and transactive distribution-level market coordination mechanisms. We introduce the centralized and transactive demand-supply coordination mechanisms for the distribution-level market and elaborate on the structural difference between the two frameworks. Relevant metrics and test scenarios are proposed for a meaningful comparison. The key observations of the comparative study are generalized from the perspective of different entities in the market: fixed loads, flexible loads, DERs, and conventional generators. It is observed that while the centralized approach leads to socially optimum solutions, the transactive approach by allowing for competitive bidding at the distribution-level, results in clearing higher flexible demand, and thus higher electricity cost at the transmission-level. As a result, DERs and fixed loads receive a higher surplus in the centralized approach, while conventional generators and flexible loads are more profitable in the transactive approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Initial soil organic carbon stocks govern changes in soil carbon: Reality or artifact?

Abstract Changes in soil organic carbon (SOC) storage have the potential to affect global climate; hence identifying environments with a high capacity to gain or lose SOC is of broad interest. Many cross‐site studies have found that SOC‐poor soils tend to gain or retain carbon more readily than SOC‐rich soils. While this pattern may partly reflect reality, here we argue that it can also be created by a pair of statistical artifacts. First, soils that appear SOC‐poor purely due to random variation will tend to yield more moderate SOC estimates upon resampling and hence will appear to accrue or retain more SOC than SOC‐rich soils. This phenomenon is an example of regression to the mean. Second, normalized metrics of SOC change—such as relative rates and response ratios—will by definition show larger changes in SOC at lower initial SOC levels, even when the absolute change in SOC does not depend on initial SOC. These two artifacts create an exaggerated impression that initial SOC stocks are a major control on SOC dynamics. To address this problem, we recommend applying statistical corrections to eliminate the effect of regression to the mean, and avoiding normalized metrics when testing relationships between SOC change and initial SOC. Careful consideration of these issues in future cross‐site studies will support clearer scientific inference that can better inform environmental management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Integrated Mechanical System Pods (CRADA Final Report)

LBNL provided input to setting the requirements related to indoor air quality and contributed to the development of metrics and test plans to evaluate prototypes of the mechanical pods, which were developed by other members of the project team. The testing of prototypes was conducted by and at Syracuse University, another project partner. LBNL also collaborated with RMI to develop a basic plan for data collection when the pods are deployed for field testing in Phase 2.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Design, Development and Testing Plan for Energy Efficiency Algorithms Related to Building-Integrated Cooling, Heating, and Power Systems

Building-integrated cooling, heating and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. It is estimated that the total CHP technical potential in the commercial building sector is approximately 76 GW, but only a small fraction of it is actually deployed. Advanced control and monitoring systems that realize the full potential of these CHP systems can transform this capacity into an asset for both the owner and the grid and also accelerate the adoption of these systems in the building sector. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. It has been demonstrated by several studies that as much as 30% of building energy use is wasted. Much of the waste results from the inability to anticipate load variations (design day vs. non-design day operations; diurnal variation of loads), identify improper operation, and efficiently operate, control and maintain building systems. Moreover, many buildings, even those with adequate control infrastructure, lack knowledgeable staff to operate and maintain energy systems. Operators of buildings with CHP systems will constantly need to make tradeoffs (economic dispatch) between onsite power generation and purchasing power, between onsite heat production from distributed generation versus heating/cooling from conventional systems, and different passive and active load management measures. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of a clean, efficient, reliable and affordable next-generation integrated energy systems. This report lists the components for which PM, real-time CxV and AFDD algorithms will be developed, how the algorithms will be tested, and metrics that will be used to validate the algorithms and easy of deployment. Deployment of these algorithms in the field will result in savings reduction in energy consumption of between 10% and 20%.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Modeling Framework for Data Center

This chapter highlights the critical need for advanced modeling of data centers due to their rapidly increasing energy consumption and impact on grid reliability. Driven by the demand for AI applications, data centers are projected to consume a significant portion of US energy by 2028, putting stress on an already challenged power grid. The chapter emphasizes the importance of "fast" time-scale models to understand the dynamic interactions between data centers and the grid, especially given the rapid power fluctuations of AI workloads. It outlines a modeling framework that includes both offline and real-time EMT domain simulations, detailing the necessary representations for various components like utility interfaces, transformers, IT loads, UPS, cooling loads, Battery Energy Storage Systems (BESS), generators, protection systems, and higher-level control systems. While standard simulation tools like PSCAD offer basic models, custom development is often required to accurately capture the unique and fast-changing behaviors of modern data centers. The chapter also discusses key metrics and test cases for validating these models, focusing on transient load responses, protection relay coordination, and demand flexibility. Finally, it addresses the challenges of modeling large-scale data centers, such as computational complexity and the trade-off between model fidelity and practicality, suggesting hybrid modeling approaches as a solution. The overarching goal is to create a robust framework that helps assess data center impacts on grid stability, identify vulnerabilities, and inform the development of standards for reliable integration of these large loads into the bulk power system.

25 ENERGY STORAGE↗
DOE OSTI2025

Foundational Dataset for Developing Large-Sample Stream Temperature Models in the Conterminous United States

This dataset provides inputs, evaluation results, and trained weights from a large-sample Long Short-Term Memory (LSTM) model designed to predict daily stream temperatures across unregulated river reaches in the conterminous United States (CONUS). It includes dynamic meteorological and hydrologic forcings, static physiographic attributes, and model outputs from cross-validation experiments spanning 300 basins. It supports reproducible modeling, direct application for new basins, and provides data suitable for integration with reservoir and river simulations under current and future climates. It contains two .zip files described below · RQ-AI_runs.zip: Model outputs from 10-fold cross-validation experiments, including observed and predicted daily stream temperatures, along with test performance metrics for water years 2017–2019. Two versions are included: 1. Model trained and validated using subbasin-area weighted dynamic features. 2. Model trained and validated using whole-basin area weighted dynamic features. · RQ-AI_inputs.zip: Collection of all formatted dynamic and static predictor datasets (meteorological, hydrologic, and physiographic features) used in model training and analysis. Detailed instructions and data structure is held at the following GitLab repository: https://code.ornl.gov/tempwise/training.

Gomez-Velez, Jesus [Oak Ridge National Laboratory ↗
DOE OSTI2022

Validation of Calibrated k–ε Model Parameters for Jet-in-Crossflow

Previous efforts determined a set of calibrated, optimal model parameter values for Reynolds-averaged Navier–Stokes (RANS) simulations of a compressible jet in crossflow (JIC) using a $k–ε$ turbulence model. These parameters were derived by comparing simulation results to particle image velocimetry (PIV) data of a complementary JIC experiment under a limited set of flow conditions. Here, a $k–ε$ model using both nominal and calibrated parameters is validated against PIV data acquired from a much wider variety of JIC cases, including a realistic flight vehicle. The results from the simulations using the calibrated model parameters showed considerable improvements over those using the nominal values, even for cases that were not used in the calibration procedure that defined the optimal parameters. This improvement is demonstrated using a number of quality metrics that test the spatial alignment of the jet core, the magnitudes of multiple flow variables, and the location and strengths of vortices in the counter-rotating vortex cores on the PIV planes. These results suggest that the calibrated parameters have applicability well outside the specific flow case used in defining them and that with the right model parameters, RANS solutions for the JIC can be improved significantly over those obtained from the nominal model.

42 ENGINEERING↗
DOE OSTI2024

TCR-H: explainable machine learning prediction of T-cell receptor epitope binding on unseen datasets

Artificial-intelligence and machine-learning (AI/ML) approaches to predicting T-cell receptor (TCR)-epitope specificity achieve high performance metrics on test datasets which include sequences that are also part of the training set but fail to generalize to test sets consisting of epitopes and TCRs that are absent from the training set, i.e., are ‘unseen’ during training of the ML model. We present TCR-H, a supervised classification Support Vector Machines model using physicochemical features trained on the largest dataset available to date using only experimentally validated non-binders as negative datapoints. TCR-H exhibits an area under the curve of the receiver-operator characteristic (AUC of ROC) of 0.87 for epitope ‘hard splitting’ (i.e., on test sets with all epitopes unseen during ML training), 0.92 for TCR hard splitting and 0.89 for ‘strict splitting’ in which neither the epitopes nor the TCRs in the test set are seen in the training data. Furthermore, we employ the SHAP (Shapley additive explanations) eXplainable AI (XAI) method for post hoc interrogation to interpret the models trained with different hard splits, shedding light on the key physiochemical features driving model predictions. TCR-H thus represents a significant step towards general applicability and explainability of epitope:TCR specificity prediction.

60 APPLIED LIFE SCIENCES↗