Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Risk-Informed Applications and Science – Past, Present, & Future

This is a presentation to be made at the University of Tokyo. The Idaho National Laboratory is creating the next-generation reliability- and risk-assessment methods and tools that support risk-informed decision-making by combining physics-based models with probabilistic quantification approaches. Integrating these two worlds of physics and probability using a simulation framework leads us to predictions based upon an approach called “computational risk assessment” which will serve as the technical basis for the future of reliability and risk approaches. The driving factors for this new approach includes: temporal (timing issues), spatial (location issues), mechanistic (physics issues), and topological (complexity issues). By combining phenomenology directly with stochastic quantification, we are able to perform advanced uncertainty analysis directly on both parameters and models. In addition, new tools allow for the creation of reduced order models that mimic high-fidelity engineering models while still permitting the realization of thousands of simulation iterations in short run-times on current workstation-class computers. While these advanced methods and tools can provide increased realism in our engineering safety and risk approaches, their greater benefit is to provide a risk-informed engineering framework for design and operation. This talk will briefly review the history of risk assessment and risk-informed applications, describe some of the current research and development found at the Idaho National Laboratory, and discuss potential future applications and approaches for advanced methods and tools.

97 MATHEMATICS AND COMPUTING↗

RLGBS: Reinforcement Learning-Guided Beam Search for process optimization in a paper machine dryer section

Paper drying is responsible for over two-thirds of energy consumption in the U.S. pulp and paper industry, presenting significant potential for energy savings through optimization of process parameters. Current approaches often assume fixed operating conditions, neglecting dynamic ambient and process variations that limit achievable savings and real-world applicability. To this end, we develop a physics-based simulation environment for a paper machine dryer section and propose a reinforcement learning (RL) framework to minimize overall energy consumption by optimizing drying process parameters under diverse operating conditions. To mitigate overdrying and numerical instabilities caused by suboptimal local RL actions, we introduce Reinforcement Learning-Guided Beam Search (RLGBS), which explores multiple action sequences in parallel using beam search. Instead of making step-by-step decisions, RLGBS prioritizes solutions based on cumulative probability, reducing the impact of individual suboptimal actions. Experiments demonstrate that RLGBS achieves consistent energy savings under unseen operating conditions not encountered during training, outperforming conventional RL methods. While validated in drying optimization, this framework is broadly applicable to other RL-based industrial process control problems.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Framework Using Applied Process Analysis Methods to Assess Water Security in the Vu Gia–Thu Bon River Basin, Vietnam

The Vu Gia–Thu Bon (VG–TB) river basin is facing numerous challenges to water security, particularly in light of the increasing impacts of climate change. These challenges, including salinity intrusion, shifts in rainfall patterns, and reduced water supply in downstream areas, are of great concern. This study comprehensively assessed the current state of water security in the basin using robust statistical analysis methods such as the Process Analysis Method (PAM), SMART principle, and Analytic Hierarchy Process (AHP). This resulted in the development of a comprehensive assessment framework for water security in the VG–TB river basin. This framework identified five key dimensions, with basin development activities (0.32), the ability to meet water needs (0.24), and natural disaster resilience (0.19) being the most crucial and water resource potential being the least crucial (0.11) according to the AHP methodology. The latter also highlighted 15 indicators, four of which are particularly influential, including waste resources (0.54), flood (0.53), water storage capacity (0.45), and basin governance (0.42). Furthermore, 28 variables with high weight factors were identified. This framework aligns with the UN-Water water security definition and addresses the global water sustainability criteria outlined in Sustainable Development Goal 6 (SDG6). It enables the computation of a comprehensive Water Security Index (WSI) for specific regions, providing a strong foundation for decision-making and policy formulation. It aims to enhance water security in the context of climate change and support sustainable basin development, thereby guiding future research and policy decisions in water resource management.

54 ENVIRONMENTAL SCIENCES↗

An Overview of the Circular Economy Lifecycle Assessment and VIsualization (CELAVI) Framework

A circular economy emphasizes the efficient use of all resources (e.g., materials, land, water). Despite anticipated overall benefits to society, the transition to a circular economy is likely to create regional differences in impacts. Current tools are unable to fully evaluate these potential externalities, which will be important for informing research prioritization and regional decision making. This presentation will review and contrast nine current impact assessment methods and describe their granularity, scope, data requirements, and capabilities within the context of identifying regional and sectoral transfers of impacts that could result from transitioning to a circular economy for energy systems. The review of current approaches highlights the need for a new hybrid circularity assessment framework that leverages multiple methods. We describe one such approach: the Circular Economy Lifecycle Assessment and VIsualization (CELAVI) framework. CELAVI uses system dynamics to model material flows for multiple circular economy pathways, network theory to track the spatial and sectoral flow of functional units across a graph, and discrete event simulation to to step through time and evaluate lifecycle assessment data at each time step. The framework is designed to be flexible and scalable enough to accommodate multiple energy materials and multiple energy technologies. CELAVI's hybridization of multiple existing methods yields additional capabilities, which may help answer questions about how flows between the technosphere and ecosphere may evolve if the circularity of energy systems is modified.

circular economy↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Distribution System Congestion Management - A Survey of Reliable Integration for Aggregated Resources and Microgrids

Rising penetration of consumer-owned Distribution Grid Resources (DGRs), increasingly managed by third party aggregators and enrolled in grid services and wholesale market programs, can create localized congestion in distribution networks. Managing these constraints is challenging due to a persistent coordination and information gap: utilities are accountable for reliability and have network topology and state visibility, while aggregators control the DGR capability needed to relieve congestion. This survey synthesizes congestion management solutions for distribution systems with high DGR penetration, covering both market-based mechanisms (distribution level markets, locational pricing, flexibility auctions) and non-market-based solutions (network reconfiguration, direct DGR control, demand response, curtailment, etc.). The literature is organized across three decision horizons: long term planning, operational planning, and real-time operation. Special attention is devoted to emerging distribution system operator architectures and coordination frameworks spanning transmission system operators, aggregators, and microgrids. Drawing on recent case studies and implementations, we distill best practices, identify key technical and economic barriers, and outline research directions. The evidence points to a shift toward integrated congestion management that combines market signals with technical controls, enabled by improved monitoring, forecasting, and closed loop control capabilities.

Active Distribution Networks (ADN)↗

Techno-Economic Evaluation of a 600MW Pumped Storage Hydropower Plant using the Pumped Storage Hydropower Valuation Tool

This paper presents a techno-economic evaluation of the proposed 600 MW, 8-hour Craig – Hayden pumped storage hydropower project using the U.S. Department of Energy’s Pumped Storage Hydropower Valuation Tool. The analysis integrates plant technical characteristics, regional grid conditions, and market-based operating assumptions to quantify stacked value streams from energy arbitrage, capacity, ancillary services, transmission congestion relief, and reliability. Both price taker and price influencer frameworks are applied to examine the impact of market participation and system interactions on lifecycle economic performance using Benefit - Cost Analysis and Multi - Criteria Decision Analysis. The results show that the price taker approach provides higher revenue estimates based on exogenous price signals, while the price influencer approach captures production cost savings, renewable curtailment reduction, and market price formation, yielding more conservative but system-representative outcomes. The study demonstrates the strategic value of long-duration PSH for enhancing operational flexibility, resource adequacy, and grid reliability in a high-renewable Western Interconnection.

Bhattacharyya, Arjun [ORNL] (ORCID:000900060976046↗

SeeQ: A Programming Model for Portable Data-Driven Building Applications

This paper introduces SeeQ, a programming model and an abstraction framework that facilitates the development of portable data- driven building applications. Data-driven approaches can provide insights into building operations and guide decision-making to achieve operational objectives. Yet the configuration of such applications per building requires extensive effort and tacit knowledge. In SeeQ, we propose a portable programming model and build a software system that enables self-configuration and execution across diverse buildings. The configuration of each building is captured in a unified data model - in this paper, we work with the Brick ontology without loss of generality. SeeQ focuses on the distinction between the application logic and the configuration of an application against building-specific data inputs and systems. We test the proposed approach by configuring and deploying a diverse range of applications across five heterogeneous real-world buildings. The analysis shows the potential of SeeQ to significantly reduce the efforts associated with the delivery of building analytics.

analytics↗

Cross-Domain Reasoning for Neuromorphic Model Design

Designing performant neuromorphic models requires reasoning across neuroscience, neuromorphic computing, and machine learning, making it a natural target for cross-domain hypothesis generation. Our primary contribution is a multi-corpus knowledge graph spanning all three domains, which we show substantially increases cross-domain retrieval novelty over single-corpus baselines. We additionally introduce NeuKReAct, an agentic reasoning framework that iteratively retrieves from this graph and synthesizes design hypotheses via a step-by-step blackboard architecture, enabling structured compartmentalization of design decisions. Lastly, we introduce an execution head that translates hypotheses into structured design documents and runnable code. We evaluate novelty using a combinatorial creativity metric that measures cross-domain retrieval distance across the citation graph. Our results confirm that corpus breadth is the dominant driver of novelty. Moreover, we highlight a concrete instance of the novelty-utility tradeoff within NeuKReAct, underscoring a need for joint creativity evaluation, balancing both novelty and utility.

Ramavarapu, Vikram [ORNL] (ORCID:0009000188757213)↗

Performance assessment for climate intervention (PACI): preliminary application to a stratospheric aerosol injection scenario

As the prospect of exceeding global temperature targets set forth in the Paris Agreement becomes more likely, methods of climate intervention are increasingly being explored. With this increased interest there is a need for an assessment process to understand the range of impacts across different scenarios against a set of performance goals in order to support policy decisions. The methodology and tools developed for Performance Assessment (PA) for nuclear waste repositories shares many similarities with the needs and requirements for a framework for climate intervention. Using PA, we outline and test an evaluation framework for climate intervention, called Performance Assessment for Climate Intervention (PACI) with a focus on Stratospheric Aerosol Injection (SAI). We define a set of key technical components for the example PACI framework which include identifying performance goals, the extent of the system, and identifying which features, events, and processes are relevant and impactful to calculating model output for the system given the performance goals. Having identified a set of performance goals, the performance of the system, including uncertainty, can then be evaluated against these goals. Using the Geoengineering Large Ensemble (GLENS) scenario, we develop a set of performance goals for monthly temperature, precipitation, drought index, soil water, solar flux, and surface runoff. The assessment assumes that targets may be framed in the context of risk-risk via a risk ratio, or the ratio of the risk of exceeding the performance goal for the SAI scenario against the risk of exceeding the performance goal for the emissions scenario. From regional responses, across multiple climate variables, it is then possible to assess which pathway carries lower risk relative to the goals. The assessment is not comprehensive but rather a demonstration of the evaluation of an SAI scenario. Future work is needed to develop a more complete assessment that would provide additional simulations to cover parametric and aleatory uncertainty and enable a deeper understanding of impacts, informed scenario selection, and allow further refinements to the approach.

climate intervention↗

Explainable Artificial Intelligence Technology for Predictive Maintenance

The domestic nuclear power plant fleet has relied on labor-intensive and time-consuming preventive maintenance programs, thus driving up operation and maintenance costs to achieve high-capacity factors. Artificial intelligence and machine learning can help simplify complex problems, such as diagnosing equipment degradation, to enable more effective decision-making. Benefits will be felt not only within existing analog and digital instrumentation and control, but also work processes, the integration of people with technology, and most importantly, the business case. Together, these hold promise to make nuclear power more efficient and reduce costs associated with operation and maintenance. While the artificial intelligence and machine learning technologies hold significant promise in the nuclear industry, there are challenges or barriers to their adoption. This report outlines the those different machine learning adoption barriers (categorized as historical, technical, economic, regulatory, and user) that the industry must overcome to realize the full benefits of artificial intelligence and machine learning capabilities for long-term economic sustainability. This report also provides solutions for some of these barriers by focusing on improving the explainability of machine learning to encourage trust from the end-user. Trust and explainability are essential to machine learning adoption. This report focuses on research-developed solutions to some of these barriers while analyzing a non-safety-related system, namely the circulating water system. This system frequently experiences waterbox fouling which our models preemptively diagnoses then explains to the operator how those conclusions were reached. This report presents and discusses the inherent trade-off between machine learning performance (in terms of accuracy) and explainability, where highly accurate machine learning methods (such as deep-learning) are the least explainable, and the most explainable methods (such as decision trees) are the least accurate. In addition, explainability of artificial intelligence techniques in terms of transparency and post-hoc metrics are discussed. This report outlines the importance of data novelty and value of new information in evaluating both the explainability and trustworthiness. Novelty detection helps to establish consistency or inconsistency of the new data with respect to the training data. On the other hand, value of information could be a part of the user-centric visualization recommendation system that request additional information to be collected, thereby strengthening the machine learning outcomes. During this project, a copyrighted user-centric visualization that aligns with a human-in-the-loop approach was developed. The user-centric visualization presents different levels of information and can be tailored as per user credentials to gain user confidence. One of the salient features of the user-centric visualization is it presents machine learning methods with explainability metrics. A simplified version of the user-centric visualization was presented to 32 users with varying levels of machine learning expertise. Feedback was solicited to test the hypothesis that the app contained sufficient explainability and that the users would trust the algorithm. Overall, the app was positively received, and the hypothesis was supported. This report discusses the trust-but-verify framework – a potential approach to build user trust artificial intelligence. The framework discusses trust from the human level to artificial intelligence level. The fundamental premise of the trust but verify framework is derived from an observation of nuclear safety culture (i.e., nuclear power plant personnel do not rely on a singular source of data to make a decision). This also ties back to the user-centric visualization that presents different levels of information to achieve both explainability and trustworthiness of artificial intelligence. Even so, the adoption of artificial intelligence and machine learning in the nuclear industry faces additional barriers, namely regulatory and stakeholder readiness. To overcome these challenges, new solutions must gain regulatory approval and cater to stakeholder needs. The Nuclear Regulatory Committee has a 5-year strategic plan which prepares them for reviewing artificial intelligence technologies in licensee submissions. Early and frequent engagement with the regulator is encouraged. Additionally, artificial intelligence solutions should incorporate human-in-the-loop considerations and offer explainability. Stakeholders must prepare by hiring or training staff to adapt to advancing technology in everyday plant tasks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Autonomous fabrication of tailored defect structures in 2D materials using machine learning-enabled scanning transmission electron microscopy

Materials with tailored quantum properties can be engineered from atomic-scale assembly techniques, but existing methods often lack the agility and accuracy to precisely and intelligently control the manufacturing process. Here, we demonstrate a fully autonomous approach for fabricating atomic-level defects using electron beams in scanning transmission electron microscopy (STEM) that combines advanced machine learning and automated beam control. As a proof of concept, we achieved controlled fabrication of MoS-nanowire (MoS-NW) edge structures by iterative and targeted exposure of MoS 2 monolayer to a focused electron beam to selectively eject sulfur atoms, utilizing high-angle annular dark-field (HAADF) imaging for feedback-controlled monitoring of structural evolution of defects. A machine learning framework combining a random forest model and a convolutional neural network (CNN) was developed to decode the HAADF image and accurately identify atomic positions and species. This atomic-level information was then integrated into an autonomous decision-making platform, which applied predefined fabrication strategies to instruct beam control about atomic sites to be ejected. The selected sites were subsequently exposed to a localized electron beam using an FPGA-controlled scan routine with precise control over beam positioning and duration. While the MoS-NW edge structures produced exhibit promising mechanical and electronic properties, the proposed methods to build the autonomous fabrication framework is material-agnostic and can be extended to other 2D materials for the creation of diverse defect structures and heterostructures beyond Mo S2 .

Engineering↗

Immersive Scientific Visualization of Molten-Salt Reactor Waste Characteristics Using Virtual Reality

Immersive visualization is changing how we explore, communicate, and understand complex scientific systems. In nuclear energy, an area in which data are often multidimensional, time-dependent, and difficult to interpret, virtual reality (VR) represents a powerful and intuitive informational medium. This work introduces a VR-based platform that visualizes the post-shutdown behavior and waste management lifecycle of molten-salt reactors (MSRs), a next-generation reactor type with unique operational and safety characteristics. The platform, built in Unity, is streamed on the Meta Quest 3 headset. It transforms high-fidelity simulation data into an interactive, immersive experience. Users can explore time-dependent reactor characteristics such as nuclide decay, which is a key factor for evaluating reactor waste strategies. The datasets were generated using the MOOSE (Multiphysics Object-Oriented Simulation Environment) framework and then processed through ParaView scripting for smooth integration into Unity. From a visualization standpoint, the platform emphasizes spatial storytelling, temporal exploration, and user-centered interaction. Users can navigate 3D reactor geometries, slice through volumetric data, and manipulate time to observe how physical phenomena evolve. Real-scale rendering and embodied interaction make the experience feel tangible. The interface is designed to be accessible, even to those without nuclear or simulation expertise. This lowers the barrier for stakeholders, policymakers, and the general public, while still supporting expert analysis and collaborative decision-making. This work shows how immersive visualization can function as both a scientific tool and a communication interface. By integrating simulation, processing, and visualization into a cohesive workflow, we offer a scalable framework for immersive scientific storytelling. The modular design supports future extensions to other reactor types and lifecycle stages, from shutdown to long-term storage, making the platform adaptable for both research and outreach.

99 - GENERAL AND MISCELLANEOUS↗

Co-optimization of nuclear reactor flexible power operation and maintenance scheduling

As flexible power operation of nuclear power plants becomes more attractive due to the reduction in fossil-fueled dispatchable generation on energy grids, finding optimal power production strategies that balance revenue generation with operational concerns becomes more complex. This article presents a general framework to aid operators in designing economically optimal long term dispatch strategies for nuclear power plants. The principal novelty is the linking of estimated system remaining useable life (RUL) to strategic operational decisions. It is shown that, depending on the relationship between the fixed costs from maintenance and the associated lost revenue from an outage, it can be economically optimal in the long term to delay a maintenance outage and not perform this alongside refueling. For a given relationship between power ramping and degradation, optimal strategies were found that discouraged load following in some situations while minimizing unnecessary maintenance. It is shown that heavy load following can cause maintenance and refueling outages to diverge due to their inverse relationships with respect to load following, potentially leading to a significant loss in capacity factor. As a result, this general framework can be applied to specific reactor dispatch allowing operators to adapt operational strategies as future grid conditions change.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Equity-Centered Engagement Through Climate Resilience Policy in Massachusetts

Communities who experience disproportionate climate change impacts tend to be excluded from resilience planning (Vale, 2014). Those efforts typically follow top-down processes within established governance practices that are inaccessible to marginalized folks and reinforce inequalities (Malloy & Ashcraft, 2020; Adger, 2003). Such participatory planning processes may offer the public little opportunity to influence the process itself or the outcomes (Smith & McDonough, 2001). They might ignore important public values or alternative ways of knowing which can be critical assets in resilience (Few et al., 2007). Designing communities for climate action and resilience means creating opportunities for everyone to meaningfully shape those decisions and experience related benefits. Having the opportunity to shape one’s community is necessary for human flourishing (Allen, 2016). Resilience planning that shifts power into communities and focuses on social vulnerability can affect how people survive and thrive in a climate changed world. The Massachusetts Municipal Vulnerability Preparedness (MVP) 2.0 program is an attempt to change the status quo in resilience planning by bringing new voices into decision-making power, recognizing their labor, addressing root causes of vulnerability, and investing in social infrastructure. It aspires to build capacity for equity-focused community engagement within teams of municipal staff and community liaisons, and ultimately build social capital and community cohesion. My mixed methods research investigates implementation of this state grant program in several western Massachusetts towns. I am using document review, participant observation, and interviews to understand the MVP 2.0 process as written, how different towns navigate it, and how individuals make sense of their experiences in it. I seek to understand how those experiences explain relationships between engagement approaches, mediating factors, and process outcomes. I am interested in the conditions that allow for community empowerment and how a model like MVP 2.0 can shift conditions that hold systems in place. In a practical sense, our findings will help municipalities reflect on their work during MVP 2.0 and plan for future community engagement. They may be informative for designing future iterations of the MVP program and for other municipalities, offices of community engagement, and practitioners. The findings will also contribute to the participation, resilience, and climate justice literatures, by adding perspectives on equity-centered resilience and community engagement approaches in smaller towns and rural settings. References: Adger, W. N. (2003). Social capital, collective action, and adaptation to climate change. Economic Geography, 79, 387-404. Allen, D. (2016). Toward a connected society. Our compelling interests: The value of diversity for democracy and a prosperous society, 71-105. Few, R., Brown, K., & Tompkins, E. L. (2007). Public participation and climate change adaptation: avoiding the illusion of inclusion. Climate Policy, 7(1), 46–59. Malloy, J. T., & Ashcraft, C. M. (2020). A framework for implementing socially just climate adaptation. Climatic Change, 160(1), 1–14. Smith, P. D., & McDonough, M. H. (2001). Beyond public participation: Fairness in natural resource decision making. Society & natural resources, 14(3), 239-249. Vale, L. J. (2014). The politics of resilient cities: whose resilience and whose city? Building Research & Information, 42(2), 191–201.

Callaham, Shannon↗

Model Predictive Control of Discrete-Continuous Energy Systems via Generalized Disjunctive Programming

Generalized Disjunctive Programming (GDP) provides an alternative framework to model optimization problems with both discrete and continuous variables. The key idea behind GDP involves the use of logical disjunctions to represent discrete decisions in the continuous space, and logical propositions to denote algebraic constraints in the discrete space. Compared to traditional mixed-integer programming (MIP), the inherent logic structure in GDP yields tighter relaxations that are exploited by global branch and bound algorithms to improve solution quality. In this paper, we present a general GDP model for optimal control of hybrid systems that exhibit both discrete and continuous dynamics. Specifically, we use GDP to formulate a model predictive control (MPC) model for piecewise-affine systems with implicit switching logic. As an example, the GDP-based MPC approach is used as a supervisory control to improve energy efficiency in residential buildings with binary on/off, relay-based thermostats. A simulation study is used to demonstrate the validity of the proposed approach, and the improved solution quality compared to existing MIPbased control approaches.

Bhattacharya, Arnab↗

Demand Response Under Stochastic, Price-Dependent User Behavior

This letter focuses on price-based demand response (DR) implemented through dynamic adjustments of electricity prices. It extends existing DR models to a stochastic framework in which customer response is represented by price-dependent random variables, leveraging models and tools from the theory of stochastic optimization with decision-dependent distributions. The inherent epistemic uncertainty in the customers' responses renders open-loop, model-based DR strategies impractical. We propose a stochastic, feedback-based pricing strategy to compensate for estimation errors and uncertainty in customer response, establish theoretical results demonstrating the stability and near-optimality of the proposed approach, and validate its effectiveness through numerical simulations.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Learning curves for drug response prediction in cancer cell lines

Motivated by the size and availability of cell line drug sensitivity data, researchers have been developing machine learning (ML) models for predicting drug response to advance cancer treatment. As drug sensitivity studies continue generating drug response data, a common question is whether the generalization performance of existing prediction models can be further improved with more training data. We utilize empirical learning curves for evaluating and comparing the data scaling properties of two neural networks (NNs) and two gradient boosting decision tree (GBDT) models trained on four cell line drug screening datasets. The learning curves are accurately fitted to a power law model, providing a framework for assessing the data scaling behavior of these models. The curves demonstrate that no single model dominates in terms of prediction performance across all datasets and training sizes, thus suggesting that the actual shape of these curves depends on the unique pair of an ML model and a dataset. The multi-input NN (mNN), in which gene expressions of cancer cells and molecular drug descriptors are input into separate subnetworks, outperforms a single-input NN (sNN), where the cell and drug features are concatenated for the input layer. In contrast, a GBDT with hyperparameter tuning exhibits superior performance as compared with both NNs at the lower range of training set sizes for two of the tested datasets, whereas the mNN consistently performs better at the higher range of training sizes. Moreover, the trajectory of the curves suggests that increasing the sample size is expected to further improve prediction scores of both NNs. These observations demonstrate the benefit of using learning curves to evaluate prediction models, providing a broader perspective on the overall data scaling characteristics. A fitted power law learning curve provides a forward-looking metric for analyzing prediction performance and can serve as a co-design tool to guide experimental biologists and computational scientists in the design of future experiments in prospective research studies.

60 APPLIED LIFE SCIENCES↗