Search NASA⌕ Search

SEARCH · Search NASA

Results for “policy framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Power Converter Circuit Design Automation using Parallel Monte Carlo Tree Search

The tidal waves of modern electronic/electrical devices have led to increasing demands for ubiquitous application-specific power converters. A conventional manual design procedure of such power converters is computation- and labor-intensive, which involves selecting and connecting component devices, tuning component-wise parameters and control schemes, and iteratively evaluating and optimizing the design. To automate and speed up this design process, we propose an automatic framework that designs custom power converters from design specifications using Monte Carlo Tree Search. Specifically, the framework embraces the upper-confidence-bound-tree (UCT), a variant of Monte Carlo Tree Search, to automate topology space exploration with circuit design specification-encoded reward signals. Moreover, our UCT-based approach can exploit small offline data via the specially designed default policy and can run in parallel to accelerate topology space exploration. Further, it utilizes a hybrid circuit evaluation strategy to substantially reduce design evaluation costs. Empirically, we demonstrated that our framework could generate energy-efficient circuit topologies for various target voltage conversion ratios. Compared to existing automatic topology optimization strategies, the proposed method is much more computationally efficient --- the sequential version can generate topologies with the same quality while being up to 67% faster. Here, the parallelization schemes can further achieve high speedups compared to the sequential version.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adaptive Framework for Maintenance Scheduling Based on Dynamic Preventive Intervals and Remaining Useful Life Estimation

Data-based prognostic methods exploit sensor data to forecast the remaining useful life (RUL) of industrial settings to optimize the scheduling of maintenance actions. However, implementing sensors may not be cost-effective or practical for all components. Traditional preventive approaches are not based on sensor data; however, they schedule maintenance at equally spaced intervals, which is not a cost-effective approach since the distribution of the time between failures changes with the degradation state of other parts or changes in working conditions. This study introduces a novel framework comprising two maintenance scheduling strategies. In the absence of sensor data, we propose a novel dynamic preventive policy that adjusts intervention intervals based on the most recent failure data. When sensor data are available, a method for RUL prediction, designated k-LSTM-GFT, is enhanced to dynamically account for RUL prediction uncertainty. The results demonstrate that dynamic preventive maintenance can yield cost reductions of up to 51.8% compared to conventional approaches. The predictive approach optimizes the exploitation of RUL, achieving costs that are only 3–5% higher than the minimum cost achievable while ensuring the safety of critical systems since all of the failures are avoided.

Nunes, Pedro (ORCID:0000000180012172)↗

Global Regulations for Sustainable Battery Recycling: Challenges and Opportunities

With the rapid expansion of transportation electrification worldwide, the demand for electric vehicles (EVs) has increased dramatically, creating new and sustainable growth opportunities for the global economy. However, as the most expensive component of EVs, lithium-ion batteries pose significant sustainability challenges due to raw material consumption and supply chain constrains, as well as the complexities of end-of-life battery disposal and recycling. To address these concerns, many countries are actively establishing regulations to promote sustainable pathways for battery reuse and recycling. Despite these efforts, existing battery recycling regulations remain often inefficient and vary significantly across different countries in legal enforcement, producer responsibility, waste classification, recycling targets, design standards, public engagement, and financial incentives, particularly given the complexities of the global supply chain and resource distribution within the battery industry. Understanding these regulatory differences and establishing a unified framework are therefore crucial to ensuring sustainable and efficient battery recycling. This review provides a comprehensive analysis of the necessity of establishing robust regulations for sustainable development of battery recycling industry. The evolution and refinement of battery recycling regulations are deeply reviewed to identifying persistent gaps and challenges in key countries. Furthermore, we discuss the challenges associated with regulatory enforcement and propose strategies for developing a more cohesive legislative framework to ensure the effective utilization of retired batteries.

25 ENERGY STORAGE↗

Africa Battery Energy Storage Systems (BESS) Capacity Building Utility-Scale Storage: BESS Valuation, Tariffs, and Remuneration [Slides]

Utility-scale Battery Energy Storage Systems (BESS) are key to enhancing grid reliability, integrating renewable energy, and providing operational flexibility. Designing effective valuation, remuneration, and tariff frameworks is essential to ensure both system benefits and financial viability for developers. This presentation outlines a structured methodology for evaluating BESS projects, covering policy and legal considerations, cost and revenue analysis, benchmarking, financial sensitivity, and risk assessment, while ensuring alignment with public interest. It also explores valuation of multiple storage services - bulk energy, ancillary services, and infrastructure support - and monetization strategies through capacity payments, energy tariffs, tolling, arbitrage, and non-wires alternative payments. Technical factors, including round-trip efficiency, degradation, and storage duration, are integrated into financial and operational modeling to quantify both system-wide and project-level benefits. Through case studies and simulation-based approaches, this framework provides regulators, utilities, and developers with practical guidance for tariff design, payment structures, and investment decisions, maximizing the economic and societal value of BESS deployment.

25 ENERGY STORAGE↗

Dynamic Role-Based Access Control Policy for Smart Grid Applications: An Offline Deep Reinforcement Learning Approach

Role-based access control (RBAC) is adopted in the information and communication technology domain for authentication purposes. However, due to a very large number of entities within organizational access control (AC) systems, static RBAC management can be inefficient, costly, and can lead to cybersecurity threats. In this paper, a novel hybrid RBAC model is proposed, based on the principles of offline deep reinforcement learning (RL) and Bayesian belief networks. The considered framework utilizes a fully offline RL agent, which models the behavioral history of users as a Bayesian belief-based trust indicator. Thus, the initial static RBAC policy is improved in a dynamic manner through off-policy learning while guaranteeing compliance of the internal users with the security rules of the system. By deploying our implementation within the smart grid domain and specifically within a Distributed Energy Resources (DER) ecosystem, we provide an end-to-end proof of concept of our model. Finally, detailed analysis and evaluation regarding the offline training phase of the RL agent are provided, while the online deployment of the hybrid RL-based RBAC model into the DER ecosystem highlights its key operation features and salient benefits over traditional RBAC models.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. The framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗

Design and optimization of a modular hydrogen-based integrated energy system to maximize revenue via nuclear-renewable sources

Here, this paper demonstrates a novel modular distributed framework that uses optimal energy-dispatching strategies to enable greater flexibility and profitability in nuclear-renewable integrated energy systems (NR-IES). Hydrogen is used as a commodity in this framework since its production can improve grid stability and system operational flexibility, decarbonize heavy industry, and create an additional revenue stream for electricity generators, particularly nuclear power plants with high operational expenses. The proposed solution addresses the challenges associated with merging multiple software and services from various domains by using functional mock-up units (FMU) to co-simulate diverse subsystems designed in various platforms. The tightly coupled integrated energy system (IES) is optimized to maximize revenue by utilizing the deep reinforcement learning (DRL) technique to make smart dispatching decisions based on variable electricity prices and the availability of renewable energy. Proximal policy optimization (PPO) algorithm is used in training and testing the DRL agent. Over a period of 120 days, the proposed hydrogen-based IES framework showed about 10% revenue boost compared to a non-hydrogen generating baseline IES while also providing an easily-adoptable framework which can help to improve the flexibility of future generation nuclear power plants.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Spatial Graph Attention and Curiosity-driven Policy for Antiviral Drug Discovery

We developed Distilled Graph Attention Policy Networks (DGAPNs), a curiosity-driven reinforcement learning model to generate novel graph-structured chemical representations that optimize user-defined objectives by efficiently navigating a physically constrained domain. Here, the framework is examined on the task of generating molecules that are designed to bind, noncovalently, to functional sites of SARS-CoV-2 proteins. We present a spatial Graph Attention Network (sGAT) that leverages self-attention over both node and edge attributes as well as encoding spatial structure -- this capability is of considerable interest in areas such as molecular and synthetic biology and drug discovery. An attentional policy network is then introduced to learn decision rules for a dynamic, fragment-based chemical environment, and state-of-the-art policy gradient techniques are employed to train the network with enhanced stability. Exploration is efficiently encouraged by incorporating innovation reward bonuses learned and proposed by random network distillation. In experiments, our framework achieved outstanding results compared to state-of-the-art algorithms, while increasing the diversity of proposed molecules and reducing the complexity of paths to chemical synthesis.

Wu, Yulun↗

Deep reinforcement learning for optimal control of induction welding process

Optimizing induction welding (IW) process parameters for the application of joining thermoplastic composites is challenging as it requires achieving complex spatiotemporal thermal characteristics along the weld-line to obtain desired weld quality. We formulate an optimal control problem which captures these requirements and seeks to optimize the IW coil speed using a fast-acting dynamic IW process model. We develop a novel Deep Reinforcement Learning (DRL) framework to solve this computationally challenging control problem and demonstrate via simulation study that the learned DRL feedback control policy results in better spatiotemporal thermal characteristics as compared to the current state-of-the-art.

36 MATERIALS SCIENCE↗

A systematic review of building energy sufficiency towards energy and climate targets

Among the sufficiency, efficiency, and renewable frameworks for reducing energy use and energy-related carbon emissions, Building Energy Sufficiency (BES) is gaining attention from policy makers and engineers. Despite the significant role of the building sector in the success of national energy and climate plans, there is a lack of research on the drivers, technologies, and effective policy instruments required to achieve BES in the building operational phase. To fill this gap, this study presents a systematic review of the definition and paradigm of BES and concludes that BES should address both occupant demand and energy or emissions requirements simultaneously. The characteristics of occupant demand in building services are divided into four dimensions: time and space, quality and quantity, control and adjustment, and flexibility. Technical options regarding the building architecture, the envelope system, and the building energy system are reviewed. Finally, policy implications and recommendations are discussed. As a result, the multiple benefits and multidisciplinary nature of BES justify further research and accelerated policy implementation in developed and developing countries.

54 ENVIRONMENTAL SCIENCES↗

Decision making for implementing non-traditional water sources: a review of challenges and potential solutions

Abstract The effects of climate change, population growth, and future hydrologic uncertainties necessitate increased water conservation, new water resources, and a shift towards sustainable urban water supply portfolios. Diversifying water portfolios with non-traditional water sources can play a key role. Rooftop harvested rainwater (RHRW), atmospheric and condensate harvesting, stormwater, recycled wastewater and greywater, and desalinated seawater and brackish water are all currently utilized and rapidly emerging non-traditional water sources. This review explores the status and trends around these non-traditional water sources, and reviews approaches and models for prioritizing, predicting, and quantifying metrics of concern. The analysis presented here suggests that understanding the challenges of location specific scenarios, socioeconomic knowledge gaps, water supply technologies, and/or water management structure is the crucial first step in establishing a model or framework approach to provide a strategy for improvement going forward. The findings of this study also suggest that clear policy guidance and onsite maintenance is necessary for variable water quality concerns of non-traditional sources like harvested rainwater and greywater. In addition, use of stormwater or reuse of wastewater raises public health concerns due to unknown risks and pathogen levels, thus rapid monitoring technologies and transparent reporting systems can facilitate their adoption. Finally, cost structure of desalination varies significantly around the world, largely due to regulatory requirements and local policies. Further reduction of its capital cost and energy consumption is identified as a hurdle for implementation. Overall, models and process analyses highlight the strength of comparative assessments across scenarios and water supply options.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

An Ethics-Based Review of Generative Artificial Intelligence: Assuring Responsible Use (Version 1.0)

The rapid expansion of generative artificial intelligence (GenAI) has generated excitement regarding its potential benefits and concern over its ethical implications. Governments, corporations, and standards organizations have described ethical principles to direct GenAI's development and use; however, practical guidance for implementing these principles is limited. Addressing this gap is critical, especially considering the array of risks associated with GenAI, such as legal liabilities, privacy concerns, security threats, and potential misuse. Robust policies and procedures are critical to support responsible deployment of GenAI. This report examines Pacific Northwest National Laboratory (PNNL)’s approach to promoting responsible GenAI use. Proposed initiatives include developing policies based on ethical principles, creating a governance process to review projects relative to those principles, and implementing onboarding processes for training staff. The governance framework described in this report adapts the structure and principles of Institutional Review Boards (IRBs), traditionally used in human subjects research, for GenAI ethical review, providing oversight. Ethical principles guiding responsible GenAI usage include transparency and accountability, privacy, fairness, safety, security, and validity and reliability. To operationalize these principles, we propose forming a GenAI Assurance Council (GAC) that mirrors the IRB's structure. The GAC will evaluate GenAI projects across privacy, accountability, transparency, safety, security, fairness, and validity dimensions. Complementing policy and governance is AI literacy training to support staff understanding of GenAI's ethical implications. An initial training effort for AI Incubator Chat—a GenAI tool deployed at PNNL—showed promising results, underscoring the importance of clear guidelines and user accountability. Collaborative efforts and the dissemination of best practices are also discussed. The proposed GAC model and AI literacy training provide a blueprint for establishing ethical GenAI use and governance, offering practical tools to bridge the gap between ethical principles and real-world applications. The responsible integration of GenAI at PNNL entails a multifaceted approach involving policy development, ethical governance, and AI literacy training. The positive initial feedback and collaborative opportunities position PNNL to lead by example in GenAI's responsible use, reflecting a proactive stance in addressing the ethical, legal, and societal challenges associated with this emerging technology. PNNL's systematic and ethical approach to GenAI offers a model for other institutions to emulate, promoting safe and responsible technological advancements in the AI domain.

97 MATHEMATICS AND COMPUTING↗

Planning Roadmap for DER Integration in India: Industry Best Practices and Resource Guide

Ensuring safe, reliable, cost-effective DER integration at scale requires holistic planning, broad stakeholder engagement, and should address key development areas such as standards adoption, equipment testing and certification, interoperability and cybersecurity, interconnection procedures, and advanced forecasting and DER management. Each of these areas currently represent significant challenges for utilities, regulators, OEMs, developers, and even consumers worldwide. India has already seen significant growth of DERs and has announced targets for substantial growth yet to come, with the potential for DERs to make up a non-negligible portion of the country's overall generation capacity. As such, it is of critical importance that Indian stakeholders consider the potential impacts of wide-spread adoption of DERs and take preemptive action related to the five development areas listed here, among others. India should consider strategies including the adoption of key DER standards related to interconnection, testing, and cybersecurity; enabling effective and secure communication channels for DER interoperability; testing and certifying DER equipment in accredited testing laboratories; building robust, streamlined interconnection procedures; and revamping legacy system planning structures to incorporate DERs in a holistic planning framework.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Valuing Ecosystems in Equitable Energy Transition Planning

In this report we explore three areas of research and practice needed to scale clean energy sustainably: 1) advancing the predictive science to quantify positive and negative outcomes of energy development for the wellbeing of communities, environments, and disadvantaged groups; 2) scenario design using this science to shape renewable energy solutions for nation-wide decarbonization while delivering tangible, local benefits; and 3) participatory science-policy processes to understand what people want for the places where they live and work and how incorporating renewable energy can help or hinder their goals. Together these three components – quantifying social-ecological values, scenario design, and participatory processes – form the basis for a framework for valuing ecosystems to inform a more equitable energy transition.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Preparing Distribution Utilities for Utility-Scale Storage and Electric Vehicles: A Novel Analytical Framework

Emerging distributed energy resources (DERs)—such as solar photovoltaics (PV), battery energy storage systems (BESS), and electric vehicles (EVs)—are expected to increase substantially in India in the coming years following policy-driven targets of the Government of India to modernize its electricity system, reduce greenhouse gas emissions (GHGs), and improve air quality. These emerging technologies can pose challenges to distribution utilities, forcing overhauls in planning and operational practices. They can also create challenges in power system infrastructure planning and cause more frequent system operational violations (e.g., network voltage bounds and loading thresholds) if not properly integrated. The impacts on the localized power distribution grid from these emerging technologies manifest in increased infrastructure investments and erratic shifts in demand patterns. These impacts are not yet well understood, and analytic solutions are not readily available. To address these challenges, the National Renewable Energy Laboratory (NREL), in collaboration with BSES Rajdhani Power Ltd. (BRPL), developed an advanced power distribution system impact analysis framework of BRPL’s distribution system. This framework helps analyze the readiness of the power distribution network to accommodate emerging technologies and the potential opportunities they might introduce. The framework has been predominantly set up to evaluate distributed PV, BESS, and EVs. In this collaboration between NREL and BRPL, we developed and evaluated the framework on two distribution feeders in the BRPL territory for various scenarios of BESS and EVs. BESS are evaluated for their effectiveness on the grid to mitigate present and future feeder overloading scenarios, and they are subsequently analyzed for their costs compared to the costs of traditional upgradation measures. Scenarios include assessing the effects of EV density on grid infrastructure upgrades and interlinking EV management with BESS integration.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

Scalable probabilistic estimates of electric vehicle charging given observed driver behavior

To prepare for rapid growth in global electric vehicle adoption, grid and policy planners depend on detailed forecasts of future charging demand. In this paper we propose a novel holistic, scalable, probabilistic framework to produce large-scale estimates of electric vehicle charging load for long-term planning that capture real drivers’ charging patterns. Our framework captures the uncertainty and stochasticity in charging demand by taking a graphical modeling approach. It has three core elements: driver groups, charging segment choices, and charging session time and energy requirements. The framework uses hierarchical clustering to group drivers by their charging histories, capturing their heterogeneous behaviors and preferences across different segments or types of charging. The framework uses probabilistic mixture models for each driver group’s sessions to identify the unique charging behaviors observed within each segment. We illustrate its application with a large data set from California, profiling the charging patterns and unique driver clusters it identifies. Using the model knobs representing drivers’ battery capacities, behavior, and segment access we present scenarios for California’s charging demand in 2030 with 8 million passenger electric vehicles. Peak charging demand ranged from 3.3 to 8.7 GW across scenarios. Furthermore, each was calculated in under 45 s on a laptop computer.

33 ADVANCED PROPULSION SYSTEMS↗