Search NASA⌕ Search

SEARCH · Search NASA

Results for “Policy optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Ten questions concerning occupant-centric control and operations

Occupant-Centric Control and Operation (OCC) represents a transformative approach to building management, integrating sensing of indoor environmental quality, occupant presence, and occupant-building interactions. These data are then utilized to optimize both operational efficiency and occupant comfort. This paper summarizes the findings from the IEA-EBC Annex 79 research program's subtask on real world implementations of OCC during the past 5 years. First, in Q1 and Q2, we provide a definition and categorization of OCC. Q3 addresses the role of building operators for OCC, while Q4 describes the implications for designers. Then, Q5 and Q6 discuss the role and possibilities of OCC for load flexibility, and for pandemic induced paradigm shifts in the built environment, respectively. In Q7, we provide a taxonomy and selection process of OCC, while Q8 details real world implementation case studies. Finally, Q9 explains the limits of OCC, and Q10 provides a vision for future research opportunities. Furthermore, our findings offer valuable insights for researchers, practitioners, and policy makers, contributing to the ongoing discourse on the future of building operations management.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Inverse reinforcement learning control for building energy management

Reinforcement learning (RL) based control is widely considered a promising approach in building automation and control as it has demonstrated the potential to deal with complex objectives in adjacent domains like robotics, autonomous vehicles, gaming applications, and advertisement recommendations. When applied to any environment, model-free RL learns to improve its control performance over time without requiring a control model, by receiving and then analyzing feedback from the building environment after each control action. Operational objectives are becoming increasingly complex through the simultaneous consideration of thermal comfort, carbon emissions, grid services, and indoor air quality. In this context, conventional rule-based control approaches are proving sub-optimal, mostly heuristic, and inadequate. The model-free and self learning nature of RL appears promising and attractive as it may address the scalability issues associated with advanced control approaches. However, it suffers from long training times and unstable control behavior during the early stages of its learning process, which makes it unsuitable to be applied directly to buildings. This paper addresses these issues using an inverse reinforcement learning approach (IRL), a technique utilized to learn the objective of a controller agent which is considered an expert in its respective domain. Here, we consider a rule-based control as the expert demonstrator. IRL is different from a direct imitation (i.e., direct mapping of states to actions) of control actions as it tries to find the underlying intent of an expert's policy, providing the controller with a better-generalized policy for unseen states or environments with slightly different dynamics. This approach propels the RL controller's policy to levels similar to or better than that of a rule-based policy before it starts learning by interacting with the building. This makes RL for building energy management applications more practical as it prevents the erratic and exploratory behavior in the initial training period, simultaneously speeding up the learning process when compared to applying an untrained RL agent directly to a building environment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

A framework and calculator for evaluating the impacts of shelf life extension and other food loss and waste reduction technologies

Optimization of the food supply chain (FSC) depends on reducing food waste, especially at the consumer stage, where a substantial portion of food is not eaten, but instead disposed of via landfill, incineration, or in-sink disposals. One key strategy is to increase the time that consumers have before food goes bad or expires. This study developed a framework to assess the efficacy of shelf-life extension (SLE) technologies for mitigating food loss and waste (FLW), such as packaging improvements. The impact flows through the entire FSC, reducing FLW, energy use, and other inputs at each stage. The framework and resulting calculator can be used to evaluate the impact of FLW reduction at any stage for any food commodity. As shown by two SLE cases, the calculator is valuable for policy-makers, government entities, and professionals, specifically those in marketing, business development, and capital projects teams, to comprehensively evaluate the impacts of FLW reduction technologies and practices. The framework and calculator are sensitive to the shape of the consumption curve, the fraction of inedible waste, and the current shelf life. The calculator was used to assess the impacts of the United States goal of reducing food waste by consumers through various SLE lengths. It was found that uptake of several near-ready-to-deploy SLE technologies would reduce annual food production demand by about 10–19 MMT and supply chain energy consumption by 240–410 PJ in the United States.

Food loss and waste (FLW)↗
DOE OSTI2025

Understanding and Modeling Pooled Rideshare Acceptance: Influential Factors, Preferred User Experiences, and Implications

This dissertation explores factors influencing pooled rideshare (PR) adoption to provide actionable insights for transportation network companies (TNCs) and policymakers. PR allows travelers to share rides with unknown passengers, offering benefits such as cost reduction and congestion relief. However, adoption remains limited due to safety concerns, privacy issues, and trust in rideshare platforms. A national U.S. survey with 5,385 respondents examined transportation preferences and barriers to PR adoption. Exploratory and confirmatory factor analyses identified five key factors influencing PR consideration—safety, service experience, privacy, traffic/environment, and time/cost. Second factor analyses examined ways to optimize PR experiences, revealing four factors—comfort/ease of use, convenience, vehicle technology/accessibility, and passenger safety. Privacy concerns, for instance, using regression analysis, were found to reduce the likelihood of PR adoption by 77%, and convenience had the potential to increase it by 156%. The Pooled Rideshare Acceptance Model (PRAM), based on the Technology Acceptance Model, assessed the impact of these factors using the Structural Equation Model (SEM). Privacy, safety, trust, and convenience had a large effect (Cohen's f2 > 0.35) on PR acceptance, while multigroup analyses (PRAMMA) explored 16 demographic variables such as gender, generation, and income, emphasizing the need for tailored strategies. Based on all the statistical analysis and workshops using descriptive statistics, 95 actionable recommendations were made from the riders' perspective. Findings highlight the importance of customized services, user experience improvements, and policy interventions to enhance PR adoption. This dissertation provides a roadmap for future research and policy development, ensuring evidence-based, practical strategies to improve PR services in the U.S. and beyond.

Gangadharaiah, Rakesh↗
DOE OSTI2022

Reinforcement Learning for feedback-enabled cyber resilience

The rapid growth in the number of devices and their connectivity has enlarged the attack surface and made cyber systems more vulnerable. As attackers become increasingly sophisticated and resourceful, mere reliance on traditional cyber protection, such as intrusion detection, firewalls, and encryption, is insufficient to secure the cyber systems. Cyber resilience provides a new security paradigm that complements inadequate protection with resilience mechanisms. A Cyber-Resilient Mechanism (CRM) adapts to the known or zero-day threats and uncertainties in real-time and strategically responds to them to maintain the critical functions of the cyber systems in the event of successful attacks. Feedback architectures play a pivotal role in enabling the online sensing, reasoning, and actuation process of the CRM. Reinforcement Learning (RL) is an important gathering of algorithms that epitomize the feedback architectures for cyber resilience. It allows the CRM to provide dynamic and sequential responses to attacks with limited or without prior knowledge of the environment and the attacker. In this work, we review the literature on RL for cyber resilience and discuss the cyber-resilient defenses against three major types of vulnerabilities, i.e., posture-related, information-related, and human-related vulnerabilities. Here we introduce moving target defense, defensive cyber deception, and assistive human security technologies as three application domains of CRMs to elaborate on their designs. The RL algorithms also have vulnerabilities themselves. We explain the major vulnerabilities of RL and present develop several attack models where the attacker target the information exchanged between the environment and the agent: the rewards, the state observations, and the action commands. We show that the attacker can trick the RL agent into learning a nefarious policy with minimum attacking effort. The paper introduces several defense methods to secure the RL-enabled systems from these attacks. However, there is still a lack of works that focuses on the defensive mechanisms for RL-enabled systems. Last but not least, we discuss the future challenges of RL for cyber security and resilience and emerging applications of RL-based CRMs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Optimal Transmission Switching Using the IV-ACOPF Linearization

In this paper we seek to investigate the performance of transmission switching using the iterative linear program approximation to the Current Voltage AC Optimal Power Flow (IV-ACOPF). Several different methods of using this switching are investigated to find a method that addresses the MIP challenges and is both fast and accurate. We consider opening only one line, opening up to five lines, and progressively opening one line at a time. The linear method with switching is much faster than the nonlinear ACOPF and generally finds solutions within 1% of the nonlinear ACOPF.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Flexible Oxy-Fuel Combustion for High-Penetration Variable Renewables

A thermodynamic model was developed for the oxy-combustion Allam-Fetvedt cycle. This information was then used to develop an optimized dispatch strategy using price strips supplied by the modeling teams. The price strips represent future possible grid configurations that include a high penetration of variable renewables and a carbon tax. Multiple optimization strategies and tools were used to maximize the net present value (NPV) of the plant on these potential future grids. The optimization varied the size of the air separation unit, the size of oxygen storage tanks, the size of carbon dioxide storage tanks and the flow rate of the carbon dioxide pipeline. The team was able to determine a dispatch strategy that resulted in a positive NPV for all price strips. This indicates that an oxy-combustion plant with oxygen storage would be economically viable on a future grid with a high degree of variable renewables.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

Modeling the Value of Integrated Canadian and U.S. Power Sector Expansion

The United States and Canada power systems are not isolated. Cross-border transmission and coordination of system operation create an interconnected power system, which results in combined imports and exports of electricity of greater than 70 TWh per year [1]. Currently, over 5 GW of new international transmission lines are in various stages of permitting and development. These lines may enable greater integration and coordination of the U.S. and Canada systems, which can in turn reduce challenges associated with integration of high penetrations of variable renewables. Furthermore, low-cost Canadian resources, such as wind and hydro, could contribute to compliance with the EPA's recently released Clean Power Plan. Improving integration and coordination internationally will reduce the costs of accessing these resources. This analysis work build on previous work by Ibanez and Zinaman [2]. In this work we seek to better understand the value of additional interconnection between the U.S. and Canadian power systems. Specifically, we quantify the value of additional interconnection and coordination within the Canadian-US integrated power system under scenarios in which large reductions (>80%) in power sector CO2 emissions are achieved. We explore how the ability to add additional cross-border transmission impacts capacity investment, the generation mix, system costs, and the ability of the system to integrate variable renewable energy into the power system. This analysis uses the Regional Energy Deployment System (ReEDS) capacity expansion model [3], [4] to quantify the value of the integrated power system expansion of the United States and Canada. ReEDS is an optimization model that assesses the deployment and operation (including transmission) of the electricity sector of the contiguous United States and Canadian provinces from 2016 through 2050. It has the ability to model the integration of renewable energy technologies into the grid. ReEDS captures renewable energy resources through the use of 356 individual resource regions and 134 balancing areas across the U.S. and is able to handle renewable energy issues such as variability in wind and solar output, transmission costs and constraints, and ancillary services requirements.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2016

DragonView: Toward Understanding Network Interference in Dragonfly-based Supercomputers

Acquiring and maintaining high performance computing systems represents a substantial, long term investment. Therefore, it is paramount to optimize their utilization in order to maximize the return on investment and the impact on science and engineering. In this context, network congestion and inter-job interference are a major challenge as they can lead to significant systemwide performance degregation. This is especially pertinent in shared interconnects such as the dragonfly network, in which resources are shared by multiple jobs. Since many large-scale applications are communication-bound, a few communication heavy applications can have a large impact on the performance of all jobs and decrease the overall system throughput. In this paper, we describe a web-based visual analytics environment to study congestion and inter-job interference on dragonfly networks. The system enables network architects, system administrators and application developers to explore the potential impact of machine configuration, job placement policies and routing algorithms by visualizing and comparing ensembles of simulated workloads and real world data. We focus on the design of the system and describe the challenges, design decisions and the final implementation. Finally, we present two detailed case studies of prototypical analysis sessions by our stakeholders aimed at exploring the implications of different workloads and machine configurations using ensembles of network simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

In Recognition of Sandia's SCRM Program, Delivering Over 500 Subcontractor Risk Assessments in 2018

The globalization of modern supply chains has resulted in many new risks to Sandia's NW programs and mission. The potential impact of counterfeit products, tampering, theft, malicious software, poor manufacturing and/or development practices, and the influence of foreign governments has become more obvious as new threats and compromises continuously emerge. The Supply Chain Risk Management (SCRM) team was formed specifically to understand and address these risks. We were able to coalesce around these principles to develop and optimize an effective risk assessment process for critical suppliers, called Subcontractor Risk Assessments (SRAs). These elevated screening techniques are planned and delivered in a cost-effective way for Sandia's programs (no increase to purchasing burden rates) and also demonstrate due diligence to DOE/NNSA as a component of Sandia's overall SCRM strategy. SRAs are communicated in a concise 1-page format complete with recommendations as well as links to reference materials for those who require additional details about the SRA process and results.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Influence of Business Models on PV-Battery Dispatch Decisions and Market Value

PV-battery hybrid projects dominate interconnection queues in some regions in the United States, but few projects have been operational long enough to assess how the hybrid capabilities may be used in practice. We interview plant operators and analyze empirical dispatch data for eleven large-scale PV-battery hybrids in three organized wholesale markets in the United States. We use the dispatch data and wholesale market prices to estimate the market value of our sample hybrids in 2020. The empirical increase in market value of a PV-battery hybrid relative to a standalone PV plant varies by project and ranges from $\$$1 to $\$$48/MWhsolar. The premium is driven by market, location, technical characteristics of the PV and battery asset, and battery dispatch strategies. In contrast to the widespread assumptions in the PV-battery hybrid modeling literature, only three of the eleven project operators optimize battery usage for wholesale market revenue as merchant plants. Instead, the majority of operators in the sample have alternate objectives. For example, load-serving entities target peak load reductions, incentive program participants focus on compliance with program requirements, and large energy consumers prioritize resiliency and utility bill minimization. Understanding prevalent dispatch signals and the degree of alignment with system-wide grid needs can increase the market value of PV-battery hybrids.

14 SOLAR ENERGY↗
DOE OSTI2018

Economic Dispatch for DC-Connected Battery Systems on Large PV Plants

Falling costs of energy storage combined with an increasing need to mitigate variable generation integration issues is leading to more PV projects that include batteries. Large PV plants that include batteries face challenges optimizing the value of the power they produce, especially when the batteries are DC-coupled and otherwise clipped power (due to high DC/AC ratio) is available. Multiple charging times and sources must be considered, including: grid charging, charging from PV that would otherwise be exported to the grid, and charging from clipped PV power. Then discharge schedules must be optimized against time-of-day pricing. The National Renewable Energy Laboratory in partnership with Southern Company has developed a heuristic algorithm in the System Advisor Model (SAM) which strategically charges the battery from PV and discharges the battery depending on the time-of-day prices of the PPA, the forecast PV production, and the estimated wear cost of the battery. The algorithm and case study results from a generic plant will be presented with recommendations for future work.

25 ENERGY STORAGE↗
DOE OSTI2026

Optimizing Fleet Operations With Telematics [Slides]

Through the U.S. Department of Energy's Energy to Communities (E2C) program, NLR, other national laboratory experts, and select organizations provide Expert Match - free, short-term technical assistance to address near-term energy challenges and questions. Expert Match is for community stakeholders who have decision-making power or influence in their community but need access to additional energy expertise to inform key upcoming decisions. This Expert Match request supported Prince William County, VA with information about fleet charging and telematics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Who Controls Energy in the Smart Home? A Multidisciplinary Taxonomy

Advances in technology have begun to open new opportunities for behavior-based and technical approaches to managing residential energy use and meet sustainability-related objectives. Visions of the future predict homes with smart technologies delivering enhanced comfort and cost savings to residents; utility-partners who can remotely optimize energy resources to meet grid needs; and occupants who play more active roles in the energy system supported by advanced information communication technologies. Each of these scenarios implies augmented control over home energy use, yet uncertainties remain regarding which ones will deliver the greatest grid benefits and services to customers in a given situation. These scenarios also raise broader questions regarding customer agency and the relationship between customers and third parties moving forward. While both the provision of information to spur behavior change and automated technologies theoretically enhance control over energy use in the built environment, these strategies are not often studied from an integrated perspective. Seeking to address this gap and develop a deeper understanding of the evolving paradigm of control over home energy use, this paper presents a taxonomy to evaluate perspectives from public policy (ex. demand-side management), technological innovation (automated controls), and user-agency (ex. the role of behavior change) on approaches to managing home energy use. We draw on theoretical and empirical evidence from across disciplines to detail the dimensions and implications of deploying programs that incorporate various levels of control and anticipate such a taxonomy will help holistically map out and evaluate tradeoffs between different approaches to demand-side management moving forward.

McIlvennie, Claire↗
DOE OSTI2015

Forecasting of municipal solid waste quantity in a developing country using multivariate grey models

Highlights: • Grey model can be used to forecast MSW quantity accurately with the limited data. • Prediction interval overcomes the uncertainty of MSW forecast effectively. • A multivariate model gives accuracy associated with factors affecting MSW quantity. • Population, urbanization, employment and household size play role for MSW quantity. - Abstract: In order to plan, manage and use municipal solid waste (MSW) in a sustainable way, accurate forecasting of MSW generation and composition plays a key role. It is difficult to carry out the reliable estimates using the existing models due to the limited data available in the developing countries. This study aims to forecast MSW collected in Thailand with prediction interval in long term period by using the optimized multivariate grey model which is the mathematical approach. For multivariate models, the representative factors of residential and commercial sectors affecting waste collected are identified, classified and quantified based on statistics and mathematics of grey system theory. Results show that GMC (1, 5), the grey model with convolution integral, is the most accurate with the least error of 1.16% MAPE. MSW collected would increase 1.40% per year from 43,435–44,994 tonnes per day in 2013 to 55,177–56,735 tonnes per day in 2030. This model also illustrates that population density is the most important factor affecting MSW collected, followed by urbanization, proportion employment and household size, respectively. These mean that the representative factors of commercial sector may affect more MSW collected than that of residential sector. Results can help decision makers to develop the measures and policies of waste management in long term period.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2014

2014 HPC Annual Report

Our commitment is to support you through delivery of an IT environment that provides mission value by transforming the way you use, protect, and access information. We approach this through technical innovation, risk management, and relationships with our workforce, Laboratories leadership, and policy makers nationwide. This second edition of our HPC Annual Report continues our commitment to communicate the details and impact of Sandia’s large-scale computing resources that support the programs associated with our diverse mission areas. A key tenet to our approach is to work with our mission partners to understand and anticipate their requirements and formulate an investment strategy that is aligned with those Laboratories priorities. In doing this, our investments include not only expanding the resources available for scientific computing and modeling and simulation, but also acquiring large-scale systems for data analytics, cloud computing, and Emulytics. We are also investigating new computer architectures in our advanced systems test bed to guide future platform designs and prepare for changes in our code development models. Our initial investments in large-scale institutional platforms that are optimized for Informatics and Emulytics work are serving a diverse customer base. We anticipate continued growth and expansion of these resources in the coming years as the use of these analytic techniques expands across our mission space. If your program could benefit from an investment in innovative systems, please work through your Program Management Unit ’s Mission Computing Council representatives to engage our teams.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Developing Renewable Energy Applications for Water Treatment Technologies and Transmission

The need for smaller treatment facilities for more isolated or rural municipal entities and industrial water treatment facilities continues to grow. From environmental justice and energy needs in remote communities that have never been serviced by larger scale utilities to smaller onsite treatment requirements to meet discharge regulations, energy efficient treatment systems that can leverage renewable energy sources can be an important asset to owners. Climate change and population dynamics have changed the needs for distributed water treatment systems and the manner in which they function. New treatment technologies that can operate under dynamic conditions and leverage variable energy sources (e.g., renewable energy, RE) can provide substantial efficiencies and cost savings. The National Renewable Energy Laboratory (NREL) is embarking on research projects that will perform multi-scale studies to investigate treatment technologies on varying source water quality that can operate under unsteady state flow conditions (timing) in response to energy availability, supply, and demand. A pilot-scale system will be built to assess modularity and scaling of treatment system operating conditions and performance. Modeling will also be used to determine feasibility and integration into grid emulation platforms to understand the use and value of operation with RE. Optimization will be completed for the treatment and distribution systems to document strengths and weaknesses of using RE power sources. Results of this effort will advance dynamic water treatment understanding under variable conditions and integration of RE sources to power these systems. This will lead to further decarbonization of municipal and private treatment facilities while supporting a paradigm shift in water treatment process operation and system design to achieve net-zero goals and move toward energy-sensitive resilient water treatment systems.

ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Oilwell Conversion (Well API 121913310501) to Geothermal Heat Storage Well for Flexible Electricity Storage

Geothermal growth is limited by a lack of geographically dispersed high-temperature thermal resources and high initial upfront investment in characterization and well construction. This project intended to address the challenges of energy supply intermittency and enhance grid resilience, reliability, and energy security by storing energy provided from currently available renewable resources in the subsurface to harvest it a later time during at-peak energy demand. This project intended to improve geothermal adoption, reduce initial project risk, and improve price competitiveness through utilizing existing oil and gas infrastructure such as non-productive wells, non-economic fields, dry holes, and orphaned wells. The project also intended to address the lack of geographically dispersed thermal resources and enhance grid resilience, reliability, and energy security by introducing an economical method for storing energy from currently available renewable resources in the subsurface for usage during at-peak energy demand. During this research, the project furthered the understanding of the feasibility of utilizing abandoned oil and gas wells as geothermal heat storage wells. The project team investigated the heat storage and hydrogeological characteristics of subsurface reservoirs in the Illinois Basin to evaluate their response to heat injection for determining the evolution of temperature profiles and heat losses over time using existing and available data sets. The project team then performed modeling and simulation to evaluate the heat losses of returning fluids during heat extraction. The outputs were used to select an optimal candidate reservoir and location in Southern Illinois. The team designed and performed a small-scale field test in an existing oil well to refine the model and to demonstrate the permitting and regulatory pathways necessary for the conversion of oil and gas assets to geothermal use. The field test also serves as a proof of concept and can guide the procedures for future research and implementation. Additionally, the project team, conducted initial market research and customer discovery to develop a go to market strategy for an Advanced Geothermal Energy Storage (AGES) system. The project team in this research also identified the parameters to be refined in future research, to improve the current go to market strategy economic model. To this end several subject matter experts were also identified to assist in future research with geothermal infrastructure setup, energy storage policy and law, energy storage market demand, potential siting based on demand etc. Future research will involve further sophistication of the site commercial modeling, implementing a larger-scale test, and further refinement of the thermodynamic modeling/simulation process. The output will be lifecycle costs and economics suitable for comparison to alternative approaches from a validated full-scale demonstration for venture capital investment into this technology. The project successfully demonstrated the ability to leverage existing oilfield infrastructure, permits, and land access and leasing agreements, to enable geothermal storage projects to come online faster and cheaper than a greenfield development could. This technology could allow for greater energy independence and security through long-term energy storage solutions. The longer duration allows for greater storage for renewables currently limited by hours-long storage durations of lithium-ion. The AGES system would support the growth of renewable energy farms, and provide greater opportunities for a cleaner energy infrastructure.

15 GEOTHERMAL ENERGY↗