The Generalization-Stability Tradeoff In Neural Network Pruning
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Abstract not provided.
Technoeconomic analysis (TEA) is commonly used to determine economic viability of power-generating technologies, including concentrating solar power (CSP) and thermal (CST) production plants. Levelized cost of electricity (LCOE) and analogous measures provide an estimate of long-term costs for operating power plants over their designed lifetimes by accounting for revenues and costs in a time-discounted manner. While these measures are effective when assessing a technology's total lifecycle costs and productivity under various designs, TEA of candidate incremental technology improvements from the lens of LCOE can be limited when required investment and LCOE impacts are small. In this work, we propose a novel metric for TEA of a plant component technology that recasts relative changes in levelized system costs into component-specific capital cost budgets. This measure, which we refer to as the equivalent breakeven installed cost, is the maximum budget for the technology component that leads to improved levelized costs. We illustrate the usefulness of this metric using the example of candidate heliostat improvements for a CSP tower plant. Here, the results suggest that a reduction in mirror washing costs yield a total plant O&M cost of $37/kWe-yr, which is a breakeven proposition if the average reflectance is reduced from 0.90 to 0.85 as a result of the cost savings.
The importance of hydropower increases as the power grid evolves with the higher variable renewable contribution. As conventional thermal power plants are retired, the importance of hydropower contribution increases to balance the variability of solar and wind generation. However, reservoir water resources are constrained by multiple constraints, and variability of water inflow to the reservoirs creates limitations to dam water releases for power grid needs. Coordinating multiple tools, including water resources, ecological, and technical and economic power grid modeling, informs dam water releases. The case study, the Columbia River Basin multipurpose reservoir project, is operated for hydropower production and many other purposes considering the aquatic habitat of the river basin. Specifically, the river basin fish population is a vital element for the tribal community of the river basin. We integrated a production cost model, a water resource model, and decades of tribal knowledge to analyze the fish-friendly way of operating Columbia hydropower scheduling and grid impacts. We measure power grid impacts for various water resources planning scenarios in terms of total system operating cost, system reliability indicators, changes in wind and solar generation and curtailments, local marginal prices, and revenue for hydropower producers. The study results inform reservoir operating rules decisions from hydropower power producers, system operators, other water users, tribes, environmentalists, and other stakeholders.
Predictive maintenance (PdM) has shown great potential for achieving substantial cost savings and enhancing the economic competitiveness of nuclear power plants (NPPs) in today's energy market. Among the different modeling approaches that exist, machine learning (ML) tools in particular have a demonstrated ability to handle high dimensional and multivariate data and to extract hidden relationships within data in industrial environments. While ML methods show great potential, their lack of explainability---especially for black-box models---is a major hurdle to their adoption. Moreover, considering the supposed trade-off between explainability and performance challenges, careful consideration must be made as to which of these quality aspects takes precedence in light of multiple modeling options, resource availability, and domain characteristics. The present work evaluates the performance of six ML models, each with a different degree of explainability, in classifying the conditions of circulating water pumps (CWPs) by utilizing sensor data from nuclear power plants. To determine the drivers behind the trade-offs presented by this array of models, this work also tests different combinations of CWP units as the training and testing data, degrees of data imbalance, and objective functions for hyperparameter tuning. It was found that black-box models tend to afford superior performance in cases where there are far more instances of one type of labeled data than of any other type. It is recommended that a guided procedure be followed for designing and delivering an ML system that is sufficiently explainable to all involved stakeholders.
We propose a modular three-dimensional bosonic quantum processor built from repeatable coupled-cavity modules linked by configurable interconnect networks. Using hardware-motivated graph-theoretic measures, we compare nearest-neighbor, hub-based, and hybrid architectures in terms of interconnect count, communication distance, resource concentration, and implementation complexity. Rather than identifying a universally optimal topology, our analysis shows how these architectures redistribute the costs of scaling, including wiring and port requirements, nonlocal communication distance, exposure to shared resources, routing bottlenecks, and scheduling overhead. Case studies of a \(3\times3\) processor and a larger hierarchical architecture further distinguish finite-size performance from asymptotic scaling. The resulting framework provides a systematic basis for evaluating modular three-dimensional bosonic processors and for identifying the device-level parameters required for quantitative hardware design.
A challenge in designing self-assembling building blocks is to ensure the target state is both thermodynamically stable and kinetically accessible. These two objectives are known to be typically in competition, but it is not known how to simultaneously optimize them. We consider this problem through the lens of multi-objective optimization theory: we develop a genetic algorithm to compute the Pareto fronts characterizing the tradeoff between equilibrium probability and folding rate, for a model system of small polymers of colloids with tunable short-ranged interaction energies. We use a coarse-grained model for the particles' dynamics that allows us to efficiently search over parameters, for systems small enough to be enumerated. For most target states there is a tradeoff when the number of types of particles is small, with medium-weak bonds favouring fast folding, and strong bonds favouring high equilibrium probability. Additionally, the tradeoff disappears when the number of particle types reaches a value m *, that is usually much less than the total number of particles. This general approach of computing Pareto fronts allows one to identify the minimum number of design parameters to avoid a thermodynamic–kinetic tradeoff. However, we argue, by contrasting our coarse-grained model's predictions with those of Brownian dynamics simulations, that particles with short-ranged isotropic interactions should generically have a tradeoff, and avoiding it in larger systems will require orientation-dependent interactions.
In this simulation study, cycle-to-cycle fuel control was used to reduce CCV by injecting additional fuel in operating conditions with sporadic misfires and partial burns. An optimal control policy was proposed that utilizes 1) a physics-based model that tracks in-cylinder gas composition and 2) a one-step-ahead prediction of the combustion efficiency based on a kernel density estimator. The optimal solution, however, presents a tradeoff between the reduction in combustion CCV and the increase in fuel injection quantity required to stabilize the charge. Such a tradeoff can be ad- just by a single parameter embedded in the cost function.
The proliferation of low-cost sensors and industrial data solutions has continued to push the frontier of manufacturing technology. Machine learning and other advanced statistical techniques stand to provide tremendous advantages in production capabilities, optimization, monitoring, and efficiency. The tremendous volume of data gathered continues to grow, and the methods for storing the data are critical underpinnings for advancing manufacturing technology. This work aims to investigate the ramifications and design tradeoffs within a decoupled architecture of two prominent database management systems (DBMS): sql and NoSQL. A representative comparison is carried out with Amazon Web Services (AWS) DynamoDB and AWS Aurora MySQL. The technologies and accompanying design constraints are investigated, and a side-by-side comparison is carried out through high-fidelity industrial data simulated load tests using metrics from a major US manufacturer. The results support the use of simulated client load testing for comparing the latency of database management systems as a system scales up from the prototype stage into production. As a result of complex query support, MySQL is favored for higher-order insights, while NoSQL can reduce system latency for known access patterns at the expense of integrated query flexibility. Here, by reviewing this work, a manufacturer can observe that the use of high-fidelity load testing can reveal tradeoffs in IoTfM write/ingestion performance in terms of latency that are not observable through prototype-scale testing of commercially available cloud DB solutions.
There is a divide in energy access studies, between technologically-focused modeling papers in engineering and economics, and energy justice frameworks and principles grounded in social sciences. Quantitative computational models are necessary when analyzing energy, and more specifically electricity, systems, as they are technologically-complex systems that can diverge from intuitive patterns. To assure energy justice, these models must be reflective of, and informative to, a wide range of stakeholders, including households and communities alongside utilities, governments, and others. Yet, moving from a qualitative understanding of preferences to quantitative modeling is challenging. In this perspective piece, we pilot the use of the value-focused thinking framework to inform stakeholder engagement. The result is a strategic objective hierarchy that highlights the tradeoffs and the social, economic and technological factors that need to be measured in models. We apply the process in Ghana, using a survey, stakeholder workshops, and follow-up interviews to uncover key tradeoffs and stakeholder-derived objectives. We discuss three key areas that have been rarely, if ever, well-represented in energy models: (1) the relationship between the dynamics of electricity end-use and the technology and economic structure of the system; (2) explicit tradeoffs between electricity access, cost, and reliability as defined by stakeholders; and (3) the definition of new objectives, such as minimizing hazards related to theft. We conclude that this model of engagement provides an opportunity to tie together rigorous qualitative analysis and stakeholder engagement with crucial quantitative models of the electricity system.
Adoption of paired solar-plus-storage systems has accelerated in recent years, driven by both the demand for backup power and a desire to manage utility bills. Tradeoffs between those two uses can arise through the reserve setting on the battery storage system, which serves to maintain a minimum state of charge in case of a power interruption. Our paper applies an economic framework to evaluate this tradeoff in terms of changes in bill savings and customer reliability value across reserve levels, considering how those tradeoffs depend on the underlying electricity rate structure and levels. The analysis is based on a representative set of load profiles, solar profiles, tariff designs, and stochastic power interruption events across ten different regions in the United States. We find that the opportunity cost of holding storage capacity in reserve, in terms of foregone bill reductions, outweighs any gains in reliability value from mitigated power interruptions in the majority of customer situations. Higher storage reserve levels increase total customer value only in specific circumstances, such as for customers with inferior reliability (10x average interruptions), with a very high value of lost load ($50/kWh), and with tariff or interconnection rules that disallow grid charging. However, even this result is dampened when considering tariff designs with higher price differentials that increase the opportunity cost of holding storage in reserve (e.g. import/export or time-of-use rates). Allowing grid charging in tariffs essentially eliminates the necessity to hold any storage in reserve in all sensitivity cases explored.
Abstract The Western US faces increasing water stress from the impacts of climate change, making it difficult to meet water demands for the region's cities, agriculture, and hydropower generators. Existing literature suggests that climate adaptation measures such as water conservation, cropland retirement, wastewater recycling, and managed aquifer recharge can alleviate some of these challenges. Few analyses, however, compare the relative efficacy and system‐wide effects of these adaptations under different climate projections across the entire Western United States. Here we use a Western US‐wide water systems model to evaluate, by sector and sub‐region, how the widespread implementation of these adaptive measures impacts water demands, water deliveries, and electricity use related to the water system for three different climate projections. We find that wastewater recycling has greater potential to lower unmet indoor water demands than urban indoor water conservation measures. However, when implemented at scale, indoor water conservation reduces electricity use by an average of 683 Terawatt hours while wastewater recycling increases energy use by an average of 721 Terawatt hours, cumulatively from 2020 to 2070. Cropland retirement and aquifer recharge adaptations increase the ability to meet agricultural water demand, increase groundwater storage, and reduce summertime electricity use. While most of these findings are consistent across different climate projections, the benefits of aquifer recharge are sensitive to spatial variation of precipitation. Given the limitations and tradeoffs of each individually, the results suggest that a portfolio of adaptation measures will be needed for a climate‐resilient water and energy future in the Western US. Plain Language Summary The Western US faces increased water stress from the impacts of climate change, making it difficult to meet demands for cities, agriculture, and hydropower facilities. Adaptation measures like water conservation, retiring agricultural lands, recycling wastewater, and storing water underground can address these challenges. However, there is little modeling to understand the impact of these adaptations if they were implemented across the entire Western US while also considering climate change. We use a Western US‐wide water systems model to evaluate how implementing adaptation measures impacts groundwater levels, the ability to meet water demands, and electricity use related to water in three different possible climate futures. We find that recycling wastewater to drinking water standards does a better job of meeting urban water demands than water conservation measures. However, indoor water conservation reduces energy use for water while recycling wastewater increases energy use for water. Retiring agricultural lands and storing water underground both increase the ability to meet agricultural water demands, increase underground water storage, and reduce summertime energy use. No adaptation measures provides benefits across every metric we track. Therefore, multiple adaptation measures will likely be needed to achieve a climate‐resilient future for energy and water in the Western US. Key Points Water‐related climate change adaptations have different benefits and tradeoffs for interconnected water‐energy systems in the Western U.S. Wastewater recycling most increases urban water coverage, but has a significant tradeoff in the form of greater electricity use Cropland retirement and aquifer recharge benefit water and electricity systems most in the summer when those systems are most stressed
The design of a 150-kW high-frequency three-port transformer (TPT) for a triple active bridge (TAB) converter application is the focus of this paper. A non-tradeoff inclusive design methodology for custom-core transformers is proposed. Classic transformer design methodologies based on complex trade-offs mechanisms require significant effort to adjust the design for commercially available pre-sized cores. The proposed design is based on the development of a set of design equations that allows to select the core dimensions and the turns numbers for the windings that best accomplish the transformer specifications. Experimental evidence verifying the proposed theoretical design methodology is presented in this work.
The ability to react to a malicious attack starts with high fidelity recognition, and with that, an agile response to the attack. The current operational technology (OT) systems for a critical infrastructure may include an intrusion detection system (IDS), but the ability to adapt to an intrusion is a human initiated response. Orchestrators, which are coming of age in the financial sector and allow for levels of automated response, are not prevalent in the OT space. To evolve to such responses in the OT space, a tradeoff analysis is first needed, The tradeoff analysis, which evaluates the mitigation benefits of responses versus the physical affects that result, inform an automated response decision. The intent of this paper is to provide a formulation of a tradeoff analysis and its use in advancing automated, agile responses.
Modern land management faces unprecedented uncertainty regarding future climates, novel disturbance regimes, and unanticipated ecological feedbacks. Mitigating this uncertainty requires a cohesive landscape management strategy that utilizes multiple methods to optimize benefits while hedging risks amidst uncertain futures. We used a process-based landscape simulation model (LANDIS-II) to forecast forest management, growth, climate effects, and future wildfire dynamics, and we distilled results using a decision support tool allowing us to examine tradeoffs between alternative management strategies. We developed plausible future management scenarios based on factorial combinations of restoration-oriented thinning prescriptions, prescribed fire, and wildland fire use. Results were assessed continuously for a 100-year simulation period, which provided a unique assessment of tradeoffs and benefits among seven primary topics representing social, ecological, and economic aspects of resilience. Projected climatic changes had a substantial impact on modeled wildfire activity. In the Wildfire Only scenario (no treatments, but including active wildfire and climate change), we observed an upwards inflection point in area burned around mid-century (2060) that had detrimental impacts on total landscape carbon storage. While simulated mechanical treatments (~ 3% area per year) reduced the incidence of high-severity fire, it did not eliminate this inflection completely. Scenarios involving wildland fire use resulted in greater reductions in high-severity fire and a more linear trend in cumulative area burned. Mechanical treatments were beneficial for subtopics under the economic topic given their positive financial return on investment, while wildland fire use scenarios were better for ecological subtopics, primarily due to a greater reduction in high-severity fire. Benefits among the social subtopics were mixed, reflecting the inevitability of tradeoffs in landscapes that we rely on for diverse and countervailing ecosystem services. This study provides evidence that optimal future scenarios will involve a mix of active and passive management strategies, allowing different management tactics to coexist within and among ownerships classes. Our results also emphasize the importance of wildfire management decisions as central to building more robust and resilient future landscapes.
The report highlights key considerations for retail regulators in the footprints of the Southwest Power Pool (SPP) or Midcontinent Independent System Operator (MISO) in states that previously opted out of allowing third-party aggregation participation under FERC Order 719 and that may want to explore reversing the decision due to a changing policy environment under new FERC orders (i.e., 2222) and/or tightening resource adequacy constraints. Through a document review and a series of 27 interviews with regulators, aggregators, and other industry professionals, this document provides a high-level policy overview of the retail regulator’s role in a selection of processes, rules, and regulations to better understand how states have treated and/or integrated aggregators into wholesale markets. The report summarizes findings in two sections: General Findings and Specific Policy Findings. The General Findings offer high level takeaways such as the fact that 17 of the 20 states in MISO and SPP footprints opted out of third party aggregations following Order 719. Additionally, there is only one state that is fully restructured in the MISO and SPP footprints whereas the rest are vertically integrated, and the majority of third-party aggregations in the U.S. take place in restructured states outside of these footprints. Even so, third-party aggregations do take place in MISO and SPP albeit in small numbers and in an ad hoc regulatory environment. The specific policy findings delve deeper into specific examples of state actions on the topics of jurisdiction, registration and licensing, data governance, dual participation, and dispute resolution. Tables in each category organize state actions into Tiers I-III, which roughly correspond to the possible level of involvement or possible change necessary by state regulators and/or legislators to implement these actions. The tier level does not indicate any value judgement, as each state has respective regulatory limitations and each decision comes with various tradeoffs. One main tradeoff is between simplicity and quick implementation versus comprehensive and prolonged implementation. In many cases, actions in Tier I could be implemented without significant changes by relying on the use of existing processes for an aggregator context. On the other hand, many actions in Tier III are more narrowly designed to address aggregators specifically, but often require more significant changes including the involvement of additional parties through stakeholder engagement or legislative action. In some cases, these tiers are discrete. However, state regulators may also choose to progress through these various tiers sequentially as they phase in aggregators while learning from their experience. With the ability to stack bulk system level services, distributed energy resource aggregations in MISO and SPP could provide various private benefits (e.g., increased value streams to the owner) as well as societally beneficial grid services (e.g., peaking capacity, ancillary services, and other services that increase the grid’s overall operational efficiency). In deciding how to best to enable these benefits, states and retail regulators must weigh various tradeoffs if considering reversing a previous opt out.
The goal of this project was to develop tools for studying plant processes in living tissues. We wanted a method for introducing probes for studying plant processes such that plants could remain intact and imaged iteratively. Towards this end, we successfully optimized carbon nanofibers that we showed could deliver non-permeable signaling probes/biomolecules to plant cells. These were created on a rigid backing and also successfully transferred to a flexible backing to use with curved plant structures. We also built fiber optic microscopes that permit iterative non-destructive fluorescence or light micrographs and created protocols and devices to stabilize plant organs during imaging. These tools were developed in conjunction with research aimed understanding receptor-mediated peptide trafficking and responses relevant to plant cell growth and defense tradeoff. During this project, we designed and built two fiberoptic fluorescence microscopes; (b) designed, fabricated and validated different nanospike designs for delivering probes to plants, including the feasibility of delivering DNA constructs for expression studies; (c) developed fluorescent peptide probes (active and inactive versions of a secreted receptor ligand called phytosulfokine or PSK) and performed mobility tests after application to plants using microscopy; (d) used appropriate genetic plant backgrounds to facilitate PSK trafficking and response mechanisms; (e) determined the transcriptional changes due to PSK-induced signaling related to growth/defense tradeoff; (f) performed experiments showing the growth/defense tradeoff involves repression of specific defense components in response to PSK. This project also involved the training of two PhD students and five Masters students.