Search NASA⌕ Search

SEARCH · Search NASA

Results for “, policy gradient”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

101 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Formulation and solution approach for calibrating activity-based travel demand model-system via microsimulation

This study addresses the problem of calibrating utility-maximizing nested logit activity-based travel demand model-systems. After estimation, it is common practice to use aggregate measurements to calibrate the estimated model-system’s parameters prior to their application in transportation planning, policy making, and operations. However, calibration of activity-based model-systems has received much less attention. Existing calibration approaches are myopic heuristics in the sense that they do not consider the fundamental inter-dependencies among choice-models and do not have a systematic way to adjust model parameters. Also, other purely simulation-based approaches do not perform well in large-scale applications. In this study, we focus on utility-maximizing nested logit activity-based model-systems and calibrating aggregate statistics such as activity shares, mode shares, time-dependent & mode-specific OD flows, and time-dependent & mode-specific sensor counts. We formulate the calibration problem as a simulation-based optimization problem and propose a stochastic gradient-based solution procedure to solve it. The solution procedure relies on microsimulation to calculate expectations of the aggregate statistics of interest to the calibration problem. Additionally, we derive approximate analytical expressions for the gradient of the objective function —that are evaluated through microsimulation on mini-batches of the population. The proposed solution procedure is sensitive to the fundamental structure of the activity-based model-system and is non-myopic in considering the dependencies across its model components. The formulated optimization problem is non-convex, highly nonlinear, and potentially has multiple-minima. Lastly, we show —through a real-world application— that the proposed solution procedure outperforms other state-of-the-art purely simulation-based optimization approaches in terms of computational efficiency, stability, and convergence. We also compare various gradient-based solution algorithms to determine the best algorithm to update the parameters. This work has the potential to facilitate wider and easier application of activity-based model-systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Noise-Resilient Quantum Machine Learning for Stability Assessment of Power Systems

Transient stability assessment (TSA) is a cornerstone for resilient operations of todays interconnected power grids. This paper is a confluence of quantum computing, data science and machine learning to potentially address the power system TSA issue. Here, we devise a quantum TSA (QTSA) method to enable scalable and efficient data-driven transient stability prediction for bulk power systems, which is the first attempt to tackle the TSA issue with quantum computing. Our contributions are three-fold: 1) A high expressibility, low-depth (HELD) quantum circuit is designed for accurate and noise-resilient TSA; 2) A quantum natural gradient descent algorithm is developed for efficient HELD circuit training; 3) A systematical analysis on QTSAs performance under various quantum factors is per-formed. QTSA underpins a foundation of quantum-enabled and data-driven power grid stability analytics. It renders the intractable TSA straightforward and effortless in the Hilbert space, and therefore provides stability information for power system operations. Extensive experiments on quantum simulators and real quantum computers verify the accuracy, noise-resilience, scalability and universality of QTSA.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Mapping Rare Earths and Toxics in E-Waste via Hyperspectral Imaging and Machine Learning

Electronic waste (e-waste) presents a mounting challenge to environmental sustainability due to its complex composition, which includes high-value rare earth elements, hazardous organic compounds, and non-recyclable plastics. Accurate and scalable material classification is essential for enabling efficient resource recovery and safe recycling practices. This study introduces a confidence-aware classification pipeline that combines mid-infrared hyperspectral imaging (HSI), spectral angle mapping (SAM), and iterative machine learning to perform pixel-level material identification across e-waste devices. A curated spectral library encompassing artificial materials (e.g., plastic iron oxide, galvanized metals), minerals (e.g., allanite, hematite), and organic compounds (e.g., benzanthracene, toluene) was used to generate pseudo-labels, each assigned a confidence score based on SAM-derived spectral similarity. High-confidence samples from seven consumer electronics—digital cameras, keyboards, laptop fans, modems, motherboards, TV remotes, and speakers—were iteratively expanded and classified using models such as Support Vector Machine (SVM), Random Forest, Gradient Boosting Classifier, Partial Least Squares Discriminant Analysis (PLSDA) and Logistic Regression. The best-performing classifiers achieved macro F1 scores approaching 1.0. Results revealed widespread plastic content (dominated by plastic iron oxide), the presence of rare earth-bearing minerals like cerium-containing allanite, and pervasive detection of hazardous organics such as benzanthracene. Principal Component Analysis (PCA) visualizations and confusion matrices confirmed high separability and robust classification performance. This methodology enables precise, non-destructive, and scalable classification of heterogeneous e-waste streams. It supports automated, hazard-aware sorting in recycling workflows, facilitating selective recovery of critical materials and compliance with circular economy goals. The confidence-aware framework provides a foundation for real-time deployment in industrial settings, offering significant implications for smart e-recycling infrastructure and policy-driven material stewardship.

Circular economy↗
DOE OSTI2023

Impacts of climate change, population growth, and power sector decarbonization on urban building energy use

Climate, technologies, and socio-economic changes will influence future building energy use in cities. However, current low-resolution regional and state-level analyses are insufficient to reliably assist city-level decision-making. Here we estimate mid-century hourly building energy consumption in 277 U.S. urban areas using a bottom-up approach. The projected future climate change results in heterogeneous changes in energy use intensity (EUI) among urban areas, particularly under higher warming scenarios, with on average 10.1–37.7% increases in the frequency of peak building electricity EUI but over 110% increases in some cities. For each 1 °C of warming, the mean city-scale space-conditioning EUI experiences an average increase/decrease of ~14%/ ~ 10% for space cooling/heating. Heterogeneous city-scale building source energy use changes are primarily driven by population and power sector changes, on average ranging from –9% to 40% with consistent south–north gradients under different scenarios. Across the scenarios considered here, the changes in city-scale building source energy use, when averaged over all urban areas, are as follows: –2.5% to –2.0% due to climate change, 7.3% to 52.2% due to population growth, and –17.1% to –8.9% due to power sector decarbonization. Our findings underscore the necessity of considering intercity heterogeneity when developing sustainable and resilient urban energy systems.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

The Global Technical, Economic, and Feasible Potential of Renewable Electricity

Renewable electricity generation will need to be rapidly scaled to address climate change and other environmental challenges. Doing so effectively will require an understanding of resource availability. We review estimates for renewable electricity of the global technical potential, defined as the amount of electricity that could be produced with current technologies when accounting for geographical and technical limitations as well as conversion efficiencies; economic potential, which also includes cost; and feasible potential, which accounts for societal and environmental constraints. We consider utility-scale and rooftop solar photovoltaics, concentrated solar power, onshore and offshore wind, hydropower, geothermal electricity, and ocean (wave, tidal, ocean thermal energy conversion, and salinity gradient energy) technologies. We find that the reported technical potential for each energy resource ranges over several orders of magnitude across and often within technologies. Therefore, we also discuss the main factors explaining why authors find such different results. According to this review and on the basis of the most robust studies, we find that technical potentials for utility-scale solar photovoltaic, concentrated solar power, onshore wind, and offshore wind are above 100 PWh/year. Hydropower, geothermal electricity, and ocean thermal energy conversion have technical potentials above 10 PWh/year. Rooftop solar photovoltaic, wave, and tidal have technical potentials above 1 PWh/year. Salinity gradient has a technical potential above 0.1 PWh/year. The literature assessing the global economic potential of renewables, which considers the cost of each renewable resource, shows that the economic potential is higher than current and near-future electricity demand. Fewer studies have calculated the global feasible potential, which considers societal and environmental constraints. While these ranges are useful for assessing the magnitude of available energy sources, they may omit challenges for large-scale renewable portfolios.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Hawai‘i Play Fairway (Final Report)

Most of Hawai'i's geothermal resources are blind—their manifestations, such as hot springs and steam vents, do not appear on the ground surface because the heated water flows far below. With the exception of $K\bar{i}lauea East Rift Zone$, in most areas of Hawai'i, high lateral permeability in the first kilometer below ground surface prevents surface thermal features from developing. As a methodology for discovering these blind resources, Play Fairway Analysis (PFA) involves finding potential locations of blind hydrothermal systems and describing potential geothermal sources in rift-zone settings. Using the PFA to find Hawai'i's geothermal resources, the University of Hawai'i (UH) conducted the Hawai‘i Play Fairway Project, Hawai'i's first statewide geothermal resource assessment since 1985. Sponsored by the U.S. Department of Energy, the Hawai'i Play Fairway Project provided an updated resource assessment, a roadmap for additional exploration activities, and the identification of areas for further exploration. Benefitting from UH's core competency in earth sciences and experienced geothermal researchers, the project comprised three phases. During the first phase, the team identified, compiled, and ranked existing geologic, groundwater, and geophysical datasets relevant to subsurface heat, fluid and permeability. Using a Bayesian statistical approach, the team developed a statistical methodology to integrate these data into a resource probability map. The team evaluated the confidence in the probability value and considered development viability of areas with geothermal resources. With these analyses, the team identified 10 locations in the Hawaiian Islands for exploration activities. For the second phase, the team collected new groundwater data in 10 locations across the state and new geophysical data on $L\bar{a}na‘i, Maui$, and central Hawai'i Island and modeled topographically induced stress to better characterize subsurface permeability. Analyzing the subsurface stresses, the team evaluated the potential for fracture-induced permeability. The team inverted the MT and gravity data to produce 3D models of resistivity and density, respectively, on $L\bar{a}na‘i$, across $Haleakal\bar{a}'s$ SW rift (Maui), and surrounding Mauna Kea (Hawai‘i Island). The team developed and applied a new method for incorporating depth information about resistivity, density, and potential for fracture-induced permeability into the statistical method for computing resource probability in these three focus areas. The team incorporated the new groundwater results with the new geophysical results and the calculations of potential for fracture-induced permeability to produce updated maps of resource probability and confidence. Through combining data from the first and second phases, the team determined locations for further exploration during the third phase. For MT and gravity surveys, the team recommended $Kaua'i's$ $L\bar{i}hu'e$ $Basin$, the east rift of $Maui's$ $Haleakal\bar{a}$ volcano, and the southwest rift of Hawai'i Island's Mauna Loa volcano. The MT and gravity surveys aimed to enable improved confidence in the resource potential in these locations. For drilling deep groundwater well(s), the team recommended Southeast Mauna Kea and $L\bar{a}na's$ $P\bar{a}l\bar{a}wai$ $Basin$. During the third phase, further exploration involved drilling a groundwater well in $L\bar{a}na's$ $P\bar{a}l\bar{a}wai$ $Basin$ and performing more geophysical surveys. We deepened an existing water well proximal to our target area on $L\bar{a}na'i$ due to funding constraints that precluded us from spudding a new well that would exceed 1km depth. Drilling was preceded by a number of substantial elements including: writing an Environmental Assessment and the subsequent legal process, performance of deviation logging, lowering a camera down the well, coordinating site preparation with $P\bar{u}lama$ $L\bar{a}na'i$, shipping the UH-owned rig interisland, procuring supplies, and leading 3 community meetings on $L\bar{a}na'i$. Drilling occurred 24/7 the entire month of June 2019 over which time $L\bar{a}na'i$ $Well$ 10 was deepened from 427 m to 1057 m, with continuous core collected. We measured a roughly linear temperature gradient averaging 42°C/km and a maximum bottom hole temperature of 66°C. This gradient is more than twice the background for Hawai'i and within a range of gradients measured in this depth range for some exploration wells within KERZ. We consider these results encouraging for $L\bar{a}na'i's$ resource potential and recommend following with a slim hole within $L\bar{a}na'i's$ caldera (our target zone) to ~ 2 km. Further, the positive implications such results have for the island of O‘ahu are substantial - the shield stage of O'ahu's volcanoes ended 1-2 My earlier. However, O'ahu uses more electricity than the rest of the islands combined, and the utility recently called for 500-700MW of firm, dispatchable renewable electricity on O'ahu by 2033. In Phase 3, we also collected limited new encouraging groundwater data, and updated our thoughts on the probabilities of fluid and permeability at resource depths (Pr F = 1; Pr P = mostly unconstrained). Ultimately, we advocate for using our final probability of heat, and confidence in this probability, to drive the next phase of exploration. We contend further development of geothermal in Hawai‘i will enable the state to achieve its 100% renewable policy objective and Hawai'i to transition off of fossil fuels through geothermal discovery and development. The project not only produced a large amount of data and expanded the existing knowledge of Hawai'i's geothermal resources, but also produced publications, theses, presentations, core photos, datasets, media reports, television interviews, community events, and a blog. Students and new professionals benefitted from the project's hands-on research experiences and educational opportunities and earned awards and recognition.

15 GEOTHERMAL ENERGY↗
DOE OSTI2021

The Colorado East River Community Observatory Data Collection

Abstract The U.S. Department of Energy's (DOE) Colorado East River Community Observatory (ER) in the Upper Colorado River Basin was established in 2015 as a representative mountainous, snow‐dominated watershed to study hydrobiogeochemical responses to hydrological perturbations in headwater systems. The ER is characterized by steep elevation, geologic, hydrologic and vegetation gradients along floodplain, montane, subalpine, and alpine life zones, which makes it an ideal location for researchers to understand how different mountain subsystems contribute to overall watershed behaviour. The ER has both long‐term and spatially‐extensive observations and experimental campaigns carried out by the Watershed Function Scientific Focus Area (SFA), led by Lawrence Berkeley National Laboratory, and researchers from over 30 organizations who conduct cross‐disciplinary process‐based investigations and modelling of watershed behaviour. The heterogeneous data generated at the ER include hydrological, genomic, biogeochemical, climate, vegetation, geological, and remote sensing data, which combined with model inputs and outputs comprise a collection of datasets and value‐added products within a mountainous watershed that span multiple spatiotemporal scales, compartments, and life zones. Within 5 years of collection, these datasets have revealed insights into numerous aspects of watershed function such as factors influencing snow accumulation and melt timing, water balance partitioning, and impacts of floodplain biogeochemistry and hillslope ecohydrology on riverine geochemical exports. Data generated by the SFA are managed and curated through its Data Management Framework. The SFA has an open data policy, and over 70 ER datasets are publicly available through relevant data repositories. A public interactive map of data collection sites run by the SFA is available to inform the broader community about SFA field activities. Here, we describe the ER and the SFA measurement network, present the public data collection generated by the SFA and partner institutions, and highlight the value of collecting multidisciplinary multiscale measurements in representative catchment observatories.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2016

Reevaluating Suitability Estimates Based on Dynamics of Cropland Expansion in the Brazilian Amazon

Agricultural suitability maps are a key input for land use zoning and projections of cropland expansion. Suitability assessments typically consider edaphic conditions, climate, crop characteristics, and sometimes incorporate accessibility to transportation and market infrastructure. However, correct weighting among these disparate factors is challenging, given rapid development of new crop varieties, irrigation, and road networks, as well as changing global demand for agricultural commodities. Here, we compared three independent assessments of cropland suitability to spatial and temporal dynamics of agricultural expansion in the Brazilian state of Mato Grosso during 2001 2012. We found that areas of recent cropland expansion identified using satellite data were generally designated as low to moderate suitability for rainfed crop production. Our analysis highlighted the abrupt nature of suitability boundaries, rather than smooth gradients of agricultural potential, with little additional cropland expansion beyond the extent of the flattest areas (0-2% slope). Satellite-based estimates of the interannual variability in the use of existing crop areas also provided an alternate means to assess suitability. On average, cropland areas in the Cerrado biome had higher utilization (84%) than croplands in the Amazon region of northern Mato Grosso (74%). Areas of more recent expansion had lower utilization than croplands established before 2002, providing empirical evidence for lower suitability or alternative management strategies (e.g., pasture soya rotations) for lands undergoing more recent land use transitions. This unplanted reserve constitutes a large area of potentially available cropland (PAC)without further expansion, within the management limits imposed for pest management and fallow cycles. Using two key constraints on future cropland expansion, slope and restrictions on further deforestation of Amazon or Cerrado vegetation, we found little available flat land for further legal expansion of crop production in Mato Grosso. Dynamics of cropland expansion from more than a decade of satellite observations indicated narrow ranges of suitability criteria, restricting PAC under current policy conditions, and emphasizing the advantages of field-scale information to assess suitability and utilization.

Morton, Douglas C.↗
DOE OSTI2024

Stochastic Optimization and Uncertainty Quantification of Natrium-based Nuclear-Renewable Energy Systems for Flexible Power Applications in Deregulated Markets

Rapid integration of variable renewable energy sources (VRES) has made modeling and stochastic optimization of hybrid energy systems crucial for studying their long-term performance and viability. However, most studies have focused on just historical data, which may be unreliable for capturing short-term fluctuations, rare events, and long-term patterns of energy demand, price, and the variability of renewable energy sources. For this study, optimal synthetic time series models were developed using Wasserstein distance. The models were validated by comparing the key statistical measures against those of the historical data. They were then used to optimize the integrated Natrium-style advanced energy systems and their long-term (30 years) economics. The stochastic model performs bi-level optimization to find the optimal sizes for the balance of plant and thermal energy storage, while also optimizing energy dispatch to achieve the maximum net present value. In studies of two deregulated markets (California ISO and the Electric Reliability Council of Texas), the integrated Natrium-style system performed better in CAISO than in ERCOT, given higher and more consistent electricity prices during peak-demand periods. The potentially enlarged cost associated with the variable operation and maintenance of the TES system also plays a significant role in driving the system sizing, thus its impacts on the system are investigated in detail through comparison against a baseline case. The study also finds that the bi-level optimization results based on stochastic gradient descent closely match the grid search results. The uncertainty quantification of the stochastic signals provides further NPV-related insights and probability distributions for the case studies. The normal standard error of the mean of NPV for the case with and without TES VOM for CAISO were found to be 7.73M (plus-minus sign) 1.09M USD and 104.99M (plus-minus sign) 1.25M USD, respectively based on a 95% confidence. Given the relatively small NPV variance based on 150 samples, the analysis affords the most robust possible prediction of the techno-economic performance of the integrated Natrium-style energy systems.

25 ENERGY STORAGE↗
DOE OSTI2021

High-fidelity kinetic modeling of instabilities and gyromotion physics in nonuniform low-beta plasmas

A fourth-order accurate continuum kinetic Vlasov solver and a systematic method for constructing customizable kinetic equilibria are demonstrated to be powerful tools for the study of nonuniform collisionless low-beta plasmas. The noise-free methodology is applied to investigate two gradient-driven instabilities in 4D (x,y,vx,vy) phase space: the Kelvin–Helmholtz instability and the lower hybrid drift instability. Nonuniform two-species configurations where ion gyroradii are comparable to gradient scale lengths are explored. The approach sheds light on the evolution of the pressure tensor in Kelvin–Helmholtz instabilities and demonstrates that the associated stress tensor deviates significantly from the gyroviscous stress tensor. Even at high magnetization, first-order approximations to finite-gyromotion physics are shown to be inadequate for the Kelvin–Helmholtz instability, as shear scales evolve to become on par with gyromotion scales. The methodology facilitates exploring transport and energy partitioning properties associated with lower hybrid drift instabilities in low-beta plasma configurations. Distribution function features are captured in detail, including the formation of local extrema in the vicinity of particle-wave resonances. Finally, the approach enables detailed targeted investigations and advances kinetic simulation capability for plasmas in which gyromotion plays an important role.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Patterns, drivers, and a predictive model of dam removal cost in the United States

Given the burgeoning dam removal movement and the large number of dams approaching obsolescence in the United States, cost estimating data and tools are needed for dam removal prioritization, planning, and execution. We used the list of removed dams compiled by American Rivers to search for publicly available reported costs for dam removal projects. Total cost information could include component costs related to project planning, dam deconstruction, monitoring, and several categories of mitigation activities. We compiled reported costs from 455 unique sources for 668 dams removed in the United States from 1965 to 2020. The dam removals occurred within 571 unique projects involving 1–18 dams. When adjusted for inflation into 2020 USD, cost of these projects totaled $\$1.522$ billion, with per-dam costs ranging from $\$1$ thousand (k) to $\$268.8$ million (M). The median cost for dam removals was $\$157$k, $\$823$k, and $\$6.2$M for dams that were< 5 m, between 5–10 m, and > 10 m in height, respectively. Geographic differences in total costs showed that northern states in general, and the Pacific Northwest in particular, spent the most on dam removal. The Midwest and the Northeast spent proportionally more on removal of dams less than 5 m in height, whereas the Northwest and Southwest spent the most on larger dam removals > 10 m tall. We used stochastic gradient boosting with quantile regression to model dam removal cost against potential predictor variables including dam characteristics (dam height and material), hydrography (average annual discharge and drainage area), project complexity (inferred from construction and sediment management, mitigation, and post-removal cost drivers), and geographic region. Dam height, annual average discharge at the dam site, and project complexity were the predominant drivers of removal cost. The final model had an R 2 of 57% and when applied to a test dataset model predictions had a root mean squared error of $\$5.09$M and a mean absolute error of $\$1.45$M, indicating its potential utility to predict estimated costs of dam removal. We developed a R shiny application for estimating dam removal costs using customized model inputs for exploratory analyses and potential dam removal planning.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗