Search NASA⌕ Search

SEARCH · Search NASA

Results for “dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Development and Evaluation of Velocity Predictive Optimal Energy Management Strategies in Intelligent and Connected Hybrid Electric Vehicles

In this study, a thorough and definitive evaluation of Predictive Optimal Energy Management Strategy (POEMS) applications in connected vehicles using 10 to 20 s predicted velocity is conducted for a Hybrid Electric Vehicle (HEV). The presented methodology includes synchronous datasets gathered in Fort Collins, Colorado using a test vehicle equipped with sensors to measure ego vehicle position and motion and that of surrounding objects as well as receive Infrastructure to Vehicle (I2V) information. These datasets are utilized to compare the effect of different signal categories on prediction fidelity for different prediction horizons within a POEMS framework. Multiple artificial intelligence (AI) and machine learning (ML) algorithms use the collected data to output future vehicle velocity prediction models. The effects of different combinations of signals and different models on prediction fidelity in various prediction windows are explored. All of these combinations are ultimately addressed where the rubber meets the road: fuel economy (FE) enabled from POEMS. FE optimization is performed using Model Predictive Control (MPC) with a Dynamic Programming (DP) optimizer. FE improvements from MPC control at various prediction time horizons are compared to that of full-cycle DP. All FE results are determined using high-fidelity simulations of an Autonomie 2010 Toyota Prius model. The full-cycle DP POEMS provides the theoretical upper limit on fuel economy (FE) improvement achievable with POEMS but is not currently practical for real-world implementation. Perfect prediction MPC (PP-MPC) represents the upper limit of FE improvement practically achievable with POEMS. Real-Prediction MPC (RP-MPC) can provide nearly equivalent FE improvement when used with high-fidelity predictions. Constant-Velocity MPC (CV-MPC) uses a constant speed prediction and serves as a “null” POEMS. Results showed that RP-MPC, enabled by high-fidelity ego future speed prediction, led to significant FE improvement over baseline nearly matching that of PP-MPC.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Implication of production tax credit on economic dispatch for electricity merchants with storage and wind farms

The production tax credit (PTC) promotes wind energy development, reduces power generation costs, and can affect merchants’ joint economic dispatch, particularly for electricity merchants with both energy storage and wind farms. Two common PTC policies are studied – in the first policy, a wind farm receives PTC by selling wind generation to the market and its storage can be used to store energy from the wind generation and energy purchased from the grid but the energy released from the storage cannot receive PTC; in the second policy, the energy released from the storage can also qualify for PTC but purchasing energy from the grid is not allowed. We then employ dynamic programming to study merchants' optimal decision-making while considering PTC and the physical characteristics of storage systems. We analytically show that the state of charge (SOC) range can be segmented into different regions by SOC reference points under two PTC policies. The merchant's optimal action can be conveniently and uniquely determined based on the region within which the current SOC falls. Moreover, this study illustrates that PTC could substantially alter the optimal scheduling policy structures by affecting reference points and their relationships. The results showed that the frequencies for charging and discharging storage decisions decreased with an increase in PTC subsidy. Last, we confirm that, although the first policy allows merchants to buy electricity from the market, the second policy can bring more profits when the PTC is large at the current PTC rates. Furthermore, the findings can provide multistage decision-making guidance to electricity merchants in the wholesale power market.

17 WIND ENERGY↗
DOE OSTI2022

Economic dispatch for electricity merchant with energy storage and wind plant: State of charge based decision making considering market impact and uncertainties

Here this paper investigates how the market impact of electricity merchants and uncertainty of wind generation affect their co-optimized scheduling policy, specifically for merchants who have both energy storage and wind plants. In the existing literature, merchants' trading actions are usually assumed not to affect market prices; however, a large-scale energy storage merchant's actions can affect market prices. To this end, we approximate the electricity price by a linear function of the quantity of power traded by the merchant in the reward function to achieve decision-making incorporating the market impact. This paper utilizes the dynamic programming approach to analyze merchants' optimal multi-period decision-making incorporating market impact, uncertain wind generation, and energy storage constraints. First, our results demonstrate that for a merchant with co-located energy storage facilities and wind power plants, the energy storage's feasible state of charge (SOC) range can be segmented into four possible sub-ranges by three analytically developed SOC reference points. The unique optimal trading decision can be achieved by comparing the current energy inventory and the SOC references of the next period. Second, our results show that market impact and uncertainties substantially change the optimal storage scheduling policy by impacting the values of the reference points. To mitigate the negative effect of the merchant's market impact on buying and selling actions, the merchant may reduce the amount of generating or pumping electricity each period to maximize profit. Moreover, we identify and investigate the trade-off between market price and transaction quantity. Our findings provide co-optimized scheduling guidance for electricity merchants with co-located energy storage and renewable power plants systems.

17 WIND ENERGY↗
DOE OSTI2020

Systems, methods and computer program products for self-tuning sensor data processing

Systems and methods are disclosed that include tools that utilize Dynamic Detector Tuning (DDT) software that identifies near-optimal parameter settings for each sensor using a neuro-dynamic programming (reinforcement learning) paradigm. DDT adapts parameter values to the current state of the environment by leveraging cooperation within a neighborhood of sensors. The key metric that guides the dynamic tuning is consistency of each sensor with its nearest neighbors: parameters are automatically adjusted on a per station basis to be more or less sensitive to produce consistent agreement of detections in its neighborhood. The DDT algorithm adapts in near real-time to changing conditions in an attempt to automatically self-tune a signal detector to identify (detect) only signals from events of interest. The disclosed systems and methods reduce the number of missed legitimate detections and the number of false detections, resulting in improved event detection.

Draelos, Timothy J.↗
DOE OSTI2021

New developments including X-ray standing waves in the dynamical Bragg diffraction program of X-ray Server

X-ray Server (https://x-server.gmca.aps.anl.gov) is a collection of programs for online modelling of X-ray diffraction and scattering. Additionally, the dynamical diffraction program is the second most popular Server program, contributing 34% of total Server usage. It models dynamical X-ray diffraction from strained crystals and multilayers for any Bragg-case geometry including grazing incidence and exit. This paper reports on a revision of equations used by the program, which yields ten times faster calculations in most use cases, on implementing calculations of X-ray standing waves and on adding new options for modelling diffraction from monolayers.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Parallel point defect identification in molecular dynamics simulations without post-processing: A compute and dump style for LAMMPS

Two classes for the molecular dynamics program LAMMPS – one compute style and one dump style – are presented that are designed to identify, count, and output point defects in cascade damage and related molecular dynamics simulations. The calculations are done in parallel across multiple MPI processes, and can be done at the same time as the original simulation. This drastically reduces storage requirements by eliminating the need to post-process every atom in the system. Non-cubic lattices, free surfaces, and large voids can be eliminated from the output by suitable choices of the reference lattice. The classes are derived from LAMMPS’s Dump and Compute classes, and pose no additional overhead to LAMMPS if they are not used.

42 ENGINEERING↗
DOE OSTI2023

Dynamics in Star-forming Cores (DiSCo): project overview and the first look towards the B1 and NGC 1333 regions in Perseus

The internal velocity structure within dense gaseous cores plays a crucial role in providing the initial conditions for star formation in molecular clouds. However, the kinematic properties of dense gas at core scales (~0.01–0.1 pc) has not been extensively characterized because of instrument limitations until the unique capabilities of GBT-Argus became available. The ongoing GBT-Argus Large Program, Dynamics in Star-forming Cores (DiSCo) thus aims to investigate the origin and distribution of angular momentum of star-forming cores. DiSCo will survey all starless cores and Class 0 protostellar cores in the Perseus molecular complex down to ~0.01 pc scales with <0.05 km s –1 velocity resolution using the dense gas tracer N 2 H + . Here, we present the first data sets from DiSCo towards the B1 and NGC 1333 regions in Perseus. Our results suggest that a dense core’s internal velocity structure has little correlation with other core-scale properties, indicating these gas motions may be originated externally from cloud-scale turbulence. These first data sets also reaffirm the ability of GBT-Argus for studying dense core velocity structure and provided an empirical basis for future studies that address the angular momentum problem with a statistically broad sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Improving Ligand Geometry in Protein Data Bank Structures Computationally

Information about the three‐dimensional structures of complex biological molecules is an indispensable research tool for many fields of study, including biology, chemistry, pharmacology, and computer science. The Protein Data Bank (PDB) is an public digital archive providing access to structures of nucleic acids, proteins, and large macromolecular machines determined experimentally by X‐ray crystallography, nuclear magnetic resonance (NMR) spectroscopy, and 3‐dimensional electron microscopy (3DEM). PDB structures undergo validation for structural plausibility upon their deposition into the PDB using the program Mogul, which cross references each deposited structure against similar data in the Cambridge Structural Database (CSD). Ligands associated with PDB structures are a common source of structural inaccuracy. In this study, a programmatic pipeline was developed to determine if ligand geometric accuracy could be improved using known computational tools. Ligands with dubious geometry were identified through a Python mining code. A sample set of the identified structures was remodeled into minimum energy conformations using the molecular dynamics program AMBER and then fit to the original experimental density maps using the molecular modeling program Coot. The refined models were compared to the original models in the PDB as well as to similar structures in the CSD using the deposition statistical validation server. Preliminary results suggest that the pipeline effectively identifies and improves ligand structures that possess inaccurate geometry. This method can be used to evaluate and improve the accuracy of specific ligands in structures both archived and pending deposition. Support or Funding Information This work was supported by an NSF REU and the RCSB PDB [NSF (DBI‐1338415), NIH, and DOE.] This abstract is from the Experimental Biology 2019 Meeting. There is no full text article associated with this abstract published in The FASEB Journal .

Miller, Beck↗
DOE OSTI2023

Reinforcement Learning of Structured Stabilizing Control for Linear Systems With Unknown State Matrix

This paper delves into designing feedback control gains for a continuous-time linear quadratic regulator (LQR) problem that is constrained to certain predefined structure with unknown state matrix. We bring forth the ideas from reinforcement learning (RL) in conjunction with sufficient stability and performance guarantees in order to design these structured gains using the trajectory measurements of states and controls. Here we first formulate a model-based framework using dynamic programming (DP) to embed the structural constraint to the LQR gain computation in the continuous-time setting, and then subsequently, formulate a policy iteration RL algorithm that can alleviate the requirement of known state matrix in conjunction with maintaining the feedback gain structure. The design enables a distributed learning control design which is necessary for many large-scale cyber-physical systems. Theoretical guarantees are provided for stability and convergence of the structured reinforcement learning (SRL) algorithm. We validate our theoretical results with numerical simulations on a multi-agent networked linear time-invariant (LTI) dynamic system.

42 ENGINEERING↗
DOE OSTI2020

Scalable molecular dynamics on CPU and GPU architectures with NAMD

NAMD is a molecular dynamics program designed for high-performance simulations of very large biological objects on CPU- and GPU-based architectures. NAMD offers scalable performance on petascale parallel supercomputers consisting of hundreds of thousands of cores, as well as on inexpensive commodity clusters commonly found in academic environments. It is written in C++ and leans on Charm++ parallel objects for optimal performance on low-latency architectures. NAMD is a versatile, multipurpose code that gathers state-of-the-art algorithms to carry out simulations in apt thermodynamic ensembles, using the widely popular CHARMM, AMBER, OPLS, and GROMOS biomolecular force fields. Here, we review the main features of NAMD that allow both equilibrium and enhanced-sampling molecular dynamics simulations with numerical efficiency. We describe the underlying concepts utilized by NAMD and their implementation, most notably for handling long-range electrostatics; controlling the temperature, pressure, and pH; applying external potentials on tailored grids; leveraging massively parallel resources in multiple-copy simulations; and hybrid quantum-mechanical/molecular-mechanical descriptions. We detail the variety of options offered by NAMD for enhanced-sampling simulations aimed at determining free-energy differences of either alchemical or geometrical transformations and outline their applicability to specific problems. Last, we discuss the roadmap for the development of NAMD and our current efforts toward achieving optimal performance on GPU-based architectures, for pushing back the limitations that have prevented biologically realistic billion-atom objects to be fruitfully simulated, and for making large-scale simulations less expensive and easier to set up, run, and analyze. NAMD is distributed free of charge with its source code at www.ks.uiuc.edu.

high-performance computing↗
DOE OSTI2019

Economic Optimal Control for Minimizing Fuel Consumption of Heavy-Duty Trucks in a Highway Environment

This paper provides a comparative assessment of three economic optimal control strategies, aimed at minimizing the fuel consumption of heavy-duty trucks in a highway environment, under a representative lead vehicle model informed by traffic data. These strategies fuse a global, offline dynamic programming (DP) optimization with online model predictive control (MPC). We then show how two of the three strategies can be adapted to accommodate the presence of traffic and optimally navigate signalized intersections using infrastructure-to-vehicular (I2V) communication. The MPC optimization, which is local in nature, makes refinements to a coarsely (but globally, subject to grid resolution) optimized target velocity profile from the DP optimization. The three candidate economic MPC formulations that are evaluated include: a nonlinear time-based formulation that directly penalizes predicted fuel consumption, a nonlinear time-based formulation that penalizes braking effort as a surrogate for fuel consumption, and a linear distance-based convex formulation that maintains a tradeoff between energy expenditure and tracking of the coarsely optimized velocity profile obtained from DP. Using a medium-fidelity Simulink model, based on a Volvo truck's longitudinal and engine dynamics, we analyze the optimization's performance on four highway routes under various traffic scenarios. Results demonstrate 3.7-8.3% fuel economy improvement on highway routes without traffic and 6.5-10% on the same routes with traffic included. Furthermore, we present a detailed analysis of energy usage by "type" (aerodynamic losses, braking losses, and comparison of brake-specific fuel consumption), under each candidate control strategy.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Developing a Hybrid Electric Vehicle Eco-Cooperative Adaptive Cruise Control System at Signalized Intersections.

This study develops an eco-driving strategy for hybrid electric vehicles (HEVs) in the vicinity of signalized intersections, entitled HEV Eco-Cooperative Adaptive Cruise Control at Intersections (Eco-CACC-I). The proposed system computes real-time, energy-optimized vehicle trajectories using HEV vehicle dynamics and energy consumption models. In the proposed system, a simple HEV energy model is used to compute the instantaneous fuel consumption. This HEV energy model is selected since it is general, transferable, and can be easily used to compute instantaneous energy consumption levels for HEVs without the additional input of vehicle engine data or complicated power control strategies. In addition, a vehicle dynamics model is used to capture the relationship between speed, acceleration level, and tractive/resistance forces on vehicles. The energy-optimum problem is formulated as an optimization problem with constraints, which is solved using a moving-horizon dynamic programming approach. The proposed HEV Eco-CACC-I system was tested to evaluate its performance for various speed limits, roadway grades, and signal timings. Lastly, the proposed HEV controller was implemented in a microscopic traffic simulation software to test its network-wide performance. The test results from an arterial corridor with three signalized intersections demonstrate that the proposed system can effectively reduce stop-and-go traffic in the vicinity of signalized intersections producing savings of 7.4% in energy consumption, 5.8% in traffic delay and 23% vehicle stops, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Capacity Investment under Bayesian Information Updates at Reporting Periods: Model and Application

We consider capacity addition decisions by a new product manufacturer faced with uncertain technology alternatives. The manufacturing capacity addition and technology development occurs in parallel, with preliminary results from a technology project's success providing valuable information to the manufacturer in adding capacity. We solve a stochastic dynamic program with Bayesian updates to obtain the manufacturer's expected profit‐maximizing capacity investment decision. Our model and applications are motivated by the Critical Materials Institute (CMI) (funded by the Department of Energy), which manages research projects focused on mitigating critical material constraints, vital to renewable energy technologies such as direct‐drive wind turbines, electric vehicles, and energy‐efficient lighting. We capture three unique aspects of the problem: first, the learning from project progress depends on task‐based stochastic outcomes and a project's percent‐done. Second, the underlying technology's profitability is based on a model of competition. Third, we evaluate the impact of progress across a portfolio of projects based on a manufacturer's capacity addition. We develop a heuristic that produces results that are close to optimal and can thus be used for large problem sizes. The managerial insights from an application of our model to CMI projects include: (i) technology projects that report the percent‐done of a project earlier increase expected manufacturer profit; (ii) careful choice of “safe bets,” that is, technologies with low profitability but a high probability of success, can increase expected manufacturer profit; (iii) a portfolio of projects can increase profits significantly over separate project evaluation; and (iv) dynamic management of project resources can increase overall profit.

Vedantam, Aditya↗
DOE OSTI2022

134 billion intersecting brane models

The landscape of string vacua is very large, but generally expected to be finite in size. Enumerating the number and properties of the vacua is an important task for both the landscape and the swampland, in part to gain a deeper understanding of what is possible and “generic”. We obtain an exact counting of distinct intersecting brane vacua of type IIA string theory on the T 6 /Z 2 × Z 2 orientifold. Care is taken to only count gauge-inequivalent brane configurations. Leveraging the recursive nature by which branes may be added together one-by-one, we use dynamic programming to efficiently count the number of solutions of the tadpole, K-theory and supersymmetry consistency conditions. The distributions of 4D gauge group rank and complex structure moduli for the entire ensemble of intersecting brane vacua are presented. The methods we developed here may be useful in obtaining sharp upper and lower bounds on other corners of the landscape.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Optimal management of electric hotel loads in mild hybrid heavy duty truck

Here, the problem of engine idling for heavy-duty trucks has been under study for decades with Auxiliary Power Units (APUs) and Truck Stop Electrification (TSE) as the most compelling solutions. With the electrification of trucks approaching feasibility in terms of cost-effective technology, hybridization offers another “degree of freedom” to tackle the problem. Here, this work aims at exploiting a battery pack of a 48 V mild-hybrid heavy-duty truck to store sufficient onboard energy for powering the auxiliary loads during the hoteling. This problem is not trivial, as the battery packs typically cannot recover the entire energy required through regeneration alone; hence an optimal energy management strategy needs to be employed to charge the battery through the engine during drive operation. This strategy optimizes powertrain performances among the four modes: (i) Engine of Coasting (EOC), (ii) Regeneration by braking, (iii) Regeneration by engine, and (iv) engine idling. This paper presents the development of a Dynamic Programming (DP) framework that employs a multi-objective cost function to minimize the fuel consumption and maximize the regeneration using the above-mentioned four modes. A typical heavy-duty truck drive cycle is used to represent the drive phase, with mandatory hoteling stops as per regulations. A comprehensive powertrain model is developed using validated components’ model. The DP employs two state variables: battery State-of-Charge (SOC) and engine mode, and three control inputs: (i) the engine ON–OFF state, (ii) clutch engagement state, and (iii) power request at the Electric Machine (EM) for calculating optimal SOC trajectory. The framework also tackles rapid engine ON–OFF scenarios to avoid the challenges associated with DP and the compromises in fuel cost with those approaches. Finally, the effectiveness of the proposed framework is tested for potential fuel savings on two different battery packs by performing the full cycle simulations. The results show 6.47% of fuel consumption reduction as compared to traditional APU-based heavy-duty truck.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

PotLib 2023: New version of a potential energy surface library for chemical systems

POTLIB is a library of global and semiglobal potential energy surface subprograms. The library currently features 410 entries, including both single-state entries and multi-state entries. When one calls the routine of a single-state entry, it returns the ground-electronic-state adiabatic potential energy surface at the input geometry. In addition, some entries also return the gradient of the surface. Further, when one calls a multi-state entry, it returns a diabatic potential energy matrix (DPEM). If the entry also has the gradient of the DPEM, one can compute adiabatic surfaces, their gradients, and the nonadiabatic coupling vectors (NACs) from the DPEM and its gradient by diagonalization. Some but not all the routines conform to one of a set of standard interfaces. The goal is to facilitate chemical dynamics research by collecting and disseminating a comprehensive collection of state-of-the-art potential energy routines (developed by a wide, international group of researchers) with systematic and well-defined interfaces for use with chemical dynamics programs. Systems in the library include CHArO 2 , CHN 2 O + , CH 2 O, CH 2 O 2 , CH 3 N 2 , CH 3 O, CH 4 , CH 4 Br, CH 4 Cl, CH 4 F, CH 4 O, CH 4 OCl, CH 4 OF, CH 4 OH, CH 5 , CH$^{+}_{5}$, CH 5 N, CH 5 O 2 , CH 8 O 2 , C 2 H 2 N 2 O, C 2 H 2 O, C 2 H 4 N, C 2 H 4 O 4 , C 2 H 6 Cl, C 2 H 6 F, C 2 H 6 H, C 2 H 6 O, C 2 H 6 OH, C 2 H 7 , C 2 O 2 , C 3 H 4 O 2 , C 3 H 7 NO, C 6 H 6 O, C 6 H 6 S, C 7 H8S, HBrCl, HCl 2 , HF 2 , HI 2 , HLiF, HNaF, HO 2 , HO 3 , HOBr, HSiO, H 2 Br, H 2 ClO, H 2 F, H 2 F 2 , H 2 FO, H 2 Na, H 2 O, H 2 O 2 , H 2 OBr, H 3 , H 3 Cl, H 3 ClN, H 3 ClO, H 3 N, H 3 O, H 3 O 2 , H$^{+}_{3}$, H 3 S, H 4 ClSi, H 4 N, H 4 NO, H 4 O 2 , H 5 GeO, H 5 Si, H$^{+}_{7}$, Al m H n , Al n , Ar N O, K 2 Rb 2 , NO 2 , N 2 O, N 2 O 2 , N 3 , N 4 , O 3 , and O 4 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

A k-mer based approach for classifying viruses without taxonomy identifies viral associations in human autism and plant microbiomes

Viruses are an underrepresented taxa in the study and identification of microbiome constituents; however, they play an essential role in health, microbiome regulation, and transfer of genetic material. Only a few thousand viruses have been isolated, sequenced, and assigned a taxonomy, which limits the ability to identify and quantify viruses in the microbiome. Additionally, the vast diversity of viruses represents a challenge for classification, not only in constructing a viral taxonomy, but also in identifying similarities between a virus’ genotype and its phenotype. However, the diversity of viral sequences can be leveraged to classify their sequences in metagenomic and metatranscriptomic samples, even if they do not have a taxonomy. To identify and quantify viruses in transcriptomic and genomic samples, we developed a dynamic programming algorithm for creating a classification tree out of 715,672 metagenome viruses. To create the classification tree, we clustered proportional similarity scores generated from the k-mer profiles of each of the metagenome viruses to create a database of metagenomic viruses. The resulting Kraken2 database of the metagenomic viruses can be found here: https://www.osti.gov/biblio/1615774 and is compatible with Kraken2. We then integrated the viral classification database with databases created with genomes from NCBI for use with ParaKraken (a parallelized version of Kraken provided in Supplemental Zip 1), a metagenomic/transcriptomic classifier. To illustrate the breadth of our utility for classifying metagenome viruses, we analyzed data from a plant metagenome study identifying genotypic and compartment specific differences between two Populus genotypes in three different compartments. We also identified a significant increase in abundance of eight viral sequences in post mortem brains in a human metatranscriptome study comparing Autism Spectrum Disorder patients and controls. We also show the potential accuracy for classifying viruses by utilizing both the JGI and NCBI viral databases to identify the uniqueness of viral sequences. Finally, we validate the accuracy of viral classification with NCBI databases containing viruses with taxonomy to identify pathogenic viruses in known COVID-19 and cassava brown streak virus infection samples. Our method represents the compulsory first step in better understanding the role of viruses in the microbiome by allowing for a more complete identification of sequences without taxonomy. Better classification of viruses will improve identifying associations between viruses and their hosts as well as viruses and other microbiome members. Despite the lack of taxonomy, this database of metagenomic viruses can be used with any tool that utilizes a taxonomy, such as Kraken, for accurate classification of viruses.

59 BASIC BIOLOGICAL SCIENCES↗