Search NASA⌕ Search

SEARCH · Search NASA

Results for “Dynamic Programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Exact and Heuristic Algorithms for Runway Scheduling

This paper explores the Single Runway Scheduling (SRS) problem with arrivals, departures, and crossing aircraft on the airport surface. Constraints for wake vortex separations, departure area navigation separations and departure time window restrictions are explicitly considered. The main objective of this research is to develop exact and heuristic based algorithms that can be used in real-time decision support tools for Air Traffic Control Tower (ATCT) controllers. The paper provides a multi-objective dynamic programming (DP) based algorithm that finds the exact solution to the SRS problem, but may prove unusable for application in real-time environment due to large computation times for moderate sized problems. We next propose a second algorithm that uses heuristics to restrict the search space for the DP based algorithm. A third algorithm based on a combination of insertion and local search (ILS) heuristics is then presented. Simulation conducted for the east side of Dallas/Fort Worth International Airport allows comparison of the three proposed algorithms and indicates that the ILS algorithm performs favorably in its ability to find efficient solutions and its computation times.

safe & surface operations↗

Three-Dimensional Trajectory Design for Reducing Climate Impact of Trans-Atlantic Flights

The impact of aircraft emissions and contrails on the environment adds an additional aspect to aircraft trajectory optimization. This study developed a three-dimensional trajectory optimization algorithm for trans-Atlantic flights in cruise to generate aircraft trajectories that minimize environmental impacts due to CO2 emissions and contrails in the presence of winds. The climate-optimal trajectory is developed using dynamic programming that adjusts a wind-optimal aircraft heading while determining the optimal locations, altitudes and times for en-route step climbs. Flying wind-optimal routes minimize aircraft travel time, fuel burn and associated emissions during cruise while adjusting aircraft heading and en-route step climbs at the optimal locations and times minimize climate impact of contrails. This capability integrates an air traffic management simulation with aircraft fuel burn and emissions models, contrail formation and dispersion models, simplified climate response models, and a common climate metric. A study was conducted to evaluate the potential cost and benefits of flying climate-optimal routes in North Atlantic Airspace and their impacts to the Organized Track System design based on the trans-Atlantic air traffic during a day, July 12, 2012. Results show eastbound flights achieved a larger environmental benefit with less additional fuel burn than westbound flights that operated in strong headwinds that caused more additional fuel burn and aircraft emissions to avoid traversing contrails favorable regions.

climate impact of aviation↗

Performance Enhancement of a Computational Persistent Homology Package

In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, voids, etc., from a point cloud by finding out when these features appear and disappear in the filtration sequence. In this project, we focus on improving the performance of Eirene, a fancy computational persistent homology package. Eirene is a 5000-line opensource software implemented by using the dynamic programming language Julia. We use the Julia profiling tools to identify the performance bottlenecks and develop different methods to manage the bottlenecks, including the parallelization of some time-consuming functions on the multicore/manycore hardware. The empirical results show that the performance can be greatly improved.

Profiling↗

Automated Contingency Management for Water Recycling System

To enable effective management, planning, and operations for future missions that involve a crewed space habitat, operational support must be migrated from Earth to the habitat. Intelligent System Health Management technologies (ISHM) promise to enable the future space habitats to increase the safety and mission success while minimizing operational risks. In this paper, Water Recycling System (WRS) deployed at NASA Ames Research Center's Sustainability Base is used for verification and validation of the proposed solution. Our work includes the development of the WRS simulation model based on its dynamic physical characteristics and the design of Automatic Contingency Management (ACM) framework that integrates fault diagnosis and optimization. In WRS modeling, a nominal model with fault injectors is developed. Fault detection and isolation techniques are then developed for isolating causes and identifying the severity of the faults. Dynamic Programming (DP) based fault mitigation strategies are designed to accommodate the faults in the system. A series of simulations are presented with different fault modes and the results indicate that the proposed ACM system can alleviate the fault in the WRS optimally regarding energy consumption and effects of the fault.

Systems Health Management↗

Reliability Characterization of TaOx-Based Commercial ReRAM in Combination with Radiation

We present reliability data combined with total dose gamma radiation for one of the first commercially available resistive memory devices. These Tantalum Oxide (TaOX)-based resistive memory chips demonstrate operation in dynamic program and erase testing up to ~130 Krad(Si) of 60Co gamma dose. In static and unbiased conditions, the stored data in the memory cells were able to withstand up to 50Mrad(Si) of exposure. The access circuitry, though, seemed less robust to gamma radiation and was able to operate only up to a total dose of 3Mrad(Si). Post exposure reliability as indicated by endurance, cycling error rate, and data retention tests showed no detectable impact from the combination with prior gamma irradiation. Overall, the total dose radiation tolerance of the commercial TaOx-based resistive memory chip appears to be higher than flash memory chips and in agreement with prior tests conducted with single cell resistive memories.

total ionizing dose↗

Tuning the Performance of a Computational Persistent Homology Package

In recent years, persistent homology has become an attractive method for data analysis. It captures topological features, such as connected components, holes, and voids from point cloud data and summarizes the way in which these features appear and disappear in a filtration sequence. In this project, we focus on improving the performanceof Eirene, a computational package for persistent homology. Eirene is a 5000-line open-source software library implemented in the dynamic programming language Julia. We use the Julia profiling tools to identify performance bottlenecks and develop novel methods to manage them, including the parallelization of some time-consuming functions on multicore/manycore hardware. Empirical results show that performance can be greatly improved.

Persistent Homology↗

The NANOGrav 12.5 Year Data Set: Monitoring Interstellar Scattering Delays

We extract interstellar scintillation parameters for pulsars observed by the NANOGrav radio pulsar timing program. Dynamic spectra for the observing epochs of each pulsar were used to obtain estimates of scintillation timescales, scintillation bandwidths, and the corresponding scattering delays using a stretching algorithm to account for frequency-dependent scaling. We were able to measure scintillation bandwidths for 28 pulsars at1500 MHz and 15 pulsars at 820 MHz. We examine scaling behavior for 17 pulsars and find power-law indices ranging from−0.7 to−3.6, though these may be biased shallow due to insufficient frequency resolution at lower frequencies. We were also able to measure scintillation timescales for six pulsars at 1500 MHz and seven pulsars at820 MHz. There is fair agreement between our scattering delay measurements and electron-density model predictions for most pulsars. We derive interstellar scattering-based transverse velocities assuming isotropic scattering and a scattering screen halfway between the pulsar and Earth. We also estimate the location of the scattering screens assuming proper motion and interstellar scattering-derived transverse velocities are equal. We find no correlations between variations in scattering delay and either variations in dispersion measure or flux density. For most pulsars for which scattering delays are measurable, we find that time-of-arrival uncertainties for a given epoch are larger than our scattering delay measurements, indicating that variable scattering delays are currently subdominant in our overall noise budget but are important for achieving precisions of tens of nanoseconds or less.

Jacob E Turner↗

Stochastic Guidance of Buoyancy Controlled Vehicles under Ice Shelves using Ocean Currents

We propose a novel technique for guidance ofbuoyancy-controlled vehicles in uncertain under-ice ocean flows.In-situ melt rate measurements collected at the grounding zoneof Antarctic ice shelves, where the ice shelf meets the underlyingbedrock, are essential to constrain models of future sea levelrise. Buoyancy-controlled vehicles, which control their verticalposition in the water column but have no means of horizontalpropulsion, offer an affordable and reliable platform for suchin-situ data collection. However, reaching the grounding zonerequires vehicles to traverse tens of kilometers under the iceshelf, with approximate position knowledge and no meansof communication, in highly variable and uncertain oceancurrents. To address this challenge, we propose a partiallyobservable MDP approach that exploits model-based knowledgeof the under-ice currents and, critically, of their uncertainty,to synthesize effective guidance policies. The approach usesapproximate dynamic programming to model uncertainty inthe currents, and QMDP to address localization uncertainty.Numerical experiments show that the policy can deliver upto 88.8% of underwater vehicles to the grounding zone – a33% improvement compared to state-of-the-art guidance techniques, and a 262% improvement over uncontrolled drifters.Collectively, these results show that model-based under-iceguidance is a highly promising technique for exploration ofunder-ice cavities, and has the potential to enable cost-effectiveand scalable access to these challenging and rarely observed environments.

Clark, Evan B.↗

Hybrid data-driven and model-informed online tool wear detection in milling machines

Precision machining tool wear is responsible for low product throughput and quality. Monitoring the tool wear online is vital to prevent degradation in machining quality. However, direct real-time tool wear measurement is not practical. This paper presents residual-based anomaly detection models, combining a hybrid model comprised of a physics-based model and a data-driven model (a decision tree or a neural network) to predict signals of interest (e.g., power or forces) under nominal conditions, followed by Page’s cumulative sum test for detecting tool wear on-line using the computer numerical control machine measurements. The most informative features are ranked using dynamic programming and its approximation variants from real-time measurements and machine settings, such as the width of cut, depth of cut, feed rate and spindle speed, that serve as inputs to the predictive models. The baseline nominal model is incrementally updated with experimental data via a gradient boosted adaptation model to generate the residuals that account for discrepancies between the actual machine data under normal conditions and the baseline nominal model predictions. The hybrid model is validated against 20 Mazak milling machine experimental tests and one Haas run-to-failure experiment. The proposed anomaly detector is applied to synthetic data from simulations of the physics-based model at different operating conditions, measurement noise levels, and tool wear levels, and the methods were able to achieve an overall 92% accuracy in data with 1% noise. The anomaly detection methods based on hybrid model reduced the false alarms of either the data-driven or physical-based models alone, and are found to be capable of good online detection of tool wear.

Online anomaly detection↗

Fused Global-Local Economic Model Predictive Control for Real-Time Eco-Optimal Control of a Heavy Duty Truck

This paper introduces a fused global-local economic model predictive control (MPC) with varying time steps for maximizing the fuel economy of a heavy-duty truck, where global MPC is performed over a long horizon using cloud-based dynamic programming (DP), and local MPC is performed on-board the vehicle using sequential quadratic programming (SQP). Because of the computational complexity of DP, an in-depth analysis of how the discretization levels, time constant, and horizon length influence the energy savings and computational complexity of online DP has been performed. The fused optimization technique has been evaluated over different route profiles, accounting for traffic, using a medium-fidelity proprietary Volvo model. Results show 4-7% fuel savings, as compared to a baseline model.

33 ADVANCED PROPULSION SYSTEMS↗

Building Battery Energy Storage System Performance Data into an Economic Assessment

Economic assessments of battery energy storage systems (BESSs) rely on optimal dispatch methods to capture temporal interdependency of BESS operations and coupling among different grid applications. Many existing BESS economic assessment studies are based on a simplified first-order scalar model using BESS nameplate numbers. Such a method cannot accurately capture varying capabilities and nonlinear dynamics of a BESS, leading to inaccurate assessment results. This paper presents a practical implementation of performance data into the economic assessment of the BESSs recently developed within the Snohomish Public Utility District system in Washington State. Extensive testing conducted over multiple seasons is used to assess the technical performance and develop high-fidelity models of the BESSs. A dynamic programming algorithm is proposed to optimally dispatch the BESSs and assess the potential benefits from stacked value streams. The proposed method can be adapted for the economic assessment of other BESSs with different applications.

Wu, Di↗

Model Predictive Control for a Grid-interactive Efficient Thermal Storage-integrated Heat Pump System

Building heating and cooling systems can be used to overcome the mismatch between the intermittent supply of renewable power and the fluctuating demand for electricity. A novel underground thermal energy storage integrated with a dual-source heat pump has been proposed to mitigate the mismatch while meeting the thermal demand of buildings efficiently. Conventional thermostat control with heuristic rules cannot provide intelligent decisions to maximize the thermal efficiency and flexibility of the proposed system. Advanced control strategies like model predictive control (MPC) have provided a new paradigm for grid-interactive efficient building operation with the advancement of computation and sensing. This study developed an MPC for the proposed system to provide grid service for Demand Side Management and minimize the operating cost of building owners. A control-oriented dynamic model of the proposed system has been developed. Given an objective function and proper constraints, an optimization problem is formulated to determine the optimal control strategy of the system. Dynamic Programming is adopted to solve the optimization problem. A rule-based control (RBC) is also developed to achieve similar goals. Short-term simulations are conducted to compare the system performance resulting from the two controls. The simulation results indicate that the MPC performs more intelligently than the RBC in charging thermal energy storage and selecting heat pump sources by taking advantage of the predicted cooling demands of the building and the performance of the integrated system. As a result, the MPC could save energy and reduce operating costs compared with the RBC. A case study shows that, for a 3-day operation, the MPC saves 36.9% energy and reduces 38.5% operating cost compared with the RBC.

Shi, Liang↗

Data-driven cyber attack detection and mitigation for decentralized wide-area protection and control in smart grids

Modern power systems have already evolved into complicated cyber physical systems (CPS), often referred to as smart grids, due to the continuous expansion of the electrical infrastructure, the augmentation of the number of heterogeneous system components and players, and the consequential application of a diversity of information and telecommunication technologies to facilitate the Wide Area Monitoring, Protection and Control (WAMPAC) of the day-to-day power system operation. Because of the reliance on cyber technologies, WAMPAC, among other critical functions, is prone to various malicious cyber attacks. Successful cyber attacks, especially those sabotage the operation of Bulk Electric System (BES), can cause great financial losses and social panics. Application of conventional IT security solutions is indispensable, but it often turns out to be insufficient to mitigate sophisticated attacks that deploy zero-day vulnerabilities or social engineering tactics. To further improve the resilience of the operation of smart grids when facing cyber attacks, it is desirable to make the WAMPAC functions per se capable of detecting various anomalies automatically, carrying out adaptive activity adjustments in time and thus staying unimpaired even under attack. Most of the existing research efforts attempt to achieve this by adding novel functional modules, such as model-based anomaly detectors, to the legacy centralized WAMPAC functions. In contrast, this dissertation investigates the application of data-driven algorithms in cyber attack detection and mitigation within a decentralized architecture aiming at improving the situational awareness and self-adaptiveness of WAMPAC. First part of the research focuses on the decentralization of System Integrity Protection Scheme (SIPS) with Multi-Agent System (MAS), within which the data-driven anomaly detection and optimal adaptive load shedding are further explored. An algorithm named as Support Vector Machine embedded Layered Decision Tree (SVMLDT) is proposed for the anomaly detection, which provides satisfactory detection accuracy as well as decision-making interpretability. The adaptive load shedding is carried out by every agent individually with dynamic programming. The load shedding relies on the load profile propagation among peer agents and the attack adaptiveness is accomplished by maintaining the historical mean of load shedding proportion. Load shedding only takes place after the consensus pertaining to the anomaly detection is achieved among all interconnected agents and it serves the purpose of mitigating certain cyber attacks. The attack resilience of the decentralized SIPS is evaluated using IEEE 39 bus model. It is shown that, unlike the traditional centralized SIPS, the proposed solution is able to carry out the remedial actions under most Denial of Service (DoS) attacks. The second part investigates the clustering based anomalous behavior detection and peer-assisted mitigation for power system generation control. To reduce the dimensionality of the data, three metrics are designed to interpret the behavior conformity of generator within the same balancing area. Semi-supervised K-means clustering and a density sensitive clustering algorithm based on Hierarchical DBSCAN (HDBSCAN) are both applied in clustering in the 3D feature space. Aiming to mitigate the cyber attacks targeting the generation control commands, a peer-assisted strategy is proposed. When the control commands from control center is detected as anomalous, i.e. either missing or the payload of which have been manipulated, the generating unit utilizes the peer data to infer and estimate a new generation adjustment value as replacement. Linear regression is utilized to obtain the relation of control values received by different generating units, Moving Target Defense (MTD) is adopted during the peer selection and 1-dimensional clustering is performed with the inferred control values, which are followed by the final control value estimation. The mitigation strategy proposed requires that generating units can communicate with each other in a peer-to-peer manner. Evaluation results suggest the efficacy of the proposed solution in counteracting data availability and data integrity attacks targeting the generation controls. However, the strategy stays effective only if less than half of the generating units are compromised and it is not able to mitigate cyber attacks targeting the measurements involved in the generation control.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Machine Learning for Well Log Analysis in Uranium Mining

This project explores the use of Artificial Intelligence (AI) and Machine Learning (ML) techniques to automate well log analysis for uranium mining. Geophysical log data—spontaneous potential, resistivity, and gamma ray—were used to classify lithology, correlate well logs and identify roll front zonation patterns, which are critical for locating uranium ore bodies. Supervised ML algorithms such as eXtreme Gradient Boosting (XGBoost), Categorical Boosting (CatBoost), and Random Forest were trained to classify lithology with high accuracy. Gradient Boosting Machines (GBM), XGBoost, Random Forest, and Neural Networks were also used for role front zone identification. Moreover, a Fast Dynamic Time Warping (FastDTW) algorithm was employed for well log correlation. Additionally, sample lag was addressed using dynamic programming. Results demonstrate the potential of AI and ML to streamline well log analysis and enhance uranium exploration workflows.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Capabilities and applications of a computer program system for dynamic loads analyses of flexible airplanes with active controls /DYLOFLEX/

This paper describes and illustrates the capabilities of the DYLOFLEX Computer Program System. DYLOFLEX is an integrated system of computer programs for calculating dynamic loads of flexible airplanes with active control systems. A brief discussion of the engineering formulation for each of the nine DYLOFLEX programs is described. The capabilities of the system are illustrated by the analyses of two example configurations.

Perry, B., III↗

Computer program system for dynamic simulation and stability analysis of passive and actively controlled spacecraft. Volume 1. Theory

A theoretical development and associated digital computer program system is presented. The dynamic system (spacecraft) is modeled as an assembly of rigid and/or flexible bodies not necessarily in a topological tree configuration. The computer program system may be used to investigate total system dynamic characteristics including interaction effects between rigid and/or flexible bodies, control systems, and a wide range of environmental loadings. Additionally, the program system may be used for design of attitude control systems and for evaluation of total dynamic system performance including time domain response and frequency domain stability analyses. Volume 1 presents the theoretical developments including a description of the physical system, the equations of dynamic equilibrium, discussion of kinematics and system topology, a complete treatment of momentum wheel coupling, and a discussion of gravity gradient and environmental effects. Volume 2, is a program users' guide and includes a description of the overall digital program code, individual subroutines and a description of required program input and generated program output. Volume 3 presents the results of selected demonstration problems that illustrate all program system capabilities.

Bodley, C. S.↗

A systems plan for an earth and ocean dynamics satellite applications program

A system for investigating phenomena associated with the earth's dynamical and crustal motions, and the sea surface is described. The proposed observing systems include the following facilities: (1) A network of fundamental stations, whose locations and motions, including polar, variations in the earth's rotational rate, and crustal motions, are determined by very long baseline interferometry, relative to the basic reference system of radio stars. The sites are all NASA Goddard stations with the exception of Kashima, Japan, a facility which has participated extensively in the ATS program. (2) A system of Geopause spacecraft in nearly circular polar orbits, normal to the ecliptic at a distance of about five earth radii with a period on the order of two thirds of a day.

Siry, J. W.↗