Search NASA⌕ Search

SEARCH · Search NASA

Results for “adaptive dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Developing a Hybrid Electric Vehicle Eco-Cooperative Adaptive Cruise Control System at Signalized Intersections.

This study develops an eco-driving strategy for hybrid electric vehicles (HEVs) in the vicinity of signalized intersections, entitled HEV Eco-Cooperative Adaptive Cruise Control at Intersections (Eco-CACC-I). The proposed system computes real-time, energy-optimized vehicle trajectories using HEV vehicle dynamics and energy consumption models. In the proposed system, a simple HEV energy model is used to compute the instantaneous fuel consumption. This HEV energy model is selected since it is general, transferable, and can be easily used to compute instantaneous energy consumption levels for HEVs without the additional input of vehicle engine data or complicated power control strategies. In addition, a vehicle dynamics model is used to capture the relationship between speed, acceleration level, and tractive/resistance forces on vehicles. The energy-optimum problem is formulated as an optimization problem with constraints, which is solved using a moving-horizon dynamic programming approach. The proposed HEV Eco-CACC-I system was tested to evaluate its performance for various speed limits, roadway grades, and signal timings. Lastly, the proposed HEV controller was implemented in a microscopic traffic simulation software to test its network-wide performance. The test results from an arterial corridor with three signalized intersections demonstrate that the proposed system can effectively reduce stop-and-go traffic in the vicinity of signalized intersections producing savings of 7.4% in energy consumption, 5.8% in traffic delay and 23% vehicle stops, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1972

Nonlinear and Digital Man-machine Control Systems Modeling

An adaptive modeling technique is examined by which controllers can be synthesized to provide corrective dynamics to a human operator's mathematical model in closed loop control systems. The technique utilizes a class of Liapunov functions formulated for this purpose, Liapunov's stability criterion and a model-reference system configuration. The Liapunov function is formulated to posses variable characteristics to take into consideration the identification dynamics. The time derivative of the Liapunov function generate the identification and control laws for the mathematical model system. These laws permit the realization of a controller which updates the human operator's mathematical model parameters so that model and human operator produce the same response when subjected to the same stimulus. A very useful feature is the development of a digital computer program which is easily implemented and modified concurrent with experimentation. The program permits the modeling process to interact with the experimentation process in a mutually beneficial way.

Mekel, R.↗
NASA NTRS1991

The AI Bus architecture for distributed knowledge-based systems

The AI Bus architecture is layered, distributed object oriented framework developed to support the requirements of advanced technology programs for an order of magnitude improvement in software costs. The consequent need for highly autonomous computer systems, adaptable to new technology advances over a long lifespan, led to the design of an open architecture and toolbox for building large scale, robust, production quality systems. The AI Bus accommodates a mix of knowledge based and conventional components, running on heterogeneous, distributed real world and testbed environment. The concepts and design is described of the AI Bus architecture and its current implementation status as a Unix C++ library or reusable objects. Each high level semiautonomous agent process consists of a number of knowledge sources together with interagent communication mechanisms based on shared blackboards and message passing acquaintances. Standard interfaces and protocols are followed for combining and validating subsystems. Dynamic probes or demons provide an event driven means for providing active objects with shared access to resources, and each other, while not violating their security.

Schultz, Roger D.↗
DOE OSTI2022

Reconfigurable perovskite nickelate electronics for artificial intelligence

Reconfigurable devices offer the ability to program electronic circuits on demand. Here, in this work, we demonstrated on-demand creation of artificial neurons, synapses, and memory capacitors in post-fabricated perovskite NdNiO 3 devices that can be simply reconfigured for a specific purpose by single-shot electric pulses. The sensitivity of electronic properties of perovskite nickelates to the local distribution of hydrogen ions enabled these results. With experimental data from our memory capacitors, simulation results of a reservoir computing framework showed excellent performance for tasks such as digit recognition and classification of electrocardiogram heartbeat activity. Using our reconfigurable artificial neurons and synapses, simulated dynamic networks outperformed static networks for incremental learning scenarios. The ability to fashion the building blocks of brain-inspired computers on demand opens up new directions in adaptive networks.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS2004

A 2-to-48-MHz Phase-Locked Loop

A 2-to-48-MHz phase-locked loop (PLL), developed for the U.S. space program, meets or exceeds all space shuttle clock electrical interface requirements by taking as its reference a 2-to-48-MHz clock signal and outputting a phaselocked clock signal set at the same frequency as the reference clock with transistor- transistor logic (TTL) voltage levels. Because it is more adaptable than other PLLs, the new PLL can be used in industries that employ signaling devices and as a tool in future space missions. A conventional PLL consists of a phase/frequency detector, loop filter, and voltage-controlled oscillator in which each component exists individually and is integrated into a single device. PLL components phase-lock to a single frequency or to a narrow bandwidth of frequencies. It is this design, however, that prohibits them from maintaining phase lock to a dynamically changing reference clock when a large bandwidth is required a deficiency the new PLL overcomes. Since most PLL components require their voltage-controlled oscillators to operate at greater than 2-MHz frequencies, conventional PLLs often cannot achieve the low-frequency phase lock allowed by the new PLL. The 2-to-48-MHz PLL is built on a wire-wrap board with pins wired to three position jumpers; this makes changing configurations easy. It responds to variations in voltage-controlled oscillator (VCO) ranges, duty cycle, signal-to-noise ratio (SNR), amplitude, and jitter, exceeding design specifications. A consensus state machine, implemented in a VCO range detector which assures the PLL continues to operate in the correct range, is the primary control state machine for the 2-to-48-MHz PLL circuit. By using seven overlapping frequency ranges with hysteresis, the PLL output sets the resulting phase-locked clock signal at a frequency that agrees with the reference clock with TTL voltage levels. As a space-shuttle tool, the new PLL circuit takes the noisy, degraded reference clock signals as input and outputs phase-locked clock signals of the same frequency but with a corrected wave shape. Since its configuration circuit can be easily changed, the new PLL can do the following: readily respond to variations in VCO ranges, duty cycle, SNR, amplitude, and jitter; continuously operate in the correct VCO range because of its consensus state machine; and use its range detector implements to overlap seven frequency ranges with hysteresis, thus giving the current design a flexibility that exceeds anything available at the time of this development. These features will benefit any industry in which safe and timely clock signals are vital to operation.

Koudelka, Robert D.↗
DOE OSTI2025

A Synoptic System for Capturing Ecosystem Control Points Across Terrestrial‐Aquatic Interfaces

Interconnected landscape features such as terrestrial‐aquatic interfaces play an outsized role in biogeochemical cycles as ecosystem control points, but it is notoriously challenging to characterize these. Here, we document a synoptic sensor network design that is (a) flexible to accommodate diverse ecosystem interfaces and gradients, (b) adaptable to monitoring and modeling needs of small and large projects alike, (c) standardized for intercomparability across sites and field experiments, and (d) adequately replicated to capture heterogeneity of each parameter monitored. This real‐time monitoring of surface water, groundwater, soil, and vegetation supports configuration and evaluation of models that span upland, wetland, open water strata, and transitions between them. We established the network at seven sites along the Chesapeake Bay and Lake Erie coastlines, including large‐scale flood manipulation experiments in both regions. A central design element is “one data logger program to rule them all”—a collection of sensor‐specific modules deployed on 40 loggers controlling ∼2,000 sensors, with the goal of streamlining maintenance, debugging, and reproducible data processing. The network generates ∼6 M observations per month, capturing system dynamics at the broad spatial and fine temporal scales needed to initialize and benchmark models; measurement frequency can be modified remotely to capture events. This network design has also revealed behaviors not represented in Earth system models, such as transient groundwater oxygen pulses. Completely documented and open source, this standardized, flexible, and efficient sensor network design can reduce barriers to understanding environmental changes and ecosystem responses across systems and scales.

Ward, Nicholas D. [Pacific Northwest National Labo↗
NASA NTRS1988

A parallel row-based algorithm with error control for standard-cell replacement on a hypercube multiprocessor

A new row-based parallel algorithm for standard-cell placement targeted for execution on a hypercube multiprocessor is presented. Key features of this implementation include a dynamic simulated-annealing schedule, row-partitioning of the VLSI chip image, and two novel new approaches to controlling error in parallel cell-placement algorithms; Heuristic Cell-Coloring and Adaptive (Parallel Move) Sequence Control. Heuristic Cell-Coloring identifies sets of noninteracting cells that can be moved repeatedly, and in parallel, with no buildup of error in the placement cost. Adaptive Sequence Control allows multiple parallel cell moves to take place between global cell-position updates. This feedback mechanism is based on an error bound derived analytically from the traditional annealing move-acceptance profile. Placement results are presented for real industry circuits and the performance is summarized of an implementation on the Intel iPSC/2 Hypercube. The runtime of this algorithm is 5 to 16 times faster than a previous program developed for the Hypercube, while producing equivalent quality placement. An integrated place and route program for the Intel iPSC/2 Hypercube is currently being developed.

Sargent, Jeff Scott↗
NASA NTRS1988

Software engineering and Ada (Trademark) training: An implementation model for NASA

The choice of Ada for software engineering for projects such as the Space Station has resulted in government and industrial groups considering training programs that help workers become familiar with both a software culture and the intricacies of a new computer language. The questions of how much time it takes to learn software engineering with Ada, how much an organization should invest in such training, and how the training should be structured are considered. Software engineering is an emerging, dynamic discipline. It is defined by the author as the establishment and application of sound engineering environments, tools, methods, models, principles, and concepts combined with appropriate standards, guidelines, and practices to support computing which is correct, modifiable, reliable and safe, efficient, and understandable throughout the life cycle of the application. Neither the training programs needed, nor the content of such programs, have been well established. This study addresses the requirements for training for NASA personnel and recommends an implementation plan. A curriculum and a means of delivery are recommended. It is further suggested that a knowledgeable programmer may be able to learn Ada in 5 days, but that it takes 6 to 9 months to evolve into a software engineer who uses the language correctly and effectively. The curriculum and implementation plan can be adapted for each NASA Center according to the needs dictated by each project.

Legrand, Sue↗
NASA NTRS2002

Analysis and Design of Crew Sleep Station for ISS

This paper details the analysis and design of the Temporary Sleep Station (TeSS) environmental control system for International Space Station (ISS). The TeSS will provide crewmembers with a private and personal space, to accommodate sleeping, donning and doffing of clothing, personal communication and performance of recreational activities. The need for privacy to accommodate these activities requires adequate ventilation inside the TeSS. This study considers whether temperature, carbon dioxide, and humidity within the TeSS remain within crew comfort and safety levels for various expected operating scenarios. Evaluation of these scenarios required the use and integration of various simulation codes. An approach was adapted for this study, whereby results from a particular code were integrated with other codes when necessary. Computational Fluid Dynamics (CFD) methods were used to evaluate the flow field inside the TeSS, from which local gradients for temperature, velocity, and species concentration such as CO (sub 2) could be determined. A model of the TeSS, containing a human, as well as equipment such as a laptop computer, was developed in FLUENT, a finite-volume code. Other factors, such as detailed analysis of the heat transfer through the structure, radiation, and air circulation from the TeSS to the US Laboratory Aisle, where the TeSS is housed, were considered in the model. A complementary model was developed in G189A, a code which has been used by NASA/JSC for environmental control systems analyses since the Apollo program. Boundary conditions were exchanged between the FLUENT and G189A TeSS models. G189A provides human respiration rates to the FLUENT model, while the FLUENT model provides local convective heat transfer coefficients to G189A model. An additional benefit from using an approach with both a systems simulation and CFD model, is the capability to verify the results of each model by comparison to the results of the other model. The G189A and FLUENT models were used to evaluate various ventilation designs for the TeSS over a range of operating conditions with varying crew metabolic load, equipment operating modes, ventilation flow rates, and with the TeSS doors open and closed. Results from the study were instrumental in the optimization of a design for the TeSS ventilation hardware. A special case was considered where failure of the TeSS ventilation system occurred. In this case, a study was conducted in order to determine the time required for the CO (sub 2) concentration inside the TeSS to increase to ISS limit values under transient conditions. A lumped-capacitance code, SINDA-FLUINT was used in this case to provide accurate predictions of the human reaction to the TeSS cabin conditions including core and skin temperatures and body heat storage. A simple two-dimensional CFD model of a crewmember inside the TeSS was developed in FLUENT in order to determine the volume envelope of the respired air from the human, which maintained a minimum velocity profile. This volume was then used in the SINDA-FLUINT model to facilitate the calculations of CO (sub 2) concentrations, dry bulb temperatures and humidity levels inside the TeSS.

Keener, John F.↗
NASA NTRS1973

A New GaAs Laser Radar for Atmospheric Measurements

A special GaAs lidar using fiber coupled diode lasers was constructed for the purpose of measuring the extinction coefficient distribution within a large atmospheric volume at a rate compatible with atmospheric kinematics. The technique is based on taking backscatter signature ratios over spatial increments after the returns are normalized by pulse integration. Essential aspects of the lidar design are beam pulse power, repetition rate, detection system dynamic range and decay linearity. It was necessary to preclude the possibility of eye hazard under any operating conditions, including directly viewing the emitting aperture at close distance with a night-adapted eye. The electronic signal processing and control circuits were built to allow versatile operations. Extinction coefficient measurements were made in fog and clouds using a low-power laboratory version of the lidar, demonstrating feasibility. Data are presented showing range squared corrected backscatter profiles converted to extinction coefficient profiles, temporal signal fluctuations, and solar induced background noise. These results aided in the design of the lidar which is described. Functional tests of this lidar and the implications relevant to the design of a prototype model are discussed. This work was jointly sponsored by Sperry Rand Corporation under its Independent Research and Development program; the Air Force Avionics Laboratory, Wright Field, Dayton, Ohio; and the Naval Ammunition Depot, Crane, Indiana.

Brown, R. T.↗
NASA NTRS2020

Squash-Box Feasibility Driven Differential Dynamic Programming

Recently, Differential Dynamic Programming (DDP) and other similar algorithms have become the solvers of choice when performing non-linear Model Predictive Control (nMPC) with modern robotic devices. The reason is that they have a lower computational cost per iteration when compared with off-the-shelf Non-Linear Programming (NLP) solvers, which enables its online operation. However, they cannot handle constraints, and are known to have poor convergence capabilities. In this paper, we propose a method to solve the optimal control problem with control bounds through a squashing function (i.e., a sigmoid, which is bounded by construction). It has been shown that a naive use of squashing functions damage the convergence rate. To tackle this, we first propose to add a quadratic barrier that avoids the difficulty of the plateau produced by the sigmoid. Second, we add an outer loop that adapts both the sigmoid and the barrier; it makes the optimal control problem with the squashing function converge to the original control-bounded problem. To validate our method, we present simulation results for different types of platforms including a multi-rotor, a biped, a quadruped and a humanoid robot.

Navarro, Angel Santamaria↗
NASA NTRS2001

ICEG2D (v2.0) - An Integrated Software Package for Automated Prediction of Flow Fields for Single-Element Airfoils With Ice Accretion

An integrated geometry/grid/simulation software package, ICEG2D, is being developed to automate computational fluid dynamics (CFD) simulations for single- and multi-element airfoils with ice accretions. The current version, ICEG213 (v2.0), was designed to automatically perform four primary functions: (1) generate a grid-ready surface definition based on the geometrical characteristics of the iced airfoil surface, (2) generate high-quality structured and generalized grids starting from a defined surface definition, (3) generate the input and restart files needed to run the structured grid CFD solver NPARC or the generalized grid CFD solver HYBFL2D, and (4) using the flow solutions, generate solution-adaptive grids. ICEG2D (v2.0) can be operated in either a batch mode using a script file or in an interactive mode by entering directives from a command line within a Unix shell. This report summarizes activities completed in the first two years of a three-year research and development program to address automation issues related to CFD simulations for airfoils with ice accretions. As well as describing the technology employed in the software, this document serves as a users manual providing installation and operating instructions. An evaluation of the software is also presented.

Thompson David S.↗
NASA NTRS2007

NASA Glenn Research in Controls and Diagnostics for Intelligent Aerospace Propulsion Systems

With the increased emphasis on aircraft safety, enhanced performance and affordability, and the need to reduce the environmental impact of aircraft, there are many new challenges being faced by the designers of aircraft propulsion systems. The Controls and Dynamics Branch (CDB) at NASA (National Aeronautics and Space Administration) Glenn Research Center (GRC) in Cleveland, Ohio, is leading and participating in various projects in partnership with other organizations within GRC and across NASA, the U.S. aerospace industry, and academia to develop advanced controls and health management technologies that will help meet these challenges through the concept of Intelligent Propulsion Systems. This presentation describes the current CDB activities in support of the NASA Aeronautics Research Mission, with an emphasis on activities under the Integrated Vehicle Health Management (IVHM) and Integrated Resilient Aircraft Control (IRAC) projects of the Aviation Safety Program. Under IVHM, CDB focus is on developing advanced techniques for monitoring the health of the aircraft engine gas path with a focus on reliable and early detection of sensor, actuator and engine component faults. Under IRAC, CDB focus is on developing adaptive engine control technologies which will increase the probability of survival of aircraft in the presence of damage to flight control surfaces or to one or more engines. The technology development plans are described as well as results from recent research accomplishments.

Garg, Sanjay↗
DOE OSTI2020

Electrothermal Micromirror Adaptive Illumination

As part of the Cyclotron Road program, Helux Lighting aimed to develop a highly adaptive illumination source based on microelectromechanical system (MEMS) technology and next-generation solid state lighting. Solid state lighting has caused a paradigm shift in the industry. Developing systems that put light only where it is needed can reduce energy consumption and have an impact on the well-being of the population by eliminating glare and wasted light. Full control could also reduce the disruption of sensitive ecosystems caused by light pollution. The most advanced fixtures available today are based on mechanical components that are bulky and expensive. The track light is the only inexpensive lighting system that permits redirection and, in some cases, spot size by motorized optical components. The most advanced light fixtures today are composed of a strategically arranged array of LEDs. More recent developments in the research community include dynamic liquid crystal lenses but fail to realize simultaneous dynamic steering and spot size. In this project, Helux worked on the capability development of their controllable micromirror combined with state-of-the-art solid state lighting to electronically adjusting light position, brightness, and illumination area.

42 ENGINEERING↗
DOE OSTI2024

Optical Control of Adaptive Nanoscale Domain Networks

Adaptive networks can sense and adjust to dynamic environments to optimize their performance. Understanding their nanoscale responses to external stimuli is essential for applications in nanodevices and neuromorphic computing. However, it is challenging to image such responses on the nanoscale with crystallographic sensitivity. Here, the evolution of nanodomain networks in (PbTiO 3 ) n /(SrTiO 3 ) n superlattices (SLs) is directly visualized in real space as the system adapts to ultrafast repetitive optical excitations that emulate controlled neural inputs. The adaptive response allows the system to explore a wealth of metastable states that are previously inaccessible. Their reconfiguration and competition are quantitatively measured by scanning x-ray nanodiffraction as a function of the number of applied pulses, in which crystallographic characteristics are quantitatively assessed by assorted diffraction patterns using unsupervised machine-learning methods. The corresponding domain boundaries and their connectivity are drastically altered by light, holding promise for light-programable nanocircuits in analogy to neuroplasticity. Phase-field simulations elucidate that the reconfiguration of the domain networks is a result of the interplay between photocarriers and transient lattice temperature. The demonstrated optical control scheme and the uncovered nanoscopic insights open opportunities for the remote control of adaptive nanoscale domain networks.

36 MATERIALS SCIENCE↗
NASA NTRS1990

An ICAI architecture for troubleshooting in complex, dynamic systems

Ahab, an intelligent computer-aided instruction (ICAI) program, illustrates an architecture for simulator-based ICAI programs to teach troubleshooting in complex, dynamic environments. The architecture posits three elements of a computerized instructor: the task model, the student model, and the instructional module. The task model is a prescriptive model of expert performance that uses symptomatic and topographic search strategies to provide students with directed problem-solving aids. The student model is a descriptive model of student performance in the context of the task model. This student model compares the student and task models, critiques student performance, and provides interactive performance feedback. The instructional module coordinates information presented by the instructional media, the task model, and the student model so that each student receives individualized instruction. Concept and metaconcept knowledge that supports these elements is contained in frames and production rules, respectively. The results of an experimental evaluation are discussed. They support the hypothesis that training with an adaptive online system built using the Ahab architecture produces better performance than training using simulator practice alone, at least with unfamiliar problems. It is not sufficient to develop an expert strategy and present it to students using offline materials. The training is most effective if it adapts to individual student needs.

Fath, Janet L.↗
NASA NTRS1986

Dynamic posture analysis of Spacelab-1 crew members

Dynamic posture testing was conducted on the science crew of the Spacelab-1 mission on a single axis linear motion platform. Tests took place in pre- and post-flight sessions lasting approximately 20 min each. The pre-flight tests were widely spaced over the several months prior to the mission while the post-flight tests were conducted over the first, second, fourth, and sixth days after landing. Two of the crew members were also tested on the day of landing. Consistent with previous postural testing conducted on flight crews, these crew members were able to complete simple postural tasks to an acceptable level even in the first few hours after landing. Our tests were designed to induce dynamic postural responses using a variety of stimuli and from these responses, evaluate subtle changes in the postural control system which had occurred over the duration of the flight. Periodic sampling post-flight allowed us to observe the time course of readaptation to terrestrial life. Our observations of hip and shoulder position, when subjected to careful analysis, indicated modification of the postural response from pre- to post-flight and that demonstrable adjustments in the dynamic control of their postural systems were taking place in the first few days after flight. For transient stimuli where the platform on which they were asked to stand quickly moved a few centimeters fore or aft then stopped, ballistic or open loop 'programs' would closely characterize the response. During these responses the desired target position was not always achieved and of equal importance not always properly corrected some 15 seconds after the platform ceased to move. The persistent observation was that the subjects had a much stronger dependence on visual stabilization post-flight than pre-flight. This was best illustrated by a slow or only partial recovery to an upward posture after a transient base-of-support movement with eyes open. Postural responses to persistent wideband pseudorandom base-of-support translation were modeled as time invarient linear systems arrived at by Kalman adaptive filter techniques. Derived model parameters such as damping factor and fundamental frequency of the closed loop system showed significant modification between pre- and post-flight. This phenomenon is best characterized by movement of the poles toward increasing stability. While pre-flight data tended to show shoulders and hips moving in phase with each other, post-flight data showed a more disjoint behavior.(ABSTRACT TRUNCATED AT 400 WORDS).

Non-NASA Center↗
DOE OSTI2025

REBOUND: Reverse Engineering Bidirectional Outflow Under Non-Equilibrium Diffusion

Rare-earth elements (REEs) are essential for electronics, renewable energy, and defense technologies. However, the current supply of REEs relies on mining concentrated in a few countries and energy-intensive separations. DOE’s Basic Energy Sciences (BES) program has launched a grand challenge which aims to ensure a sustainable supply of critical REEs by developing innovative and environmentally friendly separation methods. As an alternative to costly and harmful traditional methods, the Non-Equilibrium Transport Driven Separations (NETS) initiative has created a microfluidic Y-channel co-flow method that applies external fields to exploit magneto- and electrohydrodynamic effects for separating dilute REE ions from complex feedstocks. Computational fluid dynamics (CFD) studies have identified a few operating conditions with promising ion selectivity and separation efficiency. However, challenges remain regarding Y-channel versatility across feedstocks and accurate incorporation of physical phenomena into CFD models. In this work, we develop a multi-fidelity modelling approach which integrates experimental results with CFD simulation to build a surrogate model for the dependence of separation efficiency to variation of design parameters. The surrogate model enables a reinforcement learning (RL) method to adaptively launch CFD and experimental runs, improving model fidelity around optimal Y-channel parameters.

36 MATERIALS SCIENCE↗