Search NASA⌕ Search

SEARCH · Search NASA

Results for “adaptive dynamic programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Adaptive age replacement

Bayesian approach to adaptive age replacement treated by dynamic programming

BAYESIAN STATISTICS↗

NASTRAN computer system level 12.1

Program uses finite element displacement method for solving linear response of large, three-dimensional structures subject to static, dynamic, thermal, and random loadings. Program adapts to computers of different manufacture, permits up-dating and extention, allows interchange of output and input information between users, and is extensively documented.

Butler, T. G.↗

Adaptive Phenotypic Plasticity Stabilizes Evolution in Fluctuating Environments

Fluctuating environmental conditions are ubiquitous in natural systems, and populations have evolved various strategies to cope with such fluctuations. The particular mechanisms that evolve profoundly influence subsequent evolutionary dynamics. One such mechanism is phenotypic plasticity, which is the ability of a single genotype to produce alternate phenotypes in an environmentally dependent context. Here, we use digital organisms (self-replicating computer programs) to investigate how adaptive phenotypic plasticity alters evolutionary dynamics and influences evolutionary outcomes in cyclically changing environments. Specifically, we examined the evolutionary histories of both plastic populations and non-plastic populations to ask: (1) Does adaptive plasticity promote or constrain evolutionary change? (2) Are plastic populations better able to evolve and then maintain novel traits? And (3), how does adaptive plasticity affect the potential for maladaptive alleles to accumulate in evolving genomes? We find that populations with adaptive phenotypic plasticity undergo less evolutionary change than non-plastic populations, which must rely on genetic variation from de novo mutations to continuously readapt to environmental fluctuations. Indeed, the non-plastic populations undergo more frequent selective sweeps and accumulate many more genetic changes. We find that the repeated selective sweeps in non-plastic populations drive the loss of beneficial traits and accumulation of maladaptive alleles, whereas phenotypic plasticity can stabilize populations against environmental fluctuations. This stabilization allows plastic populations to more easily retain novel adaptive traits than their non-plastic counterparts. In general, the evolution of adaptive phenotypic plasticity shifted evolutionary dynamics to be more similar to that of populations evolving in a static environment than to non-plastic populations evolving in an identical fluctuating environment. All natural environments subject populations to some form of change; our findings suggest that the stabilizing effect of phenotypic plasticity plays an important role in subsequent adaptive evolution.

54 ENVIRONMENTAL SCIENCES↗

Dynamic, Adaptive, Systems and Materials: Complex, Simple and Emergent Behaviors

This program has been funded by DoE/BES for twenty years. It has moved into and out of various subjects as it has developed, but it has retained its focus on complexity and complex systems. The project has evolved in the following way: Self-Assembly and Biomimetic Self-Assembly: All self-assembling systems depend upon a minimum of two types of interaction: a repulsion and an attraction. For the familiar molecular systems, attractive interactions are typically hydrogen bonds and electrostatic interactions. Repulsive interactions include steric effects, hydrophobic effects (in biological systems), and charge-charge repulsion. We have expanded this repertoire to include surface interactions, magnetic interactions, and others. I list these systems in the order in which we have explored them: i) A key emphasis in current work is in understanding how the movement of ions in a magnetic field (the Lorentz effect) interacts with catalytic systems. We have demonstrated that an acceleration in rate of reduction of CO 2 to CO can be accomplished by applying an external magnetic field. This acceleration is largely due to the application of the Lorentz effect on mass transport at the catalyst’s surface. ii) We have also extensively explored the influence of electrostatics, as exhibited in self-assembling systems, by tribocharging. iii) Another key system involves surface tension effects; examples include interactions between heavy particles floating at a liquid-air interface, and interacting by changes in surface area; interactions of bubbles and bubble rafts, behaviors of bubble trains in microfluidic networks, and behaviors of microorganisms in constraining environments. iv) This work has intentionally de-emphasized biological systems; but it does include some work on protein-ligand interactions and interactions among microorganisms. v) We have also explored applications of some of these effects, these explorations include bubble rafts as diffraction gratings, exploration of the structures that can be obtained by tribocharging and uses of these structures in exploring nucleation and melting of crystals. vi) Although not a major focus of this work, several other topics have emerged and offer opportunities for future work. These include the behavior of bubble trains and bubble rafts in microfluidic systems. A particularly interesting example is the formation of bubble trains that repeat in the alteration of large and small bubbles according to rules we do not presently understand, but are uniquely large-period oscillating systems. These systems offer a new route into understanding the instabilities of the type represented by oscillations. vii) We have also begun exploratory projects on magnetic levitation (especially to determine molecular density), and information storage (in molecules). Magnetic Levitation: Self-assembling and biomimetic systems require both attraction and repulsion. We have used electrostatics (tribocharging), interfacial free-energies (surface tension and related forces) and others. Potential uses include reconfigurable diffraction gratings and liquid lenses; exploration of mechanisms in tribocharging; tunneling in EGaIn junctions; and bubble trains (especially in micro-fluidic systems). Examples of systems representing these topics is included in the following papers: Complexity: Disks rotating at a water-air interface; Benard-Marangoni effects; Vortex-Crystals from spinning magnetic disks (Marangoni effects); EGaIn Electrode to study quantum tunneling; Self-Assembly of electrostatically-charged metallic spheres (electrets); Dynamically reconfigurable lens; Using computational designs of ligands for enzymes; Electrostatic self-assembly by tribocharging; Monodisperse bubble trains in microchannel systems; Inverted dripping faucet; Flames; Printing of micro-organisms to regenerate the “ink” of printing device; Using micro-organisms to move loads (“microoxen”); Motion of bacterial swarms near surfaces; Making monodisperse particles in microfluidic systems; Coding/decoding of information stored in droplet trains in microfluidic networks; Magnetic levitation; and Information storage. i) Tribocharging. The change in focus of this work on electrets from the fundamentals of charging to applications of these materials in studying self-assembly using electrostatic interactions. ii) Bubbles in Microchannels. The realization that systems of bubbles in microchannels represented a major opportunity to study complexity in a very tractable system, and the development of a semi-quantitative theory of this subject. iii) Flames. The growth of “flames” remains an exploratory subject for the research, although their currently relatively little active work involving it ongoing. iv) Systems with Microorganisms. The removal of work in biological systems from this project. Based on work supported in this program, we now have a significant project on the development of microfluidic tools for studying C. elegans (a nematode), but this work was not appropriate for a program focused on complexity, and we developed separate support for it. (It is, however, an example of successful seeding of a new area by BES.) The work on electrets has gone through a period in which a part of the program was the subject of a MURI; the focus of this work was to develop materials that did not charge electrostatically on friction or contact. The MURI is now over, and the work on dynamic self-assembly (supported by BES) is the major focus. “Flames” has also enjoyed synergistic support, in terms of a project supported by DARPA on flame suppression (in the absence of extinguishing agents, using acoustic and electrostatic interactions). This work was helpful in understanding some of the basics of flames, but is entirely distinct from the BES focus in complexity. A growing interest is in the Lorentz effect. The Lorentz effect is the force exerted on charged particles (electrons, ions, charged molecules) when they move through a perpendicular magnetic field. The Lorentz effect is almost ubiquitous in modern technology: examples of applications include electric motors, dynamos, cathode ray tubes, many batteries, and most systems that control electrical currents with magnetic forces. We have begun to explore the Lorentz effect in electrochemical systems and heterogeneous catalytic systems involving charged organic species and inorganic ions. This work is still at an early stage, but initial studies that Lorentz effects can be large when ions move through magnetic fields, or magnetic fields move in the presence of ions.

36 MATERIALS SCIENCE↗

Discrete sequence prediction and its applications

Learning from experience to predict sequences of discrete symbols is a fundamental problem in machine learning with many applications. We apply sequence prediction using a simple and practical sequence-prediction algorithm, called TDAG. The TDAG algorithm is first tested by comparing its performance with some common data compression algorithms. Then it is adapted to the detailed requirements of dynamic program optimization, with excellent results.

Laird, Philip↗

A Multi-Model, Multi-Scale Research Program in Stressors, Responses, and Coupled Systems Dynamics at the Energy-Water-Land Nexus and for Concentrated, Interdependent Infrastructures: Toward Next Generation Capabilities in Integrated Impacts, Adaptation, and Vulnerability (I-IAV) Modeling and a Community of Practice

The goal of this research program was to build a next generation integrated suite of science-driven modeling and analytic capabilities, and a more expanded and connected community of practice, for analyses of the stressors, impacts, adaptations and vulnerabilities of global and regional change. The emphasis was on understanding energy-water-land interactions and feedbacks and interdependent infrastructures at appropriate regional and temporal scales. Although the scope spans many complex facets of data, modeling, and analysis, as well as scales appropriate for integrated impacts and adaptation research, the focus of this effort was the development of multi-model, multi-scale capabilities spanning the domains of Multi-Sector Dynamics (MSD) models; Impact, Adaptation, and Vulnerability (IAV) models; and Earth System Models (ESMs).

54 ENVIRONMENTAL SCIENCES↗

Advancing Ethanol-to-Jet cost Effectiveness via direct conversion to n -Butene-Rich olefins and Co-Product Valorization

Ethanol is a promising feedstock for sustainable aviation fuel production; however, conventional routes face significant energy and cost challenges, particularly due to the ethanol dehydration step to ethylene. Here, this study leverages breakthrough experimental data to perform comprehensive techno-economic and life-cycle assessments of an innovative ethanol-to-jet process. The process employs a single-step catalytic conversion, enabled by multifunctional Cu-ZrO 2 /SBA-16 catalyst, to directly upgrade ethanol into a mixed olefin stream rich in n-butene. The single-step conversion eliminates the costly ethanol dehydration step in the conventional process. High selectivity toward n-butene offers key advantages: it simplifies downstream oligomerization into jet-range hydrocarbons and enables the co-production of renewable n-butene alongside sustainable aviation fuel. The analysis estimates a minimum fuel selling price as low as $\$$2.50 per gallon, whether using corn ethanol or cellulosic ethanol from corn stover. Life cycle CO 2 equivalent emissions are projected to be as low as 10.6 g CO 2 eq/MJ sustainable aviation fuel, representing over 70% reduction compared to conventional petroleum-based jet fuel. This one-step ethanol upgrading approach not only facilitates SAF and n-butene co-production but also provides operational flexibility. The ability to tailor product outputs allows the ethanol-to-jet process to adapt to varying feedstocks, incentive programs, and market dynamics, ultimately enhancing the economic viability of sustainable aviation fuel production.

Xu, Yiling [Pacific Northwest National Laboratory ↗

Forward Stochastic Nonlinear Adaptive Control Method

New method of computation for optimal stochastic nonlinear and adaptive control undergoing development. Solves systematically stochastic dynamic programming equations forward in time, using nested-stochastic-approximation technique. Main advantage, simplicity of programming and reduced complexity with clear performance/computation trade-offs.

Bayard, David S.↗

Efficient Parallelization of a Dynamic Unstructured Application on the Tera MTA

The success of parallel computing in solving real-life computationally-intensive problems relies on their efficient mapping and execution on large-scale multiprocessor architectures. Many important applications are both unstructured and dynamic in nature, making their efficient parallel implementation a daunting task. This paper presents the parallelization of a dynamic unstructured mesh adaptation algorithm using three popular programming paradigms on three leading supercomputers. We examine an MPI message-passing implementation on the Cray T3E and the SGI Origin2OOO, a shared-memory implementation using cache coherent nonuniform memory access (CC-NUMA) of the Origin2OOO, and a multi-threaded version on the newly-released Tera Multi-threaded Architecture (MTA). We compare several critical factors of this parallel code development, including runtime, scalability, programmability, and memory overhead. Our overall results demonstrate that multi-threaded systems offer tremendous potential for quickly and efficiently solving some of the most challenging real-life problems on parallel computers.

Oliker, Leonid↗

Parallel processors and nonlinear structural dynamics algorithms and software

The adaptation of a finite element program with explicit time integration to a massively parallel SIMD (single instruction multiple data) computer, the CONNECTION Machine is described. The adaptation required the development of a new algorithm, called the exchange algorithm, in which all nodal variables are allocated to the element with an exchange of nodal forces at each time step. The architectural and C* programming language features of the CONNECTION Machine are also summarized. Various alternate data structures and associated algorithms for nonlinear finite element analysis are discussed and compared. Results are presented which demonstrate that the CONNECTION Machine is capable of outperforming the CRAY XMP/14.

Belytschko, Ted↗

An AD100 implementation of a real-time STOVL aircraft propulsion system

A real-time dynamic model of the propulsion system for a Short Take-Off and Vertical Landing (STOVL) aircraft was developed for the AD100 simulation environment. The dynamic model was adapted from a FORTRAN based simulation using the dynamic programming capabilities of the AD100 ADSIM simulation language. The dynamic model includes an aerothermal representation of a turbofan jet engine, actuator and sensor models, and a multivariable control system. The AD100 model was tested for agreement with the FORTRAN model and real-time execution performance. The propulsion system model was also linked to an airframe dynamic model to provide an overall STOVL aircraft simulation for the purposes of integrated flight and propulsion control studies. An evaluation of the AD100 system for use as an aircraft simulation environment is included.

Ouzts, Peter J.↗

Portable Parallel Programming for the Dynamic Load Balancing of Unstructured Grid Applications

The ability to dynamically adapt an unstructured -rid (or mesh) is a powerful tool for solving computational problems with evolving physical features; however, an efficient parallel implementation is rather difficult, particularly from the view point of portability on various multiprocessor platforms We address this problem by developing PLUM, tin automatic anti architecture-independent framework for adaptive numerical computations in a message-passing environment. Portability is demonstrated by comparing performance on an SP2, an Origin2000, and a T3E, without any code modifications. We also present a general-purpose load balancer that utilizes symmetric broadcast networks (SBN) as the underlying communication pattern, with a goal to providing a global view of system loads across processors. Experiments on, an SP2 and an Origin2000 demonstrate the portability of our approach which achieves superb load balance at the cost of minimal extra overhead.

Biswas, Rupak↗

Dual adaptive control: Design principles and applications

The design of an actively adaptive dual controller based on an approximation of the stochastic dynamic programming equation for a multi-step horizon is presented. A dual controller that can enhance identification of the system while controlling it at the same time is derived for multi-dimensional problems. This dual controller uses sensitivity functions of the expected future cost with respect to the parameter uncertainties. A passively adaptive cautious controller and the actively adaptive dual controller are examined. In many instances, the cautious controller is seen to turn off while the latter avoids the turn-off of the control and the slow convergence of the parameter estimates, characteristic of the cautious controller. The algorithms have been applied to a multi-variable static model which represents a simplified linear version of the relationship between the vibration output and the higher harmonic control input for a helicopter. Monte Carlo comparisons based on parametric and nonparametric statistical analysis indicate the superiority of the dual controller over the baseline controller.

Mookerjee, Purusottam↗

Dynamic Altitude Simulation System Performance Modeling

The "Dynamic Altitude Simulation Prediction Program," DASSPP, is a program to predict the transient response of an engine, test cell, ejector system under engine shutdown conditions. These transients are important to know so that corrective modifications can be adapted to prevent any damage to the engine or test cell. The "Dynamic Altitude System Simulation Prediction Program," DASSPP, is a major rewrite of the existing program "RL-1000" written in BASIC. The RL-1000 program was written to analyze the transients of the RL-10 system only. The new program is written to run in Excell 97 and utilizes the Visual BASIC language in Excell. The program has many added features not included in the original "Rl-1000" program. The program utilizes the ejector models developed during the summer of 1997. The new program is very user friendly and utilizes a dialog box for data input.

LaFrance, Leo J.↗

Decision making and problem solving with computer assistance

In modern guidance and control systems, the human as manager, supervisor, decision maker, problem solver and trouble shooter, often has to cope with a marginal mental workload. To improve this situation, computers should be used to reduce the operator from mental stress. This should not solely be done by increased automation, but by a reasonable sharing of tasks in a human-computer team, where the computer supports the human intelligence. Recent developments in this area are summarized. It is shown that interactive support of operator by intelligent computer is feasible during information evaluation, decision making and problem solving. The applied artificial intelligence algorithms comprehend pattern recognition and classification, adaptation and machine learning as well as dynamic and heuristic programming. Elementary examples are presented to explain basic principles.

Kraiss, F.↗

Physical Security Timeline Analysis in Support of Advanced Reactor Demonstration and Deployment

This report presents the regulatory requirements and directions on the physical security of advanced nuclear reactors in USA. Presently, a rule is being proposed that allows for a performance-based analysis. In determining the physical security requirements for an advanced reactor, new tools may be desired to conduct a performance-based analysis. These tools should incorporate dynamic analysis methods to provide as much realism as possible. In comparison, the security requirements for existing light water reactors (LWRs) are much more prescriptive and the analysis conducted to establish the required physical security strategies were more easily performed with static analysis. In order to achieve the cost goals that advanced reactors require for adoption; the nuclear security force required should not be excessive. Dynamic physical security analysis methods and tools have been developed by the US Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program. This report details how the dynamic risk analysis tools developed in the LWRS program using the dynamic risk modelling tool, EMRALD, may be adapted for use in analyzing the physical security designs for advanced reactors accounting for variable performance-based requirements. This report provides an example analysis of a hypothetical SFR using publicly available information and generic assumptions to demonstrate the methods and potential presentation and analysis of the results. No actual plant information is used in this example analysis. Future work in this area will create additional models that can be adapted for any advanced reactor concept and use various security features to create a physical security system that provides adequate protection from radiological theft and sabotage.

97 MATHEMATICS AND COMPUTING↗

PLOT3D/AMES

Interactive graphics program helps scientists visualize computational fluid dynamics grids and solutions. PLOT3D/AMES offers multitude of functions and features and adapted for more types of computers than any other CFD graphics program. Other versions available are: SGI IRIS, UNIX Supercomputer and SGI IRIS, DEC VAX using DISSPLA, Generic UNIX using DISSPLA, and Apollo UNIX using GMR3D.

Buning, Pieter G.↗