Search NASA⌕ Search

SEARCH · Search NASA

Results for “Point Optimization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification

Christopher John Sullivan↗

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L.↗

Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective rein- forcement learning algorithm used to construct low-thrust transfers between pe- riodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.

Anderson, Rodney L↗

Methods and Apparatuses for Signaling with Geometric Constellations in a Raleigh Fading Channel

Communication systems are described that use signal constellations, which have unequally spaced (i.e., `geometrically` shaped) points. In many embodiments, the communication systems use specific geometric constellations that are capacity optimized at a specific SNR (signal to noise ratio). In addition, ranges within which the constellation points of a capacity optimized constellation can be perturbed and are still likely to achieve a given percentage of the optimal capacity increase compared to a constellation that maximizes d (sub min) (i.e. minimum distance between constellations) are also described. Capacity measures that are used in the selection of the location of constellation points include, but are not limited to, parallel decode (PD) capacity and joint capacity.

Barsoum, Maged F.↗

Simultaneous beam sampling and aperture shape optimization for SPORT

Purpose: Station parameter optimized radiation therapy (SPORT) was recently proposed to fully utilize the technical capability of emerging digital linear accelerators, in which the station parameters of a delivery system, such as aperture shape and weight, couch position/angle, gantry/collimator angle, can be optimized simultaneously. SPORT promises to deliver remarkable radiation dose distributions in an efficient manner, yet there exists no optimization algorithm for its implementation. The purpose of this work is to develop an algorithm to simultaneously optimize the beam sampling and aperture shapes. Methods: The authors build a mathematical model with the fundamental station point parameters as the decision variables. To solve the resulting large-scale optimization problem, the authors devise an effective algorithm by integrating three advanced optimization techniques: column generation, subgradient method, and pattern search. Column generation adds the most beneficial stations sequentially until the plan quality improvement saturates and provides a good starting point for the subsequent optimization. It also adds the new stations during the algorithm if beneficial. For each update resulted from column generation, the subgradient method improves the selected stations locally by reshaping the apertures and updating the beam angles toward a descent subgradient direction. The algorithm continues to improve the selected stations locally and globally by a pattern search algorithm to explore the part of search space not reachable by the subgradient method. By combining these three techniques together, all plausible combinations of station parameters are searched efficiently to yield the optimal solution. Results: A SPORT optimization framework with seamlessly integration of three complementary algorithms, column generation, subgradient method, and pattern search, was established. The proposed technique was applied to two previously treated clinical cases: a head and neck and a prostate case. It significantly improved the target conformality and at the same time critical structure sparing compared with conventional intensity modulated radiation therapy (IMRT). In the head and neck case, for example, the average PTV coverage D99% for two PTVs, cord and brainstem max doses, and right parotid gland mean dose were improved, respectively, by about 7%, 37%, 12%, and 16%. Conclusions: The proposed method automatically determines the number of the stations required to generate a satisfactory plan and optimizes simultaneously the involved station parameters, leading to improved quality of the resultant treatment plans as compared with the conventional IMRT plans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A new adaptive light beam focusing principle for scanning light stimulation systems

In this article a novel principle to achieve optimal focusing conditions or rather the smallest possible beam diameter for scanning light stimulation systems is presented. It is based on the following methodology: First, a reference point on a camera sensor is introduced where optimal focusing conditions are adjusted and the distance between the light focusing optic and the reference point is determined using a laser displacement sensor. In a second step, this displacement sensor is used to map the topography of the sample under investigation. Finally, the actual measurement is conducted, using optimal focusing conditions in each measurement point at the sample surface, that are determined by the height difference between camera sensor and the sample topography. This principle is independent of the measurement values, the optical or electrical properties of the sample, the used light source, or the selected wavelength. Furthermore, the samples can be tilted, rough, bent, or of different surface materials. In the following the principle is implemented using an optical beam induced current system, but basically it can be applied to any other scanning light stimulation system. Measurements to demonstrate its operation are shown, using a polycrystalline silicon solar cell.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Comparing Consider-Covariance Analysis with Sigma-Point Consider Filter and Linear-Theory Consider Filter Formulations

Recent literature in applied estimation theory reflects growing interest in the sigma-point (also called unscented ) formulation for optimal sequential state estimation, often describing performance comparisons with extended Kalman filters as applied to specific dynamical problems [c.f. 1, 2, 3]. Favorable attributes of sigma-point filters are described as including a lower expected error for nonlinear even non-differentiable dynamical systems, and a straightforward formulation not requiring derivation or implementation of any partial derivative Jacobian matrices. These attributes are particularly attractive, e.g. in terms of enabling simplified code architecture and streamlined testing, in the formulation of estimators for nonlinear spaceflight mechanics systems, such as filter software onboard deep-space robotic spacecraft. As presented in [4], the Sigma-Point Consider Filter (SPCF) algorithm extends the sigma-point filter algorithm to the problem of consider covariance analysis. Considering parameters in a dynamical system, while estimating its state, provides an upper bound on the estimated state covariance, which is viewed as a conservative approach to designing estimators for problems of general guidance, navigation and control. This is because, whether a parameter in the system model is observable or not, error in the knowledge of the value of a non-estimated parameter will increase the actual uncertainty of the estimated state of the system beyond the level formally indicated by the covariance of an estimator that neglects errors or uncertainty in that parameter. The equations for SPCF covariance evolution are obtained in a fashion similar to the derivation approach taken with standard (i.e. linearized or extended) consider parameterized Kalman filters (c.f. [5]). While in [4] the SPCF and linear-theory consider filter (LTCF) were applied to an illustrative linear dynamics/linear measurement problem, in the present work examines the SPCF as applied to nonlinear sequential consider covariance analysis, i.e. in the presence of nonlinear dynamics and nonlinear measurements. A simple SPCF for orbit determination, exemplifying an algorithm hosted in the guidance, navigation and control (GN&C) computer processor of a hypothetical robotic spacecraft, was implemented, and compared with an identically-parameterized (standard) extended, consider-parameterized Kalman filter. The onboard filtering scenario examined is a hypothetical spacecraft orbit about a small natural body with imperfectly-known mass. The formulations, relative complexities, and performances of the filters are compared and discussed.

Lisano, Michael E.↗

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗

A time optimal Space Station reboost guidance strategy

A closed-loop guidance strategy for time and fuel optimal reboost of Space Station Freedom is discussed in this paper. The reboost maneuver is formulated as an optimal control problem rather than a parameter optimization problem, the parameters being the thrust switching times. In the present approach the thrust switching structure need not be prescribed a priori to solve the resulting two point boundary value problem. Non-optimality of singular control or intermediate thrust is proved by utilizing the second order Kelley condition or the Generalized Legendre-Clebsch condition. Only a few sets of initial co-states and time-to-go guess values need to be stored on-board for a wide range of reboost scenarios.

Kumar, Renjith R.↗

A time-optimal Space Station reboost guidance strategy

A closed-loop guidance strategy for time and fuel optimal reboost of Space Station Freedom is discussed in this paper. The reboost maneuver is formulated as an optimal control problem rather than a parameter optimization problem, the parameters being the thrust switching times. In the present approach the thrust switching structure need not be prescribed a priori to solve the resulting two point boundary value problem. Non-optimality of singular control or intermediate thrust is proved by utilizing the second order Kelley condition or the Generalized Legendre-Clebsch condition. Only a few sets of initial co-states and time-to-go guess values need to be stored on-board for a wide range of reboost scenarios.

Kumar, Renjith R.↗

Methods and Apparatuses for Signaling with Geometric Constellations in a Raleigh Fading Channel

Communication systems are described that use signal constellations, which have unequally spaced (i.e. `geometrically` shaped) points. In many embodiments, the communication systems use specific geometric constellations that are capacity optimized at a specific SNR, over the Raleigh fading channel. In addition, ranges within which the constellation points of a capacity optimized constellation can be perturbed and are still likely to achieve a given percentage of the optimal capacity increase compared to a constellation that maximizes d.sub.min, are also described. Capacity measures that are used in the selection of the location of constellation points include, but are not limited to, parallel decode (PD) capacity and joint capacity.

Barsoum, Maged F.↗

Optimal aeroassisted coplanar orbital transfer using an energy model

The atmospheric portion of the trajectories for the aeroassisted coplanar orbit transfer was investigated. The equations of motion for the problem are expressed using reduced order model and total vehicle energy, kinetic plus potential, as the independent variable rather than time. The order reduction is achieved analytically without an approximation of the vehicle dynamics. In this model, the problem of coplanar orbit transfer is seen as one in which a given amount of energy must be transferred from the vehicle to the atmosphere during the trajectory without overheating the vehicle. An optimal control problem is posed where a linear combination of the integrated square of the heating rate and the vehicle drag is the cost function to be minimized. The necessary conditions for optimality are obtained. These result in a 4th order two-point-boundary-value problem. A parametric study of the optimal guidance trajectory in which the proportion of the heating rate term versus the drag varies is made. Simulations of the guidance trajectories are presented.

Halyo, Nesim↗

Equilibrium Control Policies for Markov Chains

The average cost criterion has held great intuitive appeal and has attracted considerable attention. It is widely employed when controlling dynamic systems that evolve stochastically over time by means of formulating an optimization problem to achieve long-term goals efficiently. The average cost criterion is especially appealing when the decision-making process is long compared to other timescales involved, and there is no compelling motivation to select short-term optimization. This paper addresses the problem of controlling a Markov chain so as to minimize the average cost per unit time. Our approach treats the problem as a dual constrained optimization problem. We derive conditions guaranteeing that a saddle point exists for the new dual problem and we show that this saddle point is an equilibrium control policy for each state of the Markov chain. For practical situations with constraints consistent to those we study here, our results imply that recognition of such saddle points may be of value in deriving in real time an optimal control policy.

99 GENERAL AND MISCELLANEOUS↗

Optimizing probe design for an implantable perfusion and oxygenation sensor

In an effort to develop an implantable optical perfusion and oxygenation sensor, based on multiwavelength reflectance pulse oximetry, we investigate the effect of source–detector separation and other source detector characteristics to optimize the sensor’s signal to background ratio using Monte Carlo (MC) based simulations and in vitro phantom studies. Separations in the range 0.45 to 1.25 mm were found to be optimal in the case of a point source. The numerical aperture (NA) of the source had no effect on the collected signal while the widening of the source spatial profile caused a shift in the optimal source-detector separation. Specifically, for a 4.5 mm flat beam and a 2.4 mm × 2.5 mm photodetector, the optimal performance was found to be when the source and detector are adjacent to each other. These modeling results were confirmed by data collected from in vitro experiments on a liver phantom perfused with dye solutions mimicking the absorption properties of hemoglobin for different oxygenation states.

42 ENGINEERING↗

Optimal control of sun tracking solar concentrators

Application of the modern control theory to derive an optimal sun tracking control for a point focusing solar concentrator is presented. A standard tracking problem converted to regulator problem using a sun rate input achieves an almost zero steady state tracking error with the optimal control formulation. However, these control techniques are costly because optimal type algorithms require large computing systems, thus they will be used mainly as comparison standards for other types of control algorithms and help in their development.

Hughes, R. O.↗

Non-Toxic, Low-Freezing, Drop-In Replacement Heat Transfer Fluids

A non-toxic, non-flammable, low-freezing heat transfer fluid is being developed for drop-in replacement within current and future heat transfer loops currently using water or alcohol-based coolants. Numerous water-soluble compounds were down-selected and screened for toxicological, physical, chemical, compatibility, thermodynamic, and heat transfer properties. Two fluids were developed, one with a freezing point near 0 C, and one with a suppressed freezing point. Both fluids contain an additive package to improve material compatibility and microbial resistance. The optimized sub-zero solution had a freezing point of 30 C, and a freezing volume expansion of 10-percent of water. The toxicity of the solutions was experimentally determined as LD(50) greater than 5g/kg. The solutions were found to produce minimal corrosion with materials identified by NASA as potentially existing in secondary cooling loops. Thermal/hydrodynamic performance exceeded that of glycol-based fluids with comparable freezing points for temperatures Tf greater than 20 C. The additive package was demonstrated as a buffering agent to compensate for CO2 absorption, and to prevent microbial growth. The optimized solutions were determined to have physically/chemically stable shelf lives for freeze/thaw cycles and longterm test loop tests.

Cutbirth, J. Michael↗

Automated Tracing of Horizontal Neuron Processes During Retinal Development

In the developing mammalian retina, horizontal neurons undergo a dramatic reorganization oftheir processes shortly after they migrate to their appropriate laminar position. This is an importantprocess because it is now understood that the apical processes are important for establishing theregular mosaic of horizontal cells in the retina and proper reorganization during lamination isrequired for synaptogenesis with photoreceptors and bipolar neurons. However, this process isdifficult to study because the analysis of horizontal neuron anatomy is labor intensive and time-consuming. In this paper, we present a computational method for automatically tracing the three-dimensional (3-D) dendritic structure of horizontal retinal neurons in two-photon laser scanningmicroscope (TPLSM) imagery. Our method is based on 3-D skeletonization and is thus able topreserve the complex structure of the dendritic arbor of these cells. We demonstrate theeffectiveness of our approach by comparing our tracing results against two sets of semi-automatedtraces over a set of 10 horizontal neurons ranging in age from P1 to P5. We observe an averageagreement level of 81% between our automated trace and the manual traces. This automatedmethod will serve as an important starting point for further refinement and optimization.

59 BASIC BIOLOGICAL SCIENCES↗

Destabilizing high-capacity high entropy hydrides via earth abundant substitutions: From predictions to experimental validation

The vast chemical space of high entropy alloys (HEAs) makes trial-and-error experimental approaches for materials discovery intractable and often necessitates data-driven and/or first principles computational insights to successfully target materials with desired properties. In the context of materials discovery for hydrogen storage applications, a theoretical prediction-experimental validation approach can vastly accelerate the search for substitution strategies to destabilize high-capacity hydrides based on benchmark HEAs, e.g. TiVNbCr alloys. Here, in this study, machine learning predictions, corroborated by density functional theory calculations, predict substantial hydride destabilization with increasing substitution of earth-abundant Fe content in the (TiVNb) 75 Cr 25-x Fe x system. The as-prepared alloys crystallize in a single-phase bcc lattice for limited Fe content x < 7, while larger Fe content favors the formation of a secondary C14 Laves phase intermetallic. Short range order for alloys with x < 7 can be well described by a random distribution of atoms within the bcc lattice without lattice distortion. Hydrogen absorption experiments performed on selected alloys validate the predicted thermodynamic destabilization of the corresponding fcc hydrides and demonstrate promising lifecycle performance through reversible absorption/desorption. This demonstrates the potential of computationally expedited hydride discovery and points to further opportunities for optimizing bcc alloy ↔ fcc hydrides for practical hydrogen storage applications.

36 MATERIALS SCIENCE↗