Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Accretion of Saturn’s Inner Mid-sized Moons from a Massive Primordial Ice Ring

Saturn’s rings are rock-poor, containing 90%–95% ice by mass. As a group, Saturn’s moons interior to and including Tethys are also about 90% ice. Tethys itself contains <6% rock by mass, in contrast to its similar-mass outer neighbor Dione, which contains >40% rock. Here we simulate the evolution of a massive primordial ice-rich ring and the production of satellites as ring material spreads beyond the Roche limit. We describe the Roche-interior ring with an analytic model, and use an N-body code to describe material beyond the Roche limit. We track the accretion and interactions of spawned satellites, including tidal interaction with the planet, assuming a tidal dissipation factor for Saturn of Q∼10{sup 4}. We find that ring torques and capture of moons into mutual resonances produce a system of ice-rich inner moons that extends outward to approximately Tethys’s orbit in 10{sup 9} years, even with relatively slow orbital expansion due to tides. The resulting mass and semimajor axis distribution of spawned moons resembles that of Mimas, Enceladus, and Tethys. We estimate the mass of rock delivered to the moons by external cometary impactors during a late heavy bombardment. We find that the inner moons receive a mass in rock comparable to their current total rock content, while Dione and Rhea receive an order-of-magnitude less rock than their current rock content. This suggests that external contamination may have been the primary source of rock in the inner moons, and that Dione and Rhea formed from much more rock-rich source material. Reproducing the distribution of rock among the current inner moons is challenging, and appears to require large impactors stochasticity and/or the presence of some rock in the initial ring.

79 ASTRONOMY AND ASTROPHYSICS↗

Ion mixing in the plasma sheet boundary layer by drift instabilities

The linear stability properties of collisionless drift instabilities are analyzed in a Harris equilibrium model of the plasma sheet boundary layer (PSBL). The strearmng ions with drift-type instabilities driven in the PSBL are considered. The fluid approximation leads to growth but predicts that the mode width approaches the gyroradius of the energetic ions. Thus an integral equation theory for the modes is developed taking into account that in the PSBL the curvature drift is weak compared with the grad-B drift. The exact wave particle resonance is kept in the nonlocal response functions. Plasma density, temperature, and magnetic gradient drift motions are taken into account. The drift modes produce an anomalous cross-field momentum transport mixing the PSBL ions on the time scale of tens of seconds. A nonlinear simulation is performed which shows the coalescence of the small scale, fast growing modes into large-scale vortices. The relation between these collective modes and plasma sheet transport phenomena is discussed including the comparison with the competing plasma mixing from single-particle stochasticity.

Horton, W.↗

Stage-local partitioned two-step runge-kutta methods for large systems of ordinary differential equations

We introduce stage-local partitioned two-step Runge-Kutta methods are an extension of standard two-step Runge-Kutta methods, which are an alternative to the standard additive two-step Runge-Kutta methods currently existing in the literature. Furthermore, these new schemes are designed with an eye towards truly N-partitioned systems and leverage local stage approximations to make several computationally interesting approximations viable. Specifically, the focus on local stage approximations makes possible the construction of truly asynchronous schemes, in the parallel sense, possible. In addition, we show that an implicit-explicit approach to these schemes can lead to methods that require the inversion of only local nonlinear systems.

Applied Dynamical Systems↗

Modeling and measurement of fault-tolerant multiprocessors

The workload effects on computer performance are addressed first for a highly reliable unibus multiprocessor used in real-time control. As an approach to studing these effects, a modified Stochastic Petri Net (SPN) is used to describe the synchronous operation of the multiprocessor system. From this model the vital components affecting performance can be determined. However, because of the complexity in solving the modified SPN, a simpler model, i.e., a closed priority queuing network, is constructed that represents the same critical aspects. The use of this model for a specific application requires the partitioning of the workload into job classes. It is shown that the steady state solution of the queuing model directly produces useful results. The use of this model in evaluating an existing system, the Fault Tolerant Multiprocessor (FTMP) at the NASA AIRLAB, is outlined with some experimental results. Also addressed is the technique of measuring fault latency, an important microscopic system parameter. Most related works have assumed no or a negligible fault latency and then performed approximate analyses. To eliminate this deficiency, a new methodology for indirectly measuring fault latency is presented.

Shin, K. G.↗

Stochastic Analysis of Levee Stability Subject to Variable Seepage Conditions

© ASCE. Levee stability is highly influenced by seepage. Specifically, hydraulic conductivity distribution within a levee influences pore pressure distribution and controls the drained strength of the soil. In this study the influence of hydraulic conductivity and blanket layer thickness on failure probability is evaluated within the context of reliability analyses that also include soil strength and unit weight as random variables. First-Order Reliability Method (FORM) is used to evaluate reliability, rank random variables by importance and to obtain sensitivity of the solution to each random variable and its distribution parameters. Stability is computed using Spencer's method of slices coupled to a finite element seepage code to directly evaluate pore pressure. In addition, response surface method solutions are compared to the direct reliability solution to assess response surface accuracy. The results show that blanket layer thickness is more important than most strength parameters and that the uncertainty in hydraulic conductivity is less important to the variance in safety factor for the case of a low-permeability blanket layer. Numerical challenges caused by implementing a finite element limit-state function are discussed. Response surface methods are found to give a reasonable approximation to the direct reliability solution when the design point is between response surface fitting points.

Lanzafame, Robert↗

Cusps enable line attractors for neural computation

Here, line attractors in neuronal networks have been suggested to be the basis of many brain functions, such as working memory, oculomotor control, head movement, locomotion, and sensory processing. In this paper, we make the connection between line attractors and pulse gating in feed-forward neuronal networks. In this context, because of their neutral stability along a one-dimensional manifold, line attractors are associated with a time-translational invariance that allows graded information to be propagated from one neuronal population to the next. To understand how pulse-gating manifests itself in a high-dimensional, nonlinear, feedforward integrate-and-fire network, we use a Fokker-Planck approach to analyze system dynamics. We make a connection between pulse-gated propagation in the Fokker-Planck and population-averaged mean-field (firing rate) models, and then identify an approximate line attractor in state space as the essential structure underlying graded information propagation. An analysis of the line attractor shows that it consists of three fixed points: a central saddle with an unstable manifold along the line and stable manifolds orthogonal to the line, which is surrounded on either side by stable fixed points. Along the manifold defined by the fixed points, slow dynamics give rise to a ghost. We show that this line attractor arises at a cusp catastrophe, where a fold bifurcation develops as a function of synaptic noise; and that the ghost dynamics near the fold of the cusp underly the robustness of the line attractor. Understanding the dynamical aspects of this cusp catastrophe allows us to show how line attractors can persist in biologically realistic neuronal networks and how the interplay of pulse gating, synaptic coupling, and neuronal stochasticity can be used to enable attracting one-dimensional manifolds and, thus, dynamically control the processing of graded information.

59 BASIC BIOLOGICAL SCIENCES↗

Exits in order: How crowding affects particle lifetimes

Diffusive processes are often represented using stochastic random walk frameworks. The amount of time taken for an individual in a random walk to intersect with an absorbing boundary is a fundamental property that is often referred to as the particle lifetime, or the first passage time. The mean lifetime of particles in a random walk model of diffusion is related to the amount of time required for the diffusive process to reach a steady state. Mathematical analysis describing the mean lifetime of particles in a standard model of diffusion without crowding is well known. However, the lifetime of agents in a random walk with crowding has received much less attention. Since many applications of diffusion in biology and biophysics include crowding effects, here we study a discrete model of diffusion that incorporates crowding. Using simulations, we show that crowding has a dramatic effect on agent lifetimes, and we derive an approximate expression for the mean agent lifetime that includes crowding effects. Our expression matches simulation results very well, and highlights the importance of crowding effects that are sometimes overlooked.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection

Deep neural networks (DNNs) have achieved state-of-the-art performance across a variety of traditional machine learning tasks, e.g., speech recognition, image classification, and segmentation. The ability of DNNs to efficiently approximate high-dimensional functions has also motivated their use in scientific applications, e.g., to solve partial differential equations and to generate surrogate models. In this paper, we consider the supervised training of DNNs, which arises in many of the above applications. We focus on the central problem of optimizing the weights of the given DNN such that it accurately approximates the relation between observed input and target data. Devising effective solvers for this optimization problem is notoriously challenging due to the large number of weights, nonconvexity, data sparsity, and nontrivial choice of hyperparameters. To solve the optimization problem more efficiently, we propose the use of variable projection (VarPro), a method originally designed for separable nonlinear least-squares problems. Our main contribution is the Gauss--Newton VarPro method (GNvpro) that extends the reach of the VarPro idea to nonquadratic objective functions, most notably cross-entropy loss functions arising in classification. These extensions make GNvpro applicable to all training problems that involve a DNN whose last layer is an affine mapping, which is common in many state-of-the-art architectures. In our four numerical experiments from surrogate modeling, segmentation, and classification, GNvpro solves the optimization problem more efficiently than commonly used stochastic gradient descent (SGD) schemes. Finally, GNvpro finds solutions that generalize well, and in all but one example better than well-tuned SGD methods, to unseen data points.

97 MATHEMATICS AND COMPUTING↗

Spectral proper orthogonal decomposition and its relationship to dynamic mode decomposition and resolvent analysis

We consider the frequency domain form of proper orthogonal decomposition (POD), called spectral proper orthogonal decomposition (SPOD). Spectral POD is derived from a space–time POD problem for statistically stationary flows and leads to modes that each oscillate at a single frequency. This form of POD goes back to the original work of Lumley ( Stochastic Tools in Turbulence , Academic Press, 1970), but has been overshadowed by a space-only form of POD since the 1990s. We clarify the relationship between these two forms of POD and show that SPOD modes represent structures that evolve coherently in space and time, while space-only POD modes in general do not. We also establish a relationship between SPOD and dynamic mode decomposition (DMD); we show that SPOD modes are in fact optimally averaged DMD modes obtained from an ensemble DMD problem for stationary flows. Accordingly, SPOD modes represent structures that are dynamic in the same sense as DMD modes but also optimally account for the statistical variability of turbulent flows. Finally, we establish a connection between SPOD and resolvent analysis. The key observation is that the resolvent-mode expansion coefficients must be regarded as statistical quantities to ensure convergent approximations of the flow statistics. When the expansion coefficients are uncorrelated, we show that SPOD and resolvent modes are identical. Our theoretical results and the overall utility of SPOD are demonstrated using two example problems: the complex Ginzburg–Landau equation and a turbulent jet.

Mechanics↗

Propagation in a shearing plasma. II - Turbulence and the frequency range of pulsar microstructure

Numerical calculations are presented which explore the propagation of radio waves and pulses through a turbulent shearing plasma. A stochastic model is used to describe the turbulent velocity field, in which random fluctuations are superposed on a mean profile. Both Gaussian wave packets and shot-noise pulses polarized in the plane of shearing acquire quasi-periodic intensity modulations above the rest-frame plasma frequency. The frequency range over which these modulations appear is shown to depend on the spatial correlation length of the turbulent fluctuations and on their standard deviation from the mean velocity. The period of the modulations is variable from one realization of the random process to the next, and the average period is frequency dependent. The results of these calculations lend further support to a model for pulsar microstructure in which periodic micropulses are pure temporal modulations of the emitted radiation due to propagation effects in magnetospheric shearing regions. It is shown that turbulence on a scale of approximately 10 cm can produce these quasi-periodic modulations over a frequency range comparable to that of observed microstructure.

Harding, A. K.↗

An efficient surrogate model of secondary electron formation and evolution

This work extends the adjoint-deep learning framework for runaway electron (RE) evolution, developed by McDevitt et al. [Phys. Plasmas 32, 042503 (2025)], to account for large-angle collisions. By incorporating large-angle collisions, the framework allows the avalanche of REs to be captured, an essential component of RE dynamics. This extension is accomplished by using a Rosenbluth–Putvinski approximation to estimate the distribution of secondary electrons generated by large-angle collisions. By evolving both the primary and multiple generations of secondary electrons, the present formulation can capture both the detailed temporal evolution of a RE population beginning from an arbitrary initial momentum space distribution, along with providing approximations to the saturated growth and decay rates of the RE population. Predictions of the adjoint-deep learning framework are verified against a traditional RE solver, with good agreement present across a broad range of parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Stochastic Optimization for Grid Resilience. FY18 Final Technical Report

The optimal restoration problem lies at the foundation of the evaluation and improvement of resilience in power systems. In this report we present a scalable decomposition algorithm for solving this problem for realistic power systems. The algorithm has been developed in three major research threads, corresponding to the chapters in the present report. Chapter 1 studies mixed-integer programming (MIP) formulations for the requirement that each electrical island that appears after a recon guration must have at least one energized generator. We provide three alternative MIP formulations for this restriction, show their equivalence, and prove that two of them are stronger in terms of their linear programming relaxation than the formulation most commonly used in the power systems literature. Since the time to solve MIPs can vary signi cantly between equivalent formulations, we also present computational experiments on IEEE test systems for the Intentional Controlled Islanding (ICI) and the Black Start Allocation (BSA) problems. We observe that a polynomially separable, exponential in size, strong formulation yields the best performance for the BSA problem and exhibits a comparable performance to a linear in size, weak formulation for the ICI problem. Chapter 2 presents a methodology to generate mixed-integer linear approximations of the AC power ow equations governing lines, transformers (including tap regulators and phase shifters), shunt and series compensators, and consumption responsive to voltage. Our approximations are capable of capturing limitations for power grids under abnormal or uncommon operating conditions where common assumptions used in power ow relaxations may not hold. Particularly, the approximation captures overvoltages under almost no load, which is a major concern when energizing lines after a blackout. The method constructs piecewise linear approximations of the non-linear power ow equations by minimizing the squared approximation error over a subset of the feasible domain. We test the method using a realistic database for the Chilean system (1548 buses, 1114 lines, 564 transformers). The resulting approximations yield root mean square errors in the order of 0.05pu and are successfully applied to solve a transmission switching instance for the Chilean system. Chapter 3 presents our algorithm for optimal restoration. The algorithm works by partitioning the problem into a master problem and a slave problem. The master problem optimizes over energization sequences of generators, buses and branches, for the entire restoration horizon, while respecting the energization requiments studied in Chapter 1. The slave problem veri es that there exist power ow solutions supporting the energization sequences proposed by the master problem, adding cuts to the master if an infeasible sequence is detected.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Effect of Cumulus Cloud Field Anisotropy on Domain-Averaged Solar Fluxes and Atmospheric Heating Rates

Cumulus clouds can become tilted or elongated in the presence of wind shear. Nevertheless, most studies of the interaction of cumulus clouds and radiation have assumed these clouds to be isotropic. This paper describes an investigation of the effect of fair-weather cumulus cloud field anisotropy on domain-averaged solar fluxes and atmospheric heating rate profiles. A stochastic field generation algorithm was used to produce twenty three-dimensional liquid water content fields based on the statistical properties of cloud scenes from a large eddy simulation. Progressively greater degrees of x-z plane tilting and horizontal stretching were imposed on each of these scenes, so that an ensemble of scenes was produced for each level of distortion. The resulting scenes were used as input to a three-dimensional Monte Carlo radiative transfer model. Domain-average transmission, reflection, and absorption of broadband solar radiation were computed for each scene along with the average heating rate profile. Both tilt and horizontal stretching were found to significantly affect calculated fluxes, with the amount and sign of flux differences depending strongly on sun position relative to cloud distortion geometry. The mechanisms by which anisotropy interacts with solar fluxes were investigated by comparisons to independent pixel approximation and tilted independent pixel approximation computations for the same scenes. Cumulus anisotropy was found to most strongly impact solar radiative transfer by changing the effective cloud fraction, i.e., the cloud fraction when the field is projected on a surface perpendicular to the direction of the incident solar beam.

Hinkelman, Laura M.↗

Improving Estimation of the Koopman Operator with Kolmogorov–Smirnov Indicator Functions

It has become common to perform kinetic analysis using approximate Koopman operators that transform high-dimensional timeseries of observables into ranked dynamical modes. The key to the practical success of the approach is the identification of a set of observables that form a good basis on which to expand the slow relaxation modes. Good observables are, however, difficult to identify a priori and suboptimal choices can lead to significant underestimations of characteristic time scales. Leveraging the representation of slow dynamics in terms of Hidden Markov Models (HMM), we propose a simple and computationally efficient clustering procedure to infer surrogate observables that form a good basis for slow modes. Here, we apply the approach to an analytically solvable model system as well as on three protein systems of different complexities. We consistently demonstrate that the inferred indicator functions can significantly improve the estimation of the leading eigenvalues of Koopman operators and correctly identify key states and transition time scales of stochastic systems, even when good observables are not known a priori.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SCALE Code System

The SCALE Code System is a widely-used modeling and simulation suite for nuclear safety analysis and design that is developed, maintained, tested, and managed by the Reactor and Nuclear Systems Division (RNSD) of Oak Ridge National Laboratory (ORNL). SCALE provides a comprehensive, verified and validated, user-friendly tool set for criticality safety, reactor and lattice physics, radiation shielding, spent fuel and radioactive source term characterization, and sensitivity and uncertainty analysis. Since 1980, regulators, licensees, and research institutions around the world have used SCALE for safety analysis and design. SCALE provides an integrated framework with dozens of computational modules including three deterministic and three Monte Carlo radiation transport solvers that are selected based on the desired solution strategy. SCALE includes current nuclear data libraries and problem-dependent processing tools for continuous-energy (CE) and multigroup (MG) neutronics and coupled neutron-gamma calculations, as well as activation, depletion, and decay calculations. SCALE includes unique capabilities for automated variance reduction for shielding calculations, as well as sensitivity and uncertainty analysis. SCALE’s graphical user interfaces assist with accurate system modeling, visualization of nuclear data, and convenient access to desired results.SCALE 6.2 provides many new capabilities and significant improvements of existing features.New capabilities include:• ENDF/B-VII.1 nuclear data libraries CE and MG with enhanced group structures,• Neutron covariance data based on ENDF/B-VII.1 and supplemented with ORNL data,• Covariance data for fission product yields and decay constants,• Stochastic uncertainty and correlation quantification for any SCALE sequence with Sampler,• Parallel calculations with KENO,• Problem-dependent temperature corrections for CE calculations,• CE shielding and criticality accident alarm system analysis with MAVRIC,• CE depletion with TRITON (T5-DEPL/T6-DEPL),• CE sensitivity/uncertainty analysis with TSUNAMI-3D,• Simplified and efficient LWR lattice physics with Polaris,• Large scale detailed spent fuel characterization with ORIGAMI and ORIGAMI Automator,• Advanced fission source convergence acceleration capabilities with Sourcerer,• Nuclear data library generation with AMPX, and• Integrated user interface with Fulcrum.Enhanced capabilities include:• Accurate and efficient CE Monte Carlo methods for eigenvalue and fixed source calculations,• Improved MG resonance self-shielding methodologies and data,• Resonance self-shielding with modernized and efficient XSProc integrated into most sequences,• Accelerated calculations with TRITON/NEWT (generally 4x faster than SCALE 6.1),• Spent fuel characterization with 1470 new reactor-specific libraries for ORIGEN,• Modernization of ORIGEN (Chebyshev Rational Approximation Method [CRAM] solver, API for high-performance depletion, new keyword input format)• Extension of the maximum mixture number to values well beyond the previous limit of 2147 to ~2 billion,• Nuclear data formats enabling the use of more than 999 energy groups,• Updated standard composition library to provide more accurate use of natural abundances, andvi• Numerous other enhancements for improved usability and stability.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Manifold Learning-Based Polynomial Chaos Expansions for High-Dimensional Surrogate Models

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data representing quantities of interest of the computational or analytical model. For this purpose, we employ Grassmannian diffusion maps, a two-step nonlinear dimension reduction technique which allows us to reduce the dimensionality of the data and identify meaningful geometric descriptions in a parsimonious and inexpensive manner. Polynomial chaos expansion is then used to construct a mapping between the stochastic input parameters and the diffusion coordinates of the reduced space. An adaptive clustering technique is proposed to identify an optimal number of clusters of points in the latent space. The similarity of points allows us to construct a number of geometric harmonic emulators which are finally utilized as a set of inexpensive pretrained models to perform an inverse map of realizations of latent features to the ambient space and thus perform accurate out-of-sample predictions. Thus, the proposed method acts as an encoder-decoder system which is able to automatically handle very high-dimensional data while simultaneously operating successfully in the small-data regime. The method is demonstrated on two benchmark problems and on a system of advection-diffusion-reaction equations which model a first-order chemical reaction between two species. In all test cases, the proposed method is able to achieve highly accurate approximations which ultimately lead to the significant acceleration of UQ tasks.

42 ENGINEERING↗

Dominant Time Scales of Potentially Predictable Precipitation Variations across the Continental United States

While low-frequency variations in precipitation amount, occurrence counts (hereafter “occurrence”), and intensity can take place on seasonal to multidecadal time scales, it is often unclear at which time scales these precipitation variations can be ascribed to potentially predictable, climate-induced changes versus simple, stochastic (i.e., random) precipitation event evolutions. This paper seeks to isolate the dominant time scales at which potentially predictable changes in observed precipitation characteristics occur over the continental United States and analyze sources of revealed potentially predictable precipitation variations for particular regions. The results highlight that at interannual time scales (here defined as those shorter than 7 years), the potential for predicting annual precipitation amounts tends to be higher than for annual event occurrence or intensity, with interannual potential predictability highest in both relatively dry and wet locations and lowest in transition regions. By contrast, at time scales greater than 7 years the potential for predicting annual event occurrence tends to be higher than amount or intensity, with >20-yr time scale potential predictability highest in relatively wet locations and lowest in relatively dry locations. To highlight the utility of this type of analysis, two robust signals are selected for further investigation, including 1) approximately 10-yr time scale variations in potentially predictable annual amounts over the northwestern United States and 2) 20–60-yr time scale variations in potentially predictable annual event occurrence over the southwestern United States. While mechanistic drivers for these observed variations are still being investigated, concurrent and precursor climate-state estimates in the atmosphere and ocean—principally over the Pacific sector—are provided, the monitoring of which may help realize the potential for predicting precipitation variations in these regions.

54 ENVIRONMENTAL SCIENCES↗

A Multifaceted Mathematical Approach for Complex Systems

Applied mathematics has an important role to play in developing the tools needed for the analysis, simulation, and optimization of complex problems. These efforts require the development of the mathematical foundations for scientific discovery, engineering design, and risk analysis based on a sound integrated approach for the understanding of complex systems. However, maximizing the impact of applied mathematics on these challenges requires a novel perspective on approaching the mathematical enterprise. Previous reports that have surveyed the DOE's research needs in applied mathematics have played a key role in defining research directions with the community. Although these reports have had significant impact, accurately assessing current research needs requires an evaluation of today's challenges against the backdrop of recent advances in applied mathematics and computing. To address these needs, the DOE Applied Mathematics Program sponsored a Workshop for Mathematics for the Analysis, Simulation and Optimization of Complex Systems on September 13-14, 2011. The workshop had approximately 50 participants from both the national labs and academia. The goal of the workshop was to identify new research areas in applied mathematics that will complement and enhance the existing DOE ASCR Applied Mathematics Program efforts that are needed to address problems associated with complex systems. This report describes recommendations from the workshop and subsequent analysis of the workshop findings by the organizing committee.

97 MATHEMATICS AND COMPUTING↗