Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Ionospheric gravity wave measurements with the USU dynasonde

A method for the measurement of ionospheric Gravity Wave (GW) using the USU Dynasonde is outlined. This method consists of a series of individual procedures, which includes functions for data acquisition, adaptive scaling, polarization discrimination, interpolation and extrapolation, digital filtering, windowing, spectrum analysis, GW detection, and graphics display. Concepts of system theory are applied to treat the ionosphere as a system. An adaptive ionogram scaling method was developed for automatically extracting ionogram echo traces from noisy raw sounding data. The method uses the well known Least Mean Square (LMS) algorithm to form a stochastic optimal estimate of the echo trace which is then used to control a moving window. The window tracks the echo trace, simultaneously eliminating the noise and interference. Experimental results show that the proposed method functions as designed. Case studies which extract GW from ionosonde measurements were carried out using the techniques described. Geophysically significant events were detected and the resultant processed results are illustrated graphically. This method was also developed for real time implementation in mind.

Berkey, Frank T.↗

Integral Kernel Methods for Nonlinear Parabolic-Elliptic Systems

Nonlinear parabolic-elliptic systems arise in many physical, biological, and chemical phenomena such as chemotaxis, ion transport, self-gravitating particles, and Brownian vortices. Existing methods struggle with the strong coupling and high nonlinearity and nonlocality of some of these systems, especially the ill-conditioned, convection-dominated problems. To overcome numerical difficulties, current approaches rely on initial guesses, preconditioning, or iterative techniques with no convergence guarantees. They might suffer from poor scalability, large memory usage, and difficulty to parallelize. Inspired by the connection of parabolic-elliptic systems to stochastic processes, we introduce a novel meshless, monolithic, and fully explicit method that naturally encapsulates the elliptic and parabolic operators into a single step which updates each node deterministically with global information. By being fully quadrature-based, it avoids solving systems of discretized equations and does not utilize initial guesses or preconditioning, while requiring little memory and being easy to parallelize. We first derive the method in an integral kernel formulation with quadratic complexity in the number of integration nodes and then leverage kernel-independent fast multipole methods (FMM) to present a scalable algorithm with linear complexity. We provide numerical examples for the Poisson-Nernst-Planck equations in one, two, and three dimensions, together with the derivation of the integral kernel for each case. Furthermore, the examples demonstrate the fast convergence and scalability of the FMM-accelerated algorithm, as well as its suitability for convection-dominated problems, making it competitive against traditional PDE solvers.

PDE systems↗

Tensor decompositions for count data that leverage stochastic and deterministic optimization

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank, nonnegative CPD model to Poisson-distributed count data is of particular interest. Several popular algorithms use local search methods to approximate the maximum likelihood estimator (MLE) of the Poisson CPD model. Here, this work presents two new algorithms that extend state-of-the-art local methods for Poisson CPD. Hybrid GCP-CPAPR combines Generalized Canonical Decomposition (GCP) with stochastic optimization and CP Alternating Poisson Regression (CPAPR), a deterministic algorithm, to increase the probability of converging to the MLE over either method used alone. Restarted CPAPR with SVDrop uses a heuristic based on the singular values of the CPD model unfoldings to identify convergence toward optimizers that are not the MLE and restarts within the feasible domain of the optimization problem, thus reducing overall computational cost when using a multi-start strategy. We provide empirical evidence that indicates our approaches outperform existing methods with respect to converging to the Poisson CPD MLE.

CPAPR↗

An 'adding' algorithm for the Markov chain formalism for radiation transfer

An adding algorithm is presented, that extends the Markov chain method and considers a preceding calculation as a single state of a new Markov chain. This method takes advantage of the description of the radiation transport as a stochastic process. Successive application of this procedure makes calculation possible for any optical depth without increasing the size of the linear system used. It is determined that the time required for the algorithm is comparable to that for a doubling calculation for homogeneous atmospheres. For an inhomogeneous atmosphere the new method is considerably faster than the standard adding routine. It is concluded that the algorithm is efficient, accurate, and suitable for smaller computers in calculating the diffuse intensity scattered by an inhomogeneous planetary atmosphere.

Esposito, L. W.↗

Linearized Frequency-Domain Gust Analysis and Adjoint-Based Sensitivities

Gust analysis is added to a linearized frequency-domain method in FUN3D, a NASA computational fluid dynamics solver. The method linearizes about a nonlinear static equilibrium condition and is therefore appropriate for problems with small perturbations such as transonic stochastic gust analysis. In addition to the gust analysis, adjoint-based sensitivities of stochastic gust constraints are implemented for multidisciplinary design optimization. The linearized frequency-domain gust model and adjoint-based sensitivities are described and verified. The method is applied to an optimization for mass minimization of the AGARD 445.6 wing subject to a stochastic gust constraint limiting the displacement of the wing tip.

Aeroelasticity↗

Galaxy Correlation Function and Local Density from Photometric Redshifts Using the Stochastic Order Redshift Technique (SORT)

The stochastic order redshift technique (SORT) is a simple, efficient, and robust method to improve cosmological redshift measurements. The method relies upon having a small (∼10 per cent) reference sample of high-quality redshifts. Within pencil- beam-like sub-volumes surrounding each galaxy, we use the precise dN/dz distribution of the reference sample to recover new redshifts and assign them one-to-one to galaxies such that the original rank order of redshifts is preserved. Preserving the rank order is motivated by the fact that random variables drawn from Gaussian probability density functions with different means but equal standard deviations satisfy stochastic ordering. This process is repeated for sub-volumes surrounding each galaxy in the survey. This results in every galaxy being assigned multiple ‘recovered’ redshifts from which a new redshift estimate is determined. An earlier paper applied SORT to a mock Sloan Digital Sky Survey at z 0.2 and accurately recovered the two-point correlation function (2PCF) on scales > 4 h−1Mpc. In this paper, we test the performance of SORT in surveys spanning the redshift range 0.75 < z < 2.25. We used two mock surveys extracted from the Small MultiDark–Planck and Bolshoi–Planck N-body simulations with dark matter haloes that were populated by the Santa Cruz semi-analytic model. We find that SORT overall improves redshift estimates, accurately recovers the redshift-space 2PCF ξ (s) on scales > 2.5 h−1Mpc, and provides improved local density estimates in regions of average or higher density, which may allow for improved understanding of how galaxy properties relate to their environments.

James Kakos↗

Stochastic Modelling of Wireless Energy Transfer

This study investigates the efficiency of a new method of powering remote sensors by the means of wireless energy transfer. The increased use of sensors for data collection comes with the inherent cost of supplying power from sources such as power cables or batteries. Wireless energy transfer technology eliminates the need for power cables or periodic battery replacement. The time and cost of setting up or expanding a sensor network will be reduced while allowing sensors to be placed in areas where running power cables or battery replacement is not feasible. This paper models wireless channels for power and data separately. Smart scheduling for the data channel is proposed to avoid transmitting data on a noisy channel where the probability of data loss is high to improve power efficiency. Analytical models have been developed and verified using simulations.

Veilleux, Shaun↗

The Effect of Stochastic Perturbation of Fuel Distribution on the Criticality of a One Speed Reactor and the Development of Multi-Material Multinomial Line Statistics

The effect of random fuel redistribution on the eigenvalue of a one-speed reactor is investigated. An ensemble of such reactors that are identical to a homogeneous reference critical reactor except for the fissile isotope density distribution is constructed such that it meets a set of well-posed redistribution requirements. The average eigenvalue, , is evaluated when the total fissile loading per ensemble element, or realization, is conserved. The perturbation is proven to increase the reactor criticality on average when it is uniformly distributed. The various causes of the change in reactivity, and their relative effects are identified and ranked. From this, a path towards identifying the causes. and relative effects of reactivity fluctuations for the energy dependent problem is pointed to. The perturbation method of using multinomial distributions for representing the perturbed reactor is developed. This method has some advantages that can be of use in other stochastic problems. Finally, some of the features of this perturbation problem are related to other techniques that have been used for addressing similar problems.

Jahshan, S. N.↗

Generative AI models for learning flow maps of stochastic dynamical systems in bounded domains

Simulating stochastic differential equations (SDEs) in bounded domains, presents significant computational challenges due to particle exit phenomena, which requires accurate modeling of interior stochastic dynamics and boundary interactions. Despite the success of machine learning-based methods in learning SDEs, existing learning methods are not applicable to SDEs in bounded domains because they cannot accurately capture the particle exit dynamics. We present a unified hybrid data-driven approach that combines a conditional diffusion model with an exit prediction neural network to capture both interior stochastic dynamics and boundary exit phenomena. Our ML model consists of two major components: a neural network that learns exit probabilities using binary cross-entropy loss with rigorous convergence guarantees, and a training-free diffusion model that generates state transitions for non-exiting particles using closed-form score functions. The two components are integrated through a probabilistic sampling algorithm that determines particle exit at each time step and generates appropriate state transitions. Here, the performance of the proposed approach is demonstrated via three test cases: a one-dimensional simplified problem for theoretical verification, a two-dimensional advection-diffusion problem in a bounded domain, and a three-dimensional problem of interest to magnetically confined fusion plasmas.

Bounded domains↗

Implicit dual control for general stochastic systems

A new implicit dual technique is presented for stochastic adaptive control synthesis. In this technique, denoted as the method of utility costs (MOUC), a new control policy is derived from a known starting control policy by using a single iteration in time-varying policy space. An important result is that the new control policy yields a corresponding improvement in adaptive performance relative to the known starting policy. Since the starting policy can be chosen arbitrarily, the new policy has potentially superior performance relative to any existing design. Unlike other implicit dual designs, the MOUC can be applied to systems having constrained inputs, discontinuities, discrete valued disturbances, as well as in situations where the variances of the associated process statistics are large. A numerical example is given in which a controller is synthesized to provide improved performance relative to the Open-Loop Feedback policy of Dreyfus.

Bayard, D. S.↗

Estimation of Kalman filter gain from output residuals

This paper presents a procedure to estimate the Kalman filter gain from input-output measurement data with a given system model. The system model can be a finite element model or an experimental model from any identification method. The procedure consists of three basic steps. First, the stochastic portion related to the residuals of the response is computed. Second, the coefficients of a linear difference model for the stochastic portion are estimated by a least-squares solution that minimizes the filter residual. Third, the Kalman filter gain is computed from these model coefficients. Experimental results are presented to illustrate the usefulness of the developed procedure.

Juang, Jer-Nan↗

3D Lunar Terrain Reconstruction from Apollo Images

Generating accurate three dimensional planetary models is becoming increasingly important as NASA plans manned missions to return to the Moon in the next decade. This paper describes a 3D surface reconstruction system called the Ames Stereo Pipeline that is designed to produce such models automatically by processing orbital stereo imagery. We discuss two important core aspects of this system: (1) refinement of satellite station positions and pose estimates through least squares bundle adjustment; and (2) a stochastic plane fitting algorithm that generalizes the Lucas-Kanade method for optimal matching between stereo pair images.. These techniques allow us to automatically produce seamless, highly accurate digital elevation models from multiple stereo image pairs while significantly reducing the influence of image noise. Our technique is demonstrated on a set of 71 high resolution scanned images from the Apollo 15 mission

Broxton, Michael J.↗

Sizing and Topology Design of an Aeroelastic Wingbox Under Uncertainty

The goals of this work are to use a nested optimizer to conduct simultaneous sizing (inner level) and topology (outer level) design of a wingbox, considering uncertainties in the safety factors used to define the aeroelastic constraints. These uncertainties, propagated via sampling-driven polynomial chaos, are explicitly introduced at the inner level of the method, during gradient-based sizing optimization, resulting in a stochastic optimal sizing distribution. Measures of robustness in the total structural mass are then passed to the outer level, where a global optimizer evolves the topology parameters. The results demonstrate design choices needed to improve robustness in the face of uncertain safety factors, and the various physical mechanisms driving this process.

Stanford, Bret K.↗

Bias-Variance Trade-Off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs

Physics-Informed Neural Networks (PINNs) have triggered a paradigm shift in scientific computing, leveraging mesh-free properties and robust approximation capabilities. While proving effective for low-dimensional partial differential equations (PDEs), the computational cost of PINNs remains a hurdle in high-dimensional scenarios. This is particularly pronounced when computing high-order and high-dimensional derivatives in the physics-informed loss. Randomized Smoothing PINN (RS-PINN) introduces Gaussian noise for stochastic smoothing of the original neural net model, enabling the use of Monte Carlo methods for derivative approximation, which eliminates the need for costly automatic differentiation. Despite its computational efficiency, especially in the approximation of high-dimensional derivatives, RS-PINN introduces biases in both loss and gradients, negatively impacting convergence, especially when coupled with stochastic gradient descent (SGD) algorithms. We present a comprehensive analysis of biases in RS-PINN, attributing them to the nonlinearity of the Mean Squared Error (MSE) loss as well as the intrinsic nonlinearity of the PDE itself. We propose tailored bias correction techniques, delineating their application based on the order of PDE nonlinearity. The derivation of an unbiased RS-PINN allows for a detailed examination of its advantages and disadvantages compared to the biased version. Specifically, the biased version has a lower variance and runs faster than the unbiased version, but it is less accurate due to the bias. To optimize the bias-variance trade-off, we combine the two approaches in a hybrid method that balances the rapid convergence of the biased version with the high accuracy of the unbiased version. In addition to methodological contributions, we present an enhanced implementation of RS-PINN. Extensive experiments on diverse high-dimensional PDEs, including Fokker-Planck, Hamilton-Jacobi-Bellman (HJB), viscous Burgers’, Allen-Cahn, and Sine-Gordon equations, illustrate the bias-variance trade-off and highlight the effectiveness of the hybrid RS-PINN. Empirical guidelines are provided for selecting biased, unbiased, or hybrid versions, depending on the dimensionality and nonlinearity of the specific PDE problem.

97 MATHEMATICS AND COMPUTING↗

Stochastic solution to quantum dynamics

The quantum Liouville equation in the Wigner representation is solved numerically by using Monte Carlo methods. For incremental time steps, the propagation is implemented as a classical evolution in phase space modified by a quantum correction. The correction, which is a momentum jump function, is simulated in the quasi-classical approximation via a stochastic process. The technique, which is developed and validated in two- and three- dimensional momentum space, extends an earlier one-dimensional work. Also, by developing a new algorithm, the application to bound state motion in an anharmonic quartic potential shows better agreement with exact solutions in two-dimensional phase space.

John, Sarah↗

Interpreting experimental measurements of helium bubbles using stochastic cluster dynamics models of heterogeneous nucleation and growth in irradiated ferritic alloys

Among a number of other advantageous features, ferritic/martensitic steels are being considered as fusion reactor structural materials due to their low intrinsic swelling under irradiation. However, under high-energy neutron irradiation, He produced through (n, α) reactions stabilizes vacancy clusters, which then act as seeds for bubble formation and growth, negating the intrinsic swelling resistance of these alloys. Standard models of irradiation damage accumulation and microstructural evolution consider homogeneous nucleation as the basis for bubble formation and growth. However, this generally does not explain the large bubble densities and sizes observed experimentally under a number of different conditions. Here, we propose a more realistic physical model of bubble nucleation, formation, and growth designed to capture recent experimental measurements of He-bubble formation and evolution during co-implantation of He and Fe ions in model ferritic alloys. We find that experimental results are explained only when the following three features are considered simultaneously: (i) heterogeneous nucleation of He-vacancy bubbles at defect sinks (e.g., dislocations, grain boundaries, and second-phase precipitates), (ii) nucleation and growth of bubbles via the ‘trap mutation’ mechanism (i.e., spontaneous production of Frenkel pairs due to absorption of He atoms), and (iii) transition from a growth-limited, He-stabilized bubble regime to a ‘runaway’ void-type growth scenario. The model is implemented into a stochastic cluster dynamics framework that takes advantage of cluster size grouping methods to accelerate the simulations, allowing us to reach 10 dpa of simulated irradiated dose, and to capture cluster sizes in excess of 20 nm. Further, a careful extrapolation exercise conducted assuming classical nucleation theory leads to excellent agreement with the experimental measurements at 50 dpa of irradiation.

36 MATERIALS SCIENCE↗

Probability Density Function Control of Frequency Fluctuations in Renewable-Rich Power Systems

The stochastic nature of renewable energy sources (RESs) necessitates treating power system frequency response as a random process with a nonstationary probability density function (PDF). Here, based upon the stochastic distribution control theory originated by the second author, this paper proposes a novel stochastic controller to improve the frequency PDF in power grids when integrating a large amount of RESs, thereby minimizing the effects of uncertainties and enhancing overall system stability. The key idea is to manipulate the controllable power generation resources so that the frequency PDF is make to follow a target PDF by using the stochastic distribution control theory originated by the second author. The proposed method can easily be plugged into existing automatic generation controls for multi-area transmission grids. The proposed method is validated via a modified Kundar's two area system and 240-bus Western Electricity Coordinating Council systems. The simulation results show that the proposed control shapes the frequency PDF narrower and sharper, leading to a notable improvement toward minimizing the effects of randomness and uncertainty during grid operation.

frequency↗