Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic approximation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Entanglement dynamics of nonidentical oscillators under decohering environments

We study the evolution of entanglement for a pair of coupled nonidentical harmonic oscillators in contact with an environment. For both cases of a common bath and of two separate baths for each of the oscillators, a full master equation is provided without rotating-wave approximation. The entanglement dynamics is analyzed as a function of the diversity between the oscillators' frequencies and their positive or negative mutual coupling and also the correlation between the occupation numbers. The singular effect of the resonance condition (identical oscillators) and its relationship with the possibility of preserving asymptotic entanglement are discussed. The importance of the bath's memory properties is investigated by comparing Markovian and non-Markovian evolutions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Dynamics and quantum Zeno effect for a qubit in either a low- or high-frequency bath beyond the rotating-wave approximation

We use a non-Markovian approach to study the decoherence dynamics of a qubit in either a low- or high-frequency bath modeling the qubit environment. This is done for two separate cases: either with measurements or without them. This approach is based on a unitary transformation and does not require the rotating-wave approximation. In the case without measurement, we show that, for low-frequency noise, the bath shifts the qubit energy toward higher energies (blue shift), while the ordinary high-frequency cutoff Ohmic bath shifts the qubit energy toward lower energies (red shift). In order to preserve the coherence of the qubit, we also investigate the dynamics of the qubit subject to measurements (quantum Zeno regime) in two cases: low- and high-frequency baths. For very frequent projective measurements, the low-frequency bath gives rise to the quantum anti-Zeno effect on the qubit. The quantum Zeno effect only occurs in the high-frequency-cutoff Ohmic bath, after counterrotating terms are considered. In the condition that the decay rate due to the two kinds of baths are equal under the Wigner-Weisskopf approximation, we find that without the approximation, for a high-frequency environment, the decay rate should be faster (without measurements) or slower (with frequent measurements, in the Zeno regime), compared to the low-frequency bath case. The experimental implementation of our results here could distinguish the type of bath (either a low- or high-frequency one) and protect the coherence of the qubit by modulating the dominant frequency of its environment.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Excitation energy transfer: Study with non-Markovian dynamics

In this paper, we investigate the non-Markovian dynamics of a model to mimic the excitation energy transfer (EET) between chromophores in photosynthesis systems. The numerical path integral method is used. This method includes the non-Markovian effects of the environmental affects, and it does not need the perturbation approximation in solving the dynamics of systems of interest. It implies that the coherence helps the EET between chromophores through lasting the transfer time rather than enhancing the transfer rate of the EET. In particular, the non-Markovian environment greatly increases the efficiency of the EET in the photosynthesis systems.

74 ATOMIC AND MOLECULAR PHYSICS↗

An Uncertainty Analysis of the Hydrogen Source Term for a Station Blackout Accident in Sequoyah Using MELCOR 1.8.5

A methodology for using the MELCOR code with the Latin Hypercube Sampling method was developed to estimate uncertainty in various predicted quantities such as hydrogen generation or release of fission products under severe accident conditions. In this case, the emphasis was on estimating the range of hydrogen sources in station blackout conditions in the Sequoyah Ice Condenser plant, taking into account uncertainties in the modeled physics known to affect hydrogen generation. The method uses user-specified likelihood distributions for uncertain model parameters, which may include uncertainties of a stochastic nature, to produce a collection of code calculations, or realizations, characterizing the range of possible outcomes. Forty MELCOR code realizations of Sequoyah were conducted that included 10 uncertain parameters, producing a range of in-vessel hydrogen quantities. The range of total hydrogen produced was approximately 583kg ± 131kg. Sensitivity analyses revealed expected trends with respected to the parameters of greatest importance, however, considerable scatter in results when plotted against any of the uncertain parameters was observed, with no parameter manifesting dominant effects on hydrogen generation. It is concluded that, with respect to the physics parameters investigated, in order to further reduce predicted hydrogen uncertainty, it would be necessary to reduce all physics parameter uncertainties similarly, bearing in mind that some parameters are inherently uncertain within a range. It is suspected that some residual uncertainty associated with modeling complex, coupled and synergistic phenomena, is an inherent aspect of complex systems and cannot be reduced to point value estimates. The probabilistic analyses such as the one demonstrated in this work are important to properly characterize response of complex systems such as severe accident progression in nuclear power plants.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Effect of Dust Coagulation Dynamics on the Geometry of Aggregates

Master equation gives a more fundamental description of stochastic coagulation processes rather than popular Smoluchowski's equation. In order to examine the effect of the dynamics on the geometry of resulting aggregates, we study Master equation with a rigorous Monte Carlo algorithm. It is found that Cluster-Cluster aggregation model is a good approximation of orderly growth and the aggregates have fluffy structures with a fractal dimension approx. 2. A scaling analysis of Smoluchowski's equation also supports this conclusion.

Nakamura, R.↗

First Test of Stochastic Growth Theory for Langmuir Waves in Earth's Foreshock

This paper presents the first test of whether stochastic growth theory (SGT) can explain the detailed characteristics of Langmuir-like waves in Earth's foreshock. A period with unusually constant solar wind magnetic field is analyzed. The observed distributions P(logE) of wave fields E for two intervals with relatively constant spacecraft location (DIFF) are shown to agree well with the fundamental prediction of SGT, that P(logE) is Gaussian in log E. This stochastic growth can be accounted for semi-quantitatively in terms of standard foreshock beam parameters and a model developed for interplanetary type III bursts. Averaged over the entire period with large variations in DIFF, the P(logE) distribution is a power-law with index approximately -1; this is interpreted in terms of convolution of intrinsic, spatially varying P(logE) distributions with a probability function describing ISEE's residence time at a given DIFF. Wave data from this interval thus provide good observational evidence that SGT can sometimes explain the clumping, burstiness, persistence, and highly variable fields of the foreshock Langmuir-like waves.

Cairns, Iver H.↗

Comparison of the secondary electrons produced by proton and electron beams in water

The secondary electrons produced in water by electron and proton beams are compared with each other. The total ionization cross section (TICS) for an electron impact in water is obtained by using the binary-encounter-Bethe model. Hence, an empirical equation based on two adjustable fitting parameters is presented to determine the TICS for proton impact in media. In order to calculate the projectile trajectory, a set of stochastic differential equations based on the inelastic collision, elastic scattering, and bremsstrahlung emission are used. In accordance with the projectile trajectory, the depth dose deposition, electron energy loss distribution in a certain depth, and secondary electrons produced in water are calculated. The obtained results for the depth dose deposition and energy loss distribution in certain depth for electron and proton beams with various incident energies in media are in excellent agreement with the reported experimental data. The difference between the profiles for the depth dose deposition and production of secondary electrons for a proton beam can be ignored approximately. But, these profiles for an electron beam are completely different due to the effect of elastic scattering on electron trajectory.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Calculating uncertainty on K-effective with MONK10 - 14583

Criticality safety assessments require a demonstration that a particular configuration of fissile material has an adequate sub-critical margin (k-effective sufficiently below unity) to ensure that the risk of criticality under normal operation and accident conditions is acceptable. The required sub-critical margin depends upon the uncertainty in the estimated value of k-effective. The uncertainty in the calculated value of k-effective arises from a number of sources, including: manufacturing tolerances on input data to the code (affecting geometry, compositions and densities), uncertainty in the nuclear data used by the code, stochastic uncertainty resulting from Monte Carlo simulation and modelling approximations/errors, including the inevitable bugs in the software. The ANSWERS Software Service, in collaboration with industrial partners, is developing a number of techniques to better understand and quantify uncertainty on predicted values of k-effective, using MONK. The SPRUCE utility code has been developed to allow uncertainty to be estimated using sampling methods. This can include the sampling of input parameters (including dimensions, compositions and densities) from statistical distributions. It can also include sampling different nuclear data libraries. A set of nuclear data libraries has been generated for this purpose by sampling from statistical distributions that represent the uncertainties in the published nuclear data evaluated files; a set of libraries has been produced for Latin Hypercube Sampling. By varying the input data and nuclear data, separate and combined uncertainties due to manufacturing tolerances and nuclear data can be derived. By performing least squares fitting on the results it is also possible to estimate the contribution of each of the uncertain inputs and a sensitivity method in MONK can break down the nuclear data uncertainty. (authors)

42 ENGINEERING↗

A Data-Driven Methodology for Contextual Unit Commitment Using Regression Residuals

Day after day, system operators are faced with the challenge of taking unit commitment (UC) decisions under uncertain net load conditions. The standard operating procedure for taking UC decisions begins by leveraging auxiliary data on covariates (such as the day of the week or latest weather information) to generate a point prediction for net load, which is used in solving a deterministic UC problem. Such an approach, however, is known to deliver a notoriously poor out-of-sample (OOS) performance, as it completely disregards the stochastic nature of net load. While stochastic programming models explicitly represent uncertainty, they mostly do so using a generic set of scenarios that neglect covariate observations, squandering useful auxiliary data that could be harnessed to glean insights into uncertainty. In this article, we discuss a contextual stochastic optimization approach to UC, which effectively exploits covariate observations while explicitly assessing uncertainty so as to boost the OOS performance of UC decisions. The key thrust of our approach is to leverage regression models, along with their empirical residuals, to set up and solve sample average approximation problems. Not only do we prove that our approach satisfies the requisite conditions for asymptotic optimality and consistency laid out in (Kannan et al., 2022), but we also assess its performance on several case studies conducted using real-world data collected in California ISO and New York ISO grids. In conclusion, results show that the proposed approach can significantly improve OOS performance compared to alternative methods proposed in the literature under varying dataset sizes.

Yurdakul, Ogun↗

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗

Navigation capability for an ion drive rendezvous with Halley's Comet

An analysis has been conducted in connection with plans for a study of Halley's Comet during its 1986 apparition. The use of low-thrust vehicles, utilizing an ion drive system, is being considered for a comet rendezvous mission. A preliminary trajectory for the Halley rendezvous mission calls for launch on June 20, 1982, followed by rendezvous on December 21, 1985. The navigation analysis described focuses on the terminal approach to Halley, the 60-day period preceding rendezvous. Navigation analysis assumptions are examined, taking into account navigation error sources, radio tracking, onboard optical data, earth-based comet observations, and orbit determination and guidance strategies. The preliminary mission design considers a rendezvous at approximately 56,000 km from the comet nucleus (6,000 km outside the dust envelope). Navigation performance is measured in terms of comet-relative position and velocity errors at encounter. Variations to the baseline navigation study provide illustrations concerning the close link between delivery accuracy and stochastic thrust errors.

Thornton, C. L.↗

Time and Measurement Days

Questions in data analysis involving the concepts of time and measurement are often pushed into the background or reserved for a philosophical discussion. Some examples are: a) Is causality a consequence of the laws of physics, or can the arrow of time be reversed? b) Can we determine the arrow of time of an event? c) Do we need the continuum hypothesis for the underlying function in any measurement process? d) Can we say anything about the analyticity of the underlying process of an event? e) Would it be valid to model a non-analytical process as function of time? f) What are the implications of all these questions for classical Fourier techniques? However, in the age of big data gathered either from space missions supplying ultra-precise long time series, or e.g. LIGO data from the ground, the moment to bring these questions to the foreground seems arrived. The limitations of our understanding of some fundamental processes is emphasized by the lack of solution for problems open for more than 2 decades, such as the non-detection of solar g-modes, or the modal identification of main sequence stellar pulsators like delta Scuti stars. Flicker noise or 1/f noise, for example, attributed in solar-like stars to granulation, is analyzed mostly only to apply noise reduction techniques, neither considering the classical problem of 1/f noise that was introduced a 100 years ago, nor taking into account ergodic or non-ergodic solutions that make inapplicable spectral analysis techniques in practice. This topic was discussed by Nicholas W. Watkins during the ITISE meeting held in Granada in 2016. There he presented preliminary results of his research on Mandelbrot's related work. We reproduce here his quotation of Mandelbrot (1999) "There is a sharp contrast between a highly anomalous ("non-white") noise that proceeds in ordinary clock time and a noise whose principal anomaly is that it is restricted to fractal time", suggesting a connection with the above proposed topics that could be phrased as the following additional questions:a) Is self-organized criticality (SOC) frequent in astrophysical phenomena? b) Could all fractals in nature be considered stochastic? c) Could we establish mathematical/physical relationships between chaotic and fractal behaviors in time series? d) Could the differences between fractals and chaos in terms of analyticity be used to understand the residuals of the fitting of stellar light curves? In this meeting we would like to approximate these problems from a holistic and multidisciplinary perspective, taking into account not only technical issues but also the deeper implications. In particular the concept of connectivity (introduced in Pascual-Granado et al. A&A, 2015) could be used to implement, within the framework of ARMA processes, an "arrow of time" (see attached document), and so studying the possible implications in the concept of time as envisaged by Watkins.

data analysis↗

The theory of stochastic cosmological lensing

On the scale of the light beams subtended by small sources, e.g. supernovae, matter cannot be accurately described as a fluid, which questions the applicability of standard cosmic lensing to those cases. In this article, we propose a new formalism to deal with small-scale lensing as a diffusion process: the Sachs and Jacobi equations governing the propagation of narrow light beams are treated as Langevin equations. We derive the associated Fokker-Planck-Kolmogorov equations, and use them to deduce general analytical results on the mean and dispersion of the angular distance. This formalism is applied to random Einstein-Straus Swiss-cheese models, allowing us to: (1) show an explicit example of the involved calculations; (2) check the validity of the method against both ray-tracing simulations and direct numerical integration of the Langevin equation. As a byproduct, we obtain a post-Kantowski-Dyer-Roeder approximation, accounting for the effect of tidal distortions on the angular distance, in excellent agreement with numerical results. Besides, the dispersion of the angular distance is correctly reproduced in some regimes.

79 ASTRONOMY AND ASTROPHYSICS↗

Model reduction for stochastic chemical systems with abundant species

Biochemical processes typically involve many chemical species, some in abundance and some in low molecule numbers. We first identify the rate constant limits under which the concentrations of a given set of species will tend to infinity (the abundant species) while the concentrations of all other species remains constant (the non-abundant species). Subsequently, we prove that, in this limit, the fluctuations in the molecule numbers of non-abundant species are accurately described by a hybrid stochastic description consisting of a chemical master equation coupled to deterministic rate equations. This is a reduced description when compared to the conventional chemical master equation which describes the fluctuations in both abundant and non-abundant species. We show that the reduced master equation can be solved exactly for a number of biochemical networks involving gene expression and enzyme catalysis, whose conventional chemical master equation description is analytically impenetrable. We use the linear noise approximation to obtain approximate expressions for the difference between the variance of fluctuations in the non-abundant species as predicted by the hybrid approach and by the conventional chemical master equation. Furthermore, we show that surprisingly, irrespective of any separation in the mean molecule numbers of various species, the conventional and hybrid master equations exactly agree for a class of chemical systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A test of gravity with Pulsar Timing Arrays

Abstract A successful measurement of the Stochastic Gravitational Wave Background (SGWB) in Pulsar Timing Arrays (PTAs) would open up a new window through which to test the predictions of General Relativity (GR). We consider how these measurements might reveal deviations from GR by studying the overlap reduction function — the quantity that in GR is approximated by the Hellings-Downs curve — in some sample modifications of gravity, focusing on the generic prediction of a modified dispersion relation for gravitational waves. We find a distinct signature of such modifications to GR — a shift in the minimum angle of the angular distribution — and demonstrate that this shift is quantitatively sensitive to any change in the phase velocity. In a given modification of gravity, this result can be used, in some regions of parameter space, to distinguish the effect of a modified dispersion relation from that due to the presence of extra polarization modes.

Astronomy & Astrophysics↗

Final Report. Analysis and Reduction of Complex Networks Under Uncertainty

The project was a collaborative effort among MIT, Sandia National Laboratories (local PI Dr. Habib Najm), the University of Southern California (local PI Prof. Roger Ghanem), and The Johns Hopkins University (local PI Prof. Omar Knio, now at Duke University). Our focus was the analysis and reduction of large-scale dynamical systems emerging from networks of interacting components. Such networks underlie myriad natural and engineered systems. Examples important to DOE include chemical models of energy conversion processes, and elements of national infrastructure—e.g., electric power grids. Time scales in chemical systems span orders of magnitude, while infrastructure networks feature both local and long-distance connectivity, with associated clusters of time scales. These systems also blend continuous and discrete behavior; examples include saturation phenomena in surface chemistry and catalysis, and switching in electrical networks. Reducing size and stiffness is essential to tractable and predictive simulation of these systems. Computational singular perturbation (CSP) has been effectively used to identify and decouple dynamics at disparate time scales in chemical systems, allowing reduction of model complexity and stiffness. In realistic settings, however, model reduction must contend with uncertainties, which are often greatest in large-scale systems most in need of reduction. Uncertainty is not limited to parameters; one must also address structural uncertainties—e.g., whether a link is present in a network—and the impact of random perturbations, e.g., fluctuating loads or sources. Research under this project developed new methods for the analysis and reduction of complex multiscale networks under uncertainty, by combining computational singular perturbation (CSP) with probabilistic uncertainty quantification. CSP yields asymptotic approximations of reduceddimensionality “slow manifolds” on which a multiscale dynamical system evolves. Introducing uncertainty in this context raised fundamentally new issues, e.g., how is the topology of slow manifolds transformed by parametric uncertainty? How to construct dynamical models on these uncertain manifolds? To address these questions, we used stochastic spectral polynomial chaos (PC) methods to reformulate uncertain network models and analyzed them using CSP in probabilistic terms. Finding uncertain manifolds involved the solution of stochastic eigenvalue problems, facilitated by projection onto PC bases. These problems motivated us to explore the spectral properties stochastic Galerkin systems. We also introduced novel methods for rank-reduction in stochastic eigensystems—transformations of a uncertain dynamical system that lead to lower storage and solution complexity. These technical accomplishments are detailed below. This report focuses on the MIT portion of the joint project.

97 MATHEMATICS AND COMPUTING↗

Modeling Streamflow and Sediment Transport Under Current and Future Climates at the West Valley Site - 20231

Performance Assessment models often require inputs representing specific hydrologic processes such as streamflow and sediment flux. This paper details the development of a process-level hydrologic model and its use in a Probabilistic Performance Assessment (PPA) system-level model for the West Valley Site in western New York. For this PPA model, a watershed model was developed using SWAT (Soil and Water Assessment Tool) and used to evaluate water and sediment fluxes in nearby streams draining the Site. A particular challenge of probabilistic modeling over long periods of time is scaling parameters appropriately so that outcomes are not grossly over- or underestimated. This challenge is especially important when the spatial and temporal scales of process and system level models differ. In this instance, the SWAT watershed model and GoldSim PPA model have similar spatial scales of stream reaches and sub-catchments within a single watershed (approximately hundreds to tens of thousands of square meters, but the temporal scales differ considerably. The SWAT model calculates streamflow and sediment transport rates at the daily scale, while the PPA model requires long-term average values that are applied over hundreds to thousands of year-long periods. As such, distributions of daily climatic parameters such as average precipitation rate, temperature, wind speed, and relative humidity were developed to force a transient SWAT model that captures the dynamic behavior of the watershed in response to daily changes in the weather. Output from the model, which includes stream flow (m{sup 3}/y) and sediment transport rate (Mg/y) is then averaged over a 100-year period as an approximation for the long-term average values which can be applied in GoldSim. A single SWAT model was run 5000 times with varying climatic inputs and deterministic soil, land use, and elevation data, and the range of outputs were compiled into a distribution which can be implemented stochastically into the PPA Model. Additionally, this paper includes a high-level discussion of how changes in future climate affect weather input distributions, and a summary of how those changes in weather affect the outcomes from the SWAT model and the inputs into the PPA model. In this analysis, future climate distributions were developed based on climate research documenting the expected changes to precipitation and temperature in western New York. The 5,000 SWAT simulations were then repeated with these future climate distributions, and the resulting output was implemented into the PPA Model as hydrologic conditions under a future climate. In the current version of the PPA Model, hydrologic parameters change linearly from the 'current climate' conditions to the 'future climate' conditions over a period of 100 years, after which they remain constant. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Learning the temporal evolution of multivariate densities via normalizing flows

In this work, we propose a method to learn multivariate probability distributions using sample path data from stochastic differential equations. Specifically, we consider temporally evolving probability distributions (e.g., those produced by integrating local or nonlocal Fokker–Planck equations). Here, we analyze this evolution through machine learning assisted construction of a time-dependent mapping that takes a reference distribution (say, a Gaussian) to each and every instance of our evolving distribution. If the reference distribution is the initial condition of a Fokker–Planck equation, what we learn is the time-T map of the corresponding solution. Specifically, the learned map is a multivariate normalizing flow that deforms the support of the reference density to the support of each and every density snapshot in time. We demonstrate that this approach can approximate probability density function evolutions in time from observed sampled data for systems driven by both Brownian and Lévy noise. We present examples with two- and three-dimensional, uni- and multimodal distributions to validate the method.

97 MATHEMATICS AND COMPUTING↗