Search NASA⌕ Search

SEARCH · Search NASA

Results for “Metropolis algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Using the Metropolis algorithm to explore the loss surface of a recurrent neural network

In the limit of small trial moves the Metropolis Monte Carlo algorithm is equivalent to gradient descent on the energy function in the presence of Gaussian white noise. This observation was originally used to demonstrate a correspondence between Metropolis Monte Carlo moves of model molecules and overdamped Langevin dynamics, but it also applies in the context of training a neural network: making small random changes to the weights of a neural network, accepted with the Metropolis probability, with the loss function playing the role of energy, has the same effect as training by explicit gradient descent in the presence of Gaussian white noise. We explore this correspondence in the context of a simple recurrent neural network. We also explore regimes in which this correspondence breaks down, where the gradient of the loss function becomes very large or small. In these regimes the Metropolis algorithm can still effect training, and so can be used as a probe of the loss function of a neural network in regimes in which gradient descent struggles. We also show that training can be accelerated by making purposely-designed Monte Carlo trial moves of neural-network weights.

Casert, Corneel↗

Stochastic relativistic viscous hydrodynamics from the Metropolis algorithm

We propose an algorithm for simulating stochastic relativistic fluid dynamics based on Metropolis updates. Each step of the algorithm begins with an update based on ideal hydrodynamics. This is followed by proposing random (spatial) momentum transfers between fluid cells, keeping the total energy fixed. These proposals are then accepted or rejected using the change in entropy as a statistical weight. The algorithm reproduces relativistic viscous hydrodynamics in the “density frame,” which is a formulation of viscous hydrodynamics we review and clarify here. This formulation is first order in time and requires no auxiliary dynamical fields such as Π 𝜇⁢𝜈 . The only parameters are the shear and bulk viscosities and the equation of state. Here, by adopting the 3+1 split of general relativity, we extend the Metropolis algorithm to general space-time coordinates, such as Bjorken coordinates, which are commonly used to simulate heavy-ion collisions.

Hydrodynamic noise↗

Automatic Step Size Selection in Random Walk Metropolis Algorithms

Practitioners of Markov chain Monte Carlo (MCMC) may hesitate to use random walk Metropolis- Hastings algorithms, especially variable-at-a-time algorithms with many parameters, because these algorithms require users to select values of tuning parameters (step sizes). These algorithms perform poorly if the step sizes are set to be too low or too high. We show in this paper that it is not difficult for an algorithm to tune these step sizes automatically to obtain a desired acceptance probability, since the logit of the acceptance probability is very nearly linear in the log of the step size, with known slope coefficient. These ideas work in most applications, including single parameter or block moves on the linear, log, or logit scales. We discuss the implementation of this algorithm in the software package YADAS.

97 MATHEMATICS AND COMPUTING↗

MODELING OF THE INITIAL MASS FUNCTION USING THE METROPOLIS-HASTINGS ALGORITHM

A stochastic model has been developed for the hierarchical fragmentation of a molecular cloud. Here, the number of fragments, time between successive fragmentation steps, and mass of a fragment are considered as random variables, and fragment masses are generated using the Metropolis-Hastings algorithm. The resulting mass spectra, computed at different projected distances and taking opacity into consideration, show a signature of mass segregation. The critical mass, mass spectrum, and mass segregation are consistent with the observations of young massive clusters in our Galaxy as well as in external galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗

Experimental realization of Feynman’s ratchet

Feynman's ratchet is a microscopic machine in contact with two heat reservoirs, at temperatures T A and T B , that was proposed by Richard Feynman to illustrate the second law of thermodynamics. In equilibrium (T A = T B ), thermal fluctuations prevent the ratchet from generating directed motion. When the ratchet is maintained away from equilibrium by a temperature difference (T A ≠T B ), it can operate as a heat engine, rectifying thermal fluctuations to perform work. While it has attracted much interest, the operation of Feynman's ratchet as a heat engine has not been realized experimentally, due to technical challenges. In this work, we realize Feynman's ratchet with a colloidal particle in a one dimensional optical trap in contact with two heat reservoirs: one is the surrounding water, while the effect of the other reservoir is generated by a novel feedback mechanism, using the Metropolis algorithm to impose detailed balance. We verify that the system does not produce work when T A = T B , and that it becomes a microscopic heat engine when T A ≠T B . We analyze work, heat and entropy production as functions of the temperature difference and external load. As a result, our experimental realization of Feynman's ratchet and the Metropolis algorithm can also be used to study the thermodynamics of feedback control and information processing, the working mechanism of molecular motors, and controllable particle transportation.

42 ENGINEERING↗

Hybrid optimization and Bayesian inference techniques for a non-smooth radiation detection problem

In this paper, we propose several algorithms to recover the location and intensity of a radiation source located in a simulated 250 × 180 m block of an urban center based on synthetic measurements. Radioactive decay and detection are Poisson random processes, so we employ likelihood functions based on this distribution. Owing to the domain geometry and the proposed response model, the negative logarithm of the likelihood is only piecewise continuous differentiable, and it has multiple local minima. To address these difficulties, we investigate three hybrid algorithms composed of mixed optimization techniques. For global optimization, we consider simulated annealing, particle swarm, and genetic algorithm, which rely solely on objective function evaluations; that is, they do not evaluate the gradient in the objective function. By employing early stopping criteria for the global optimization methods, a pseudo-optimum point is obtained. This is subsequently utilized as the initial value by the deterministic implicit filtering method, which is able to find local extrema in non-smooth functions, to finish the search in a narrow domain. These new hybrid techniques, combining global optimization and implicit filtering address, difficulties associated with the non-smooth response, and their performances, are shown to significantly decrease the computational time over the global optimization methods. To quantify uncertainties associated with the source location and intensity, we employ the delayed rejection adaptive Metropolis and DiffeRential Evolution Adaptive Metropolis algorithms. Finally, marginal densities of the source properties are obtained, and the means of the chains compare accurately with the estimates produced by the hybrid algorithms.

42 ENGINEERING↗

The REFLEX project: Comparing different algorithms and implementations for the inversion of a terrestrial ecosystem model against eddy covariance data

We describe a model-data fusion (MDF) inter-comparison project (REFLEX), which compared various algorithms for estimating carbon (C) model parameters consistent with both measured carbon fluxes and states and a simple C model. Participants were provided with the model and with both synthetic net ecosystem exchange (NEE) ofCO2 and leaf area index (LAI) data, generated from the model with added noise, and observed NEE and LAI data from two eddy covariance sites. Participants endeavoured to estimate model parameters and states consistent with the model for all cases over the two years for which data were provided, and generate predictions for one additional year without observations. Nine participants contributed results using Metropolis algorithms, Kalman filters and a genetic algorithm. For the synthetic data case, parameter estimates compared well with the true values. The results of the analyses indicated that parameters linked directly to gross primary production (GPP) and ecosystem respiration, such as those related to foliage allocation and turnover, or temperature sensitivity of heterotrophic respiration,were best constrained and characterised. Poorly estimated parameters were those related to the allocation to and turnover of fine root/wood pools. Estimates of confidence intervals varied among algorithms, but several algorithms successfully located the true values of annual fluxes from synthetic experiments within relatively narrow 90% confidence intervals, achieving>80% success rate and mean NEE confidence intervals <110 gCm-2 year-1 for the synthetic case. Annual C flux estimates generated by participants generally agreed with gap-filling approaches using half-hourly data. The estimation of ecosystem respiration and GPP through MDF agreed well with outputs from partitioning studies using half-hourly data. Confidence limits on annual NEE increased by an average of 88% in the prediction year compared to the previous year, when data were available. Confidence intervals on annual NEE increased by 30% when observed data were used instead of synthetic data, reflecting and quantifying the addition of model error. Finally, our analyses indicated that incorporating additional constraints, using data on C pools (wood, soil and fine roots) would help to reduce uncertainties for model parameters poorly served by eddy covariance data.

09 BIOMASS FUELS↗

Monte Carlo Study of Magnetic and Thermal Phase Transitions of a Diluted Magnetic Nanosystem

Monte Carlo (MC) simulation method with the Metropolis algorithm is used to study the magnetic and thermal phase transition properties of a spherical nanoparticle. The system consists of two concentric spheres of rays R{sub C} and R{sub S}, respectively (R{sub c} < R{sub s}). For r < R{sub c}, the spin is σ = ±3 /2 and ±1 /2, and for R{sub C} < r ≤ R{sub S}, the spin is S = ±7 /2, + 5/2, ±3 /2, and ±1 /2 with antiferromagnetic interface coupling. Between R{sub C} and R{sub S}, the sites are populated with the probability (p). We present a detailed discussion on the magnetic and thermal phase transition characteristics of the system under consideration. Our investigations show that this system can be used as a magnetic nanostructure possessing potential applications in magnetism.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Mean-Field and Monte Carlo Studies of the Magnetic Properties of a Spin-7/2 and Spin-5/2 Ising Bilayer Film

We use standard Monte Carlo simulations based on the Metropolis algorithm and mean-field calculations to investigate the magnetic properties of an Ising bilayer film consisting of two superposed ferromagnetic squared lattices A and B whose magnetic atoms have spin 7/2 and 5/2 respectively. Crystal-field and external magnetic field effects on the spins are considered in the model. The magnetic order parameters and response functions are calculated as functions of the temperature for selected values of the model parameters and this enables one to devise thermal phase diagrams by both methods. Our calculations only reveal second-order phase boundaries. Under appropriate conditions, compensation point phenomena are detected in the calculations below the critical temperatures. When the system is exposed to the external magnetic constraint, attracting hysteresis phenomena are sometimes generated. The temperature dependence of the coercitive field for various values of the crystal-field is singled out.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Compensation Behavior in a Ferrimagnetic Mixed Spin-7/2 and Spin-3: Monte Carlo Simulation

The ferrimagnetic systems have been extensively investigated because of their fascinating properties. In this paper, the mixed spin-7/2 and spin-3 Ising system with periodic boundary conditions on a square lattice has been studied using the Monte Carlo simulation within the Metropolis algorithm; the Hamiltonian of the system includes the interaction between the first nearest neighbors and the crystal fields Δ{sub 7/2} and Δ{sub 3} generated by the spin-7/2 and spin-3, respectively. The ground-state phase diagram of the system has been established. On the other hand, the impact of the single-ion anisotropies on the compensation temperature has been shown. Several topologies of the total magnetization have been found for this system.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

The Blocking Temperature of an Amorphous Alternate A and B Layers Cylindrical Nanowire

The blocking temperature of an amorphous cylindrical nanowire of length L and radius R is studied within the framework of Monte Carlo simulation based on Metropolis algorithm. The nanowire is formed by alternate layers of atoms A and B. The interlayer coupling J{sub AB} is ferromagnetic. The effects of the exchange couplings J{sub B} and J{sub AB}, the plane anisotropy D{sub xy}, and the amorphization α on the blocking temperature of the system are investigated. We found that the blocking temperature increases with increasing the value of the exchange couplings J{sub B} and J{sub AB} and decreases with increasing the plane anisotropy D{sub xy} and the degree of the amorphization α.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

A theoretical calculation of stacking fault energy of Ni alloys: The effects of temperature and composition

Combining cluster expansion (CE) method with one dimensional axial Ising model, this work investigated the effects of alloying elements and configurational variations due to temperature on the stacking fault energy (SFE) of FCC Ni binary alloys. Ensembles of large numbers of atomistic structures, each with more than ~400 atoms, were generated to consider sufficient long-range chemical disorder and temperature effects due to configurational entropy. Here, a Monte Carlo Metropolis algorithm was used to generate these structures, whose energies were then evaluated based on the effective cluster interactions obtained from CE. As a baseline, this work had shown the SFE of pure Ni and Al to be 127 mJ/m 2 and 137 mJ/m 2 , respectively, which agreed with the experimental values of 125 mJ/m 2 and 150 mJ/m 2 reported in the literature. Additions of Al, Ti, Cr and Co to pure Ni were found to decrease the SFE to different extents. Although temperature does not strongly influence the SFE of the FCC Ni-Al and Ni-Cr binary alloys, it can lead to significant changes to the SFE of the FCC Ni-Ti and Ni-Co alloys. While effects of temperature and composition on SFE observed in this work were calculated from binary Ni alloys, the general trends are nonetheless expected to be valid in the γ phase of multicomponent Ni superalloys.

36 MATERIALS SCIENCE↗

Quantifying model-structure- and parameter-driven uncertainties in spring wheat phenology prediction with Bayesian analysis

Recent international efforts have brought renewed emphasis on the comparison of different agricultural systems models. Thus far, analysis of model-ensemble simulated results has not clearly differentiated between ensemble prediction uncertainties due to model structural differences per se and those due to parameter value uncertainties. Additionally, despite increasing use of Bayesian parameter estimation approaches with field-scale crop models, inadequate attention has been given to the full posterior distributions for estimated parameters. The objectives of this study were to quantify the impact of parameter value uncertainty on prediction uncertainty for modeling spring wheat phenology using Bayesian analysis and to assess the relative contributions of model-structure-driven and parameter-value-driven uncertainty to overall prediction uncertainty. This study used a random walk Metropolis algorithm to estimate parameters for 30 spring wheat genotypes using nine phenology models based on multi-location trial data for days to heading and days to maturity. Across all cases, parameter-driven uncertainty accounted for between 19 and 52% of predictive uncertainty, while model-structure-driven uncertainty accounted for between 12 and 64%. Here, this study demonstrated the importance of quantifying both model-structure- and parameter-value-driven uncertainty when assessing overall prediction uncertainty in modeling spring wheat phenology. More generally, Bayesian parameter estimation provided a useful framework for quantifying and analyzing sources of prediction uncertainty.

60 APPLIED LIFE SCIENCES↗

Stress-dominated growth of two-dimensional materials on nonplanar substrates

Curved features are ubiquitous on solid surfaces, but the effect of surface curvatures on growth of two-dimensional (2D) materials has not yet been established. Using a newly developed method based on the Metropolis algorithm and taking graphene as a prototype, we find that a curved feature on substrates can result in a variety of topological defects in 2D materials. As the feature's size increases by just nanometers, the defects can vary from adatoms, dislocation pairs, and grain boundary scars to long-range grain boundaries, in contrast to previously reported defect-free modes of rigid colloidal crystals growing on spheres. We identify an important role of curvature-induced lattice stress in lowering the growth rate over the curved features and driving a plastic instability in the materials. When the feature's size increases to several nanometers, the stress effect is compromised by an enhanced effect of geodesic curvature, yielding long-range grain boundaries as a result of increased local growth rate on the feature with respect to that on flat regions. Here we further provide a ‘phase diagram’ of defects that helps to guide a rational choice of geometrical parameters of features towards the growth of high-quality 2D materials as well as controllable creation of topological defects.

36 MATERIALS SCIENCE↗

Revisiting Structural and Electromechanical Properties of the Lead-free (K,Na)NbO 3 High-Piezoelectric Material

Having lead-free systems with excellent piezoelectric responses is crucial to the development of environmentally friendly electromechanical applications. In this work, we build an effective Hamiltonian model to explore the promising (K x Na 1–x )NbO 3 system, whose rich phase diagram near x = 50% remains poorly understood meanwhile exhibiting a colossal effective piezoelectric response. Thanks to the numerical implementation of this effective Hamiltonian scheme into a Monte Carlo Metropolis algorithm, we reveal striking features. First, a long-period state can be the ground state at low temperatures for some concentrations while only a short-period conventional polar ground state exists for larger x. Second, the electric field-driven transformation, via a first-order transition, of this long-period state into a short-period polar state creates large electromechanical strains (on the order of the percent) and is likely the origin of the colossal piezoelectric response reported in KNN, for which we evaluate an effective piezoelectric coefficient of several thousands of pC/N.

(K,Na)NbO3↗

Pt-Zn Clusters on Stoichiometric MgO(100) and TiO2(110): Dramatically Different Sintering Behavior

Zn was suggested to be a promising additive to Pt in the catalysis of dehydrogenation reactions. In this work, mixed Pt-Zn clusters deposited on two simple oxides, MgO(100) and TiO2(110), were investigated. The stability of these systems against cluster sintering, one of the major mechanisms of catalyst deactivation, is simulated using a Metropolis Monte Carlo scheme under the assumption of the Ostwald ripening mechanism. Particle migration, association to and dissociation from clusters, and evaporation and redeposition of monomers were all included in the simulations. Simulations are done at several high temperatures relevant to reactions of catalytic dehydrogenation. The effect of temperature is included via both the Metropolis algorithm and the Boltzmann-weighted populations of the global and thermally accessible local minima on the density functional theory potential energy surfaces of clusters of all sizes and compositions up to tetramers. On both surfaces, clusters are shown to sinter quite rapidly. However, the resultant compositions of the clusters most resistant to sintering are quite different on the two supports. On TiO2(110), Pt and Zn appear to phase separate, preferentially forming clusters rich in just one or the other metal. On MgO(100), Pt and Zn remain well-mixed and form a range of bimetallic clusters of various compositions that appear relatively stable. However, Zn is more easily lost from MgO through evaporation. These phenomena were rationalized by several means of chemical bonding analysis.

Environmental Molecular Sciences Laboratory↗

Semiclassical propagation of Wigner functions

We present a comprehensive study of semiclassical phase-space propagation in the Wigner representation, emphasizing numerical applications, in particular as an initial-value representation. Two semiclassical approximation schemes are discussed. The propagator of the Wigner function based on van Vleck's approximation replaces the Liouville propagator by a quantum spot with an oscillatory pattern reflecting the interference between pairs of classical trajectories. Employing phase-space path integration instead, caustics in the quantum spot are resolved in terms of Airy functions. We apply both to two benchmark models of nonlinear molecular potentials, the Morse oscillator and the quartic double well, to test them in standard tasks such as computing autocorrelation functions and propagating coherent states. The performance of semiclassical Wigner propagation is very good even in the presence of marked quantum effects, e.g., in coherent tunneling and in propagating Schroedinger cat states, and of classical chaos in four-dimensional phase space. We suggest options for an effective numerical implementation of our method and for integrating it in Monte-Carlo-Metropolis algorithms suitable for high-dimensional systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗