Search NASA⌕ Search

SEARCH · Search NASA

Results for “sequential updates”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments

Importance sampling often drastically improves the variance of percentile and quantile estimators of rare events. We propose a sequential strategy for iterative refinement of importance distributions for sampling uncertain inputs to a computer model to estimate quantiles of model output or the probability that the model output exceeds a fixed or random threshold. A framework is introduced for updating a model surrogate to maximize its predictive capability for rare event estimation with sequential importance sampling. Examples of the proposed methodology involving materials strength and nuclear reactor applications will be presented. The conclusions are: (1) Importance sampling improves UQ of percentile and quantile estimates relative to brute force approach; (2) Benefits of importance sampling increase as percentiles become more extreme; (3) Iterative refinement improves importance distributions in relatively few iterations; (4) Surrogates are necessary for slow running codes; (5) Sequential design improves surrogate quality in region of parameter space indicated by importance distributions; and (6) Importance distributions and VRFs stabilize quickly, while quantile estimates may converge slowly.

97 MATHEMATICS AND COMPUTING↗

CCSI Toolset 3.19 Release

CCSI Toolset 3.19 Release Highlights A gradient generation tool was developed to support GENN models in FOQUS. Certain machine learning tools train gradient-enhanced neural network (GENN) models which can be more accurate for complex datasets given a priori knowledge of model derivatives. However, the derivatives must be known beforehand and are not often available for process data. This tool automatically predicts the gradients for a training dataset in a form usable by common GENN trainers, such as Surrogate Modeling Toolbox. Support was added for Surrogate Modeling Toolbox GENN models in FOQUS, including updates to the run methods, node properties, test framework, documentation and optional dependencies list. Users can train/save Surrogate Modeling Toolbox gradient-enhanced neural network (GENN) models with custom objects and produce .pkl files compatible with the Machine Learning/Artificial Intelligence Plugin in FOQUS. A simpler implementation of the ordering algorithm in the Sequential Design of Experiments (SDOE) module was included. The SDOE examples documentation was updated. The Optimality-Based Design of Experiments was updated to improve the error handling when the results are None.

AS↗

Comparing, optimizing, and benchmarking quantum-control algorithms in a unifying programming framework

For paving the way to novel applications in quantum simulation, computation, and technology, increasingly large quantum systems have to be steered with high precision. It is a typical task amenable to numerical optimal control to turn the time course of pulses, i.e., piecewise constant control amplitudes, iteratively into an optimized shape. Here, we present a comparative study of optimal-control algorithms for a wide range of finite-dimensional applications. We focus on the most commonly used algorithms: GRAPE methods which update all controls concurrently, and Krotov-type methods which do so sequentially. Guidelines for their use are given and open research questions are pointed out. Moreover, we introduce a unifying algorithmic framework, DYNAMO (dynamic optimization platform), designed to provide the quantum-technology community with a convenient matlab-based tool set for optimal control. In addition, it gives researchers in optimal-control techniques a framework for benchmarking and comparing newly proposed algorithms with the state of the art. It allows a mix-and-match approach with various types of gradients, update and step-size methods as well as subspace choices. Open-source code including examples is made available at http://qlib.info.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Physics-based, Bayesian sequential detection method and system for radioactive contraband

A distributed sequential method and system for detecting and identifying radioactive contraband from highly uncertain (noisy) low-count, radionuclide measurements, i.e. an event mode sequence (EMS), using a statistical approach based on Bayesian inference and physics-model-based signal processing based on the representation of a radionuclide as a monoenergetic decomposition of monoenergetic sources. For a given photon event of the EMS, the appropriate monoenergy processing channel is determined using a confidence interval condition-based discriminator for the energy amplitude and interarrival time and parameter estimates are used to update a measured probability density function estimate for a target radionuclide. A sequential likelihood ratio test is then used to determine one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or not, and if not, then repeating the process for the next sequential photon event of the EMS until one of the two threshold conditions is satisfied.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Frog: Asynchronous Graph Processing on GPU with Hybrid Coloring Model

GPUs have been increasingly used to accelerate graph processing for complicated computational problems regarding graph theory. Many parallel graph algorithms adopt the asynchronous computing model to accelerate the iterative convergence. Unfortunately, the consistent asynchronous computing requires locking or atomic operations, leading to significant penalties/overheads when implemented on GPUs. As such, coloring algorithm is adopted to separate the vertices with potential updating conflicts, guaranteeing the consistency/correctness of the parallel processing. Common coloring algorithms, however, may suffer from low parallelism because of a large number of colors generally required for processing a large-scale graph with billions of vertices. We propose a light-weight asynchronous processing framework called Frog with a preprocessing/hybrid coloring model. The fundamental idea is based on Pareto principle (or 80-20 rule) about coloring algorithms as we observed through masses of realworld graph coloring cases. We find that a majority of vertices (about 80%) are colored with only a few colors, such that they can be read and updated in a very high degree of parallelism without violating the sequential consistency. Accordingly, our solution separates the processing of the vertices based on the distribution of colors. In this work, we mainly answer three questions: (1) how to partition the vertices in a sparse graph with maximized parallelism, (2) how to process large-scale graphs that cannot fit into GPU memory, and (3) how to reduce the overhead of data transfers on PCIe while processing each partition. Here, we conduct experiments on real-world data (Amazon, DBLP, YouTube, RoadNet-CA, WikiTalk and Twitter) to evaluate our approach and make comparisons with well-known non-preprocessed (such as Totem, Medusa, MapGraph and Gunrock) and preprocessed (Cusha) approaches, by testing four classical algorithms (BFS, PageRank, SSSP and CC). On all the tested applications and datasets, Frog is able to significantly outperform existing GPU-based graph processing systems except Gunrock and MapGraph. MapGraph gets better performance than Frog when running BFS on RoadNet-CA. The comparison between Gunrock and Frog is inconclusive. Frog can outperform Gunrock more than 1.04X when running PageRank and SSSP, while the advantage of Frog is not obvious when running BFS and CC on some datasets especially for RoadNet-CA.

97 MATHEMATICS AND COMPUTING↗

The Nuclear Energy Advanced Modeling and Simulation Safeguards and Separations Reprocessing Plant Toolkit

This report details the progress made in the development of the Reprocessing Plant Toolkit (RPTk) for the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. RPTk is an ongoing development effort intended to provide users with an extensible, integrated, and scalable software framework for the modeling and simulation of spent nuclear fuel reprocessing plants by enabling the insertion and coupling of user-developed physicochemical modules of variable fidelity. The NEAMS Safeguards and Separations IPSC (SafeSeps) and the Enabling Computational Technologies (ECT) supporting program element have partnered to release an initial version of the RPTk with a focus on software usability and utility. RPTk implements a data flow architecture that is the source of the system's extensibility and scalability. Data flows through physicochemical modules sequentially, with each module importing data, evolving it, and exporting the updated data to the next downstream module. This is accomplished through various architectural abstractions designed to give RPTk true plug-and-play capabilities. A simple application of this architecture, as well as RPTk data flow and evolution, is demonstrated in Section 6 with an application consisting of two coupled physicochemical modules. The remaining sections describe this ongoing work in full, from system vision and design inception to full implementation. Section 3 describes the relevant software development processes used by the RPTk development team. These processes allow the team to manage system complexity and ensure stakeholder satisfaction. This section also details the work done on the RPTk ``black box'' and ``white box'' models, with a special focus on the separation of concerns between the RPTk user interface and application runtime. Section 4 and 5 discuss that application runtime component in more detail, and describe the dependencies, behavior, and rigorous testing of its constituent components.

Enabling Computational Technologies↗

Seismic Monitoring at the Farnsworth CO2-EOR Field Using Time-Lapse Elastic-Waveform Inversion of 3D-3C VSP Data

During the Development Phase of the U.S. Southwest Regional Partnership on Carbon Sequestration, supercritical CO2 was continuously injected into the deep oil-bearing Morrow B formation of the Farnsworth Unit in Texas for Enhanced Oil Recovery (EOR). The project injected approximately 94 kilotons of CO2 to study geologic carbon storage during CO2-EOR. A three-dimensional (3D) surface seismic dataset was acquired in 2013 to characterize the subsurface structures of the Farnsworth site. Following this data acquisition, the baseline and three time-lapse three-dimensional three-component (3D-3C) vertical seismic profiling (VSP) data were acquired at a narrower surface area surrounding the CO2 injection and oil/gas production wells between 2014 and 2017 for monitoring CO2 injection and migration. With these VSP datasets, we inverted for subsurface velocity models to quantitatively monitor the CO2 plume within the Morrow B formation. We first built 1D initial P-wave (Vp) and S-wave (Vs) velocity models by upscaling the sonic logs. We improved the deep region of the Vp and Vs models by incorporating the deep part of a migration velocity model derived from the 3D surface seismic data. We improved the shallow region of 3D Vp and Vs models using 3D traveltime tomography of first arrivals of VSP downgoing waves. We further improved the 3D baseline velocity models using elastic-waveform inversion (EWI) of the 3D baseline VSP upgoing data. Our advanced EWI method employs alternative tomographic and conventional gradients and total-variation-based regularization to ensure the high-fidelity updates of the 3D baseline Vp and Vs models. We then sequentially applied our 3D EWI method to the three time-lapse datasets to invert for spatiotemporal changes of Vp and Vs in the reservoir. Our inversion results reveal the volumetric changes of the time-lapse Vp and Vs models and show the evolution of the CO2 plume from the CO2 injection well to the oil/gas production wells.

42 ENGINEERING↗

Entanglement engineering of optomechanical systems by reinforcement learning

Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement—so-called entanglement engineering—for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon–phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.

97 MATHEMATICS AND COMPUTING↗

An iterative particle filter approach for coupled hydro-geophysical inversion of a controlled infiltration experiment

The modeling of unsaturated groundwater flow is affected by a high degree of uncertainty related to both measurement and model errors. Geophysical methods such as Electrical Resistivity Tomography (ERT) can provide useful indirect information on the hydrological processes occurring in the vadose zone. In this paper, we propose and test an iterated particle filter method to solve the coupled hydrogeophysical inverse problem. We focus on an infiltration test monitored by time-lapse ERT and modeled using Richards equation. The goal is to identify hydrological model parameters from ERT electrical potential measurements. Traditional uncoupled inversion relies on the solution of two sequential inverse problems, the first one applied to the ERT measurements, the second one to Richards equation. This approach does not ensure an accurate quantitative description of the physical state, typically violating mass balance. To avoid one of these two inversions and incorporate in the process more physical simulation constraints, we cast the problem within the framework of a SIR (Sequential Importance Resampling) data assimilation approach that uses a Richards equation solver to model the hydrological dynamics and a forward ERT simulator combined with Archie's law to serve as measurement model. ERT observations are then used to update the state of the system as well as to estimate the model parameters and their posterior distribution. The limitations of the traditional sequential Bayesian approach are investigated and an innovative iterative approach is proposed to estimate the model parameters with high accuracy. The numerical properties of the developed algorithm are verified on both homogeneous and heterogeneous synthetic test cases based on a real-world field experiment.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An advisory system for predicting and resolving airspace violations based on four-dimensional guidance techniques

New heuristics are integrated with four-dimensional guidance techniques developed by NASA in order to automate the prediction and resolution of airspace violations, and three rules are derived to reduce the amount of computation time for conflict detection. Controller experience has been used to establish techniques for resolving potential conflicts including speed control, altitude maneuvers, and horizontal flight maneuvers. Current aircraft states, flight plans, and extrapolation of aircraft trajectories are used to synthesize four-dimensional trajectories, and the state of the air traffic and the interaction between aircraft are projected into the future using the four-dimensional algorithms. The situation is immediately updated to incorporate any new information. Potential conflicts among multiple aircraft are resolved by fast sequential resolution of potential conflicts between aircraft pairs, one at a time.

Lee, Homer Q.↗

Batch Sequential Estimation with Non-Uniform Measurements and Non-Stationary Noise

Sequential estimation using the traditional discrete Kalman filter typically assumes the measurement time and state update time are coincident. This is often a poor assumption in realistic measurement scenarios where the data can be received from multiple sources at differing times. This paper develops the necessary algorithm adjustments needed for the Kalman filter to readily process measurement data that arrive at varying times and with non-stationary noise. The algorithm is applied to a relevant problem of orbit determination using one-way uplink radiometric tracking of a spacecraft (in the present case a Mars orbiter).

Seubert, Jill↗

Nonlinear Rescaling and Proximal-Like Methods in Convex Optimization

The nonlinear rescaling principle (NRP) consists of transforming the objective function and/or the constraints of a given constrained optimization problem into another problem which is equivalent to the original one in the sense that their optimal set of solutions coincides. A nonlinear transformation parameterized by a positive scalar parameter and based on a smooth scaling function is used to transform the constraints. The methods based on NRP consist of sequential unconstrained minimization of the classical Lagrangian for the equivalent problem, followed by an explicit formula updating the Lagrange multipliers. We first show that the NRP leads naturally to proximal methods with an entropy-like kernel, which is defined by the conjugate of the scaling function, and establish that the two methods are dually equivalent for convex constrained minimization problems. We then study the convergence properties of the nonlinear rescaling algorithm and the corresponding entropy-like proximal methods for convex constrained optimization problems. Special cases of the nonlinear resealing algorithm are presented. In particular a new class of exponential penalty-modified barrier functions methods is introduced.

Polyak, Roman↗

Ignition of Metals in Heated Supersonic Particle Impact with Inert Particulate

The conventional understanding of particle impact ignition characteristic elements relies on the following principles: 1) flammable particulate (except in the case of titanium and aluminum target materials); 2) gas velocity greater than 100 ft/s; 3) Impact point ranging from 45° to perpendicular to the path of the particle [1]; 4) flammable target material. To test assumptions about particulate flammability being necessary for particle impact ignition of less reactive target materials, such as Inconel 718, testing was performed with inert particulate. Supersonic particle impact testing was conducted with heated gas and 1500-µm sapphire particulate on various target materials: 304 stainless steel, wrought and selective laser melted Inconel 718, and Monel 400. Posttest characterization of impact craters was performed on each type of metallic target sample, including surface characterization performed by light optical microscopy and scanning electron microscopy with energy dispersive spectroscopy. Full consumption of the stainless steel and wrought Inconel 718 targets were noted to occur with sequential impacts. The results of testing will be discussed in detail, as well as recommendations for updating the understanding of the particle impact ignition mechanism.

Particle Impact↗

Real-Time Principal-Component Analysis

A recently written computer program implements dominant-element-based gradient descent and dynamic initial learning rate (DOGEDYN), which was described in Method of Real-Time Principal-Component Analysis (NPO-40034) NASA Tech Briefs, Vol. 29, No. 1 (January 2005), page 59. To recapitulate: DOGEDYN is a method of sequential principal-component analysis (PCA) suitable for such applications as data compression and extraction of features from sets of data. In DOGEDYN, input data are represented as a sequence of vectors acquired at sampling times. The learning algorithm in DOGEDYN involves sequential extraction of principal vectors by means of a gradient descent in which only the dominant element is used at each iteration. Each iteration includes updating of elements of a weight matrix by amounts proportional to a dynamic initial learning rate chosen to increase the rate of convergence by compensating for the energy lost through the previous extraction of principal components. In comparison with a prior method of gradient-descent-based sequential PCA, DOGEDYN involves less computation and offers a greater rate of learning convergence. The sequential DOGEDYN computations require less memory than would parallel computations for the same purpose. The DOGEDYN software can be executed on a personal computer.

Duong, Vu↗

Reduction of display artifacts by random sampling

The application of random-sampling techniques to remove visible artifacts (such as flicker, moire patterns, and paradoxical motion) introduced in TV-type displays by discrete sequential scanning is discussed and demonstrated. Sequential-scanning artifacts are described; the window of visibility defined in spatiotemporal frequency space by Watson and Ahumada (1982 and 1983) and Watson et al. (1983) is explained; the basic principles of random sampling are reviewed and illustrated by the case of the human retina; and it is proposed that the sampling artifacts can be replaced by random noise, which can then be shifted to frequency-space regions outside the window of visibility. Vertical sequential, single-random-sequence, and continuously renewed random-sequence plotting displays generating 128 points at update rates up to 130 Hz are applied to images of stationary and moving lines, and best results are obtained with the single random sequence for the stationary lines and with the renewed random sequence for the moving lines.

Ahumada, A. J., Jr.↗

Application of Sequential Design of Experiments (SDoE) to Large Pilot-Scale Solvent-Based CO2 Capture Process at Technology Centre Mongstad (TCM)

The United States Department of Energy’s Carbon Capture Simulation for Industry Impact (CCSI2) program has developed a framework for sequential design of experiments (SDoE) that aims to maximize knowledge gained from budget- and schedule-limited pilot scale testing. SDoE was applied to the planning and execution of campaigns for testing CO2 capture systems at pilot-scale in order to optimally allocate resources available for the testing. In this methodology, a stochastic process model is developed by quantifying the parametric uncertainty in submodels of interest; for a solvent-based CO2 capture system, these may include physical properties and equipment performance submodels (e.g., mass transfer, interfacial area). This uncertainty is propagated through the full process model, over variable operating conditions, for estimating the resulting uncertainty in key model outputs (e.g., percentage of CO2 capture, solvent regeneration energy requirement). In developing a data collection plan, the predicted output uncertainty is incorporated into an algorithm that seeks simultaneously to select process operating conditions for which the predicted uncertainty is relatively high and to ensure that the entire space of operation is well represented. This test plan is then used to guide operation of the pilot plant at varying steady-state conditions, with resulting process data incorporated into the existing model using Bayesian inference to refine parameter distributions. The updated stochastic model, with reduced parametric uncertainty from data collected, is then used to guide additional data collection, thus the sequential nature of the experimental design. The SDoE process was implemented at the pilot test unit (12 MWe in scale) at Norway’s Technology Centre Mongstad (TCM) in a summer 2018 test campaign with aqueous monoethanolamine (MEA). During the test campaign, the varied operating conditions included the flowrates of circulated solvent, flue gas, and reboiler steam and the CO2 concentration in the flue gas. The process data were used to update probability distributions of mass transfer and interfacial area parameters of a stochastic process model developed by the CCSI2 team. Two iterations of the SDoE process were executed, resulting in the uncertainty in model predicted CO2 capture percentage decreasing by an average of 58.0 ± 4.7% over the full input space of interest. This work demonstrates the potential of the SDoE process for model refinement through reduction in process model parametric uncertainty, and ultimately risk in scale-up, in CO2 capture technology performance.

carbon capture↗

A triangular covariance factorization for sequential filtering algorithms

A method for propagating the square-root of the state error covariance matrix in lower triangular UDU form is described. This update method can be combined with the UDU transformation used by Bierman to obtain the equations of a square-root free triangular estimation algorithm. The method is compared with the state transition matrix time update algorithm on the basis of integration accuracy, computational efficiency and storage requirements.

Tapley, B. D.↗

Sequential formulation of all‐way coupled finite strain thermoporomechanics for largely deformable gas hydrate deposits

We develop a numerically stable sequential formulation of thermoporomechanics for largely deformable gas hydrate deposits, extended from the fixed stress split of infinitesimal transformation. Constitutive equations are based on the total Lagrangian approach for both flow and geomechanics, including dynamic full tensor permeability and thermal conductivity updated from the deformation gradient. For space discretization, we take the cell-centered finite volume and node-based finite element method for flow and geomechanics, respectively. Then, we propose a sequential implicit method for all-way coupled thermoporomechanics, where the nonisothermal multiphase flow problem of gas hydrates is solved implicitly first and then the geomechanics problem is solved implicitly at the next step. During solution of the flow problem, we fix the rate of first Pioal total stress for numerical stability as well as apply porosity correction and entropy correction to account for geomechanical effects. We test numerical examples where flow and geomechanics parameters are based on deep oceanic gas hydrate deposits. When applying depressurization, even though the results between the infinitesimal transformation and finite strain geomechanics are similar in the early stages due to small deformation, we find differences between them in the late times as deformation becomes large. Accordingly, permeability and thermal conductivity tensors become nonisotropic full tensors although they are initially isotropic. Furthermore, we identify numerical stability of the developed sequential method from the test cases that exhibit the highly complex coupled gas hydrate systems with large deformation. Thus, the proposed sequential formulation can be applied in largely deformable gas hydrate systems.

42 ENGINEERING↗