Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic Sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗

Geological activity shapes the microbiome in deep-subsurface aquifers by advection

Subsurface environments host diverse microorganisms in fluid-filled fractures; however, little is known about how geological and hydrological processes shape the subterranean biosphere. Here, we sampled three flowing boreholes weekly for 10 mo in a 1478-m-deep fractured rock aquifer to study the role of fracture activity (defined as seismically or aseismically induced fracture aperture change) and advection on fluid-associated microbial community composition. We found that despite a largely stable deep-subsurface fluid microbiome, drastic community-level shifts occurred after events signifying physical changes in the permeable fracture network. The community-level shifts include the emergence of microbial families from undetected to over 50% relative abundance, as well as the replacement of the community in one borehole by the earlier community from a different borehole. Null-model analysis indicates that the observed spatial and temporal community turnover was primarily driven by stochastic processes (as opposed to deterministic processes). We, therefore, conclude that the observed community-level shifts resulted from the physical transport of distinct microbial communities from other fracture(s) that outpaced environmental selection. Given that geological activity is a major cause of fracture activity and that geological activity is ubiquitous across space and time on Earth, our findings suggest that advection induced by geological activity is a general mechanism shaping the microbial biogeography and diversity in deep-subsurface habitats across the globe.

59 BASIC BIOLOGICAL SCIENCES↗

Estimation of elastic properties of an additively manufactured lattice using resonant ultrasound spectroscopy

Development of improved approaches in the characterization of additively manufactured structures continues to be a topic of interest for the advanced manufacturing community. This article will investigate an approach using resonant ultrasound spectroscopy (RUS) to determine the effective elastic constants of an orthotropic lattice structure. The evaluation is performed on a cube shaped 316 L stainless steel test specimen, constructed using selective laser melting techniques. The approach uses RUS techniques in conjunction with the assumption that in the frequency regime of interest, the wavelength of the diagnostic ultrasound is greater than the discrete structural features of the unit cell of the lattice; thus, the AM structure can be treated as an anisotropic continuum with effective material properties and symmetry inherited from the unit cell. The RUS analysis estimates the nine elastic coefficients associated with orthotropic sample symmetry, which, in turn, are used to determine the elastic moduli and Poisson ratios. Current results show good agreement between experiments and modeled data. Comparisons to published results are also in good agreement, indicating the potential applicability of this characterization technique for estimating the linear elastic properties of innovative additive manufactured metal lattice structures.

36 MATERIALS SCIENCE↗

Reconstructing high-dimensional Hilbert-valued functions via compressed sensing

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our theoretical framework treats the function approximation problem as a joint sparse recovery problem, where the set of jointly sparse vectors is possibly infinite. To achieve the simultaneous reconstruction of Hilbert-valued functions in both parametric domain and Hilbert space, we propose a novel mixed-norm based `1 regularization method that exploits both energy and sparsity. Our approach requires extensions of concepts such as the restricted isometry and null space properties, allowing us to prove recovery guarantees for sparse Hilbert-valued function reconstruction. We complement the enclosed theory with an algorithm for Hilbert-valued recovery, based on standard forward-backward algorithm, meanwhile establishing its strong convergence in the considered infinite-dimensional setting. Finally, we demonstrate the minimal sample complexity requirements of our approach, relative to other popular methods, with numerical experiments approximating the solutions of high-dimensional parameterized elliptic PDEs.

Dexter, Nick↗

Predicting rare events using neural networks and short-trajectory data

Estimating the likelihood, timing, and nature of events is a major goal of modeling stochastic dynamical systems. When the event is rare in comparison with the timescales of simulation and/or measurement needed to resolve the elemental dynamics, accurate prediction from direct observations becomes challenging. In such cases a more effective approach is to cast statistics of interest as solutions to Feynman-Kac equations (partial differential equations). Here, we develop an approach to solve Feynman-Kac equations by training neural networks on short-trajectory data. Our approach is based on a Markov approximation but otherwise avoids assumptions about the underlying model and dynamics. This makes it applicable to treating complex computational models and observational data. Additionally, we illustrate the advantages of our method using a low-dimensional model that facilitates visualization, and this analysis motivates an adaptive sampling strategy that allows on-the-fly identification of and addition of data to regions important for predicting the statistics of interest. Finally, we demonstrate that we can compute accurate statistics for a 75-dimensional model of sudden stratospheric warming. This system provides a stringent test bed for our method.

97 MATHEMATICS AND COMPUTING↗

PlumeSeeker{sup TM}: A Model-Based Least-Cost Monitoring Network Design Technology for 3-D Contaminant Plume Boundary Delineation - 19582

Delineating the extent of contamination in an aquifer is a pre-requisite for designing remediation schemes as well as for satisfying regulators and stakeholders. Contaminant plumes are typically delineated using either monitoring well locations with observed concentrations below remedial goals or with computer-drawn contour maps based on available concentration measurements in the groundwater. Computer-generated plume information lacks ground truth resulting in uncertainty about the true limits of contamination. The location of groundwater delineation wells is usually chosen solely based on professional judgement and experience. Both approaches can be inefficient, risky and often unnecessarily expensive. PlumeSeeker{sup TM} is a software-based technology well-suited for the optimal delineation of radiological or emerging contaminant plumes with single or multiple source locations. The software is an enhancement of a university research code for plume delineation using geostatistical and stochastic modeling tools integrated with the widely used groundwater flow and transport modeling software MODFLOW-SURFACT{sup TM}. PlumeSeeker{sup TM} increases the overall confidence in the location and geometry of the plume boundary through the sequential (i.e. a rank-ordered listing) or batch (i.e. a suite of multiple wells) selection of existing or new monitoring wells based on the criteria of maximizing plume boundary uncertainty reduction and on new field information. Using PlumeSeeker{sup TM}, remediation managers can optimally locate new wells at sites where well installation costs are high or hydrogeology is complex. Applicable at sites with or without existing monitoring wells, PlumeSeeker{sup TM} is particularly powerful for optimally allocating project resources (labor, well installation, and laboratory costs) between existing wells and sampling at new locations. An application of PlumeSeeker{sup TM} at a DoD installation demonstrates how the cost of delineating a plume can be minimized. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

TYPE Ia SUPERNOVA LIGHT-CURVE INFERENCE: HIERARCHICAL BAYESIAN ANALYSIS IN THE NEAR-INFRARED

We present a comprehensive statistical analysis of the properties of Type Ia supernova (SN Ia) light curves in the near-infrared using recent data from Peters Automated InfraRed Imaging TELescope and the literature. We construct a hierarchical Bayesian framework, incorporating several uncertainties including photometric error, peculiar velocities, dust extinction, and intrinsic variations, for principled and coherent statistical inference. SN Ia light-curve inferences are drawn from the global posterior probability of parameters describing both individual supernovae and the population conditioned on the entire SN Ia NIR data set. The logical structure of the hierarchical model is represented by a directed acyclic graph. Fully Bayesian analysis of the model and data is enabled by an efficient Markov Chain Monte Carlo algorithm exploiting the conditional probabilistic structure using Gibbs sampling. We apply this framework to the JHK{sub s} SN Ia light-curve data. A new light-curve model captures the observed J-band light-curve shape variations. The marginal intrinsic variances in peak absolute magnitudes are sigma(M{sub J}) = 0.17 +- 0.03, sigma(M{sub H}) = 0.11 +- 0.03, and sigma(M{sub Ks}) = 0.19 +- 0.04. We describe the first quantitative evidence for correlations between the NIR absolute magnitudes and J-band light-curve shapes, and demonstrate their utility for distance estimation. The average residual in the Hubble diagram for the training set SNe at cz > 2000kms{sup -1} is 0.10 mag. The new application of bootstrap cross-validation to SN Ia light-curve inference tests the sensitivity of the statistical model fit to the finite sample and estimates the prediction error at 0.15 mag. These results demonstrate that SN Ia NIR light curves are as effective as corrected optical light curves, and, because they are less vulnerable to dust absorption, they have great potential as precise and accurate cosmological distance indicators.

79 ASTRONOMY AND ASTROPHYSICS↗

Curvature of the spectral energy distributions of blazars

In this paper, spectral energy distributions (SED) of both synchrotron and inverse Compton (IC) components of a sample of Fermi bright blazars are fitted by a log-parabolic law. The second-degree term of the log parabola measures the curvature of an SED. We find a statistically significant correlation between the synchrotron peak frequency and its curvature. This result is in agreement with the theoretical prediction and confirms previous studies that dealt with a single source with observations at various epochs or a small sample. If a broken power law is employed to fit the SED, the difference between the two spectral indices (i.e., |α{sub 2} – α{sub 1}|) can be considered a 'surrogate' of the SED curvature. We collect data from the literature and find a correlation between the synchrotron peak frequency and the spectral difference. We do not find a significant correlation between the IC peak frequency and its curvature, which may be caused by a complicated seed photon field. It is also found that the synchrotron curvatures are on average larger than those of IC curvatures, and there is no correlation between these two parameters. As suggested by previous works, both the log-parabolic law of the SED and the above correlation can be explained by statistical and/or stochastic particle accelerations. Based on a comparison of the slops of the correlation, our result seems to favor stochastic acceleration mechanisms and emission processes. Additional evidence, including SED modeling, particle acceleration simulation, and comparisons between some predictions and empirical relations/correlations, also seems to support the idea that the electron energy distribution (and/or synchrotron SED) may be log-parabolic.

79 ASTRONOMY AND ASTROPHYSICS↗

A High-Performance Embedded Hybrid Methodology for Uncertainty Quantification With Applications

Multiphysics processes modeled by a system of unsteady differential equations are naturally suited for partitioned (modular) solution strategies. We consider such a model where probabilistic uncertainties are present in each module of the system and represented as a set of random input parameters. A straightforward approach in quantifying uncertainties in the predicted solution would be to sample all the input parameters into a single set, and treat the full system as a black-box. Although this method is easily parallelizable and requires minimal modifications to deterministic solver, it is blind to the modular structure of the underlying multiphysical model. On the other hand, using spectral representations polynomial chaos expansions (PCE) can provide richer structural information regarding the dynamics of these uncertainties as they propagate from the inputs to the predicted output, but can be prohibitively expensive to implement in the high-dimensional global space of uncertain parameters. Therefore, we investigated hybrid methodologies wherein each module has the flexibility of using sampling or PCE based methods of capturing local uncertainties while maintaining accuracy in the global uncertainty analysis. For the latter case, we use a conditional PCE model which mitigates the curse of dimension associated with intrusive Galerkin or semi-intrusive Pseudospectral methods. After formalizing the theoretical framework, we demonstrate our proposed method using a numerical viscous flow simulation and benchmark the performance against a solely Monte-Carlo method and solely spectral method.

97 MATHEMATICS AND COMPUTING↗

Application of a new hybrid particle swarm optimization-mixed kernels function-based support vector machine model for reservoir porosity prediction: A case study in Jacksonburg-Stringtown oil field, West Virginia, USA

Porosity is a fundamental property that characterizes the storage capability of fluid and gas-bearing formations in a reservoir. An accurate porosity value can be measured from core samples in the laboratory; however, core analysis is expensive and time consuming. Well-log data can be used to calculate porosity, but the availability of log suites is often limited in mature fields. Therefore, robust porosity prediction requires integration of core-measured porosity with available well-log suites to control for changes in lithology and fluid content. A support vector machine (SVM) model with mixed kernel function (MKF) is used to construct the relationship between limited conventional well-log suites and sparse core data. Porosity is the desired output, and two conventional well-log responses (gamma ray [GR] and bulk density) and three well-log-derived parameters (the slope of GR, the slope of density, and [Formula: see text]) are input parameters. A global stochastic searching algorithm, particle swarm optimization (PSO), is applied to improve the efficiency of locating the appropriate values of five control parameters in MKF-SVM model. The results of SVM with different traditional kernel functions were compared, and the MKF-SVM model provided an improvement over the traditional SVM model. To confirm the advantage of the hybrid PSO-MKF-SVM model, the results from three models: (1) radial basis function (RBF)-based least-squares SVM, (2) multilayer perceptron artificial neural network (ANN), and (3) RBF ANN, are compared with the result of the hybrid PSO-MKF-SVM model. The results indicate that the hybrid PSO-MKF-SVM model improves porosity prediction with the highest correlation coefficient ([Formula: see text] of 0.9560), the highest coefficient of determination ([Formula: see text] of 0.9140), the lowest root-mean-square error (1.6505), average absolute error value (1.4050), and maximum absolute error (2.717).

Geochemistry & Geophysics↗

Structuring Nutrient Yields throughout Mississippi/Atchafalaya River Basin Using Machine Learning Approaches

To minimize the eutrophication pressure along the Gulf of Mexico or reduce the size of the hypoxic zone in the Gulf of Mexico, it is important to understand the underlying temporal and spatial variations and correlations in excess nutrient loads, which are strongly associated with the formation of hypoxia. This study’s objective was to reveal and visualize structures in high-dimensional datasets of nutrient yield distributions throughout the Mississippi/Atchafalaya River Basin (MARB). For this purpose, the annual mean nutrient concentrations were collected from thirty-three US Geological Survey (USGS) water stations scattered in the upper and lower MARB from 1996 to 2020. Eight surface water quality indicators were selected to make comparisons among water stations along the MARB over the past two decades. Principal component analysis (PCA) was used to comprehensively evaluate the nutrient yields across thirty-three USGS monitoring stations and identify the major contributing nutrient loads. The results showed that all samples could be analyzed using two main components, which accounted for 81.6% of the total variance. The PCA results showed that yields of orthophosphate (OP), silica (SI), nitrate–nitrites (NO 3 -NO 2 ), and total suspended sediment (TSS) are major contributors to nutrient yields. It also showed that land-planted crops, density of population, domestic and industrial discharges, and precipitation are fundamental causes of excess nutrient loads in MARB. These factors are of great significance for the excess nutrient load management and pollution control of the Mississippi River. It was found that the average nutrient yields were stable within the sub-MARB area, but the large nitrogen yields in the upper MARB and the large phosphorus yields in the lower MARB were of great concern. t-distributed stochastic neighbor embedding (t-SNE) revealed interesting nonlinear and local structures in nutrient yield distributions. Clustering analysis (CA) showed the detailed development of similarities in the nutrient yield distribution. Moreover, PCA, t-SNE, and CA showed consistent clustering results. This study demonstrated that the integration of dimension reduction techniques, PCA, and t-SNE with CA techniques in machine learning are effective tools for the visualization of the structures of the correlations in high-dimensional datasets of nutrient yields and provide a comprehensive understanding of the correlations in the distributions of nutrient loads across the MARB.

54 ENVIRONMENTAL SCIENCES↗

Toward the modeling of land use change: A spatial analysis using remote sensing and historical data

It was hypothesized that the chronological observation of land use change could be shown to follow a predictable pattern and these patterns could be correlated with other statistical data to develop transition probabilities suitable for modeling purposes. A literature review and preliminary research, however, indicated a totally stochastic approach was not practical for simulating land use change and thus a more deterministic approach was adopted. The approach used assumes the determinants of the land use conversion process are found in the market place, where land transactions among buyers and sellers occur. Only one side of the market transaction process is studied, however, namely, the purchaser's desires in securing an ideal or suitable site. The problem was to identify the ideal qualities, quantities or attributes desired in an industrial site (or housing development), and to formulate a general algorithmic statement capable of identifying potential development sites. Research procedures involved developing a list of variables previously noted in the literature to be related to site selection and streamlining the list to a set suitable for statistical testing. A sample of 157 industries which have located (or relocated) in the 16-county Knoxville metropolitan region since 1950 was selected for industrial location analysis. Using NASA color infrared photography and Tennessee Valley Authority historical aerial photography, data were collected on the spatial characteristics of each industrial location event. These data were then subjected to factor analysis to determine the interrelations of variables.

Honea, R. B.↗

Uniform Dust Deposition System for Dust Tolerance Studies

Future missions to the Moon will require mechanisms and materials to effectively and reliably operate in the presences of lunar regolith. One of the challenges of developing such technologies is terrestrial testing with lunar dust simulants. Dust has a stochastic nature of depositing and it can be difficult to accurately apply it to surfaces of interest. Deposition density, particles size distribution, and percent coverage are all factors that affect the quality of dust mitigation testing. Therefore, to enable such testing the dust mitigation and seals teams at NASA Glenn Research Center (GRC) have developed a system that can uniformly and repeatably deposit lunar simulants on a range of surfaces. Testing of the Dust Deposition System (DDS) and an associatedsimulant preparation methodology have quantified the levels of uniformity and precision for this system. Furthermore, the deposition system has been paired with automated micrograph capturing and machine learning image analysis to correlate the images of dust on a surface to deposition density (in g/cm2). This correlation alleviates the need for tested samples to be accurately weighed with milligram precision and may be a useful tool for in-situ contamination evaluation on the Moon. This paper covers the design and validation testing for the DDS.

Stephen Gerdts↗

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗

Uniform Dust Deposition System for Dust Tolerance Studies

Future missions to the Moon will require mechanisms and materials to effectively and reliably operate in the presences of lunar regolith. One of the challenges of developing such technologies is terrestrial testing with lunar dust simulants. Dust has a stochastic nature of depositing and it can be difficult to accurately apply it to surfaces of interest. Deposition density, particles size distribution, and percent coverage are all factors that affect the quality of dust mitigation testing. Therefore, to enable such testing the dust mitigation and seals teams at NASA Glenn Research Center (GRC) have developed a system that can uniformly and repeatably deposit lunar simulants on a range of surfaces. Testing of the Dust Deposition System (DDS) and an associated simulant preparation methodology have quantified the levels of uniformity and precision for this system. Furthermore, the deposition system has been paired with automated micrograph capturing and machine learning image analysis to correlate the images of dust on a surface to deposition density (in g/cm2). This correlation alleviates the need for tested samples to be accurately weighed with milligram precision and may be a useful tool for in-situ contamination evaluation on the Moon. This paper covers the design and validation testing for the DDS.

Dust↗

Effect of Shear Displacement and Stress Changes on Fracture Hydraulic Aperture and Flow Anisotropy

Fluid flow in fractures has the potential to drastically change the economic, environmental, and safety risks associated with a subsurface operation. This work focuses on the analysis of experimental shear fracturing and subsequent shear displacement of a shale specimen that contains multiple pre-existing natural fractures. A triaxial direct shear apparatus with concurrent µCT imaging allowed continuous monitoring of sample permeability and changes in fracture geometry during fracture creation, displacement, and changes in stress. Steady-state, low Reynolds number fluid flow simulations were used to determine the changes of each individual fracture’s hydraulic aperture due to displacement and effective stress. The development of anisotropy in the hydraulic aperture of a generated shear fracture was determined for shear displacements of 0.38, 0.74, and 2.04 mm. At high confining stress (30 MPa), shear displacement significantly reduced the hydraulic aperture of the shear fracture to below flow detectable limits and X-ray imaging resolution (23 × 23 × 23 µm 3 ). The shear generated fracture was found to be more sensitive to changes in effective stress compared to the pre-existing natural fractures. Existing models derived from fluid flow equations accounting for stochastic fracture roughness were able to partially fit the simulated flow properties of the pre-existing fractures, but no model was found to fit the flow properties of the newly formed shear fracture. These results are the first report of simultaneous changes in the geometry and flow properties of surrounding, parallel natural fractures as a shear fracture is generated with varying stress and shear displacement conditions.

58 GEOSCIENCES↗

Cluster decomposition of full configuration interaction wave functions: A tool for chemical interpretation of systems with strong correlation

Approximate full configuration interaction (FCI) calculations have recently become tractable for systems of unforeseen size, thanks to stochastic and adaptive approximations to the exponentially scaling FCI problem. The result of an FCI calculation is a weighted set of electronic configurations, which can also be expressed in terms of excitations from a reference configuration. The excitation amplitudes contain information on the complexity of the electronic wave function, but this information is contaminated by contributions from disconnected excitations, i.e., those excitations that are just products of independent lower-level excitations. The unwanted contributions can be removed via a cluster decomposition procedure, making it possible to examine the importance of connected excitations in complicated multireference molecules which are outside the reach of conventional algorithms. We present an implementation of the cluster decomposition analysis and apply it to both true FCI wave functions, as well as wave functions generated from the adaptive sampling CI algorithm. Furthermore, the cluster decomposition is useful for interpreting calculations in chemical studies, as a diagnostic for the convergence of various excitation manifolds, as well as as a guidepost for polynomially scaling electronic structure models. Applications are presented for (i) the double dissociation of water, (ii) the carbon dimer, (iii) the π space of polyacenes, and (iv) the chromium dimer. While the cluster amplitudes exhibit rapid decay with an increasing rank for the first three systems, even connected octuple excitations still appear important in Cr 2 , suggesting that spin-restricted single-reference coupled-cluster approaches may not be tractable for some problems in transition metal chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗