Search NASA⌕ Search

SEARCH · Search NASA

Results for “SAMPLER”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Bayesian Calibration of the Community Land Model using Surrogates

We present results from the Bayesian calibration of hydrological parameters of the Community Land Model (CLM), which is often used in climate simulations and Earth system models. A statistical inverse problem is formulated for three hydrological parameters, conditioned on observations of latent heat surface fluxes over 48 months. Our calibration method uses polynomial and Gaussian process surrogates of the CLM, and solves the parameter estimation problem using a Markov chain Monte Carlo sampler. Posterior probability densities for the parameters are developed for two sites with different soil and vegetation covers. Our method also allows us to examine the structural error in CLM under two error models. We find that accurate surrogate models can be created for CLM in most cases. The posterior distributions lead to better prediction than the default parameter values in CLM. Climatologically averaging the observations does not modify the parameters’ distributions significantly. The structural error model reveals a correlation time-scale which can potentially be used to identify physical processes that could be contributing to it. While the calibrated CLM has a higher predictive skill, the calibration is under-dispersive.

Bayesian calibration↗

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗

Hierarchical Gaussian Random Field Sampling for Multilevel Markov Chain Monte Carlo: Coupling Stochastic Partial Differential Equation and the Karhunen–Loève Decomposition

This work introduces structure preserving hierarchical decompositions for sampling Gaussian random fields (GRFs) within the context of multilevel Bayesian inference in high-dimensional space. Existing scalable hierarchical sampling methods, such as those based on stochastic partial differential equations (SPDEs), often reduce the dimensionality of the sample space at the cost of accuracy of inference. Other approaches, such that those based on Karhunen-Loève (KL) expansions, offer sample space dimensionality reduction but sacrifice GRF representation accuracy and ergodicity of the Markov chain Monte Carlo (MCMC) sampler and are computationally expensive for high-dimensional problems. The proposed method integrates the dimensionality reduction capabilities of KL expansions with the scalability of SPDE-based sampling, thereby providing a robust, unified framework for high-dimensional uncertainty quantification (UQ) that is scalable and accurate, preserves ergodicity, and offers dimensionality reduction of the sample space. The hierarchy in our multilevel algorithm is derived from the geometric multigrid hierarchy. By constructing a hierarchical decomposition that maintains the covariance structure across the levels in the hierarchy, the approach enables efficient coarse-to-fine sampling while ensuring that all samples are drawn from the desired distribution. The effectiveness of the proposed method is demonstrated on a benchmark subsurface flow problem, demonstrating its effectiveness in improving computational efficiency and statistical accuracy. Furthermore, our proposed technique is more efficient and accurate and displays better convergence properties than existing methods for high-dimensional Bayesian inference problems.

Gaussian random fields↗

Implementing and evaluating a Gaussian mixture framework for identifying gene function from TnSeq data

The rapid acceleration of microbial genome sequencing increases opportunities to understand bacterial gene function. Unfortunately, only a small proportion of genes have been studied. Recently, TnSeq has been proposed as a cost-effective, highly reliable approach to predict gene functions as a response to changes in a cell’s fitness before-after genomic changes. However, major questions remain about how to best determine whether an observed quantitative change in fitness represents a meaningful change. To address the limitation, we develop a Gaussian mixture model framework for classifying gene function from TnSeq experiments. In order to implement the mixture model, we present the Expectation-Maximization algorithm and a hierarchical Bayesian model sampled using Stan’s Hamiltonian Monte-Carlo sampler. We compare these implementations against the frequentist method used in current TnSeq literature. From simulations and real data produced by E.coli TnSeq experiments, we show that the Bayesian implementation of the Gaussian mixture framework provides the most consistent classification results.

Li, Kevin↗

Production Application Performance Data Streaming for System Monitoring

In this article, we present an approach to streaming collection of application performance data. Practical application performance tuning and troubleshooting in production high-performance computing (HPC) environments requires an understanding of how applications interact with the platform, including (but not limited to) parallel programming libraries such as Message Passing Interface (MPI). Several profiling and tracing tools exist that collect heavy runtime data traces either in memory (released only at application exit) or on a file system (imposing an I/O load that may interfere with the performance being measured). Although these approaches are beneficial in development stages and post-run analysis, a systemwide and low-overhead method is required to monitor deployed applications continuously. This method must be able to collect information at both the application and system levels to yield a complete performance picture. In our approach, an application profiler collects application event counters. A sampler uses an efficient inter-process communication method to periodically extract the application counters and stream them into an infrastructure for performance data collection. We implement a tool-set based on our approach and integrate it with the Lightweight Distributed Metric Service (LDMS) system, a monitoring system used on large-scale computational platforms. LDMS provides the infrastructure to create and gather streams of performance data in a low overhead manner. We demonstrate our approach using applications implemented with MPI, as it is one of the most common standards for the development of large-scale scientific applications. We utilize our tool-set to study the impact of our approach on an open source HPC application, Nalu. Our tool-set enables us to efficiently identify patterns in the behavior of the application without source-level knowledge. We leverage LDMS to collect system-level performance data and explore the correlation between the system and application events. Finally, we demonstrate how our tool-set can help detect anomalies with a low latency. We run tests on two different architectures: a system enabled with Intel Xeon Phi and another system equipped with Intel Xeon processor. Our overhead study shows our method imposes at most 0.5% CPU usage overhead on the application in realistic deployment scenarios.

59 BASIC BIOLOGICAL SCIENCES↗

AGS-GNN: Attribute-guided Sampling for Graph Neural Networks

We propose AGS-GNN, a novel attribute-guided sampling algorithm for Graph Neural Networks (GNNs) that exploits node features and connectivity structure of a graph while simultaneously adapting for both homophily and heterophily in graphs. (In homophilic graphs vertices of the same class are more likely to be connected, and vertices of different classes tend to be linked in heterophilic graphs.) While GNNs have been successfully applied to homophilic graphs, their application to heterophilic graphs remains challenging. The best-performing GNNs for heterophilic graphs do not fit the sampling paradigm, suffer high computational costs, and are not inductive. We employ samplers based on feature-similarity and feature-diversity to select subsets of neighbors for a node, and adaptively capture information from homophilic and heterophilic neighborhoods using dual channels. Currently, AGS-GNN is the only algorithm that we know of that explicitly controls homophily in the sampled subgraph through similar and diverse neighborhood samples. For diverse neighborhood sampling, we employ submodularity, which was not used in this context prior to our work. The sampling distribution is pre-computed and highly parallel, achieving the desired scalability. Using an extensive dataset consisting of 35 small (<=100K nodes) and large (>100K nodes) homophilic and heterophilic graphs, we demonstrate the superiority of AGS-GNN compare to the current approaches in the literature. AGS-GNN achieves comparable test accuracy to the best-performing heterophilic GNNs, even outperforming methods using the entire graph for node classification. AGS-GNN also converges faster compared to methods that sample neighborhoods randomly, and can be incorporated into existing GNN models that employ node or graph sampling.

artificial intelligence↗

Turbidity and suspended sediment data for Gwynns Falls, Baisman Run, and Pond Branch, Baltimore County and Baltimore City, MD, USA

This resource includes turbidity and suspended sediment data collected at two sampling stations located on Gwynns Falls in Baltimore County, MD, USA. In addition, two forested reference sites, Baisman Run and Pond Branch at Oregon Ridge, and two urban sites, Dead Run and Maiden's Choice Run (tributaries to Gwynns Falls), were sampled in Baltimore County and Baltimore City, MD, USA. Turbidity sensor data were collected at a 5-minute frequency using YSI EXO2 sondes. Suspended sediment was collected using ISCO samplers for the purpose of establishing correlations between turbidity and suspended sediment concentration. The six sites are co-located with USGS stream gages. This resource is part of the Baltimore Social-Environmental Collaborative Urban Integrated Field Laboratory supported by Department of Energy as well as the Critical Zone Collaborative Network supported by National Science Foundation. This resource includes a technical report summarizing the findings.

58 GEOSCIENCES↗

Parameter Optimization Toolbox for NS-3 network optimization, NS-3 Parameter Optimization Framework [SWR-18-60]

This simulation-based parameter optimization framework is proposed to tune parameters of different types of communication networks using ns-3 to achieve the optimal network performance. It consists of three main components: an ns-3 packet reporting module; a sampler running simulations with all possible parameter sets for the input parameter variables by using a parallel executor at each generation; and a hybrid optimization algorithm for tuning configurable parameters of hybrid designs and application parameter variables. The proposed hybrid metaheuristic optimization algorithm combines an evolutionary algorithm with a gradient descent function to quickly achieve an approximate globally optimum solution. This software is designed to be used in a multi-core processing Linux environment and run over a long duration of time. The execution time varies depending mainly upon the nature of the ns-3 configuration being simulated. This software includes a custom ns-3 QoS measurement application which must be included with the ns-3 source code during installation of the software.

Hasandka, Adarsh↗

BIhNNs

The code enables to perform Bayesian inference in an efficient manner through the use of Hamiltonian Neural Networks (HNNs), Deep Neural Networks (DNNs), Neural ODEs, and Symplectic Neural Networks (SympNets) used with state-of-the-art sampling schemes like Hamiltonian Monte Carlo (HMC) and the No-U-Turn-Sampler (NUTS).

Dhulipala, Som↗

LFIS

Repository of the codes developed for the paper titled "Liouville Flow Importance Sampler"

Tian, Yifeng↗

NERSC_Lightweight Distributed Metric Service (NERSC_LDMS) v4.4.2

Miscellany This LDMS Loftsman/Helm Chart horizontally scales LDMS daemons in order to achieve a 1Hz sample rate from over 5,000 nodes, collecting 38k metrics per minute on Perlmutter. This LMDS Configuration relies on already running `ldmsd` producers running on nodes, which produce metrics via sampler plugins. The Helm chart distributes the collection of metrics from producer acrross many aggregator and storage `ldmsd` daemons, ensuring no damon is overloaded and data loss is avoided.

Stile, John [Lawrence Berkeley National Laboratory↗

Remote Sensing of Sea Salt Aerosol below Trade Wind Clouds

Abstract Sea salt aerosol in the boundary layer below shallow cumulus clouds is remotely observed with a Ka-band cloud radar at the Barbados Cloud Observatory and is detected in 76% of the measurements over 1 year. Carried by convection, sea salt particles with a diameter larger than 500 nm show an upward motion of 0.2 m s−1 below shallow cumulus clouds for a 2-day case study. Caused by an increasing relative humidity with increasing altitude, the sea salt particles become larger as they move closer to the cloud base. By using combined measurements of a Ka-band cloud radar and a Raman lidar, the retrieved equivolumetric diameter of the hygroscopically grown sea salt particles is found to be between 6 and 11 μm with a total number concentration of 20 cm−3 near cloud base. Assuming a fixed shape parameter, a size distribution of sea salt particles under high-relative-humidity conditions below cloud base is estimated and agrees with measurements taken by a dry-deposition sampler and online aerosol observations. The methods outlined in this paper can be used in future studies to get a better understanding of the vertical and temporal sea salt distribution in the boundary layer and sea salt aerosol–cloud interaction processes.

54 ENVIRONMENTAL SCIENCES↗

Radar-Based Bayesian Estimation of Ice Crystal Growth Parameters within a Microphysical Model

The potential for polarimetric Doppler radar measurements to improve predictions of ice microphysical processes within an idealized model–observational framework is examined. In an effort to more rigorously constrain ice growth processes (e.g., vapor deposition) with observations of natural clouds, a novel framework is developed to compare simulated and observed radar measurements, coupling a bulk adaptive-habit model of vapor growth to a polarimetric radar forward model. Bayesian inference on key microphysical model parameters is then used, via a Markov chain Monte Carlo sampler, to estimate the probability distribution of the model parameters. The statistical formalism of this method allows for robust estimates of the optimal parameter values, along with (non-Gaussian) estimates of their uncertainty. To demonstrate this framework, observations from Department of Energy radars in the Arctic during a case of pristine ice precipitation are used to constrain vapor deposition parameters in the adaptive habit model. The resulting parameter probability distributions provide physically plausible changes in ice particle density and aspect ratio during growth. A lack of direct constraint on the number concentration produces a range of possible mean particle sizes, with the mean size inversely correlated to number concentration. Consistency is found between the estimated inherent growth ratio and independent laboratory measurements, increasing confidence in the parameter PDFs and demonstrating the effectiveness of the radar measurements in constraining the parameters. Furthermore, the combined Doppler and polarimetric observations produce the highest-confidence estimates of the parameter PDFs, with the Doppler measurements providing a stronger constraint for this case.

54 ENVIRONMENTAL SCIENCES↗

Validation of KENO Delayed Neutron Fraction Capabilities

The delayed neutron fraction, which is necessary for the safe operation of reactors, varies by fissionable material and neutron spectrum. A prompt fission neutron spectrum has been included in the SCALE 6.2 release to account for the removal of delayed neutrons from precursor materials from the neutron balance. This paper describes how experimental measurements from criticality safety benchmarks were used to validate the SCALE calculational procedure for the delayed neutron fraction. Additionally, the effect of nuclear data uncertainty on the KENO calculation of β eff was examined with the SAMPLER sequence.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Shallow (2-meter) Temperature Surveys in Colorado

Shallow temperature surveys are useful in early-stage geothermal exploration to delineate surface outflow zones, with the intent to identify the source of upwelling, usually a fault. Detailed descriptions of the 2-meter survey method and equipment design can be found in Coolbaugh et al. (2007) and Sladek et al. (2007), and are summarized here. The survey method was devised to measure temperature as far below the zone of solar influence as possible, have minimal equilibration time, and yet be portable enough to fit on the back of an all-terrain vehicle (ATV); Figure 2). This method utilizes a direct push technology (DPT) technique where 2.3 m long, 0.54" outer diameter hollow steel rods are pounded into the ground using a demolition hammer. Resistance temperature devices (RTD) are then inserted into the rods at 2-meter depths, and allowed to equilibrate for one hour. The temperatures are then measured and recorded, the rods pulled out of the ground, and re-used at future sites. Usually multiple rods are planted over the course of an hour, and then the sampler returns back to the first station, measures the temperatures, pulls the rods, and so on, to eliminate waiting time. At Wagon Wheel Gap, 32 rods were planted around the hot springs between June 20 and July 1, 2012. The purpose was to determine the direction of a possible upflow fault or other structure. Temperatures at 1.5m and 2m depths were measured and recorded in the attribute table of this point shapefile. Several anomalous temperatures suggest that outflow is coming from a ~N60W striking fault or shear zone that contains the quartz-fluorite-barite veins of the adjacent patented mining claims. It should be noted that temperatures at 2m depth vary according to the amount of solar heating from above, as well as possible geothermal heating from below.

15 GEOTHERMAL ENERGY↗

Wet and dry plastic deposition data for western US National Atmospheric Deposition Program sites (2017-2019)

Raw plastic counts and calculated plastic deposition rates for 11 National Atmospheric Deposition Program (NADP) sites in the western USA recorded from 2017-2019. Samples were collected to determine plastic deposition rates in remote locations and identify the potential sources of plastic to the atmosphere. Samples were collected using an Aerochem Metrics Wet and Dry sampler. Wet deposition refers to the material retained on a 0.45-micron filter. Dry deposition refers to the dry only deposition collected using a Dry Side Insert (DSI) (Brahney et al. 2020). Plastics are identified as either fibers or particles (includes small colored films). Wet deposition rates are recorded weekly and dry plastic deposition rates are based on monthly sampling intervals. Sites included are Grand Canyon National Park (AZ03), Joshua Tree National Park (CA67), Rocky Mountain National Park (CO98), Niwot Ridge (CO02), Ashley National Forest (UT95), East River SFA (CO10)), Craters of the Moon National Park (ID03), Great Basin National Park (NV05), Canyonlands National Park (UT09), Bryce Canyon Nationa Park (UT99), and Wind River Range (WY06). Data collection is being published in collaboration with the Department of Energy's research project, "Constraining physical understanding of aerosol loading, biogeochemistry, and snowmelt hydrology from hillslope to watershed scale in the East River Scientific Focus Areas.

54 ENVIRONMENTAL SCIENCES↗

Effect of fluctuating redox conditions on trace metal release from wetland soils from South Carolina and stream sediments from Tennessee

Natural aquatic systems undergo fluctuating redox conditions due to microbial activity, varying water saturation levels, and nutrients dynamics. With fluctuating oxic and anoxic conditions, trace metals can be mobilized or sequestered in response to changes in iron and sulfur speciation and the concentrations and lability of organic carbon. We conducted a systematic laboratory-based microcosm study to examine the effect of redox fluctuations on trace metal mobility in samples collected from two different natural aquatic systems: riparian wetlands and a stream. We incubated water-saturated soils under three cycles of anoxic-oxic conditions (τanoxic:τoxic = 3) spanning 24 days and monitored the change in dissolved and bioavailable metal (copper (Cu), nickel (Ni), zinc (Zn), cobalt (Co), iron (Fe), and manganese (Mn)) concentrations. The dataset includes the results of the variation in metal concentrations due to redox fluctuations in wetland soils and stream sediments. Additionally, the variation in the bioavailable concentration of metals obtained using passive samplers based on diffuse gradient in thin-films technique is included in the dataset. We have also reported the change in the pH values and dissolved oxygen concentrations in the microcosms during the entire study of 24 days. The dataset also contains the dissolved organic carbon and sulfate concentrations, and the data on fractions of metals bound to reducible and oxidizable phases. For materials from both the wetlands and the stream, anoxic conditions favored Co and Zn release, which corresponded with the reductive dissolution of iron oxides. In contrast, dissolved Cu concentrations increased under oxic conditions for both sites and correlated positively with the release of sulfate. In wetland soils, dissolution of Fe (hydr)oxides increased Ni solubility; however, in stream sediments, Ni release occurred when sulfides or organic matter were oxidized. For stream sediments, each subsequent redox cycle increased the bioavailability of trace metals. Upon redox fluctuations in wetland soils, the bioavailability of Zn and Cu increased, whereas bioavailable Ni and Co decreased. This study illustrates that different trace metals display distinct bioavailability patterns during oxic-anoxic fluctuations in natural environments. The biogeochemical cycling of carbon and nitrogen in systems with redox fluctuations may be influenced by these patterns in trace metal availability in addition to the availability of electron donors and acceptors.

54 ENVIRONMENTAL SCIENCES↗

Plant Characteristics, Porewater, Gas Flux, and Soil Biogeochemistry at Council Road Site Mile Marker 71, Seward Peninsula, Alaska, 2023

Data collected at Council, AK (64°51’35.0”N 163°41’59.1”W) during a summer campaign in 2023. Water data consists of soil porewater collected by centrifuging soil cores and also by field collection with porewater samplers (rhizons). Gas data consists of CO2, CH4 and N2O surface soil fluxes measured with a portable FTIR analyzer. Plant and root data consists of biomass, root length, diameter and mass. Soil data consists of total C and N. Air, water and soil samples span two main locations: a thermokarst wetland and an upland tussock. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).This dataset was generated to broadly address the following research question: how will climate change (i.e., thawing permafrost, landscape change) alter the ecosystem flux (sink versus source) of important greenhouse gases such as CO2, CH4 and N2O?Description of the contents of this data package: This dataset contains 5 different individual .csv files containing plant, soil, water and gas data. No software is needed to utilize them. PFTCover: Plant functional type ground cover in 1x1 meter plots. SoilCores: Solidphase and porewater phase soil biogeochemical variablesPlantData: Above and belowground plant traits. GasFlux: Surface plant-soil gas measurementsFieldPorewater: Field collected porewater biogeochemical variables

54 ENVIRONMENTAL SCIENCES↗