Search NASA⌕ Search

SEARCH · Search NASA

Results for “hierarchical sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Multilevel, Hierarchical Sampling Technique for Spatially Correlated Random Fields

In this paper, we propose an alternative method to generate samples of a spatially correlated random field with applications to large-scale problems for forward propagation of uncertainty. A classical approach for generating these samples is the Karhunen--Loève (KL) decomposition. However, the KL expansion requires solving a dense eigenvalue problem and is therefore computationally infeasible for large-scale problems. Sampling methods based on stochastic partial differential equations provide a highly scalable way to sample Gaussian fields, but the resulting parametrization is mesh dependent. We propose a multilevel decomposition of the stochastic field to allow for scalable, hierarchical sampling based on solving a mixed finite element formulation of a stochastic reaction-diffusion equation with a random, white noise source function. Lastly, numerical experiments are presented to demonstrate the scalability of the sampling method as well as numerical results of multilevel Monte Carlo simulations for a subsurface porous media flow application using the proposed sampling method.

97 MATHEMATICS AND COMPUTING↗

Iterative self-organizing SCEne-LEvel sampling (ISOSCELES) for large-scale building extraction

Convolutional neural networks (CNN) provide state-of-the-art performance in many computer vision tasks, including those related to remote-sensing image analysis. Successfully training a CNN to generalize well to unseen data, however, requires training on samples that represent the full distribution of variation of both the target classes and their surrounding contexts. With remote sensing data, acquiring a sufficiently representative training set is a challenge due to both the inherent multi-modal variability of satellite or aerial imagery and the general high cost of labeling data. To address this challenge, we have developed ISOSCELES, an Iterative Self-Organizing SCEne LEvel Sampling method for hierarchical sampling of large image sets. Using affinity propagation, ISOSCELES automates the selection of highly representative training images. Compared to random sampling or using available reference data, the distribution of the training is principally data driven, reducing the chance of oversampling uninformative areas or undersampling informative ones. In comparison to manual sample selection by an analyst, ISOSCELES exploits descriptive features, spectral and/or textural, and eliminates human bias in sample selection. Using a hierarchical sampling approach, ISOSCELES can obtain a training set that reflects both between-scene variability, such as in viewing angle and time of day, and within-scene variability at the level of individual training samples. We verify the method by demonstrating its superiority to stratified random sampling in the challenging task of adapting a pre-trained model to a new image and spatial domain for country-scale building extraction. Using a pair of hand-labeled training sets comprising 1,987 sample image chips, a total of 496,000,000 individually labeled pixels, we show, across three distinct model architectures, an increase in accuracy, as measured by F1-score, of 2.2–4.2%.

42 ENGINEERING↗

Using Dynamic Quantum Clustering to Analyze Hierarchically Heterogeneous Samples on the Nanoscale

Dynamic Quantum Clustering (DQC) is an unsupervised, high visual data mining technique. DQC was tested as an analysis method for X-ray Absorption Near Edge Structure (XANES) data from the Transmission X-ray Microscopy (TXM) group. The TXM group images hierarchically heterogeneous materials with nanoscale resolution and large field of view. XANES data consists of energy spectra for each pixel of an image. It was determined that DQC successfully identifies structure in data of this type without prior knowledge of the components in the sample. Clusters and sub-clusters clearly reflected features of the spectra that identified chemical component, chemical environment, and density in the image. DQC can also be used in conjunction with the established data analysis technique, which does require knowledge of components present.

99 GENERAL AND MISCELLANEOUS↗

Substrate Type Determines Metagenomic Profiles from Diverse Chemical Habitats

Environmental parameters drive phenotypic and genotypic frequency variations in microbial communities and thus control the extent and structure of microbial diversity. Here, we tested the extent to which microbial community composition changes are controlled by shifting physiochemical properties within a hypersaline lagoon. We sequenced four sediment metagenomes from the Coorong, South Australia from samples which varied in salinity by 99 Practical Salinity Units (PSU), an order of magnitude in ammonia concentration and two orders of magnitude in microbial abundance. Despite the marked divergence in environmental parameters observed between samples, hierarchical clustering of taxonomic and metabolic profiles of these metagenomes showed striking similarity between the samples (.89%). Comparison of these profiles to those derived from a wide variety of publically available datasets demonstrated that the Coorong sediment metagenomes were similar to other sediment, soil, biofilm and microbial mat samples regardless of salinity (.85% similarity). Overall, clustering of solid substrate and water metagenomes into discrete similarity groups based on functional potential indicated that the dichotomy between water and solid matrices is a fundamental determinant of community microbial metabolism that is not masked by salinity, nutrient concentration or microbial abundance.

59 BASIC BIOLOGICAL SCIENCES↗

Change of texture, microdeformation and hardness in surface layer of TiNi alloy depending on the number of pulses of electron beam effects

This work comprises a study of the influence of the pulse number of low-energy high-current electron beam (LEHCEB) exposure on the value and character of distribution of residual elastic stresses, texturing effects and the relationship between structural-phase states and physical and mechanical properties of the modified surface layers of TiNi alloy. LEHCEB processing of the surface of TiNi samples was carried out using a RITM-SP [3] installation. Energy density of electron beam was constant at E{sub s} = 3.9 ± 0.5 J/cm{sup 2}; pulse duration was 2.8 ± 0.3 μs. The number of pulses in the series was changeable, (n = 2–128). It was shown that as the result of multiple LEHCEB processing of TiNi samples, hierarchically organized multilayer structure is formed in the surface layer. The residual stress field of planar type is formed in the modified surface layer as following: in the direction of the normal to the surface the strain component ε{sub ⊥} < 0 (compressing strain), and in a direction parallel to the surface, the strain component ε{sub ||} > 0 (tensile deformation). Texturing effects and the level of residual stresses after LEHCEB processing of TiNi samples with equal energy density of electron beam (∼3.8 J/cm{sup 2}) depend on the number of pulses and increase with the rise of n > 10.

36 MATERIALS SCIENCE↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Stabilized multilevel Monte Carlo method for stiff stochastic differential equations

A multilevel Monte Carlo (MLMC) method for mean square stable stochastic differential equations with multiple scales is proposed. For such problems, that we call stiff, the performance of MLMC methods based on classical explicit methods deteriorates because of the time step restriction to resolve the fastest scales that prevents to exploit all the levels of the MLMC approach. We show that by switching to explicit stabilized stochastic methods and balancing the stabilization procedure simultaneously with the hierarchical sampling strategy of MLMC methods, the computational cost for stiff systems is significantly reduced, while keeping the computational algorithm fully explicit and easy to implement. Numerical experiments on linear and nonlinear stochastic differential equations and on a stochastic partial differential equation illustrate the performance of the stabilized MLMC method and corroborate our theoretical findings.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Micro on a macroscale: relating microbial-scale soil processes to global ecosystem function

ABSTRACT Soil microorganisms play a key role in driving major biogeochemical cycles and in global responses to climate change. However, understanding and predicting the behavior and function of these microorganisms remains a grand challenge for soil ecology due in part to the microscale complexity of soils. It is becoming increasingly clear that understanding the microbial perspective is vital to accurately predicting global processes. Here, we discuss the microbial perspective including the microbial habitat as it relates to measurement and modeling of ecosystem processes. We argue that clearly defining and quantifying the size, distribution and sphere of influence of microhabitats is crucial to managing microbial activity at the ecosystem scale. This can be achieved using controlled and hierarchical sampling designs. Model microbial systems can provide key data needed to integrate microhabitats into ecosystem models, while adapting soil sampling schemes and statistical methods can allow us to collect microbially-focused data. Quantifying soil processes, like biogeochemical cycles, from a microbial perspective will allow us to more accurately predict soil functions and address long-standing unknowns in soil ecology.

59 BASIC BIOLOGICAL SCIENCES↗

Predicting the offshore distribution and abundance of marine birds with a hierarchical community distance sampling model

Abstract Proposed offshore wind energy development on the Atlantic Outer Continental Shelf has brought attention to the need for baseline studies of the distribution and abundance of marine birds. We compiled line transect data from 15 shipboard surveys (June 2012–April 2014), along with associated remotely sensed habitat data, in the lower Mid‐Atlantic Bight off the coast of Delaware, Maryland, and Virginia, USA . We implemented a recently developed hierarchical community distance sampling model to estimate the seasonal abundance of 40 observed marine bird species. Treating each season separately, we included six oceanographic parameters to estimate seabird abundance: three static (distance to shore, slope, sediment grain size) and three dynamic covariates (sea surface temperature [ SST ], salinity, primary productivity). We expected that avian bottom‐feeders would respond primarily to static covariates that characterize seafloor variability, and that surface‐feeders would respond more to dynamic covariates that quantify surface productivity. We compared the variation in species‐specific and community‐level responses to these habitat features, including for rare species, and we predicted species abundance across the study area. While several protected species used the study area in summer during their breeding season, estimated abundance and observed diversity were highest for nonbreeding species in winter. Distance to shore was the most common significant predictor of abundance, and thus useful in estimating the potential exposure of marine birds to offshore development. In many cases, our expectations based on feeding ecology were confirmed, such as in the first winter season, when bottom‐feeders associated significantly with the three static covariates (distance to shore, slope, and sediment grain size), and surface‐feeders associated significantly with two dynamic covariates ( SST , primary productivity). However, other cases revealed significant relationships between static covariates and surface‐feeders (e.g., distance to shore) and between dynamic covariates and bottom‐feeders (e.g., primary productivity during that same winter). More generally, we found wide interannual, seasonal, and interspecies variation in habitat relationships with abundance. These results show the importance of quantifying detection and determining the ecological drivers of a community's distribution and abundance, within and among species, for evaluating the potential exposure of marine birds to offshore development.

Goyert, Holly F.↗

Hierarchical Gaussian Random Field Sampling for Multilevel Markov Chain Monte Carlo: Coupling Stochastic Partial Differential Equation and the Karhunen–Loève Decomposition

This work introduces structure preserving hierarchical decompositions for sampling Gaussian random fields (GRFs) within the context of multilevel Bayesian inference in high-dimensional space. Existing scalable hierarchical sampling methods, such as those based on stochastic partial differential equations (SPDEs), often reduce the dimensionality of the sample space at the cost of accuracy of inference. Other approaches, such that those based on Karhunen-Loève (KL) expansions, offer sample space dimensionality reduction but sacrifice GRF representation accuracy and ergodicity of the Markov chain Monte Carlo (MCMC) sampler and are computationally expensive for high-dimensional problems. The proposed method integrates the dimensionality reduction capabilities of KL expansions with the scalability of SPDE-based sampling, thereby providing a robust, unified framework for high-dimensional uncertainty quantification (UQ) that is scalable and accurate, preserves ergodicity, and offers dimensionality reduction of the sample space. The hierarchy in our multilevel algorithm is derived from the geometric multigrid hierarchy. By constructing a hierarchical decomposition that maintains the covariance structure across the levels in the hierarchy, the approach enables efficient coarse-to-fine sampling while ensuring that all samples are drawn from the desired distribution. The effectiveness of the proposed method is demonstrated on a benchmark subsurface flow problem, demonstrating its effectiveness in improving computational efficiency and statistical accuracy. Furthermore, our proposed technique is more efficient and accurate and displays better convergence properties than existing methods for high-dimensional Bayesian inference problems.

Gaussian random fields↗

Determining the Bayesian optimal sampling strategy in a hierarchical system.

Consider a classic hierarchy tree as a basic model of a 'system-of-systems' network, where each node represents a component system (which may itself consist of a set of sub-systems). For this general composite system, we present a technique for computing the optimal testing strategy, which is based on Bayesian decision analysis. In previous work, we developed a Bayesian approach for computing the distribution of the reliability of a system-of-systems structure that uses test data and prior information. This allows for the determination of both an estimate of the reliability and a quantification of confidence in the estimate. Improving the accuracy of the reliability estimate and increasing the corresponding confidence require the collection of additional data. However, testing all possible sub-systems may not be cost-effective, feasible, or even necessary to achieve an improvement in the reliability estimate. To address this sampling issue, we formulate a Bayesian methodology that systematically determines the optimal sampling strategy under specified constraints and costs that will maximally improve the reliability estimate of the composite system, e.g., by reducing the variance of the reliability distribution. This methodology involves calculating the 'Bayes risk of a decision rule' for each available sampling strategy, where risk quantifies the relative effect that each sampling strategy could have on the reliability estimate. A general numerical algorithm is developed and tested using an example multicomponent system. The results show that the procedure scales linearly with the number of components available for testing.

99 GENERAL AND MISCELLANEOUS↗

Stochastic nonlinear analysis of unidirectional fiber composites using image-based microstructural uncertainty quantification

Here, we present a data-driven nonlinear uncertainty quantification and propagation framework to study the microstructure-induced stochastic performance of unidirectional (UD) carbon fiber reinforced polymer (CFRP) composites. The proposed approach integrates (1) microscopic image characterization, (2) stochastic microstructure reconstruction, and (3) efficient multiscale finite element simulations enabled by self-consistent clustering (SCA) analysis. To model the complex microstructural variability, the proposed UQ methods take the non-Gaussian uncertainty sources into account through a distribution-free sampling approach leveraging nonparametric and asymptotic statistical tools. A hierarchical conditional sampling strategy enables the simultaneous sampling of multiple sources of uncertainties. Our approach provides insights into the impact of microstructural variabilities, which are shown to have an increasing impact on the nonlinear responses of UD CFRP parts under progressive compression loading and ultimately on the failure rate over time. We discover that before CFRP parts start to fail, a characteristic time period emerges with distinctive uncertainty distributions specific to the microstructure variability and the probability of failure. Identifying the failure time period is crucial to the reliability prediction, which is an essential component of CFRP design.

36 MATERIALS SCIENCE↗

hiposa v0.1.0

Fast construction of hierarchical N-dimensional experimental design. The software allows construction of sampling strategies that are self-avoiding, tunable in resolution in N dimensions. This code is a drop-in replacement for seeding optimization runs often performed using uniform random sampling. The hierarchical approach allows for a rapid, top down method for construction the most effective design that drives towards a global optimum.

Zwart, PetrusH [Lawrence Berkeley National Laborat↗

Grassland Bird Distribution and Raptor Flight Patterns in the Competitive Renewable Energy Zones of the Texas Panhandle [Thesis]

The consistent wind resource in the Great Plains of North America has encouraged the development of wind energy facilities across this region. In the Texas Panhandle, a high quality wind resource is only one factor that has led to the expansion of wind energy development. Other factors include federal tax incentives and the availability of subsidies. Moreover, the State Renewable Portfolio Standards (RPS), mandating production of 10,000 mega-watts of renewable energy in the state by 2025, has contributed to an amicable regulatory and permitting environment (State Energy Conservation Office 2010). Considering the current rate of development, the RPS will be met in coming years (American Wind Energy Association 2011) and the rate of development is likely to continue. To meet increased energy demands in the face of a chronically constrained transmission grid, Texas has developed a comprehensive plan that organizes and prioritizes new transmission systems in high quality wind resource areas called Competitive Renewable Energy Zones (CREZ). The CREZ plan provides developers a solution to transmission constraints and unlocks large areas of undeveloped wind resource areas. In the northern Texas panhandle, there are two CREZs that are classified Class 3 wind (Class 5 is the highest) and range from 862,725 to 1,772,328 ha in size (Public Utility Commission of Texas 2008). Grassland bird populations have declined more than any other bird group in North America (Peterjohn and Sauer 1999, Sauer et al. 2004). Loss of grassland habitat from agricultural development has been the greatest contributor to the decline of grassland bird populations, but development of non-renewable (i.e., oil, coal, and gas) and renewable energy (i.e., wind, solar, biomass, and geothermal) sources have contributed to the decline as well (Pimentel et al. 2002, Maybe and Paul 2007). The effects of wind energy development on declining grassland bird populations has become an area of extensive research, as we attempt to understand and minimize potential impacts of a growing energy sector on declining bird populations. Based on data from post-construction fatality surveys, two grassland bird groups have been the specific focus of research, passerines (songbird guild) and raptors (birds of prey). The effects of wind energy development on these two groups of birds, both of conservation concern, have been examined over the last decade. The primary focus of this research has been on mortality resulting from collision with wind turbines (Kuvlesky et al. 2007). Most studies just quantify post-construction fatality levels (e.g., Erickson et al. 2002) while very few studies provide a comparison of bird populations prior to development through a Before-After-Control-Impact (BACI) study design. Before-After-Control-Impact studies provide powerful evidence of avian/wind energy relationships (Anderson et al. 1999). Despite repeated urgency on conducting these types of studies (Anderson et al. 1999, Madders and Whitfield 2006, Kuvelsky et al. 2007), few have been conducted in North America. Although several European researchers (Larsson 1994, de Lucas et al. 2007) have used BACI designs to examine whether wind facilities modified raptor behavior, there is a scarcity of BACI data relating to North America grassland ecosystems that examine avian-wind energy relationships. There are less than a handful of studies in the entire United States, let alone the southern short grass prairie ecosystem, that incorporate preconstruction data to form the baseline for post-construction impact estimates (Johnson et al. 2000, Erickson et al. 2002). Although declines in grassland bird populations are well-documented (Peterjohn and Sauer 1999, Sauer et al. 2004), the causal mechanisms affecting the decline of grassland birds with increasing wind energy development in the southern short grass prairie are not well-understood (Kuvlesky et al. 2007, Maybe and Paul 2007). Several factors may potentially affect the bird population when wind turbines are constructed in areas with high bird densities (de Lucas et al. 2007). Habitat fragmentation, noise from turbines, physical movement of turbine blades, and increased vehicle traffic have been suggested as causes of decreased density of nesting grassland birds in Minnesota (Leddy et al. 1999), Oklahoma (O’Connell and Piorkowski 2006), and South Dakota (Shaffer and Johnson 2008). Similarly, constructing turbines in areas where bird flight patterns place them at similar heights of turbine blades increases the potential for bird collisions (Johnson et al. 2000, Hoover 2002). Raptor fatalities have been associated with topographic features such as ridges, saddles and rims where birds use updrafts from prevailing winds (Erickson et al. 2000, Johnson et al. 2000, Barrios and Rodriquez 2004, Hoover and Morrison 2005). Thus, wind energy development can result in indirect (e.g., habitat avoidance, decreased nest success) and direct (e.g., collision fatalities) impacts to bird populations (Anderson et al. 1999). Directly quantifying the level of potential impacts (e.g., estimated fatalities/mega-watthour) from wind energy development is beyond the scope of this study. Instead, I aim to quantify density, occupancy and flight behavior for the two bird groups mentioned earlier: obligate grassland songbirds and raptors, respectively, predict where impacts may occur, and provide management recommendations to minimize potential impacts. The United States Department of Energy (DOE), through the Office of Energy Efficiency and Renewable Energy Allocation, contracted Texas Tech University to investigate grassland bird patterns of occurrence in the anticipated CREZ in support of DOE’s 20% Wind Energy by 2030 initiative. In cooperation with Iberdrola Renewables, Inc., studies initiated by Wulff (2010) at Texas Tech University were continued at an area proposed for wind energy development and a separate reference site unassociated with wind energy development. I focused on four primary objectives and this thesis is accordingly organized in four separate chapters that address grassland bird density, grassland bird occupancy, raptor flight patterns, and finally I summarize species diversity and composition. The following chapters use formatting from the Journal of Wildlife Management guidelines (Block et al. 2011) with modifications as required by the Texas Tech University Graduate School. 1) I estimate pre-construction bird density patterns using methods that adjust for imperfect detection. I used a distance sampling protocol that effectively accounts for incomplete detection in the field where birds are present but not detected (Buckland et al. 2001). I improved density estimates with hierarchical distance sampling models, a modeling technique that effectively incorporates the detection process with environmental covariates that further influence bird density (Royle et al. 2004, Royle and Dorazio 2008). Covariates included road density and current oil and gas infrastructure to determine the relationship between existing energy development and bird density patterns. Further, I used remote sensing techniques and vegetation field data to investigate how landcover characteristics influenced bird density patterns. I focused species-specific analyses on obligate grassland birds with >70 detections per season namely grasshopper sparrow (Ammodramus savannarum) and horned lark (Eremophila alpestris). Chapter II focuses on hierarchical models that model and describe relationships between grassland bird density and anthropogenic and landscape features. 2) A large number of bird detections (>70) are needed to estimate density using distance sampling and collection of such quantity are often not feasible, particularly for cryptic species or species that naturally occur at low densities (Buckland et al. 2001). Occupancy models operate with far fewer data and are often used as a surrogate for bird abundance when there are fewer detections (MacKenzie and Nichols 2004). I used occupancy models that allow for the possibility of imperfect detection and species abundance to improve estimates of occurrence probability (Royal 2004). I focused species-specific analyses on grassland birds with few detections: Cassin’s sparrow (Peucaea cassinii), eastern meadowlark (Sturnella magna), and upland sandpiper (Bartramia longicauda). Chapter III uses a multi-season dynamic site occupancy model that incorporates bird abundance to better estimate occurrence probability. 3) When I considered the topographic relief of the study sites, the proposed design of the wind facility and its location within the central U.S. migratory corridor, I expanded the study to investigate raptor abundance and flight behavior (Hoover 2002, Miller 2008). I developed a new survey technique that improved the accuracy of raptor flight height estimates and compared seasonal counts and flight heights at the plateau rim and areas further inland. I used counts and flight behaviors to calculate species-specific collision risk indices for raptors based on topographic features. I focused species-specific analyses on raptors with the highest counts: American kestrel (Falco sparverius), northern harrier (Circus cyaneus), red-tailed hawk (Buteo jamaicensis), Swainson’s hawk (Buteo swainsoni), and turkey vulture (Cathartes aura). Chapter IV describes patterns of seasonal raptor abundance and flight behavior and how topography modulates collision risk with proposed wind energy turbines. 4) Finally, for completeness, in Chapter V I summarize morning point count data for all species and provide estimates of relative composition and species diversity with the Shannon-Wiener Diversity Index (Shannon and Weaver 1949).

17 WIND ENERGY↗