Search NASA⌕ Search

SEARCH · Search NASA

Results for “random sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Power Grid Reliability Estimation via Adaptive Importance Sampling

Electricity production currently generates approximately 25% of greenhouse gas emissions in the USA. Thus, increasing the amount of renewable energy is a key step to carbon neutrality. However, integrating a large amount of fluctuating renewable generation is a significant challenge for power grid operating and planning. Grid reliability, i.e., an ability to meet operational constraints under power fluctuations, is probably the most important of them. In this letter, we propose computationally efficient and accurate methods to estimate the probability of line overflow, i.e., reliability constraints violation, under a known distribution of renewable energy generation. To this end, we investigate an importance sampling approach, a flexible extension of Monte-Carlo methods, which adaptively changes the sampling distribution to generate more samples near the reliability boundary. The approach allows to estimate overload probability in real-time based only on a few dozens of random samples, compared to thousands required by the plain Monte-Carlo. Our study focuses on high voltage direct current power transmission grids with linear reliability constraints on power injections and line currents. Herein, we propose a novel theoretically justified physics-informed adaptive importance sampling algorithm and compare its performance to state-of-the-art methods on multiple IEEE power grid test cases.

power system faults↗

Hashed Binary Search Sampling for Convolutional Network Training with Large Overhead Image Patches

Very large overhead imagery associated with ground truth maps has the potential to generate billions of training image patches for machine learning algorithms. However, random sampling selection criteria often leads to redundant and noisy-image patches for model training. With minimal research efforts behind this challenge, the current status spells missed opportunities to develop supervised learning algorithms that generalize over wide geographical scenes. In addition, much of the computational cycles for large scale machine learning are poorly spent crunching through noisy and redundant image patches. We demonstrate a potential framework to address these challenges specifically, while evaluating a human settlement detection task. A novel binary search tree sampling scheme is fused with a kernel based hashing procedure that maps image patches into hash-buckets using binary codes generated from image content. The framework exploits inherent redundancy within billions of image patches to promote mostly high variance preserving samples for accelerating algorithmic training and increasing model generalization.

Lunga, Dalton↗

Curiosity driven exploration to optimize structure–property learning in microscopy

Rapidly determining structure–property correlations in materials is an important challenge in better understanding fundamental mechanisms and greatly assists in materials design. In microscopy, imaging data provides a direct measurement of the local structure, while spectroscopic measurements provide relevant functional property information. Deep kernel active learning approaches have been utilized to rapidly map local structure to functional properties in microscopy experiments, but are computationally expensive for multi-dimensional and correlated output spaces. Here, we present an alternative lightweight curiosity algorithm which actively samples regions with unexplored structure–property relations, utilizing a deep-learning based surrogate model for error prediction. We show that the algorithm outperforms random sampling for predicting properties from structures, and provides a convenient tool for efficient mapping of structure–property relationships in materials science.

36 MATERIALS SCIENCE↗

NEAR-INFRARED ADAPTIVE OPTICS IMAGING OF INFRARED LUMINOUS GALAXIES: THE BRIGHTEST CLUSTER MAGNITUDE-STAR FORMATION RATE RELATION

We have established a relation between the brightest super star cluster (SSC) magnitude in a galaxy and the host star formation rate (SFR) for the first time in the near-infrared (NIR). The data come from a statistical sample of ∼40 luminous IR galaxies (LIRGs) and starbursts utilizing K-band adaptive optics imaging. While expanding the observed relation to longer wavelengths, less affected by extinction effects, it also pushes to higher SFRs. The relation we find, M{sub K} ∼ –2.6log SFR, is similar to that derived previously in the optical and at lower SFRs. It does not, however, fit the optical relation with a single optical to NIR color conversion, suggesting systematic extinction and/or age effects. While the relation is broadly consistent with a size-of-sample explanation, we argue physical reasons for the relation are likely as well. In particular, the scatter in the relation is smaller than expected from pure random sampling strongly suggesting physical constraints. We also derive a quantifiable relation tying together cluster-internal effects and host SFR properties to possibly explain the observed brightest SSC magnitude versus SFR dependency.

79 ASTRONOMY AND ASTROPHYSICS↗

FORTÉ Machine Learning

Of the non-corrupted data collected by the Orbiting Experiment (forté) satellite’s Photo-Diode Detector during the year 2001, I estimate that 7.9% of 914 894 signals are noise. My result differs dramatically from Guillen’s estimate of 96%. To arrive at this estimate, I used Gaussian mixture model (GMM) clustering–unsupervised machine learning–to aggregate the wave forms into groups based on the absolute value of the lowest 25 positive frequency discrete Fourier transform coefficients. Then, I marked several of the groups as noise by inspecting a random sampling of wave forms from each group. Marking groups as either noise or non-noise is a supervised binary classification operation. After removing the signals in noise groups from further consideration, I clustered the remaining signals into families. Again, I used a GMM, but for the familial clustering I used a Non-Negative Matrix Factorization feature vector transform. The result was 9 distinct families of lightning signals, as well as a second stage of noise filtering. To efficiently represent the entirety of the signal space, I broke each family into deciles based on their distance from the family mean. In this case, distance means the log-likelihood based on the GMM. Signals in lower deciles are more similar in shape and amplitude to their family average. I took the top 200 samples from each decile of each group, resulting in 18 000 signals. These signal approximately represent the entirety of the forté observations. To represent outliers, I also kept a zoo of the 1000 signals furthest from any family’s average. All told, the resulting data set represents the forté data with a reduction of about 51:1. To allow synthesis of an arbitrarily large number of test signals, I also captured each family’s average signal and the time-sample covariance matrix over the signals in each family. Using these two pieces of information, I can synthesize new waveforms by using a Gaussian random realization from the family average and covariance matrix. I wrote a program to test the synthesis quality. The program shows me two signals on the screen, one synthesized and one randomly drawn from the data. I attempted to identify the synthesized signal. Although the synthesis is imperfect, in an A/B comparison I only correctly chose the synthesized signal 36% of the time.

97 MATHEMATICS AND COMPUTING↗

Graphite Characterization: Baseline Variability Analysis Report

The Idaho National INL’s Baseline Material Property program provides many measurements of different material properties on a variety of nuclear graphite grades being investigated for irradiation-induced changes in material properties. The baseline material properties provide an unirradiated reference for comparison with measurements of those properties after irradiation. This study describes how uncertainty, or variance, in estimates of important material properties, like compressive strength, may depend on sample size, sample distribution and parameter estimation methods. Compressive strength data from two large collections of specimens from a billet of PCEA graphite (sample size = 230) and a billet of IG-110 graphite (sample size = 48) are used to illustrate these dependencies. The grades of graphite used represent approximate end members in terms of relative variability in strength measurements. Monte Carlo simulation and bootstrapping methods were used to examine variance in Weibull-parameter estimates as a function of sample size. Results were consistent with what previous statistical analyses have shown about the relationship between sample size and width of the confidence interval for maximum likelihood (ML) estimated parameters when samples are repeatedly drawn from a Weibull distribution. As a function of sample size, the precision of the modulus estimate increases faster than that of the characteristic strength. The modulus maximum likelihood estimates (MLEs) are biased for low sample sizes. The American Society for Testing and Materials document ASTM D7846-16 provides equations that describe the dependence of the variance of parameter MLEs on sample size. Using the same methodology, we show that the polynomials provided for variance dependence on sample size are inaccurate for sample sizes greater than ~120. We provide approximations to that relationship that illustrate relative constancy for sample size > ~10, in the logspace relationship of the modulus variance and the log transformed characteristic strength variance. Bootstrapping provided a means of comparing Weibull parameters obtained using ASME’s guidance for specimen collection to those obtained using different weighting in a case where strength is related to position in a billet and to grain orientation and a single distribution is used to characterize the billet. ASME specifies that samples be collected with equal representation in all locations and grain orientations. Parameter values obtained using ASME’s method were different from those obtained using random sampling of the complete data sets, and this was particularly true for the PCEA data. In addition, while the ASME approach yielded more conservative parameters for the PCEA data, the opposite was true for the IG-110 data. The difference observed for the PCEA data set likely reflects the larger number of against-grain specimens collected, which had generally higher strength than the with-grain specimens. This emphasizes the importance of the dependence of strength on location or grain orientation and suggests that it may be prudent to weight specimen collection toward the weaker subgroups if a conservative estimate as desired, as the equal weighting method recommended by ASME would will not always provide the most conservative Weibull parameters. Because spatial correlations commonly exist in certain grades of graphite, future work may involve developing a methodology for parameter inference that relaxes the assumption of independent specimens. ASTM and ASME codes recommend different parameter estimation methods and models of the Weibull distribution in different situations. Descriptions of the effects on parameter estimates for the example billets used in this study provide an example of how the method may affect the parameter estimate, and how—in this case—that compares to differences due to other factors, such as sample size and dependence on grain orientation or sample location.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The Role of Data Filtering in Open Source Software Ranking and Selection

Faced with more than 100M open source projects, a more manageable small subset is needed for most empirical investigations. More than half of the research papers in leading venues investigated filtering projects by some measure of popularity with explicit or implicit arguments that unpopular projects are not of interest, may not even represent "real" software projects, or that less popular projects are not worthy of study. However, such filtering may have enormous effects on the results of the studies if and precisely because the sought-out response or prediction is in any way related to the filtering criteria.This paper exemplifies the impact of this common practice on research outcomes, specifically how filtering of software projects on GitHub based on inherent characteristics affects the assessment of their popularity. Using a dataset of over 100,000 repositories, we used multiple regression to model the number of stars -a commonly used proxy for popularity- based on factors such as the number of commits, the duration of the project, the number of authors and the number of core developers. Our control model included the entire dataset, while a second filtered model considered only projects with ten or more authors. The results indicated that while certain characteristics of the repository consistently predict popularity, the filtering process significantly alters the relationships between these characteristics and the response. We found that the number of commits exhibited a positive correlation with popularity in the control sample but showed a negative correlation in the filtered sample. These findings highlight the potential biases introduced by data filtering and emphasize the need for careful sample selection in empirical research of mining software repositories. We recommend that empirical work should either analyze complete datasets such as World of Code, or employ stratified random sampling from a complete dataset to ensure that filtering is not biasing the results.

Malviya Thakur, Addi↗

A Statistical Framework for Microbial Source Attribution

This report presents a general approach to inferring transmission and source relationships among microbial isolates from their genetic sequences. The outbreak transmission graph (also called the transmission tree or transmission network) is the fundamental structure which determines the statistical distributions relevant to source attribution. The nodes of this graph are infected individuals or aggregated sub-populations of individuals in which transmitted bacteria or viruses undergo clonal expansion, leading to a genetically heterogeneous population. Each edge of the graph represents a transmission event in which one or a small number of bacteria or virions infects another node thus increasing the size of the transmission network. Recombination and re-assortment events originate in nodes which are common to two distinct networks. In order to calculate the probability that one node was infected by another, given the observed genetic sequences of microbial isolates sampled from them, we require two fundamental probability distributions. The first is the probability of obtaining the observed mutational differences between two isolates given that they are separated by M steps in a transmission network. The second is the probability that two nodes sampled randomly from an outbreak transmission network are separated by M transmission events. We show how these distributions can be obtained from the genetic sequences of isolates obtained by sampling from past outbreaks combined with data from contact tracing studies. Realistic examples are drawn from the SARS outbreak of 2003, the FMDV outbreak in Great Britain in 2001, and HIV transmission cases. The likelihood estimators derived in this report, and the underlying probability distribution functions required to calculate them possess certain compelling general properties in the context of microbial forensics. These include the ability to quantify the significance of a sequence 'match' or 'mismatch' between two isolates; the ability to capture non-intuitive effects of network structure on inferential power, including the 'small world' effect; the insensitivity of inferences to uncertainties in the underlying distributions; and the concept of rescaling, i.e. ability to collapse sub-networks into single nodes and examine transmission inferences on the rescaled network.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stochastic sampling method with MCNPX for nuclear data uncertainty propagation in criticality safety applications

In the domain of criticality safety, the efficient propagation of uncertainty in nuclear data to uncertainty in k{sub eff} is an important area of current research. In this paper, a method based on stochastic sampling is presented for uncertainty propagation in MCNPX calculations. To that aim, the nuclear data (i.e. cross sections) are assumed to have a multivariate normal distribution and simple random sampling is performed following this presumed probability distribution. A verification of the developed stochastic sampling procedure with MCNPX is then conducted using the {sup 239}Pu Jezebel experiment as well as the PB-2 BWR and TMI-1 PWR pin cell models from the Uncertainty Analysis in Modeling (UAM) exercises. For the Jezebel case, it is found that the developed stochastic sampling approach predicts similar k{sub eff} uncertainties compared to conventional sensitivity and uncertainty methods. For the UAM models, slightly lower uncertainties are obtained when comparing to existing preliminary results. Further details of these verification studies are discussed and directions for future work are outlined. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Case Study in Assessing a Potential Severity Framework for Incidents from a Decadal Sample

In this study, the primary objective of this case study is to determine the applicability and feasibility of a framework that leverages occupational incident details to prospectively identify “potential Serious Injury or Fatality” (pSIF) cases. This study comprehensively reviewed a random sample of 1,081 injury and illness cases across 21 generalized incident types spanning over a decade at Lawrence Livermore National Laboratory (LLNL), a U.S. Department of Energy research and development facility with more than 9,000 employees. The review applied a general framework that classified each case on information suitability, potential severity, and future incident mitigation. The findings from the study indicate that 86.6% of the cases had sufficient information to make a high-confidence determination on potential severity, underscoring the feasibility of applying this general framework. Additionally, cases with a higher pSIF score had, on average, a higher level of institutional response. Implementing a simplified methodology for incident classification that emphasizes incidents that pose high potential severity, regardless of incident type, can help LLNL prioritize resources and tailor responses to such incidents using a graded approach. LLNL has recognized the value of this capability and is integrating the framework into their injury and illness process in the 2024 calendar year.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Computing the QRPA level density with the finite amplitude method

Here, we describe a new algorithm to calculate the vibrational nuclear level density of an atomic nucleus. Fictitious perturbation operators that probe the response of the system are generated by drawing their matrix elements from some probability distribution function. We use the Finite Amplitude Method to explicitly compute the response for each such sample. With the help of the Kernel Polynomial Method, we build an estimator of the vibrational level density and provide the upper bound of the relative error in the limit of infinitely many random samples. The new algorithm can give accurate estimates of the vibrational level density. Since it is based on drawing multiple samples of perturbation operators, its computational implementation is naturally parallel and scales like the number of available processing units.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessing the Uncertainty in QUANTEC's Dose–Response Relation of Lung and Spinal Cord With a Bootstrap Analysis

Purpose: To apply a statistical bootstrap analysis to assess the uncertainty in the dose–response relation for the endpoints pneumonitis and myelopathy reported in the QUANTEC review. Methods and Materials: The bootstrap method assesses the uncertainty of the estimated population-based dose-response relation due to sample variability, which reflects the uncertainty due to limited numbers of patients in the studies. A large number of bootstrap replicates of the original incidence data were produced by random sampling with replacement. The analysis requires only the dose, the number of patients, and the number of occurrences of the studied endpoint, for each study. Two dose–response models, a Poisson-based model and the Lyman model, were fitted to each bootstrap replicate using maximum likelihood. Results: The bootstrap analysis generates a family of curves representing the range of plausible dose–response relations, and the 95% bootstrap confidence intervals give an estimated upper and lower toxicity risk. The curve families for the 2 dose–response models overlap for doses included in the studies at hand but diverge beyond that, with the Lyman model suggesting a steeper slope. The resulting distributions of the model parameters indicate correlation and non-Gaussian distribution. For both data sets, the likelihood of the observed data was higher for the Lyman model in >90% of the bootstrap replicates. Conclusions: The bootstrap method provides a statistical analysis of the uncertainty in the estimated dose–response relation for myelopathy and pneumonitis. It suggests likely values of model parameter values, their confidence intervals, and how they interrelate for each model. Finally, it can be used to evaluate to what extent data supports one model over another. For both data sets considered here, the Lyman model was preferred over the Poisson-based model.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

hiposa v0.1.0

Fast construction of hierarchical N-dimensional experimental design. The software allows construction of sampling strategies that are self-avoiding, tunable in resolution in N dimensions. This code is a drop-in replacement for seeding optimization runs often performed using uniform random sampling. The hierarchical approach allows for a rapid, top down method for construction the most effective design that drives towards a global optimum.

Zwart, PetrusH [Lawrence Berkeley National Laborat↗

In-service inspection of radioactive waste tanks at the Savannah River Site - 15410

Liquid radioactive wastes from the Savannah River Site (SRS) separation process are stored in large underground carbon steel tanks. The high level wastes are processed in several of the tanks and then transferred by piping to other site facilities for further processing before they are stabilized in a vitrified or grout waste form. Based on waste removal and processing schedules, many of the tanks, will be required to be in service for times exceeding the initial intended life. Until the waste is removed from storage, transferred, and processed, the materials and structures of the tanks must maintain a confinement function by providing a barrier to the environment and by maintaining acceptable structural stability during design basis events, which include loadings from both normal service and abnormal (e.g., earthquake) conditions. A structural integrity program is in place to maintain the structural and leak integrity functions of these waste tanks throughout their intended service life. In-service inspection (ISI) is an essential element of a comprehensive structural integrity program for the waste tanks at the Savannah River Site (SRS). The ISI program was developed to determine the degree of degradation the waste tanks have experienced due to service conditions. As a result of the inspections, an assessment can be made of the effectiveness of corrosion controls for the waste chemistry, which precludes accelerated localized and general corrosion of the waste tanks. Ultrasonic inspections (UT) are performed to detect and quantify the degree of general wall thinning, pitting and cracking as a measure of tank degradation. The results from these inspections through 2013, for the 27 Type III/IIIA tanks, indicate no reportable in-service corrosion degradation in the primary tank (i.e., general, pitting, or cracking). The average wall thickness for all tanks remains above the manufactured nominal thickness minus 0.25 millimeter and the largest pit identified is approximately 1.70 millimeter deep (i.e., less than 10% through-wall). Improvements to the inspection program were recently instituted to provide additional confidence in the degradation rates. Thickness measurements from a single vertical strip along the accessible height of the primary tank have been used as a baseline to compare historical measurements. Changes in wall thickness and pit depths along this vertical strip are utilized to estimate the rate of corrosion degradation. An independent review of the ISI program methodology, results, and path forward was held in August 2009. The review recommended statistical sampling of the tanks to improve the confidence of the single strip inspection program. The statistical sampling plan required that SRS increase the amount of area scanned per tank. Therefore, in addition to the baseline vertical strip that is obtained for historical comparisons, four additional randomly selected vertical strips are inspected. To date, a total of 104 independent vertical strips along the height of the primary tank have been completed. A statistical analysis of the data indicates that at this coverage level there is a 99.5% confidence level that one of the worst 5% of all the vertical strips was inspected. That is, there is a relatively high likelihood that the SRS inspection program has covered one of the most corroded areas of any of the Type III/IIIA waste tanks. These data further support the conclusion that there are no significant indications of wall thinning or pitting. Random sampling will continue to increase the confidence that one of the worst 5% has been inspected. In order to obtain the additional vertical strips, and minimize budget and schedule impacts, data collection speed for the UT system was optimized. Prior to 2009, the system collected data at a rate of 32 square centimeters per minute. The scan rate was increased to 129 - 160 square centimeters per minute by increasing the scanner step and pixel sizes in the data acquisition set-up. Laboratory testing was utilized to optimize the scan index/pixel size such that the requirements for wall thinning and pit detection were still maintained. SRS continues to evaluate improvements to ultrasonic equipment. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Energy Delivery Systems with Verifiable Trustworthiness (Final Report)

Energy Delivery Systems (EDS) must be verified to be free from intrusive and malicious software. One way of verifying this software is to perform device scans to detect malicious code. Because it is possible to have “fileless” malware that exists only in device (volatile) memory, offline scanning and even many forms of online scanning is insufficient for detection. This project (“Verify”) addresses this need by performing direct sampling of memory during device operation to detect unexpected or modified software while not interfering with device operation. The Verify project provides a proof-of-concept of detection by random sampling combined with remote software- and timing-based attestation methods for robust detection of in-memory threats. An external review of Verify was performed by our partner, General Electric (GE), and a summary of their findings is provided.

97 MATHEMATICS AND COMPUTING↗

High-Dimensional Spectral Sampling

A wide variety of applications in science and engineering depend on effectively and efficiently exploring high- dimensional parameter spaces. Common examples are uncertainty quantification, inverse problems, or various optimization approaches. In such applications, the first step is to create an initial uniform, random sampling of the space to create a baseline of knowledge. The simulations evaluated at these samples are then used for subsequent processing. In its most generic form, the goal of sampling is to produce the maximal amount of information with the minimal number of samples. However, despite being the first step and thus influencing the performance of the entire workflow, the quality of the initial sample designs is rarely analyzed or optimized. This project develops a new spectral sampling theory for analyzing and creating experiment designs in high-dimensional spaces. Further, new algorithms for estimating sample properties and sample synthesis are designed. Finally, applications of the proposed spectral sampling tools in surrogate modeling, scientific machine learning and image analysis are presented.

97 MATHEMATICS AND COMPUTING↗

A Machine Learning-Based Vulnerability Analysis for Cascading Failures of Integrated Power-Gas Systems

This article proposes a cascading failure simulation (CFS) method and a hybrid machine learning method for vulnerability analysis of integrated power-gas systems (IPGSs). The CFS method is designed to study the propagating process of cascading failures between the two systems, generating data for machine learning with initial states randomly sampled. The proposed method considers generator and gas well ramping, transmission line and gas pipeline tripping, island issue handling and load shedding strategies. Then, a hybrid machine learning model with a combined random forest (RF) classification and regression algorithms is proposed to investigate the impact of random initial states on the vulnerability metrics of IPGSs. Extensive case studies are carried out on three test IPGSs to verify the proposed models and algorithms. Simulation results show that the proposed models and algorithms can achieve high accuracy for the vulnerability analysis of IPGSs.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Modeling the determinants of the social impacts of agricultural development projects

In an attempt to help policy-makers improve the social sustainability of development projects, this study identifies the key determinants of farmers' attitudes relating to the social impacts of the floodwater spreading project (FWSP) on the Gareh-Bygone plain in Iran. In order to analyze the links between the various factors that affect the experience of social impact, a theoretical framework was developed. Stratified random sampling was used to survey 138 farm households from the four villages in the region. One male and one female from each house were interviewed face-to-face using a questionnaire, resulting in a total of 276 interviews. Structural factors were found to be the largest contribution to stakeholders' attitudes relating to the social impacts of the project. Results from a cluster analysis suggested that the level of floodwater information, level of participation, water access, ownership change, and environmental worldview were the most important factors explaining attitude towards social impact of the FWSP.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗