Search NASA⌕ Search

SEARCH · Search NASA

Results for “quantile sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Interpretable Net Load Forecasting Using Smooth Multiperiodic Features

We consider the problem of forecasting net load over a horizon such as one day, using a trailing window of past net load values as well as date and time. We focus on three variations on this problem: point forecasts, marginal quantile forecasts, and generating conditional samples of the future value. We propose a method that relies on linear regression using some custom engineered time-based features to capture multiple periodicities, such as daily, weekly, and seasonal, and their interactions. Our proposed models are readily interpretable, and rely on efficient and reliable convex optimization [1] to fit. We illustrate our method on four years worth of hourly net load data, comparing predictions made with various subsets of the features.

Ogut, Mehmet G↗
DOE OSTI2024

Nonparametric Multiparticle Set Methods for Interpreting Environmental Samples

Collection and analysis of environmental samples is commonly used by a range of stakeholders in nuclear safeguards and security contexts. While the ubiquity of samples and their transport in the environment allow regular collection, developing and demonstrating methods for analyzing these samples is difficult. In this work, an environmental sample consists of a set of one or more individual particles. Recent advances in reactor simulation have allowed us to generate data that are more representative of real-world environmental samples, enabling statistically defensible method development and testing. The most notable of these advances is a drastic increase in the number of material depletion regions, which allows our simulations to capture the variation in isotopic composition seen at length scales consistent with environmental samples. Traditional approaches for handling multiparticle samples treat each particle in the sample individually, estimating the quantity of interest (e.g., core-average burnup) resulting from measurement and analysis of signatures (e.g., nuclide assays) from each individual particle. Individual estimates are then averaged to generate a single estimate of the quantity of interest over the entire sample. In this presentation, we introduce two novel approaches for interpreting environmental samples that comprise of multiple particles: (1) the Quantile-Quantile Comparator, which uses a multivariate generalization of quantile-quantile plots for comparing unknown statistical distributions, and (2) the Set Transformer, an attention-based neural network module designed to model interactions among elements (particles) in the input set (sample). Statistically representative sampling cannot be guaranteed as samples are passively collected and are beholden to what particles are available in the environment. These new analysis methods for set-input problems are expected to be more robust than traditional approaches to issues of sampling bias where particles are not uniformly distributed throughout regions of interest, as well as generally outperform traditional approaches by jointly considering all elements in the set. We will present results comparing the performance of traditional single particle approaches and the novel Quantile-Quantile Comparator and Set Transformer for interpretation of simulated environmental samples.

Phathanapirom, Birdy↗
DOE OSTI2020

Quantile-specific heritability of sibling leptin concentrations and its implications for gene-environment interactions

“Quantile-dependent expressivity” occurs when the effect size of a genetic variant depends upon whether the phenotype (e.g., leptin) is high or low relative to its distribution. Leptin concentrations are strongly related to adiposity, whose heritability is quantile dependent. Whether inheritance of leptin concentrations is quantile dependent, and whether this explains the greater heritability in women than men in accordance with their greater adiposity, and explains other gene-environment interactions, remains to be determined. Therefore, leptin and leptin receptor concentrations from 3068 siblings in 1133 sibships from the Framingham Heart Study Third Generation Cohort were analyzed. Free leptin index (FLI) was calculated as the ratio of leptin to soluble leptin receptor concentrations. Full-sib (β FS ) regression slopes were robustly estimated by quantile regression with nonparametric significance assigned from 1000 bootstrap samples. The analyses showed β FS increased significantly with increasing percentiles of the offspring’s age- and sex-adjusted leptin distribution (P linear = 0.0001), which was accelerated at the higher concentrations (P quadratic = 0.0003). β FS at the 90th percentile (0.418 ± 0.066) was 4.7-fold greater than at the 10th percentile (0.089 ± 0.032, P difference = 3.6 × 10 –6 ). Consistent with quantile-dependent expressivity, the β FS was greater in female sibs, which was attributable to their higher leptin concentrations. Reported gene-environment interactions involving adiposity and LEP , LEPR , MnSOD , PPARγ , PPARγ2 , and IRS-1 polymorphisms were consistent with quantile-dependent expressivity of leptin concentrations. β FS for leptin receptor concentrations and free leptin index also increased significantly with increasing percentiles of their distributions (P linear = 0.04 and P linear = 8.5 × 10 –6 , respectively). In conclusion, inherited genetic and shared environmental effects on leptin concentrations were quantile dependent, which likely explains male–female differences in heritability and some gene-environment interactions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Flexible classification with spatial quantile comparison and novel statistical features applied to spent nuclear fuel analysis

Multivariate classification algorithms are a common tool in contemporary data science that have begun to be applied to nuclear forensic analyses. Using a multivariate generalization of quantile–quantile plots for comparing unknown statistical distributions, a new model-free multivariate classifier called the Quantile–Quantile Comparator has been developed and tested on the analysis of simulated irradiated nuclear fuel. A method to estimate the sample-specific probability of having made an incorrect classification decision by analyzing the distribution of quantile comparisons has been developed, and methods have been developed to analyze the partition of the known data library used to analyze unknown data. By analyzing this partition, the analyst may identify classes that are likely to be confused, identify test data that are inconsistent with the data library and return a “None-of-the-Above” classification decision, and optimize the class boundaries. In this paper, the development of these capabilities is described, and a case study using real experimental assay data collected from nuclear fuel extracted from the newly-released In conclusion, Spent Fuel Isotopic Composition Database to demonstrate the efficacy of these capabilities is presented.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Spirometric traits show quantile-dependent heritability, which may contribute to their gene-environment interactions with smoking and pollution

Background: “Quantile-dependent expressivity” refers to a genetic effect that is dependent upon whether the phenotype (e.g., spirometric data) is high or low relative to its population distribution. Forced vital capacity (FVC), forced expiratory volume in 1 second (FEV 1 ), and the FEV 1 /FVC ratio are moderately heritable spirometric traits. The aim of the analyses is to test whether their heritability (h 2 ) is constant over all quantiles of their distribution. Methods: Quantile regression was applied to the mean age, sex, height and smoking-adjusted spirometric data over multiple visits in 9,993 offspring-parent pairs and 1,930 sibships from the Framingham Heart Study to obtain robust estimates of offspring-parent (β OP ), offspring-midparent (β OM ), and full-sib regression slopes (β FS ). Nonparametric significance levels were obtained from 1,000 bootstrap samples. β OP s were used as simple indicators of quantile-specific heritability (i.e.,h 2 = 2β OP /(1+r spouse ), where r spouse was the correlation between spouses). Results: β OP ± standard error (SE) decreased by 0.0009 ± 0.0003 (P = 0.003) with every one-percent increment in the population distribution of FEV 1 /FVC, i.e., β OP ± SE were: 0.182 ± 0.031, 0.152 ± 0.015; 0.136 ± 0.011; 0.121 ± 0.013; and 0.099 ± 0.013 at the 10th, 25th, 50th, 75th, and 90th percentiles of the FEV 1 /FVC distribution, respectively. These correspond to h 2 ± SEs of 0.350 ± 0.060 at the 10th, 0.292 ± 0.029 at the 25th, 0.262 ± 0.020 at the 50th, 0.234 ± 0.025 at the 75th, and 0.191 ± 0.025 at the 90th percentiles of the FEV 1 /FVC ratio. Maximum mid-expiratory flow (MMEF) h 2 ± SEs increased 0.0025 ± 0.0007 (P = 0.0004) with every one-percent increment in its distribution, i.e.: 0.467 ± 0.046, 0.467 ± 0.033, 0.554 ± 0.038, 0.615 ± 0.042, and 0.675 ± 0.060 at the 10th, 25th, 50th, 75th, and 90th percentiles of its distribution. This was due to forced expiratory flow at 75% of FVC (FEF75%), whose quantile-specific h 2 increased an average of 0.0042 ± 0.0008 for every one-percent increment in its distribution. It is speculated that previously reported gene-environment interactions may be partially attributable to quantile-specific h 2 , i.e., greater heritability in individuals with lower FEV 1 /FVC due to smoking or airborne particles exposure vs. nonsmoking, unexposed individuals. Conclusion: Heritabilities of FEV 1 /FVC, MMEF, and FEF75% from quantile-regression of offspring-parent and sibling spirometric data suggest their quantile-dependent expressivity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Representation of U.S. Warm Temperature Extremes in Global Climate Model Ensembles

Extreme temperature events can have considerable negative impacts on sectors such as health, agriculture, and transportation. Observational evidence indicates the severity and frequency of warm extremes are increasing over much of the United States, but there are sizeable challenges both in estimating extreme temperature changes and in quantifying the relevant associated uncertainties. This study provides a simple statistical framework using a block maxima approach to analyze the representation of warm temperature extremes in several recent global climate model ensembles. Uncertainties due to structural model differences, grid resolution, and internal variability are characterized and discussed. Results show that models and ensembles differ greatly in the representation of extreme temperature over the United States, and variability in tail events is dependent on time and anthropogenic warming, which can influence estimates of return periods and distribution parameter estimates using generalized extreme value (GEV) distributions. These effects can considerably influence the uncertainty of model hindcasts and projections of extremes. Several idealized regional applications are highlighted for evaluating ensemble skill and trends, based on quantile analysis and root-mean-square errors in the overall sample and the upper tail. The results are relevant to regional climate assessments that use global model outputs and that are sensitive to extreme warm temperature. Accompanying this manuscript is a simple toolkit using the R statistical programming language for characterizing extreme events in gridded datasets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty quantification of the virial black hole mass with conformal prediction

Precise measurements of the black hole mass are essential to gain insight on the black hole and host galaxy co-evolution. A direct measure of the black hole mass is often restricted to nearest galaxies and instead, an indirect method using the single-epoch virial black hole mass estimation is used for objects at high redshifts. However, this method is subjected to biases and uncertainties as it is reliant on the scaling relation from a small sample of local active galactic nuclei. In this study, we propose the application of conformalized quantile regression (CQR) to quantify the uncertainties of the black hole predictions in a machine learning setting. We compare CQR with various prediction interval techniques and demonstrated that CQR can provide a more useful prediction interval indicator. In contrast to baseline approaches for prediction interval estimation, we show that the CQR method provides prediction intervals that adjust to the black hole mass and its related properties. That is it yields a tighter constraint on the prediction interval (hence more certain) for a larger black hole mass, and accordingly, bright and broad spectral line width source. Using a combination of neural network model and CQR framework, the recovered virial black hole mass predictions and uncertainties are comparable to those measured from the Sloan Digital Sky Survey. The code is publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Economic consequences of aviation system disruptions: A reduced-form computable general equilibrium analysis

The state of the art approach to economic consequence analysis (ECA) is computable general equilibrium (CGE) modeling. However, such models contain thousands of equations and cannot readily be incorporated into computerized systems used by policy analysts to yield estimates of economic impacts of various types of transportation system failures due to natural hazards, human related attacks or technological accidents. This paper presents a reduced-form approach to simplify the analytical content of CGE models to make them more transparent and enhance their utilization potential. The reduced-form CGE analysis is conducted by first running simulations one hundred times, varying key parameters, such as magnitude of the initial shock, duration, location, remediation, and resilience, according to a Latin Hypercube sampling procedure. Statistical analysis is then applied to the “synthetic data” results in the form of both ordinary least squares and quantile regression. The analysis yields linear equations that are incorporated into a computerized system and utilized along with Monte Carlo simulation methods for propagating uncertainties in economic consequences. Although our demonstration and discussion focuses on aviation system disruptions caused by terrorist attacks, the approach can be applied to a broad range of threat scenarios.

Aviation System Disruptions↗
DOE OSTI2018

Calibrating Climate Model Ensembles for Assessing Extremes in a Changing Climate

Climate models serve as indispensable tools to investigate the effect of anthropogenic emissions on current and future climate, including extremes. However, as low-dimensional approximations of the climate system, they will always exhibit biases. Several attempts have been made to correct for biases as they affect extremes prediction, predominantly focused on correcting model-simulated distribution shapes. In this study, the effectiveness of a recently published quantile-based bias correction scheme, as well as a new subset selection method introduced here, are tested out-of-sample using model-as-truth experiments. Results show that biases in the shape of distributions tend to persist through time, and therefore, correcting for shape bias is useful for past and future statements characterizing the probability of extremes. However, for statements characterized by a ratio of the probabilities of extremes between two periods, we find that correcting for shape bias often provides no skill improvement due to the dominating effect of bias in the long-term trend. Using a toy model experiment, we examine the relative importance of the shape of the distribution versus its position in response to long-term changes in radiative forcing. It confirms that the relative position of the two distributions, based on the trend, is at least as important as the shape. We encourage the community to consider all model biases relevant to their metric of interest when using a bias correction procedure and to construct out-of-sample tests that mirror the intended application.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1982

Quantiles, parametric-select density estimation, and bi-information parameter estimators

A quantile-based approach to statistical analysis and probability modeling of data is presented which formulates statistical inference problems as functional inference problems in which the parameters to be estimated are density functions. Density estimators can be non-parametric (computed independently of model identified) or parametric-select (approximated by finite parametric models that can provide standard models whose fit can be tested). Exponential models and autoregressive models are approximating densities which can be justified as maximum entropy for respectively the entropy of a probability density and the entropy of a quantile density. Applications of these ideas are outlined to the problems of modeling: (1) univariate data; (2) bivariate data and tests for independence; and (3) two samples and likelihood ratios. It is proposed that bi-information estimation of a density function can be developed by analogy to the problem of identification of regression models.

Parzen, E.↗
DOE OSTI2022

‘Flux+Mutability’: a conditional generative approach to one-class classification and anomaly detection

Abstract Anomaly Detection is becoming increasingly popular within the experimental physics community. At experiments such as the Large Hadron Collider, anomaly detection is growing in interest for finding new physics beyond the Standard Model. This paper details the implementation of a novel Machine Learning architecture, called Flux+Mutability, which combines cutting-edge conditional generative models with clustering algorithms. In the ‘flux’ stage we learn the distribution of a reference class. The ‘mutability’ stage at inference addresses if data significantly deviates from the reference class. We demonstrate the validity of our approach and its connection to multiple problems spanning from one-class classification to anomaly detection. In particular, we apply our method to the isolation of neutral showers in an electromagnetic calorimeter and show its performance in detecting anomalous dijets events from standard QCD background. This approach limits assumptions on the reference sample and remains agnostic to the complementary class of objects of a given problem. We describe the possibility of dynamically generating a reference population and defining selection criteria via quantile cuts. Remarkably this flexible architecture can be deployed for a wide range of problems, and applications like multi-class classification or data quality control are left for further exploration.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

Beyond Point Estimates: Benchmarking Uncertainty Quantification Methods on the AION-1 Astronomical Foundation Model

Foundation models for astronomical surveys offer powerful learned representations that can be transferred to downstream regression tasks such as galaxy property estimation. However, point predictions alone are insufficient for scientific inference; reliable uncertainty quantification (UQ) is essential. We compare seven UQ methods on galaxy property regression using frozen AION-1 foundation-model embeddings, predicting redshift, stellar mass, stellar-population age, gas-phase metallicity, and specific star-formation rate, from Legacy Survey photometry/imaging and DESI spectra, with PROVABGS-derived labels. Distribution-free conformal methods achieve marginal coverage within $\sim$1 pp of the nominal 90% across all properties, while non-conformal baselines (Deep Ensembles, MC~Dropout) fail to calibrate reliably. Among conformal approaches, Conformalized Quantile Regression (CQR) delivers the best coverage in the bin with the poorest model predictions. More importantly, only the Locally Valid and Discriminative (LVD) framework -- particularly when operating on AION-1 embeddings -- also provides finite-sample \emph{local validity}, producing intervals that adapt to each galaxy's local prediction difficulty rather than relying on marginal guarantees alone. These results establish conformal prediction, and LVD in particular, as the preferred UQ framework for uncertainty-aware inference on foundation-model embeddings in astrophysics.

Tame-Narvaez, Karla [Fermilab] (ORCID:000000022249↗
DOE OSTI2021

Stem hydraulic conductivity and vulnerability to cavitation for 26 tree species in Panama

Stem hydraulic conductivity and vulnerability to cavitation were measured for 26 tree species located in Panama. The data were generated to better understand the ecology of the focal tree species. Complementary NGEE-Tropics datasets for these species include sap flow, leaf-level gas exchange, and leaf water potential. Stem samples were collected from distal branches of canopy trees, brought to the Smithsonian Tropical Research Institute laboratory in Gamboa, Panama, and allowed to dry to various water potentials before measurements. For each species, a Weibull function was fit to the 90% quantile of the relationship between stem area specific hydraulic conductivity (Ks) and stem water potential. From these functions, maximum Ks and vulnerability parameters were derived. The data files in the package include raw data, derived parameters, and the R script used for analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

The X-Ray Binary Population of the Nearby Dwarf Starburst Galaxy IC 10: Variable and Transient X-Ray Sources

We have monitored the Cassiopeia dwarf galaxy (IC 10) in a series of 10 Chandra ACIS-S observations to capture its variable and transient X-ray source population, which is expected to be dominated by High Mass X-ray Binaries (HMXBs). We present a sample of 21 X-ray sources that are variable between observations at the 3 σ level, from a catalog of 110 unique point sources. We find four transients (flux variability ratio greater than 10) and a further eight objects with ratios >5. The observations span the years 2003–2010 and reach a limiting luminosity of >10{sup 35} erg s{sup −1}, providing sensitivity to X-ray binaries in IC 10 as well as flare stars in the foreground Milky Way. The nature of the variable sources is investigated from light curves, X-ray spectra, energy quantiles, and optical counterparts. The purpose of this study is to discover the composition of the X-ray binary population in a young starburst environment. IC 10 provides a sharp contrast in stellar population age (<10 My) when compared to the Magellanic Clouds (40–200 My) where most of the known HMXBs reside. We find 10 strong HMXB candidates, 2 probable background Active Galactic Nuclei, 4 foreground flare-stars or active binaries, and 5 not yet classifiable sources. Complete classification of the sample requires optical spectroscopy for radial velocity analysis and deeper X-ray observations to obtain higher S/N spectra and search for pulsations. A catalog and supporting data set are provided.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Conformal Hierarchical Simulation-Based Inference with Local Validity

Trustworthy and interpretable uncertainty quantification is a long-standing challenge in artificial intelligence. Simulation-based inference (SBI) comprises a broad swath of approaches for estimating latent parameters with uncertainties. Although flexible neural density estimators in SBI can be remark- ably expressive capturing highly structured, high-dimensional posteriors their credible regions can be badly mis-calibrated and are often only accompanied by heuristic coverage checks. We present the first SBI framework that delivers finite-sample local valid coverage guarantees that hold in the neighborhood of each observation. Our framework can couple any off-the-shelf hierarchical SBI engine with a confor- mal Bayesian post-processing step that operates on the posterior predictive density. A kernel-weighted conformity score adapts the conformal quantile to the local geometry of the data, yielding prediction sets that are simultaneously (i) marginally calibrated, (ii) locally valid, and (iii) hierarchical, handling global and observation-specific parameters in a single pass. Through experiments on synthetic data and benchmarks from neuroscience and physics, we show that our approach attains 1 − α coverage, where prior SBI methods under- or over-cover. Our approach also maintains a competitive, credible set size with minimal computational overhead. Finally, our approach can be used to make predictions on real data and give valid credible regions modulo weight-initialization-based model mis-specification.

Trivedi, Shubhendu [Fermilab]↗
NASA NTRS2016

Persistence Mapping Using EUV Solar Imager Data

We describe a simple image processing technique that is useful for the visualization and depiction of gradually evolving or intermittent structures in solar physics extreme-ultraviolet imagery. The technique is an application of image segmentation, which we call "Persistence Mapping," to isolate extreme values in a data set, and is particularly useful for the problem of capturing phenomena that are evolving in both space and time. While integration or "time-lapse" imaging uses the full sample (of size N ), Persistence Mapping rejects (N - 1)/N of the data set and identifies the most relevant 1/N values using the following rule: if a pixel reaches an extreme value, it retains that value until that value is exceeded. The simplest examples isolate minima and maxima, but any quantile or statistic can be used. This paper demonstrates how the technique has been used to extract the dynamics in long-term evolution of comet tails, erupting material, and EUV dimming regions.

Thompson, B. J.↗
NASA NTRS2021

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be-+12.390.981.30km and-+2.0720.0660.067Me respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is=-+TlogK5.99100.060.05([])for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters(within the prior support)and can thus be computed from the posterior samples.

Millisecond pulsars↗