Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Studying the hadron structure with PANDA and CLAS using machine learning techniques

The hadron spectroscopy and structure are currently very active fields of research to study the non-perturbative regime of quantum chronodynamics. The first one studies the complex structure of excited hadrons by looking at their decay products, while the latter uses lepton scattering on nucleons. Both methods require reconstruction algorithms with great efficiency and good particle identification and background rejection rates. This work aims to provide these by either improving the existing methods or developing new ones. The first part of this document presents a feasibility study of a predicted hybrid charmonium state for the PANDA experiment. Lattice QCD calculations predict the ground state hybrid charmonium to be a spin exotic with quantum numbers of JP C = 1?+ at a mass of around 4.3 GeV with a width to be around 20 MeV. A machine learning based data analysis scheme is proposed to further improve the signal efficiency and the background reduction, alongside with improvements of the analysis software (PandaRoot), that are vital for this study. These improvements include a reworked clustering algorithm for the electromagnetic calorimeter (EMC) and an optimized monte carlo matching for neutral particles. The second part of this document is about studying the proton structure. A multidimensional study of the structure function ratio Fsin(?)LU /FUU has been performed for K±, based on the measurement of beam-spin asymmetries. It uses the high statistics data recorded with the CLAS12 spectrometer at Jefferson Laboratory. Fsin(?)LU is a twist-3 quantity that provides information about the quark gluon correlations in the proton. This document will present for the first time a simultaneous analysis of two kaon channels over a large kinematic range of z, xB , PT and Q2 with virtualities Q2 ranging from 1 GeV2 up to 8 GeV2 using machine learning techniques for improved particle identification.

Kripko, Aron↗

Structure of chalcogen overlayers on Au(111): Density functional theory and lattice-gas modeling

Ordering of different chalcogens, S, Se, and Te, on Au(111) exhibit broad similarities but also some distinct features, which must reflect subtle differences in relative values of the long-range pair and many-body lateral interactions between adatoms. We develop lattice-gas (LG) models within a cluster expansion framework, which includes about 50 interaction parameters. These LG models are developed based on density functional theory (DFT) analysis of the energetics of key adlayer configurations in combination with the Monte Carlo (MC) simulation of the LG models to identify statistically relevant adlayer motifs, i.e., model development is based entirely on theoretical considerations. The MC simulation guides additional DFT analysis and iterative model refinement. Given their complexity, development of optimal models is also aided by strategies from supervised machine learning. The model for S successfully captures ordering motifs over a broader range of coverage than achieved by previous models, and models for Se and Te capture the features of ordering, which are distinct from those for S. More specifically, the modeling for all three chalcogens successfully explains the linear adatom rows (also subtle differences between them) observed at low coverages of ~0.1 monolayer. The model for S also leads to a new possible explanation for the experimentally observed phase with a (5 × 5)-type low energy electron diffraction (LEED) pattern at 0.28 ML and to predictions for LEED patterns that would be observed with Se and Te at this coverage.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dark energy survey year 3 results: likelihood-free, simulation-based w CDM inference with neural compression of weak-lensing map statistics

We present simulation-based cosmological wcold dark matter (wCDM) inference using dark energy survey year 3 weak-lensing maps, via neural data compression of weak-lensing map summary statistics: power spectra, peak counts, and direct map-level compression/inference with convolutional neural networks (CNN). Using simulation-based inference, also known as likelihood-free or implicit inference, we use forward-modelled mock data to estimate posterior probability distributions of unknown parameters. This approach allows all statistical assumptions and uncertainties to be propagated through the forward-modelled mock data; these include sky masks, non-Gaussian shape noise, shape measurement bias, source galaxy clustering, photometric redshift uncertainty, intrinsic galaxy alignments, non-Gaussian density fields, neutrinos, and non-linear summary statistics. We include a series of tests to validate our inference results. This paper also describes the Gower Street simulation suite: 791 full-sky pkdgrav3 dark matter simulations, with cosmological model parameters sampled with a mixed active-learning strategy, from which we construct over 3000 mock dark energy survey lensing data sets. For wCDM inference, for which we allow –1 < w < –$\frac{1}{3}$⁠, our most constraining result uses power spectra combined with map-level (CNN) inference. Using gravitational lensing data only, this map-level combination gives Ω m = 0.283$^{+0.020}_{–0.027}$⁠, S 8 = 0.804$^{+0.025}_{–0.017⁠}$, and w < –0.80 (with a 68 per cent credible interval); compared to the power spectrum inference, this is more than a factor of two improvement in dark energy parameter (Ω⁠ DE , w⁠) precision.

79 ASTRONOMY AND ASTROPHYSICS↗

A cautionary tale of decorrelating theory uncertainties

A variety of techniques have been proposed to train machine learning classifiers that are independent of a given feature. While this can be an essential technique for enabling background estimation, it may also be useful for reducing uncertainties. We carefully examine theory uncertainties, which typically do not have a statistical origin. We will provide explicit examples of two-point (fragmentation modeling) and continuous (higher-order corrections) uncertainties where decorrelating significantly reduces the apparent uncertainty while the true uncertainty is much larger. These results suggest that caution should be taken when using decorrelation for these types of uncertainties as long as we do not have a complete decomposition into statistically meaningful components.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Semi-Analytical Hierarchical Bayesian Inference of Nonlinear Model Structure in Stochastic Dynamics: Applied to Compartmental Models of Infectious Diseases

A Bayesian computational framework for parsimonious inference in stochastic nonlinear dynamical systems is presented. This framework enables the concurrent estimation of system states, time-varying parameters, time-invariant parameters, and the optimal sparsity structure of the model parameters. Because differential equation-based models are often simplified mechanistic or phenomenological representations, robust inference from noisy measurement data requires explicit treatment of model error and uncertainty. Model error and time-varying parameters can be represented as random processes, enabling inference while making minimal assumptions about the underlying sources of discrepancy and variability. Adopting stochastic differential equation representations affords the model significant flexibility, but can also render it susceptible to overfitting during statistical inversion, where the inferred model may track noise rather than the underlying signal. To alleviate the effects of overfitting and to enable the discovery of the optimal sparse representation of the time-invariant parameters, a Bayesian sparse learning algorithm is embedded within the framework. This sparse learning framework adopts an approximate hierarchical Bayesian setting defined by a series of semi-analytical expressions. The model structure inference framework is validated using a stochastic compartmental model for tracking and forecasting active cases of an infectious disease. Compartmental models describe population-level infectious disease dynamics through interactions among population fractions grouped by disease state. Mathematically, such models consist of a system of coupled ordinary differential equations. This example adopts an expressive compartmental model that includes multiple possible interactions between disease states, motivated by early uncertainty surrounding COVID-19 reinfection dynamics and their implications for long-term epidemic forecasting. The sparse learning exercise permits the inference of a priori unknown epidemiological dynamics from simulated public health data, discovering the nested compartmental model that optimizes the trade-off between average data-fit and model complexity. It is shown that inducing sparsity among the model parameters eliminates redundant interactions between compartments, equivalently revealing the optimal coupling structure between differential equations.

97 MATHEMATICS AND COMPUTING↗

Taking the initiative: A leadership conference for women in science and engineering

The conference sprang from discussions on the current climate that women face in science, mathematics, engineering, and technology. The conference (and this document) is a beginning, not a culmination, of women's learning leadership skills. Conferees were active, articulate, energetic, and ready to learn leadership qualities, some of which seem universal, others that appear to require skills in specific fields. After the introduction, the workshops and presentations are arranged under vision and direction, barriers, alignment and communication, and motivation and inspiration. Some statistics are presented on women degrees and employment in various fields.

Source record↗

Summary of Propagation Cases of the Second AIAA Sonic Boom Prediction Workshop

A summary is provided for the propagation portion of the second AIAA Sonic Boom Workshop held January 8, 2017 in conjunction with the AIAA SciTech 2017 conference. Near-field pressure waveforms for two cases were supplied and ground signatures at multiple azimuthal angles as well as their corresponding loudness metrics were requested from 10 participants, representing 3 countries. Each case had some required runs, as well as some optional runs. The required cases included atmospheric profiles with measured data including winds, using Radiosonde balloon data at multiple geographically spread locations, while the optional cases included temperature and pressure profiles from the US Standard atmosphere. The humidity profiles provided for the optional cases were taken from ANSI guidance, as the authors were unaware of an accepted standard at the time the cases were released to the participants. Participants provided ground signatures along with the requested data, including some loudness metrics using their best practices, which included lossy as well as lossless schemes. All the participants' submissions, for each case, are compared and discussed. Noise or loudness measures are calculated and detailed comparisons and statistical analyses are performed and presented. It has been observed that the variation in the loudness measures and spread between participants' submissions increased as the computation proceeded from under-track locations towards the lateral cut-off. Lessons learned during this workshop are discussed and recommendations are made for potential improvements and possible subsequent workshops as we collectively attempt to refine our analysis methods.

Rallabhandi, Sriram↗

Summary of Propagation Cases of the Second AIAA Sonic Boom Prediction Workshop

A summary is provided for the propagation portion of the second AIAA Sonic Boom Workshop held January 8, 2017 in conjunction with the AIAA SciTech 2017 conference. Near-field pressure waveforms for two cases were supplied and ground signatures at multiple azimuthal angles as well as their corresponding loudness metrics were requested from 10 participants, representing 3 countries. Each case had some required, as well as some optional runs. The required cases included atmospheric profiles with measured data including winds, using Radiosonde balloon data at multiple geographically spread locations. The humidity profiles provided for the optional cases were taken from ANSI guidance, as the authors were unaware of an accepted standard at the time the cases were released to the participants. Participants provided ground signatures along with the requested data, including some loudness metrics using their best practices, which included lossy as well as lossless atmospheric propagation schemes. All the participants’ submissions, for each case, are compared and discussed. Noise or loudness measures are calculated and detailed comparisons and statistical analyses are performed and presented. It has been observed that the variation in the loudness measures and spread between participants’ submissions increased as the computation proceeded from under-track locations towards the lateral cut-off. Lessons learned during this workshop are discussed and recommendations are made for potential improvements and possible subsequent workshops as we collectively attempt to refine our analysis methods.

Rallabhandi, Sriram↗

Automatic detection of microlensing events in the galactic bulge using machine learning techniques

The Wide Field Infrared Survey Telescope (WFIRST) is a NASA flagship mission scheduled to launch in mid-2020, with more than one year of its lifetime dedicated to microlensing survey. The survey is to discover thousands of exoplanets near or beyond the snowline via their microlensing light curve signatures, enabling a Kepler-like statistical analysis of planets at ~1-10 AU from their host stars and potentially revolutionizing our understanding of planet formation. The goal of our work is to create an automated system that has the ability to efficiently process and classify large-scale astronomical datasets that missions such as WFIRST will produce. In this paper, we discuss our framework that utilizes features election and parameter optimization for classification models to automatically differentiate the different types of stellar variability and detect microlensing events.

Shvartzvald, Yossi↗

GrainPaint: A multi-scale diffusion-based generative model for microstructure reconstruction of large-scale objects

Simulation-based approaches to microstructure generation can suffer from a variety of limitations, such as high memory usage, long computational times, and difficulties in generating complex geometries. Generative machine learning models present a way around these issues, but they have previously been limited by the fixed size of their generation area. Here, we present a new microstructure generation methodology leveraging advances in inpainting using denoising diffusion models to overcome this generation area limitation. We show that microstructures generated with the presented methodology are statistically similar to grain structures generated with a kinetic Monte Carlo simulator, SPPARKS.

36 MATERIALS SCIENCE↗

MaTableGPT: GPT‐Based Table Data Extractor from Materials Science Literature

Abstract Efficiently extracting data from tables in the scientific literature is pivotal for building large‐scale databases. However, the tables reported in materials science papers exist in highly diverse forms; thus, rule‐based extractions are an ineffective approach. To overcome this challenge, the study presents MaTableGPT, which is a GPT‐based table data extractor from the materials science literature. MaTableGPT features key strategies of table data representation and table splitting for better GPT comprehension and filtering hallucinated information through follow‐up questions. When applied to a vast volume of water splitting catalysis literature, MaTableGPT achieves an extraction accuracy (total F1 score) of up to 96.8%. Through comprehensive evaluations of the GPT usage cost, labeling cost, and extraction accuracy for the learning methods of zero‐shot, few‐shot, and fine‐tuning, the study presents a Pareto‐front mapping where the few‐shot learning method is found to be the most balanced solution owing to both its high extraction accuracy (total F1 score >95%) and low cost (GPT usage cost of 5.97 US dollars and labeling cost of 10 I/O paired examples). The statistical analyses conducted on the database generated by MaTableGPT revealed valuable insights into the distribution of the overpotential and elemental utilization across the reported catalysts in the water splitting literature.

Yi, Gyeong Hoon [Computational Science Research Ce↗

Assessing the Influence of Microphysical and Environmental Parameter Perturbations on Orographic Precipitation

Microphysical (MP) schemes contain parameters whose values can impact the amount and location of forecasted precipitation, and sensitivity is typically explored by perturbing one parameter at a time while holding the rest constant. Although much can be learned from these “one-at-a-time” studies, the results are limited as these methods do not allow for nonlinear interactions of multiple perturbed parameters. This study applies the Morris one-at-a-time (MOAT) method, a robust statistical tool allowing for simultaneous perturbation of numerous parameters, to explore orographic precipitation sensitivity to changes in microphysical and environmental parameters within an environment characteristic of an atmospheric river. Results show parameters associated with snow fall speed coefficient A s and density ρ s , ice-cloud water collection efficiency (ECI), rain accretion (WRA), relative humidity, zonal wind speed, and surface potential temperature cause the largest influence on simulated precipitation. MP and environmental parameter perturbations can cause precipitation changes of similar magnitude, but results vary by location on the mountain. Different environments are also tested, with A s being the most influential MP parameter regardless of environment. Fewer MP parameters influence precipitation in a faster-wind-speed environment, possibly due to the stronger dynamical forcing upwind and different wave dynamics downwind, compared to a slower-wind-speed environment. Finally, perturbing MP parameters within a single scheme can result in precipitation variations of similar magnitude compared to using entirely different microphysics schemes. MOAT results presented in this study have implications for Bayesian parameter estimation methods and stochastic parameterization within ensemble forecasting.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Long Duration Head-Down Tilt Bed Rest Studies: Safety Considerations Regarding Vision Health

Visual symptoms reported in astronauts returning from long duration missions in low Earth orbit, including hyperopic shift, choroidal folds, globe flattening and papilledema, are thought to be related to fluid shifts within the body due to microgravity exposure. Because of this possible relation to fluid shifts, safety considerations have been raised regarding the ocular health of head-down tilt (HDT) bed rest subjects. HDT is a widely used ground ]based analog that simulates physiological changes of spaceflight, including fluid shifts. Thus, vision monitoring has been performed in bed rest subjects in order to evaluate the safety of HDT with respect to vision health. Here we report ocular outcomes in 9 healthy subjects (age range: 27-48 years; Male/Female ratio: 8/1) completing bed rest Campaign 11, an integrated, multidisciplinary 70-day 6 degrees HDT bed rest study. Vision examinations were performed on a weekly basis, and consisted of office-based (2 pre- and 2 post-bed rest) and in-bed testing. The experimental design was a repeated measures design, with measurements for both eyes taken for each subject at each planned time point. Findings for the following tests were all reported as normal in each testing session for every subject: modified Amsler grid, red dot test, confrontational visual fields, color vision and fundus photography. Overall, no statistically significant differences were observed for any of the measures, except for both near and far visual acuity, which increased during the course of the study. This difference is not considered clinically relevant as may result from the effect of learning. Intraocular pressure results suggest a small increase at the beginning of the bed rest phase (p=0.059) and lesser increase at post-bed rest with respect to baseline (p=0.046). These preliminary results provide the basis for further analyses that will include correlations between intraocular pressure change pre- and post-bed rest, and optical coherence tomography measurements of the retina.

Cromwell, Ronita L.↗

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗

Boosting the Performance of Plug-and-Play Priors via Denoiser Scaling

Plug-and-play priors (PnP) is an image reconstruction framework that utilizes an image denoiser as an imaging prior. Unlike traditional regularized inversion, PnP does not require the prior to be expressible in the form of a regularization function. This flexibility enables PnP algorithms to exploit the most effective image denoisers, leading to their state-of-the-art performance in various imaging tasks. However, many powerful denoisers, such as the ones based on convolutional neural networks (CNNs), do not have tunable parameters that would allow controlling their influence within PnP. To address this issue, in this paper, we introduce a scaling parameter that adjusts the magnitude of the denoiser input and output. We theoretical justify the denoiser scaling from the perspectives of proximal optimization, statistical estimation, and consensus equilibrium. Finally, we provide numerical experiments demonstrating the ability of denoiser scaling to systematically improve the performance of PnP for denoising CNN priors that do not have explicitly tunable parameters.

Boosting↗

Search for $\mu^- \rightarrow e^+$ conversion: what can be learned from the SINDRUM-II positron data on a gold target

In their 2006 paper setting the current limit on \mumemconv\ conversion search on a gold target \cite{sindrum_ii:Bertl2006}, the SINDRUM-II collaboration published, along with the electron momentum distribution, the momentum distribution of reconstructed positrons. Near the positron spectrum endpoint, there is a statistically significant excess of observed events over the expected background. We estimate that in the region 88 MeV/c < p < 95 MeV/c there are 13 events with an expected background of about 1-1.5 event, which has not been discussed by the authors. Those 13 events form a bump with a width consistent with the experimental resolution, making one think of a $\mu^- \rightarrow e^+$ conversion signal. However, the reconstructed position of the bump is about 1 MeV/c, or $\sim\ 4\sigma_p$, lower than the expected $\mu^- Au \rightarrow e^+ Ir $ signal, which strongly discourages the exotic interpretation. The excess, however, could be due to an exclusive dipole radiative muon capture (RMC) transition $^{197}Au(GS) ~\rightarrow~ ^{197}Pt(GS)$ with the branching fraction of about $2\cdot 10^{-4}$. Such a transition would not be resolved by the existing RMC measurements. We conclude that the exclusive RMC transitions could significantly modify the positron spectrum near the kinematic endpoint, to fully exploit the physics potential of the upcoming experiments such as Mu2e and COMET, a better theoretical understanding of the RMC spectrum on nuclei is needed. A high-resolution measurement of the RMC photon spectra has to be carried out. Without that, the sensitivity of the searches for $\mu^- \rightarrow e^+$ and $\mu^- \rightarrow e^-$ might be severely limited by unknown probabilities of RMC transitions to the exclusive low-lying states of the daughter nuclei.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Online Multi-Modal Learning and Adaptive Information Trajectory Planning for Autonomous Exploration

In robotic information gathering missions, scientists are typically interested in understanding variables which require proxy measurements from specialized sensor suites to estimate. However, energy and time constraints limit how often these sensors can be used in a mission. Robots are also equipped with cheaper to use navigation sensors such as cameras. In this paper, we explore a challenging planning problem in which a robot is required to learn about a scientific variable of interest in an initially unknown environment by planning informative paths and deciding when and where to use its sensors. To tackle this we present two innovations: a Bayesian generative model framework to automatically learn correlations between expensive science sensors and cheaper to use navigation sensors online, and a sampling based approach to plan for multiple sensors while handling long horizons and budget constraints. Our approach does not grow in complexity with data and is anytime making it highly applicable to field robotics. We tested our approach extensively in simulation and validated it with real data collected during the 2014 Mojave Volatiles Prospector Mission. Our planning algorithm performs statistically significantly better than myopic approaches and at least as well as a coverage-based algorithm in an initially unknown environment while having added advantages of being able to exploit prior knowledge and handle other intricacies of the real world without further algorithmic modifications.

learning↗

OmicsMLMentor: A Web Application for Guided Machine Learning Analysis of Omics Data

Expression-based omics technologies (e.g. proteomics, metabolomics, transcriptomics, etc.) increasingly rely on supervised and unsupervised machine learning (ML) models to find key biomolecules distinguishing conditions, identify natural groupings in biological data, or generate predictions for outcomes of interest. Fitting ML models to omics data presents several challenges, including handling missing data, selecting a normalization method, choosing a valid model, and optimizing hyperparameters, all requiring statistical programming skills to address these challenges. Thus, the open-source web application SLOPE was designed to lower the barrier to ML modeling for omics data. SLOPE supports the fitting of 15 ML models (10 supervised and 5 unsupervised) tailored to omics datasets, such as proteomics, metabolomics, lipidomics, and transcriptomics. SLOPE offers several omics-specific features, including methods for handling missingness (imputation, conversion, removal), normalization tests, ranking of models based on the structure of a user’s data and user input, and optimal hyperparameter selections using cross-validation splits. By streamlining ML workflows for omics analysis, SLOPE address critical gaps in existing online web tools, facilitating a broader adoption of these models for omics research. Here, SLOPE is applied to data from a lignin exposure study to highlight the workflow for fitting both supervised and unsupervised models to data.

lipidomics↗