Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Manifold Learning: What, How, and Why

Manifold learning (ML), also known as nonlinear dimension reduction, is a set of methods to find the low-dimensional structure of data. Dimension reduction for large, high-dimensional data is not merely a way to reduce the data; the new representations and descriptors obtained by ML reveal the geometric shape of high-dimensional point clouds and allow one to visualize, denoise, and interpret them. This review presents the underlying principles of ML, its representative methods, and their statistical foundations, all from a practicing statistician's perspective. It describes the trade-offs and what theory tells us about the parameter and algorithmic choices we make in order to obtain reliable conclusions.

Mathematics↗

Convergence Rates for Empirical Estimation of Binary Classification Bounds

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error rate depend on information divergences between the pair of class distributions. Recently, the Henze–Penrose (HP) divergence has been proposed for bounding classification error probability. We consider the problem of empirically estimating the HP-divergence from random samples. We derive a bound on the convergence rate for the Friedman–Rafsky (FR) estimator of the HP-divergence, which is related to a multivariate runs statistic for testing between two distributions. The FR estimator is derived from a multicolored Euclidean minimal spanning tree (MST) that spans the merged samples. We obtain a concentration inequality for the Friedman–Rafsky estimator of the Henze–Penrose divergence. We validate our results experimentally and illustrate their application to real datasets.

97 MATHEMATICS AND COMPUTING↗

Performance and Evaluation of the Global Modeling and Assimilation Office Observing System Simulation Experiment

The National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) has spent more than a decade developing and implementing a global Observing System Simulation Experiment framework for use in evaluting both new observation types as well as the behavior of data assimilation systems. The NASA/GMAO OSSE has constantly evolved to relect changes in the Gridpoint Statistical Interpolation data assimiation system, the Global Earth Observing System model, version 5 (GEOS-5), and the real world observational network. Software and observational datasets for the GMAO OSSE are publicly available, along with a technical report. Substantial modifications have recently been made to the NASA/GMAO OSSE framework, including the character of synthetic observation errors, new instrument types, and more sophisticated atmospheric wind vectors. These improvements will be described, along with the overall performance of the current OSSE. Lessons learned from investigations into correlated errors and model error will be discussed.

OSS↗

Recurrent neural networks for short-term and long-term prediction of geothermal reservoirs

Accurate prediction of geothermal reservoir responses to alternative energy production scenarios is critical for optimizing the development of the underlying resources. While the conventional physics-based models offer a comprehensive prediction tool, data-driven models provide an efficient alternative to build fit-for-purpose predictive models by extracting and using the statistical patterns in the collected data to make predictions. The recurrent neural network (RNN) is a data-driven model that is commonly applied to predict time series sequences. This paper presents a variant of RNN that also utilizes the efficiency of convolutional neural networks (CNN) for the prediction of energy production from geothermal reservoirs. Specifically, a CNN–RNN architecture is developed that takes historical well controls as input (features) and their corresponding production response data as output (labels) to learn an input-output mapping that can predict the future well production responses/performance for any given future well control inputs. The model is paired with a labeling scheme to handle real field disturbances that create data gaps. In addition to the model structure, we introduce a thorough workflow for applying the model, which includes data pre-processing, feature selection, as well as different training strategies for short-term and long-term prediction. Finally, the performance and accuracy of the model are evaluated by applying it to multiple datasets, including a field reservoir model.

15 GEOTHERMAL ENERGY↗

Sesame Equation of State Number 2100 for Scandium

An equation of state (EOS) for scandium has been constructed using the OpenSesame code and was placed in the SESAME library as material number 2100. The cold curve was constructed with a Mie-Grüneisen model fitted to the high pressure Hugoniot data and to the zero pressure bulk sound speed, the nuclear contribution was calculated from JD Johnson nuclear model and the electronic thermal contribution from the Thomas-Fermi-Dirac statistical model. The EOS behaves reasonably well over a wide range of densities, pressures and temperatures, and compares fairly with the available experimental data. Of the 5 solid phases present in scandium at room temperature, however, only the first one, the hcp phase, is assumed to occur. Also the transition to bcc at room pressure just before melting is ignored. We plan to construct a multiphase EOS as the next step. The purpose of the present calculation was mostly for learning purposes, as is reflected by the way the report is written.

36 MATERIALS SCIENCE↗

Application of Machine Learning Algorithms to the Study of Noise Artifacts in Gravitational-Wave Data

The sensitivity of searches for astrophysical transients in data from the Laser Interferometer Gravitationalwave Observatory (LIGO) is generally limited by the presence of transient, non-Gaussian noise artifacts, which occur at a high-enough rate such that accidental coincidence across multiple detectors is non-negligible. Furthermore, non-Gaussian noise artifacts typically dominate over the background contributed from stationary noise. These "glitches" can easily be confused for transient gravitational-wave signals, and their robust identification and removal will help any search for astrophysical gravitational-waves. We apply Machine Learning Algorithms (MLAs) to the problem, using data from auxiliary channels within the LIGO detectors that monitor degrees of freedom unaffected by astrophysical signals. Terrestrial noise sources may manifest characteristic disturbances in these auxiliary channels, inducing non-trivial correlations with glitches in the gravitational-wave data. The number of auxiliary-channel parameters describing these disturbances may also be extremely large; high dimensionality is an area where MLAs are particularly well-suited. We demonstrate the feasibility and applicability of three very different MLAs: Artificial Neural Networks, Support Vector Machines, and Random Forests. These classifiers identify and remove a substantial fraction of the glitches present in two very different data sets: four weeks of LIGO's fourth science run and one week of LIGO's sixth science run. We observe that all three algorithms agree on which events are glitches to within 10% for the sixth science run data, and support this by showing that the different optimization criteria used by each classifier generate the same decision surface, based on a likelihood-ratio statistic. Furthermore, we find that all classifiers obtain similar limiting performance, suggesting that most of the useful information currently contained in the auxiliary channel parameters we extract is already being used. Future performance gains are thus likely to involve additional sources of information, rather than improvements in the MLAs themselves.

gravitational-wave data↗

Dosimetric comparison of rectal-sparing capabilities of rectal balloon vs injectable spacer gel in stereotactic body radiation therapy for prostate cancer: lessons learned from prospective trials

This study aimed to compare the rectal-sparing capabilities of rectal balloons vs absorbable injectable spacer gel in stereotactic body radiation therapy (SBRT) for prostate cancer. Patient samples included in this analysis were obtained from 2 multi-institutional prospective trials of SBRT for prostate cancer using a rectal balloon (n = 36 patients) and injectable spacer gel (n = 36). Treatment prescription dose was 45 Gy in 5 fractions in 42 patients; for equal comparison, the remaining 30 patients were rescaled to 45 Gy from 47.5 Gy prescription (n = 6) and 50 Gy prescription (n = 24). The median prostate volumes and body mass index in the 2 patient samples were not statistically significantly different (p = 0.67 and 0.45, respectively), supporting anatomic similarity between cohorts. The injectable spacer gel achieved dosimetric superiority over the rectal balloon with respect to the maximum dose to the rectum (42.3 vs 46.2 Gy, p vs 35.1 Gy, p Gy ), V40{sub Gy}, and V30{sub Gy} (0.3 vs 1.7 cc, 1 vs 5.4 cc, and 4.1 vs 9.6 cc, respectively; p Gy of the rectum or the dose to 50% of the rectal circumference (p = 0.29 and 0.06, respectively). The V18.3{sub Gy} of the bladder was significantly larger with the rectal balloon (19.9 vs 14.5 cc, p = 0.003). In this analysis of patients enrolled on 2 consecutive multi-institutional prospective trials of SBRT for prostate cancer, the injectable spacer gel outperformed the rectal balloon in the majority of the examined and relevant dosimetric rectal-sparing parameters. The rectal balloon did not outperform the injectable spacer gel in any measured rectal dose parameter.

61 RADIATION PROTECTION AND DOSIMETRY↗

Mapathons versus automated feature extraction: a comparative analysis for strengthening immunization microplanning

Background: Social instability and logistical factors like the displacement of vulnerable populations, the difficulty of accessing these populations, and the lack of geographic information for hard-to-reach areas continue to serve as barriers to global essential immunizations (EI). Microplanning, a population-based, healthcare intervention planning method has begun to leverage geographic information system (GIS) technology and geospatial methods to improve the remote identification and mapping of vulnerable populations to ensure inclusion in outreach and immunization services, when feasible. We compare two methods of accomplishing a remote inventory of building locations to assess their accuracy and similarity to currently employed microplan line-lists in the study area. Methods: The outputs of a crowd-sourced digitization effort, or mapathon, were compared to those of a machine-learning algorithm for digitization, referred to as automatic feature extraction (AFE). The following accuracy assessments were employed to determine the performance of each feature generation method: (1) an agreement analysis of the two methods assessed the occurrence of matches across the two outputs, where agreements were labeled as “befriended” and disagreements as “lonely”; (2) true and false positive percentages of each method were calculated in comparison to satellite imagery; (3) counts of features generated from both the mapathon and AFE were statistically compared to the number of features listed in the microplan line-list for the study area; and (4) population estimates for both feature generation method were determined for every structure identified assuming a total of three households per compound, with each household averaging two adults and 5 children. Results: The mapathon and AFE outputs detected 92,713 and 53,150 features, respectively. A higher proportion (30%) of AFE features were befriended compared with befriended mapathon points (28%). The AFE had a higher true positive rate (90.5%) of identifying structures than the mapathon (84.5%). The difference in the average number of features identified per area between the microplan and mapathon points was larger (t = 3.56) than the microplan and AFE (t = -2.09) (alpha = 0.05). Conclusions: Our findings indicate AFE outputs had higher agreement (i.e., befriended), slightly higher likelihood of correctly identifying a structure, and were more similar to the local microplan line-lists than the mapathon outputs. These findings suggest AFE may be more accurate for identifying structures in high-resolution satellite imagery than mapathons. However, they both had their advantages and the ideal method would utilize both methods in tandem.

59 BASIC BIOLOGICAL SCIENCES↗

Novel Ultrabright and Air-Stable Photocathodes Discovered from Machine Learning and Density Functional Theory Driven Screening

The high brightness, low emittance electron beams achieved in modern X-ray free-electron lasers (XFELs) have enabled powerful X-ray imaging tools, allowing molecular systems to be imaged at picosecond time scales and sub-nanometer length scales. One of the most promising directions for increasing the brightness of XFELs is through the development of novel photocathode materials. Whereas past efforts aimed at discovering photocathode materials have typically employed trial-and-error-based iterative approaches, this work represents the first data-driven screening for high brightness photocathode materials. Through screening over 74 000 semiconducting materials, a vast photocathode dataset is generated, resulting in statistically meaningful insights into the nature of high brightness photocathode materials. This screening results in a diverse list of photocathode materials that exhibit intrinsic emittances that are up to 4x lower than currently used photocathodes. In a second effort, multiobjective screening is employed to identify the family of M 2 O (M = Na, K, Rb) that exhibits photoemission properties that are comparable to the current state-of-the-art photocathode materials, but with superior air stability. This family represents perhaps the first intrinsically bright, visible light photocathode materials that are resistant to reactions with oxygen, allowing for their transport and storage in dry air environments.

36 MATERIALS SCIENCE↗

Machine learning enabled discovery of application dependent design principles for two-dimensional materials

Abstract The unique electronic and mechanical properties of two-dimensional (2D) materials make them promising next-generation candidates for a variety of applications. Large-scale searches for high-performing 2D materials are limited to calculating descriptors with computationally demanding first-principles density functional theory. In this work, we alleviate this issue by extending and generalizing crystal graph convolutional neural networks to systems with planar periodicity and train an ensemble of models to predict thermodynamic, mechanical and electronic properties. We carry out a screening of nearly 45,000 structures for two separate applications: mechanical strength and photovoltaics. By collecting statistics of the screened candidates, we investigate structural and compositional design principles that impact the properties of the structures surveyed. Our approach recovers some well-accepted design rules: hybrid organic-inorganic perovskites with lead and tin tend to be good candidates for solar cell applications and titanium based MXenes usually have high stiffness coefficients. Interestingly, other members of the group 4 elements also contribute to increasing the mechanical strength of MXenes. For all-inorganic perovskites, we discover some compositions that have not been deeply studied in the field of photovoltaics and thus open up paths for further investigation. We open-source the code-base to spur further development in this space.

Venturi, Victor (ORCID:0000000156727549)↗

TH-CD-207A-07: Prediction of High Dimensional State Subject to Respiratory Motion: A Manifold Learning Approach

Purpose: The development of high dimensional imaging systems (e.g. volumetric MRI, CBCT, photogrammetry systems) in image-guided radiotherapy provides important pathways to the ultimate goal of real-time volumetric/surface motion monitoring. This study aims to develop a prediction method for the high dimensional state subject to respiratory motion. Compared to conventional linear dimension reduction based approaches, our method utilizes manifold learning to construct a descriptive feature submanifold, where more efficient and accurate prediction can be performed. Methods: We developed a prediction framework for high-dimensional state subject to respiratory motion. The proposed method performs dimension reduction in a nonlinear setting to permit more descriptive features compared to its linear counterparts (e.g., classic PCA). Specifically, a kernel PCA is used to construct a proper low-dimensional feature manifold, where low-dimensional prediction is performed. A fixed-point iterative pre-image estimation method is applied subsequently to recover the predicted value in the original state space. We evaluated and compared the proposed method with PCA-based method on 200 level-set surfaces reconstructed from surface point clouds captured by the VisionRT system. The prediction accuracy was evaluated with respect to root-mean-squared-error (RMSE) for both 200ms and 600ms lookahead lengths. Results: The proposed method outperformed PCA-based approach with statistically higher prediction accuracy. In one-dimensional feature subspace, our method achieved mean prediction accuracy of 0.86mm and 0.89mm for 200ms and 600ms lookahead lengths respectively, compared to 0.95mm and 1.04mm from PCA-based method. The paired t-tests further demonstrated the statistical significance of the superiority of our method, with p-values of 6.33e-3 and 5.78e-5, respectively. Conclusion: The proposed approach benefits from the descriptiveness of a nonlinear manifold and the prediction reliability in such low dimensional manifold. The fixed-point iterative approach turns out to work well practically for the pre-image recovery. Our approach is particularly suitable to facilitate managing respiratory motion in image-guide radiotherapy. This work is supported in part by NIH grant R01 CA169102-02.

60 APPLIED LIFE SCIENCES↗

An Increase in Medical Student Knowledge of Radiation Oncology: A Pre-Post Examination Analysis of the Oncology Education Initiative

Purpose: The Oncology Education Initiative was created to advance oncology and radiation oncology education by integrating structured didactics into the existing core radiology clerkship. We set out to determine whether the addition of structured didactics could lead to a significant increase in overall medical student knowledge about radiation oncology. Methods and Materials: We conducted a pre- and posttest examining concepts in general radiation oncology, breast cancer, and prostate cancer. The 15-question, multiple-choice exam was administered before and after a 1.5-hour didactic lecture by an attending physician in radiation oncology. Individual question changes, overall student changes, and overall categorical changes were analyzed. All hypothesis tests were two-tailed (significance level 0.05). Results: Of the 153 fourth-year students, 137 (90%) took the pre- and posttest and were present for the didactic lecture. The average test grade improved from 59% to 70% (p = 0.011). Improvement was seen in all questions except clinical vignettes involving correct identification of TNM staging. Statistically significant improvement (p {<=} 0.03) was seen in the questions regarding acute and late side effects of radiation, brachytherapy for prostate cancer, delivery of radiation treatment, and management of early-stage breast cancer. Conclusions: Addition of didactics in radiation oncology significantly improves medical students' knowledge of the topic. Despite perceived difficulty in teaching radiation oncology and the assumption that it is beyond the scope of reasonable knowledge for medical students, we have shown that even with one dedicated lecture, students can learn and absorb general principles regarding radiation oncology.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Soft matter roadmap

Soft materials are usually defined as materials made of mesoscopic entities, often self-organised, sensitive to thermal fluctuations and to weak perturbations. Archetypal examples are colloids, polymers, amphiphiles, liquid crystals, foams. The importance of soft materials in everyday commodity products, as well as in technological applications, is enormous, and controlling or improving their properties is the focus of many efforts. From a fundamental perspective, the possibility of manipulating soft material properties, by tuning interactions between constituents and by applying external perturbations, gives rise to an almost unlimited variety in physical properties. Together with the relative ease to observe and characterise them, this renders soft matter systems powerful model systems to investigate statistical physics phenomena, many of them relevant as well to hard condensed matter systems. Understanding the emerging properties from mesoscale constituents still poses enormous challenges, which have stimulated a wealth of new experimental approaches, including the synthesis of new systems with, e.g. tailored self-assembling properties, or novel experimental techniques in imaging, scattering or rheology. Theoretical and numerical methods, and coarse-grained models, have become central to predict physical properties of soft materials, while computational approaches that also use machine learning tools are playing a progressively major role in many investigations. This Roadmap intends to give a broad overview of recent and possible future activities in the field of soft materials, with experts covering various developments and challenges in material synthesis and characterisation, instrumental, simulation and theoretical methods as well as general concepts.

36 MATERIALS SCIENCE↗

FrESCO: Framework for Exploring Scalable Computational Oncology

The National Cancer Institute (NCI) monitors population level cancer trends as part of its Surveillance, Epidemiology, and End Results (SEER) program. This program consists of state or regional level cancer registries which collect, analyze, and annotate cancer pathology reports. From these annotated pathology reports, each individual registry aggregates cancer phenotype information from electronic health records. This data is then used to create summary statistics about cancer incidence and mortality to facilitate population health monitoring. Extracting phenotypic information from these reports is a labor intensive task, requiring specialized knowledge about the reports and cancer. Automating the information extraction process from cancer pathology reports has the potential to improve data quality by extracting information in a consistent manner across registries. It can also improve patient outcomes by reducing the time from diagnosis, enabling rapid case ascertainment for clinical trials. Here we present FrESCO, a modular deep-learning natural language processing (NLP) library initially designed for extracting pathology information from clinical text documents. This repository is not solely limited to clinical medical text, but may also be used by researchers just getting started with NLP methods and those looking for a robust solution for their classification problems.

60 APPLIED LIFE SCIENCES↗

Framework for an adaptive integrated observation system using a hierarchy of machine learning approaches

Focal Area(s): 1. Data acquisition enabled by machine learning, AI, and advanced methods including experimental/network design/optimization, and hardware-related efforts involving AI. 2. Insight gleaned from complex measurements using AI, big data analytics, and other advanced methods, including explainable AI and physics- or knowledge-guided AI Science Challenge and Rationale: Atmospheric processes are stochastic, occur at scales from the micrometer to many kilometers, and are constantly changing over time. Characterizing these interactions and associated environmental conditions using traditional measurement techniques is difficult and can take years to build statistics on atmospheric phenomena that occurs episodically. Developing new innovative approaches to modify sampling strategies in real-time would enable the routine collection of targeted measurements focused on a specific set of science questions.

54 ENVIRONMENTAL SCIENCES↗

Mammalian Vestibular Macular Synaptic Plasticity: Results from SLS-2 Spaceflight

The effects of exposure to microgravity were studied in rat utricular maculas collected inflight (IF, day 13), post-flight on day of orbiter landing (day 14, R+O) and after 14 days (R+ML). Controls were collected at corresponding times. The objectives were 1) to learn whether hair cell ribbon synapses counts would be higher in tissues collected in space than in tissues collected postflight during or after readaptation to Earth's gravity; and 2) to compare results with those of SLS-1. Maculas were fixed by immersion, micro-dissected, dehydrated and prepared for ultrastructural study by usual methods. Synapses were counted in 100 serial sections 150 nm thick and were located to specific hair cells in montages of every 7th section. Counts were analyzed for statistical significance using analysis of variance. Results in maculas of IF dissected rats, one 13 day control (IFC), and one R + 0 rat have been analyzed. Study of an R+ML macula is nearly completed. For type I cells, IF mean is 2.3 +/-1.6; IFC mean is 1.6 +/-1.0; R+O mean is 2.3 +/- 1.6. For type II cells, IF mean is 11.4 +/- 17.1; IFC mean is 5.5 +/-3.5; R+O mean is 10.1 +/- 7.4. The difference between IF and IFC means for type I cells is statistically significant (p less than 0.0464). For type It cells, IF compared to IFC means, p less than 0.0003; and for IFC to R+O means, p less than 0.0139. Shifts toward spheres (p less than 0.0001) and pairs (p less than 0.0139) were significant in type II cells of IF rats. The results are largely replicating findings from SLS-1 and indicate that spaceflight affects synaptic number, form and distribution, particularly in type II hair cells. The increases in synaptic number and in sphere-like ribbons are interpreted to improve synaptic efficacy, to help return afferent discharges to a more normal state. Findings indicate that a great capacity for synaptic plasticity exists in mammalian gravity sensors, and that this plasticity is more dominant in the local circuitry. The local circuit includes type II cells and is interpreted to be responsible for shaping the final output of the system.

Ross, Muriel D.D.↗

Search for two-neutrino double-beta decay of 136 Xe to the $0$$^{+}_{1}$ excited state of 136 Ba with the complete EXO-200 dataset*

A new search for two-neutrino double-beta (2νββ) decay of 136 Xe to the $0$$^{+}_{1}$ excited state of 136 Ba is performed with the full EXO-200 dataset. A deep learning-based convolutional neural network is used to discriminate signal from background events. Signal detection efficiency is increased relative to previous searches by EXO-200 by more than a factor of two. With the addition of the Phase II dataset taken with an upgraded detector, the median 90% confidence level half-life sensitivity of 2νββ decay to the $0$$^{+}_{1}$ state of 136 Ba is 2.9 x 10 24 yr using a total 136 Xe exposure of 234.1 kg yr. Furthermore, no statistically significant evidence for 2νββ decay to the $0$$^{+}_{1}$ state is observed, leading to a lower limit of $T$$^{2v}_{1/2}$(0 + → $0$$^{+}_{1}$) > 1.4 x 10 24 yr at 90% confidence level, improved by 70% relative to the current world's best constraint.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Reconstruction and Selection of Neutrino Interactions in MicroBooNE using Deep Convolutional Neural Networks

In this document, we describe a new reconstruction workflow developed for the MicroBooNE experiment. It features the use of Deep Convolutional Neural Networks trained to recognize key structures within the data sufficient for the 3D reconstruction of neutrino interactions within the detector. As a test of the reconstruction utility, the products of the reconstruction workflow are used to select inclusive charged-current (CC) $\nu_e$ and $\nu_\mu$ interactions in both simulated and real MicroBooNE data. In simulation, our $\nu_e$ and $\nu_\mu$ selections achieve an efficiency of 57% and 68\%, respectively, with a purity of 91% and 96%, respectively. We find that these selections are competitive with the inclusive selections used for the most recent MicroBooNE LEE searches. In particular, the CC-$\nu_e$ inclusive selection efficiency improves by over 20% while also improving sample purity. As a first step in quantifying potential bias, the data and Monte Carlo expectati ons are compared for both selections using the MicroBooNE open data. Within statistical and systematic uncertainties, both the electron and muon CC-inclusive event samples agree. A comparison of the real data events chosen by our work and another reconstruction framework shows that the two analyses each identify a sizeable fraction of events the other does not. This suggests that future analyses integrating the strengths of each could lead to combined gains. This work demonstrates, for the first time on real LArTPC data, state-of-the-art neutrino interaction reconstruction centered around deep learning algorithms.

43 PARTICLE ACCELERATORS↗