SEARCH · Search NASA

Results for “statistical visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

DOE OSTI2019

Extreme-Scale Distribution-Based Data Analysis

Scientists overview and identify regions of interest by transforming data into compact information descriptors that characterize simulation results and allow detailed analysis on demand. Among many existing feature descriptors, statistical information derived from data samples is a promising approach to taming the big data avalanche because data distributionscomputed from a population can compactly describe the presence and characteristics of salient data features with minimal data movement. The ability to computationally summarize and process data using distributions also provides an efficient and representative capture of information that can adjust to size and resource constraints, with the added benefit that uncertainty associated with results can be quantified and communicated. In this project, we have developed a distribution-based data analysis and visualization framework for optimizing in situ processing and analysis of extreme-scale scientific data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

FAST: Using Federal Fleet Data for Decision-Making

This presentation provides an overview of the information currently being collected by the US Department of Energy, US General Services Administration, and US Energy Information Administration about the federal government's fleet of motor vehicles. The recent transition to collecting this information at the individual vehicle level provides new ways of visualizing the fleet and its operation and of using the information to support new forms of data-driven decision-making about the fleet. This presentation provides three examples of the types of analysis and decision-making this dataset supports.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Machine-learning-enabled on-the-fly analysis of RHEED patterns during thin film deposition by molecular beam epitaxy

Thin film deposition is a fundamental technology for the discovery, optimization, and manufacturing of functional materials. Deposition by molecular beam epitaxy (MBE) typically employs reflection high-energy electron diffraction (RHEED) as a real-time in situ probe of the growing film. However, the state-of-the-art for RHEED analysis during deposition requires human observation. Here, we present an approach using machine learning (ML) methods to monitor, analyze, and interpret RHEED images on-the-fly during thin film deposition. In the analysis workflow, RHEED pattern images are collected at one frame per second and featurized using a pretrained deep convolutional neural network. The feature vectors are then statistically analyzed to identify changepoints; these changepoints can be related to changes in the deposition mode from initial film nucleation to a transition regime, smooth film deposition, and in some cases, an additional transition to a rough, islanded deposition regime. The feature vectors are additionally analyzed via graph analysis and community classification. The graph is quantified as a stabilization plot, and we show that inflection points in the stabilization plot correspond to changes in the growth regime. The full RHEED analysis workflow is termed RHAAPsody and includes data transfer and output to a visual dashboard. We demonstrate the functionality of RHAAPsody by analyzing the precaptured RHEED images from epitaxial depositions of anatase TiO2 on SrTiO3(001) and show that the analysis workflow can be executed in less than 1 s. Our approach shows promise as one component of ML-enabled real-time feedback control of the MBE deposition process.

36 MATERIALS SCIENCE↗

DOE OSTI2014

Homogenization of time series from Portugal and its former colonies for the period from the late 19th to the early 21st century

Here, three homogenization software packages – AnClim, RhTestsV3 and HOMER – have been applied to monthly and annual temperature and pressure series from Portugal and its ex-colonies in Africa and Asia to detect non-climatic breaks. Homogenization tests in both absolute and relative mode were performed with an a posteriori statistical assessment to select the most probable breakpoints. Time series from neighbouring stations as well as reanalyses data were used as reference series. The reanalyses data sets were used due to lack of suitable neighbouring stations and also to test reanalyses as proxy data. A list of probable shifts is produced and will be used to support future global reanalyses. Moreover, temperature and pressure series were adjusted using adjustment factors that were obtained by calculating the difference between certain periods before and after the breaks. The accuracy of the adjusted series was verified subjectively (visually) and objectively using three verification techniques: correlation coefficient, central root-mean-square error and standard deviation. A positive impact of the applied adjustment in terms of all three scores was reflected in a majority of cases.

abrupt breaks↗

DOE OSTI2021

Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks

ABSTRACT The problem of anomaly detection in astronomical surveys is becoming increasingly important as data sets grow in size. We present the results of an unsupervised anomaly detection method using a Wasserstein generative adversarial network (WGAN) on nearly one million optical galaxy images in the Hyper Suprime-Cam (HSC) survey. The WGAN learns to generate realistic HSC-like galaxies that follow the distribution of the data set; anomalous images are defined based on a poor reconstruction by the generator and outlying features learned by the discriminator. We find that the discriminator is more attuned to potentially interesting anomalies compared to the generator, and compared to a simpler autoencoder-based anomaly detection approach, so we use the discriminator-selected images to construct a high-anomaly sample of ∼13 000 objects. We propose a new approach to further characterize these anomalous images: we use a convolutional autoencoder to reduce the dimensionality of the residual differences between the real and WGAN-reconstructed images and perform UMAP clustering on these. We report detected anomalies of interest including galaxy mergers, tidal features, and extreme star-forming galaxies. A follow-up spectroscopic analysis of one of these anomalies is detailed in the Appendix; we find that it is an unusual system most likely to be a metal-poor dwarf galaxy with an extremely blue, higher-metallicity H ii region. We have released a catalogue with the WGAN anomaly scores; the code and catalogue are available at https://github.com/kstoreyf/anomalies-GAN-HSC; and our interactive visualization tool for exploring the clustered data is at https://weirdgalaxi.es.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2014

Monte Carlo study for designing a dedicated “D”-shaped collimator used in the external beam radiotherapy of retinoblastoma patients

Purpose: Retinoblastoma is the most common intraocular malignancy in the early childhood. Patients treated with external beam radiotherapy respond very well to the treatment. However, owing to the genotype of children suffering hereditary retinoblastoma, the risk of secondary radio-induced malignancies is high. The University Hospital of Essen has successfully treated these patients on a daily basis during nearly 30 years using a dedicated “D”-shaped collimator. The use of this collimator that delivers a highly conformed small radiation field, gives very good results in the control of the primary tumor as well as in preserving visual function, while it avoids the devastating side effects of deformation of midface bones. The purpose of the present paper is to propose a modified version of the “D”-shaped collimator that reduces even further the irradiation field with the scope to reduce as well the risk of radio-induced secondary malignancies. Concurrently, the new dedicated “D”-shaped collimator must be easier to build and at the same time produces dose distributions that only differ on the field size with respect to the dose distributions obtained by the current collimator in use. The scope of the former requirement is to facilitate the employment of the authors' irradiation technique both at the authors' and at other hospitals. The fulfillment of the latter allows the authors to continue using the clinical experience gained in more than 30 years. Methods: The Monte Carlo codePENELOPE was used to study the effect that the different structural elements of the dedicated “D”-shaped collimator have on the absorbed dose distribution. To perform this study, the radiation transport through a Varian Clinac 2100 C/D operating at 6 MV was simulated in order to tally phase-space files which were then used as radiation sources to simulate the considered collimators and the subsequent dose distributions. With the knowledge gained in that study, a new, simpler, “D”-shaped collimator is proposed. Results: The proposed collimator delivers a dose distribution which is 2.4 cm wide along the inferior-superior direction of the eyeball. This width is 0.3 cm narrower than that of the dose distribution obtained with the collimator currently in clinical use. The other relevant characteristics of the dose distribution obtained with the new collimator, namely, depth doses at clinically relevant positions, penumbrae width, and shape of the lateral profiles, are statistically compatible with the results obtained for the collimator currently in use. Conclusions: The smaller field size delivered by the proposed collimator still fully covers the planning target volume with at least 95% of the maximum dose at a depth of 2 cm and provides a safety margin of 0.2 cm, so ensuring an adequate treatment while reducing the irradiated volume.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2016

Statistical and clustering analysis for disturbances: A case study of voltage dips in wind farms

This study proposes and evaluates an alternative statistical methodology to analyze a large number of voltage dips. For a given voltage dip, a set of lengths is first identified to characterize the root mean square (rms) voltage evolution along the disturbance, deduced from partial linearized time intervals and trajectories. Principal component analysis and K-means clustering processes are then applied to identify rms-voltage patterns and propose a reduced number of representative rms-voltage profiles from the linearized trajectories. This reduced group of averaged rms-voltage profiles enables the representation of a large amount of disturbances, which offers a visual and graphical representation of their evolution along the events, aspects that were not previously considered in other contributions. The complete process is evaluated on real voltage dips collected in intense field-measurement campaigns carried out in a wind farm in Spain among different years. The results are included in this paper.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

A Search of the Full Six Years of the Dark Energy Survey for Outer Solar System Objects

We present a search for outer solar system objects in the 6 yr of data from the Dark Energy Survey (DES). The DES covered a contiguous 5000 deg 2 of the southern sky with ≈80,000 3 deg 2 exposures in the grizY filters between 2013 and 2019. This search yielded 812 trans-Neptunian objects (TNOs), one Centaur and one Oort cloud comet, 458 reported here for the first time. We present methodology that builds upon our previous search on the first 4 yr of data. All images were reprocessed with an optimized detection pipeline that leads to an average completeness gain of 0.47 mag per exposure, as well as improved transient catalog production and algorithms for linkage of detections into orbits. All objects were verified by visual inspection and by the “sub-threshold significance,” the signal-to-noise ratio in the stack of images in which its presence is indicated by the orbit, but no detection was reported. This yields a pure catalog complete to r ≈ 23.8 mag and distances 29 < d < 2500 au. The TNOs have minimum (median) of 7 (12) nights’ detections and arcs of 1.1 (4.2) yr, and will have grizY magnitudes available in a further publication. We present software for simulating our observational biases for comparisons of models to our detections. Initial inferences demonstrating the catalog’s statistical power are: the data are inconsistent with the CFEPS-L7 model for the classical Kuiper Belt; the 16 “extreme” TNOs (a > 150 au, q > 30 au) are consistent with the null hypothesis of azimuthal isotropy; and nonresonant TNOs with q > 38 au, a > 50 au show a significant tendency to be sunward of major mean-motion resonances.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2015

SU-E-I-91: Quantitative Assessment of Early Hepatocellular Carcinoma and Cavernous Hemangioma of Live Using In-Line Phase-Contrast X-Ray Imaging

Purpose: To investigate the potential utility of in-line phase-contrast imaging (ILPCI) technique with synchrotron radiation in detecting early hepatocellular carcinoma and cavernous hemangioma of live using in vitro model system. Methods: Without contrast agents, three typical early hepatocellular carcinoma specimens and three typical cavernous hemangioma of live specimens were imaged using ILPCI. To quantitatively discriminate early hepatocellular carcinoma tissues and cavernous hemangioma tissues, the projection images texture feature based on gray level co-occurrence matrix (GLCM) were extracted. The texture parameters of energy, inertia, entropy, correlation, sum average, sum entropy, difference average, difference entropy and inverse difference moment, were obtained respectively. Results: In the ILPCI planar images of early hepatocellular carcinoma specimens, vessel trees were clearly visualized on the micrometer scale. Obvious distortion deformation was presented, and the vessel mostly appeared as a ‘dry stick’. Liver textures appeared not regularly. In the ILPCI planar images of cavernous hemangioma of live specimens, typical vessels had not been found compared with the early hepatocellular carcinoma planar images. The planar images of cavernous hemangioma of live specimens clearly displayed the dilated hepatic sinusoids with the diameter of less than 100 microns, but all of them were overlapped with each other. The texture parameters of energy, inertia, entropy, correlation, sum average, sum entropy, and difference average, showed a statistically significant between the two types specimens image (P<0.01), except the texture parameters of difference entropy and inverse difference moment(P>0.01). Conclusion: The results indicate that there are obvious changes in morphological levels including vessel structures and liver textures. The study proves that this imaging technique has a potential value in evaluating early hepatocellular carcinoma and cavernous hemangioma of live.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2016

WE-AB-207A-08: BEST IN PHYSICS (IMAGING): Advanced Scatter Correction and Iterative Reconstruction for Improved Cone-Beam CT Imaging On the TrueBeam Radiotherapy Machine

Purpose: To improve CBCT image quality for image-guided radiotherapy by applying advanced reconstruction algorithms to overcome scatter, noise, and artifact limitations Methods: CBCT is used extensively for patient setup in radiotherapy. However, image quality generally falls short of diagnostic CT, limiting soft-tissue based positioning and potential applications such as adaptive radiotherapy. The conventional TrueBeam CBCT reconstructor uses a basic scatter correction and FDK reconstruction, resulting in residual scatter artifacts, suboptimal image noise characteristics, and other artifacts like cone-beam artifacts. We have developed an advanced scatter correction that uses a finite-element solver (AcurosCTS) to model the behavior of photons as they pass (and scatter) through the object. Furthermore, iterative reconstruction is applied to the scatter-corrected projections, enforcing data consistency with statistical weighting and applying an edge-preserving image regularizer to reduce image noise. The combined algorithms have been implemented on a GPU. CBCT projections from clinically operating TrueBeam systems have been used to compare image quality between the conventional and improved reconstruction methods. Planning CT images of the same patients have also been compared. Results: The advanced scatter correction removes shading and inhomogeneity artifacts, reducing the scatter artifact from 99.5 HU to 13.7 HU in a typical pelvis case. Iterative reconstruction provides further benefit by reducing image noise and eliminating streak artifacts, thereby improving soft-tissue visualization. In a clinical head and pelvis CBCT, the noise was reduced by 43% and 48%, respectively, with no change in spatial resolution (assessed visually). Additional benefits include reduction of cone-beam artifacts and reduction of metal artifacts due to intrinsic downweighting of corrupted rays. Conclusion: The combination of an advanced scatter correction with iterative reconstruction substantially improves CBCT image quality. It is anticipated that clinically acceptable reconstruction times will result from a multi-GPU implementation (the algorithms are under active development and not yet commercially available). All authors are employees of and (may) own stock of Varian Medical Systems.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2024

Visual Fixations in Basketball Shooting: Differences between Shooting Conditions

Basketball is a sport where shooting is one of the most important factors that determines the success or failure of the teams. Therefore, basketball players need to shoot the ball accurately. The present study aimed to evaluate whether different shooting conditions influence the visual behavior of athletes. For this, the Tobbi Pro Glasses 3 equipment was used to evaluate the time of the first fixation, the number of fixations, and the total time of fixations in the basket, during the shooting movement. Different distances to the basket, simulated gym audience noise, and shooting with opposition were considered. A group of 18 athletes with an average age of 22 ± 3.72 years and an average basketball practice experience of 12.5 ± 4.52 years performed 10 valid shots from different distances and different shooting angles, with different restrictions, namely, shooting with simulated opposition and gym audience noise. Statistically significant differences between shooting with opposition and baseline, in terms of the number of fixations and the total time of fixation, were found. Regarding shooting with gym audience noise, differences only occur for the total time of fixations in one position. Despite this, in all variables and positions, the values were lower in shooting with constraints compared to the baseline.

Amaro, Catarina M. (ORCID:0000000303343503)↗

DOE OSTI2025

Collaborative: in situ visual analytics technologies for extreme scale combustion simulations

This project aims to drastically enhance the usability of in situ analysis and visualization for extreme-scale scientific simulations. Current exascale computing capabilities promise to offer greater predictive ability of simulations and to further push the frontiers of science and technology. However, to validate the simulation output at extreme scale, examine the modeled phenomena, and discover previously unknowns from the output data, the output must be reduced or transformed in situ as it is being generated during the simulation such that the amount of data to examine and store is kept to a minimum. Such in situ approaches allow us to process and analyze the data and any embedded geometry to an extent that would be prohibitively expensive, if not impossible, to perform as a post hoc task. While in situ processing has been demonstrated to be a feasible and promising approach, its full potential has not yet been leveraged. In this project, we have developed comprehensive enhancements to in situ technology based on probability distributions in data. Our research focuses on jointly developing new ways of interacting with massive statistical samples while creatively utilizing new state-of-the-art computational resources to push the boundaries of in situ exploration. Moreover, we have developed new time-dependent techniques to enable previously unattainable capabilities in areas such as intelligent simulation steering and precise feature identification. We have experimentally studied our design and implementation at NERSC and OLCF, and are able to leverage existing in situ infrastructures whenever possible. While the exemplar in this project is combustion, many other fields for which turbulent transport is important, e.g., fusion, climate, astrophysics among others, encounter similar issues as simulations scale up to the exascale. This project shows its potential to generate high impact on DOE missions since the resulting technology promises to improve scientists’ ability to rapidly and correctly interpret and tune extreme-scale simulations, leading to new scientific understanding and advancements.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2014

Vertebral Augmentation with Nitinol Endoprosthesis: Clinical Experience in 40 Patients with 1-Year Follow-up

Purpose: This study was designed to assess the clinical outcomes of patients treated by vertebral augmentation with nitinol endoprosthesis (VNE) to treat painful vertebral compression fractures. Methods: Forty patients with one or more painful osteoporotic VCF, confirmed by MRI and accompanied by back-pain unresponsive to a minimum 2 months of conservative medical treatment, underwent VNE at 42 levels. Preoperative and postoperative pain measured with Visual Analog Scale (VAS), disability measured by Oswestry Disability Index (ODI), and vertebral height restoration (measured with 2-dimensional reconstruction CT) were compared at last follow-up (average follow-up 15 months). Cement extravasation, subsequent fractures, and implant migration were recorded. Results: Long-term follow-up was obtained in 38 of 40 patients. Both VAS and ODI significantly improved from a median of 8.0 (range 5–10) and 66 % (range 44–88 %) to 0.5 (range 0–8) and 6 % (range 6–66 %), respectively, at 1 year (p < 0.0001). Vertebral height measurements comparing time points increased in a statistically significant manner (ANOVA, p < 0.001). Overall cement extravasation rate was 9.5 %. Discal and venous leakage rates were 7.1 and 0 % respectively. No symptomatic extravasations occurred. Five of 38 (13.1 %) patients experienced new spontaneous, osteoporotic fractures. No device change or migration was observed. Conclusions: VNE is a safe and effective procedure that is able to provide long-lasting pain relief and durable vertebral height gain with a low rate of new fractures and cement leakages.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2025

Relative Contributions of sc-DER, mel-DER, Color Rendition, Chromaticity, and Illuminance to Spatial Brightness Perception

An experiment was conducted to examine spectrally based factors that contribute to the visual perception of interior environments, with a focus on brightness perception. Thirty-two participants evaluated 60 different lighting scenes in a mock office. The lighting spectral power distributions varied systematically in illuminance, chromaticity (CCT and Duv), s cone opic daylight efficacy ratio (sc-DER), melanopic daylight efficacy ratio (mel-DER), and color rendition (R f , R g , and R cs,h1 ). At the operationalized levels of these variables, illuminance had the largest effect on brightness perception. Notably, the second largest effect was due to changes in red chroma (R cs,h1 ). The effect of sc-DER was also statistically significant but was a tertiary effect. The effects of mel-DER, CCT, and Duv were not statistically significant. This large effect of red chroma is consistent with the existing understanding that changes in color perception are often perceived when illuminance changes. In conclusion, with appropriate changes in color rendition and other factors held constant, spatial brightness perception was preserved through a decrease from 500 lux to 250 lux.

42 ENGINEERING↗

DOE OSTI2013

Salvage/Adjuvant Brachytherapy After Ophthalmic Artery Chemosurgery for Intraocular Retinoblastoma

Purpose: To evaluate the efficacy and toxicity of brachytherapy after ophthalmic artery chemosurgery (OAC) for retinoblastoma. Methods and Materials: This was a single-arm, retrospective study of 15 eyes in 15 patients treated with OAC followed by brachytherapy at (blinded institution) between May 1, 2006, and December 31, 2012, with a median 19 months' follow-up from plaque insertion. Outcome measurements included patient and ocular survival, visual function, and retinal toxicity measured by electroretinogram (ERG). Results: Brachytherapy was used as adjuvant treatment in 2 eyes and as salvage therapy in 13 eyes of which 12 had localized vitreous seeding. No patients developed metastasis or died of retinoblastoma. The Kaplan-Meier estimate of ocular survival was 79.4% (95% confidence interval 48.7%-92.8%) at 18 months. Three eyes were enucleated, and an additional 6 eyes developed out-of-target volume recurrences, which were controlled with additional treatments. Patients with an ocular complication had a mean interval between last OAC and plaque of 2.5 months (SD 2.3 months), which was statistically less (P=.045) than patients without ocular complication who had a mean interval between last OAC and plaque of 6.5 months (SD 4.4 months). ERG responses from pre- versus postplaque were unchanged or improved in more than half the eyes. Conclusions: Brachytherapy following OAC is effective, even in the presence of vitreous seeding; the majority of eyes maintained stable or improved retinal function following treatment, as assessed by ERG.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

DOE OSTI2020

ACCESS: A Visual to Near-infrared Spectrum of the Hot Jupiter WASP-43b with Evidence of H{sub 2}O, but No Evidence of Na or K

We present a new ground-based visual transmission spectrum of the hot Jupiter WASP-43b, obtained as part of the ACCESS Survey. The spectrum was derived from four transits observed between 2015 and 2018, with combined wavelength coverage between 5300 and 9000 Å and an average photometric precision of 708 ppm in 230 Å bins. We perform an atmospheric retrieval of our transmission spectrum combined with literature Hubble Space Telescope/WFC3 observations to search for the presence of clouds/hazes as well as Na, K, Hα, and H{sub 2}O planetary absorption and stellar spot contamination over a combined spectral range of 5318–16420 Å. We do not detect a statistically significant presence of Na i or K i alkali lines, or Hα in the atmosphere of WASP-43b. We find that the observed transmission spectrum can be best explained by a combination of heterogeneities on the photosphere of the host star and a clear planetary atmosphere with H{sub 2}O. This model yields a log evidence of 8.26 ± 0.42 higher than a flat (featureless) spectrum. In particular, the observations marginally favor the presence of large, low-contrast spots over the four ACCESS transit epochs with an average covering fraction f{sub het}=0.27{sub −0.16}{sup +0.42} and temperature contrast ΔT = 132 K ± 132 K. Within the planet’s atmosphere, we recover a log H{sub 2}O volume mixing ratio of −2.78{sub −1.47}{sup +1.38}, which is consistent with previous H{sub 2}O abundance determinations for this planet.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Chemical composition of material extractives influences microbial growth and dynamics on wetted wood materials

The impact of material chemical composition on microbial growth on building materials remains relatively poorly understood. We investigate the influence of the chemical composition of material extractives on microbial growth and community dynamics on 30 different wood species that were naturally inoculated, wetted, and held at high humidity for several weeks. Microbial growth was assessed by visual assessment and molecular sequencing. Unwetted material powders and microbial swab samples were analyzed using reverse phase liquid chromatography with tandem mass spectrometry. Different wood species demonstrated varying susceptibility to microbial growth after 3 weeks and visible coverage and fungal qPCR concentrations were correlated (R 2 = 0.55). Aspergillaceae was most abundant across all samples; Meruliaceae was more prevalent on 8 materials with the highest visible microbial growth. A larger and more diverse set of compounds was detected from the wood shavings compared to the microbial swabs, indicating a complex and heterogeneous chemical composition within wood types. Several individual compounds putatively identified in wood samples showed statistically significant, near-monotonic associations with microbial growth, including C 11 H 16 O 4 , C 18 H 34 O 4 , and C 6 H 15 NO. A pilot experiment confirmed the inhibitory effects of dosing a sample of wood materials with varying concentrations of liquid C 6 H 15 NO (assuming it presented as Diethylethanolamine).

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2018

Matminer: An open source toolkit for materials data mining

As materials data sets grow in size and scope, the role of data mining and statistical learning methods to analyze these materials data sets and build predictive models is becoming more important. This manuscript introduces matminer, an open-source, Python-based software platform to facilitate data-driven methods of analyzing and predicting materials properties. Matminer provides modules for retrieving large data sets from external databases such as the Materials Project, Citrination, Materials Data Facility, and Materials Platform for Data Science. It also provides implementations for an extensive library of feature extraction routines developed by the materials community, with 47 featurization classes that can generate thousands of individual descriptors and combine them into mathematical functions. Finally, matminer provides a visualization module for producing interactive, shareable plots. These functions are designed in a way that integrates closely with machine learning and data analysis packages already developed and in use by the Python data science community. We explain the structure and logic of matminer, provide a description of its various modules, and showcase several examples of how matminer can be used to collect data, reproduce data mining studies reported in the literature, and test new methodologies.

97 MATHEMATICS AND COMPUTING↗