Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,063 records · Page 59

An AERONET-Based Aerosol Classification Using the Mahalanobis Distance

We present an aerosol classification based on AERONET aerosol data from 1993 to 2012. We used the AERONET Level 2.0 almucantar aerosol retrieval products to define several reference aerosol clusters which are characteristic of the following general aerosol types: Urban-Industrial, Biomass Burning, Mixed Aerosol, Dust, and Maritime. The classification of a particular aerosol observation as one of these aerosol types is determined by its five-dimensional Mahalanobis distance to each reference cluster. We have calculated the fractional aerosol type distribution at 190 AERONET sites, as well as the monthly variation in aerosol type at those locations. The results are presented on a global map and individually in the supplementary material. Our aerosol typing is based on recognizing that different geographic regions exhibit characteristic aerosol types. To generate reference clusters we only keep data points that lie within a Mahalanobis distance of 2 from the centroid. Our aerosol characterization is based on the AERONET retrieved quantities, therefore it does not include low optical depth values. The analysis is based on point sources (the AERONET sites) rather than globally distributed values. The classifications obtained will be useful in interpreting aerosol retrievals from satellite borne instruments.

Hamill, Patrick↗

Improving Medication Regimen Recommendation for Parkinson’s Disease Using Sensor Technology

Parkinson’s disease medication treatment planning is generally based on subjective data obtained through clinical, physician-patient interactions. The Personal KinetiGraph™ (PKG) and similar wearable sensors have shown promise in enabling objective, continuous remote health monitoring for Parkinson’s patients. In this proof-of-concept study, we propose to use objective sensor data from the PKG and apply machine learning to cluster patients based on levodopa regimens and response. The resulting clusters are then used to enhance treatment planning by providing improved initial treatment estimates to supplement a physician’s initial assessment. We apply k-means clustering to a dataset of within-subject Parkinson’s medication changes—clinically assessed by the MDS-Unified Parkinson’s Disease Rating Scale-III (MDS-UPDRS-III) and the PKG sensor for movement staging. A random forest classification model was then used to predict patients’ cluster allocation based on their respective demographic information, MDS-UPDRS-III scores, and PKG time-series data. Clinically relevant clusters were partitioned by levodopa dose, medication administration frequency, and total levodopa equivalent daily dose—with the PKG providing similar symptomatic assessments to physician MDS-UPDRS-III scores. A random forest classifier trained on demographic information, MDS-UPDRS-III scores, and PKG time-series data was able to accurately classify subjects of the two most demographically similar clusters with an accuracy of 86.9%, an F1 score of 90.7%, and an AUC of 0.871. A model that relied solely on demographic information and PKG time-series data provided the next best performance with an accuracy of 83.8%, an F1 score of 88.5%, and an AUC of 0.831, hence further enabling fully remote assessments. These computational methods demonstrate the feasibility of using sensor-based data to cluster patients based on their medication responses with further potential to assist with medication recommendations.

59 BASIC BIOLOGICAL SCIENCES↗

Application of sulfur SAD to small crystals with a large asymmetric unit and anomalous substructure

The application of sulfur single-wavelength anomalous dispersion (S-SAD) to determine the crystal structures of macromolecules can be challenging if the asymmetric unit is large, the crystals are small, the size of the anomalously scattering sulfur structure is large and the resolution at which the anomalous signals can be accurately measured is modest. Here, as a study of such a case, approaches to the SAD phasing of orthorhombic Ric-8A crystals are described. The structure of Ric-8A was published with only a brief description of the phasing process [Zeng et al. (2019), Structure , 27 , 1137–1141]. Here, alternative approaches to determining the 40-atom sulfur substructure of the 103 kDa Ric-8A dimer that composes the asymmetric unit are explored. At the data-collection wavelength of 1.77 Å measured at the Frontier micro-focusing Macromolecular Crystallography (FMX) beamline at National Synchrotron Light Source II, the sulfur anomalous signal strength, |Δ ano |/σΔ ano ( d ′′/sig), approaches 1.4 at 3.4 Å resolution. The highly redundant, 11 000 000-reflection data set measured from 18 crystals was segmented into isomorphous clusters using BLEND in the CCP 4 program suite. Data sets within clusters or sets of clusters were scaled and merged using AIMLESS from CCP 4 or, alternatively, the phenix.scale_and_merge tool from the Phenix suite. The latter proved to be the more effective in extracting anomalous signals. The HySS tool in Phenix , SHELXC / D and PRASA as implemented in the CRANK 2 program suite were each employed to determine the sulfur substructure. All of these approaches were effective, although HySS , as a component of the phenix.autosol tool, required data from all crystals to find the positions of the sulfur atoms. Critical contributors in this case study to successful phase determination by SAD included (i) the high-flux FMX beamline, featuring helical-mode data collection and a helium-filled beam path, (ii) as recognized by many authors, a very highly redundant, multiple-crystal data set and (iii) the inclusion within that data set of data from crystals that were scanned over large ω ranges, yielding highly isomorphous and highly redundant intensity measurements.

59 BASIC BIOLOGICAL SCIENCES↗

On the refinement of time-resolved diffraction data: comparison of the random-distribution and cluster-formation models and analysis of the light-induced increase in the atomic displacement parameters

Expressions for the random-distribution and cluster-formation models for light-induced changes in crystals studied by time-resolved diffraction are presented. The two models can be distinguished on the basis of differences in the predicted intensities. The light-induced increase in the atomic displacement parameters is analyzed with both simulated and experimental data sets.

43 PARTICLE ACCELERATORS↗

AMiBA: SCALING RELATIONS BETWEEN THE INTEGRATED COMPTON-y AND X-RAY-DERIVED TEMPERATURE, MASS, AND LUMINOSITY

We investigate the scaling relations between the X-ray and the thermal Sunyaev-Zel'dovich effect properties of clusters of galaxies, using data taken during 2007 by the Y. T. Lee Array for Microwave Background Anisotropy (AMiBA) at 94 GHz for the six clusters A1689, A1995, A2142, A2163, A2261, and A2390. The scaling relations relate the integrated Compton-y parameter Y {sub 2500} to the X-ray-derived gas temperature T {sub e}, total mass M {sub 2500}, and bolometric luminosity L{sub X} within r {sub 2500}. Our results for the power-law index and normalization are both consistent with the self-similar model and other studies in the literature except for the Y {sub 2500}-L{sub X} relation, for which a physical explanation is given though further investigation may be still needed. Our results not only provide confidence for the AMiBA project but also support our understanding of galaxy clusters.

79 ASTRONOMY AND ASTROPHYSICS↗

The detection of extended X-ray emission surrounding cD galaxies in poor clusters

The paper presents some preliminary results of a survey, performed with an imaging proportional counter, to detect X-ray emission from poor clusters which nevertheless contain dominant D or cD galaxies and could, therefore, be classified as Bautz-Morgan Type I. The data suggest that poor clusters can collect enough gas to become detectable X-ray sources if they are relatively compact, which the presence of dominant galaxies indicates.

Kriss, G. A.↗

"A Richness Study of 14 Distant X-Ray Clusters from the 160 Square Degree Survey"

We have measured the surface density of galaxies toward 14 X-ray-selected cluster candidates at redshifts z(sub i) 0.46, and we show that they are associated with rich galaxy concentrations. These clusters, having X-ray luminosities of Lx(0.5-2 keV) approx. (0.5 - 2.6) x 10(exp 44) ergs/ sec are among the most distant and luminous in our 160 deg(exp 2) ROSAT Position Sensitive Proportional Counter cluster survey. We find that the clusters range between Abell richness classes 0 and 2 and have a most probable richness class of 1. We compare the richness distribution of our distant clusters to those for three samples of nearby clusters with similar X-ray luminosities. We find that the nearby and distant samples have similar richness distributions, which shows that clusters have apparently not evolved substantially in richness since redshift z=0.5. There is, however, a marginal tendency for the distant clusters to be slightly poorer than nearby clusters, although deeper multicolor data for a large sample would be required to confirm this trend. We compare the distribution of distant X-ray clusters in the L(sub X)-richness plane to the distribution of optically selected clusters from the Palomar Distant Cluster Survey. The optically selected clusters appear overly rich for their X-ray luminosities, when compared to X-ray-selected clusters. Apparently, X-ray and optical surveys do not necessarily sample identical mass concentrations at large redshifts. This may indicate the existence of a population of optically rich clusters with anomalously low X-ray emission, More likely, however, it reflects the tendency for optical surveys to select unvirialized mass concentrations, as might be expected when peering along large-scale filaments.

Jones, Christine↗

Strange Bedfellows: Quantum Mechanics and Data Mining

Last year, in 2008, I gave a talk titled Quantum Calisthenics. This year I am going to tell you about how the work I described then has spun off into a most unlikely direction. What I am going to talk about is how one maps the problem of finding clusters in a given data set into a problem in quantum mechanics. I will then use the tricks I described to let quantum evolution lets the clusters come together on their own.

99 GENERAL AND MISCELLANEOUS↗

Leveraging graph clustering techniques for cyber‐physical system analysis to enhance disturbance characterisation

Abstract Cyber‐physical systems have behaviour that crosses domain boundaries during events such as planned operational changes and malicious disturbances. Traditionally, the cyber and physical systems are monitored separately and use very different toolsets and analysis paradigms. The security and privacy of these cyber‐physical systems requires improved understanding of the combined cyber‐physical system behaviour and methods for holistic analysis. Therefore, the authors propose leveraging clustering techniques on cyber‐physical data from smart grid systems to analyse differences and similarities in behaviour during cyber‐, physical‐, and cyber‐physical disturbances. Since clustering methods are commonly used in data science to examine statistical similarities in order to sort large datasets, these algorithms can assist in identifying useful relationships in cyber‐physical systems. Through this analysis, deeper insights can be shared with decision‐makers on what cyber and physical components are strongly or weakly linked, what cyber‐physical pathways are most traversed, and the criticality of certain cyber‐physical nodes or edges. This paper presents several types of clustering methods for cyber‐physical graphs of smart grid systems and their application in assessing different types of disturbances for informing cyber‐physical situational awareness. The collection of these clustering techniques provide a foundational basis for cyber‐physical graph interdependency analysis.

97 MATHEMATICS AND COMPUTING↗

TIME-SERIES PHOTOMETRY OF GLOBULAR CLUSTERS: M62 (NGC 6266), THE MOST RR LYRAE-RICH GLOBULAR CLUSTER IN THE GALAXY?

We present new time-series CCD photometry, in the B and V bands, for the moderately metal-rich ([Fe/H] {approx_equal} -1.3) Galactic globular cluster M62 (NGC 6266). The present data set is the largest obtained so far for this cluster and consists of 168 images per filter, obtained with the Warsaw 1.3 m telescope at the Las Campanas Observatory and the 1.3 m telescope of the Cerro Tololo Inter-American Observatory, in two separate runs over the time span of 3 months. The procedure adopted to detect the variable stars was the optimal image subtraction method (ISIS v2.2), as implemented by Alard. The photometry was performed using both ISIS and Stetson's DAOPHOT/ALLFRAME package. We have identified 245 variable stars in the cluster fields that have been analyzed so far, of which 179 are new discoveries. Of these variables, 133 are fundamental mode RR Lyrae stars (RRab), 76 are first overtone (RRc) pulsators, 4 are type II Cepheids, 25 are long-period variables (LPVs), 1 is an eclipsing binary, and 6 are not yet well classified. Such a large number of RR Lyrae stars places M62 among the top two most RR Lyrae-rich (in the sense of total number of RR Lyrae stars present) globular clusters known in the Galaxy, second only to M3 (NGC 5272) with a total of 230 known RR Lyrae stars. Since this study covers most but not all of the cluster area, it is not unlikely that M62 is in fact the most RR Lyrae-rich globular cluster in the Galaxy. In like vein, thanks to the time coverage of our data sets, we were also able to detect the largest sample of LPVs known so far in a Galactic globular cluster. We analyze a variety of Oosterhoff type indicators for the cluster, including mean periods, period distribution, Bailey diagrams, and Fourier decomposition parameters (as well as the physical parameters derived therefrom). All of these indicators clearly show that M62 is an Oosterhoff type I system. This is in good agreement with the moderately high metallicity of the cluster, in spite of its predominantly blue horizontal branch morphology-which is more typical of Oosterhoff type II systems. We thus conclude that metallicity plays a key role in defining Oosterhoff type. Finally, based on an application of the 'A-method', we conclude that the cluster RR Lyrae stars have a similar He abundance as M3, although more work on the temperatures of the M62 RR Lyrae is needed before this result can be conclusively established.

79 ASTRONOMY AND ASTROPHYSICS↗

Load Asymmetry Observed During Orion Main Parachute Inflation

The Crew Exploration Vehicle Parachute Assembly System (CPAS) has flight tested the first two generations of the Orion parachute program. Three of the second generation tests instrumented the dispersion bridles of the Main parachute with a Tension Measuring System. The goal of this load measurement was to better understand load asymmetry during the inflation process of a cluster of Main parachutes. The CPAS Main parachutes exhibit inflations that are much less symmetric than current parachute literature and design guides would indicate. This paper will examine loads data gathered on three cluster tests, quantify the degree of asymmetry observed, and contrast the results with published design guides. Additionally, the measured loads data will be correlated with videos of the parachute inflation to make inferences about the shape of the parachute and the relative load asymmetry. The goal of this inquiry and test program is to open a dialogue regarding asymmetrical parachute inflation load factors.

Morris, Aaron L.↗

Markov Chain Monte Carlo Joint Analysis of Chandra X-Ray Imaging Spectroscopy and Sunyaev-Zel'dovich Effect Data

X-ray and Sunyaev-Zel'dovich effect data can be combined to determine the distance to galaxy clusters. High-resolution X-ray data are now available from Chandra, which provides both spatial and spectral information, and Sunyaev-Zel'dovich effect data were obtained from the BIMA and Owens Valley Radio Observatory (OVRO) arrays. We introduce a Markov Chain Monte Carlo procedure for the joint analysis of X-ray and Sunyaev- Zel'dovich effect data. The advantages of this method are the high computational efficiency and the ability to measure simultaneously the probability distribution of all parameters of interest, such as the spatial and spectral properties of the cluster gas and also for derivative quantities such as the distance to the cluster. We demonstrate this technique by applying it to the Chandra X-ray data and the OVRO radio data for the galaxy cluster A611. Comparisons with traditional likelihood ratio methods reveal the robustness of the method. This method will be used in follow-up paper to determine the distances to a large sample of galaxy cluster.

Bonamente, Massimillano↗

Machine learning to discover mineral trapping signatures due to CO 2 injection

Mineral trapping is pursued as a geological CO 2 sequestration (GCS) mechanism because it permanently stores CO 2 in solid phases or minerals. However, CO 2 mineral-trapping mechanisms are poorly understood due to (1) lack of sufficient field and laboratory data characterizing these complex processes, and (2) challenges to develop site-specific reactive-transport models coupling fluid flow and geochemical reactions occurring at various temporal (from milliseconds to years) and spatial (from pore (millimeters) to field (kilometers)) scales. Reactive transport with additional complexities such as heterogeneity can make the simulation outputs even more difficult to interpret because of complex nonlinearity and multi-scale interdependencies. Furthermore, the values of model outputs such as concentrations can vary by several orders of magnitude, making it harder to correlate and characterize the impact of the variables via traditional data interpretation techniques such as exploratory data analyses. Recently, machine learning (ML) has shown promise in feature discovery and in highlighting hidden mechanisms that cannot be obtained by existing data-analytics and statistical methods. In this study, we applied an unsupervised ML approach, non-negative matrix factorization with custom -means clustering (NMF) to the data generated by reactive-transport simulations of GCS. The reactive-transport data consisted of 19 attributes, including four physio-chemical variables (pH, porosity, aqueous CO 2 , and sequestered CO 2 ), six chemical species (K + , Na + , HCO, Ca 2+ , Mg 2+ , Fe 2+ ), and four carbonate minerals (calcite, dolomite, siderite, and ankerite), a feldspar mineral (albite), and four clay minerals (illite, clinochlore, kaolinite, and smectite) over a period of 200 years of simulation time. Furthermore, the simulation data used was for Morrow B sandstone at the Farnsworth hydrocarbon unit in Texas. Data are sampled at two locations within the model domain: (1) at the injection well and (2) 200 m west of the injection well. The injection was performed for a period of 10 years. Using NMF, we estimated the temporal interdependencies among the 19 attributes over a span of 200 years. We found that NMF was able to identify four reaction stages and their dominant attributes; these cannot be directly discerned through traditional visualization (e.g., line plots, Pareto analysis, Glyph-based visualization methods) or exploratory data analysis tools of the simulation data. The four stages were: reactions in the injection phase followed by short-, mid-, and long-term reactions. The NMF analysis also revealed that 10 among the 19 attributes are dominant. These dominant attributes for mineral trapping include calcite, dolomite at injection well, siderite at 200 m away from the injection well, clinochlore, kaolinite, Na + , K + , Ca 2+ , Mg 2+ , pH, and aqeuous CO 2 . Finally, at late times (65–200 years), our results showed that calcite plays a major role in mineral trapping with insignificant contribution from siderite, ankerite, and clay minerals. These findings make the proposed unsupervised ML-model attractive for reactive-transport sensing towards real-time GCS monitoring.

54 ENVIRONMENTAL SCIENCES↗

MROrchestrator: A Fine-Grained Resource Orchestration Framework for MapReduce Clusters

Efficient resource management in data centers and clouds running large distributed data processing frameworks like MapReduce is crucial for enhancing the performance of hosted applications and boosting resource utilization. However, existing resource scheduling schemes in Hadoop MapReduce allocate resources at the granularity of fixed-size, static portions of nodes, called slots. In this work, we show that MapReduce jobs have widely varying demands for multiple resources, making the static and fixed-size slot-level resource allocation a poor choice both from the performance and resource utilization standpoints. Furthermore, lack of co-ordination in the management of mul- tiple resources across nodes prevents dynamic slot reconfigura- tion, and leads to resource contention. Motivated by this, we propose MROrchestrator, a MapReduce resource Orchestrator framework, which can dynamically identify resource bottlenecks, and resolve them through fine-grained, co-ordinated, and on- demand resource allocations. We have implemented MROrches- trator on two 24-node native and virtualized Hadoop clusters. Experimental results with a suite of representative MapReduce benchmarks demonstrate up to 38% reduction in job completion times, and up to 25% increase in resource utilization. We further show how popular resource managers like NGM and Mesos when augmented with MROrchestrator can hike up their performance.

99 GENERAL AND MISCELLANEOUS↗

Planck 2015 results: XXVII. The second Planck catalogue of Sunyaev-Zeldovich sources

Here, we present the all-sky Planck catalogue of Sunyaev-Zeldovich (SZ) sources detected from the 29 month full-mission data. The catalogue (PSZ2) is the largest SZ-selected sample of galaxy clusters yet produced and the deepest systematic all-sky surveyof galaxy clusters. It contains 1653 detections, of which 1203 are confirmed clusters with identified counterparts in external data sets, and is the first SZ-selected cluster survey containing >103 confirmed clusters. We present a detailed analysis of the survey selection function in terms of its completeness and statistical reliability, placing a lower limit of 83% on the purity. Using simulations, we find that the estimates of the SZ strength parameter Y5R500are robust to pressure-profile variation and beam systematics, but accurate conversion to Y500 requires the use of prior information on the cluster extent. We describe the multi-wavelength search for counterparts in ancillary data, which makes use of radio, microwave, infra-red, optical, and X-ray data sets, and which places emphasis on the robustness of the counterpart match. We discuss the physical properties of the new sample and identify a population of low-redshift X-ray under-luminous clusters revealed by SZ selection. These objects appear in optical and SZ surveys with consistent properties for their mass, but are almost absent from ROSAT X-ray selected samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Rain volume estimation over areas using satellite and radar data

The analysis of 18 convective clusters demonstrates that the extension of the Area-Time-Integral (ATI) technique to the use of satellite data is possible. The differences of the internal structures of the radar reflectivity features, and of the satellite features, give rise to differences in estimating rain volumes by delineating area; however, by focusing upon the area integrated over the lifetime of the storm, it is suggested that some of the errors produced by the differences in the cloud geometries as viewed by radar or satellite are minimized. The results are good and future developments should consider data from different climatic regions and should allow for implementation of the technique in a general circulation model.

Doneaud, Andre A.↗

Imaging Electron Spectrometer (IES) Electron Preprocessor (EPP) Design

The Aerospace Corporation developed the Electron PreProcessor (EPP) to support the Imaging Electron Spectrometer (IES) that is part of the RAPID experiment on the ESA/NASA CLUSTER mission. The purpose of the EPP is to collect raw data from the IES and perform processing and data compression on it before transferring it to the RAPID microprocessor system for formatting and transmission to the CLUSTER satellite data system. The report provides a short history of the RAPID and CLUSTER programs and describes the EPP design. Four EPP units were fabricated, tested, and delivered for the original CLUSTER program. These were destroyed during a launch failure. Four more EPP units were delivered for the CLUSTER II program. These were successfully launched and are operating nominally on orbit.

Fennell, J. F.↗

Hundreds of weak lensing shear-selected clusters from the Hyper Suprime-Cam Subaru Strategic Program S19A data

Abstract We use the Hyper Suprime-Cam Subaru Strategic Program S19A shape catalog to construct weak lensing shear-selected cluster samples. From aperture mass maps covering ∼510 deg2 created using a truncated Gaussian filter, we construct a catalog of 187 shear-selected clusters that correspond to mass map peaks with signal-to-noise ratio larger than 4.7. Most of the shear-selected clusters have counterparts in optically selected clusters, from which we estimate the purity of the catalog to be higher than 95%. The sample can be expanded to 418 shear-selected clusters with the same signal-to-noise ratio cut by optimizing the shape of the filter function and by combining weak lensing mass maps created with several different background galaxy selections. We argue that dilution and obscuration effects of cluster member galaxies can be mitigated by using background source galaxy samples and adopting a filter function with its inner boundary larger than about 2′. The large samples of shear-selected clusters that are selected without relying on any baryonic tracer are useful for detailed studies of cluster astrophysics and cosmology.

Oguri, Masamune↗