Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Comparison of Clustering Techniques for Residential Energy Behavior using Smart Meter Data

Current practice in whole time series clustering of residential meter data focuses on aggregated or subsampled load data at the customer level, which ignores day-to-day differences within customers. This information is critical to determine each customer’s suitability to various demand side management strategies that support intelligent power grids and smart energy management. Clustering daily load shapes provides fine-grained information on customer attributes and sources of variation for subsequent models and customer segmentation. In this paper, we apply 11 clustering methods to daily residential meter data. We evaluate their parameter settings and suitability based on 6 generic performance metrics and post-checking of resulting clusters. Finally, we recommend suitable techniques and parameters based on the goal of discovering diverse daily load patterns among residential customers. To the authors’ knowledge, this paper is the first robust comparative review of clustering techniques applied to daily residential load shape time series in the power systems’ literature.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Narrow-angle tail radio sources and the distribution of galaxy orbits in Abell clusters

The present data on the orientations of the tails with respect to the cluster centers of a sample of 70 narrow-angle-tail (NAT) radio sources in Abell clusters show the distribution of tail angles to be inconsistent with purely radial or circular orbits in all the samples, while being consistent with isotropic orbits in (1) the whole sample, (2) the sample of NATs far from the cluster center, and (3) the samples of morphologically regular Abell clusters. Evidence for very radial orbits is found, however, in the sample of NATs near the cluster center. If these results can be generalized to all cluster galaxies, then the presence of radial orbits near the center of Abell clusters suggests that violent relaxation may not have been fully effective even within the cores of the regular clusters.

O'Dea, Christopher P.↗

STAR FORMATION EFFICIENCY IN THE COOL CORES OF GALAXY CLUSTERS

We have assembled a sample of high spatial resolution far-UV (Hubble Space Telescope Advanced Camera for Surveys/Solar Blind Channel) and H{alpha} (Maryland-Magellan Tunable Filter) imaging for 15 cool core galaxy clusters. These data provide a detailed view of the thin, extended filaments in the cores of these clusters. Based on the ratio of the far-UV to H{alpha} luminosity, the UV spectral energy distribution, and the far-UV and H{alpha} morphology, we conclude that the warm, ionized gas in the cluster cores is photoionized by massive, young stars in all but a few (A1991, A2052, A2580) systems. We show that the extended filaments, when considered separately, appear to be star forming in the majority of cases, while the nuclei tend to have slightly lower far-UV luminosity for a given H{alpha} luminosity, suggesting a harder ionization source or higher extinction. We observe a slight offset in the UV/H{alpha} ratio from the expected value for continuous star formation which can be modeled by assuming intrinsic extinction by modest amounts of dust (E(B - V) {approx} 0.2) or a top-heavy initial mass function in the extended filaments. The measured star formation rates vary from {approx}0.05 M{sub sun} yr{sup -1} in the nuclei of non-cooling systems, consistent with passive, red ellipticals, to {approx}5 M{sub sun} yr{sup -1} in systems with complex, extended, optical filaments. Comparing the estimates of the star formation rate based on UV, H{alpha}, and infrared luminosities to the spectroscopically determined X-ray cooling rate suggests a star formation efficiency of 14{sup +18}{sub -8}%. This value represents the time-averaged fraction, by mass, of gas cooling out of the intracluster medium, which turns into stars and agrees well with the global fraction of baryons in stars required by simulations to reproduce the stellar mass function for galaxies. This result provides a new constraint on the efficiency of star formation in accreting systems.

79 ASTRONOMY AND ASTROPHYSICS↗

MODEL-INDEPENDENT X-RAY MASS DETERMINATIONS

A new method is introduced for making X-ray mass determinations of spherical clusters of galaxies. Treating the distribution of gravitating matter as piecewise constant and the cluster atmosphere as piecewise isothermal, X-ray spectra of a hydrostatic atmosphere are determined up to a single overall normalizing factor. In contrast to more conventional approaches, this method relies on the minimum of assumptions, apart from the conditions of hydrostatic equilibrium and spherical symmetry. The method has been implemented as an XSPEC mixing model called CLMASS, which was used to determine masses for a sample of nine relaxed X-ray clusters. Compared to conventional mass determinations, CLMASS provides weak constraints on values of M{sub 500}, reflecting the quality of current X-ray data for cluster regions beyond r{sub 500}. At smaller radii, where there are high quality X-ray spectra inside and outside the radius of interest to constrain the mass, CLMASS gives confidence ranges for M{sub 2500} that are only moderately less restrictive than those from more familiar mass determination methods. The CLMASS model provides some advantages over other methods and should prove useful for mass determinations in regions where there are high quality X-ray data.

79 ASTRONOMY AND ASTROPHYSICS↗

HeCS-SZ: The hectospec survey of Sunyaev–Zeldovich-selected clusters

We estimate cluster masses and velocity dispersions for 123 clusters from optical spectroscopy to compare the Sunyaev–Zeldovich (SZ) mass proxy and dynamical masses. Our new survey, HeCS-SZ (Hectospec Cluster Survey of SZ-selected clusters), includes 7721 new or remeasured redshifts from MMT/Hectospec observations of 21 SZ-selected clusters at redshifts z = 0.05–0.20. We supplement the Hectospec data with spectra from the Sloan Digital Sky Survey (SDSS) and cluster data from the Cluster Infall Regions in SDSS project and the Hectospec Cluster Survey, our Hectospec survey of clusters selected by X-ray flux. We measure the scaling relation between velocity dispersion and SZ mass estimates from the integrated Compton parameter for an SZ-complete sample of 83 clusters. The observed relation agrees very well with a simple virial scaling from mass (based on SZ) to velocity dispersion. The SZ mass estimates (calibrated with hydrostatic X-ray mass estimates) are not significantly biased compared to dynamical mass estimates under the assumption of small velocity bias of galaxies compared to dark matter particles. Significant mass bias in SZ mass estimates could relieve tension between cosmological results from Planck SZ cluster counts and Planck CMB data. In principle, SZ mass bias and velocity bias of galaxies could conspire to yield good agreement, but the required velocity bias is σ{sub galaxy}≈0.77σ{sub DM}, outside the range of recent models of velocity bias in the literature. More likely, SZ mass bias and velocity bias are both small, and the tension between SZ cluster counts and CMB data requires another explanation.

79 ASTRONOMY AND ASTROPHYSICS↗

Insights on sources and formation mechanisms of liquid-bearing clouds over MOSAiC examined from a Lagrangian framework

Understanding Arctic stratiform liquid-bearing cloud life cycles and properly representing these life cycles in models is crucial for evaluations of cloud feedbacks as well as the faithfulness of climate projections for this rapidly warming region. Examination of cloud life cycles typically requires analyses of cloud evolution and origins on short time scales, on the order of hours to several days. Measurements from the recent Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) expedition provide a unique view of the current state of the central Arctic over an annual cycle. Here, we use the MOSAiC radiosonde measurements to detect liquid-bearing cloud layers over full atmospheric columns and to examine the cloud-generating air masses’ properties. We perform 5-day (120 h) back-trajectory calculations for every detected cloud and cluster them using a unique set of variables extracted from these trajectories informed by ERA5 reanalysis data. This clustering method enables us to separate between the air mass source regions such as ice-covered Arctic and midlatitude open water. We find that moisture intrusions into the central Arctic typically result in multilayer liquid-bearing cloud structures and that more than half of multilayer profiles include overlying liquid-bearing clouds originating in different types of air masses. Finally, we conclude that Arctic cloud formation via prolonged radiative cooling of elevated stable subsaturated air masses circulating over the Arctic can occur frequently (up to 20% of detected clouds in the sounding data set) and may lead to a significant impact of ensuing clouds on the surface energy budget, including net surface warming in some cases.

54 ENVIRONMENTAL SCIENCES↗

Blue compact dwarf galaxies in the Virgo Cluster - H I and IRAS data and upper limits on proto-dwarf galaxies

Correlations between various properties of blue compact dwarf (BCD) galaxies in the Virgo Cluster were studied. It was found that, at constant mass, BCD galaxies are comparable to non-BCD irregulars in both blue luminosity and H I flux. About one-third of the BCDs were detected by IRAS at 60 or 100 microns, mostly at intensities just above the threshold sensitivity.

Hoffman, G. Lyle↗

Gyrophase-bunched Electrons: Cluster Observations and Simulations

The interaction of the solar wind with the Earth's bow shock is responsible for a number of phenomena both upstream and downstream. One of the least understood and studied of these is the generation of gyrophase-bunched electrons. We will describe initial work searching for and analyzing such events in (Plasma Electron And Current Experiment (PEACE) data from CLUSTER. Plasma simulations will complement the data analysis. Recent analyses suggest that gyrophase-bunched electrons are present rather frequently in the upstream region, due either to energization in the reflection off the shock front or, more likely, to phase trapping in locally produced whistler wave fields.

Gurgiolo, C.↗

Onboard Algorithms for Data Prioritization and Summarization of Aerial Imagery

Many current and future NASA missions are capable of collecting enormous amounts of data, of which only a small portion can be transmitted to Earth. Communications are limited due to distance, visibility constraints, and competing mission downlinks. Long missions and high-resolution, multispectral imaging devices easily produce data exceeding the available bandwidth. To address this situation computationally efficient algorithms were developed for analyzing science imagery onboard the spacecraft. These algorithms autonomously cluster the data into classes of similar imagery, enabling selective downlink of representatives of each class, and a map classifying the terrain imaged rather than the full dataset, reducing the volume of the downlinked data. A range of approaches was examined, including k-means clustering using image features based on color, texture, temporal, and spatial arrangement

Chien, Steve A.↗

STAR FORMATION AND SUPERCLUSTER ENVIRONMENT OF 107 NEARBY GALAXY CLUSTERS

We analyze the relationship between star formation (SF), substructure, and supercluster environment in a sample of 107 nearby galaxy clusters using data from the Sloan Digital Sky Survey. Previous works have investigated the relationships between SF and cluster substructure, and cluster substructure and supercluster environment, but definitive conclusions relating all three of these variables has remained elusive. We find an inverse relationship between cluster SF fraction ( f {sub SF}) and supercluster environment density, calculated using the Galaxy luminosity density field at a smoothing length of 8 h {sup −1} Mpc (D8). The slope of f {sub SF} versus D8 is −0.008 ± 0.002. The f {sub SF} of clusters located in low-density large-scale environments, 0.244 ± 0.011, is higher than for clusters located in high-density supercluster cores, 0.202 ± 0.014. We also divide superclusters, according to their morphology, into filament- and spider-type systems. The inverse relationship between cluster f {sub SF} and large-scale density is dominated by filament- rather than spider-type superclusters. In high-density cores of superclusters, we find a higher f {sub SF} in spider-type superclusters, 0.229 ± 0.016, than in filament-type superclusters, 0.166 ± 0.019. Using principal component analysis, we confirm these results and the direct correlation between cluster substructure and SF. These results indicate that cluster SF is affected by both the dynamical age of the cluster (younger systems exhibit higher amounts of SF); the large-scale density of the supercluster environment (high-density core regions exhibit lower amounts of SF); and supercluster morphology (spider-type superclusters exhibit higher amounts of SF at high densities).

79 ASTRONOMY AND ASTROPHYSICS↗

X-RAY SUBSTRUCTURE STUDIES OF FOUR GALAXY CLUSTERS USING XMM-NEWTON DATA

Mahdavi et al. find that the degree of agreement between weak lensing and X-ray mass measurements is a function of cluster radius. Numerical simulations also point out that X-ray mass proxies do not work equally well at all radii. The origin of the effect is thought to be associated with cluster mergers. Recent work presenting the cluster maps showed an ability of X-ray maps to reveal and study cluster mergers in detail. Here, we present a first attempt to use the study of substructure in assessing the systematics of the hydrostatic mass measurements using two-dimensional (2D) X-ray diagnostics. The temperature map is uniquely able to identify the substructure in an almost relaxed cluster which would be unnoticed in the intracluster medium electron number density and pressure maps. We describe the radial fluctuations in the 2D maps by a cumulative/differential scatter profile relative to the mean profile within/at a given radius. The amplitude indicates {approx}10% fluctuations in the temperature, electron number density, and entropy maps, and {approx}15% fluctuations in the pressure map. The amplitude of and the discontinuity in the scatter complement 2D substructure diagnostics, e.g., indicating the most disturbed radial range. There is a tantalizing link between the substructure identified using the scatter of the entropy and pressure fluctuations and the hydrostatic mass bias relative to the expected mass based on the M-Y{sub X} and M-M{sub gas} relations particularly at r{sub 500}. XMM-Newton observations with {approx}120,000 source photons from the cluster are sufficient to apply our substructure diagnostics via the spectrally measured 2D temperature, electron number density, entropy, and pressure maps.

79 ASTRONOMY AND ASTROPHYSICS↗

Detecting Gravitational Lensing of the Cosmic Microwave Background by Galaxy Clusters

Clusters of galaxies gravitationally lens the Cosmic Microwave Background (CMB) leading to a distinct signal in the CMB on arcminute scales. Measurement of the cluster lensing effect offers the exciting possibility of constraining the masses of galaxy clusters using CMB data alone. Improved constraints on cluster masses are in turn essential to the use of clusters as cosmological probes: uncertainties in cluster masses are currently the dominant systematic affecting cluster abundance constraints on cosmology. To date, however, the CMB cluster lensing signal remains undetected because of its small magnitude and angular size. In this thesis, we develop a maximum likelihood approach to extracting the signal from CMB temperature data. We validate the technique by applying it to mock data designed to replicate as closely as possible real data from the South Pole Telescope’s (SPT) Sunyaev-Zel’dovich (SZ) survey: the effects of the SPT beam, transfer function, instrumental noise and cluster selection are incorporated. We consider the effects of foreground emission on the analysis and show that uncertainty in amount of foreground lensing results in a small systematic error on the lensing constraints. Additionally, we show that if unaccounted for, the SZ effect leads to unacceptably large biases on the lensing constraints and develop an approach for removing SZ contamination. The results of the mock analysis presented here suggest that a 4σ first detection of the cluster lensing effect can be achieved with current SPT-SZ data.

79 ASTRONOMY AND ASTROPHYSICS↗

Self-consistent clustering analysis: an efficient multiscale scheme for inelastic heterogeneous materials

A predictive computational theory is shown for modeling complex, hierarchical materials ranging from metal alloys to polymer nanocomposites. The theory can capture complex mechanisms such as plasticity and failure that span across multiple length scales. This general multiscale material modeling theory relies on sound principles of mathematics and mechanics, and a cutting-edge reduced order modeling method named self-consistent clustering analysis (SCA) [Zeliang Liu, M.A. Bessa, Wing Kam Liu, “Self-consistent clustering analysis: An efficient multi-scale scheme for inelastic heterogeneous materials,” Comput. Methods Appl. Mech. Engrg. 306 (2016) 319–341]. SCA reduces by several orders of magnitude the computational cost of micromechanical and concurrent multiscale simulations, while retaining the microstructure information. This remarkable increase in efficiency is achieved with a data-driven clustering method. Computationally expensive operations are performed in the so-called offline stage, where degrees of freedom (DOFs) are agglomerated into clusters. The interaction tensor of these clusters is computed. In the online or predictive stage, the Lippmann-Schwinger integral equation is solved cluster-wise using a self-consistent scheme to ensure solution accuracy and avoid path dependence. To construct a concurrent multiscale model, this scheme is applied at each material point in a macroscale structure, replacing a conventional constitutive model with the average response computed from the microscale model using just the SCA online stage. A regularized damage theory is incorporated in the microscale that avoids the mesh and RVE size dependence that commonly plagues microscale damage calculations. The SCA method is illustrated with two cases: a carbon fiber reinforced polymer (CFRP) structure with the concurrent multiscale model and an application to fatigue prediction for additively manufactured metals. For the CFRP problem, a speed up estimated to be about 43,000 is achieved by using the SCA method, as opposed to FE2, enabling the solution of an otherwise computationally intractable problem. The second example uses a crystal plasticity constitutive law and computes the fatigue potency of extrinsic microscale features such as voids. This shows that local stress and strain are capture sufficiently well by SCA. This model has been incorporated in a process-structure-properties prediction framework for process design in additive manufacturing.

Liu, Z.↗

Unsupervised classification of Space Acceleration Measurement System (SAMS) data using ART2-A

The Space Acceleration Measurement System (SAMS) has been developed by NASA to monitor the microgravity acceleration environment aboard the space shuttle. The amount of data collected by a SAMS unit during a shuttle mission is in the several gigabytes range. Adaptive Resonance Theory 2-A (ART2-A), an unsupervised neural network, has been used to cluster these data and to develop cause and effect relationships among disturbances and the acceleration environment. Using input patterns formed on the basis of power spectral densities (psd), data collected from two missions, STS-050 and STS-057, have been clustered.

STS-57 Shuttle Project↗

Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with i<24.5 and analyze it in four redshift bins covering 0.15≲z≲1.5. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales k max = 1Mpc –1 , including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a ~3σ detection of lensing magnification in the HSC data. Our results are stable to variations in σ 8 and Ω c and we find constraints that agree well with measurements from Planck and low-redshift probes. Lastly, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift.

79 ASTRONOMY AND ASTROPHYSICS↗

Tomographic Galaxy Clustering with the Subaru Hyper Suprime-Cam First Year Public Data Release

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with $i<24.5$ and analyze it in four redshift bins covering $0.15\lesssim z \lesssim1.5$. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales $k_{\rm max}=1\,{\rm Mpc}^{-1}$, including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a $\sim3\sigma$ detection of lensing magnification in the HSC data. Our results are stable to variations in $\sigma_8$ and $\Omega_c$ and we find constraints that agree well with measurements from Planck and low-redshift probes. Finally, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift. [abridged]

79 ASTRONOMY AND ASTROPHYSICS↗

The XXL survey. V. Detection of the Sunyaev-Zel'dovich effect of the redshift 1.9 galaxy cluster XLSSU J021744.1–034536 with CARMA

We report the detection of the Sunyaev-Zel'dovich (SZ) effect of galaxy cluster XLSSU J021744.1–034536, using 30 GHz Combined Array for Research in Millimeter-wave Astronomy (CARMA) data. This cluster was discovered via its extended X-ray emission in the XMM- Newton Large Scale Structure survey, the precursor to the XXL survey. It has a photometrically determined redshift z=1.91{sub −0.21}{sup +0.19}, making it among the most distant clusters known, and nominally the most distant for which the SZ effect has been measured. The spherically integrated Comptonization is Y {sub 500} = (3.0 ± 0.4) × 10{sup –12}, a measurement that is relatively insensitive to assumptions regarding the size and redshift of the cluster, as well as the background cosmology. Using a variety of locally calibrated cluster scaling relations extrapolated to z ∼ 2, we estimate a mass M {sub 500} ∼ (1-2) × 10{sup 14} M {sub ☉} from the X-ray flux and SZ signal. The measured properties of this cluster are in good agreement with the extrapolation of an X-ray luminosity-SZ effect scaling relation calibrated from clusters discovered by the South Pole Telescope at higher masses and lower redshifts. The full XXL-CARMA sample will provide a more complete, multi-wavelength census of distant clusters in order to robustly extend the calibration of cluster scaling relations to these high redshifts.

79 ASTRONOMY AND ASTROPHYSICS↗

Impact of Magnetic Draping, Convection, and Field Line Tying on Magnetopause Reconnection Under Northward IMF

We simulate a northward IMF cusp reconnection event at the magnetopause using the OpenGGCM resistive MHD code. The ACE input data, solar wind parameters, and dipole tilt belong to a 2002 reconnection event observed by IMAGE and Cluster. Based on a fully three-dimensional skeleton separators, nulls, and parallel electric fields, we show magnetic draping, convection, ionospheric field line tying play a role in producing a series of locally reconnecting nulls with flux ropes. The flux ropes in the cusp along the global separator line of symmetry. In 2D projection, the flux ropes the appearance of a tearing mode with a series of 'x's' and 'o's' but bearing a kind of 'guide field' that exists only within the magnetopause. The reconnecting field lines in the string of ropes involve IMF and both open and closed Earth magnetic field lines. The observed magnetic geometry reproduces the findings of a superposed epoch impact parameter study derived from the Cluster magnetometer data for the same event. The observed geometry has repercussions for spacecraft observations of cusp reconnection and for the imposed boundary conditions reconnection simulations.

Wendel, Deirdre E.↗