Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

AIRS Observations of Deep Convective Clouds

Large thunderstorms can be identified in the AIRS data as areas where the brightness temperature of the 1231 cm-1 atmospheric window channel in non-polar areas is less than 210 K. Each day about 6000 large thunderstorms are identified, almost exclusively within 30 degrees of the equator. Since the size of the AIRS footprint at nadir is 13.5 km, a brightness temperature of less than 210 K indicates that the top of the anvil of the thunderstorm protrudes well into the tropopause. Such objects are commonly referred to as Deep Convective Clouds (DCC). Our interest in DCC was motivated by the question 'Are severe weather events increasing due to global warming'. Each DCC is a severe weather event, although not on the scale of the much less frequent hurricanes, which can be identified in the AIRS data as clusters of several hundred DCC. The number of DCC per day has been fairly stable over the past four years for the mean of the tropical oceans, but a significant increase can be seen day and night in the Atlantic Ocean. The number of DCC per day shows a strong seasonal and latitudinal dependence, with the peak count lagging the solstice of the latitude zone by about 2 months. The most prominent features in brightness temperature spectra of DCC are due to stratospheric CO2, Ozone and Methane. In the channels with weighting functions below the stratosphere the brightness temperature is typically 205 K, with a characteristic 1 to 2.5 K drop between 1000 and 750 cm-1, equivalent to a 2-4 % drop in emissivity. This is likely due to the presence of cirrus (ice) particles. Some of this analysis of DCC can be extended using past and future operational sounders in polar orbit.

temperature↗

Turbulence and Global Properties of the Solar Wind

The solar wind shows striking characteristics that suggest that it is a turbulent magnetofluid, but the picture is not altogether simple. From the earliest observations, a strong correlation between magnetic fluctuations and plasma velocity fluctuations was noted. The high corrections suggest that the fluctuations are Alfven waves. In addition, the power spectrum of the magnetic fluctuation showed evidence of an inertial range that resembled that seen in fully-developed fluid turbulence. Alfven waves, however, are exact solutions of the equations of incompressible magnetohydrodynamics. Thus, there was a puzzle: how can a magnetofluid consisting of Alfven waves be turbulent? The answer lay in the role of velocity shears in the solar wind that could drive turbulent evolution. Puzzles remain: for example, the power spectrum of the velocity fluctuations is less steep than the slope of the magnetic fluctuations. The plasma in the magnetic tail of Earth's magnetosphere also shows aspects of turbulence, as does the plasma in the dayside magnetosphere near the poles the dayside cusps. Recently, new analyses of high time resolution magnetic field data from Cluster have offered a glimpse of how turbulence is dissipated, thus heating the ambient plasma.

Goldstein, Melvyn L.↗

New Insight into Short-Wavelength Solar Wind Fluctuations from Vlasov Theory

The nature of solar wind (SW) turbulence below the proton gyroscale is a topic that is being investigated extensively nowadays, both theoretically and observationally. Although recent observations gave evidence of the dominance of kinetic Alfven waves (KAWs) at sub-ion scales with omega < omega(sub ci), other studies suggest that the KAW mode cannot carry the turbulence cascade down to electron scales and that the whistler mode (i.e., omega > omega (sub ci)) is more relevant. Here, we study key properties of the short-wavelength plasma modes under limited, but realistic, SW conditions, Typically Beta(sub i) approx. > Beta (sub e) ∼ 1 and for high oblique angles of propagation 80 deg <= Theta (sub kB) < 90 deg as observed from the Cluster spacecraft data. The linear properties of the plasma modes under these conditions are poorly known, which contrasts with the well-documented cold plasma limit and/or moderate oblique angles of propagation (Theta (sub kB) < 80 deg). Based on linear solutions of the Vlasov kinetic theory, we discuss the relevance of each plasma mode (fast, Bernstein, KAW, whistler) in carrying the energy cascade down to electron scales. We show, in particular, that the shear Alfven mode (known in the magnetohydrodynamic limit) extends at scales kappa rho (sub i) approx. > 1 to frequencies either larger or smaller than omega (sub ci), depending on the anisotropy kappa (parallel )/ kappa(perpendicular). This extension into small scales is more readily called whistler (omega > omega (sub ci)) or KAW (omega < omega (sub ci)) although the mode is essentially the same. This contrasts with the well-accepted idea that the whistler branch always develops as a continuation at high frequencies of the fast magnetosonic mode. We show, furthermore, that the whistler branch is more damped than the KAW one, which makes the latter the more relevant candidate to carry the energy cascade down to electron scales. We discuss how these new findings may facilitate resolution of the controversy concerning the nature of the small-scale turbulence, and we discuss the implications for present and future spacecraft wave measurements in the SW.

waves↗

Extrinsic Sources of Scatter in the Richness-Mass Relation of Galaxy Clusters

Maximizing the utility of upcoming photometric cluster surveys requires a thorough understanding of the richness-mass relation of galaxy clusters. We use Monte Carlo simulations to study the impact of various sources of observational scatter on this relation. Cluster ellipticity, photometric errors, photometric redshift errors, and cluster-to-cluster variations in the properties of red-sequence galaxies contribute negligible noise. Miscentering, however, can be important, and likely contributes to the scatter in the richness - mass relation of galaxy maxBCG clusters at the low mass end, where centering is more difficult. We also investigate the impact of projection effects under several empirically motivated assumptions about cluster environments. Using SDSS data and the maxBCG cluster catalog, we demonstrate that variations in cluster environments can rarely ({approx} 1%-5% of the time) result in significant richness boosts. Due to the steepness of the mass/richness function, the corresponding fraction of optically selected clusters that suffer from these projection effects is {approx} 5%-15%. We expect these numbers to be generic in magnitude, but a precise determination requires detailed, survey-specific modeling.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

BD-CATS-IO

Modern cosmology and plasma physics codes are now capable of simulating trillions of particles on petascale systems. Each timestep output from such simulations is on the order of 10s of TBs. Summarizing and visualizing raw particle data is challenging, and scientists often focus on density structures, whether in the real 3D space, or a high-dimensional phase space. In this work, code was developed for reading 10s of terabytes of data and for writing the resultant cluster IDs for each particle. This code will be part of a highly scalable version of the clustering algorithm DBSCAN, and apply it to the largest datasets produced by state-of-the-art codes. The overall function of BD-CATS (Big Data Clustering at Trillion Particles Scale) is to perform end-to-end analysis: loading the data, dynamic partitioning, computing kdtrees, performing clustering analysis, and storing the results. BD-CATS-IO provides the functionality of loading the data and storing the results.

Byna, Surendra↗

Automated Detection of Anomalous Shipping Manifests to Identify Illicit Trade

We describe an approach to analyzing trade data which uses clustering to detect similarities across shipping manifest records, classification to evaluate clustering results and categorize new unseen shipping data records, and visual analytics to provide to support situation awareness in dynamic decision making to monitor and warn against the movement of radiological threat materials through search, analysis and forecasting capabilities. The evaluation of clustering results through classification and systematic inspection of the clusters show the clusters have strong semantic cohesion and offer novel ways to detect transactions related to nuclear smuggling.

classification↗

Constraining the Scatter in the Mass-Richness Relation of maxBCG Clusters With Weak Lensing and X-ray Data

We measure the logarithmic scatter in mass at fixed richness for clusters in the maxBCG cluster catalog, an optically selected cluster sample drawn from SDSS imaging data. Our measurement is achieved by demanding consistency between available weak lensing and X-ray measurements of the maxBCG clusters, and the X-ray luminosity-mass relation inferred from the 400d X-ray cluster survey, a flux limited X-ray cluster survey. We find {sigma}{sub lnM|N{sub 200}} = 0.45{sub -0.18}{sup +0.20} (95%CL) at N{sub 200} {approx} 40, where N{sub 200} is the number of red sequence galaxies in a cluster. As a byproduct of our analysis, we also obtain a constraint on the correlation coefficient between lnL{sub X} and lnM at fixed richness, which is best expressed as a lower limit, r{sub L,M|N} {ge} 0.85 (95% CL). This is the first observational constraint placed on a correlation coefficient involving two different cluster mass tracers. We use our results to produce a state of the art estimate of the halo mass function at z = 0.23 - the median redshift of the maxBCG cluster sample - and find that it is consistent with the WMAP5 cosmology. Both the mass function data and its covariance matrix are presented.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Weak-lensing mass calibration of redMaPPer galaxy clusters in Dark Energy Survey Science Verification data

We use weak-lensing shear measurements to determine the mean mass of optically selected galaxy clusters in Dark Energy Survey Science Verification data. In a blinded analysis, we split the sample of more than 8,000 redMaPPer clusters into 15 subsets, spanning ranges in the richness parameter $5 \leq \lambda \leq 180$ and redshift $0.2 \leq z \leq 0.8$, and fit the averaged mass density contrast profiles with a model that accounts for seven distinct sources of systematic uncertainty: shear measurement and photometric redshift errors; cluster-member contamination; miscentering; deviations from the NFW halo profile; halo triaxiality; and line-of-sight projections. We combine the inferred cluster masses to estimate the joint scaling relation between mass, richness and redshift, $\mathcal{M}(\lambda,z) \varpropto M_0 \lambda^{F} (1+z)^{G}$. We find $M_0 \equiv \langle M_{200\mathrm{m}}\,|\,\lambda=30,z=0.5\rangle=\left[ 2.35 \pm 0.22\ \rm{(stat)} \pm 0.12\ \rm{(sys)} \right] \cdot 10^{14}\ M_\odot$, with $F = 1.12\,\pm\,0.20\ \rm{(stat)}\, \pm\, 0.06\ \rm{(sys)}$ and $G = 0.18\,\pm\, 0.75\ \rm{(stat)}\, \pm\, 0.24\ \rm{(sys)}$. The amplitude of the mass-richness relation is in excellent agreement with the weak-lensing calibration of redMaPPer clusters in SDSS by Simet et al. (2016) and with the Saro et al. (2015) calibration based on abundance matching of SPT-detected clusters. Our results extend the redshift range over which the mass-richness relation of redMaPPer clusters has been calibrated with weak lensing from $z\leq 0.3$ to $z\leq0.8$. Calibration uncertainties of shear measurements and photometric redshift estimates dominate our systematic error budget and require substantial improvements for forthcoming studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Transfer Learning Trained LSTM Models for Household Load Profile Forecasting

Grid edge renewable energy resources, such as rooftop solar photovoltaics, closely interact with consumer load profiles. Therefore, forecasting future electricity demand, ideally at the individual household level, is indispensable. In this paper, we present a transfer learning enhanced household load profile forecasting method. First, we tune a long short-term memory forecasting model to perform day-ahead prediction of household electricity load profiles. Then we improve these individualized models using transfer learning, and we use k-means clustering to create optimal source data sets. We find average improvements of 4.38% (largest improvement of 10.71%) when the entire data set was used to train the source model and 2.45% (largest improvement of 11.57%) in the mean absolute error when households were first clustered and used to train separate source models for each cluster. We find that transfer learning with clustered data can effectively boost the forecasting performance of the LSTM models. We use realistic household power measurements for 148 real residential households in Austin, Texas.

deep learning↗

Formation and study of p–i–n structures based on two-phase hydrogenated silicon with a germanium layer in the i-type region

Four pairs of p–i–n structures based on polymorphous Si:H (pm-Si:H) are fabricated by the method of plasma-enhanced chemical vapor deposition. The structures in each pair are grown on the same substrate so that one of them does not contain Ge in the i-type layer while the other structure contains Ge deposited by molecular-beam epitaxy as a layer with a thickness of 10 nm. The pair differ from one another in terms of the substrate temperature during Ge deposition; these temperatures are 300, 350, 400, and 450°C. The data of electron microscopy show that the structures formed at 300°C contain Ge nanocrystals (nc-Ge) nucleated at nanocrystalline inclusions at the pm-Si:H surface. The nc-Ge concentration increases as the temperature is raised. The study of the current–voltage characteristics show that the presence of Ge in the i-type layer decreases the density of the short-circuit current in p–i–n structures when they are used as solar cells, whereas these layers give rise to an increase in current at a reverse bias under illumination. The obtained results are consistent with known data for structures with Ge clusters in Si; according to these data, Ge clusters increase the coefficient of light absorption but they also increase the rate of charge-carrier recombination.

36 MATERIALS SCIENCE↗

Cluster Seeking Techniques in Pattern Recognition

A cluster seeking technique is defined as a method of dividing data into subsets, called clusters. These clusters contain data points that are similar to each other and different from the elements of other clusters. Various cluster seeking techniques were broken down into seven categories: (1) probabilistic, (2) signal detection, (3) clustering, (4) clumping, (5) eigenvalue, (6) minimal mode seeking, and (7) miscellaneous. Each category is described and one or more algorithms of that type are presented.

Barr, B. J.↗

Verification of land cover maps from LANDSAT data

The application of cluster sampling to verifying the accuracy of maps derived from digital data is discussed. Variants of the cluster sampling technique were used in large scale assessments for areas in excess of one million hectares. Three types of classification errors are possible: commission errors, omission errors, and overall error classification. Commission errors for a particular cover type occur when pixels are classified as that cover type but are found to be some other cover type when the field is checked. Omission errors occur when pixels of fields already visited and known to be of a particular cover type, are classified as some other cover type. Overall error is the proportion of pixels incorrectly classified, without regard to omission or commission. Since the classified image represents the sampling frame, sampling for accuracy assessment was designed to estimate commission error. However, the sample can also provide useful estimates of omission and overall error. Assessment for Alaska, Arizona, and Oklahoma are presented.

Linden, D. S.↗

Galaxies in X-ray selected clusters and groups in Dark Energy Survey data – II. Hierarchical Bayesian modelling of the red-sequence galaxy luminosity function

Using ~100 X-ray selected clusters in the Dark Energy Survey Science Verification data, in this work we constrain the luminosity function (LF) of cluster red-sequence galaxies as a function of redshift. This is the first homogeneous optical/X-ray sample large enough to constrain the evolution of the LF simultaneously in redshift (0.1 < z < 1.05) and cluster mass ($13.5 \le \rm {log_{10}}(M_{200crit}) \sim \lt 15.0$). We pay particular attention to completeness issues and the detection limit of the galaxy sample. We then apply a hierarchical Bayesian model to fit the cluster galaxy LFs via a Schechter function, including its characteristic break (m*) to a faint end power-law slope (α). Our approach allows us to avoid known issues in similar analyses based on stacking or binning the clusters. We find weak and statistically insignificant (~1.9σ) evolution in the faint end slope α versus redshift. We also find no dependence in α or m* with the X-ray inferred cluster masses. Yet, the amplitude of the LF as a function of cluster mass is constrained to ${\sim } 20{{\ \rm per\ cent}}$ precision. As a by-product of our algorithm, we utilize the correlation between the LF and cluster mass to provide an improved estimate of the individual cluster masses as well as the scatter in true mass given the X-ray inferred masses. This technique can be applied to a larger sample of X-ray or optically selected clusters from the Dark Energy Survey, greatly improving the sensitivity of the analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Search for Gamma-Ray Emission from the Coma Cluster with Six Years of Fermi-LAT Data

We present results from gamma-ray observations of the Coma cluster incorporating six years of Fermi-LAT data and the newly released 'Pass 8' event-level analysis. Our analysis of the region reveals low-significance residual structures within the virial radius of the cluster that are too faint for a detailed investigation with the current data. Using a likelihood approach that is free of assumptions on the spectral shape we derive upper limits on the gamma-ray flux that is expected from energetic particle interactions in the cluster. We also consider a benchmark spatial and spectral template motivated by models in which the observed radio halo is mostly emission by secondary electrons. In this case, the median expected and observed upper limits for the flux above 100 MeV are 1.7 x 10(exp -9) ph cm(exp -2) s(exp -1) and 5.2 x 10(exp -9) ph cm(exp -2) s(exp -1) respectively (the latter corresponds to residual emission at the level of 1.8sigma). These bounds are comparable to or higher than predicted levels of hadronic gamma-ray emission in cosmic-ray (CR) models with or without reacceleration of secondary electrons, although direct comparisons are sensitive to assumptions regarding the origin and propagation mode of CRs and magnetic field properties. The minimal expected gamma-ray flux from radio and star-forming galaxies within the Coma cluster is roughly an order of magnitude below the median sensitivity of our analysis.

galaxies: clusters: individual (Coma) – gamma ra↗

The Splashback Feature around DES Galaxy Clusters: Galaxy Density and Weak Lensing Profiles

Splashback refers to the process of matter that is accreting onto a dark matter halo reaching its first orbital apocenter and turning around in its orbit. The clustercentric radius at which this process occurs, r sp, defines a halo boundary that is connected to the dynamics of the cluster. A rapid decline in the halo profile is expected near r sp. We measure the galaxy number density and weak lensing mass profiles around redMaPPer galaxy clusters in the first-year Dark Energy Survey (DES) data. For a cluster sample with mean M 200m mass ≈2.5 × 10 14 M ⊙ , we find strong evidence of a splashback-like steepening of the galaxy density profile and measure r sp = 1.13 ± 0.07 h –1 Mpc, consistent with the earlier Sloan Digital Sky Survey measurements of More et al. and Baxter et al. Moreover, our weak lensing measurement demonstrates for the first time the existence of a splashback-like steepening of the matter profile of galaxy clusters. We measure r sp = 1.34 ± 0.21 h –1 Mpc from the weak lensing data, in good agreement with our galaxy density measurements. For different cluster and galaxy samples, we find that, consistent with ΛCDM simulations, r sp scales with R 200m and does not evolve with redshift over the redshift range of 0.3–0.6. We also find that potential systematic effects associated with the redMaPPer algorithm may impact the location of r sp . In conclusion, we discuss the progress needed to understand the systematic uncertainties and fully exploit forthcoming data from DES and future surveys, emphasizing the importance of more realistic mock catalogs and independent cluster samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Cosmological Constraints from Gas Mass Fractions of Massive, Relaxed Galaxy Clusters

We present updated cosmological constraints from measurements of the gas mass fractions (f(gas)) of massive, dynamically relaxed galaxy clusters. Our new data set has greater leverage on models of dark energy, thanks to the addition of the Perseus cluster at low redshifts, two new clusters at redshifts z greater than or similar to 1, and significantly longer observations of four clusters at 0.6 < z < 0.9. Our low-redshift (z < 0.16) f(gas) data, combined with the cosmic baryon fraction measured from the cosmic microwave background (CMB), imply a Hubble constant of h = 0.722 +/- 0.067. Combining the full f(gas) data set with priors on the cosmic baryon density and the Hubble constant, we constrain the dark energy density to be Omega(Lambda) = 0.865 +/- 0.119 in non-flat Lambda cold dark matter (cosmological constant) models, and its equation of state to be in flat, constant-w models, respectively 41percent and 29percent tighter than our previous work, and comparable to the best constraints available from other probes. Combining f(gas), CMB, supernova, and baryon acoustic oscillation data, we also constrain models with global curvature and evolving dark energy. For the massive, relaxed clusters employed here, we find the scaling of f(gas) with mass to be consistent with a constant, with an intrinsic scatter that corresponds to just similar to 3percent in distance.

clusters: general – X-rays:↗