Search NASA⌕ Search

SEARCH · Search NASA

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Challenge Online Time Series Clustering For Demand Response A Theory to Break the ‘Curse of Dimensionality'

The advent of smart meters and advanced communication infrastructures catalyzes numerous smart grid applications such as dynamic demand response, and paves the way to solve challenging research problems in sustainable energy consumption. The space of solution possibilities are restricted primarily by the huge amount of generated data requiring considerable computational resources and efficient algorithms. To overcome this Big Data challenge, data clustering techniques have been proposed. Current approaches however do not scale in the face of the “increasing dimensionality” problem where a cluster point is represented by the entire customer consumption time series. To overcome this aspect we first rethink the way cluster points are created and designed, and then design an efficient online clustering technique for demand response (DR) in order to analyze high volume, high dimensional energy consumption time series data at scale, and on the fly. Our online algorithm is randomized in nature, and provides optimal performance guarantees in a computationally efficient manner. Unlike prior work we (i) study the consumption properties of the whole population simultaneously rather than developing individual models for each customer separately, claiming it to be a ‘killer’ approach that breaks the “curse of dimensionality” in online time series clustering, and (ii) provide tight performance guarantees in theory to validate our approach. Our insights are driven by the field of sociology, where collective behavior often emerges as the result of individual patterns and lifestyles.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1977

Measured oxygen fugacities of the Angra dos Reis achondrite as a function of temperature

Measurements of the oxygen fugacity, f(O2), as a function of temperature, T, were made on an interior bulk sample of the cumulate achondrite, Angra dos Reis. Data clustered between the f(O2)-T relationship of the iron-wustite assemblage and 1.2 log atm units above iron-wustite. Interpretation of the data indicates that, throughout most of the cooling history of the meteorite, f(O2) values were defined by equilibria involving iron-bearing species at values close to the f(O2) of the assemblage iron-wustite. Measured f(O2) data are compatible with crystallization and cooling at pressures greater than 50 bars.

Brett, R.↗
NASA NTRS2010

The HST/ACS Coma Cluster Survey. II. Data Description and Source Catalogs

The Coma cluster, Abell 1656, was the target of a HST-ACS Treasury program designed for deep imaging in the F475W and F814W passbands. Although our survey was interrupted by the ACS instrument failure in early 2007, the partially-completed survey still covers approximately 50% of the core high density region in Coma. Observations were performed for twenty-five fields with a total coverage area of 274 aremin(sup 2), and extend over a wide range of cluster-centric radii (approximately 1.75 Mpe or 1 deg). The majority of the fields are located near the core region of Coma (19/25 pointings) with six additional fields in the south-west region of the cluster. In this paper we present SEXTRACTOR source catalogs generated from the processed images, including a detailed description of the methodology used for object detection and photometry, the subtraction of bright galaxies to measure faint underlying objects, and the use of simulations to assess the photometric accuracy and completeness of our catalogs. We also use simulations to perform aperture corrections for the SEXTRACTOR Kron magnitudes based only on the measured source flux and its half-light radius. We have performed photometry for 76,000 objects that consist of roughly equal numbers of extended galaxies and unresolved objects. Approximately two-thirds of all detections are brighter than F814W=26.5 mag (AB), which corresponds to the 10sigma, point-source detection limit. We estimate that Coma members are 5-10% of the source detections, including a large population of compact objects (primarily GCs, but also cEs and UCDs), and a wide variety of extended galaxies from cD galaxies to dwarf low surface brightness galaxies. The initial data release for the HST-ACS Coma Treasury program was made available to the public in August 2008. The images and catalogs described in this study relate to our second data release.

Hammer, Derek↗
NASA NTRS1992

Adaptive fuzzy leader clustering of complex data sets in pattern recognition

A modular, unsupervised neural network architecture for clustering and classification of complex data sets is presented. The adaptive fuzzy leader clustering (AFLC) architecture is a hybrid neural-fuzzy system that learns on-line in a stable and efficient manner. The initial classification is performed in two stages: a simple competitive stage and a distance metric comparison stage. The cluster prototypes are then incrementally updated by relocating the centroid positions from fuzzy C-means system equations for the centroids and the membership values. The AFLC algorithm is applied to the Anderson Iris data and laser-luminescent fingerprint image data. It is concluded that the AFLC algorithm successfully classifies features extracted from real data, discrete or continuous.

Newton, Scott C.↗
DOE OSTI2014

Observational tests of backreaction with recent data

We explore the backreaction model based on the template metric proposed in Larena et al. [1] constraining the matter density parameter Ω{sub m}{sup D{sub 0}} and the Dark Energy parameter w with recent data. We provide constraints based on Supernovae Ia from the SNLS and the Union2.1 catalogs, confirming that the backreacted Universe should have a higher matter density than the corresponding Friedmaniann one. Angular diameter distances from clusters data confirm the same feature. Finally we combine these results with constraints obtained from the position of the first three peaks and the first dip of the CMB power spectrum, fitting WMAP-9 and Planck data. We find that an inconsistency arises in predicting the scale factor at recombination, leading to a backreacted Universe with lower matter density, in contradiction with results produced by SnIa and clusters. The same behavior is confirmed by analyzing the CMB-shift parameters from WMAP-9. We conclude exploring qualitatively the motivations of this inconsistency.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Is there scale-dependent bias in single-field inflation?

Scale-dependent halo bias due to local primordial non-Gaussianity provides a strong test of single-field inflation. While it is universally understood that single-field inflation predicts negligible scale-dependent bias compared to current observational uncertainties, there is still disagreement on the exact level of scale-dependent bias at a level that could strongly impact inferences made from future surveys. In this paper, we clarify this confusion and derive in various ways that there is exactly zero scale-dependent bias in single-field inflation. Much of the current confusion follows from the fact that single-field inflation does predict a mode coupling of matter perturbations at the level of f{sub NL}{sup local}; ≈ −5/3, which naively would lead to scale-dependent bias. However, we show explicitly that this mode coupling cancels out when perturbations are evaluated at a fixed physical scale rather than fixed coordinate scale. Furthermore, we show how the absence of scale-dependent bias can be derived easily in any gauge. This result can then be incorporated into a complete description of the observed galaxy clustering, including the previously studied general relativistic terms, which are important at the same level as scale-dependent bias of order f{sub NL}{sup local} ∼ 1. This description will allow us to draw unbiased conclusions about inflation from future galaxy clustering data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1978

Experimental testing of flight control head up displays

Experiments and tests with 4 generations of head up displays was reported. The CV 191, based on fighter aircraft gunsights was replaced by the CV 193, with several improvements. The CV 193 V incorporates the velocity vector reference mark, eliminates much other data, clusters the rest in a small area of the visual field and is seen together with the outside landscape. The CV 91 presents only velocity vector and total angle of descent data, used when runway and horizon are visible; TC 121 displays an outline of the runway and can be used in visual and instrument approaches.

Berjal, M.↗
DOE OSTI2024

Hydrogen Leak Modeling for Development of Smart Distributed Monitoring Under Unintended Releases

Hydrogen is a versatile and clean energy carrier that can be produced from various renewable sources such as wind, solar, and hydropower. Hydrogen has the potential to play a crucial role in decarbonizing industrial processes that are currently reliant on fossil fuels and provide long-duration and/or seasonal energy storage to enable electricity decarbonization. Hydrogen can also be used as a fuel for fuel cell vehicles, providing a zero-emission alternative to traditional internal combustion engines. DOE launched the Hydrogen Energy Earthshot (Hydrogen Shot) in June 2021 to reduce the cost of clean hydrogen by 80% to $1 per 1 kilogram in 1 decade ("1 1 1"). While promising, Hydrogen is highly-flammable, and in the presence of oxygen, it can form explosive mixtures. . Therefore, understanding leak scenarios is essential to evaluate and mitigate the safety risks associated with potential hydrogen leaks. An increased understanding of leak behavior, and having tools to model leaks, can help assess how hydrogen would disperse in different environments, influencing emergency response plans and safety measures, and identify potential issues with materials and design systems that can withstand the challenges posed by hydrogen. Recently, researchers have attempted to study hydrogen leaks for development of risk management strategies. However, the focus has been on closed or semi-closed spaces like storage rooms, vehicles, garages, and fueling stations - all promising locations for future hydrogen infrastructure. In this presentation, the modeling environment extends the span of research further by modeling hydrogen leak in an outdoor, open space. We will present the key challenges with modeling hydrogen leaks in an uncontrollable environment, how they were handled, and how modeling results informed sensor selection and placement. A Hydrogen research facility at the National Renewable Energy Laboratory (NREL) was used as a case study to model hydrogen leaks. In the future, Hydrogen wide area detection methodologies will be developed and tested at this site to monitor for unintended and operational hydrogen releases. The data generated from modeling will be used to develop a predictive model to detect hydrogen leak location based on concentration measured by sensors in this open space. Furthermore, the facility was also chosen because controlled hydrogen releases can be performed. A computational fluid dynamics (CFD) based modeling approach was taken to model hydrogen leak. The full-scale hydrogen facility was modeled with a large ambient domain. The electrolyzer at the facility can produce a controlled release rate of 27 kg-H2/hr. Site-specific atmospheric and weather condition data such as wind direction, wind speed at various altitudes, and temperature were used as inputs to the model. To capture the variability of weather conditions, a subset of the weather conditions experienced during daytime hours without precipitation over the course of three months was generated; using established data clustering techniques, a total of 100 condition sets were chosen. The results show statistical distributions and ranges of hydrogen concentrations at locations throughout the domain. These distributions are compared to experimental data from a constant mass flow, controlled hydrogen release at the facility. The stochastic wind conditions of the release make direct validation difficult, therefore, statistical comparison approaches were used. Wind conditions are found to significantly impact the release behavior, including direction and concentration. Sensor selection and placement is proposed for the facility and is now based on release behavior predicted for the facility given its weather patterns; this is much more informed than without the modeling results. The methodology and analysis procedure can be translated to other facilities using modified geometries and site-specific weather conditions. Hydrogen holds great promise as a renewable energy fuel, but ensuring safety in its production, storage, and use is paramount. Studying potential leak scenarios in an open space will help develop sensors to detect hydrogen on a large spectrum of concentration and eventually build a smart distributed monitoring system.

CFD↗
DOE OSTI2024

Searching for parity violation in SDSS DR16 Lyman-α forest data

The four-point correlation function is the lowest order correlation function for scalar fields that can be used to probe statistical parity invariance in an isotropic universe. There are intriguing claims of detection of parity violation in the 4-point function of BOSS galaxy clustering data. We apply the same estimator to the public SDSS Data Release 16 Lyman-α forest data. Lyman-α forest data probes a different redshift range and is sensitive to a different density regime using a completely different technique. A detection would therefore be a strong indication of new physics. We identify an accurate covariance matrix as a crucial impediment to performing this measurement accurately, consistent with existing literature on galaxy 4-point function. Here, we discuss several approaches to estimating the covariance matrix, several of which produce spurious detection. Using a robust, but very suboptimal, covariance matrix derived from subsample bootstrapping, we find no evidence for parity violation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Data-driven fuel consumption estimation: A multivariate adaptive regression spline approach

Providing guidance and information to drivers to help them make fuel-efficient route choices remains an important and effective strategy in the near term to reduce fuel consumption from the transportation sector. One key component in implementing this strategy is a fuel-consumption estimation model. In this paper, we developed a mesoscopic fuel consumption estimation model that can be implemented into an eco-routing system. Our proposed model presents a framework that utilizes large-scale, real-world driving data, clusters road links by free-flow speed and fits one statistical model for each of cluster. This model includes predicting variables that were rarely or never considered before, such as free-flow speed and number of lanes. We applied the model to a real-world driving data set based on a global positioning system travel survey in the Philadelphia-Camden-Trenton metropolitan area. Results from the statistical analyses indicate that the independent variables we chose influence the fuel consumption rates of vehicles. But the magnitude and direction of the influences are dependent on the type of road links, specifically free-flow speeds of links. Here, a statistical diagnostic is conducted to ensure the validity of the models and results. Although the real-world driving data we used to develop statistical relationships are specific to one region, the framework we developed can be easily adjusted and used to explore the fuel consumption relationship in other regions.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2024

Analysis of BOSS galaxy data with weighted skew-spectra

We present the first application of the weighted skew-spectra to analyze non-Gaussian information in galaxy survey data. Using the tree-level galaxy skew-spectra together with the one-loop power spectrum multipoles, we analyze the Sloan Digital Sky Survey (SDSS)-III Baryon Oscillation Spectroscopic Survey (BOSS) galaxy clustering data, and target our search towards the equilateral bispectrum shape of primordial non-Gaussianity. We use the Effective Field Theory model for the galaxy power spectrum and bispectrum, and account for systematic effects, such as the survey geometry. From our likelihood analysis, we find f NL equil = -34 +296 -334 at 68% CL, consistent with previous works, while systematic errors from our treatment of the survey geometry lead to an unreliable estimation of f NL ortho . As a result, we further constrain the bias and counterterm parameters, while keeping the cosmology fixed to Planck 2018 values. As a check, we also validate our analysis pipeline using theNseries simulation suite.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

Scalable Reasoning System (SRS)

SRS is a web-based and mobile toolkit for information visualization and collaboration. It includes server-side components in the form of web services that provide analytical functions such as data clustering and temporal analysis. The SRS client is accessed via a web browser and uses asynchronous javascript and XML (AJAX) to interact with and visualize the results of these web services. Users of SRS can query data sources that are connected to the SRS backend, and query results are presented in the form of coordinated visual displays in a web browser that depict temporal, topical, and spatial relationships in the results. SRS also includes an early stage graphical reasoning diagram interface that helps analysts express and test hypotheses. This software was developed with funding from the Science and Technology Directorate of the U.S. Department of Homeland Security.

Pike, William↗
DOE OSTI2018

Exploring cosmic origins with CORE: Gravitational lensing of the CMB

Lensing of the cosmic microwave background (CMB) is now a well-developed probe of the clustering of the large-scale mass distribution over a broad range of redshifts. By exploiting the non-Gaussian imprints of lensing in the polarization of the CMB, the CORE mission will allow production of a clean map of the lensing deflections over nearly the full-sky. The number of high-S/N modes in this map will exceed current CMB lensing maps by a factor of 40, and the measurement will be sample-variance limited on all scales where linear theory is valid. Here, we summarise this mission product and discuss the science that will follow from its power spectrum and the cross-correlation with other clustering data. For example, the summed mass of neutrinos will be determined to an accuracy of 17 meV combining CORE lensing and CMB two-point information with contemporaneous measurements of the baryon acoustic oscillation feature in the clustering of galaxies, three times smaller than the minimum total mass allowed by neutrino oscillation measurements. Lensing has applications across many other science goals of CORE, including the search for B-mode polarization from primordial gravitational waves. Here, lens-induced B-modes will dominate over instrument noise, limiting constraints on the power spectrum amplitude of primordial gravitational waves. With lensing reconstructed by CORE, one can "delens" the observed polarization internally, reducing the lensing B-mode power by 60 %. This can be improved to 70 % by combining lensing and measurements of the cosmic infrared background from CORE, leading to an improvement of a factor of 2.5 in the error on the amplitude of primordial gravitational waves compared to no delensing (in the null hypothesis of no primordial B-modes). Lensing measurements from CORE will allow calibration of the halo masses of the tens of thousands of galaxy clusters that it will find, with constraints dominated by the clean polarization-based estimators. The 19 frequency channels proposed for CORE will allow accurate removal of Galactic emission from CMB maps. We present initial findings that show that residual Galactic foreground contamination will not be a significant source of bias for lensing power spectrum measurements with CORE.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The pantropical response of soil moisture to El Niño

Abstract. The 2015–2016 El Niño event ranks as one of the most severe on record in terms of the magnitude and extent of sea surface temperature (SST) anomalies generated in the tropical Pacific Ocean. Corresponding global impacts on the climate were expected to rival, or even surpass, those of the 1997–1998 severe El Niño event, which had SST anomalies that were similar in size. However, the 2015–2016 event failed to meet expectations for hydrologic change in many areas, including those expected to receive well above normal precipitation. To better understand how climate anomalies during an El Niño event impact soil moisture, we investigate changes in soil moisture in the humid tropics (between ±25∘) during the three most recent super El Niño events of 1982–1983, 1997–1998 and 2015–2016, using data from the Global Land Data Assimilation System (GLDAS). First, we use in situ soil moisture observations obtained from 16 sites across five continents to validate and bias-correct estimates from GLDAS (r2=0.54). Next, we apply a k-means cluster analysis to the soil moisture estimates during the El Niño mature phase, resulting in four groups of clustered data. The strongest and most consistent decreases in soil moisture occur in the Amazon basin and maritime southeastern Asia, while the most consistent increases occur over eastern Africa. In addition, we compare changes in soil moisture to both precipitation and evapotranspiration, which showed a lack of agreement in the direction of change between these variables and soil moisture most prominently in the southern Amazon basin, the Sahel and mainland southeastern Asia. Our results can be used to improve estimates of spatiotemporal differences in El Niño impacts on soil moisture in tropical hydrology and ecosystem models at multiple scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

The Anatomy of Mr. Scan: A Dissection of Performance of an Extreme Scale GPU-Based Clustering Algorithm, In: 2014 5th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems

The emergence of leadership class systems with GPU-equipped nodes has the potential to vastly increase the performance of existing distributed applications. However, the inclusion of GPU computation into existing extreme scale distributed applications can reveal scalability issues that were absent in the CPU version. The issues exposed in scaling by a GPU can become limiting factors to overall application performance. We developed an extreme scale GPU-based application to perform data clustering on multi-billion point datasets. In this application, called Mr. Scan, we ran into several of these performance limiting issues. Through the use of complete end-to-end benchmarking of Mr. Scan (measuring time from reading and distribution to final output), we were able to identify three major sources of real world performance issues: data distribution, GPU load balancing, and system specific issues such as start-up time. These issues comprised a vast majority of the run time of Mr. Scan. Data distribution alone accounted for 68% of the total run time of Mr. Scan when processing 6.5 billion points on Cray Titan at 8192 nodes. With improvements in these areas, we have been able able to cut total run time of Mr. Scan from 17.5 minutes to 8.3 minutes when clustering 6.5 billion points.

Computer Science↗
DOE OSTI2015

Non-Gaussian shape discrimination with spectroscopic galaxy surveys

We consider how galaxy clustering data, from Mpc to Gpc scales, from upcoming large scale structure surveys, such as Euclid and DESI, can provide discriminating information about the bispectrum shape arising from a variety of inflationary scenarios. Through exploring in detail the weighting of shape properties in the calculation of the halo bias and halo mass function we show how they probe a broad range of configurations, beyond those in the squeezed limit, that can help distinguish between shapes with similar large scale bias behaviors. We assess the impact, on constraints for a diverse set of non-Gaussian shapes, of galaxy clustering information in the mildly non-linear regime, and surveys that span multiple redshifts and employ different galactic tracers of the dark matter distribution. Fisher forecasts are presented for a Euclid-like spectroscopic survey of Hα-selected emission line galaxies (ELGs), and a DESI-like survey, of luminous red galaxies (LRGs) and [O-II] doublet-selected ELGs, in combination with Planck-like CMB temperature and polarization data.While ELG samples provide better probes of shapes that are divergent in the squeezed limit, LRG constraints, centered below z<1, yield stronger constraints on shapes with scale-independent large-scale halo biases, such as the equilateral template. The ELG and LRG samples provide complementary degeneracy directions for distinguishing between different shapes. For Hα-selected galaxies, we note that recent revisions of the expected Hα luminosity function reduce the halo bias constraints on the local shape, relative to the CMB. For galaxy clustering constraints to be comparable to those from the CMB, additional information about the Gaussian galaxy bias is needed, such as can be determined from the galaxy clustering bispectrum or probing the halo power spectrum directly through weak lensing. If the Gaussian galaxy bias is constrained to better than a percent level then the LSS and CMB data could provide complementary constraints that will enable differentiation of bispectrum with distinct theoretical origins but with similar large scale, squeezed-limit properties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Ab initio molecular dynamics simulations of liquid water using high quality meta-GGA functionals

We have used ab initio molecular dynamics (AIMD) to characterize water properties using two meta-generalized gradient approximation (meta-GGA) functionals, M06-L-D3 and B97M-rV, and compared their performance against a standard GGA corrected for dispersion, revPBE-D3, at ambient conditions (298 K, and 1 g cm –3 or 1 atm). Simulations of the equilibrium density, radial distribution functions, self-diffusivity, the infrared spectrum, liquid dipole moments, and characterizations of the hydrogen bond network show that all three functionals have overcome the problem of the early AIMD simulations that erroneously found ambient water to be highly structured, but they differ substantially among themselves in agreement with experiment on this range of water properties. We show directly using water cluster data up through the pentamer that revPBE-D3 benefits from a cancellation of its intrinsic functional error by running classical trajectories, whereas the meta-GGA functionals are demonstrably more accurate and would require the simulation of nuclear quantum effects to realize better agreement with all cluster and condensed phase properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2016

SU-F-R-08: Can Normalization of Brain MRI Texture Features Reduce Scanner-Dependent Effects in Unsupervised Machine Learning?

Purpose: To reduce differences in features calculated from MRI brain scans acquired at different field strengths with or without Gadolinium contrast. Methods: Brain scans were processed for 111 epilepsy patients to extract hippocampus and thalamus features. Scans were acquired on 1.5 T scanners with Gadolinium contrast (group A), 1.5T scanners without Gd (group B), and 3.0 T scanners without Gd (group C). A total of 72 features were extracted. Features were extracted from original scans and from scans where the image pixel values were rescaled to the mean of the hippocampi and thalami values. For each data set, cluster analysis was performed on the raw feature set and for feature sets with normalization (conversion to Z scores). Two methods of normalization were used: The first was over all values of a given feature, and the second by normalizing within the patient group membership. The clustering software was configured to produce 3 clusters. Group fractions in each cluster were calculated. Results: For features calculated from both the non-rescaled and rescaled data, cluster membership was identical for both the non-normalized and normalized data sets. Cluster 1 was comprised entirely of Group A data, Cluster 2 contained data from all three groups, and Cluster 3 contained data from only groups 1 and 2. For the categorically normalized data sets there was a more uniform distribution of group data in the three Clusters. A less pronounced effect was seen in the rescaled image data features. Conclusion: Image Rescaling and feature renormalization can have a significant effect on the results of clustering analysis. These effects are also likely to influence the results of supervised machine learning algorithms. It may be possible to partly remove the influence of scanner field strength and the presence of Gadolinium based contrast in feature extraction for radiomics applications.

60 APPLIED LIFE SCIENCES↗