Search NASA⌕ Search

SEARCH · Search NASA

Results for “Hierarchical Clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Validation of TRMM Multi-Satellite Precipitation Analysis (TMPA) Products in the Peruvian Andes

The relevance of accurate and timely rainfall estimates cannot be overstated. The rainfall gauge network is still insufficient across significant areas worldwide. Rainfall estimates fromspaceborne sensors present an opportunity to supplement the existing network and enable the development of critical, near real time applications. However, the societal benefits of such systems can only be realized if the estimates are properly validated and the performance of existing products accurately described. In this study, two products generated by the Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) are validated for the Peruvian Andes. This is a region of complex topography that poses significant challenges to the retrieval of rainfall values fromspace. The TMPA products, both research grade (3B42V7) and near real time (3B42RT), are compared against in situ data. Different observation lengths are studied and the results are analyzed in light of geographic, topographic and climatic constraints. The Time Series of the science grade product were also studied under Dynamic TimeWarping and Hierarchical Clustering to streamline intertile comparisons. The TMPA products showa good agreementwith the gauge values, especially formore prolonged observation periods (over 8 days). The validation results display a strong regional dependence as a consequence of differences in the climate and topography. This region-specific performance calls for additional, detailed case studies and localized validation efforts. Overall the TMPAwas found to performadequately and provide quality information for a number of applications requiring timely estimates in convenient formats.

satellites↗

Classifying Multi-Model Wheat Yield Impact Response Surfaces Showing Sensitivity to Temperature and Precipitation Change

Crop growth simulation models can differ greatly in their treatment of key processes and hence in their response to environmental conditions. Here, we used an ensemble of 26 process-based wheat models applied at sites across a European transect to compare their sensitivity to changes in temperature (minus 2 to plus 9 degrees Centigrade) and precipitation (minus 50 to plus 50 percent). Model results were analysed by plotting them as impact response surfaces (IRSs), classifying the IRS patterns of individual model simulations, describing these classes and analysing factors that may explain the major differences in model responses. The model ensemble was used to simulate yields of winter and spring wheat at four sites in Finland, Germany and Spain. Results were plotted as IRSs that show changes in yields relative to the baseline with respect to temperature and precipitation. IRSs of 30-year means and selected extreme years were classified using two approaches describing their pattern. The expert diagnostic approach (EDA) combines two aspects of IRS patterns: location of the maximum yield (nine classes) and strength of the yield response with respect to climate (four classes), resulting in a total of 36 combined classes defined using criteria pre-specified by experts. The statistical diagnostic approach (SDA) groups IRSs by comparing their pattern and magnitude, without attempting to interpret these features. It applies a hierarchical clustering method, grouping response patterns using a distance metric that combines the spatial correlation and Euclidian distance between IRS pairs. The two approaches were used to investigate whether different patterns of yield response could be related to different properties of the crop models, specifically their genealogy, calibration and process description. Although no single model property across a large model ensemble was found to explain the integrated yield response to temperature and precipitation perturbations, the application of the EDA and SDA approaches revealed their capability to distinguish: (i) stronger yield responses to precipitation for winter wheat than spring wheat; (ii) differing strengths of response to climate changes for years with anomalous weather conditions compared to period-average conditions; (iii) the influence of site conditions on yield patterns; (iv) similarities in IRS patterns among models with related genealogy; (v) similarities in IRS patterns for models with simpler process descriptions of root growth and water uptake compared to those with more complex descriptions; and (vi) a closer correspondence of IRS patterns in models using partitioning schemes to represent yield formation than in those using a harvest index. Such results can inform future crop modelling studies that seek to exploit the diversity of multi-model ensembles, by distinguishing ensemble members that span a wide range of responses as well as those that display implausible behaviour or strong mutual similarities.

Classification; Climate change; Crop model; Ensemb↗

Modeling the Distribution and Type of High-Latitude Natural Wetlands for Methane Studies

High latitude (>50N) natural wetlands emit a substantial amount of methane to the atmosphere, and are located in a region of amplified warming. Northern hemisphere high latitudes are characterized by cold climates, extensive permafrost, poor drainage, short growing seasons, and slow decay rates. Under these conditions, organic carbon accumulates in the soil, sequestering CO2 from the atmosphere. Methanogens produce methane from this carbon reservoir, converting stored carbon into a powerful greenhouse gas. Methane emission from wetland ecosystems depends on vegetation type, climate characteristics (e.g, precipitation amount and seasonality, temperature, snow cover, etc.), and geophysical variables (e.g., permafrost, soil type, and landscape slope). To understand how wetland methane dynamics in this critical region will respond to climate change, we have to first understand how wetlands themselves will change and therefore, what the primary controllers of wetland distribution and type are. Understanding these relationships permits data-anchored, physically-based modeling of wetland distribution and type in other climate scenarios, such as paleoclimates or future climates, a necessary first step toward modeling wetland methane emissions in these scenarios. We investigate techniques and datasets for predicting the distribution and type of high latitude (>50N) natural wetlands from a suite of geophysical and climate predictors. Hierarchical clustering is used to derive an empirical methane-centric wetland model. The model is applied in a multistep process first to predict the distribution of wetlands from relevant geophysical parameters, and then, given the predicted wetland distribution, to classify the wetlands into methane-relevant types using an expanded suite of climate and biogeophysical variables. As the optimum set of predictor variables is not known a priori, the model is applied iteratively, and each simulation is evaluated with respect to observed high-latitude wetlands.

Romanski, Joy↗

Using Machine-Learning to Dynamically Generate Operationally Acceptable Strategic Reroute Options

The newly developed Trajectory Option Set (TOS), a preference-weighted set of alternative routes submitted by flight operators, is a capability in the U.S. traffic flow management system that enables automated trajectory negotiation between flight operators and Air Navigation Service Providers. The objective of this paper is to describe and demonstrate an approach for automatically generating pre-departure and airborne TOSs that have a high probability of operational acceptance. The approach uses hierarchical clustering of historical route data to identify route candidates. The probability of operational acceptance is then estimated using predictors trained on historical flight plan amendment data using supervised machine learning algorithms, allowing the routes with highest probability of operational acceptance to be selected for the TOS. Features used describe historical route usage, difference in flight time and downstream demand to capacity imbalance. A random forest was found to be the best performing algorithm for learning operational acceptability, with a model accuracy of 0.96. The approach is demonstrated for an historical pre-departure flight from Dallas/Fort Worth International Airport to Newark Liberty International Airport.

Evans, Antony↗

Using Machine-Learning to Dynamically Generate Operationally Acceptable Strategic Reroute Options

The newly developed Trajectory Option Set (TOS), a preference-weighted set of alternative routes submitted by flight operators, is a capability in the U.S. traffic flow management system that enables automated trajectory negotiation between flight operators and Air Navigation Service Providers. The objective of this paper is to describe and demonstrate an approach for automatically generating pre-departure and airborne TOSs that have a high probability of operational acceptance. The approach uses hierarchical clustering of historical route data to identify route candidates. The probability of operational acceptance is then estimated using predictors trained on historical flight plan amendment data using supervised machine learning algorithms, allowing the routes with highest probability of operational acceptance to be selected for the TOS. Features used describe historical route usage, difference in flight time and downstream demand to capacity imbalance. A random forest was found to be the best performing algorithm for learning operational acceptability, with a model accuracy of 0.96. The approach is demonstrated for an historical pre-departure flight from Dallas/Fort Worth International Airport to Newark Liberty International Airport.

Evans, Antony↗

Variation of Florida scrub vegetation along gradients of soil pH and landscape age on a barrier island complex

Florida scrub is a fire-maintained shrub vegetation of well-drained, sandy soils associated with ridge systems that originated as coastal dunes. It is unique to Florida and supports many rare plants and animals. Between 1992 and 2005, we sampled 30 stands of long-unburned scrub with 196 line-intercept transects (15 m length) across the Merritt Island-Cape Canaveral barrier island complex where dune ridges range from relatively recent to > 30,000 years old with a range of soil leaching and reaction. These data allow us to determine the relationships of landscape age and soil reaction on community composition. We recorded community composition in < 0.5 m and > 0.5 m height strata. We determined mapped soil type for all transects; for 151 transects we determined soil pH of the 0–15 cm and 15–30 cm layers. Hierarchical cluster analysis of stands (N=30) and transects (N=196) using 41 species (of 53) present in > 2 transects gave two groups: coastal scrub with Quercus virginiana (shrub form) and Serenoa repens as dominant species on the most alkaline soils, and oak-saw palmetto scrub with Quercus chapmanii, Quercus geminata, Quercus myrtifolia, and S. repens on the strongly to somewhat acidic soils. Direct gradient analysis indicated that dominant species except S. repens varied from acidic to alkaline soils. Indicator species analysis identified seven species that indicated acidic soils and five that indicated alkaline soils (P < 0.01). Nonmetric multidimensional scaling (NMS) ordination at the stand level separated the two groups along the first axis, and NMS ordination of the transect data showed the gradient of coastal to oak-saw palmetto scrub. Position of transects on the first axis was related to soil pH class, and to measured pH of the 0–15 cm and 15–30 cm layers. Soils show a progressive leaching of shell material from the surface horizons followed by podsolization; this process takes > 4,000 years. Our results indicate substantial differences between the community composition of scrub vegetation on recent alkaline soils compared to leached acidic soils.

Barrier island↗

A Census of Young Stellar Objects in Two Line-of-Sight Star-Forming Regions Toward IRAS 22147+5948 in the Outer Galaxy

Context. Star formation in the outer Galaxy, namely, outside of the Solar circle, has not been extensively studied in part due to the low CO brightness of the molecular clouds linked with the negative metallicity gradient. Recent infrared surveys provide an overview of dust emission in large sections of the Galaxy, but they suffer from cloud confusion and poor spatial resolution at far-infrared wavelengths. Aims. We aim to develop a methodology to identify and classify young stellar objects (YSOs) in star-forming regions in the outer Galaxy and use it to resolve a long-standing disparity in terms of the distance and evolutionary status of IRAS 22147+5948. Methods. We used a support vector machine learning algorithm to complement standard color–color and color–magnitude diagrams in our search for YSOs in the IRAS 22147 region, based on publicly available data from the Spitzer Mapping of the Outer Galaxy survey. The agglomerative hierarchical clustering algorithm was used to identify clusters. Then the physical properties of individual YSOs were calculated. The distances were determined using CO 1–0 from the Five College Radio Astronomy Observatory survey. Results. We identified 13 Class I and 13 Class II YSO candidates using the color–color diagrams, along with an additional 2 and 21 sources, respectively, using the applied machine learning techniques. The spectral energy distributions of 23 sources were modeled with a star and a passive disk, corresponding to Class II objects. The models of three sources include envelopes that are typical for Class I objects. The objects were grouped into two clusters located at a distance of 2:2 kpc and 5 clusters at 5:6 kpc. The spatial extent of CO, radio continuum, and dust emission confirms the origin of YSOs in two distinct star-forming regions along a similar line of sight. Conclusions. The outer Galaxy may serve as a unique laboratory for exploring star formation across environments, on the condition that complementary methods and ancillary data are used to properly account for cloud confusion and distance uncertainties.

Agata Karska↗

Multiyear Dry Periods in Southern Africa

Characteristics and physical features related to low precipitation across many years in Southern Africa that lead to societal disruptions are diagnosed using observed analyses and an ensemble of historical coupled climate model simulations during 1921 to 2014. Four regions are evaluated, as identified through a hierarchical clustering algorithm applied to the Standardized Precipitation Index (SPI) during the October–April precipitation season. Although dryness spanning many October–April occurs periodically in each region, they seldom occur simultaneously, consistent with largely insignificant SPI cross-correlations between them. However, characteristics relevant to low precipitation across many years are generalizable between the four regions, including the serial persistence of October–April precipitation, the likelihood of consecutive dry October–April, and the likelihood of dry October–April in temporal extents of up to 10 consecutive such 7-month seasons. Systematic precipitation persistence is not a feature in any of the four Southern Africa regions, as serial correlations of October–April SPI are not statistically significant at any time lags. It follows that there is an exponential-folding decay in the likelihood of consecutive October–April for various SPI thresholds and that there is a large spread in the likelihood of low October–April SPI across many years. In terms of physical features, low October–April SPI in each Southern Africa region is closely related to local atmospheric circulations; however, they are not as closely related to sea surface temperatures (SSTs). These results suggest that dryness spanning many years is determined primarily by persistent local circulations related to atmospheric variability and to a lesser extent variability related to SST anomalies, including the El Niño–Southern Oscillation.

subtropical Indian Ocean dipole↗

Hierarchical Velocity Structure in the Core of Abell 2597

We present XMM-Newton RGS and EPIC data of the putative cooling flow cluster Abell 2597. Velocities of the low-ionization emission lines in the spectrum are blue shifted with respect to the high-ionization lines by 1320 (sup +660) (sub -210) kilometers per second, which is consistent with the difference in the two peaks of the galaxy velocity distribution and may be the signature of bulk turbulence, infall, rotation or damped oscillation in the cluster. A hierarchical velocity structure such as this could be the direct result of galaxy mergers in the cluster core, or the injection of power into the cluster gas from a central engine. The uniform X-ray morphology of the cluster, the absence of fine scale temperature structure and the random distribution of the the galaxy positions, independent of velocity, suggests that our line of sight is close to the direction of motion. These results have strong implications for cooling flow models of the cluster Abell 2597. They give impetus to those models which account for the observed temperature structure of some clusters using mergers instead of cooling flows.

Still, Martin↗

Recursive Hierarchical Image Segmentation by Region Growing and Constrained Spectral Clustering

This paper describes an algorithm for hierarchical image segmentation (referred to as HSEG) and its recursive formulation (referred to as RHSEG). The HSEG algorithm is a hybrid of region growing and constrained spectral clustering that produces a hierarchical set of image segmentations based on detected convergence points. In the main, HSEG employs the hierarchical stepwise optimization (HS WO) approach to region growing, which seeks to produce segmentations that are more optimized than those produced by more classic approaches to region growing. In addition, HSEG optionally interjects between HSWO region growing iterations merges between spatially non-adjacent regions (i.e., spectrally based merging or clustering) constrained by a threshold derived from the previous HSWO region growing iteration. While the addition of constrained spectral clustering improves the segmentation results, especially for larger images, it also significantly increases HSEG's computational requirements. To counteract this, a computationally efficient recursive, divide-and-conquer, implementation of HSEG (RHSEG) has been devised and is described herein. Included in this description is special code that is required to avoid processing artifacts caused by RHSEG s recursive subdivision of the image data. Implementations for single processor and for multiple processor computer systems are described. Results with Landsat TM data are included comparing HSEG with classic region growing. Finally, an application to image information mining and knowledge discovery is discussed.

Tilton, James C.↗

Star formation in molecular clouds - Observation and theory

Star-formation (SF) processes occurring on the scale of giant molecular clouds (10 to the 6th solar masses and 10 to the 20th cm) or smaller are discussed, reviewing the results of recent theoretical and observational investigations. Topics examined include the origin of stellar masses; bimodal SF; initial mass functions; binary stars, bound clusters, and hierarchical fragmentation; and the efficiency of SF. The properties of molecular clouds and the origin of substructures in molecular clumps are explored in detail, and consideration is given to gravitational collapse and protostars, bipolar outflows from young stellar objects, visible young stellar objects, and the implications for binary-star and planetary-system formation.

Shu, Frank H.↗

A statistical analysis of mesoscale rainfall as a random cascade

The paper considers the random cascade theory for spatial rainfall. Particular attention was given to the following four areas: (1) the relationship of the random cascade theory of rainfall to the simple scaling and the hierarchical cluster-point-process theories, (2) the mathematical foundations for some of the formalisms commonly applied in the develpment of statistical cascade theory, (3) the empirical evidence for a random cascade theory of rainfall, and (4) the way of using data for making estimates of parameters and for making statistical inference within this theoretical framework. An analysis of space-time rainfall data is presented. Cascade simulations are carried out to provide a comparison with methods of analysis that are applied to the rainfall data.

Gupta, Vijay K.↗

Constraints on cold dark matter theories from observations of massive x-ray-luminous clusters of galaxies at high redshift

During the course of a gravitational lensing survey of distant, X-ray selected Einstein Observatory Extended Medium Sensitivity Survey (EMSS) clusters of galaxies, we have studied six X-ray-luminous (L(sub x) greater than 5 x 10(exp 44)(h(sub 50)(exp -2))ergs/sec) clusters at redshifts exceeding z = 0.5. All of these clusters are apparently massive. In addition to their high X-ray luminosity, two of the clusters at z approximately 0.6 exhibit gravitationally lensed arcs. Furthermore, the highest redshift cluster in our sample, MS 1054-0321 at z = 0.826, is both extremely X-ray luminous (L(sub 0.3-3.5keV)=9.3 x 10(exp 44)(h(sub 50)(exp -2))ergs/sec) and exceedingly rich with an optical richness comparable to an Abell Richness Class 4 cluster. In this Letter, we discuss the cosmological implications of the very existence of these clusters for hierarchical structure formation theories such as standard Omega = 1 CDM (cold dark matter), hybrid Omega = 1 C + HDM (hot dark matter), and flat, low-density Lambda + CDM models.

Luppino, G. A.↗

Statistics of voids in hierarchical universes

As one alternative to the N-point galaxy correlation function statistics, the distribution of holes or the probability that a volume of given size and shape be empty of galaxies can be considered. The probability of voids resulting from a variety of hierarchical patterns of clustering is considered, and these are compared with the results of numerical simulations and with observations. A scaling relation required by the hierarchical pattern of higher order correlation functions is seen to be obeyed in the simulations, and the numerical results show a clear difference between neutrino models and cold-particle models; voids are more likely in neutrino universes. Observational data do not yet distinguish but are close to being able to distinguish between models.

Fry, J. N.↗

Utilizing Hierarchical Segmentation to Generate Water and Snow Masks to Facilitate Monitoring Change with Remotely Sensed Image Data

The hierarchical segmentation (HSEG) algorithm is a hybrid of hierarchical step-wise optimization and constrained spectral clustering that produces a hierarchical set of image segmentations. This segmentation hierarchy organizes image data in a manner that makes the image's information content more accessible for analysis by enabling region-based analysis. This paper discusses data analysis with HSEG and describes several measures of region characteristics that may be useful analyzing segmentation hierarchies for various applications. Segmentation hierarchy analysis for generating landwater and snow/ice masks from MODIS (Moderate Resolution Imaging Spectroradiometer) data was demonstrated and compared with the corresponding MODIS standard products. The masks based on HSEG segmentation hierarchies compare very favorably to the MODIS standard products. Further, the HSEG based landwater mask was specifically tailored to the MODIS data and the HSEG snow/ice mask did not require the setting of a critical threshold as required in the production of the corresponding MODIS standard product.

Tilton, James C.↗

Parallel Implementation of the Recursive Approximation of an Unsupervised Hierarchical Segmentation Algorithm

The hierarchical image segmentation algorithm (referred to as HSEG) is a hybrid of hierarchical step-wise optimization (HSWO) and constrained spectral clustering that produces a hierarchical set of image segmentations. HSWO is an iterative approach to region grooving segmentation in which the optimal image segmentation is found at N(sub R) regions, given a segmentation at N(sub R+1) regions. HSEG's addition of constrained spectral clustering makes it a computationally intensive algorithm, for all but, the smallest of images. To counteract this, a computationally efficient recursive approximation of HSEG (called RHSEG) has been devised. Further improvements in processing speed are obtained through a parallel implementation of RHSEG. This chapter describes this parallel implementation and demonstrates its computational efficiency on a Landsat Thematic Mapper test scene.

Tilton, James C.↗

Decision net, directed graph, and neural net processing of imaging spectrometer data

A decision-net solution involving a novel hierarchical classifier and a set of multiple directed graphs, as well as a neural-net solution, are respectively presented for large-class problem and mixture problem treatments of imaging spectrometer data. The clustering method for hierarchical classifier design, when used with multiple directed graphs, yields an efficient decision net. New directed-graph rules for reducing local maxima as well as the number of perturbations required, and the new starting-node rules for extending the reachability and reducing the search time of the graphs, are noted to yield superior results, as indicated by an illustrative 500-class imaging spectrometer problem.

Casasent, David↗

Einstein imaging observations of clusters with a bimodal mass distribution

Einstein imaging observations of four X-ray clusters of galaxies characterized by a double X-ray surface brightness and thus mass distribution are presented. The clusters A98, A115, A1750 and SC 0627-54 were found to exhibit two enhancements in their X-ray surface brightness distributions in observations made with the Einstein Imaging Proportional Counter. Calculations of the probability that the clusters represent chance superpositions indicate that the double clusters are physically associated. The radial distributions of the components are inconsistent with those of single point sources, and have been used to derive cluster luminosities which are typical of rich clusters. Masses of the subclusters are also found to be typical of bound and virialized clusters with gas contributing 10%. Within the framework of the hierarchical theory of galactic clustering, the double clusters are suggested to represent an intermediate evolutionary stage before the merger of subclusters into a relaxed Coma-type cluster.

Forman, W.↗