Search NASA⌕ Search

SEARCH · Search NASA

Results for “Dynamic clustering algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Adaptive Waveform Correlation Detectors for Arrays: Algorithms for Autonomous Calibration

Waveform correlation detectors compare a signal template with successive windows of a continuous data stream and report a detection when the correlation coefficient, or some comparable detection statistic, exceeds a specified threshold. Since correlation detectors exploit the fine structure of the full waveform, they are exquisitely sensitive when compared to power (STA/LTA) detectors. The drawback of correlation detectors is that they require complete knowledge of the signal to be detected, which limits such methods to instances of seismicity in which a very similar signal has already been observed by every station used. Such instances include earthquake swarms, aftershock sequences, repeating industrial seismicity, and many other forms of controlled explosions. The reduction in the detection threshold is even greater when the techniques are applied to arrays since stacking can be performed on the individual channel correlation traces to achieve significant array gain. In previous years we have characterized the decrease in detection threshold afforded by correlation detection across an array or network when observations of a previous event provide an adequate template for signals from subsequent events located near the calibration event. Last year we examined two related issues: (1) the size of the source region calibration footprint afforded by a master event, and (2) the use of temporally incoherent detectors designed to detect the gross envelope structure of the signal to extend the footprint. In Case 1, results from the PETROBAR-1 marine refraction profile indicated that array correlation gain was usable at inter-source separations out to one or two wavelengths. In Case 2, we found that incoherent detectors developed from a magnitude 6 event near Svalbard were successful at detecting aftershocks where correlation detectors derived from individual aftershocks were not. Incoherent detectors might provide 'seed' events for correlation detectors that then could extend detection to lower magnitudes. This year we addressed a problem long known to limit the acceptance of correlation detectors in practice: the labor intensive development of templates. For example, existing design methods cannot keep pace with rapidly unfolding aftershock sequences. We successfully built and tested an object-oriented framework (as described in our 2005 proposal) for autonomous calibration of waveform correlation detectors for an array. The framework contains a dynamic list of detectors of several types operating on a continuous array data stream. The list has permanent detectors: beam forming power (STA/LTA) detectors which serve the purpose of detecting signals not yet characterized with a waveform template. The framework also contains an arbitrary number of subspace detectors which are launched automatically using the waveforms from validated power detections as templates. The implementation is very efficient such that the computational cost of adding subspace detectors was low. The framework contains a supervisor that oversees the validation of power detections, and periodically halts the processing to revise the portfolio of detectors. The process of revision consists of collecting the waveforms from all detections, performing cross-correlations pairwise among all waveforms, clustering the detections using correlations as a distance measure, then creating a new subspace detector from each cluster. The collection of new subspace detectors replaces the existing portfolio and processing of the data stream resumes. This elaborate scheme was implemented to prevent proliferation of closely-related subspace detectors. The method performed very well on several simple sequences: 2005 'drumbeat' events observed locally at Mt. St. Helens, and the 2003 Orinda, CA aftershock sequence. Our principal test entailed detection of the aftershocks of the San Simeon earthquake using the NVAR array; in this case, the system automatically detected and categorized approximately 2/3 of the events above magnitude 2.8.

58 GEOSCIENCES↗

Mapping the Evolution of Scientific Fields

Despite the apparent cross-disciplinary interactions among scientific fields, a formal description of their evolution is lacking. Here we describe a novel approach to study the dynamics and evolution of scientific fields using a network-based analysis. We build an idea network consisting of American Physical Society Physics and Astronomy Classification Scheme (PACS) numbers as nodes representing scientific concepts. Two PACS numbers are linked if there exist publications that reference them simultaneously. We locate scientific fields using a community finding algorithm, and describe the time evolution of these fields over the course of 1985–2006. The communities we identify map to known scientific fields, and their age depends on their size and activity. We expect our approach to quantifying the evolution of ideas to be relevant for making predictions about the future of science and thus help to guide its development.

59 BASIC BIOLOGICAL SCIENCES↗

Power Minimization techniques for Networked Data Centers.

Our objective is to develop a mathematical model to optimize energy consumption at multiple levels in networked data centers, and develop abstract algorithms to optimize not only individual servers, but also coordinate the energy consumption of clusters of servers within a data center and across geographically distributed data centers to minimize the overall energy cost and consumption of brown energy of an enterprise. In this project, we have formulated a variety of optimization models, some stochastic others deterministic, and have obtained a variety of qualitative results on the structural properties, robustness, and scalability of the optimal policies. We have also systematically derived from these models decentralized algorithms to optimize energy efficiency, analyzed their optimality and stability properties. Finally, we have conducted preliminary numerical simulations to illustrate the behavior of these algorithms. We draw the following conclusion. First, there is a substantial opportunity to minimize both the amount and the cost of electricity consumption in a network of datacenters, by exploiting the fact that traffic load, electricity cost, and availability of renewable generation fluctuate over time and across geographical locations. Judiciously matching these stochastic processes can optimize the tradeoff between brown energy consumption, electricity cost, and response time. Second, given the stochastic nature of these three processes, real-time dynamic feedback should form the core of any optimization strategy. The key is to develop decentralized algorithms that can be implemented at different parts of the network as simple, local algorithms that coordinate through asynchronous message passing.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A general ansatz for constructing quasi-diabatic states in electronically excited aggregated systems

We present a general method for analyzing the character of singly excited states in terms of charge transfer (CT) and locally excited (LE) configurations. The analysis is formulated for configuration interaction singles (CIS) singly excited wave functions of aggregate systems. It also approximately works for the second-order approximate coupled cluster singles and doubles and the second-order algebraic-diagrammatic construction methods [CC2 and ADC(2)]. The analysis method not only generates a weight of each character for an excited state, but also allows to define the related quasi-diabatic states and corresponding coupling matrix elements. In the character analysis approach, we divide the target system into domains and use a modified Pipek-Mezey algorithm to localize the canonical MOs on each domain, respectively. The CIS wavefunction is then transformed into the localized basis, which allows us to partition the wavefunction into LE configurations within domains and CT configuration between pairs of different domains. Quasi-diabatic states are then obtained by mixing excited states subject to the condition of maximizing the weight of one single LE or CT configuration (localization in configuration space). Different aims of such a procedure are discussed, either the construction of pure LE and CT states for analysis purposes (by including a large number of excited states) or the construction of effective models for dynamics calculations (by including a restricted number of excited states). Applications are given to LE/CT mixing in π-stacked systems, charge-recombination matrix elements in a hetero-dimer, and excitonic couplings in multi-chromophoric systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Generative Adversarial Network for Synthetic Time Series Data Generation in Smart Grids

The availability of fine grained time series data is a pre-requisite for research in smart-grids. While data for transmission systems is relatively easily obtainable, issues related to data collection, security and privacy hinder the widespread public availability/accessibility of such datasets at the distribution system level. This has prevented the larger research community from effectively applying sophisticated machine learning algorithms to significantly improve the distribution-level accuracy of predictions and increase the efficiency of grid operations. Synthetic dataset generation has proven to be a promising solution for addressing data availability issues in various domains such as computer vision, natural language processing and medicine. However, its exploration in the smart grid context remains unsatisfactory. Previous works have tried to generate synthetic datasets by modeling the underlying system dynamics: an approach which is difficult, time consuming, error prone and often times infeasible in many problems. In this work, we propose a novel data-driven approach to synthetic dataset generation by utilizing deep generative adversarial networks (GAN) to learn the conditional probability distribution of essential features in the real dataset and generate samples based on the learned distribution. To evaluate our synthetically generated dataset, we measure the maximum mean discrepancy (MMD) between real and synthetic datasets as probability distributions, and show that their sampling distance converges. To further validate our synthetic dataset, we perform common smart grid tasks such as k-means clustering and short-term prediction on both datasets. Experimental results show the efficacy of our synthetic dataset approach: the real and synthetic datasets are indistinguishable by solely examining the output of these tasks.

14 SOLAR ENERGY↗

Data Analysis Approaches for the Risk-Informed Safety Margins Characterization Toolkit

In the past decades, several numerical simulation codes have been employed to simulate accident dynamics (e.g., RELAP5-3D, RELAP-7, MELCOR, MAAP). In order to evaluate the impact of uncertainties into accident dynamics, several stochastic methodologies have been coupled with these codes. These stochastic methods range from classical Monte-Carlo and Latin Hypercube sampling to stochastic polynomial methods. Similar approaches have been introduced into the risk and safety community where stochastic methods (such as RAVEN, ADAPT, MCDET, ADS) have been coupled with safety analysis codes in order to evaluate the safety impact of timing and sequencing of events. These approaches are usually called Dynamic PRA or simulation-based PRA methods. These uncertainties and safety methods usually generate a large number of simulation runs (database storage may be on the order of gigabytes or higher). The scope of this paper is to present a broad overview of methods and algorithms that can be used to analyze and extract information from large data sets containing time dependent data. In this context, “extracting information” means constructing input-output correlations, finding commonalities, and identifying outliers. Some of the algorithms presented here have been developed or are under development within the RAVEN statistical framework.

97 MATHEMATICS AND COMPUTING↗

The Splashback Feature around DES Galaxy Clusters: Galaxy Density and Weak Lensing Profiles

Splashback refers to the process of matter that is accreting onto a dark matter halo reaching its first orbital apocenter and turning around in its orbit. The clustercentric radius at which this process occurs, r sp, defines a halo boundary that is connected to the dynamics of the cluster. A rapid decline in the halo profile is expected near r sp. We measure the galaxy number density and weak lensing mass profiles around redMaPPer galaxy clusters in the first-year Dark Energy Survey (DES) data. For a cluster sample with mean M 200m mass ≈2.5 × 10 14 M ⊙ , we find strong evidence of a splashback-like steepening of the galaxy density profile and measure r sp = 1.13 ± 0.07 h –1 Mpc, consistent with the earlier Sloan Digital Sky Survey measurements of More et al. and Baxter et al. Moreover, our weak lensing measurement demonstrates for the first time the existence of a splashback-like steepening of the matter profile of galaxy clusters. We measure r sp = 1.34 ± 0.21 h –1 Mpc from the weak lensing data, in good agreement with our galaxy density measurements. For different cluster and galaxy samples, we find that, consistent with ΛCDM simulations, r sp scales with R 200m and does not evolve with redshift over the redshift range of 0.3–0.6. We also find that potential systematic effects associated with the redMaPPer algorithm may impact the location of r sp . In conclusion, we discuss the progress needed to understand the systematic uncertainties and fully exploit forthcoming data from DES and future surveys, emphasizing the importance of more realistic mock catalogs and independent cluster samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Computationally-efficient stochastic cluster dynamics method for modeling damage accumulation in irradiated materials

An improved version of a recently developed stochastic cluster dynamics (SCD) method (Marian and Bulatov, 2012) [6] is introduced as an alternative to rate theory (RT) methods for solving coupled ordinary differential equation (ODE) systems for irradiation damage simulations. SCD circumvents by design the curse of dimensionality of the variable space that renders traditional ODE-based RT approaches inefficient when handling complex defect population comprised of multiple (more than two) defect species. Several improvements introduced here enable efficient and accurate simulations of irradiated materials up to realistic (high) damage doses characteristic of next-generation nuclear systems. The first improvement is a procedure for efficiently updating the defect reaction-network and event selection in the context of a dynamically expanding reaction-network. Next is a novel implementation of the τ-leaping method that speeds up SCD simulations by advancing the state of the reaction network in large time increments when appropriate. Lastly, a volume rescaling procedure is introduced to control the computational complexity of the expanding reaction-network through occasional reductions of the defect population while maintaining accurate statistics. The enhanced SCD method is then applied to model defect cluster accumulation in iron thin films subjected to triple ion-beam (Fe{sup 3+}, He{sup +} and H{sup +}) irradiations, for which standard RT or spatially-resolved kinetic Monte Carlo simulations are prohibitively expensive.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A NEW PERSPECTIVE OF THE RADIO BRIGHT ZONE AT THE GALACTIC CENTER: FEEDBACK FROM NUCLEAR ACTIVITIES

New observations of Sgr A have been carried out with the Jansky VLA in the B and C arrays using the broadband (2 GHz) continuum mode at 5.5 GHz. The field of view covers the central 13′ (30 pc) region of the radio-bright zone at the Galactic center. Using the multi-scale and multi-frequency-synthesis (MS-MFS) algorithms in CASA, we have imaged Sgr A with a resolution of 1″, achieving an rms noise of 8 μJy beam{sup −1}, and a dynamic range of 100,000:1. Both previously known and newly identified radio features in this region are revealed, including numerous filamentary sources. The radio continuum image is compared with Chandra X-ray images, with a CN emission-line image obtained with the Submillimeter Array and with detailed Paschen-α images obtained with Hubble Space Telescope/NICMOS. We discuss several prominent features in the radio image. The “Sgr A west Wings” extend 2′ (5 pc) from the NW and SE tips of the Sgr A west H ii region (the “Mini-spiral”) to positions located 2.9 and 2.4 arcmin to the northwest and southeast of Sgr A*, respectively. The NW wing, along with several other prominent features, including the previously identified “NW Streamers,” form an elongated radio lobe (NW lobe), oriented nearly perpendicular to the Galactic plane. This radio lobe, with a size of 6.′3 × 3.′2 (14.4 pc × 7.3 pc), has a known X-ray counterpart. In the outer region of the NW lobe, a row of three thermally emitting rings is observed. A field containing numerous amorphous radio blobs extends for a distance of ∼2 arcmin beyond the tip of the SE wing; these newly recognized features coincide with the SE X-ray lobe. Most of the amorphous radio blobs in the NW and SE lobes have Paschen-α counterparts. We propose that they have been produced by shock interaction of ambient gas concentrations with a collimated nuclear wind or an outflow that originated from within the circumnuclear disk (CND). We also discuss the possibility that the ionized wind or outflow has been launched by radiation force produced by the central star cluster. Finally, we remark on the detailed structure of a prominent radio emission feature located within the shell of the Sgr A east supernova remnant. Because this feature—the “Sigma Front”—correlates well in shape and orientation with the nearby edge of the CND, we propose that it is a reflected shock wave resulting from the impact of the Sgr A east blast wave on the CND.

79 ASTRONOMY AND ASTROPHYSICS↗

A Decentralized Approach for Modeling Organized Convection Based on Thermal Populations on Microgrids

Abstract In this study, a spectral model for convective transport is coupled to a thermal population model on a two‐dimensional horizontal “microgrid,” covering the typical gridbox size of general circulation models. The goal is to explore new ways of representing impacts of spatial organization in cumulus cloud fields. The thermals are considered the smallest building block of convection, with thermal life cycle and movement represented through binomial functions. Thermals interact through two simple rules, reflecting pulsating growth and environmental deformation. Long‐lived thermal clusters thus form on the microgrid, exhibiting scale growth and spacing that represent simple forms of spatial organization and memory. Size distributions of cluster number are diagnosed from the microgrid through an online clustering algorithm, and provided as input to a spectral multiplume eddy‐diffusivity mass flux scheme. This yields a decentralized transport system, in that the thermal clusters acting as independent but interacting nodes that carry information about spatial structure. The main objectives of this study are (a) to seek proof of concept of this approach, and (b) to gain insight into impacts of spatial organization on convective transport. Single‐column model experiments demonstrate satisfactory skill in reproducing two observed cases of continental shallow convection. Metrics expressing self‐organization and spatial organization match well with large‐eddy simulation results. We find that in this coupled system, spatial organization impacts convective transport primarily through the scale break in the size distribution of cluster number. The rooting of saturated plumes in the subcloud mixed layer plays a key role in this process.

54 ENVIRONMENTAL SCIENCES↗

Automatic Cloud Bursting under FermiCloud

Cloud computing is changing the infrastructure upon which scientific computing depends from supercomputers and distributed computing clusters to a more elastic cloud-based structure. The service-oriented focus and elasticity of clouds can not only facilitate technology needs of emerging business but also shorten response time and reduce operational costs of traditional scientific applications. Fermi National Accelerator Laboratory (Fermilab) is currently in the process of building its own private cloud, FermiCloud, which allows the existing grid infrastructure to use dynamically provisioned resources on FermiCloud to accommodate increased but dynamic computation demand from scientists in the domains of High Energy Physics (HEP) and other research areas. Cloud infrastructure also allows to increase a private cloud’s resource capacity through “bursting” by borrowing or renting resources from other community or commercial clouds when needed. This paper introduces a joint project on building a cloud federation to support HEP applications between Fermi National Accelerator Laboratory and Korea Institution of Science and Technology Information, with technical contributions from the Illinois Institute of Technology. In particular, this paper presents two recent accomplishments of the joint project: (a) cloud bursting automation and (b) load balancer. Automatic cloud bursting allows computer resources to be dynamically reconfigured to meet users’ demands. The load balance algorithm which the cloud bursting depends on decides when and where new resources need to be allocated. Our preliminary prototyping and experiments have shown promising success, yet, they also have opened new challenges to be studied

Wu, Hao↗

CLUSTERED STAR FORMATION IN MAGNETIC CLOUDS: PROPERTIES OF DENSE CORES FORMED IN OUTFLOW-DRIVEN TURBULENCE

We investigate the physical properties of dense cores formed in turbulent, magnetized, parsec-scale clumps of molecular clouds, using three-dimensional numerical simulations that include protostellar outflow feedback. The dense cores are identified in the simulated density data cube through a clumpfind algorithm. We find that the core velocity dispersion does not show any clear dependence on the core size, in contrast to Larson's linewidth-size relation, but consistent with recent observations. In the absence of a magnetic field, the majority of the cores have supersonic velocity dispersions. A moderately strong magnetic field reduces the dispersion to a subsonic or at most transonic value typically. Most of the cores are out of virial equilibrium, with the external pressure dominating the self-gravity. The implication is that the core evolution is largely controlled by the outflow-driven turbulence. Even an initially weak magnetic field can retard star formation significantly, because the field is amplified by the outflow-driven turbulence to an equipartition strength, with the distorted field component dominating the uniform one. In contrast, for a moderately strong field, the uniform component remains dominant. Such a difference in the magnetic structure is evident in our simulated polarization maps of dust thermal emission; it provides a handle on the field strength. Recent polarization measurements show that the field lines in cluster-forming clumps are spatially well ordered. It is indicative of a moderately strong, dynamically important field which, in combination with outflow feedback, can keep the rate of star formation in embedded clusters at the observationally inferred, relatively slow rate of several percent per free-fall time.

79 ASTRONOMY AND ASTROPHYSICS↗

Full-dimensional global potential energy surfaces describing abstraction and exchange for the H + H{sub 2}S reaction

For the H + H{sub 2}S system, ∼34 000 data points are sampled over a large configuration space including both abstraction and exchange channels, and calculated at the level of explicitly correlated unrestricted coupled cluster method with singles, doubles, and perturbative triples excitations with the augmented correlation-consistent polarized triple zeta basis set (UCCSD(T)-F12a/aug-cc-pVTZ). The data set was fit using the newly proposed permutation invariant polynomial-neural network (PIP-NN) method with three different vectors as the input: two redundant sets of PIPs, one with the maximum order four (PES-I) and one with the maximum order three (PES-II), and nine non-redundant PIPs (PES-III). All these PESs show small fitting errors and essentially the same performance in representing the title system. Various kinetics and dynamical properties are calculated using the tunneling corrected transition state theory and quasi-classical trajectory, and compared with available experimental results. At a collision energy of 10 kcal/mol, both the H{sub 2} and SH products are found to be internally cold, with ∼20% of H{sub 2} at its first vibrational excited state, while SH is essentially a spectator. The angular distributions of the products are mainly in backward with considerable contributions from sideway direction. In addition, analytical partial derivatives of any PIP-NN PES with respect to the coordinates of atoms are derived by making use of the monomial symmetrization algorithm [Z. Xie and J. M. Bowman, J. Chem. Theory Comput. 6, 26–34 (2010)]. It can not only accelerate the evaluation of the derivatives, but also improve the energy convergence significantly.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Current Status of Single Particle Imaging with X-ray Lasers

The advent of ultrafast X-ray free-electron lasers (XFELs) opens the tantalizing possibility of the atomic-resolution imaging of reproducible objects such as viruses, nanoparticles, single molecules, clusters, and perhaps biological cells, achieving a resolution for single particle imaging better than a few tens of nanometers. Improving upon this is a significant challenge which has been the focus of a global single particle imaging (SPI) initiative launched in December 2014 at the Linac Coherent Light Source (LCLS), SLAC National Accelerator Laboratory, USA. A roadmap was outlined, and significant multi-disciplinary effort has since been devoted to work on the technical challenges of SPI such as radiation damage, beam characterization, beamline instrumentation and optics, sample preparation and delivery and algorithm development at multiple institutions involved in the SPI initiative. Currently, the SPI initiative has achieved 3D imaging of rice dwarf virus (RDV) and coliphage PR772 viruses at ~10 nm resolution by using soft X-ray FEL pulses at the Atomic Molecular and Optical (AMO) instrument of LCLS. Meanwhile, diffraction patterns with signal above noise up to the corner of the detector with a resolution of ~6 Ångström (Å) were also recorded with hard X-rays at the Coherent X-ray Imaging (CXI) instrument, also at LCLS. Achieving atomic resolution is truly a grand challenge and there is still a long way to go in light of recent developments in electron microscopy. However, the potential for studying dynamics at physiological conditions and capturing ultrafast biological, chemical and physical processes represents a tremendous potential application, attracting continued interest in pursuing further method development. In this paper, we give a brief introduction of SPI developments and look ahead to further method development.

36 MATERIALS SCIENCE↗

Comparing Synoptic Pattern Evolution for Flash‐Flood‐Producing and Non‐Flash‐Flood‐Producing Mesoscale Convective Systems in the United States

Understanding how the short-term evolution of synoptic weather patterns influence Mesoscale Convective Systems (MCSs) is essential, as these systems are responsible for over half of central U.S. flash floods, leading to substantial socioeconomic and water resource management impacts. This study analyzes long-term MCS data, flash flood reports, and atmospheric reanalyses from 2007 to 2017 using a machine learning clustering algorithm to examine how the synoptic weather patterns evolve prior to MCS initiation. While the clusters reflect seasonal and regional differences in MCS occurrence, they do not consistently distinguish between MCSs that do and do not produce flash floods. Systems in the southern Great Plains are more flood-prone when a synoptic-scale forcing, located near the system, drives strong water vapor transport from the nearby moisture source. More generally under different synoptic weather patterns, a broader precipitating area is the most dominant factor governing MCS flash flood potential.

atmospheric dynamics↗

Automated detection and analysis of particle beams in laser-plasma accelerator simulations

Numerical simulations of laser-plasma wakefield (particle) accelerators model the acceleration of electrons trapped in plasma oscillations (wakes) left behind when an intense laser pulse propagates through the plasma. The goal of these simulations is to better understand the process involved in plasma wake generation and how electrons are trapped and accelerated by the wake. Understanding of such accelerators, and their development, offer high accelerating gradients, potentially reducing size and cost of new accelerators. One operating regime of interest is where a trapped subset of electrons loads the wake and forms an isolated group of accelerated particles with low spread in momentum and position, desirable characteristics for many applications. The electrons trapped in the wake may be accelerated to high energies, the plasma gradient in the wake reaching up to a gigaelectronvolt per centimeter. High-energy electron accelerators power intense X-ray radiation to terahertz sources, and are used in many applications including medical radiotherapy and imaging. To extract information from the simulation about the quality of the beam, a typical approach is to examine plots of the entire dataset, visually determining the adequate parameters necessary to select a subset of particles, which is then further analyzed. This procedure requires laborious examination of massive data sets over many time steps using several plots, a routine that is unfeasible for large data collections. Demand for automated analysis is growing along with the volume and size of simulations. Current 2D LWFA simulation datasets are typically between 1GB and 100GB in size, but simulations in 3D are of the order of TBs. The increase in the number of datasets and dataset sizes leads to a need for automatic routines to recognize particle patterns as particle bunches (beam of electrons) for subsequent analysis. Because of the growth in dataset size, the application of machine learning techniques for scientific data mining is increasingly considered. In plasma simulations, Bagherjeiran et al. presented a comprehensive report on applying graph-based techniques for orbit classification. They used the KAM classifier to label points and components in single and multiple orbits. Love et al. conducted an image space analysis of coherent structures in plasma simulations. They used a number of segmentation and region-growing techniques to isolate regions of interest in orbit plots. Both approaches analyzed particle accelerator data, targeting the system dynamics in terms of particle orbits. However, they did not address particle dynamics as a function of time or inspected the behavior of bunches of particles. Ruebel et al. addressed the visual analysis of massive laser wakefield acceleration (LWFA) simulation data using interactive procedures to query the data. Sophisticated visualization tools were provided to inspect the data manually. Ruebel et al. have integrated these tools to the visualization and analysis system VisIt, in addition to utilizing efficient data management based on HDF5, H5Part, and the index/query tool FastBit. In Ruebel et al. proposed automatic beam path analysis using a suite of methods to classify particles in simulation data and to analyze their temporal evolution. To enable researchers to accurately define particle beams, the method computes a set of measures based on the path of particles relative to the distance of the particles to a beam. To achieve good performance, this framework uses an analysis pipeline designed to quickly reduce the amount of data that needs to be considered in the actual path distance computation. As part of this process, region-growing methods are utilized to detect particle bunches at single time steps. Efficient data reduction is essential to enable automated analysis of large data sets as described in the next section, where data reduction methods are steered to the particular requirements of our clustering analysis. Previously, we have described the application of a set of algorithms to automate the data analysis and classification of particle beams in the LWFA simulation data, identifying locations with high density of high energy particles. These algorithms detected high density locations (nodes) in each time step, i.e. maximum points on the particle distribution for only one spatial variable. Each node was correlated to a node in previous or later time steps by linking these nodes according to a pruned minimum spanning tree (PMST). We call the PMST representation 'a lifetime diagram', which is a graphical tool to show temporal information of high dense groups of particles in the longitudinal direction for the time series. Electron bunch compactness was described by another step of the processing, designed to partition each time step, using fuzzy clustering, into a fixed number of clusters.

43 PARTICLE ACCELERATORS↗

Science Validation for Dark Energy Research with Optical Imaging Surveys

The Universe has been expanding at an accelerating rate over the past several billion years, as though an unknown form of dark energy permeates all of space. The ultimate scientific goal of the proposed research is to distinguish between different physical mechanisms that could account for this observed accelerated expansion, for example, the zero-point energy of the vacuum, a dynamical form of energy that varies in time and/or space, or a modification to our theory of gravity. Wide- field optical imaging surveys of the night sky can test these competing models by measuring both the cosmic expansion history and the growth of large-scale structure. To this end, the Dark Energy Survey (DES) has cataloged several hundred million galaxies and thousands of supernovae. The Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), will enlarge the census to billions of galaxies and hundreds of thousands of supernovae. A critical question for these dark energy experiments is whether systematic uncertainties can continue to be controlled at a level to keep pace with the statistical precision offered by such enormous datasets. The immediate research objectives of this project were (1) to prepare and validate input datasets that are the foundation of cosmological analyses with DES, and (2) to prepare for value-added characterization of Rubin Observatory commissioning data to inform early operations and accelerate the realization of dark energy science from LSST data products. For DES, we assembled and curated cosmology-ready data releases that include value-added components such as enhanced photometric and astrometric calibrations, alternative source extraction algorithms, maps of the survey coverage and survey conditions, object classifications, object quality selections, galaxy shapes, and photometric redshifts. We used the galaxy clustering technique to validate the photometric redshift distributions of various galaxy samples to be used as lenses in combined studies of galaxy clustering and weak gravitational lensing. The galaxy clustering redshift analysis was enhanced by use of a larger sample of reference galaxies from the eBOSS spectroscopic survey that extends to higher redshifts. For LSST, we prepared for science validation studies of commissioning data aimed at dark energy science capability that extend beyond the normative system-level tests to be done by the Rubin Observatory Construction Project. We identified a set of proposed survey strategies and candidate target fields that could be observed during the commissioning period to enhance science validation activities related to studies of dark energy.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PERSIANN Dynamic Infrared–Rain Rate (PDIR-Now): A Near-Real-Time, Quasi-Global Satellite Precipitation Dataset

This study presents the Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks–Dynamic Infrared Rain Rate (PDIR-Now) near-real-time precipitation dataset. This dataset provides hourly, quasi-global, infrared-based precipitation estimates at 0.04° × 0.04° spatial resolution with a short latency (15–60 min). It is intended to supersede the PERSIANN–Cloud Classification System (PERSIANN-CCS) dataset previously produced as the near-real-time product of the PERSIANN family. We first provide a brief description of the algorithm’s fundamentals and the input data used for deriving precipitation estimates. Second, we provide an extensive evaluation of the PDIR-Now dataset over annual, monthly, daily, and subdaily scales. Last, the article presents information on the dissemination of the dataset through the Center for Hydrometeorology and Remote Sensing (CHRS) web-based interfaces. The evaluation, conducted over the period 2017–18, demonstrates the utility of PDIR-Now and its improvement over PERSIANN-CCS at all temporal scales. Specifically, PDIR-Now improves the estimation of rain/no-rain days as demonstrated by a critical success index (CSI) of 0.53 compared to 0.47 of PERSIANN-CCS. In addition, PDIR-Now improves the estimation of seasonal and diurnal cycles of precipitation as well as regional precipitation patterns erroneously estimated by PERSIANN-CCS. Finally, an evaluation is carried out to examine the performance of PDIR-Now in capturing two extreme events, Hurricane Harvey and a cluster of summer thunderstorms that occurred over the Netherlands, where it is shown that PDIR-Now adequately represents spatial precipitation patterns as well as subdaily precipitation rates with a correlation coefficient (CORR) of 0.64 for Hurricane Harvey and 0.76 for the Netherlands thunderstorms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗