Search NASA⌕ Search

SEARCH · Search NASA

Results for “Complex Network Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

As system scales and application complexity grow, managing and processing simulation data has become a significant challenge. While recent approaches based on data staging and in-situ/in-transit data processing are promising, dynamic data volumes and distributions, such as those occurring in AMR-based simulations, make the efficient use of these techniques challenging. In this paper we propose cross-layer adaptations that address these challenges and respond at runtime to dynamic data management requirements. Specifically we explore (1) adaptations of the spatial resolution at which the data is processed, (2) dynamic placement and scheduling of data processing kernels, and (3) dynamic allocation of in-transit resources. We also exploit coordinated approaches that dynamically combine these adaptations at the different layers. We evaluate the performance of our adaptive cross-layer management approach on the Intrepid IBM-BlueGene/P and Titan Cray-XK7 systems using Chombo-based AMR applications, and demonstrate its effectiveness in improving overall time-to-solution and increasing resource efficiency.

Computer Science↗

Benefits and Limits of Phasing Alleles for Network Inference of Allopolyploid Complexes

Abstract Accurately reconstructing the reticulate histories of polyploids remains a central challenge for understanding plant evolution. Although phylogenetic networks can provide insights into relationships among polyploid lineages, inferring networks may be hindered by the complexities of homology determination in polyploid taxa. We use simulations to show that phasing alleles from allopolyploid individuals can improve phylogenetic network inference under the multispecies coalescent by obtaining the true network with fewer loci compared with haplotype consensus sequences or sequences with heterozygous bases represented as ambiguity codes. Phased allelic data can also improve divergence time estimates for networks, which is helpful for evaluating allopolyploid speciation hypotheses and proposing mechanisms of speciation. To achieve these outcomes in empirical data, we present a novel pipeline that leverages a recently developed phasing algorithm to reliably phase alleles from polyploids. This pipeline is especially appropriate for target enrichment data, where the depth of coverage is typically high enough to phase entire loci. We provide an empirical example in the North American Dryopteris fern complex that demonstrates insights from phased data as well as the challenges of network inference. We establish that our pipeline (PATÉ: Phased Alleles from Target Enrichment data) is capable of recovering a high proportion of phased loci from both diploids and polyploids. These data may improve network estimates compared with using haplotype consensus assemblies by accurately inferring the direction of gene flow, but statistical nonidentifiability of phylogenetic networks poses a barrier to inferring the evolutionary history of reticulate complexes.

Evolutionary Biology↗

Deep Cellular Recurrent Network for Efficient Analysis of Time-Series Data With Spatial Information

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high dimensional data. Deep recurrent neural networks have shown promise in automated feature learning for improved time-series processing. However, generic deep recurrent models grow in scale and depth with increased complexity of the data. This is particularly challenging in presence of high dimensional data with temporal and spatial characteristics. Consequently, this work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to efficiently process complex multi-dimensional time series data with spatial information. Here, the cellular recurrent architecture in the proposed model allows for location-aware synchronous processing of time series data from spatially distributed sensor signal sources. Extensive trainable parameter sharing due to cellularity in the proposed architecture ensures efficiency in the use of recurrent processing units with high-dimensional inputs. This study also investigates the versatility of the proposed DCRNN model for classification of multi-class time series data from different application domains. Consequently, the proposed DCRNN architecture is evaluated using two time-series datasets: a multichannel scalp EEG dataset for seizure detection, and a machine fault detection dataset obtained in-house. The results suggest that the proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.

60 APPLIED LIFE SCIENCES↗

DeepClone: Lightweight State Replication of Deep Learning Models for Data Parallel Training

Training modern deep neural network (DNN) models involves complex workflows triggered by model exploration, sensitivity analysis, explainability, etc. A key primitive in this context is the ability to clone a model training instance, i.e. “fork” the training process in a potentially different direction, which enables comparisons of different evolution paths using variations of training data and model parameters. However, in a quest improve the training throughput, a mix of data parallel, model parallel, pipeline parallel and layer-wise parallel approaches are making the problem of cloning highly complex. In this paper, we explore the problem of efficient cloning under such circumstances. To this end, we leverage several properties of data-parallel training and layer-wise parallelism to design DeepClone, a cloning approach based on augmenting the execution graph to gain direct access to tensors, which are then sharded and reconstructed asynchronously in order to minimize runtime overhead, standby duration, readiness duration. Compared with state-of-art approaches, DeepClone shows orders of magnitude improvement for several classes of DNN models.

data-parallel training↗

Fate and transport of uranium (VI) in weathered saprolite

We conducted batch and column experiments to investigate sorption and transport of uranium (U) in the presence of saprolite derived from interbedded shale, limestone, and sandstone sequences. Sorption kinetics were measured at two initial concentrations (C0; 1, 10 mM) and three soil:solution ratios (Rs/w; 0.005, 0.25, 2 kg/L) at pH 4.5 (pH of the saprolite). The rate of U loss from solution (mmole/L/h) increased with increasing Rs/w. Uranium sorption exhibited a fast phase with 80% sorption in the first eight hours for all C0 and Rs/w values and a slow phase during which the reaction slowly approached (pseudo) equilibrium over the next seven days. The pH-dependency of U sorption was apparent in pH sorption edges. U(VI) sorption increased over the pH range 4e6, then decreased sharply at pH > 7.5. U(VI) sorption edges were well described by a surface complexation model using calibrated parameters and the reaction network proposed by Waite et al. (1994). Sorption isotherms measured using the same Rs/w and pH values showed a solids concentration effect where U(VI) sorption capacity and affinity decreased with increasing solids concentration. Moreover, this effect may have been due to either particle aggregation or competition between U(VI) and exchangeable cations for sorption sites. The surface complexation model with calibrated parameters was able to predict the general sorption behavior relatively well, but failed to reproduce solid concentration effects, implying the importance of appropriate design if batch experiments are to be utilized for dynamic systems. Transport of U(VI) through the packed column was significantly retarded. We also conducted transport simulations using the reactive transport model HydroGeoChem (HGC) v5.0 that incorporated the surface complexation reaction network used to model the batch data. Model parameters reported by Waite et al. (1994) provided a better prediction of U transport than optimized parameters derived from our sorption edges. The results presented in this study highlight the challenges in defining appropriate conditions for batch-type experiments used to extrapolate parameters for transport models, and also underline a gap in our ability to transfer batch results to transport simulations.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

X-Band Radar and Surface-Based Observations of Cold-Season Precipitation in Western Colorado’s Complex Terrain

Abstract Hydrologic processes associated with intermountain cold-season precipitation in the Upper Colorado River basin have important impacts on avalanche forecasting and water resource management. However, traditional weather radar networks struggle with observations in this complex terrain. Data collected during the Study of Precipitation, the Lower Atmosphere, and the Surface for Hydrometeorology (SPLASH) and its sister campaign, Surface Atmosphere Integrated Field Laboratory (SAIL) in the East River watershed of western Colorado, are used to examine a multistorm period from 23 December 2021 to 1 January 2022 that contributed 35% of the total winter precipitation in this watershed. Dual-polarization X-band radar and disdrometer measurements show ∼30-mm differences in precipitation amount at two sites in proximity over four distinct storm events within the period. Wind patterns, synoptic forcings, microphysical characteristics of precipitation, and surface meteorology are analyzed to explain the observed spatial variability of cold-season precipitation in complex mountainous terrain. Analysis shows that differences over time within this event are mainly accounted for by synoptic forcings, such as frontal passages; differences between sites are accounted for by the impact of variations in local wind patterns on precipitation microphysics. Patterns of surface precipitation intensity are compared and found to be correlated with X-band radar signatures; a relationship between a strong dendritic growth stage and intense low-density surface precipitation is reinforced by this study. This relationship demonstrates the importance of particle growth mechanisms on surface snowfall patterns in high-altitude complex terrain, underscoring the importance of realistic microphysical parameterizations. Significance Statement The amount and density of snowpack from western Colorado winter storms have significant impacts on water resources in the Upper Colorado River basin. Snowpack characteristics are affected by small-scale differences in how snow forms in the atmosphere. These differences are hard to study in the complex terrain of the Rockies, but data from the SPLASH and SAIL field campaigns allows us to investigate how snow crystal formation and mountain-driven wind patterns affect snow near the surface. Our study finds that snow crystal growth varies over small space and time scales and is likely controlled by the terrain beneath a given location and resultant local wind patterns. These results imply that predicting snowpack in the Rockies requires properly representing local wind patterns and crystal growth processes in models.

Heflin, Stella↗

Visualization Techniques for Computer Network Defense

Effective visual analysis of computer network defense (CND) information is challenging due to the volume and complexity of both the raw and analyzed network data. A typical CND is comprised of multiple niche intrusion detection tools, each of which performs network data analysis and produces a unique alerting output. The state-of-the-practice in the situational awareness of CND data is the prevalent use of custom-developed scripts by Information Technology (IT) professionals to retrieve, organize, and understand potential threat events. We propose a new visual analytics framework, called the Oak Ridge Cyber Analytics (ORCA) system, for CND data that allows an operator to interact with all detection tool outputs simultaneously. Aggregated alert events are presented in multiple coordinated views with timeline, cluster, and swarm model analysis displays. These displays are complemented with both supervised and semi-supervised machine learning classifiers. The intent of the visual analytics framework is to improve CND situational awareness, to enable an analyst to quickly navigate and analyze thousands of detected events, and to combine sophisticated data analysis techniques with interactive visualization such that patterns of anomalous activities may be more easily identified and investigated.

99 GENERAL AND MISCELLANEOUS↗

Discovery of Chemical Toxicity via Biological Networks and Systems Biology

Both soldiers and animals are exposed to many chemicals as the result of military activities. Tools are needed to understand the hazards and risks that chemicals and new materials pose to soldiers and the environment. We have investigated the potential of global gene regulatory networks in understanding the impact of chemicals on reproduction. We characterized effects of chemicals on ovaries of the model animal system, the Fathead minnow (Pimopheles promelas) connecting chemical impacts on gene expression to circulating blood levels of the hormones testosterone and estradiol in addition to the egg yolk protein vitellogenin. We describe the application of reverse engineering complex interaction networks from high dimensional gene expression data to characterize chemicals that disrupt the hypothalamus-pituitary-gonadal endocrine axis that governs reproduction in fathead minnows. The construction of global gene regulatory networks provides deep insights into how drugs and chemicals effect key organs and biological pathways.

59 BASIC BIOLOGICAL SCIENCES↗

Measurements and analytics of wide-area file transfers over dedicated connections

Distributed scientific and big-data computations are becoming increasingly dependent on access to remote files. Wide-area file transfers are supported by two basic schemes: (i) application-level tools, such as GridFTP, that provide transport services between file systems housed at geographically separated sites, and (ii) file systems mounted over wide-area networks, using mechanisms such as LNet routers that make them transparently available. In both cases, the file transfer performance critically depends on the configuration consisting of host, file, IO, and disk subsystems, which are complex by themselves, as well as on their complex compositions implemented using buffers and IO-network data transitions. We present extensive file transfer rate measurements collected over dedicated 10 Gbps connections with 0-366 ms round-trip times, using GridFTP and XDD file transfer tools, and Lustre file system extended over wide-area networks using LNet routers. Our test configurations are composed of: three types of host systems; XFS, Lustre, and ext3 file systems; and Ethernet and SONET wide-area connections. We present analytics based on the convexity-concavity of throughput profiles which provide insights into throughput and its superior or inferior trend compared to linear interpolations. We propose the utilization-concavity coefficient, a scalar metric that characterizes the overall performance of any file transfer method consisting of specific configuration and scheme. Our results enable performance optimizations by highlighting the significant roles of (i) buffer sizes and parallelism in GridFTP and XDD, and (ii) buffer utilization and credit mechanism in LNet routers.

Rao, Nageswara↗

Network Models of Active Degradation Mechanisms and Pathways for Service Life Prediction of Indoor and Outdoor PV Modules

ct: PV service lifetime prediction (SLP) enables accurate calculation of levelized cost of energy (LCOE), which is crucial to rationalizing PV investment and installation. However, SLP is challeging since PV reliability in the field is affected by many combined factors, including various environmental stresses and module quality. In order to map out the active degradation mechanisms and pathways that best resemble real world conditions, we introduce the framework of a study protocol and use network models fitted to data, to enable analysis and SLP of complex PV systems with multiple active degradation mechanisms. The study protocol is the experimental design, including module variants and different exposure conditions, selection of evaluation methods, time-series data acquisition and training of network models to these data. We present SLP of minimodules in the lab and PV systems in the field. For lab SLP, minimodules with 8 variants based on manufacturer, architecture, and encapsulation were prepared and aged in modified damp heat with or without full spectrum light exposure. Stepwise I-V and Suns-Voc data acquisition tracks changes in electrical properties including Rs,IV, Isc,IV, Vmp,PIV providing insights into power loss of minimodules. Network structural equation modeling (netSEM) was utilized to construct degradation pathway models that identify active degradation mechanisms and predict power loss over time. For field SLP, datastreams of Pmp values and I-V curve datastreams of two types of modules installed in three distinctly different Köppen-Geiger climate zones for 9 years were acquired. With power loss modes corresponding to uniform current loss (ΔPIsc), recombination (ΔPVoc), series resistance (ΔPRs), and current mismatch (ΔPImis) determined, the performance loss rates (PLR) were determined using PVplr. We show how to establish a study protocol framework to ensure appropriate parametric variations and valid data collection from the variants of your complex systems. Then the data-driven netSEM model fitting provides a comprehensive mapping of multiple active degradation mechanisms, and accurate service life prediction.

network model, degradation, photovoltaic, solar↗

Ice-nucleating particles (INPs) concentrations from SAIL-Net

This data set contains ice-nucleating particle (INP) concentration spectra collected during the SAIL-Net sampling period, which complemented the Surface Atmosphere Integrated Field Laboratory (SAIL) campaign in the East River watershed near Crested Butte, Colorado. SAIL-Net was a distributed aerosol measurement network designed to investigate aerosol variability across complex mountainous terrain. The data set includes samples from multiple SAIL-Net sites, including AOS, Gothic, Snodgrass, Pumphouse, Irwin, and Top. INP concentrations are reported as a function of freezing temperature, together with confidence limits, sampling times, site location, elevation, sampled air volume, and treatment information. These data provide an analysis-ready record of the INPs across the SAIL-Net network.

activation temperature↗

Modeling and simulation of the data communication network at the ASRM Facility

This paper describes the modeling and simulation of the communication network for the NASA Advanced Solid Rocket Motor (ASRM) facility under construction at Yellow Creek near Luka, Mississippi. Manufacturing, testing, and operations at the ASRM site will be performed in different buildings scattered over an 1800 acre site. These buildings are interconnected through a local area network (LAN), which will contain one logical Fiber Distributed Data Interface (FDDI) ring acting as a backbone for the whole complex. The network contains approximately 700 multi-vendor workstations, 22 multi-vendor workcells, and 3 VAX clusters interconnected via Ethernet and FDDI. The different devices produce appreciably different traffic patterns, each pattern will be highly variable, and some patterns will be very bursty. Most traffic is between the VAX clusters and the other devices. Comdisco's Block Oriented Network Simulator (BONeS) has been used for network simulation. The two primary evaluation parameters used to judge the expected network performance are throughput and delay.

Nirgudkar, R. P.↗

Ultra-Scale Computing for Emergency Evacuation

Emergency evacuations are carried out in anticipation of a disaster such as hurricane landfall or flooding, and in response to a disaster that strikes without a warning. Existing emergency evacuation modeling and simulation tools are primarily designed for evacuation planning and are of limited value in operational support for real time evacuation management. In order to align with desktop computing, these models reduce the data and computational complexities through simple approximations and representations of real network conditions and traffic behaviors, which rarely represent real-world scenarios. With the emergence of high resolution physiographic, demographic, and socioeconomic data and supercomputing platforms, it is possible to develop micro-simulation based emergency evacuation models that can foster development of novel algorithms for human behavior and traffic assignments, and can simulate evacuation of millions of people over a large geographic area. However, such advances in evacuation modeling and simulations demand computational capacity beyond the desktop scales and can be supported by high performance computing platforms. This paper explores the motivation and feasibility of ultra-scale computing for increasing the speed of high resolution emergency evacuation simulations.

99 GENERAL AND MISCELLANEOUS↗

Energy Transfer Networks within Upconverting Nanoparticles Are Complex Systems with Collective, Robust, and History-Dependent Dynamics

Applications of photon upconverting nanoparticles (UCNPs) in biological imaging and solar energy conversion demand that their anti-Stokes luminescence be both tunable and efficient. Rational design of more efficient UCNPs requires an understanding of energy transfer (ET) between their lanthanide dopants, dynamics that are typically characterized by measuring luminescence lifetimes. Existing knowledge, however, cannot explain basic observations in lifetime experiments, such as their dependence on excitation power, significantly limiting the generality and reliability of lifetime measurements. Here in this paper, we elucidate the origins of the ET dynamics and luminescence lifetimes of Yb 3+ -, Er 3+ -co-doped NaYF 4 UCNPs using time-resolved luminescence and novel applications of rate equations and stochastic simulations. Experiments and calculations consistently show that at high concentrations of Er 3+ , the luminescence lifetimes of UCNPs decrease as much as six-fold when excitation power densities are increased over 6 orders of magnitude. Since power-dependent lifetimes cannot be explained by intrinsic relaxation rates of individual transitions, we analyze lifetime data by treating each UCNP as a complex ET network. We find that UCNP ET networks exhibit four distinguishing characteristics of complex systems: collectivity, nonlinear feedback, robustness, and history dependence. We conclude that power-dependent lifetimes are the consequence of thousands of minor relaxation pathways that act collectively to depopulate and repopulate Er 3+ emitting levels. These ET pathways are dependent on past excitation power because they originate from excited donors and excited acceptors; however, each transition has an unexpectedly small impact on lifetimes due to negative feedback in the network. This robustness is determined by systematically “knocking out”, or disabling, ET transitions in kinetic models. Our classification of UCNP ET networks as complex systems explains why UCNP luminescence lifetimes do not match the intrinsic lifetimes of emitting states. In the future, UCNP networks may be engineered to rival the complexity of biological networks that pattern features with unmatched precision.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Communications among data and science centers

The ability to electronically access and query the contents of remote computer archives is of singular importance in space and earth sciences; the present evaluation of such on-line information networks' development status foresees swift expansion of their data capabilities and complexity, in view of the volumes of data that will continue to be generated by NASA missions. The U.S.'s National Space Science Data Center (NSSDC) manages NASA's largest science computer network, the Space Physics Analysis Network; a comprehensive account is given of the structure of NSSDC international access through BITNET, and of connections to the NSSDC available in the Americas via the International X.25 network.

Green, James L.↗

The Feasibility of Moving PMU Data in the Future Power Grid

The power grid is a complex network connecting electricity providers with their consumers. With an increasing consumer base requiring more resources and the requirement to integrate significant renewable sources, maintaining the network requires new and innovative management solutions. To manage this complexity and provide precise, real-time views of the grid, Phasor Measurement Units (PMUs) are undergoing widespread deployment. These units provide measurements as often as 60 times per second, with an accurate time identifier attached to each reading, enabling real-time monitoring of the network. However, this new capability generates much more data than the current infrastructure is designed to handle. With the expectation that there will eventually be tens of thousands of PMUs monitoring the transmission lines, the power community is looking towards accumulating multiple terabytes of data per day - several orders of magnitude beyond current data acquisition rates. This has led to questions being raised in the power community about whether or not a significant research effort is required to effectively transfer the volume of information generated by these new data streams. This paper answers that question by comparing a worst-case data generation scenario with several alternative networking protocols and historical trends in protocol advancement. Based on this analysis we are able to conclude that transferring the information between the PMUs and the resulting data repositories is feasible. We recognize that there are issues beyond transferring the data that need to be addressed such as effective access to historical data, data transfer latency, cyber security, and data analysis. There is also an extensive engineering trade-off that the power companies will need to make to decide the best mix of networking protocols for their particular PMU deployments, since that requires significant assumptions about proprietary information including deployment cost, deployment schedules, PMU locations, and available resources.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Shewregdb: Database and visualization environment for experimental and predicted regulatory information in Shewanella oneidensis mr-1

Shewanella oneidensis MR-1 is an important model organism for environmental research as it has an exceptional metabolic and respiratory versatility regulated by a complex regulatory network. We have developed a database to collect experimental and computational data relating to regulation of gene and protein expression and a visualization environment that enables integration of these data types. The regulatory information in the database was collected from the published literature and different Internet resources. It includes predictions of DNA regulator binding sites, sigma factor binding sites, transcription units, operons, promoters, and RNA regulators including non-coding RNAs, riboswitches, and different types of terminators. A visualization environment based on GBrowser was developed for accessing the collected information and for its overlaying with experimental data (experimental results from studies employing microarrays, proteomics, and/or gene mutagenesis) and other genome annotations.

Data Integration↗