Search NASA⌕ Search

SEARCH · Search NASA

Results for “Complex Network Data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

SAIL-Net CloudPuck CCN Data

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleations particles (INP). This network enables the investigation of small-scale variations in complex terrain. This specific dataset provides the cleaned data recorded from the CloudPuck, an in house instrument made by Handix Scientific that counts CCN concentrations. The CloudPuck was deployed at the sites for the summer/fall of 2022 before winter conditions were too harsh to maintain the instrument. For more information on the the CloudPuck or how the raw data are processed, see the read me.

54 ENVIRONMENTAL SCIENCES↗

Reverse Engineering Adverse Outcome Pathways

The toxicological effects of many stressors are mediated through unknown, or poorly characterized, mechanisms of action. We describe the application of reverse engineering complex interaction networks from high dimensional omics data (gene, protein, metabolic, signaling) to characterize adverse outcome pathways (AOPs) for chemicals that disrupt the hypothalamus-pituitary-gonadal endocrine axis in fathead minnows. Gene expression changes in fathead minnow ovaries in response to 7 different chemicals, over different times, doses, and in vivo versus in vitro conditions were captured in a large data set of 868 arrays. We examined potential AOPs of the antiandrogen flutamide using two mutual information theory methods, ARACNE and CLR to infer gene regulatory networks and potential adverse outcome pathways. Representative networks from these studies were used to predict a network path from stressor to adverse outcome as a candidate AOP. The relationship of individual chemicals to an adverse outcome can be determined by following perturbations through the network in response to chemical treatment leading to the nodes associated with the adverse outcome. Identification of candidate pathways allows for formation of testable hypotheses about key biologic processes, biomarkers or alternative endpoints, which could be used to monitor an adverse outcome pathway. Finally, we identify the unique challenges facing the application of this approach in ecotoxicology, and attempt to provide a road map for the utilization of these tools. Key Words: mechanism of action, toxicology, microarray, network inference

59 BASIC BIOLOGICAL SCIENCES↗

RWRtoolkit: multi-omic network analysis using random walks on multiplex networks in any species

Abstract We introduce RWRtoolkit, a multiplex generation, exploration, and statistical package built for R and command-line users. RWRtoolkit enables the efficient exploration of large and highly complex biological networks generated from custom experimental data and/or from publicly available datasets, and is species agnostic. A range of functions can be used to find topological distances between biological entities, determine relationships within sets of interest, search for topological context around sets of interest, and statistically evaluate the strength of relationships within and between sets. The command-line interface is designed for parallelization on high-performance cluster systems, which enables high-throughput analysis such as permutation testing. Several tools in the package have also been made available for use in reproducible workflows via the KBase web application.

Kainer, David (ORCID:0000000172714676)↗

Robotic tape library system level testing at NSA: Present and planned

In the present of declining Defense budgets, increased pressure has been placed on the DOD to utilize Commercial Off the Shelf (COTS) solutions to incrementally solve a wide variety of our computer processing requirements. With the rapid growth in processing power, significant expansion of high performance networking, and the increased complexity of applications data sets, the requirement for high performance, large capacity, reliable and secure, and most of all affordable robotic tape storage libraries has greatly increased. Additionally, the migration to a heterogeneous, distributed computing environment has further complicated the problem. With today's open system compute servers approaching yesterday's supercomputer capabilities, the need for affordable, reliable secure Mass Storage Systems (MSS) has taken on an ever increasing importance to our processing center's ability to satisfy operational mission requirements. To that end, NSA has established an in-house capability to acquire, test, and evaluate COTS products. Its goal is to qualify a set of COTS MSS libraries, thereby achieving a modicum of standardization for robotic tape libraries which can satisfy our low, medium, and high performance file and volume serving requirements. In addition, NSA has established relations with other Government Agencies to complete this in-house effort and to maximize our research, testing, and evaluation work. While the preponderance of the effort is focused at the high end of the storage ladder, considerable effort will be extended this year and next at the server class or mid range storage systems.

Shields, Michael F.↗

Earth Science System of the Future: Observing, Processing, and Delivering Data Products Directly to Users

Advancement of our predictive capabilities will require new scientific knowledge, improvement of our modeling capabilities, and new observation strategies to generate the complex data sets needed by coupled modeling networks. New observation strategies must support remote sensing from a variety of vantage points and will include "sensorwebs" of small satellites in low Earth orbit, large aperture sensors in Geostationary orbits, and sentinel satellites at L1 and L2 to provide day/night views of the entire globe. Onboard data processing and high speed computing and communications will enable near real-time tailoring and delivery of information products (i.e., predictions) directly to users.

Crisp, David↗

Suite of Comprehensive Rapid Analysis Tools for Estimation (SOCRATES) - 19076

Long-term monitoring and remedy implementation require ongoing assessment and analytics, much of which relies on intensive and time-consuming data integration and engineering, data manipulation, and 'big-data' analytics. Many of these analyses, such as groundwater flow direction, contaminant rate attenuation, and non-parametric statistics, are spatial-temporal in nature and involve coalescing disparate data sets from a variety of sources with measurement frequencies from milliseconds to years, as well as total data volumes often exceeding the petabyte scale. Web-based analytical tools are advantageous for ongoing real-time or near-real-time ingestion of data from various sources for general data access and visualization, and also allow for complex, data rich calculations by leveraging expansive networks and virtually unlimited compute power. A web-based framework offers a natural architecture for such endeavors, as access to compute nodes through auto-scaling and dynamic frameworks enables speedy data manipulation and unlimited access to any data set that is made available via an http request. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Computationally efficient Bayesian estimation of graphical networks for omics data

Graphical networks are useful, widely-used modeling approaches to represent complex biological processes with biological measurements generated by platforms such as mass spectrometry. Bayesian analyses of graphical networks for omics data have several advantages over their frequentist counterparts, such as the inclusion of prior knowledge in the estimation of models. However, Bayesian approaches to date have only been feasible for data with a couple hundred biomolecules due to prohibitive computational time, but omics data often contains tens of thousands of biomolecules. Here, we present and illustrate a more computationally efficient approach named BPlane (Bayesian PseudoLikelihood-based Algorithm for Network Estimation) to extend Bayesian modeling capabilities for larger-sized datasets, such as most untargeted proteomics data. Via simulation, we demonstrate that BPlane produces substantial computational savings over a current state-of-the-art Bayesian algorithm while maintaining competitive edge detection accuracy. On a SARS-CoV2 proteomics data with 7000 proteins, the competing algorithm takes three times as long to complete the first iteration as BPlane takes to converge after over 100 iterations.

EM algorithm↗

FlbB forms a distinctive ring essential for periplasmic flagellar assembly and motility in Borrelia burgdorferi

Spirochetes are a widespread group of bacteria with a distinct morphology. Some spirochetes are important human pathogens that utilize periplasmic flagella to achieve motility and host infection. The motors that drive the rotation of periplasmic flagella have a unique spirochete-specific feature, termed the collar, crucial for the flat-wave morphology and motility of the Lyme disease spirochete Borrelia burgdorferi. Here, we deploy cryo-electron tomography and subtomogram averaging to determine high-resolution in-situ structures of the B. burgdorferi flagellar motor. Comparative analysis and molecular modeling of in-situ flagellar motor structures from B. burgdorferi mutants lacking each of the known collar proteins (FlcA, FlcB, FlcC, FlbB, and Bb0236/FlcD) uncover a complex protein network at the base of the collar. Importantly, our data suggest that FlbB forms a novel periplasmic ring around the rotor but also acts as a scaffold supporting collar assembly and subsequent recruitment of stator complexes. The complex protein network based on the FlbB ring effectively bridges the rotor and 16 torque-generating stator complexes in each flagellar motor, thus contributing to the specialized motility and lifestyle of spirochetes in complex environments.

59 BASIC BIOLOGICAL SCIENCES↗

Harnessing expert knowledge: Defining a Bayesian network decision model with limited data-Model structure for the vibration qualification problem

As systems become more complex, systems engineers rely on experts to inform decisions. There are few experts and limited data in many complex new technologies. This challenges systems engineers as they strive to plan activities such as qualification in an environment where technical constraints are coupled with the traditional cost, risk, and schedule constraints. Bayesian network (BN) models provide a framework to aid systems engineers in planning qualification efforts with complex constraints by harnessing expert knowledge and incorporating technical factors. By quantifying causal factors, a BN model can provide data about the risk of implementing a decision supplemented with information on driving factors. This allows a systems engineer to make informed decisions and examine “what-if” scenarios. This paper discusses a novel process developed to define a BN model structure based primarily on expert knowledge supplemented with extremely limited data (25 data sets or less). The model was developed to aid qualification decisions—specifically to predict the suitability of six degrees of freedom (6DOF) vibration testing for qualification. The process defined the model structure with expert knowledge in an unbiased manner. Finally, validation during the process execution and of the model provided evidence the process may be an effective tool in harnessing expert knowledge for a BN model.

97 MATHEMATICS AND COMPUTING↗

Prediction of Aerodynamic Coefficient using Genetic Algorithm Optimized Neural Network for Sparse Data

Wind tunnels use scale models to characterize aerodynamic coefficients, Wind tunnel testing can be slow and costly due to high personnel overhead and intensive power utilization. Although manual curve fitting can be done, it is highly efficient to use a neural network to define the complex relationship between variables. Numerical simulation of complex vehicles on the wide range of conditions required for flight simulation requires static and dynamic data. Static data at low Mach numbers and angles of attack may be obtained with simpler Euler codes. Static data of stalled vehicles where zones of flow separation are usually present at higher angles of attack require Navier-Stokes simulations which are costly due to the large processing time required to attain convergence. Preliminary dynamic data may be obtained with simpler methods based on correlations and vortex methods; however, accurate prediction of the dynamic coefficients requires complex and costly numerical simulations. A reliable and fast method of predicting complex aerodynamic coefficients for flight simulation I'S presented using a neural network. The training data for the neural network are derived from numerical simulations and wind-tunnel experiments. The aerodynamic coefficients are modeled as functions of the flow characteristics and the control surfaces of the vehicle. The basic coefficients of lift, drag and pitching moment are expressed as functions of angles of attack and Mach number. The modeled and training aerodynamic coefficients show good agreement. This method shows excellent potential for rapid development of aerodynamic models for flight simulation. Genetic Algorithms (GA) are used to optimize a previously built Artificial Neural Network (ANN) that reliably predicts aerodynamic coefficients. Results indicate that the GA provided an efficient method of optimizing the ANN model to predict aerodynamic coefficients. The reliability of the ANN using the GA includes prediction of aerodynamic coefficients to an accuracy of 110% . In our problem, we would like to get an optimized neural network architecture and minimum data set. This has been accomplished within 500 training cycles of a neural network. After removing training pairs (outliers), the GA has produced much better results. The neural network constructed is a feed forward neural network with a back propagation learning mechanism. The main goal has been to free the network design process from constraints of human biases, and to discover better forms of neural network architectures. The automation of the network architecture search by genetic algorithms seems to have been the best way to achieve this goal.

Rajkumar, T.↗

SAIL-Net Raw and Post Corrected POPS Data Fall 2021 - Summer 2023

SAIL-Net is a DOE funded project in the East River Watershed near Crested Butte, Colorado with the goal of advancing our understanding of aerosol-cloud interactions in complex, mountainous regions. Through the deployment of a network of six low cost microphysics nodes in Fall 2021 in the same domain at the SAIL campaign, SAIL-Net provides data on aerosol size distributions, cloud condensation nuclei (CCN), and ice nucleation particles (INP). This network enables the investigation of small-scale variations in complex terrain. Two datasets are provided - one containing raw data and the other containing post-corrected data. The raw dataset provides the raw data recorded from the POPS which were deployed at each of the six sites. These data are organized by site and broken down into daily data files. The six site names used here are: “gothic”, “irwin”, “cbtop”, “cbmid”, “pumphouse”, and “snodgrass”. These data are not cleaned or post-corrected, but some flags have been added. The data are reported at 1 second time resolution. The post-corrected dataset provides the post-corrected and cleaned data recorded from the POPS which were deployed at each of the six sites. This data are also organized by site (same as those found in the raw data) and broken down into daily data files. Unlike the raw POPS data, these data have already been cleaned to remove what we believe are bad values. These data should be ready to use with no cleaning. For a full description of the cleaning and post-correction process, see the readme.

54 ENVIRONMENTAL SCIENCES↗

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture resulting in high-dimensional, difficult to interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper we apply cutting edge techniques from TDA with the goal of gaining insight towards interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers and discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight as to how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

topological data analysis, deep learning↗

Single-cell and spatial omics in plants: from cellular atlases to regulatory mechanisms

Single-cell RNA sequencing (scRNA-seq) has transformed transcriptomic studies by enabling gene expression profiling at the resolution of individual cells within and across a broad range of tissue types, revealing cellular heterogeneity that is obscured in bulk tissue transcriptomes. Over the past decade, improvements in microfluidics and library preparation have drastically increased throughput, allowing tens of thousands of cells to be assayed in a single experiment. Although initially developed in animal systems, scRNA-seq has rapidly emerged as a powerful and widely adopted approach in plant biology. Beyond transcriptomics, the integration of single-cell data with chromatin accessibility, proteomics, metabolomics, and spatial omics is enabling a system-level understanding of plant gene regulation and cellular organization. Network-based analytical frameworks further support the reconstruction of gene regulatory networks and the interpretation of complex single-cell data. In this review, we summarize the current technological landscape of plant single-cell studies, discuss key experimental and analytical challenges, and review emerging strategies for validating single-cell discoveries. We also discuss future directions in applying single-cell technologies to woody perennials plants and bioenergy-relevant crops, emphasizing their potential to accelerate the discovery of cell type-specific regulatory mechanisms underlying growth, stress resilience, and biomass production.

Li, Miaomiao [ORNL] (ORCID:0000000321326168)↗

Delay-Throughput Performance of the Deep-Space Ka-band Link

In this paper, performance of a first-in, first-out (FIFO), selective retransmission scheme for the deep-space Ka-band link is presented and compared to the performance of a comparable X-band link. In this analysis, 16 months of water vapor radiometer (WVR) and advanced water vapor radiometer (AWVR) data from the three Deep Space Network (DSN) Communication Complexes (DSCC) were used to emulate weather effects on X-band and Ka-band links from Mars. Mars Reconnaissance Orbiter (MRO) X-band and Ka-band telecommunications parameters were used for spacecraft telecommunications capabilities. One pass per week per complex was selected from MRO's Deep Space Network (DSN) schedule from April 1, 2006 to August 31, 2007 for a total of 207 passes (69 passes per complex) for this analysis. For each pass both X-band and Ka-band links were designed using at most two data rates so that the expected pass capacity would be maximized subject to a minimum availability requirement (MAR). In conjunction with the WVR/AWVR data, elevation profiles of the selected passes and models for the performance of the antennas in the DSN were used to emulate the performance of both links. It was assumed that the retransmission of the data takes place not on the same pass as the original transmission but during subsequent passes. The data collected before a pass was assumed to be a fraction of the expected capacity of the pass as calculated through the link design process. Infinite spacecraft storage was assumed to obtain an upper bound on the spacecraft storage requirement. The independent parameters of this analysis were MAR and the ratio of data collected before a pass to the expected pass capacity. Since the selected passes did not occur at regular intervals, the delay in this analysis was measured in terms of number of passes. The throughput was measured in terms of number of bits received successfully on the ground. The results indicate that reasonable delay performance could be achieved with very high throughput for relatively low MAR values for data collection to expected pass capacity ratio of around 97% for Ka-band. The results indicate that, except for very low average delay requirements, the Ka-band link provides more than twice the throughput of the X-band link for the same amount of power consumed by the spacecraft. In addition, the results indicate that the required storage onboard the spacecraft is not prohibitive and good performance could be achieved by using a buffer size less than three times the maximum amount of data collected before a pass.

Shambayati, Shervin↗

Delay-Throughput Performance the Deep-Space Ka-Band Link

In this paper, performance of a first-in, first-out (FIFO), selective retransmission scheme for the deep-space Ka-band link is presented and compared to the performance of a comparable X-band link. In this analysis, 16 months of water vapor radiometer (WVR) and advanced water vapor radiometer (AWVR) data from the three Deep Space Network (DSN) Communication Complexes (DSCC) were used to emulate weather effects on X-band and Ka-band links from Mars. Mars Reconnaissance Orbiter (MRO) X-band and Ka-band telecommunications parameters were used for spacecraft telecommunications capabilities. One pass per week per complex was selected from MRO's Deep Space Network (DSN) schedule from April 1, 2006 to August 31, 2007 for a total of 207 passes (69 passes per complex) for this analysis. For each pass both X-band and Ka-band links were designed using at most two data rates so that the expected pass capacity would be maximized subject to a minimum availability requirement (MAR). In conjunction with the WVR/AWVR data, elevation profiles of the selected passes and models for the performance of the antennas in the DSN were used to emulate the performance of both links. It was assumed that the retransmission of the data takes place not on the same pass as the original transmission but during subsequent passes. The data collected before a pass was assumed to be a fraction of the expected capacity of the pass as calculated through the link design process. Infinite spacecraft storage was assumed to obtain an upper bound on the spacecraft storage requirement. The independent parameters of this analysis were MAR and the ratio of data collected before a pass to the expected pass capacity. Since the selected passes did not occur at regular intervals, the delay in this analysis was measured in terms of number of passes. The throughput was measured in terms of number of bits received successfully on the ground. The results indicate that reasonable delay performance could be achieved with very high throughput for relatively low MAR values for data collection to expected pass capacity ratio of around 97% for Ka-band. The results indicate that, except for very low average delay requirements, the Ka-band link provides more than twice the throughput of the X-band link for the same amount of power consumed by the spacecraft. In addition, the results indicate that the required storage onboard the spacecraft is not prohibitive and good performance could be achieved by using a buffer size less than three times the maximum amount of data collected before a pass.

Shambayati, Shervin↗

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

As system scales and application complexity grow, managing and processing simulation data has become a significant challenge. While recent approaches based on data staging and in-situ/in-transit data processing are promising, dynamic data volumes and distributions, such as those occurring in AMR-based simulations, make the efficient use of these techniques challenging. In this paper we propose cross-layer adaptations that address these challenges and respond at runtime to dynamic data management requirements. Specifically we explore (1) adaptations of the spatial resolution at which the data is processed, (2) dynamic placement and scheduling of data processing kernels, and (3) dynamic allocation of in-transit resources. We also exploit coordinated approaches that dynamically combine these adaptations at the different layers. We evaluate the performance of our adaptive cross-layer management approach on the Intrepid IBM-BlueGene/P and Titan Cray-XK7 systems using Chombo-based AMR applications, and demonstrate its effectiveness in improving overall time-to-solution and increasing resource efficiency.

Computer Science↗

Benefits and Limits of Phasing Alleles for Network Inference of Allopolyploid Complexes

Abstract Accurately reconstructing the reticulate histories of polyploids remains a central challenge for understanding plant evolution. Although phylogenetic networks can provide insights into relationships among polyploid lineages, inferring networks may be hindered by the complexities of homology determination in polyploid taxa. We use simulations to show that phasing alleles from allopolyploid individuals can improve phylogenetic network inference under the multispecies coalescent by obtaining the true network with fewer loci compared with haplotype consensus sequences or sequences with heterozygous bases represented as ambiguity codes. Phased allelic data can also improve divergence time estimates for networks, which is helpful for evaluating allopolyploid speciation hypotheses and proposing mechanisms of speciation. To achieve these outcomes in empirical data, we present a novel pipeline that leverages a recently developed phasing algorithm to reliably phase alleles from polyploids. This pipeline is especially appropriate for target enrichment data, where the depth of coverage is typically high enough to phase entire loci. We provide an empirical example in the North American Dryopteris fern complex that demonstrates insights from phased data as well as the challenges of network inference. We establish that our pipeline (PATÉ: Phased Alleles from Target Enrichment data) is capable of recovering a high proportion of phased loci from both diploids and polyploids. These data may improve network estimates compared with using haplotype consensus assemblies by accurately inferring the direction of gene flow, but statistical nonidentifiability of phylogenetic networks poses a barrier to inferring the evolutionary history of reticulate complexes.

Evolutionary Biology↗

Deep Cellular Recurrent Network for Efficient Analysis of Time-Series Data With Spatial Information

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high dimensional data. Deep recurrent neural networks have shown promise in automated feature learning for improved time-series processing. However, generic deep recurrent models grow in scale and depth with increased complexity of the data. This is particularly challenging in presence of high dimensional data with temporal and spatial characteristics. Consequently, this work proposes a novel deep cellular recurrent neural network (DCRNN) architecture to efficiently process complex multi-dimensional time series data with spatial information. Here, the cellular recurrent architecture in the proposed model allows for location-aware synchronous processing of time series data from spatially distributed sensor signal sources. Extensive trainable parameter sharing due to cellularity in the proposed architecture ensures efficiency in the use of recurrent processing units with high-dimensional inputs. This study also investigates the versatility of the proposed DCRNN model for classification of multi-class time series data from different application domains. Consequently, the proposed DCRNN architecture is evaluated using two time-series datasets: a multichannel scalp EEG dataset for seizure detection, and a machine fault detection dataset obtained in-house. The results suggest that the proposed architecture achieves state-of-the-art performance while utilizing substantially less trainable parameters when compared to comparable methods in the literature.

60 APPLIED LIFE SCIENCES↗