Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA NETWORKS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

In Situ Indexing and Query Processing of AMR Data

We have developed the first, holistic, Adaptive Mesh Refinement (AMR) capable, in situ query framework to ensure the tractability of the current- and next-generation AMR simulation analysis on the path to extreme scale. We have addressed key issues pertaining to in situ analysis, memory hierarchy, generalized parallel indexing, index-compression, and real-time access pattern detection. We have published the following research papers in high profile peer reviewed computer science conferences: (a) Parallel In Situ Detection of Connected Components in Adaptive Mesh Refinement Data; (b) AMR-aware In Situ Indexing and Scalable Querying; (c) Pattern-driven dynamic data layout optimization; (d) In situ Storage Layout Optimization for AMR Spatio-temporal Read Accesses; (e) AMRZone: A Runtime AMR Data Sharing Framework for Scientific Applications; (f) Exploring Memory Hierarchy and Network Topology for Runtime AMR Data Sharing Across Scientific Applications.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

The Advanced Global Atmospheric Gases Experiment (AGAGE) Data

In the ALE/GAGE/AGAGE global network program, continuous high frequency gas chromatographic measurements of four biogenic/anthropogenic gases (methane, CH4; nitrous oxide, N2O; hydrogen, H2; and carbon monoxide, CO) and several anthropogenic gases that contribute to stratospheric ozone destruction and/or to the greenhouse effect have been carried out at five globally distributed sites for several years. The program, which began in 1978, is divided into three parts associated with three changes in instrumentation: the Atmospheric Lifetime Experiment (ALE), which used Hewlett Packard HP5840 gas chromatographs; the Global Atmospheric Gases Experiment (GAGE), which used HP5880 gas chromatographs; and the present Advanced GAGE (AGAGE). AGAGE uses two types of instruments: a gas chromatograph with multiple detectors (GC-MD), and a gas chromatograph with mass spectrometric analysis (GC-MS). Beginning in January 2004, an improved cryogenic preconcentration system (Medusa) replaced the absorption-desorption module in the GC-MS systems at Mace Head and Cape Grim; this provided improved capability to measure a broader range of volatile perfluorocarbons with high global warming potentials. The Medusa GC-MS systems were subsequently used at other AGAGE stations (Trinidad Head, Barbados, American Samoa, Zeppelin, Jungfraujoch, and Goan) after the initial setup at Mace Head and Cape Grim. More information may be found at the AGAGE home page: https://agage.mit.edu/instruments.Compared to the previous version (https://data.ess-dive.lbl.gov/datasets/doi: doi:10.15485/1781803), the latest update (Agage_gcmd_gcms.data.2022_01_03.tar.gz) includes 6 months of new data through the end of September 2020. For a complete list of released compounds and used standard scales, please see “AGAGE_scale_2021_v1.pdf” file. Additional information can also be found on the AGAGE website (https://agage.mit.edu).

54 ENVIRONMENTAL SCIENCES↗

Material transfers detection with seismic observations

We are exploring the use of data from a seismic network around a research nuclear reactor and isotope production facility at Oak Ridge National Laboratory to study activity patterns related to the transfer of nuclear material. A sensor network with eight seismometers was installed around the High Flux Isotope Reactor and the Radiochemical Engineering Development Center and started operating in October 2019. These data are used to detect and characterize operational events around facility. We are using those data to extract signals related to the movement of vehicles involved in the transport of nuclear materials (e.g., transportation of reactor fuel, targets, and product isotopes). Large vehicles produce mechanical energy that can be observed as seismic signals, either as the result of sound emanating from the vehicle engine or by the generation of surface waves as a response of the ground to the load of the vehicles. In particular, the station located near the entrance gate of the facility displays a clear seismic signature as vehicles cross a metal platform on the ground. This signal is characterized by sharp energy bursts that correspond to the number of axles on the vehicle. We developed and are testing an algorithm to identify sequences of energy bursts to count and characterize vehicles of different sizes. We are also exploring the use of seismic polarization analysis to measure the degree of polarization of the observed signals. These two techniques for detection and characterization of vehicles used for nuclear material transfers will be validated with seismic data from a targeted collection using different vehicles and routes similar to the ones used in real-life scenarios at the High Flux Isotope Reactor.

Marcillo, Omar↗

CHROMOSPHERIC MASS MOTIONS AND INTRINSIC SUNSPOT ROTATIONS FOR NOAA ACTIVE REGIONS 10484, 10486, AND 10488 USING ISOON DATA

This work utilizes Improved Solar Observing Optical Network continuum (630.2 nm) and H{alpha} (656.2 nm) data to: (1) detect and measure intrinsic sunspot rotations occurring in the photosphere and chromosphere, (2) identify and measure chromospheric filament mass motions, and (3) assess any large-scale photospheric and chromospheric mass couplings. Significant results from 2003 October 27-29, using the techniques of Brown et al., indicate significant counter-rotation between the two large sunspots in NOAA AR 10486 on October 29, as well as discrete filament mass motions in NOAA AR 10484 on October 27 that appear to be associated with at least one C-class solar flare.

79 ASTRONOMY AND ASTROPHYSICS↗

Measuring semantic similarities by combining gene ontology annotations and gene co-function networks

Background: Gene Ontology (GO) has been used widely to study functional relationships between genes. The current semantic similarity measures rely only on GO annotations and GO structure. This limits the power of GO-based similarity because of the limited proportion of genes that are annotated to GO in most organisms. Results: We introduce a novel approach called NETSIM (network-based similarity measure) that incorporates information from gene co-function networks in addition to using the GO structure and annotations. Using metabolic reaction maps of yeast, Arabidopsis, and human, we demonstrate that NETSIM can improve the accuracy of GO term similarities. We also demonstrate that NETSIM works well even for genomes with sparser gene annotation data. We applied NETSIM on large Arabidopsis gene families such as cytochrome P450 monooxygenases to group the members functionally and show that this grouping could facilitate functional characterization of genes in these families. Conclusions: Using NETSIM as an example, we demonstrated that the performance of a semantic similarity measure could be significantly improved after incorporating genome-specific information. NETSIM incorporates both GO annotations and gene co-function network data as a priori knowledge in the model. Therefore, functional similarities of GO terms that are not explicitly encoded in GO but are relevant in a taxon-specific manner become measurable when GO annotations are limited.

59 BASIC BIOLOGICAL SCIENCES↗

Neural Network Export Package (nexport) v0.1.0

nexport is a lightweight python 3 package which enables neural network developers to export the weights and biases of trained networks to useful file types. It provides I/O support for applications which require specific data types for instantiating neural networks in various inference environments. It was initially developed to support exporting to the data structure used by 'inference-engine', a Fortran inference package.

Welsman, Jordan↗

Network Intrusion Detection and Visualization using Aggregations in a Cyber Security Data Warehouse

The challenge of achieving situational understanding is a limiting factor in effective, timely, and adaptive cyber-security analysis. Anomaly detection fills a critical role in network assessment and trend analysis, both of which underlie the establishment of comprehensive situational understanding. To that end, we propose a cyber security data warehouse implemented as a hierarchical graph of aggregations that captures anomalies at multiple scales. Each node of our pro-posed graph is a summarization table of cyber event aggregations, and the edges are aggregation operators. The cyber security data warehouse enables domain experts to quickly traverse a multi-scale aggregation space systematically. We describe the architecture of a test bed system and a summary of results on the IEEE VAST 2012 Cyber Forensics data.

anomaly detection↗

FedCSpc: A Cross-Silo Federated Learning System With Error-Bounded Lossy Parameter Compression

Cross-Silo federated learning is widely used for scaling deep neural network (DNN) training over data silos from different locations worldwide while guaranteeing data privacy. Communication has been identified as the main bottleneck when training large-scale models due to large-volume model parameters and gradient transmission across public networks with limited bandwidth. Most previous works focus on gradient compression, while limited work tries to compress parameters that can not be ignored and extremely affect communication performance during the training. Here, to bridge this gap, we propose FedCSpc: an efficient cross-silo federated learning system with an XAI-driven adaptive parameter compression strategy for large-scale model training. Our work substantially differs from existing gradient compression techniques due to the distinct data features of gradient and parameter. The key contributions of this paper are fourfold. (1) Our designed FedCSpc proposes to compress the parameter during the training using the state-of-the-art error-bounded lossy compressor – SZ3. (2) We develop an adaptive compression error bound adjustment algorithm to guarantee the model accuracy effectively. (3) We exploit an efficient approach to utilize the idle CPU resources of clients to compress the parameters. (4) We perform a comprehensive evaluation with a wide range of models and benchmarks on a GPU cluster with 65 GPUs. Results show that FedCSpc can achieve the same model accuracy as FedAvg while reducing the data volume of parameters and gradients in communication by up to 7.39× and 288×, respectively. With 32 clients on a 4 Gb size model, FedCSpc significantly outperforms FedAvg in wall-clock time in the emulated WAN environment (at the bandwidth of 1 Gbps or lower without loss of generality).

SZ3↗

PolyODENet

Kinetics of a reaction network that follows mass-action rate laws can be described with a system of ordinary differential equations (ODEs) with polynomial right-hand side. However, it is challenging to derive such kinetic differential equations from transient kinetic data without knowing the reaction network, especially when the data are incomplete due to experimental limitations. We introduce a program, PolyODENet, toward this goal. Based on the machine-learning method Neural ODE, PolyODENet defines a generative model and predicts concentrations at arbitrary time. As such, it is possible to include unmeasurable intermediate species in the kinetic equations. Importantly, we have implemented various measures to apply physical constraints and chemical knowledge in the training to regularize the solution space.

Wu, Qin [Brookhaven National Lab. (BNL), Upton, NY↗

Mappymatch FKA: YAMM (Yet Another Map-Matcher) [SWR 22-38]

A surprisingly non-trivial technical challenge is to associate points in space (e.g., GPS data) with specific segments of a road network or map. The software package ( allows users to match GPS point data to a road network (commonly known as "map matching"). The software is designed such that a user could match a set of GPS points to a variety of different road network representations using a variety of map matching algorithms. There are currently several "built-in" road networks and map matching algorithms but the software has been designed to enable new ones to be added with minimal overhead.

Reinicke, Nicholas↗

Decentralized Signal Processing and Distributed Control of Collaborative Autonomous Networks (17-ERD-101 LDRD Final Report)

Intelligent autonomous sensor networks, often comprised of large numbers of sensors, must be capable of jointly exploiting data collected at each agent in the network, and using that data to optimize their future actions towards multiple mission objectives. Centralized signal processing and optimization solutions process all data and determine all future actions at a single agent, and the resulting information and commands are disseminated back to the network. The communications bandwidth this requires and the single point of failure the central agent represents often make these solutions untenable for national security applications. In this project, several fundamental algorithms for solving both the decentralized signal processing and network optimization were developed, as well as simulation software to validate the results of these algorithms at scale. Specifically, novel algorithms for Bayesian decentralized estimation and decentralized detection and optimization based on the alternating direction method of multipliers (ADMM) were developed for autonomous sensor networks and published in the literature. The first large scale simulation of autonomous sensor networks (1000 agents) was conducted on this project, validating the performance of the developed algorithms. These algorithms and simulation tools are critical components of any decentralized autonomous network and have current and future national security applications, including distributed sensor networks for detection, estimation, and tracking problems, and large decentralized cyber-physical infrastructure such as the power grid.

42 ENGINEERING↗

Atmospheric pressure changes in the Arctic from 1801 to 1920

In this article, the results of an investigation into the atmospheric pressure conditions in the Arctic in the period from 1801 to 1920 are presented. For this period, which can be described as ‘early instrumental’, limited meteorological data exist from a network of regular stations. As a result, in order to get at least a rough idea of pressure conditions in the Arctic in the study period, data from different land and marine expeditions were collected. A total of 94 pressure series of monthly means have been gathered, the duration of which is usually less than 2 years. While the area and time periods covered by the data are variable, it is still possible to describe the general character of the pressure conditions. The results show that the areally averaged Arctic pressure in the early instrumental period (1861–1920) was 0.8 hPa lower than today (1961–1990). Lower values of atmospheric pressure were also observed in all study regions, excluding the Atlantic. The greatest negative differences (-2.1 hPa) have been found for the Canadian Arctic. The greatest changes between the historical and present times were noted in all winter months and in winter as a whole (-1.9 hPa), while in summer and autumn they were very small and their average differences came to - 0.1 and - 0.2 hPa, respectively. Comparison of historical and contemporary annual courses of atmospheric pressure in the whole of the Arctic and in its particular regions reveals general consonance. There is evidence to show that changes in Arctic atmospheric pressure during the whole study period were insignificant. Atmospheric pressure in the first International Polar Year (IPY) period (September 1882 to July 1883) was, on average, 1.4 hPa higher than in modern period (1961–1990). The greatest positive seasonal differences between historical and contemporary pressure values occurred in autumn (2.6 hPa), while the lowest were in winter (only 0.2 hPa). Spatial patterns of average annual and seasonal atmospheric pressure in the Arctic were very similar to present day ones. The pressure differences calculated between historical and modern mean monthly values show that almost all of them lie within one standard deviation from present long-term mean (1961–1990). Thus, this means that the atmospheric pressure in the early instrumental period was not significantly different to that of the present day. Recent, commonly used gridded datasets of the sea level atmospheric pressure (HadSLP2 and the 20th Century Reanalysis Project) reveal quite a large positive bias in the period 1850–1920 in comparison to the real data from the instrumental observations. Copyright © 2012 Royal Meteorological Society

Meteorology & Atmospheric Sciences↗

Language-Theoretic Data Analysis to Support ICS Protocol Baselining

Critical infrastructure stakeholders need to baseline their systems to understand expected protocol communications. Baseline behaviors may vary based on operational context. Expected operations during a maintenance window, for example, may be different from normal operations. Furthermore, constructing system baselines for Industrial Control Systems (ICS) is difficult and time-consuming. ICS processes generate artifacts expressed across heterogeneous data sources such as network traffic and device logs. This paper explores the hypothesis that such ICS artifacts form a language in the language-theoretic sense. From a theoretical perspective, the variety of implementations of ICS protocols and constrained environment of OT networks provide a rich application domain for language-theoretic approaches. We present several use cases related to the practical construction of system baselines: grammars for data fusion, language dialects for device fingerprinting, and security automata for system baselining

24 POWER TRANSMISSION AND DISTRIBUTION↗

Transcriptome-driven integrative exploration of functional state of ureter tissue affected by CAKUT

Aims: (1) to identify the most dysregulated genes in ureter tissue affected by congenital anomalies of the kidney and urinary tract (CAKUT) and to extract the biological meaning of these markers; (2) to describe the key molecular networks in CAKUT and to provide expression validation of the genes selected from these networks. Main methods: Transcriptome data was obtained from ureter samples of CAKUT patients and controls by Illumina iScan microarray. Identification of differentially expressed genes was coupled with subsequent bioinformatics analyses. Expression of candidate genes was validated by qRT-PCR. Key findings: Analysis of the transcriptome led to the identification of 78 commonly dysregulated genes in CAKUT tissue compared to controls. Integrative bioinformatic analyses of differentially expressed genes identified 7 major networks. The targets for qRT-PCR validation were selected as members of the major molecular networks in CAKUT, which had both, the significant high fold change and biological relevance for CAKUT. By qRT-PCR the substantial increase of LCN2, PROM1, SOSTDC1, and decrease of INA, RASD1 and TAC3 mRNA levels was confirmed. Significance: Since CAKUT is a leading cause of end-stage renal disease in children, the search for molecular targets for postnatal therapy is of particular interest. Data described in this study represents the gene expression profile and significant molecular networks specific to human ureter affected by CAKUT. The discovery of impaired molecular factors and processes is the step towards the uncovering of the key mechanisms that reflect CAKUT postnatally and could lead to the affected tissue deterioration and end organ damage. © 2018 Elsevier Inc.

60 APPLIED LIFE SCIENCES↗

On Data Transfers Over Wide-Area Dedicated Connections

Dedicated wide-area network connections are employed in big data and high-performance computing scenarios, since the absence of cross-traffic promises to make it easier to analyze and optimize data transfers over them. However, nonlinear transport dynamics and end-system complexity due to multi-core hosts and distributed file systems make these tasks surprisingly challenging. We present an overview of methods to analyze memory and disk file transfers using extensive measurements over 10 Gbps physical and emulated connections with 0–366 ms round trip times (RTTs). For memory transfers, we derive performance profiles of TCP and UDT throughput as a function of RTT, which show concave regions in contrast to entirely convex regions predicted by previous models. These highly desirable concave regions can be expanded by utilizing large buffers and more parallel flows. We also present Poincar´e maps and Lyapunov exponents of TCP and UDT throughputtraces that indicate complex throughput dynamics. For disk file transfers, we show that throughput can be optimized using a combination of parallel I/O and network threads under direct I/O mode. Our initial throughput measurements of Lustre filesystems mounted over long-haul connections using LNet routers show convex profiles indicative of I/O limits.

Rao, Nageswara S.↗

The Effects of a Dynamic Spectrum Access Overlay in LTE-Advanced Networks

As early as 2014, wireless network operators spectral capacity will be overwhelmed by a data tsunami brought on by new devices and applications. To augment spectral capacity, operators could deploy a Dynamic Spectrum Access (DSA) overlay. In the light of the many planned Long Term Evolution (LTE) network deployments, the affects of a DSA overlay have not been fully considered into the existing LTE standards. Coalescing many different aspects of DSA, this paper develops the Spectrum Accountability (SA) framework. The SA framework defines specific network element functionality, protocol interfaces, and signaling flow diagrams for LTE to support service requests and enforce rights of responsibilities of primary and secondary users, respectively. We also include a network simulation to quantify the benefits of using DSA channels to augment capacity. Based on our simulation we show that, network operators can benefit up to %40 increase in operating capacity when sharing DSA bands to augment spectral capacity. With our framework, this paper could serve as an guide in developing future LTE network standards that include DSA.

42 ENGINEERING↗

Transferable predictions of energetic and structural properties for refractory solid solution alloys across chemical compositions

We present a data-efficient approach to train graph neural networks (GNNs) on density functional theory (DFT) data for accurate and transferable predictions of energetic and structural properties of refractory solid solution alloys in the niobium-tantalum-vanadium (Nb-Ta-V) chemical space. We start by training the GNN model only on DFT data that describes refractory binary alloys niobium-tantalum (Nb-Ta), niobium-vanadium (Nb-V), and tantalum-vanadium (Ta-V) to predict formation enthalpy and root mean squared displacement. Once trained, the GNN predictions are tested on DFT data describing refractory ternary alloys Nb-Ta-V. While, unsurprisingly, direct transferability from binary to ternary is not sufficiently accurate, augmenting the training with only 1% of the available ternary data (uniformly distributed across the entire range of chemical compositions) improves significantly the quality of the GNN predictions. For comparison, we assess the transferability in the opposite direction by training GNN models on ternary Nb-Ta-V data and making predictions on binaries Nb-Ta, Nb-V, and Ta-V, which exhibits notably higher predictive errors. The proposed methodology, which favors transferability from lower-component to higher-component alloys, offers an efficient path towards avoiding the curse of dimensionality incurred when collecting DFT data for discovery and design of multi-component disordered alloys.

Density functional theory calculations↗

The Colorado East River Community Observatory Data Collection

Abstract The U.S. Department of Energy's (DOE) Colorado East River Community Observatory (ER) in the Upper Colorado River Basin was established in 2015 as a representative mountainous, snow‐dominated watershed to study hydrobiogeochemical responses to hydrological perturbations in headwater systems. The ER is characterized by steep elevation, geologic, hydrologic and vegetation gradients along floodplain, montane, subalpine, and alpine life zones, which makes it an ideal location for researchers to understand how different mountain subsystems contribute to overall watershed behaviour. The ER has both long‐term and spatially‐extensive observations and experimental campaigns carried out by the Watershed Function Scientific Focus Area (SFA), led by Lawrence Berkeley National Laboratory, and researchers from over 30 organizations who conduct cross‐disciplinary process‐based investigations and modelling of watershed behaviour. The heterogeneous data generated at the ER include hydrological, genomic, biogeochemical, climate, vegetation, geological, and remote sensing data, which combined with model inputs and outputs comprise a collection of datasets and value‐added products within a mountainous watershed that span multiple spatiotemporal scales, compartments, and life zones. Within 5 years of collection, these datasets have revealed insights into numerous aspects of watershed function such as factors influencing snow accumulation and melt timing, water balance partitioning, and impacts of floodplain biogeochemistry and hillslope ecohydrology on riverine geochemical exports. Data generated by the SFA are managed and curated through its Data Management Framework. The SFA has an open data policy, and over 70 ER datasets are publicly available through relevant data repositories. A public interactive map of data collection sites run by the SFA is available to inform the broader community about SFA field activities. Here, we describe the ER and the SFA measurement network, present the public data collection generated by the SFA and partner institutions, and highlight the value of collecting multidisciplinary multiscale measurements in representative catchment observatories.

54 ENVIRONMENTAL SCIENCES↗