Search NASA⌕ Search

SEARCH · Search NASA

Results for “Elephant flows”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Systems and methods for fast detection of elephant flows in network traffic

In a system for efficiently detecting large/elephant flows in a network, the rate at which the received packets are sampled is adjusted according to a top flow detection likelihood computed for a cache of flows identified in the arriving network traffic. After observing packets sampled from the network, Dirichlet-Categorical inference is employed to calculate a posterior distribution that captures uncertainty about the sizes of each flow, yielding a top flow detection likelihood. The posterior distribution is used to find the most likely subset of elephant flows. The technique rapidly converges to the optimal sampling rate at a speed O(1/n), where n is the number of packet samples received, and the only hyperparameter required is the targeted detection likelihood.

Gudibanda, Aditya↗

Streaming Solutions for Fine-Grained Network Traffic Measurements and Analysis

Online network traffic measurements and analysis is critical for detecting and preventing any real-time anomalies in the network. We propose, implement, and evaluate an online, adaptive measurement platform, which utilizes real-time traffic analysis results to refine subsequent traffic measurements. Central to our solution is the concept of Multi-Resolution Tiling (MRT), a heuristic approach that performs sequential analysis of traffic data to zoom into traffic subregions of interest. However, MRT is sensitive to transient traffic spikes. In this paper, we propose three novel traffic streaming algorithms that overcome the limitations of MRT and can cater to varying degrees of computational and storage budgets, detection latency, and accuracy of query response. We evaluate our streaming algorithms on a highly parallel and programmable hardware as well as a traditional software-based platforms. The algorithms demonstrate significant accuracy improvement over MRT in detecting anomalies consisting of synthetic hard-to-track elephant flows and global icebergs. Our proposed algorithms maintain the worst-case complexities of the MRT while incurring only a moderate increase in average resource utilization.

97 MATHEMATICS AND COMPUTING↗

Adaptive Protection of Scientific Backbone Networks Using Machine Learning

In this article, we propose a new protection scheme for backbone networks to guarantee high service availability. The presented scheme does not require any reconfiguration immediately after the failure (i.e., it is proactive). At the same time, it does not require any reserved backup network resources either. To achieve these seemingly contradictory goals, we utilize the recent advancements in Machine Learning (ML) to implement a network intelligence that periodically re-allocates the unused capacity as protection bandwidth to meet the service availability requirements of each connection. Our goal is achieved by two components (1) predicting the traffic for the next period on each link, and (2) intelligently selecting the best fit dedicated protection scheme for the next period depending on the estimated unused (spare) bandwidth and the previous service availability violations. Note that re-allocating protection bandwidth affects neither the operational connections nor the current best practice of operators to over-provision network bandwidth to support elephant flows. Finally, we provide a case study on the real traffic from Energy Sciences Network (ESnet), a high-speed, international scientific backbone network. The key benefit of our framework is that adaptively utilizing the over-provisioned bandwidth for spare capacity is sufficient to improve the availability from three-nines to five-nines (in ESnet for the 30 examined connections). The drawback is negligible bandwidth limitations; the user perceives a minor and very temporal bandwidth limitation in less than 0.1% of the time.

42 ENGINEERING↗

Final Technical Report for Terabit-scale hybrid networking project.

This report describes our accomplishments and activities for the project titled Terabit-Scale Hybrid Networking. The key accomplishment is that we developed, tested and deployed an Alpha Flow Characterization System (AFCS) in ESnet. It is being run in production mode since Sept. 2015. Also, a new QoS class was added to ESnet5 to support alpha flows.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

A Network Management System for Handling Scientific Data Flows

Large scientific data transfers often occur at high rates causing increased burstiness in Internet traffic. To limit the adverse effects of these high-rate large-sized flows, which are referred to as $\alpha $ flows, on delay-sensitive audio/video flows, a network management system called Alpha Flow Traffic Engineering System (AFTES) is proposed for intra-domain traffic engineering. An offline approach is used in which AFTES analyzes NetFlow records collected by routers, extracts source–destination address prefixes of $\alpha $ flows, and uses these prefixes to configure firewall filters at ingress routers of a provider’s network to redirect future $\alpha $ flows to traffic-engineered paths and isolated queues. The effectiveness of this scheme was evaluated through an analysis of 7 months of NetFlow data obtained from an ESnet router. For this data set, 91 % of bytes generated by $\alpha $ flows during high-rate intervals would have been directed had AFTES been deployed. The negative aspect of using address prefixes in firewall filters, i.e., the redirection of $\beta $ flows to $\alpha $-flow paths/queues, was also quantified.

97 MATHEMATICS AND COMPUTING↗

Indira: intent-based networking and rendering for networks (Indira) v1

Intelligent Network Deployment Intent Renderer Application an interactive network assistant that will help us configure a data path between two scientific end-point groups (EPGs) to optimize the transfer of elephant data flows. This tool is able to talk to scientists gather network requirements and then convert to network programming code and automate the end-to-end provisioning.

Pouyoul, Eric↗

Shape-shifting Elephants: Multi-modal Transport for Integrated Research Infrastructure

Data Acquisition (DAQ) workloads form an important class of scientific network traffic that by its nature (1) flows across different research infrastructure, including remote instruments and supercomputer clusters, (2) has ever-increasing throughput demands, and (3) has ever-increasing integration demands---for example, observations at one instrument could trigger a reconfiguration of another instrument. Today's DAQ transfers rely on UDP and (heavily tuned) TCP, but this is driven by convenience rather than suitability. The mismatch between Internet transport protocols and scientific workloads becomes more stark with the steady increase in link capacities, data generation, and integration across research infrastructure.This position paper argues the importance of developing specialized transport protocols for DAQ workloads. It proposes a new transport feature for this kind of elephant flow: multi-modality involves the network actively configuring the transport protocol to change how DAQ flows are processed across different underlying networks that connect scientific research infrastructure. Multi-modality is a layering violation that is proposed as a pragmatic technique for DAQ transport protocol design. It takes advantage of programmable network hardware that is increasingly being deployed in scientific research infrastructure. The paper presents an initial evaluation through a pilot study that includes a Tofino2 switch and Alveo FPGA cards, and using data from a particle detector.

97 MATHEMATICS AND COMPUTING↗

Redshift space power spectrum beyond Einstein-de Sitter kernels

Abstract We develop a framework to compute the redshift space power spectrum (PS), with kernels beyond Einstein-de Sitter (EdS), that can be applied to a wide variety of generalized cosmologies. We build upon a formalism that was recently employed for standard cosmology in Chen, Vlah & White (2020), and utilize an expansion of the density-weighted velocity moment generating function that explicitly separates the magnitude of the k-modes and their angle to the line-of-sight direction dependencies. We compute the PS for matter and biased tracers to 1-loop Perturbation Theory (PT) and show that the expansion has a correct infrared and ultraviolet behavior, free of unwanted divergences. We also add Effective Field Theory (EFT) counterterms, necessary to account for small-scale contributions to PT, and employ an IR-resummation prescription to properly model the smearing of the BAO due to large scale bulk flows within Standard-PT. To demonstrate the applicability of our formalism, we apply it on the ΛCDM and the Hu-Sawicki f(R) models, and compare our numerical results against the elephant suite of N-body simulations, finding very good agreement up to k = 0.27 Mpc -1 h at z = 0.5 for the first three non-vanishing Legendre multipoles of the PS. To our knowledge, the model presented in this work is the most accurate theoretical EFT-PT for modified gravity to date, being the only one that accounts for beyond linear local biasing in redshift-space. Hence, we argue our RSD modeling is a promising tool to construct theoretical templates in order to test deviations from ΛCDM using real data obtained from the next stage of cosmological surveys such as DESI and LSST.

Astronomy & Astrophysics↗

Elephants Sharing the Highway: Studying TCP Fairness in Large Transfers over High Throughput Links

Escalating bandwidth demand strains high-performance data networks, posing potential performance risks. TCP congestion control algorithms enhance reliability and optimize bandwidth usage. Network performance is influenced by factors such as AQM algorithms and router buffer size. In the context of constrained network resources, understanding how TCP flows share networks and the resulting performance impact is essential. This paper introduces insights into TCP fairness and performance involving a comparison of TCP CUBIC, Reno, Hamilton, and BBR versions 1 and 2 across real-world networks supporting high bandwidths of up to 25 Gbps. The research explores TCP behaviors with AQM algorithms like FIFO, FQ_CODEL, and RED, alongside diverse buffer sizes. Notably, findings reveal that manipulating buffers and queuing methods yields contrasting outcomes based on bandwidth. BBRv2 emerges as a superior fair algorithm, pivotal for swift transfers, particularly in scientific data scenarios. These results provide crucial guidance for future network design, ensuring equitable performance optimization.

Kiran, Mariam↗

Petrogenesis of the Elephant Moraine A79001 meteorite Multiple magma pulses on the shergottite parent body

The EETA 79001 achondrite consists of two distinct igneous lithologies joined along a planar, non-brecciated contact. Both are basaltic rocks composed primarily of pigeonite, augite, and maskelynite, but one contains zoned megacrysts of olivine, orthopyroxene, and chromite that represent disaggregated xenoliths of harzburzite. Both lithologies probably formed from successive volcanic flows or multiple injections of magma into a small, shallow chamber. Many similarities between the two virtually synchronous magmas suggest that they are related. Possible mechanisms to explain their differences involve varying degrees of assimilation, fractionation from similar parental magmas, or partial melting of a similar source peridotite; of these, assimilation of the observed megacryst assemblage seems most plausible. However, some isotopic contamination may be required in any of these petrogenetic models. The meteorite has suffered extensive shock metamorphism and localized melting during a large impact event that probably excavated and liberated it from its parent body.

Mcsween, H. Y., Jr.↗

Quantifying Disconnection of Groundwater From Managed‐Ephemeral Surface Water During Drought and Conjunctive Agricultural Use

Abstract The physics of disconnection between interrelated surface and groundwater has evolved considerably in recent years, especially since conjunctive use of water resources is increasingly dependent on groundwater resilience, but methods to measure disconnection on a river basin scale are lacking especially for managed‐ephemeral and irrigated‐agricultural systems. Multiyear drought limited surface water along Rincon Valley within the Elephant Butte Irrigation District (EBID) in the arid, Lower Rio Grande Basin of south‐central New Mexico, USA, and effects were compounded by continued extraction of groundwater to meet crop requirements. Average year‐end water table elevations in recent years have been below the average elevation of the riverbed, indicating potential disconnection between the river and the aquifer even when the river flows during the irrigation season. This study analyzed data from EBID groundwater monitoring wells adjacent to the river, infiltration determined from river flows, and riverbed measurements along the Rincon Valley reach to determine net annual seepage discharge to the aquifer and annual average pressure head below the river. Annual assessment from 2010 to 2017 confirmed that the drought shifted the system from connection to transition and then to disconnection. Nonlinear regression was used to quantify this shift to disconnection and back, enabled determination of several disconnection process metrics, and was also used to confirm that nonlinear disconnection behavior was reversible without significant hysteresis. The method developed herein confirms that the total head difference transition threshold can be determined from river/riparian monitoring sites over reach to basin scales.

Fuchs, Erek H.↗

GALAXY CLUSTER BULK FLOWS AND COLLISION VELOCITIES IN QUMOND

We examine the formation of clusters of galaxies in numerical simulations of a QUMOND cosmogony with massive sterile neutrinos. Clusters formed in these exploratory simulations develop higher velocities than those found in {Lambda}CDM simulations. The bulk motions of clusters attain {approx}1000 km s{sup -1} by low redshift, comparable to observations whereas {Lambda}CDM simulated clusters tend to fall short. Similarly, high pairwise velocities are common in cluster-cluster collisions like the Bullet Cluster. There is also a propensity for the most massive clusters to be larger in QUMOND and to appear earlier than in {Lambda}CDM, potentially providing an explanation for ''pink elephants'' like El Gordo. However, it is not obvious that the cluster mass function can be recovered.

79 ASTRONOMY AND ASTROPHYSICS↗

Final Report of the HyPER Harvester Project

The HyPER Harvester Project resulted in the first full­scale design, fabrication and testing of two vertical­axis harvester prototypes at the Elephant Butte Irrigation District Drop 8 Station in Southern New Mexico. The design, followed by fabrication, and deployment clearly demonstrated the feasibility to manufacture and deploy harvester prototypes at low cost. While several issues common to irrigation canal systems have to be overcome, the electromechanical performance of the integrated turbine­generator system demonstrated proof­of­concept. Proof­of­concept includes 1) feasibility for using additive manufacturing techniques to fabricate Carbon­composite turbine­generator components at low cost, 2) ease of transportation and deployment, and 3) the harvester performance. The benefits of modularity were demonstrated in terms of rapid deployment at the Drop 8 Station. Scalability and adaptability were proven in terms of the custom­fitting characteristics that enabled rapid deployment. While keeping the same shape and form, the harvester can be easily adapted to any drop environment. Self­supporting ability makes the harvester design minimally intrusive on existing structures. There are two technical challenges ahead that have to be addressed. Irregular flow patterns in canal flow induce vertical oscillations due to pressure change across the impeller. Despite the nosecone in conventional Kaplan turbine design that ordinarily dampens oscillations, an effective coupling design is required to eliminate the hydrodynamic effect on the generating system. In arid areas where tumbleweed is present, a robust design to prevent trash entering the drop is required. The compact shape and form have an aesthetic appearance and appear to illustrate an environmentally friendly attribute. The systems­engineered design enables rapid manufacturing and assembly of desired size units that can be deployed at sites along U.S. waterways as small hydropower plants. There is worldwide potential for this technology to provide sustainable hydropower to communities isolated from grid­ supply.

13 HYDRO ENERGY↗