Search NASASearch

SEARCH · Search NASA

Results for “WAN Latency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Use of Open Networks and Delay-Tolerant Protocol to Decrease WAN Latency of EOS near Real-Time Data

Since 1999, NASA's Earth Observing System Data Operations System (EDOS) project at Goddard Space Flight Center (GSFC) has provided high-rate data capture, level zero processing, and product distribution services for a majority of NASA's EOS (Earth Observing System) high-rate missions, including Terra, Aqua, Aura, ICESat, EO-1, SMAP, and OCO-2. EDOS high-rate science and engineering (150-300 Mbps) data-driven capture systems are deployed at 7 worldwide ground stations which are connected via both private (closed) and public (open) wide area networks (WANs) to the centralized EDOS Level Zero Processing Facility (LZPF) located at GSFC, where the data is processed and Level 0 products are distributed to users worldwide. All data transferred over the open networks to GSFC traverse an IPSec tunnel, providing the same level of security as a VPN connection. EDOS produces both time-based and near real-time products (session-based). Near real-time data products are produced from a single ground station contact; time-based products are produced from multiple ground station contacts. EDOS is the primary supplier of EOS Level 0 data to the NASA near real-time user community known as the Land, Atmosphere Near real-time Capability for EOS (LANCE). For the past few years, EDOS has streamlined its systems to reduce WAN latency for near real-time data delivery, including implementing Quality of Service (QoS), expanding closed network bandwidth, adding open network connections with more bandwidth, and implementing a delay-tolerant protocol to mitigate long round-trip times to remote ground stations.

Delay-Tolerant Protocol

The Impact of Traffic Prioritization on Deep Space Network Mission Traffic

A select number of missions supported by NASA's Deep Space Network (DSN) are demanding very high data rates. For example, the Kepler Mission was launched March 7, 2009 and at that time required the highest data rate of any NASA mission, with maximum rates of 4.33 Mb/s being provided via Ka band downlinks. The James Webb Space Telescope will require a maximum 28 Mb/s science downlink data rate also using Ka band links; as of this writing the launch is scheduled for a June 2014 launch. The Lunar Reconnaissance Orbiter, launched June 18, 2009, has demonstrated data rates at 100 Mb/s at lunar-Earth distances using NASA's Near Earth Network (NEN) and K-band. As further advances are made in high data rate space telecommunications, particularly with emerging optical systems, it is expected that large surges in demand on the supporting ground systems will ensue. A performance analysis of the impact of high variance in demand has been conducted using our Multi-mission Advanced Communications Hybrid Environment for Test and Evaluation (MACHETE) simulation tool. A comparison is made regarding the incorporation of Quality of Service (QoS) mechanisms and the resulting ground-to-ground Wide Area Network (WAN) bandwidth necessary to meet latency requirements across different user missions. It is shown that substantial reduction in WAN bandwidth may be realized through QoS techniques when low data rate users with low-latency needs are mixed with high data rate users having delay-tolerant traffic.

prioritization

The Impact of Traffic Prioritization on Deep Space Network Mission Traffic

A select number of missions supported by NASA's Deep Space Network (DSN) are demanding very high data rates. For example, the Kepler Mission was launched March 7, 2009 and at that time required the highest data rate of any NASA mission, with maximum rates of 4.33 Mb/s being provided via Ka band downlinks. The James Webb Space Telescope will require a maximum 28 Mb/s science downlink data rate also using Ka band links; as of this writing the launch is scheduled for a June 2014 launch. The Lunar Reconnaissance Orbiter, launched June 18, 2009, has demonstrated data rates at 100 Mb/s at lunar-Earth distances using NASA's Near Earth Network (NEN) and K-band. As further advances are made in high data rate space telecommunications, particularly with emerging optical systems, it is expected that large surges in demand on the supporting ground systems will ensue. A performance analysis of the impact of high variance in demand has been conducted using our Multi-mission Advanced Communications Hybrid Environment for Test and Evaluation (MACHETE) simulation tool. A comparison is made regarding the incorporation of Quality of Service (QoS) mechanisms and the resulting ground-to-ground Wide Area Network (WAN) bandwidth necessary to meet latency requirements across different user missions. It is shown that substantial reduction in WAN bandwidth may be realized through QoS techniques when low data rate users with low-latency needs are mixed with high data rate users having delay-tolerant traffic.

quality of service

Coarse-Grain Bandwidth Estimation Scheme for Large-Scale Network

A large-scale network that supports a large number of users can have an aggregate data rate of hundreds of Mbps at any time. High-fidelity simulation of a large-scale network might be too complicated and memory-intensive for typical commercial-off-the-shelf (COTS) tools. Unlike a large commercial wide-area-network (WAN) that shares diverse network resources among diverse users and has a complex topology that requires routing mechanism and flow control, the ground communication links of a space network operate under the assumption of a guaranteed dedicated bandwidth allocation between specific sparse endpoints in a star-like topology. This work solved the network design problem of estimating the bandwidths of a ground network architecture option that offer different service classes to meet the latency requirements of different user data types. In this work, a top-down analysis and simulation approach was created to size the bandwidths of a store-and-forward network for a given network topology, a mission traffic scenario, and a set of data types with different latency requirements. These techniques were used to estimate the WAN bandwidths of the ground links for different architecture options of the proposed Integrated Space Communication and Navigation (SCaN) Network. A new analytical approach, called the "leveling scheme," was developed to model the store-and-forward mechanism of the network data flow. The term "leveling" refers to the spreading of data across a longer time horizon without violating the corresponding latency requirement of the data type. Two versions of the leveling scheme were developed: 1. A straightforward version that simply spreads the data of each data type across the time horizon and doesn't take into account the interactions among data types within a pass, or between data types across overlapping passes at a network node, and is inherently sub-optimal. 2. Two-state Markov leveling scheme that takes into account the second order behavior of the store-and-forward mechanism, and the interactions among data types within a pass. The novelty of this approach lies in the modeling of the store-and-forward mechanism of each network node. The term store-and-forward refers to the data traffic regulation technique in which data is sent to an intermediate network node where they are temporarily stored and sent at a later time to the destination node or to another intermediate node. Store-and-forward can be applied to both space-based networks that have intermittent connectivity, and ground-based networks with deterministic connectivity. For groundbased networks, the store-and-forward mechanism is used to regulate the network data flow and link resource utilization such that the user data types can be delivered to their destination nodes without violating their respective latency requirements.

Cheung, Kar-Ming

Coarse-Grain Bandwidth Estimation Techniques for Large-Scale Space Network

In this paper, we describe a top-down analysis and simulation approach to size the bandwidths of a store-andforward network for a given network topology, a mission traffic scenario, and a set of data types with different latency requirements. We use these techniques to estimate the wide area network (WAN) bandwidths of the ground links for different architecture options of the proposed Integrated Space Communication and Navigation (SCaN) Network.

Cheung, Kar-Ming

Newly Available Single Field-of-view Sounder Atmospheric Product (SiFSAP) and Its Derivative Product

The Single Field-of-view Sounder Atmospheric product (SiFSAP) has been developed and delivered to NASA GES DISC. The SiFSAP Algorithm Theoretical Basis Documents (ATBD) and users manuals are ready to be released to public. This novel data product supplements other operational products such as AIRS version 7 and the Community Long-term Infrared Microwave Combined Atmospheric Product System (CLIMCAPS) from two main perspectives: 1) improving the spatial resolution of sounder Level-2 data to extend its usage in weather and dynamics focus area; 2) establishing radiance closure between Level-2 data and directly measured Level-1 radiances to facilitate the climate trend analysis. SiFSAP has 3-times higher spatial resolution and 9-times denser data products comparing to current NASA and NOAA operational IR sounder products. SiFSAP is derived using the optimal estimation method based physical retrieval algorithm. The Principal Component-based Radiative Transfer Model (PCRTM) which includes the cloud scattering simulation is used for the forward model so that the solution can fit the spectral radiances under all-sky conditions for individual single field-of-view (SFOV) measurements. A general introduction of the SiFSAP algorithm and corresponding validation work will be presented. Also introduced here is the Climate Fingerprinting Sounder product (ClimFiSP) that is the derivative product of SiFSAP and will be released in the near future. The ClimFiSP algorithm uses pre-constructed fingerprinting relationship to achieve a low-latency Level-3 data production and facilitate the fusion of data of different sounders.

Wan Wu

EDOS Initiatives to Decrease Latency of NRT Data for LANCE

NASA's EOS Data and Operations System (EDOS) is the primary supplier of NRT (near real-time) data to the NASA NRT user community known as the Land, Atmosphere NRT Capability for EOS (LANCE). EDOS provides NRT data for various instruments on the EOS missions Terra, Aqua, Aura, as well as for the NOAA missions Suomi NPP and NOAA-20. This poster describes an overview of the EDOS multi-mission system with emphasis on the NRT products distributed for LANCE elements: AIRS, MISR, MLS, MODIS, MOPITT, OMPS, OMI and VIIRS. Remote EDOS high-rate data capture systems are deployed at NASA ground stations which provide data-driven capture of high-rate science for EOS missions. The remote EDOS components transfer the science data via high-rate WANs to the centralized EDOS Level-zero processing systems located at Goddard Space Flight Center. EDOS produces session-based data sets especially for LANCE NRT use from a single ground station contact; this data is sent to dual LANCE destinations as part of the standard redundancy requirement for LANCE elements. EDOS has implemented various latency improvements with the ultimate goal to have EDOS processing of NRT data keep up with the spacecraft data downlink. EDOS enhancements have included implementation of priority-based QoS, expanded network architecture to include open networks, and use of a delay-tolerant protocol. EDOS has streamlined its systems and infrastructure to minimize latency for NRT data delivery for LANCE. EDOS begins to transfer the NRT data to the LANCE elements within minutes of the end of the contact session with an average packet latency from instrument observation to Level 0 product delivery to each LANCE element of just over one hour.

Michael, Karen

Development of a High-Fidelity CLARREO Pathfinder Simulator

CLARREO Pathfinder is a hyperspectral instrument designed to resolve reflectance of solar radiation from Earth in the wavelength range of 350 nm to 2300 nm with an uncertainty of 0.3% (k=2) or less. Its success will demonstrate CLARREO’s ability to provide on-orbit SI-Traceable calibration of measured spectral reflectance with an advanced accuracy. The CLARREO pathfinder simulator has been developed to generate high-fidelity inter-calibration event data products that can be used for pre-launch inter-calibration algorithm study. A high-fidelity simulation for CLARREO inter-calibration events includes computationally intensive radiative transfer calculations for observations within each individual collocation footprint. A principal component based radiative transfer model is incorporated in the simulator to enable an ultra-fast forward simulation, ensuring a low latency data processing for month- to year-long intercalibration events. This paper introduces the design and development of the CLARREO pathfinder simulator and some of its applications for inter-calibration matching error evaluation.

Wan Wu

Data Grid Management Systems

The "Grid" is an emerging infrastructure for coordinating access across autonomous organizations to distributed, heterogeneous computation and data resources. Data grids are being built around the world as the next generation data handling systems for sharing, publishing, and preserving data residing on storage systems located in multiple administrative domains. A data grid provides logical namespaces for users, digital entities and storage resources to create persistent identifiers for controlling access, enabling discovery, and managing wide area latencies. This paper introduces data grids and describes data grid use cases. The relevance of data grids to digital libraries and persistent archives is demonstrated, and research issues in data grids and grid dataflow management systems are discussed.

Moore, Reagan W.

Strategy for Developing Expert-System-Based Internet Protocols (TCP/IP)

The Satellite Networks and Architectures Branch of NASA's Lewis Research is addressing the issue of seamless interoperability of satellite networks with terrestrial networks. One of the major issues is improving reliable transmission protocols such as TCP over long latency and error-prone links. Many tuning parameters are available to enhance the performance of TCP including segment size, timers and window sizes. There are also numerous congestion avoidance algorithms such as slow start, selective retransmission and selective acknowledgment that are utilized to improve performance. This paper provides a strategy to characterize the performance of TCP relative to various parameter settings in a variety of network environments (i.e. LAN, WAN, wireless, satellite, and IP over ATM). This information can then be utilized to develop expert-system-based Internet protocols.

Ivancic, William D.

Hyperspectral Sounder Products: SiFSAP and ClimFiSP

Infrared hyperspectral sounders have demonstrated to provide very high value information for a range of weather and climate applications. Traditional retrieval algorithms of hyperspectral sounders use the ‘cloud clearing’ methodology in the retrieval process due to the lack of means to account for cloud scattering effect. The corresponding Level-2 data products are therefore limited by two major factors: the degradation of spatial resolution as compared with the native resolution of the instruments and the lack of ‘radiance closure’ that is critically needed for climate trend studies. The single field-of-view (FOV) sounder atmospheric products (SiFSAP) algorithm has been developed to supplement existing operational products. The SiFSAP algorithm uses the principal component based radiative transfer model (PCRTM) that is ultra-fast and has been extensively validated for the cloud scattering simulation capability. The cloud properties are physically retrieved along with profiles of temperature, moisture, and trace gases of interest, surface properties simultaneously by fitting single FOV spectral measurements. Therefore, SiFSAP ensure the radiometric consistency between the retrieved geophysical properties and the top-of-atmosphere (TOA) spectral measurements. This presentation provides a general introduction of SiFSAP and details about the physical retrieval algorithm. Also introduced here is a derivative data product of SiFSAP, the climate fingerprinting Sounder Products (ClimFiSP). ClimFiSP include the space-time averaged properties of key climate variables that are derived from the space-time averaged radiances via the spectral fingerprinting scheme. The spectral fingerprinting method allows a low latency data update on ClimFiSP following any potential calibration update on satellite measurements. ClimFiSP also include the rigorously defined uncertainty characterization for trends or anomalies of climate variables, being critical for the construction of long-term climate data record. Both SiFSAP and ClimFiSP will be available to users through NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC).

Wan Wu

Homogenization of Satellite Based Hyperspectral Infrared Sounder Data To Build Long Term Climate Record

Building long term climate record using data from multiple hyperspectral Infrared (IR)sounders requires the homogenization of different data record to ensure the consistency andcontinuity. Such a requirement comes from two perspectives: 1) the need to adjust theoverlapping measurements of different sounders to ensure the radiometric consistency in thespectral radiance domain; 2) the need for a rigorously defined scheme to ensure the radiometricconsistency being transferred to the essential climate variables derived from the radiance record.We develop a solution that uses a spectral fingerprinting scheme to derive anomalies of keyclimate variables from long term spectral radiance data record constructed using both AIRS andCrIS observations aboard AQUA, SNPP and JPSS satellites. The fingerprinting scheme usescommon radiative kernels for all sounder measurements and therefore effectively avoids thealgorithm introduced inconsistency in retrieved geophysical variables. Our approach uses aunified sampling scheme to match AIRS and CrIS observations in both spectral and spatial-temporal domain, facilitating the intercomparison of spectral radiances from different sensors(platforms). The optimized liner inversion scheme allows the direct quantification and thereforethe adjustment for the impact on the derived climate anomalies imposed by potential radiometricinconsistency between the overlapping measurements. Such a scheme also enables the low-latency data processing of long term hyperspectral sounder data records. This paper provides a detailed introduction of the spectral fingerprinting methodology.Also introduced here is the climate fingerprinting Sounder Product (ClimFiSP) developed basedon the fingerprinting methodology. ClimFiSP products include the space-time averagedproperties of key climate variables that are derived from the long-term, space-time averagedradiances from AQUA-AIRS, SNPP-CrIS, and JPSS1-CrIS. ClimFiSP will be available to usersthrough NASA'sGoddard Earth Sciences Data and Information Services Center (GES DISC).

Wan Wu

Climate Fingerprinting Sounder Product (ClimFiSP) Skin Temperature Trends Analysis

Climate fingerprinting Sounder Product (ClimFiSP) has been developed at NASA Langley Research Center which includes daily skin temperature, surface emissivity, air temperature, H2O, trace gases, and cloud properties on 0.5x0.5 grid. Those properties are derived from IR hyper-spectral radiance measured by AIRS on Aqua and CrIS on SNPP and JPSS series. Global skin temperature trends have been derived using more than 20 years of monthly mean skin temperature data from ClimFiSP. The ClimFiSP algorithm use the spectral fingerprinting methodology that allows a low latency procession of more than two decades long satellite data record. The computational cost can be reduced by more than two orders of magnitude as compared with traditional Level-Level2-Level3 retrieval algorithms. In this presentation the global skin temperature trend from ClimFiSP will be compared with skin temperature trend derived from CLIMCAPS, ERA5, GISTEMP, HadCRUT5, and IASI data products, and the results show that pattern of ClimFiSP global skin temperature trends overall matches well with other datasets. The zonally averaged skin temperature anomaly will also be validated using those datasets. It is expected that ClimFiSP surface temperature data can serve as an important complement for surface-based estimates, especially in the regions where the spatial coverage of the surface-based observations is scarce.

Liqiao Lei