Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Center Networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Software-Defined Data Center Network Architecture using VXLAN-based BGP EVPN for Dynamic Workflows in a Supercomputing Environment (VXLAN-based BGP EVPN Fabric for HPC) v1

This software repository automates the deployment of a multi-vendor VXLAN-based BGP EVPN architecture, leveraging Containerlab to instantiate a stretched CLOS topology. It integrates Linux, Nokia SR Linux, and Arista cEOS, using BGP for underlay, overlay, and topology extension. The software enables rapid prototyping and testing of advanced network configurations. Its key advantage lies in providing a dynamic, programmable environment for research and development of critical technologies supporting dynamic workflows within supercomputing environments, surpassing the limitations of static, vendor-locked alternatives by fostering interoperability and agility.

Kumar, Ronal [Lawrence Berkeley National Laborator↗

NASA Earth Observing System Data and Information System (EOSDIS): A U.S. Network of Data Centers Serving Earth Science Data: A Network Member of ICSU WDS

NASA's Earth Observing System Data and Information System (EOSDIS) has been in operation since August 1994, and serving a diverse user community around the world with Earth science data from satellites, aircraft, field campaigns and research investigations. The ESDIS Project, responsible for EOSDIS is a Network Member of the International Council for Sciences (ICSU) World Data System (WDS). Nine of the 12 Distributed Active Archive Centers (DAACs), which are part of EOSDIS, are Regular Members of the ICSUWDS. This poster presents the EOSDIS mission objectives, key characteristics of the DAACs that make them world class Earth science data centers, successes, challenges and best practices of EOSDIS focusing on the years 2014-2016, and illustrates some highlights of accomplishments of EOSDIS. The highlights include: high customer satisfaction, growing archive and distribution volumes, exponential growth in number of products distributed to users around the world, unified metadata model and common metadata repository, flexibility provided to uses by supporting data transformations to suit their applications, near-real-time capabilities to support various operational and research applications, and full resolution image browse capabilities to help users select data of interest. The poster also illustrates how the ESDIS Project is actively involved in several US and international data system organizations.

Earth Science↗

A Diagnostic Analysis of the Kennedy Space Center LDAR Network: Data Characteristics - 1

An analytical framework is developed in which to analyze climatological VHF (66 MHz) radiation measurements taken by the Kennedy Space Center Lightning Detection and Ranging (LDAR) network. A 19-month noise-filtered sample of LDAR observations is examined using this framework. It is found that the climatological VHF source density as observed by LDAR falls off approximately 10 dB every 71 km of ground range away from the network centroid (a 31 km e-folding scale). From this framework it is inferred that the underlying source distribution is likely inverse exponential in amplitude, with a log-slope of 126-147 mW(sup -1/2). The underlying vertical distribution of VHF sources is approximately normally distributed with a mean altitude of 9 km and a standard deviation of 2.7 km; this implies that the loss of below-horizon sources has a negligible effect on column-integrated source densities within 200 km ground range. At medium to far ranges, location errors are primarily radial and have a slightly asymmetric distribution whose first moment increases as range squared. Error moments estimated from observed lightning are significantly higher than those from aircraft-based signal generator or analytic solution estimates, suggesting that timing errors arising from poor signal identification and discrimination may dominate over timing errors arising from nominal sensor resolution. The VHF source properties of individual LDAR-observed flashes are computed and an analytic expression for flash detection efficiency vs. range is derived. This reveals nearly constant flash detection efficiency to 80-94 km range from the network centroid.

Boccippio, D. J.↗

A Diagnostic Analysis of the Kennedy Space Center LDAR Network: Data Characteristics - 1

An analytic framework is developed in which to analyze climatological VHF (66 MHz) radiation measurements taken by the Kennedy Space Center Lightning Detection and Ranging (LDAR) network. A 19 month noise-filtered sample of LDAR observations is examined using this framework. It is found that the climatological impulsive VHF source density as observed by LDAR falls off approximately 10 dB every 71 km of ground range away from the network centroid (a 31 km e-folding scale). The underlying vertical distribution of impulsive VHF sources is approximately normally distributed with a mean altitude of 9 km and a standard deviation of 2.7 km; this implies that the loss of below-horizon sources has a negligible effect on column-integrated source densities within a 200 km ground range. At medium to far ranges, location errors are primarily radial and have a slightly asymmetric distribution whose standard deviation increases as r(exp 2). Error moments estimated from observed lightning are significantly higher than those from aircraft-based signal generator or analytic estimates. LDAR bulk flash detection efficiency is predicted to be above 90% to 94-113 km range from the network centroid and to fall below 10% at ranges greater than 200-240 km.

Boccippio, D. J.↗

Assessing Impacts of Waves on Hub-Height Winds off the U.S. West Coast Using Lidar Buoys and Coupled Modeling Approaches

Given the importance of offshore wind energy development to the U.S. clean energy targets, it is vital to be able to characterize the wind resource in that environment accurately. Toward that end, two Bureau of Ocean Energy Management buoys equipped with Doppler lidar are being maintained by Pacific Northwest National Laboratory on behalf of the Department of Energy and deployed to regions of potential offshore wind development. In addition to standard meteorological and oceanographic measurements, the buoys document the wind profile between about 40 m and 250 m above the sea surface through Doppler lidar retrievals. After a multiyear deployment of two buoys along the U.S. East Coast, the buoys were redeployed to the U.S. West coast from 2020 – 2022 to locations near the Humboldt and Morro Bay lease areas. The buoys provide nearly continuous, multiyear datasets that can be used to evaluate predictions of hub-height (~100 m) wind speed for standard atmospheric models in the region. In the absence of measurements at the study site, offshore wind developers rely on model-based data to assess site conditions. Potential sources of model error in this environment include under-resolution or misrepresentation of coastal topographically forced flows, marine boundary layer dynamics and the evolution of their associated cloud and turbulence fields, the role of upwelling and other currents on surface heat fluxes into the boundary layer, and the impact of wave fields on surface momentum fluxes and thus the wind speed profile. In particular, most predictive models of wind speed do not predict wave fields at all, relying on parameterizations to represent their effects. In thus study, we focus on evaluating the role of wind / wave interactions on modeled hub-height wind speed and error by using the Coupled Ocean–Atmosphere–Wave–Sediment–Transport Modeling System to capture two-way interactions between an atmospheric model (Weather Research and Forecasting (WRF)) and a wave model (WAVEWATCHIII (WW3)) and compare to both stand-alone WRF and one-way coupled WRF / WW3 configurations. Our approach is similar to that used in Gaudet et al. (2022) to evaluate wind / wave coupling over the U.S. East Coast, but applied to the very different environment of the U.S. West Coast. We show examples for two cases, a cold-season frontal case and a warm-season low-level jet case. We find that wind / wave coupling makes little impact on model error for these cases at the location of the lidar buoys, for which other misrepresentations of model physics seems to be responsible for model-observation discrepancies. However, domain-wide evaluations, which also make use of the National Buoy Data Center network, show that a two-way coupling approach is less prone to systematic errors in the hub-height wind field than the one-way coupled approach. WRF resolution of kilometer-scale or less is needed to properly capture the sharp wind speed gradients that can be found along the coastline, and WW3 simulations driven by the downscaled WRF produce better bulk and spectral wave fields when compared to observations. Implications of the results for wind resource characterization are then discussed.

17 WIND ENERGY↗

SLR Data: from Station to User

The ILRS provides laser ranging data and products on an operational basis to geodesy analysts as well as a broader scientific community. ILRS is one of four services within the International Association for Geodesy (IAG) supporting space geodesy. IAG established these services to facilitate international cooperation and scientific research: Networks, Data centers, Analysis groups. Services perform successful operations through cooperation of many international organizations, leveraging their respective resources to all levels of service functionality.

Noll, Carey↗

Exploring the benefits of using co-packaged optics in data center and AI supercomputer networks: a simulation-based analysis [Invited]

We investigate the advantages of using co-packaged optics in next-generation data center and AI supercomputer networks. The increased escape bandwidth offered by co-packaged optics provides multiple possibilities for building 50T switches and beyond, expanding the opportunities in both the data center and supercomputing domains. Furthermore, this provides network architects with the opportunity to expand their design space and develop simplified networks with enhanced network locality properties. Co-packaging at the switch and server points enables networks with double capacity while reducing the switch count by 64% compared to state-of-the-art systems. We evaluate these concepts through discrete-event simulations using all-to-all and all-reduce traffic patterns that simulate collective communications commonly found in network-bound applications. Initially, we investigate the all-to-all overhead involved in distributing the virtual machines of the applications across multiple leaf switches and compare it to the scenario in which all VMs are placed under a single switch. Subsequently, we evaluate the performance of an AI supercomputing cluster by simulating both patterns for different message sizes, while also varying the number of participating nodes. The results suggest that networks with improved locality properties become increasingly important as the network stack operates at higher speeds; for a stack latency of 1.25 µs, placing the applications under multiple switches can result in up to 68% higher completion times than placing them under a single switch. For AI supercomputers, significant improvements are observed in the mean server throughput, reaching more than 90% for configurations involving 256 nodes and message sizes of at least 128 KiB.

99 GENERAL AND MISCELLANEOUS↗

Station Data Acquisition and Control System.

The Station Data Acquisition and Control System (STADAC), a multicomputer data handling and control system, is expected to be installed in six network stations, the first station to be established at Goddard Space Flight Center. Network control data, in the form of schedules and acquisition pointing data, flow from the Network Control Center to the stations, while station status data flow in the other direction. The system will format spacecraft telemetry data for real-time transmission of control and status data to the project operations control centers and for transmission of experiment data to the data processing facilities. The system will also schedule station equipment resources, perform prepass tests to assure data quality, and automatically set up selected station equipment.

Kiebler, J. W.↗

PCDS as a tool in teaching and research at the University of Michigan

The Space Physics Research Laboratory's (SPRL) use of the Pilot Climate Data System (PCDS) is discussed. For this purpose, a computer center was established to provide the hardware and software necessary to fully utilize existing data bases for research and teaching purposes. A schematic of the SPRL network is given. The core of the system consists of two VAX 11/750s and a VAX 8600, networked through ETHERNET to several LSI 11/23 microprocessors. Much of the system is used for external communications with major networks and data centers. A VAX 11/750 provides DECNET services through the SPAN network to the PCDS. A functional diagram of PCDS usage is given. The browsing capabilities of the PCDS are used to generate data files, which are later transferred to the SPRL center for further data manipulation and display. This mode of operation for classroom instruction will be used to effectively use terminals and to simplify usage of the data base. The Atmosphere Explorer data base has been used successfully in a similar manner in courses related to the thermosphere and ionosphere. The main motivation to access the PCDS was to complement research efforts related to the High Resolution Doppler Imager (HRDI), to be flown on the Upper Atmosphere Research Satellite (UARS).

Abreu, V.↗

The role of the World Data Centers in handling ocean climate data

The World Data Center System, set up for the International Geophysical Year in 1957, is an international network of data centers that links data contributors to data users in the geosciences. It includes means for the synthesis, analysis, and preparation of data products. It was set up in response to the needs of the international scientific community, and is still overseen by non-governmental scientific organizations. Because it is freely available to researchers in all countries, the World Data Center System has a special role to play in support of ocean climate research and monitoring programs. The World Data Centers face a number of challenges today. Apathy is probably the greatest, since many scientists take the system for granted. There is need to improve access and exploit new technology. The system must establish new links to assure continuity in a world with political changes. The multidisciplinary needs of global change research will demand capabilities for data and information management that go beyond the traditional emphasis on geophysics.

Webster, Ferris↗

NASA ground communications

As part of the Communications Requirements and Constraints, NASA's two major Ground Data Networks were briefly described. The NASA Communication Network, called NASCOM, is the worldwide operational telecommunications system which interconnects as the tracking and telemetry acquisition sites, launch areas, mission and project control centers, data capture facilities, and network control centers in support of space flight. For the Space Station era, NASCOM plans are set for higher data rate service utilizing data packet switched technology. Increased use of fiber optics is expected in a much more diverse network topology. The second major ground network, the Program Support Communications Network (PSCN), interconnects all NASA Centers and NASA contractor locations for intercenter non-operation communications. The primary functions are to transport voice, video, data and facsimile information for intercenter coordination, and to provide user access to space science and applications data bases. For the Space Station era, PSCN plans address the significant increase in forecast requirements for science data distribution and access to the Numerical Aerodynamics Simulator, and increased use of the Video Teleconference System.

Roeder, John↗

Automatic Speech Recognition for Launch Control Center Communication Using Recurrent Neural Networks with Data Augmentation and Custom Language Model

Transcribing voice communications in NASA’s launch control center is important for information utilization. However, automatic speech recognition in this environment is particularly challenging due to the lack of training data, unfamiliar words in acronyms, multiple different speakers and accents, and conversational characteristics of speaking. We used bidirectional deep recurrent neural networks to train and test speech recognition performance. We showed that data augmentation and custom language models can improve speech recognition accuracy. Transcribing communications from the launch control center will help the machine analyze information and accelerate knowledge generation.

Chow, Edward↗

Space Communications and Navigation Validation: Extracting Data for the Strategic Center for Networking, Integration, and Communications Scheduling Algorithms

Efficiency in communication system architecture performance between Space Communications and Navigation (SCaN) assets and missions is crucial, as space communication is varied, complex, and often not utilized to its full potential. The SCaN Strategic Center for Networking, Integration, and Communications (SCENIC) new scheduling algorithms, which are designed to simulate the allocation of resources between SCaN assets and missions, have the potential to simulate an increase of this efficiency; however, they require real-world data to be validated against. The purpose of this project was to extract said validation data, which details the frequency and duration of utilized contact windows between missions and assets in the Near Earth Network (NEN), Space Network (SN), and Deep Space Network (DSN). Stored as images in daily operations summaries (DOSs), the tabular data existed in a variety of file formats such as.pdf, .docx, and .doc. Since the tables were stored as images, ABBYY® FineReader® (ABBYY Software Ltd.) optical character recognition (OCR) was implemented, which is a proprietary software that reads images from text. The comma separated value (CSV) output was utilized as input to a series of MATLAB® (The MathWorks, Inc.) methods for reformatting, at which point it was ready to be machine-read. Finally, the results were converted to a Microsoft Excel format for human readability. Along with being used for validation purposes, the data will also be used to map equipment degradation as a function of time to analyze the reliability of network assets.

Kontur, Noah P.↗

IceNet for FireBox - A Berkeley Warehouse-Scale Computer

Berkeley’s FireBox is a next-generation warehouse-scale computer (WSC) that utilizes the energy-efficiency and bandwidth density of integrated silicon-photonic interconnects to enable a new high-bandwidth and low-latency network fabric connecting thousands of compute nodes to petabytes of DRAM and Flash storage. The high bandwidth, low latency and high connectivity of FireBox’s WSC network fabric (IceNet) will enable dramatic improvements in the overall system energy efficiency enabling fine-grain power control on system resources (processors, links and memory/storage components). IceNet is a special 3-stage photonic Clos network architected to achieve ultra-low-latency connectivity between processor nodes and memory, drastically cutting down on the energy wasted in resource idling (processors and memory stalled due to pending network requests). This is achieved by integration of the first and last switch stages into processor/memory hub clients and by heavy over-provisioning of the high-radix middle switches (FlareSwitches). A key hardware component developed in this program is an active laser power management photonic integrated circuits called LightSpark. It interacts with the FlareSwitch and provides laser power to a subset of occupied switch ports, increasing the utilization of laser light in the photonic network by an order of magnitude. In addition to guiding the laser power where it is needed, the laser-power management module enables both wavelength and laser redundancy, significantly increasing the robustness of the system. The goal of the IceNet fabric is to enable communication between 1000s of processor nodes and PBs of memory/storage with <100ns latency, <10pJ/b wall-plug energy cost at multiple Pb/s of available connectivity bandwidth. These metrics represent two-orders of magnitude improvement with respect to the status of current data-center technology.

42 ENGINEERING↗

Obtaining Data from Space

Ground support of nasa space programs - tracking and command techniques - minitrack, deep space stations, mercury network, data processing centers

DEEP SPACE INSTRUMENTATION FACILITY /DSIF/↗

Network performance analysis for HPC datacenters (net_perf) v1.0

The software has two main features: (1) identify data movement trends in HPC data centers that use network flow monitoring (2) analyze the performance of individual data flows under the existing data movement management strategy and identify performance bottlenecks that impede timely data availability for science workflows. Its main advantage is that it is tailored for HPC network traffic by considering HPC data movement management intricacies.

Giannakou, Anna↗

Data management for community research projects: A JGOFS case study

Since the mid 1980s, much of the marine science research effort in the United Kingdom has been focused into large scale collaborative projects involving public sector laboratories and university departments, termed Community Research Projects. Two of these, the Biogeochemical Ocean Flux Study (BOFS) and the North Sea Project incorporated large scale data collection to underpin multidisciplinary modeling efforts. The challenge of providing project data sets to support the science was met by a small team within the British Oceanographic Data Centre (BODC) operating as a topical data center. The role of the data center was to both work up the data from the ship's sensors and to combine these data with sample measurements into online databases. The working up of the data was achieved by a unique symbiosis between data center staff and project scientists. The project management, programming and data processing skills of the data center were combined with the oceanographic experience of the project communities to develop a system which has produced quality controlled, calibrated data sets from 49 research cruises in 3.5 years of operation. The data center resources required to achieve this were modest and far outweighed by the time liberated in the scientific community by the removal of the data processing burden. Two online project databases have been assembled containing a very high proportion of the data collected. As these are under the control of BODC their long term availability as part of the UK national data archive is assured. The success of the topical data center model for UK Community Research Project data management has been founded upon the strong working relationships forged between the data center and project scientists. These can only be established by frequent personal contact and hence the relatively small size of the UK has been a critical factor. However, projects covering a larger, even international scale could be successfully supported by a network of topical data centers managing online databases which are interconnected by object oriented distributed data management systems over wide area networks.

Lowry, Roy K.↗

Enhancing the IGS Data and Products Infrastructure: A Data Center Perspective

The Data Transfer and Data Centers session will present papers on current data center activities as well as various topics geared towards enhancing the availability and acquisition of International Global Positions System Service (IGS) data and products. These topics include: strategies for reducing data file latency at IGS Data Centers, standardization of data file replacement notification methods, improving the efficiency of data file transfer among IGS Data Centers, and defining a network topology for GPS data files for use in applications.

Scharber, Michael↗