Search NASA⌕ Search

SEARCH · Search NASA

Results for “data center efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Generic and ML Workloads in an HPC Datacenter: Node Energy, Job Failures, and Node-Job Analysis

HPC datacenters offer a backbone to the modern digital society. Increasingly, they run Machine Learning (ML) jobs next to generic, compute-intensive workloads, supporting science, business, and other decision-making processes. However, understanding how ML jobs impact the operation of HPC datacenters, relative to generic jobs, remains desirable but understudied. In this work, we leverage long-term operational data, collected from a national-scale production HPC datacenter, and statistically compare how ML and generic jobs can impact the performance, failures, resource utilization, and energy consumption of HPC datacenters. Our study provides key insights, e.g., ML-related power usage causes GPU nodes to run into temperature limitations, median/mean runtime and failure rates are higher for ML jobs than for generic jobs, both ML and generic jobs exhibit highly variable arrival processes and resource demands, significant amounts of energy are spent on unsuccessfully terminating jobs, and concurrent jobs tend to terminate in the same state. We open-source our cleaned-up data traces on Zenodo (https://doi. org/10.5281/zenodo.13685426), and provide our analysis toolkit as software hosted on GitHub (https://github.com/atlarge-research/2024-icpads-hpc-workload-characterization). This study offers multiple benefits for data center administrators, who can improve operational efficiency, and for researchers, who can further improve system designs, scheduling techniques, etc.

crossanalysis↗

Interactive data analysis for astronomy Shuttle experiments at Goddard Space Flight Center

The eye as an efficient selection device for determining what is important in astronomical imagery can be greatly aided by the computer. A suitable facility, called the Interactive Astronomical Data Analysis Facility (IADAF), has been developed for the display and analysis of astronomical imagery by the Laboratory for Astronomy and Solar Physics. The Laboratory for Astronomy and Solar Physics currently has approval to fly two experiments on Spacelab. The Solar Extreme Ultraviolet Telescope (SEUTS) is to be used for the study of several fundamental problems of solar physics. The Ultraviolet Image Telescope for Astronomical Investigations (UIT) is to provide direct imagery of selected fields of view throughout the sky. A description is given of IADAF, taking into account its 16-bit computer and the COMTAL image processing display system. The use of IADAF by SEUTS and UIT is discussed.

Klinglesmith, D. A., III↗

Advanced techniques and technology for efficient data storage, access, and transfer

Advanced techniques for efficiently representing most forms of data are being implemented in practical hardware and software form through the joint efforts of three NASA centers. These techniques adapt to local statistical variations to continually provide near optimum code efficiency when representing data without error. Demonstrated in several earlier space applications, these techniques are the basis of initial NASA data compression standards specifications. Since the techniques clearly apply to most NASA science data, NASA invested in the development of both hardware and software implementations for general use. This investment includes high-speed single-chip very large scale integration (VLSI) coding and decoding modules as well as machine-transferrable software routines. The hardware chips were tested in the laboratory at data rates as high as 700 Mbits/s. A coding module's definition includes a predictive preprocessing stage and a powerful adaptive coding stage. The function of the preprocessor is to optimally process incoming data into a standard form data source that the second stage can handle.The built-in preprocessor of the VLSI coder chips is ideal for high-speed sampled data applications such as imaging and high-quality audio, but additionally, the second stage adaptive coder can be used separately with any source that can be externally preprocessed into the 'standard form'. This generic functionality assures that the applicability of these techniques and their recent high-speed implementations should be equally broad outside of NASA.

Rice, Robert F.↗

Automated Indexing of Structured Scientific Metadata Using Apache Solr

Scientific datasets are continuously growing with the amount of raw data being collected worldwide. This amount of data poses the biggest challenge to web search engines on how to retrieve them efficiently. This paper discusses how major scientific data centers are using popular open-source search platforms such as Solr [1] to retrieve structured data stored in data sources such as relational database management systems using its import handler mechanisms [2]. Additionally, we will also focus on how we can configure Solr to serve advanced full-text, faceted search capabilities, along with its key features, which simplify representing and delivering better performance to the scientific search interfaces.

Guntupally, Kavya↗

Energy Use in Quantum Data Centers: Scaling the Impact of Computer Architecture, Qubit Performance, Size, and Thermal Parameters

As quantum computers increase in size, the total energy used by a quantum data center, including the cooling, will become a greater concern. The cooling requirements of quantum computers, which operate at temperatures near absolute zero, are determined by computing system parameters, including the number and type of physical qubits, the packaging efficiency of the system, and the split between circuits operating at cryogenic temperatures and those operating at room temperature. When combined with thermal system parameters such as cooling efficiency and cryostat heat transfer, the total energy use can be determined using a first-principles energy model. These models show that cooling of quantum computers differs in two fundamental ways from conventional data centers: (1) the energy required for cooling is much greater than the energy required for computation, and (2) the cooling loads are sensitive to the computational architecture. The temperature requirements for different qubit types can change energy requirements by orders of magnitude. Power use and computational power, as quantified by quantum volume, are analytically correlated. Approaches are identified for minimizing energy use in integrated quantum systems relative to computational power. Furthermore, designing a sustainable quantum computer will require both efficient cooling and system design that minimizes cooling requirements.

97 MATHEMATICS AND COMPUTING↗

Highly boosted dielectron identification in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A new technique is developed to identify dielectrons (e$^+$e$^-$) with Lorentz boost $γ_\mathrm{L}$$\gt$ 20 that produce one single merged cluster in the electromagnetic calorimeter of the CMS detector. The identification uses two multivariate models: one for the case where both electron tracks are reconstructed, and another where only one of the tracks is reconstructed. The efficiency is determined using proton-proton collision data collected at a center-of-mass energy of 13 TeV. Boosted J/$ψ$ mesons decaying into e$^+$e$^-$ pairs are used to estimate the efficiency of the model with two tracks, yielding an overall efficiency of 80%. The Z $\to$ $μ^+μ^-γ$ events, where the photon converts into a collimated dielectron, are used for the model with a single track, yielding an efficiency of about 60%. A dedicated energy correction for dielectron candidates is also developed using B$^\pm$ $\to$ J/$ψ$K$^\pm$ $\to$ e$^+$e$^-$K$^\pm$ data.

Hayrapetyan, A. [Yerevan Phys. Inst.]↗

NASA's EOSDIS, Trust and Certification

NASA's Earth Observing System Data and Information System (EOSDIS) has been in operation since August 1994, managing most of NASA's Earth science data from satellites, airborne sensors, filed campaigns and other activities. Having been designated by the Federal Government as a project responsible for production, archiving and distribution of these data through its Distributed Active Archive Centers (DAACs), the Earth Science Data and Information System Project (ESDIS) is responsible for EOSDIS, and is legally bound by the Office of Management and Budgets circular A-130, the Federal Records Act. It must follow the regulations of the National Institute of Standards and Technologies (NIST) and National Archive and Records Administration (NARA). It must also follow the NASA Procedural Requirement 7120.5 (NASA Space Flight Program and Project Management). All these ensure that the data centers managed by ESDIS are trustworthy from the point of view of efficient and effective operations as well as preservation of valuable data from NASA's missions. Additional factors contributing to this trust are an extensive set of internal and external reviews throughout the history of EOSDIS starting in the early 1990s. Many of these reviews have involved external groups of scientific and technological experts. Also, independent annual surveys of user satisfaction that measure and publish the American Customer Satisfaction Index (ACSI), where EOSDIS has scored consistently high marks since 2004, provide an additional measure of trustworthiness. In addition, through an effort initiated in 2012 at the request of NASA HQ, the ESDIS Project and 10 of 12 DAACs have been certified by the International Council for Science (ICSU) World Data System (WDS) and are members of the ICSUWDS. This presentation addresses questions such as pros and cons of the certification process, key outcomes and next steps regarding certification. Recently, the ICSUWDS and Data Seal of Approval (DSA) organizations merged their Core Trustworthy Data Repositories Requirements and require that members be recertified every three years. Given the rigor with which NASA manages the ESDIS Project and the DAACs, the recertification through WDSDSA, while involving some additional work, is a relatively simple process.

Certification↗

Hierarchical Analysis of Halo Center in Cosmology

Ever-increasing data size raises many challenges for scientific data analysis. Particularly in cosmological N-body simulation, finding the center of a dark matter halo suffers heavily from the large computational cost associated with the large number of particles (up to 20 million). In this work, we exploit the latent structure embed in a halo, and we propose a hierarchical approach to approximate the exact gravitational potential calculation for each particle in order to more efficiently find the halo center. Tests of our method on data from N-body simulations show that in many cases the hierarchical algorithm performs significantly faster than existing methods with a desirable accuracy.

97 MATHEMATICS AND COMPUTING↗

Enabling power measurement and control on Astra: The first petascale Arm supercomputer

Astra, deployed in 2018, was the first petascale supercomputer to utilize processors based on the ARM instruction set. The system was also the first under Sandia's Vanguard program which seeks to provide an evaluation vehicle for novel technologies that with refinement could be utilized in demanding, large-scale HPC environments. In addition to ARM, several other important first-of-a-kind developments were used in the machine, including new approaches to cooling the datacenter and machine. Here we document our experiences building a power measurement and control infrastructure for Astra. While this is often beyond the control of users today, the accurate measurement, cataloging, and evaluation of power, as our experiences show, is critical to the successful deployment of a large-scale platform. While such systems exist in part for other architectures, Astra required new development to support the novel Marvell ThunderX2 processor used in compute nodes. In addition to documenting the measurement of power during system bring up and for subsequent on-going routine use, we present results associated with controlling the power usage of the processor, an area which is becoming of progressively greater interest as data centers and supercomputing sites look to improve compute/energy efficiency and find additional sources for full system optimization.

97 MATHEMATICS AND COMPUTING↗

Description of data base management activities

ARC's current and future data processing needs have been identified and defined. Requirements for improved data processing capabilities are listed: (1) Centralized control of system data files. Establish a DBA/data base administrator position with responsibility for management of the Centers numerous data bases; (2) Programmer tools to improve efficiency of performance; (3) Direct and timely access to information. Presently, the user submits query requests to the data processing department where they are prioritized with other queries and then batch processed using a report generator; (4) On line data entry. With the merger of the Dryden facility with ARC on line data entry, edit and updates have become mandatory for timely operation and reporting. A DBMS software package was purchased to meet the above requirements.

Source record↗

The International Global Network of Geodetic Fiducial Stations

Scientific need and technological opportunity require that we move toward implementing a global network of geodetic fiducial stations which feature co-located SLR, VLBI, GNSS, and DORIS instrumentation. Earth science of the next decade will require more accurate global change measurements of sea level topography, sea level change, polar ice mass balance, hydrological and atmospheric mass flux. and topographic deformation, real time mm scale navigation and precision time transfer on a global scale. These scientific requirements have been translated into a goal of mm scale annual stability for the terrestrial reference frame, earth orientation parameters, as well as the orbit and clock determinations tbr the GNSS systems. To meet these challenges, the four geodetic observing systems must be more tightly integrated in technology, location, and analysis. NASA strongly supports the objectives of the IGGOS initiative vis NASA's National Geodetic Observatory and INDIGO programs. The Global networks of GNSS, SLR. and VLBI observatories are for the most part poorly suited for these new demands. These important geodetic networks have evolved with little planning yet these systems are providing essential measurements to a wide swath of society. New signal structures in the GPS and the developing Galileo GNSS will soon require replacement of the GNSS receivers. The SLR network is poorly distributed globally, requires labor intensive observations and analysis, and for the most part relies upon antiquated technology. The VLBI observatories utilize large radio telescopes in remote regions that are poorly distributed globally. Co-location of these networks is sparse and co-location errors contribute significantly to the observing error spectrum. Increasing use of the S and X band by commercial and other government services will also contribute to increased observational errors. The time is upon us for an international effort to develop an optimized global geodetic fiducial network of twelve or more integrated automated geodetic observatories that will provide in near real time high density mea.surements of Earth orientation, geodetic positioning, and GNSS system monitoring. The strategic goal for the optimized global fiducial network should be efficient autonomous operation, real time data streaming to analysis centers with an integrated near real time analysis capability for all four observing systems. These goals are achievable in the next decade given the dramatic technological improvements in all geodetic systems. For VLBI, the BKG TIGO might be viewed as a preliminary prototype of technology for fundamental stations. Mark 5, PC-VSI. e-VLBI broadband development efforts are laying the groundwork to reduce the aperture of the VLBI antennas and to allow for precision mm level co-location of observing systems. Operating costs and enhanced accuracy would accrue from the elimination of hydrogen maser clocks using double differencing, GNSS time transfer technology, GHz broadband recording, real time analysis, and mm wavelength VLBI observations. A global geodetic fiducial network will not be realizable without international efforts and the support of the four services.

LaBrecque, John↗

Alternative Fuels Data Center and Related Technology Integration Tools

The U.S. Department of Energy's (DOE) Office of Energy Efficiency and Renewable Energy's Vehicle Technologies Office (VTO) facilitates national coordination of the Clean Cities coalitions through its Technology Integration Program. VTO's Technology Integration Program supports a broad technology portfolio that can reduce transportation energy costs for businesses and consumers. Fleets, cities, and regions can use the tools featured in this guide to implement alternative fuels and advanced vehicles. Also learn how Clean Cities coalitions and their stakeholders across the country have used the tools.

47 OTHER INSTRUMENTATION↗

Alternative Fuels Data Center and Related Technology Integration Tools

The U.S. Department of Energy's (DOE) Office of Energy Efficiency and Renewable Energy's Vehicle Technologies Office (VTO) facilitates national coordination of the Clean Cities coalitions through its Technology Integration Program. VTO's Technology Integration Program supports a broad technology portfolio that can reduce transportation energy costs for businesses and consumers. Fleets, cities, and regions can use the tools featured in this guide to implement alternative fuels and advanced vehicles. Also learn how Clean Cities coalitions and their stakeholders across the country have used the tools.

AFDC↗

Considerations for Distributed Edge Data Centers and Use of Building Loads to Support Large Interconnections

The rapid expansion of artificial intelligence (AI) and machine learning is driving unprecedented electricity demand from data centers. It is predicted that by 2030, 90% of AI workloads will be inference-based, requiring interconnection of multiple low-latency edge data centers (<20 MW) sited closer to end users - often on already constrained distribution feeders. Although individually small, these loads can aggregate to large loads per feeder, straining infrastructure, creating multi-year interconnection delays, and driving up customer costs. This paper proposes a data center-focused grid-integration framework that combines feeder hosting capacity analysis with building energy efficiency, building load flexibility, and waste heat reuse to expand effective feeder and substation headroom. Such approaches can reduce interconnection delays, lower costs for ratepayers, and accelerate AI-ready infrastructure deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Approach to Managing MeaSURES Data at the GSFC Earth Science Data and Information Services Center (GES DISC)

A major need stated by the NASA Earth science research strategy is to develop long-term, consistent, and calibrated data and products that are valid across multiple missions and satellite sensors. (NASA Solicitation for Making Earth System data records for Use in Research Environments (MEaSUREs) 2006-2010) Selected projects create long term records of a given parameter, called Earth Science Data Records (ESDRs), based on mature algorithms that bring together continuous multi-sensor data. ESDRs, associated algorithms, vetted by the appropriate community, are archived at a NASA affiliated data center for archive, stewardship, and distribution. See http://measures-projects.gsfc.nasa.gov/ for more details. This presentation describes the NASA GSFC Earth Science Data and Information Services Center (GES DISC) approach to managing the MEaSUREs ESDR datasets assigned to GES DISC. (Energy/water cycle related and atmospheric composition ESDRs) GES DISC will utilize its experience to integrate existing and proven reusable data management components to accommodate the new ESDRs. Components include a data archive system (S4PA), a data discovery and access system (Mirador), and various web services for data access. In addition, if determined to be useful to the user community, the Giovanni data exploration tool will be made available to ESDRs. The GES DISC data integration methodology to be used for the MEaSUREs datasets is presented. The goals of this presentation are to share an approach to ESDR integration, and initiate discussions amongst the data centers, data managers and data providers for the purpose of gaining efficiencies in data management for MEaSUREs projects.

Vollmer, Bruce↗

High-Efficiency Quantum Dot Lasers as Comb Sources for DWDM Applications

The trend of data center transceivers is to increase bandwidth while simultaneously decreasing their size, power consumption, and cost. While data center links have previously relied on vertical-cavity surface-emitting lasers (VCSELs) or in-plane lasers using coarse wavelength division multiplexing (WDM) to encode data, recently, dense WDM (DWDM) has moved to the forefront for next-generation links. Several approaches exist as light sources for DWDM links; DFB arrays, nonlinear microcombs, and semiconductor mode-locked lasers (MLLs). This paper focuses on quantum dot MLLs (QDMLLs), which currently offer the best efficiency, simplicity, and size. The efficiency of optical combs generated by QDMLLs is analyzed in depth in this study.

Dumont, Mario (ORCID:000000023956612X)↗

Novel method for the identification of the production flavor of neutral charmed mesons

We propose a new algorithm for the identification of the production flavor of neutral D mesons in the Belle II experiment. The algorithm exploits the correlation between the flavor of a reconstructed neutral D meson (signal D meson) and the electric charges of particles reconstructed in the rest of the e + e – →$c\bar{c}$ event. These include those originating from the decay of the other charm hadron produced in the event, as well as those possibly produced in association with the signal D meson. We develop the algorithm using simulation and calibrate it in data using decay modes that identify the flavor of the decaying neutral D meson. We use a data sample of e + e – collisions, corresponding to 362 fb –1 of integrated luminosity, collected by Belle II at center-of-mass energies near the Υ(4S) mass. The effective tagging efficiency in data is (47.91±0.07 (stat) ±0.51 (syst)) %, independent of the neutral-D-meson decay mode. This charm flavor tagger will approximately double the effective sample size of many CP-violation and charm-mixing measurements that so far have exclusively relied on neutral D mesons originating from D* ± decays. While developed for Belle II, the basic principles underlying the charm flavor tagger can be used in other experiments, including those at hadron colliders.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Semantic Web Data Discovery of Earth Science Data at NASA Goddard Earth Sciences Data and Information Services Center (GES DISC)

Mirador is a web interface for searching Earth Science data archived at the NASA Goddard Earth Sciences Data and Information Services Center (GES DISC). Mirador provides keyword-based search and guided navigation for providing efficient search and access to Earth Science data. Mirador employs the power of Google's universal search technology for fast metadata keyword searches, augmented by additional capabilities such as event searches (e.g., hurricanes), searches based on location gazetteer, and data services like format converters and data sub-setters. The objective of guided data navigation is to present users with multiple guided navigation in Mirador is an ontology based on the Global Change Master directory (GCMD) Directory Interchange Format (DIF). Current implementation includes the project ontology covering various instruments and model data. Additional capabilities in the pipeline include Earth Science parameter and applications ontologies.

Hegde, Mahabaleshwara↗