Search NASA⌕ Search

SEARCH · Search NASA

Results for “data tiering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

SESAME: ASCII2 File Format

A new ASCII format for SESAME data is explicitly defined and dubbed ASCII2. This format fixes some of the onerous limitations of the legacy ASCII-styled format in addition to relaxing the FORTRAN style fixed-format layout of data tables. With the exception of the multi-tiered indexes of the legacy binary format, the new ASCII2 is more compatible with the binary in that it does not restrict the extent of various integer data (e.g., SESAME material and table numbers) to six digits nor does it restrict the extent or precision of the various floating point data. There will be very limited support of the legacy ASCII-styled formats in the future.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Repurposing of the Run 2 CMS High Level Trigger Infrastructure as a Cloud Resource for Offline Computing

The former CMS Run 2 High Level Trigger (HLT) farm is one of the largest contributors to CMS compute resources, providing about 25k job slots for offline computing. This CPU farm was initially employed as an opportunistic resource, exploited during inter-fill periods, in the LHC Run 2. Since then, it has become a nearly transparent extension of the CMS capacity at CERN, being located on-site at the LHC interaction point 5 (P5), where the CMS detector is installed. This resource has been configured to support the execution of critical CMS tasks, such as prompt detector data reconstruction. It can therefore be used in combination with the dedicated Tier 0 capacity at CERN, in order to process and absorb peaks in the stream of data coming from the CMS detector. The initial configuration for this resource, based on statically configured VMs, provided the required level of functionality. However, regular operations of this cluster revealed certain limitations compared to the resource provisioning and use model employed in the case of WLCG sites. A new configuration, based on a vacuum-like model, has been implemented for this resource in order to solve the detected shortcomings. This paper reports about this redeployment work on the permanent cloud for an enhanced support to CMS offline computing, comparing the former and new models’ respective functionalities, along with the commissioning effort for the new setup.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Interfacing HDF5 with a scalable object‐centric storage system on hierarchical storage

Summary Object storage technologies that take advantage of multitier storage on HPC systems are emerging. However, to use these technologies at present, applications have to be modified significantly from current I/O libraries. HDF5, a widely used I/O middleware on HPC systems, provides a virtual object layer (VOL) that allows applications to connect to different storage mechanisms transparently without requiring significant code modifications. We recently designed the proactive data containers (PDC) object‐centric storage system that provides the capabilities of transparent, asynchronous, and autonomous data movement taking advantage of multiple storage tiers—a decision that has so far been left upon the user on most current systems. To enable PDC's features through HDF5 without modifying application codes, we have developed an HDF5 VOL connector that interfaces with PDC. We present in this article the connector interface and evaluate its performance on Cori, a Cray XC40 supercomputer located at the National Energy Research Scientific Computing Center (NERSC). Our evaluation demonstrates up to an 8× improvement compared with HDF5 that has the most recent optimizations.

Mu, Jingqing↗
NASA NTRS2000

Critical Heat Flux in Pool Boiling on Metal-Graphite Composite Surfaces

A study is conducted on high heat-flux pool boiling of pentane on micro-configured composite surfaces. The boiling surfaces are copper-graphite (Cu-Gr) and aluminum-graphite (Al-Gr) composites with a fiber volume concentration of 50%. The micro-graphite fibers embedded in the matrix contribute to a substantial enhancement in boiling heat-transfer performance. Correlation equations are obtained for both the isolated and coalesced bubble regimes, utilizing a mathematical model based on a metal-graphite, two-tier configuration with the aid of experimental data. A new model to predict the critical heat flux (CHF) on the composites is proposed to explain the fundamental aspects of the boiling phenomena. Three different factors affecting the CHF are considered in the model. Two of them are expected to become the main agents driving vapor volume detachment under microgravity conditions, using the metal-graphite composite surfaces as the heating surface and using liquids with an unusual Marangoni effect as the working fluid.

Zhang, Nengli↗
DOE OSTI2020

Wireless Sensing and Communication Capability from In-Core to a Monitoring Center

Significant cost savings can be made if electrical cables can be replaced by wireless technology in current Nuclear Power Plants (NPP) and in advance reactor designs. Wireless technology can also provide in-core opportunities by significantly reducing the number of penetrations in the pressure vessel, cost and complexity of sensor installation and by increasing the efficiency of current and advanced reactors. Unlike other deployment scenarios for an industrial environment, operators need to have centralized control over all the networks. Centralized control will reduce implementation costs, provide single point control and enable monitoring of network devices, improve security, and enhance connectivity. Micro-sensors that can simultaneously monitor temperature and pressure within a fuel rod inside nuclear reactors will enable preventative actions during abnormal operating conditions. This ability could avert accidents and enable the expedient development of accident tolerant fuels. A novel micro-sensor suite (~ mm) to simultaneously measure multiple parameters such as temperature, strain, pressure, and neutron/gamma flux inside a fuel rod is being developed for use in reactors. The necessary communication architecture is also being developed to transmit measurement signals from the core to the plant's data cloud or control room. A three three-tier strategy has been developed to support wireless transmission of in-core measurements to the control room or to a secure cloud platform for control, analytics, and decision-making purposes. 1. In-core: data signal from in-core to outside of the pressure vessel within the containment building 2. Containment building: data signal from inside to the outside of the containment building and into the balance of the plant network 3. Balance of the plant network: information transmitted to the data cloud and control room This plan presents a wireless sensing and communication system for use within a reactor core and elsewhere. The communication technology is advantageous to compensate for network equipment failures and adverse data transmission conditions. Wireless technology will significantly increase the resiliency of the plants network system. The wireless system naturally provides multiple transmission path capability and data redundancy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Overcoming obstacles to IPv6 on WLCG

The transition of the Worldwide Large Hadron Collider Computing Grid (WLCG) storage services to dual-stack IPv6/IPv4 is almost complete; all Tier-1 and 94% of Tier-2 storage are IPv6 enabled. While most data transfers now use IPv6, a significant number of IPv4 transfers still occur even when both endpoints support IPv6. This paper presents the ongoing efforts of the HEPiX IPv6 working group to steer WLCG toward IPv6-only services by investigating and fixing the obstacles to the use of IPv6 and identifying cases where IPv4 is used when IPv6 is available. Removing IPv4 use is essential for the long-term agreed goal of IPv6-only access to resources within WLCG, thus eliminating the complexity and security concerns associated with dual-stack services. We present our achievements and ongoing challenges as we navigate the final stages of the transition from IPv4 to IPv6 within WLCG.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2002

The D3 Middleware Architecture

DARWIN is a NASA developed, Internet-based system for enabling aerospace researchers to securely and remotely access and collaborate on the analysis of aerospace vehicle design data, primarily the results of wind-tunnel testing and numeric (e.g., computational fluid-dynamics) model executions. DARWIN captures, stores and indexes data; manages derived knowledge (such as visualizations across multiple datasets); and provides an environment for designers to collaborate in the analysis of test results. DARWIN is an interesting application because it supports high-volumes of data. integrates multiple modalities of data display (e.g., images and data visualizations), and provides non-trivial access control mechanisms. DARWIN enables collaboration by allowing not only sharing visualizations of data, but also commentary about and views of data. Here we provide an overview of the architecture of D3, the third generation of DARWIN. Earlier versions of DARWIN were characterized by browser-based interfaces and a hodge-podge of server technologies: CGI scripts, applets, PERL, and so forth. But browsers proved difficult to control, and a proliferation of computational mechanisms proved inefficient and difficult to maintain. D3 substitutes a pure-Java approach for that medley: A Java client communicates (though RMI over HTTPS) with a Java-based application server. Code on the server accesses information from JDBC databases, distributed LDAP security services, and a collaborative information system. D3 is a three tier-architecture, but unlike 'E-commerce' applications, the data usage pattern suggests different strategies than traditional Enterprise Java Beans - we need to move volumes of related data together, considerable processing happens on the client, and the 'business logic' on the server-side is primarily data integration and collaboration. With D3, we are extending DARWIN to handle other data domains and to be a distributed system, where a single login allows a user transparent access to test results from multiple servers and authority domains.

Walton, Joan↗
DOE OSTI2023

A Three-Tier Incremental Approach for Development of Smart Corridor Digital Twins

Development of an arterial smart corridor digital twin requires the integration of real time data streams, data storage, and simulation model execution. This process may be complex, time consuming, and susceptible to errors. To aid in smart corridor digital twin development this paper seeks to provide a framework, best practices, and development guidance. As such, a three-tier incremental approach to smart corridor digital twin development is presented. The paper highlights practical issues in digital twin construction along with key data challenges based on experiences from the development of digital twins for two large Smart Corridor deployments, one in Chattanooga, Tennessee, and the other in Atlanta, Georgia. The presented three-tier incremental approach includes: 1) development of a prepopulated offline simulation, 2) development of a pseudo digital twin that is driven by archived data, and 3) integration of real time data streams to create the online digital twin model. The three-tiered approach facilitates conducting multiple trials and scenarios with increasing complexity, allowing for incremental error processing and updating of the digital twin.

Saroj, Abhilasha↗
DOE OSTI2023

MAGNET Scaling and Methodology

The purpose of this study was to analyze the heat transfer of the Microreactor Agile Non-nuclear Experimental Testbed (MAGNET) within the Dynamic Energy Transport and Integration Laboratory (DETAIL) and develop scaling equations and models to couple with other systems. Hierarchical Two-Tiered Scaling (H2TS) methodologies were applied to DETAIL’s MAGNET facility to scale and project data sets while conserving the observed behavior based on first principles. The MAGNET system was successfully scaled using H2TS and multiple system parameters were determined or calculated from experimental data including steady state and transient data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS2011

CANDELS: The Cosmic Assembly Near-Infrared Deep Extragalactic Legacy Survey

The Cosmic Assembly Near-IR Deep Extragalactic Legacy Survey (CANDELS) is designed to document the first third of galactic evolution, from z approx. 8 - 1.5. It will image > 250,000 distant galaxies using three separate cameras on the Hubble Space Tele8cope, from the mid-UV to near-IR, and will find and measure Type Ia supernovae beyond z > 1.5 to test their accuracy as standard candles for cosmology. Five premier multi-wavelength sky regions are selected, each with extensive ancillary data. The use of five widely separated fields mitigates cosmic variance and yields statistically robust and complete samples of galaxies down to a stellar mass of 10(exp 9) solar mass to z approx. 2, reaching the knee of the UV luminosity function of galaxies to z approx. 8. The survey covers approximately 800 square arc minutes and is divided into two parts. The CANDELS/Deep survey (5(sigma) point-source limit H =27.7mag) covers approx. 125 square arcminutes within GOODS-N and GOODS-S. The CANDELS/Wide survey includes GOODS and three additional fields (EGS, COSMOS, and UDS) and covers the full area to a 50(sigma) point-source limit of H ? or approx. = 27.0 mag. Together with the Hubble Ultradeep Fields, the strategy creates a three-tiered "wedding cake" approach that has proven efficient for extragalactic surveys. Data from the survey are non-proprietary and are useful for a wide variety of science investigations. In this paper, we describe the basic motivations for the survey, the CANDELS team science goals and the resulting observational requirements, the field selection and geometry, and the observing design.

Grogin, Norman A.↗
NASA NTRS2009

The Deep Impact Network Experiment Operations Center Monitor and Control System

The Interplanetary Overlay Network (ION) software at JPL is an implementation of Delay/Disruption Tolerant Networking (DTN) which has been proposed as an interplanetary protocol to support space communication. The JPL Deep Impact Network (DINET) is a technology development experiment intended to increase the technical readiness of the JPL implemented ION suite. The DINET Experiment Operations Center (EOC) developed by JPL's Protocol Technology Lab (PTL) was critical in accomplishing the experiment. EOC, containing all end nodes of simulated spaces and one administrative node, exercised publish and subscribe functions for payload data among all end nodes to verify the effectiveness of data exchange over ION protocol stacks. A Monitor and Control System was created and installed on the administrative node as a multi-tiered internet-based Web application to support the Deep Impact Network Experiment by allowing monitoring and analysis of the data delivery and statistics from ION. This Monitor and Control System includes the capability of receiving protocol status messages, classifying and storing status messages into a database from the ION simulation network, and providing web interfaces for viewing the live results in addition to interactive database queries.

Delay/Disruption Tolerant Network (DTN)↗
DOE OSTI2021

Dynamic Distribution of High-Rate Data Processing from CERN to Remote HPC Data Centers

The prompt reconstruction of the data recorded from the Large Hadron Collider (LHC) detectors has always been addressed by dedicated resources at the CERN Tier-0. Such workloads come in spikes due to the nature of the operation of the accelerator and in special high load occasions experiments have commissioned methods to distribute (spill-over) a fraction of the load to sites outside CERN. The present work demonstrates a new way of supporting the Tier-0 environment by provisioning resources elastically for such spilled-over workflows onto the Piz Daint Supercomputer at CSCS. Furthermore, this is implemented using containers, tuning the existing batch scheduler and reinforcing the scratch file system, while still using standard Grid middleware. ATLAS, CMS and CSCS have jointly run selected prompt data reconstruction on up to several thousand cores on Piz Daint into a shared environment, thereby probing the viability of the CSCS high performance computer site as on demand extension of the CERN Tier-0, which could play a role in addressing the future LHC computing challenges for the high luminosity LHC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Technology Maturation of Wireless Harsh Environment Sensors For Improved Condition Based Monitoring Of Coal Fired Power Generation

The overall goal of this project was to demonstrate and develop the usage of high-temperature (HT) harsh-environment (HE) wireless surface acoustic wave resonator (SAWR) sensor technology to promote reliable maintenance through condition-based maintenance (CBM) for field applications in harsh service conditions associated with power plant environments. The project aimed to advance the HT HE wireless SAWR sensor technology from TRL 5 to TRL 7. In addition to HT HE wireless temperature sensing, efforts were dedicated during this project to investigate, develop and increase the TRL from 3 to 5 for the following technologies: (a) HT HE strain sensors to address additional CBM monitoring needs, such as boiler tube mechanical / thermal stresses, which can provide early indications for boiler tube cracking and failure; and (b) HT aluminum nitride (AlN) and scandium aluminum nitride (ScAlN) based piezoelectric thin film fabrication and implementation of SAW sensors, with the goal of releasing the need to use single crystal piezoelectric materials for SAWRs and thus broaden possible technology applications to non-planar and harder to modify surfaces. To achieve the goals mentioned above, UMaine and its partner, Environetix Technologies Corporation, established partnerships with the following power plants: Longview Power (Maidsville, WV), a coal-fired power plant; Penobscot Energy Recovery Corp (PERC, Orrington, ME), a waste-to-energy power plant; and the UMaine Steam Plant (Orono, ME), an oil / natural gas power plant. To realize wireless HT HE SAWR sensor systems in these harsh service conditions, the University of Maine research team worked with Environetix and these power plants to define, design, fabricate, test and validate a mature prototype wireless temperature SAWR sensor system for boiler tube applications within the HT HE of the reheater pass damper chamber to directly and wirelessly monitor the temperature at eighteen independent boiler tube locations. The system included three levels, or “tiers”, of wireless communication to enable remote monitoring: Tier 1, the wireless link in the reheater pass damper chamber directly accessing the sensors on the boilers; Tier 2, the wireless local area network link, transmitting processed sensor information within the power plant to the Tier 3, a commercial wireless signal carrier company for secure remote data monitoring outside of the power plant. Regarding the wireless sensor system installed at Longview Power, temperature information from the boilers was continuously transmitted from the Longview boilers at Maidsville, WV, to Environetix headquarters, Orono, ME, over a 34 month period, when the system was finally decommissioned. Strain sensors and piezoelectric ScAlN thin film sensors were successfully installed on the exhaust duct at the UMaine Steam Power plant. The advances in wireless strain sensors and thin film piezoelectric film fabrication and testing were performed mostly in UMaine laboratories and field tested at the UMaine Steam Plant, due to its close proximity to UMaine/Environetix, access to the plant facility, and due to difficulties in accessing the other power plants during the COVID shut-down period. The project accomplished the TRL level increase of the targeted CBM technologies through the successful fabrication, installation, test, and validation of dedicated and commercial wireless sensor systems, utilizing the three different power plants. The outcomes of this project, including the wireless sensor data capability, are expected to yield an advance for CBM in harsh power plant environments. The reduction of maintenance costs, improved safety during plant operation, and increased power plant efficiency will lead to increased revenues (i.e., fewer forced outages) due to better process monitoring enabled by the wireless HT HE SAWR temperature sensor technology.

20 FOSSIL-FUELED POWER PLANTS↗
NASA NTRS2005

A Reliable Service-Oriented Architecture for NASA's Mars Exploration Rover Mission

The Collaborative Information Portal (CIP) was enterprise software developed jointly by the NASA Ames Research Center and the Jet Propulsion Laboratory (JPL) for NASA's highly successful Mars Exploration Rover (MER) mission. Both MER and CIP have performed far beyond their original expectations. Mission managers and engineers ran CIP inside the mission control room at JPL, and the scientists ran CIP in their laboratories, homes, and offices. All the users connected securely over the Internet. Since the mission ran on Mars time, CIP displayed the current time in various Mars and Earth time zones, and it presented staffing and event schedules with Martian time scales. Users could send and receive broadcast messages, and they could view and download data and image files generated by the rovers' instruments. CIP had a three-tiered, service-oriented architecture (SOA) based on industry standards, including J2EE and web services, and it integrated commercial off-the-shelf software. A user's interactions with the graphical interface of the CIP client application generated web services requests to the CIP middleware. The middleware accessed the back-end data repositories if necessary and returned results for these requests. The client application could make multiple service requests for a single user action and then present a composition of the results. This happened transparently, and many users did not even realize that they were connecting to a server. CIP performed well and was extremely reliable; it attained better than 99% uptime during the course of the mission. In this paper, we present overviews of the MER mission and of CIP. We show how CIP helped to fulfill some of the mission needs and how people used it. We discuss the criteria for choosing its architecture, and we describe how the developers made the software so reliable. CIP's reliability did not come about by chance, but was the result of several key design decisions. We conclude with some of the important lessons we learned form developing, deploying, and supporting the software.

Mak, Ronald↗
DOE OSTI2021

Cross-correlation analysis of X-ray photon correlation spectroscopy to extract rotational diffusion coefficients

Coefficients for translational and rotational diffusion characterize the Brownian motion of particles. Emerging X-ray photon correlation spectroscopy (XPCS) experiments probe a broad range of length scales and time scales and are well-suited for investigation of Brownian motion. While methods for estimating the translational diffusion coefficients from XPCS are well-developed, there are no algorithms for measuring the rotational diffusion coefficients based on XPCS, even though the required raw data are accessible from such experiments. In this paper, we propose angular-temporal cross-correlation analysis of XPCS data and show that this information can be used to design a numerical algorithm (Multi-Tiered Estimation for Correlation Spectroscopy [MTECS]) for predicting the rotational diffusion coefficient utilizing the cross-correlation: This approach is applicable to other wavelengths beyond this regime. We verify the accuracy of this algorithmic approach across a range of simulated data.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1988

A fiber optic tactical voice/data network based on FDDI

An asynchronous high-speed fiber optic local area network is described that supports ordinary data packet traffic simultaneously with synchronous Tl voice traffic over a common FDDI token ring channel. A voice interface module was developed that parses, buffers, and resynchronizes the voice data to the packet network. The technique is general, however, and can be applied to any deterministic class of networks, including multi-tier backbones. A conventional single token access protocol was employed at the lowest layer, with fixed packet sizes for voice and variable for data. In addition, the higher layer packet data protocols are allowed to operate independently of those for the voice thereby permitting great flexibility in reconfiguring the network. Voice call setup and switching functions were performed external to the network with PABX equipment.

Bergman, L. A.↗