SEARCH · Search NASA

Results for “HOC storage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

25 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Optimizing Error-Bounded Lossy Compression for Scientific Data With Diverse Constraints

Vast volumes of data are produced by today's scientific simulations and advanced instruments. These data cannot be stored and transferred efficiently because of limited I/O bandwidth, network speed, and storage capacity. Error-bounded lossy compression can be an effective method for addressing these issues: not only can it significantly reduce data size, but it can also control the data distortion based on user-defined error bounds. In practice, many scientific applications have specific requirements or constraints for lossy compression, in order to guarantee that the reconstructed data are valid for post hoc analysis. For example, some datasets contain irrelevant data that should be isolated in particular and users often have intuition regarding value ranges, geospatial regions, and other data subsets that are crucial for subsequent analysis. Existing state-of-the-art error-bounded lossy compressors, however, do not consider these constraints during compression, resulting in inferior compression ratios with respect to user's post hoc analysis, due to the fact that the data itself provides little or no value for post hoc analysis. In this work we address this issue by proposing an optimized framework that can preserve diverse constraints during the error-bounded lossy compression, e.g., cleaning the irrelevant data, efficiently preserving different precision for multiple value intervals, and allowing users to set diverse precision over both regular and irregular regions. We perform our evaluation on a supercomputer with up to 2,100 cores. Experiments with six real-world applications show that our proposed diverse constraints based error-bounded lossy compressor can obtain a higher visual quality or data fidelity on reconstructed data with the same or even higher compression ratios compared with the traditional state-of-the-art compressor SZ. Furthermore, our experiments also demonstrate very good scalability in compression performance compared with the I/O throughput of the parallel file system.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

An overview of data tools for representing and managing building information and performance data

Building information modeling (BIM) has been widely adopted for representing and exchanging building data across disciplines during building design and construction. However, BIM's use in the building operation phase is limited. With the increasing deployment of low-cost sensors and meters, as well as affordable digital storage and computing technologies, growing volumes of data have been collected from buildings, their energy services systems, and occupants. Such data are crucial to help decision makers understand what, how, and when energy is consumed in buildings—a critical step to improving building performance for energy efficiency, demand flexibility, and resilience. However, practical analyses and use of the collected data are very limited due to various reasons, including poor data quality, ad-hoc representation of data, and lack of data science skills. To unlock value from building data, there is a strong need for a toolchain to curate and represent building information and performance data in common standardized terminologies and schemas, to enable interoperability between tools and applications. This study selected and reviewed 24 data tools based on common use cases of data across the building life cycle, from design to construction, commissioning, operation, and retrofits. The selected data tools are grouped into three categories: (1) data dictionary or terminology, (2) data ontology and schemas, and (3) data platforms. The data are grouped into ten typologies covering most types of data collected in buildings. This study resulted in five main findings: (1) most data representation tools can represent their intended data typologies well, such as Green Button for smart meter data and Brick schema for metadata of sensors in buildings and HVAC systems, but none of the tools cover all ten types of data; (2) there is a need for data schemas to represent the basis of design data and metadata of occupant data; (3) standard terminologies such as those defined in BEDES are only adopted in a few data tools; (4) integrating data across various stages in the building life cycle remains a challenge; and (5) most data tools were developed and maintained by different parties for different purposes, their flexibility and interoperability can be improved to support broader use cases. Finally, recommendations for future research on building data tools are provided for the data and buildings community based on the FAIR principles to make data Findable, Accessible, Interoperable, and Reusable.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows

Scientific workflows are used almost universally across science domains for solving complex and largescale computing and data analysis problems. The importance of workflows is highlighted by the fact that they have underpinned some of the most significant discoveries of the past decades. Many of these workflows have significant computational, storage, and communication demands, and thus must execute on a range of large-scale computer systems, from local clusters to public clouds and upcoming exascale HPC platforms. Managing these executions is often a significant undertaking, requiring a sophisticated and versatile software infrastructure. Historically, infrastructures for workflow execution consisted of complex, integrated systems, developed in-house by workflow practitioners with strong dependencies on a range of legacy technologies—even including sets of ad hoc scripts. Due to the increasing need to support workflows, dedicated workflow systems were developed to provide abstractions for creating, executing, and adapting workflows conveniently and efficiently while ensuring portability. While these efforts are all worthwhile individually, there are now hundreds of independent workflow systems. These workflow systems are created and used by thousands of researchers and developers, leading to a rapidly growing corpus of workflows research publications. The resulting workflow system technology landscape is fragmented, which may present significant barriers for future workflow users due to many seemingly comparable, yet usually mutually incompatible, systems that exist. In order to tackle some of the challenges described above, the DOE-funded ExaWorks and NSF-funded WorkflowsRI projects have organized in 2021 a series of events entitled the “Workflows Community Summit”. The third edition of the “Workflows Community Summit” explored workflows challenges and opportunities from the perspective of computing centers and facilities. This third summit builds on two prior summits (https://workflowsri.org/summits) that (i) established a high level vision for workflows research; and (ii) explored technical approaches for realizing that vision. The third summit brought together a small group of facilities representatives with the aim to understand how workflows are currently being used at each facility, how facilities would like to interact with workflow developers and users, how workflows fit with facility roadmaps, and what opportunities there are for tighter integration between facilities and workflows. This report documents and organizes the wealth of information provided by the participants before, during, and after the summit.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Project 2.8: Biological Specimen Repository for the Mayak Project

Curation of the existing specimens, including Standard Operating Procedures: The Southern Urals Biophysics Institute (SUBI) will continue to manage the day-to-day operations of the biorepository, but will have to assume the financial costs of maintaining and purchasing equipment such as freezers; Standard Operating Procedures are already in place for all aspects of the operations, and the Georgetown University team will be available on a voluntary and ad hoc basis to answer any technical questions in the future. Acquisition and tracking of new specimens: SUBI will decide on the collection of new tissues and blood samples in the future, and on what scale, depending on available resources and research needs. The Georgetown University team is willing to provide advice on a voluntary and ad hoc basis. Procedures for receiving and approving specimen requests from users: SUBI can take over this function; Chris Loffredo and other qualified research scientists at Georgetown University would be willing to serve as Tissue Review Committee members on a voluntary and ad hoc basis. Biospecimens remaining at Georgetown University: pursuant to the original terms of the Biospecimen Transfer Agreement between SUBI and Georgetown University, all unused portions of specimens (FFPE blocks, slides, and frozen tissues) will be returned to SUBI at the conclusion of the approved scientific research for which they were transferred. It was anticipated that the return shipment of biospecimens would occur in the fall of 2023. However, at this time, due to international developments, there are no shipping companies who can provide such deliveries to Russia. For now, the biospecimens can remain at Georgetown University where they are stored at the Genomics and Epigenomics Shared Resource. There have not been any storage costs to date, but this could change in the future.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Scalable In Situ Computation of Lagrangian Representations via Local Flow Maps

In situ computation of Lagrangian flow maps to enable post hoc time-varying vector field analysis has recently become an active area of research. However, the current literature is largely limited to theoretical settings and lacks a solution to address scalability of the technique in distributed memory. To improve scalability, we propose and evaluate the benefits and limitations of a simple, yet novel, performance optimization. Our proposed optimization is a communication-free model resulting in local Lagrangian flow maps, requiring no message passing or synchronization between processes, intrinsically improving scalability, and thereby reducing overall execution time and alleviating the encumbrance placed on simulation codes from communication overheads. To evaluate our approach, we computed Lagrangian flow maps for four time-varying simulation vector fields and investigated how execution time and reconstruction accuracy are impacted by the number of GPUs per compute node, the total number of compute nodes, particles per rank, and storage intervals. Our study consisted of experiments computing Lagrangian flow maps with up to 67M particle trajectories over 500 cycles and used as many as 2048 GPUs across 512 compute nodes. In all, our study contributes an evaluation of a communication-free model as well as a scalability study of computing distributed Lagrangian flow maps at scale using in situ infrastructure on a modern supercomputer.

Sane, Sudhanshu↗

DOE OSTI2022

Beam and Spin Optics Simulation Tutorials, Using Zgoubi Exercises and Solutions 2 - RHIC Run 22 Spin Transparency Experiment

High electron and ion polarizations are paramount design requirements for the future Electron Ion Collider (EIC) at BNL. A “spin transparency” mode of operation, inherited from the “figure-8” ring design [1], allows preservation and control of electron and ion spin polarization in a collider or storage ring [2, 3]. It makes the ring lattice “invisible” to the spin and allows for polarization control by small quasi-static magnetic fields with practically no effect on beam orbital parameters. Beam polarization can then be fully controlled by small adjustments of snake axis orientation (a few degrees) and snake strengths (a few percent); polarization orientation at IPs can be controlled without spin rotators, spins can be adiabatically flipped without the need of ac magnets. The transparent spin mode has been demonstrated in simulations [2] for the purpose of being tested experimentally during RHIC Run 22. This experiment was aimed at providing data to validate the principles. Yellow RHIC ring (Fig. 1.1) was configured in the transparent spin mode by aligning the axes of its two helical snakes (located respectively in the 3 o’clock and 9 o’clock sextants) parallel to the longitudinal axis. Experiment goals and expected results, ad hoc procedures and hardware requirements, are addressed in Refs. [2, 3].

43 PARTICLE ACCELERATORS↗

DOE OSTI2023

The Energy Transition: Advanced Nuclear Needed but Address Climate Vulnerabilities Now

The term “Energy Transition” is an attempt to capture an elaborate set of activities related to the modernization and decarbonization of energy grids. Performed concurrently and often in an ad hoc manner across local, state, regional and national boundaries, it is bringing chaos to what should arguably be one of the most conservatively managed of all critical infrastructure sectors. What’s more, with climate change producing an increasing tempo of extreme events, confidence in the intended resilient and redundant structure of the electric grids is likely to ebb. Even without these climate induced stressors, the nation’s electric grid was built for an earlier century. In addition to a drive towards greater efficiency via digitization and a continuing price decline in distributed energy resources (DERs), one could argue that climate change concerns are the primary driver of the energy transition. Non-CO2 emitting generation sources like wind and solar have become an important part of the overall generation fleet, albeit ones that cannot be counted upon to provide dispatchable power. Current projections indicate deployment of even larger percentages of DERs in coming years. Until far better storage capabilities arrive, the variability of wind and solar, inconsistent performance of traditional thermal generation plants, and energy delivery failures associated with natural gas pipelines will reinforce mounting reliability concerns. This pertains to both electric transmission and distribution. The recent shuttering of nuclear power plants in Germany, Japan, the US and elsewhere are also putting more downward pressure on dispatchable generation. Russia’s attack on Ukraine has roiled energy markets worldwide and forced some countries to return to coal as a primary fuel. In view circumstances such as these, it is essential that significant changes be made to policies and planning criteria, and to the standards and code on which they are based. Given the accelerating pace of extreme weather events, this needs to occur as soon as possible.

24 POWER TRANSMISSION AND DISTRIBUTION↗