Search NASA⌕ Search

SEARCH · Search NASA

Results for “File Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Methods and apparatus for capture and storage of semantic information with sub-files in a parallel computing system

Techniques are provided for storing files in a parallel computing system using sub-files with semantically meaningful boundaries. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a plurality of sub-files. The method comprises the steps of obtaining a user specification of semantic information related to the file; providing the semantic information as a data structure description to a data formatting library write function; and storing the semantic information related to the file with one or more of the sub-files in one or more storage nodes of the parallel computing system. The semantic information provides a description of data in the file. The sub-files can be replicated based on semantically meaningful boundaries.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Storing files in a parallel computing system using list-based index to identify replica files

Improved techniques are provided for storing files in a parallel computing system using a list-based index to identify file replicas. A file and at least one replica of the file are stored in one or more storage nodes of the parallel computing system. An index for the file comprises at least one list comprising a pointer to a storage location of the file and a storage location of the at least one replica of the file. The file comprises one or more of a complete file and one or more sub-files. The index may also comprise a checksum value for one or more of the file and the replica(s) of the file. The checksum value can be evaluated to validate the file and/or the file replica(s). A query can be processed using the list.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

System and method of managing large data files

Disclosed are systems and software that provide a high-performance, extensible file format and web API for remote data access and a visual interface for data viewing, query, and analysis. The described system can support storage of raw spectroscopic data such as neural recording data, MSI data, metadata, and derived analyses in a single, self-describing format that may be compatible by a large range of analysis software.

Bowen, Benjamin P.↗
DOE OSTI2015

Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information

Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Advanced TidGen Power System - OpenFOAM Version 5 CFD Case Files

The TidGen Power System generates emission-free electricity from tidal currents and connects directly into existing grids using smart grid technology. The power system consists of three major subsystems: shore-side power electronics, mooring system, and turbine generator unit (TGU) device. This submission contains supporting CFD files, case files and geometry for the Advanced TidGen. TSR = Tip speed ratio Cp = Power coefficient Cl = Lift coefficient Cd = Drag coefficient

16 TIDAL AND WAVE POWER↗
DOE OSTI2017

Challenges and Opportunities of User-Level File Systemsfor HPC

The performance gap between magnetic disks and data processing on HPC systems has become that huge that an efficient data processing can only be achieved by introducing non-volatile memory (NVRAM) as a new storage tier. Although the benefits of hierarchical storage have been adequately demonstrated to the point that the newest leadership class HPC systems will employ burst buffers, critical questions remain for supporting hierarchical storage systems, including: How should we present hierarchical storage systems to user applications, such that they are easy to use and that application code is portable across systems? How should we manage data movement through a storage hierarchy for best performance and resilience of data? How do the particular I/O use cases mandate the way we manage data? There have been many efforts to explore this space in the form of file systems, with increasingly more implemented at the user level. This is because it is relatively easy to swap in new, specialized user-level file systems for use by applications on a case-by-case basis, as opposed to the current mainstream approach of using general-purpose, system-level file systems which may not be optimized for HPC workloads and must be installed by administrators. In contrast, file systems at the user level can be tailored for specific HPC workloads for high performance and can be used by applications without administrator intervention. Many user-level file system developers have found themselves “having to reinvent the wheel” to implement various optimizations in their file systems. Thus, a main goal of this meeting was to bring together experts in I/O performance, file systems, and storage, and collectively explore the space of current and future problems and solutions for I/O on hierarchical storage systems in order to begin a community effort in enabling user-level file system support for HPC systems. We had a lively week of learning about each other’s approaches as well as unique I/O use cases that can influence the design of a community-driven file and storage system standards. The agenda for this meeting contained talks from participants on the following high level topics: HPC storage and I/O support today; what do HPC users need for I/O; existing userlevel file system efforts; object stores and other alternative storage systems; and components for building user-level file systems. The talks were short and intended to be conversation starters for more in-depth discussions with the whole group. The participants engaged in lengthy discussions on various questions that arose from the talks including: Are we ready to program to a memory hierarchy versus block devices? Are the needs of HPC users reflected in our existing file systems and storage systems? Should we drop or keep POSIX moving forward? What do we mean when we say “user-level file system”? Do we all mean the same thing? How should the IO 500 benchmark be defined so it is fair and useful? and How are stage-in and stage-out actually going to work? The report for this seminar contains a record of the talks from the participants as well as the resulting discussions. Our hope is that the effort initiated during this seminar will result in long-term collaborations that will benefit the HPC community as a whole.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Representation and Impact of Water Head on Power System Planning and Operation

Representing water head information in power system model files, can provide a more realistic model of the system and thereby inform operation and planning personnel in the decision-making process. This article describes a procedure for modifying the power system model files (steady-state and dynamic) to represent water head information. Additionally, the impact of representing the water head on power system reliability studies including contingency analysis, cascading failure analysis and dynamic frequency response analysis has been investigated, using the modified power system models. This paper considers the detailed Western Electricity Coordination Council model during summer and winter conditions as the test system for the impact analysis. Results show that under reduced water head: 1) the number of critical voltage and branch flow violations increases; 2) chances of cascading failure and island formation increases; and 3) frequency nadir decreases as compared to those of the base cases where the water head information is not represented.

13 - HYDRO ENERGY↗
DOE OSTI2025

Data from: Short-Term Inhibition and Long-Term Enhancement of IrreversibleTrace Metal Binding to Goethite in Multi-Metal Systems

These files include the data used in all figures from the following paper: Short-Term Inhibition and Long-Term Enhancement of Irreversible Trace Metal Binding to Goethite in Multi-Metal Systems Below is a brief description of each of the figures and associated data. Fig 1. Ni adsorption isotherms to goethite in the presence and absence of Zn and Cd Fig 2. % of Ni, Zn, and Cd exchanged as a function of time in isotope exchange experiments conducted after 2 days, 30 days, and 60 days aging. Fig. 3. This shows the % of Ni, Cd, and Zn in single metal and mixed metal systems that is non-exchangeable, both in units of % non-exchangeable and in micromoles of metal per gram of goethite. Fig. 4. Particle size distributions of Ni-Zn and Ni-Cd systems after aging. Fig 5. Ni and Zn XANES fits for Ni-Cd and Ni-Zn systems after 30 and 60 days aging. Linear combination fits were performed between freshly adsorbed and incorporated phases (synthesized as Ni- or Zn-substituted goethite) to determine the proportions of each. Figure S1. Dissolved Metal Concentrations at the Start of Isotope Exchange Figure S2. Reactor pH with Aging Figure S3. Dissolved Cd and Ni Concentrations during Isotope Exchange Figure S4. Dissolved Zn and Ni Concentrations during Isotope Exchange Figure S5. Tracer Mole Fractions in Ni-Zn Isotope Exchange Experiments Figure S6. Tracer Mole Fractions in Ni-Cd Isotope Exchange Experiments

58 GEOSCIENCES↗
DOE OSTI2022

Study of reference burnup steps optimization in fuel segment data file generation for NEXUS/ANC9 code system

For any two-step core design code system, the cross-section files are the primary factor to determine the accuracy of the system prediction. For a once-through cross-section system to cover all potential applicable conditions, the system may need to perform tens of thousands state points of lattice calculations. These calculations take a significant amount of CPU times and computing power, especially when a fine or ultra-fine energy group library is used. As computer power increases, so does the calculational complexity. Therefore, it is important to make the lattice calculations effective and efficient. Based on the Westinghouse core design code system NEXUS/ANC9, this work focuses on the reference burnup steps used by the lattice code when performing the calculations. Following the fundamental cross-section methodology and analyzing the contribution of each individual terms, this study provides an applicable solution of the optimized reference burnup steps. The test results show that, with the existing cross-section methodology, it is possible to significantly reduce the lattice calculation cases and cross-section file generation time without sacrificing the accuracy of system prediction. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2016

Storing files in a parallel computing system based on user or application specification

Techniques are provided for storing files in a parallel computing system based on a user-specification. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a specification from the distributed application indicating how the plurality of files should be stored; and storing one or more of the plurality of files in one or more storage nodes of a multi-tier storage system based on the specification. The plurality of files comprise a plurality of complete files and/or a plurality of sub-files. The specification can optionally be processed by a daemon executing on one or more nodes in a multi-tier storage system. The specification indicates how the plurality of files should be stored, for example, identifying one or more storage nodes where the plurality of files should be stored.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Storing files in a parallel computing system based on user-specified parser function

Techniques are provided for storing files in a parallel computing system based on a user-specified parser function. A plurality of files generated by a distributed application in a parallel computing system are stored by obtaining a parser from the distributed application for processing the plurality of files prior to storage; and storing one or more of the plurality of files in one or more storage nodes of the parallel computing system based on the processing by the parser. The plurality of files comprise one or more of a plurality of complete files and a plurality of sub-files. The parser can optionally store only those files that satisfy one or more semantic requirements of the parser. The parser can also extract metadata from one or more of the files and the extracted metadata can be stored with one or more of the plurality of files and used for searching for files.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Distribution of Documents through the Robatel Technologies Client Portal - 16328

Robatel Technologies introduced the Client Portal section of the www.robateltech.com web site in 2015. This feature allows our customers to download quality documents at their convenience. Initially, the Client Portal will be used to distribute procedures for the RT-100 Type B transportation cask. After a user registers with the web site, Robatel verifies the user and assigns download privileges. The user next receives a confirmation e-mail and instructions on how to access the files. This system allows Robatel to efficiently distribute updated procedures, files, and drawings to all cask users immediately when new files are uploaded to the site. Users are automatically notified of the update. The web site also records and documents when files are downloaded and by whom. This feature ensures compliance with our quality management system by documenting when files are distributed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

State Requirements for Electric Distribution System Planning

Utilities have conducted distribution planning since they first began building and operating electricity systems. But filing these plans for regulatory and stakeholder review is a relatively recent phenomenon. This report summarizes legislative and regulatory requirements for regulated electric utilities to file some type of distribution system plan in 20 U.S. jurisdictions. Some plans focus on expedited cost recovery for certain types of distribution system improvements; other plans focus on investments for grid modernization or distributed energy resources. Increasingly, states are adopting requirements for Integrated Distribution Plans. Such plans provide holistic grid investment strategies that address state and local policies and increasing complexity at the grid edge. The report covers the following topics for distribution system plans, highlighting advanced practices: -State goals and objectives -Procedural requirements -Forecasting loads and distributed energy resources -Hosting capacity analysis -Baseline information requirements -Grid modernization strategy -Grid needs assessment -Non-wires solutions -Reliability and resilience analyses -Stakeholder engagement -Equity -Pilots -Coordination with other planning processes The report includes links to legislation; regulatory requirements, proceedings, and orders; and filed utility plans. The U.S. Department of Energy’s Office of Electricity provided funding support.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

"PoliMOR: A Policy Engine \"Made-to-Order\" for Automated and Scalable Data Management in Lustre"

Modern supercomputing systems are increasingly reliant on hierarchical, multi-tiered file and storage system architectures due to cost-performance-capacity trade-offs. Within such multi-tiered systems, data management services are required to maintain healthy utilization, performance, and capacity levels. We present PoliMOR, a pragmatic and reliable policy-driven data management framework. PoliMOR is composed of modular, single-purpose agents that gather file system metadata and enforce policies on storage systems. PoliMOR facilitates automated and scalable data management with customizable agents tailored to HPC facility-specific storage systems and policies. Our evaluations demonstrate the scalability and performance of PoliMOR both by its individual agents and as a collective entity. We believe PoliMOR is widely applicable across HPC facilities with large-scale data management challenges and will garner interest from the HPC community, given its flexible and open-source nature.

George, Anjus↗
DOE OSTI2022

Scalable access to shared files in a distributed system

Logic may pre-populate cache of compute nodes allocated to a user's session. Logic may access an image file of a global filesystem, the image file to comprise a first set of one or more files associated with a user session and a second set of one or more files upon which execution of the first set will depend. Logic may store the image file in local data storage of each compute node of a spanning tree of compute nodes allocated for the user session. Logic may unpack the image file based on the data. Logic may configure the local environment of each compute node in the spanning tree to identify a location in local memory of each of the files. And logic may initiate execution of a local filesystem service in each of the compute nodes of the spanning tree.

Oganezov, Alexander↗
DOE OSTI2019

Systems and methods for generating slice files from native CAD geometries

A system and method for improving the production of objects with fully defined CAD models by generating CAD slice files from the native CAD geometries for use by AM machines. An electronic processing element receives the CAD model having a native and/or neutral format with metadata, determines a desired resolution, slices the CAD model to create the slice files having a slice format (e.g., point, edge, surface, volume) and retaining the metadata, and evaluates the slice files to determine whether the resolution has been achieved. If so, the slice files are sent to the AM machine. If not, a new desired resolution is determined and the CAD model is re-sliced, which may include combining the slice files to regenerate the CAD model. A support structure for the object may be analyzed, and if distortion is predicted, a modified CAD model may be created and sliced to create modified slice files.

Vernon, Gregory J.↗
DOE OSTI2024

A Framework for Addressing Hydropower Modeling Gaps in Electric Grid Planning and Operational Studies [Slides]

Realistic representation of hydropower in power system planning and operation studies is extremely important as it helps in avoiding under/over-estimation of the services the hydro power units can provide. A framework and tools have been developed to account for hydrological conditions and modify power system models accordingly. For example, HyDat – data and AI driven platform, that provides that data required for editing the power system model files Collaborative effort with V&R Energy. Also, development of POM based tools have been performed, a) Tool1: editing .raw files with realistic current and maximum hydrogeneration and redispatch of other units, and b) Tool2: Editing .dyr files to represent water head, current and maximum generation. Finally the framework, HASP framework combines HyDat and V&R energy tools to produce modified power system model files. Key Take-away points from contingency analysis studies include a) the number of critical contingencies increases as the water levels are reduced (70%>75%>80%), and b) both the extent and the quality of dynamic response of the Hydropower unit is different with varying water head levels.

13 HYDRO ENERGY↗