A User-level Infiniband-based File System and Checkpoint Strategy for Burst Buffers
Explore the source record for details and available documents.
Computer science↗
SEARCH · Search NASA
Results for “Computer Science - Operating Systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Time Series Dimension Reduction for Surrogate Models of Port Scanning Cyber Emulations
Surrogate model development is a key resource in the scientific modeling community for providing computational expedience when simulating complex systems without loss of great fidelity. The initial step to development of a surrogate model is identification of the primary governing components of the system. Principal component analysis (PCA) is a widely used data science technique that provides inspection of such driving factors, when the objective for modeling is to capture the greatest sources of variance inherent to a dataset. Although an efficient linear dimension reduction tool, PCA makes the fundamental assumption that the data is continuous and normally distributed. Thus, it provides ideal performance when these conditions are met. In the case for which cyber emulations provide realizations of a port scanning scenario, the data to be modeled follows a discrete time series function comprised of monotonically increasing piece-wise constant steps. The sources of variance are related to the timing and magnitude of these steps. Therefore, we consider using XPCA, an extension to PCA for continuous and discrete random variates. This report provides the documentation of the trade-offs between the PCA and XPCA linear dimension reduction algorithms, for the intended purpose to identify key components of greatest variance in our time series data. These components will ultimately provide the basis for future surrogate models of port scanning cyber emulations.
97 MATHEMATICS AND COMPUTING↗
Customisable X-ray fluorescence photodetector with submicron sensitivity using a ring array of silicon p-i-n diodes
Explore the source record for details and available documents.
99 GENERAL AND MISCELLANEOUS↗
2020 Multiscale Microbial Dynamics Modeling Course
The 2020 Multiscale Microbial Dynamics course is adapted from the virtual 2020 Mutliscale Microbial Dynamics Summer School that was hosted by Environmental Molecular Sciences Laboratory (EMSL), a U.S. Department of Energy (DOE) science user facility located on the Pacific Northwest National Laboratory (PNNL) campus, in collaboration with the Joint Genome Institute (JGI) and the DOE Systems Biology Knowledgebase (KBase). The course course covers how to incorporate microbial metagenomic and environmental metabolite data from watershed ecosystems into metabolic and community modeling using computational frameworks, such as KBase and PFLOTRAN. The curriculum includes lectures and software and data analysis tutorials. All materials are freely accessible to the community as part of the 2020 Microbial Dynamics Summer School Organization in KBase.
54 ENVIRONMENTAL SCIENCES↗
Initial User Study Insights Clarified Community Requirements & Early Feedback on Conceptual Design
The HPDF User Experience (UX) team conducted eight semi-structured interviews with twelve individuals leading data and computing infrastructure work at DOE Office of Science (SC) user facilities or projects. This report presents key takeaways synthesizing community perspectives and needs, along with recommendations for the project. These insights should be considered as conceptual design work continues, early partnerships begin, workflow readiness activities evaluate and enhance key scientific tools, and early access systems are made available to the Office of Science (SC) community. Vigilance in meeting community requirements and ensuring workflow readiness will be needed to ensure HPDF’s success.
97 MATHEMATICS AND COMPUTING↗
FireWorks: a Dynamic Workflow System Designed for High-Throughput Applications
This work introduces FireWorks, a workflow software for running high-throughput calculation workflows at supercomputing centers. FireWorks has been used to complete over 50 million CPU-hours worth of computational chemistry and materials science calculations at the National Energy Research Supercomputing Center. It has been designed to serve the demanding high-throughput computing needs of these applications, with extensive support for (i) concurrent execution through job packing, (ii) failure detection and correction, (iii) provenance and reporting for long-running projects, (iv) automated duplicate detection, and (v) dynamic workflows (i.e., modifying the workflow graph during runtime). We have found that these features are highly relevant to enabling modern data-driven and high-throughput science applications, and we discuss our implementation strategy that rests on Python and NoSQL databases (MongoDB). Finally, we present performance data and limitations of our approach along with planned future work.
97 MATHEMATICS AND COMPUTING↗
Quantum Optimization and Approximation Algorithms
Shor's groundbreaking quantum algorithm for integer factoring provides an exponential speedup over the best-known classical algorithms. In the 20 years since Shor's algorithm was conceived, only a handful of fundamental quantum algorithmic kernels, generally providing modest polynomial speedups over classical algorithms, have been invented. To better understand the potential advantage quantum resources provide over their classical counterparts, one may consider other resources than execution time of algorithms. Quantum Approximation Algorithms direct the power of quantum computing towards optimization problems where quantum resources provide higher-quality solutions instead of faster execution times. We provide a new rigorous analysis of the recent Quantum Approximate Optimization Algorithm, demonstrating that it provably outperforms the best known classical approximation algorithm for special hard cases of the fundamental Maximum Cut graph-partitioning problem. We also develop new types of classical approximation algorithms for finding near-optimal low-energy states of physical systems arising in condensed matter by extending seminal discrete optimization techniques. Our interdisciplinary work seeks to unearth new connections between discrete optimization and quantum information science.
97 MATHEMATICS AND COMPUTING↗
Nuclear Science User Facilities High Performance Computing FY 2021 End of Year HPC Utilization Report M3UF-21IN0701019
In FY21, INL HPC capabilities were utilized by a diverse set of computing and applied researchers, for a wide range of research and engineering activities. This report focuses on current INL HPC systems and utilization from October 1, 2020 through September 30, 2021.
99 GENERAL AND MISCELLANEOUS↗
Biological Electron Transfer and Catalysis EFRC
The focus of the Biological Electron Transfer and Catalysis (BETCy) EFRC research is elucidating mechanisms of conversion of electrochemical potential into chemical bond energy and is organized into two integrated Thrusts: Electron Bifurcation Catalysis and Electron Transfer Kinetics. We are developing a collective knowledge of metalloenzymes as models for redox reactions by applying physical science and computational tools to characterize biochemical reactions catalyzed by multi- subunit enzymes harboring arrays of iron-sulfur clusters and flavin cofactors. Understanding these mechanisms is central to overcoming the thermodynamic barriers that currently limit production of reduced products and fuels. Biological systems have elegant strategies for converting electrochemical potential energy into chemical bond energy (e.g., C-H, H-H, and N-H) stored in reduced compounds that can serve as advanced biofuels. One significant limitation for the production of highly reduced compounds is that their production in natural and industrial processes relies on low oxidation-reduction potential chemicals as feedstocks.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Fuel Cycle Technologies 2016 Achievements Report
The U.S. Department of Energy (DOE), Office of Nuclear Energy (DOE- NE) established the Fuel Cycle Technologies (FCT) program to address challenges such as growing stockpiles of used nuclear fuel (UNF) and high-level waste (HLW), and an urgency to enhance accident tolerance of the existing reactor fleet. Resolution of these challenges involves developing systems that reduce waste while improving resource utilization and safety. Towards this goal, the FCT program implemented a research and development (R&D) science-based approach, integratesing theory and experiment with high performance computing modeling and simulation. The FCT program establishes and strengthens collaborations with experts at international agencies, universities, and industry to develop the nuclear fuel cycle of the future. DOE-NE national laboratories and their international counterparts provide extensive expertise and experience and access to critical R&D facilities. Universities provide a wellspring of innovative ideas while industry provides the venue to integrate the expertise, experience, and ideas into commercial practice.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
A hierarchical evaluation framework for assessing climate simulations relevant to the energy-water-land nexus (Final Report)
The overarching goal was to construct a hierarchy of new and well-tested metrics and analysis tools that support both fundamental and use-inspired research. Motivating this goal was a convergence of needs from climate scientists and stakeholders alike for a systematic, robust framework of model evaluation and diagnosis to provide scientific insights, inform model development, support best practices for the use of climate model outputs, and facilitate communication of climate information in the evolving landscapes of multi-model, multi-resolution, and large ensemble simulations that generate terabytes of data for any single climate run. Steps toward attaining these goals benefited from expertise and established capability of the project team, which included leadership of the North American Regional Climate Change Assessment Program (NARCCAP) and the Coordinated Regional Downscaling Experiment (CORDEX), development of hierarchical model evaluation approaches, and successful research in the analysis and diagnosis of climate model skill, as well as the understanding and modeling of regional climate processes in North America. As part of the overarching goal, the project worked to disseminate a suite of methodologies, algorithms, and software components that the wider community can employ to advance climate science and applications. With rigorous demonstration, the evaluation framework and the mix of standard and high risk / high reward approaches helped form the basis for future development of a computationally enabled user-friendly system for community use.
17 WIND ENERGY↗
Artificial Intelligence and Computer Vision for Cost-Effective Benthic Habitat Characterizations
Machine learning applied to computer vision and pattern recognition is a type of artificial intelligence that has advanced rapidly in the last 10 to 15 years, spurred forward by breakthroughs in deep convolutional neural networks. These state-of-the-art methods are poised to become widely used in environmental monitoring applications as a result of the increasing abundance of data available from different imaging platforms (e.g., fixed-point cameras, drone surveys, high-resolution satellite data) that can be analyzed to observe, model, and understand environmental conditions. Computer vision and pattern recognition (CVPR) tools advance our ability to use imagery and camera-based tools in cost-effective ways for environmental monitoring. Although these techniques offer great potential, some challenges remain, such as the need for large sets of labeled images for model training and validation and optimized hardware and software to ensure that the models can be trained effectively and in a reasonable amount of time. Here, we have overcome many of these rate-limiting challenges by using a diverse image library built across multiple projects coupled with staff expertise and onsite computing resources. We are working toward a fully automated SPI processing system and also are moving to develop CVPR analytical tools for other imaging platforms and data sets.
02 PETROLEUM↗
The Building Science Advisor: A Web-Based Tool to Assess the Durability of Building Envelope Components
The Department of Energy (DOE) and Oak Ridge National Laboratory (ORNL) have developed an innovative new design tool that will put building science expert advice in the hands of every building designer who cares to manage moisture risk in high-R envelope components. As modern buildings become increasingly more airtight, constructed with modern labor-saving materials, and equipped with air-conditioning, they have become less forgiving to moisture intrusion. The Building Science Advisor (BSA) provides building science knowledge and advice based on expert experience, field measurements, laboratory tests, and computer simulations.BSA users are prompted to enter relevant information about the building location, design, and material selection options like cladding, structural system, and insulation. Influential factors such as climate, building air tightness, material properties, and internal moisture loads are also considered to estimate and compare the moisture durability performance of several design options. If the BSA deems the assembly’s performance unsatisfactory, it will provide the reasons why, and suggest necessary changes to wall design to ensure more robust performance.Using the BSA tool enables building designers to confidently select assembly design characteristics that achieve their design goals with the least moisture durability risk. Links to design-specific guidance are also be provided to help users manage any remaining risk. This tool will further enable DOE’s Building Technologies Office (BTO) to meet its long-term energy goal of a 50% reduction in building energy consumption by reducing builder concern about using highly energy efficient wall systems.
Desjarlais, Andre Omer↗
Development of a Multi-Sensor Data Science System Used for Signature Development on Solvent Extraction Processes in support of safeguards- an overview
A new nuclear fuel cycle test bed is being built at Idaho National Laboratory to support the purification of special nuclear material recovered from used fuel. The test bed provides an opportunity to research process flow and the application of computational tools in solvent extraction processes. A deeper understanding of process and equipment behavior coupled with real time data collection can indicate whether a process failure is accidental or purposeful. The goal of this project is to develop a system that utilizes non-traditional measurement sources such as vibration, acoustics, current, light, flow, and temperature in conjunction with data-based, machine learning techniques that will allow for signal discovery. This multi-sensor data can support the development of safeguards by design and security by design measures for such a facility. Additionally, it can aid in early detection and identification of removed materials indicating diversion, which is essential for initiating material recovery and actor identification. This overview encompasses the current research and testing of sensors to develop a spectrum of process signatures. To be followed by planned experiments aimed to characterize said signatures and study potential feature extraction techniques to identify a fault in the system (i.e. flow diversion).
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
Tusas: A fully implicit parallel approach for coupled phase-field equations
In this study, we develop a fully-coupled, fully-implicit approach for phase-field modeling of solidification in metals and alloys. Predictive simulation of solidification in pure metals and metal alloys remains a significant challenge in the field of materials science, as microstructure formation during the solidification process plays a critical role in the properties and performance of the solid material. Our simulation approach consists of a finite element spatial discretization of the fully-coupled nonlinear system of partial differential equations at the microscale, which is treated implicitly in time with a preconditioned Jacobian-free Newton-Krylov method. The approach is algorithmically scalable as well as efficient due to an effective preconditioning strategy based on algebraic multigrid and block factorization. We implement this approach in the open-source Tusas framework, which is a general, flexible tool developed in C++ for solving coupled systems of nonlinear partial differential equations. The performance of our approach is analyzed in terms of algorithmic scalability and efficiency, while the computational performance of Tusas is presented in terms of parallel scalability and efficiency on emerging heterogeneous architectures. We demonstrate that modern algorithms, discretizations, and computational science, and heterogeneous hardware provide a robust route for predictive phase-field simulation of microstructure evolution during additive manufacturing.
97 MATHEMATICS AND COMPUTING↗
FFT, FMM, and multigrid on the road to exascale: Performance challenges and opportunities
FFT, FMM, and multigrid methods are widely used fast and highly scalable solvers for elliptic PDEs. However, emerging large-scale computing systems are introducing challenges in comparison to current petascale computers. Recent efforts (Dongarra et al. 2011) have identified several constraints in the design of exascale software that include massive concurrency, resilience management, exploiting the high performance of heterogeneous systems, energy efficiency, and utilizing the deeper and more complex memory hierarchy expected at exascale. In this paper, we perform a model-based comparison of the FFT, FMM, and multigrid methods in the context of these projected constraints. Finally, we use performance models to offer predictions about the expected performance on upcoming exascale system configurations based on current technology trends.
97 MATHEMATICS AND COMPUTING↗
High pressure suppression of plasticity due to an overabundance of shear embryo formation
Abstract High pressure shear band formation is a critical phenomenon in energetic materials due to its influence on both mechanical strength and mechanochemical activation. While shear banding is known to occur in a variety of these materials, the governing dynamics of the mechanisms are not well defined for molecular crystals. We conduct molecular dynamics simulations of shock wave induced shear band formation in the energetic material 1,3,5-trinitroperhydro-1,3,5-triazine (RDX) to assess shear band nucleation processes. We find, that at high pressures, the initial formation sites for shear bands, “embryos”, form in excess and rapidly lower deviatoric stresses prior to shear band formation and growth. This results in the suppression of plastic deformation. A local cluster analysis is used to quantify and contrast this mechanism with a more typical shear banding seen at lower pressures. These results demonstrate a mechanism that is reversible in nature and that supersedes shear band formation at increased pressures. We anticipate that these results will have a broad impact on the modeling and development of high-strain rate application materials such as those for high explosives and hypersonic systems.
36 MATERIALS SCIENCE↗
Evaluation of In-Situ Analysis Strategies at Scale for Power Efficiency and Scalability
The increasing gap between available compute power and I/O capabilities is resulting in simulation pipelines running on leadership computing facilities being reformulated. In particular, in-situ processing is complementing conventional post-process analysis, however, it can be performed by using the same compute resources as the simulation or using secondary dedicated resources. In this paper, we focus on three different in-situ analysis strategies, which use the same compute resources as the ongoing simulation but different data movement strategies. We evaluate the costs incurred by these strategies in terms of run time, scalability and power/energy consumption. Furthermore, we extrapolate power behavior to peta-scale and investigate different design choices through projections. Experimental evaluation at full machine scale on Titan supports that using fewer cores per node for in-situ analysis is the optimum choice in terms of scalability. Hence, further research effort should be devoted towards developing in-situ analysis techniques following this strategy in future high-end systems.
97 MATHEMATICS AND COMPUTING↗