Hobbes Node Virtualization Layer: System Software Infrastructure for Application Composition and Performance Isolation.
Abstract not provided.
Evans, Noah↗
SEARCH · Search NASA
Results for “system software”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Enabling Exascale Hardware and Software Design through Scalable System Virtualization (Final Report)
The purpose of this project has been to extend the state of the art of systems software for high-end computing (HEC) platforms, and to use systems software to better enable the evaluation of potential future HEC platforms, for example exascale platforms. Such platforms, and their systems software, have the goal of providing scientific computation at new scales, thus enabling new research in the physical sciences and engineering. Over time, the innovations in systems software for such platforms also become applicable to more widely used computing clusters, data centers, and clouds. This was a five-institution project, centered on the Palacios virtual machine monitor (VMM) systems software, a project begun at Northwestern, and originally developed in a previous collaboration between Northwestern University and the University of New Mexico. In this project, Northwestern (including via our subcontract to the University of Pittsburgh) contributed to the continued development of Palacios, along with other team members. We took the leadership role in (1) continued extension of support for emerging Intel and AMD hardware, (2) integration and performance enhancement of overlay networking, (3) connectivity with architectural simulation, (4) binary translation, and (5) support for modern Non-Uniform Memory Access (NUMA) hosts and guests. We also took a supporting role in support for specialized hardware for I/O virtualization, profiling, configurability, and integration with configuration tools. The efforts we led (1-5) were largely successful and executed as expected, with code and papers resulting from them. The project demonstrated the feasibility of a virtualization layer for HEC computing, similar to such layers for cloud or datacenter computing. For effort (3), although a prototype connecting Palacios with the GEM5 architectural simulator was demonstrated, our conclusion was that such a platform was less useful for design space exploration than anticipated due to inherent complexity of the connection between the instruction set architecture level and the microarchitectural level. For effort (4), we found that a code injection approach proved to be more fruitful. The results of our efforts are publicly available in the open source Palacios codebase and published papers, all of which are available from the project web site, v3vee.org. Palacios is currently one of the two codebases (the other being Sandia’s Kitten lightweight kernel) that underlies the node operating system for the DOE Hobbes Project, one of two projects tasked with building a systems software prototype for the national exascale computing effort.
97 MATHEMATICS AND COMPUTING↗
Time managed virtualization for simulating systems of systems
Software is an integral part of almost every non-trivial system. Yet simulation technologies to understand how software affects system performance lag behind what is available to understand physical behavior. This is not surprising. An abstract model of software tells us what it is supposed to do, not what it actually does. In this respect software is very different from a physical system. Kirchhoff’s laws predict the behavior of an electrical circuit with great precision. The mathematics of fluids do an adequate job of anticipating how a wing will perform in flight. Only the software itself, observed in operation, can tell us how it behaves.
97 MATHEMATICS AND COMPUTING↗
Relap-7: Advanced Nuclear Reactor Systems Analysis Software Package
Advanced Nuclear Reactor Systems Analysis Software Package
Martineau, RichardC.↗
Enabling Exascale Hardware and Software Design through Scalable System Virtualization (Final Report)
In this grant, we enhanced the Palacios virtual machine monitor to increase its scalability and suitability for addressing exascale system software design issues. This included a wide range of research on core Palacios features, large-scale system emulation, fault injection, perfomrance monitoring, and VMM extensibility. This research resulted in large number of high-impact publications in well-known venues, the support of a number of students, and the graduation of two Ph.D. students and one M.S. student. In addition, our enhanced version of the Palacios virtual machine monitor has been adopted as a core element of the Hobbes operating system under active DOE-funded research and development.
97 MATHEMATICS AND COMPUTING↗
XACC: a system-level software infrastructure for heterogeneous quantum–classical computing
Quantum programming techniques and software have advanced significantly over the past five years, with a majority focusing on high-level language frameworks targeting remote REST library APIs. As quantum computing architectures advance and become more widely available, lower-level, system software infrastructures will be needed to enable tighter, co-processor programming and access models. In this work, we present XACC, a system-level software infrastructure for quantum–classical computing that promotes a service-oriented architecture to expose interfaces for core quantum programming, compilation, and execution tasks. Additionally, we detail XACC's interfaces, their interactions, and its implementation as a hardware-agnostic framework for both near-term and future quantum–classical architectures. We provide concrete examples demonstrating the utility of this framework with paradigmatic tasks. Our approach lays the foundation for the development of compilers, associated runtimes, and low-level system tools tightly integrating quantum and classical workflows.
97 MATHEMATICS AND COMPUTING↗
Optimization of the configuration of manufacturing systems
Software for optimizing the configuration of manufacturing systems so as to reduce expenditures in all stages of the product life cycle is considered. Mathematical expressions are given for the three crossover operators used in the genetic optimization algorithm. A computational experiment indicates the most effective crossover operator.
42 ENGINEERING↗
Security Vulnerability and Mitigation in Photovoltaic Systems
Software and firmware vulnerabilities pose security threats to photovoltaic (PV) systems. When patches are not available or cannot be timely applied to fix vulnerabilities, it is important to mitigate vulnerabilities such that they cannot be exploited by attackers or their impacts will be limited when exploited. However, the vulnerability mitigation problem for PV systems has received little attention. This paper analyzes known security vulnerabilities in PV systems, proposes a multi-level mitigation framework and various mitigation strategies including neural network-based attack detection inside inverters, and develops a prototype system as a proof-of-concept for building vulnerability mitigation into PV system design.
14 SOLAR ENERGY↗
Performance Evaluation of Distributed Energy Resource Management Systems Using Software- and Hardware-in-the-Loop
Distributed energy resource management systems (DERMS) are an important emerging technology for coordinating distributed energy resources (DERs) integrated in power distribution networks. These solutions implement a software platform to monitor, control, and coordinate DERs in real time to provide aggregate grid services to the electric utility or distribution system operator. To move DERMS technology forward, research and performance validation in a laboratory environment are needed to ensure proper function of DERMS prior to field deployment. This presentation presents a generic hardware-in-the-loop (HIL) platform to evaluate performance of DERMS using software-in-the-loop (SIL) and power HIL. The platform provides realistic testing in a laboratory environment, including accurate modeling of full-scale distribution systems, DERMS software controllers, and at-power distributed energy resources (DERs), such as solar and battery inverters. Two case studies are presented to demonstrate how the platform can be used independently as an integrated development and validation approach for different projects. Laboratory testing results are included to showcase the voltage regulation performance of each study and the benefits of implementing such a platform for DERMS evaluation.
DERMS↗
SCA Tools - SCRM Value Add or Lossy Noise Machines
Software supply chain risk management (SCRM) depends upon accurate information regarding the software components that comprise any given software system. The collection of components included in a software package can be organized within a software bill of materials, or SBOM. SBOMs are ideally generated when the software components are put together, such as at compile time, but for many reasons that has not and is not always possible. For example, legacy or proprietary software packages often do not have SBOMs available to downstream consumers of that software. It’s not just end users that are affected, manufacturers themselves also must deal with this problem. To answer these questions, the market has seen the rise of several commercial software composition analysis (SCA) tools. These tools aim to peer into completed software systems, automatically identifying hidden software dependencies and looking up known vulnerabilities associated with those dependencies to enable end-users to enhance their cyber supply chain risk management processes. These tools are potentially a huge boon to end users of legacy and proprietary software – and a potential bane, depending on how accurate they are. This research asks that question – how accurate are currently available binary SCA tools – and provides answers to several other questions: What does it mean to be “accurate”? What limitations do the tools have in identifying common edge cases that take place in modern software development? Can they help you avoid a devastating supply chain attack, or is it all just noise? After researching SCA tools on the market, we identified three vendors that fit our use case and would provide analysis on compiled binaries. Using these tools, we submitted firmware for critical infrastructure devices for analysis and SBOM generation. The SBOM outputs were then cross referenced with SBOMs generated through manual analysis for comparison. In addition to the firmware samples, we also submitted edge case samples based off a popular open-source library that were specifically crafted to evaluate each tools’ ability to accurately identify components. These samples were customized to be consistent with modifications we have seen in modern software development as well as a couple that are representative of supply chain attacks.
97 MATHEMATICS AND COMPUTING↗
Personal Alarm System
Software that runs on smartphones and desktop web browsers and notifies border officials of radiation alarms. It displays images and data associated with an alarm and provides a variety of reports. DOE had a need for discrete notification. PAS replaces the lights and sounds of a Radiation Portal Monitor.
Source record↗
A Framework to Support the Fusion of Operation and Planning
The management of the nation’s power system has progressed to the point where the boundary lines between operations and planning are becoming blurred. The dynamic behavior of smart grid technologies brings pressures of incorporating the predictive capability from planning to enhance operations. These needs are requiring a smoother, better integrated interplay between the functional roles of planning and operations. This paper presents a framework to support the fusion of operation and planning. A case study of predicting the intra-hour deficiency in generation capability and ramping capacity and presenting the outputs to operators was conducted. The study shows the benefits of the fusion and the effectiveness of the framework. All the function blocks used in the study were built upon GridOPTICS Software System (GOSS), a software system middleware platform that facilitates deployment of new applications for the future power grid.
Framework↗
Hardware Specification and Reference Design for the Low-Cost, Interoperable, User-Centric, Supervisory Controller Kit for Small and Medium Size Commercial Buildings
Commercial buildings are responsible for approximately 20 percent of the total United States energy consumption and greenhouse gas emissions. Over 85 percent of these buildings lack building automation systems to manage the various building systems they have. Many of these buildings are small (< 50,000 square feet), underserved, and use rooftop units (RTUs) for heating, ventilation, and air-conditioning needs. Because these buildings lack proper control systems, they have several operational deficiencies that lead to excess energy consumption. Studies have shown that managing the RTU’s heating and cooling setpoints, schedules, setbacks, and optimal start times can result in 20 to 25 percent reduction in electricity consumption in small and medium commercial buildings (SMBs). In addition, improving the demand flexibility of these buildings will result in additional cost savings for the building owner. To address the needs of the SMBs, the Department of Energy’s Building Technologies Office jointly funded Pacific Northwest National Laboratory (PNNL) and Oak Ridge National Laboratory (ORNL) to design, develop, test, and validate a low-cost, interoperable, user-centric, retrofit supervisory controller kit (SC-SMB) that can be used to continuously optimize energy consumption and deliver demand flexibility of SMBs, including all-electric buildings, and provide a means for maximizing decarbonization benefits. The team also includes industry partners Edo and Intellimation. Previously, the team drafted an SC-SMB system specification document (Goodman et al. 2023). This document describes a reference design of a low-cost supervisory control system for SMBs, including the various hardware components, software system, and an example implementation of the reference design. The final release of the reference design is planned for December 2025. Section 2.0 of the report documents the relevant building types that the SC-SMB system is suitable for. Section 3.0 documents the various hardware components, their function, cost, whether they are off-the-shelve, support standard communication, etc., and the software system. An example deployment in a 10,000-sf building with six rooftop units, a hot water heater, solar, and storage is described in Section 4.0. The planned next steps are described in Section 5.0, and references are listed in Section 6.0.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
SoS-SDQN: System of Systems Software-defined Quantum Networking
Quantum networks are needed for quantum domain applications that may run across different network deployments - point-to-point, multi-node networks, and possibly across inter-domain quantum networks, like the quantum internet. Unlike classical computing networks, quantum networks involve heterogeneous systems nodes that currently require local and manual control. This needs a unified control approach to help them integrate, work seamlessly, and have global knowledge. Software-defined Networking (SDN) has been successfully leveraged in classical networking for seamless and software-driven control of network infrastructure and packet switching, but not in management of quantum network applications across heterogeneous systems. In this paper, we review the current state of the art and present early developments of a System-of-Systems Software-defined Quantum Networking architecture (SoS-SDQN), a generic architecture that supports software-driven quantum network experiments across heterogeneous quantum systems. The architecture modifies the generic SDN to address the domain requirements of quantum networks and proposes a multilevel SDQN to provide a global view of network status, running applications, and control of incorporated heterogeneous quantum systems. We also design and implement a SoS SouthBound Quantum Interface (SoS-SBQI), a quantum infrastructure protocol that abstracts automation of applications across the network.
Alnajjar, Anees [ORNL] (ORCID:0000000237101601)↗
The Minos Computing Library: Efficient Parallel Programming for Extremely Heterogeneous Systems
Hardware specialization has become the silver bullet to achieve efficient high performance, from Systems-on-Chip systems, where hardware specialization can be ``extreme'', to large-scale HPC systems. As the complexity of the systems increases, so does the complexity of programming such architectures in a portable way. This work introduces the Minos Computing Library (MCL), as system software, programming model, and programming model runtime that facilitate programming extremely heterogeneous systems. MCL supports the execution of several multi-threaded applications within the same compute node, performs asynchronous execution of application tasks, efficiently balances computation across hardware resources, and provides performance portability. We show that code developed on a personal desktop automatically scales up to fully utilize powerful workstations with 8 GPUs and down to power-efficient embedded systems. MCL provides up to 17.5x speedup over OpenCL on NVIDIA DGX-1 systems and up to 1.88x speedup on single-GPU systems. In multi-application workloads, MCL dynamically resource allocation provides up to 2.43x performance improvement over manual, static allocation of computing resources.
Gioiosa, Roberto↗
In Situ Data Infrastructure for Scientific Unit Testing Platform
Testing is a significant software development process for the management of software systems and scientific code. However, as the complexity of scientific codes increases, extra checks are needed to monitor impacts to dependent models and to verify system constraints. The software complexity also impedes the efforts of module developers and software engineers to rapidly develop and extend their code. Recently, we have developed an automatic methodology and prototype platform to facilitate scientific verification of individual functions within complex scientific codes. With this system, the scientific module builders are able to track variables conveniently in one module or track variables’ changes among different modules. In this paper, we present a procedure for automatic unit testing generation. For the interest of a general audience of this conference, we are emphasizing the technical details of integrating the In Situ data infrastructure into our platform. At the end of this paper, we have included an implementation of unit testing for the ACME Land Model (ALM) to demonstrate the usefulness and correctness of the platform. We have also used single- and multipoint checks to demonstrate the efficient variable tracking capability of this platform.
97 MATHEMATICS AND COMPUTING↗
XScan: An Integrated Tool for Understanding Open Source Community-Based Scientific Code
Many scientific communities have adopted community-based models that integrate multiple components to simulate whole system dynamics. The community software projects’ complexity, stems from the integration of multiple individual software components that were developed under different application requirements and various machine architectures, has become a challenge for effective software system understanding and continuous software development. The paper presents an integrated software toolkit called X-ray Software Scanner (in abbreviation, XScan) for a better understanding of large-scale community-based scientific codes. Our software tool provides support to quickly summarize the overall information of scientific codes, including the number of lines of code, programming languages, external library dependencies, as well as architecture-dependent parallel software features. The XScan toolkit also realizes a static software analysis component to collect detailed structural information and provides an interactive visualization and analysis of the functions. We use a large-scale community-based Earth System Model to demonstrate the workflow, functions and visualization of the toolkit. We also discuss the application of advanced graph analytics techniques to assist software modular design and component refactoring.
Zheng, Weijian↗
FOX: A Fault Oblivious Extreme-Scale Execution Environment
The FOX project, funded under the ASCR X-stack I program, developed systems software and runtime libraries for a new approach to the data and work distribution for massively parallel, fault oblivious application execution. Our work was motivated by the premise that exascale computing systems will provide a thousand-fold increase in parallelism and a proportional increase in failure rate relative to today’s machines. To deliver the capability of exascale hardware, the systems software must provide the infrastructure to support existing applications while simultaneously enabling efficient execution of new programming models that naturally express dynamic, adaptive, irregular computation; coupled simulations; and massive data analysis in a highly unreliable hardware environment with billions of threads of execution. Our OS research has prototyped new methods to provide efficient resource sharing, synchronization, and protection in a many-core compute node. We have experimented with alternative task/dataflow programming models and shown scalability in some cases to hundreds of thousands of cores. Much of our software is in active development through open source projects. Concepts from FOX are being pursued in next generation exascale operating systems. Our OS work focused on adaptive, application tailored OS services optimized for multi → many core processors. We developed a new operating system NIX that supports role-based allocation of cores to processes which was released to open source. We contributed to the IBM FusedOS project, which promoted the concept of latency-optimized and throughput-optimized cores. We built a task queue library based on distributed, fault tolerant key-value store and identified scaling issues. A second fault tolerant task parallel library was developed, based on the Linda tuple space model, that used low level interconnect primitives for optimized communication. We designed fault tolerance mechanisms for task parallel computations employing work stealing for load balancing that scaled to the largest existing supercomputers. Finally, we implemented the Elastic Building Blocks runtime, a library to manage object-oriented distributed software components. To support the research, we won two INCITE awards for time on Intrepid (BG/P) and Mira (BG/Q). Much of our work has had impact in the OS and runtime community through the ASCR Exascale OS/R workshop and report, leading to the research agenda of the Exascale OS/R program. Our project was, however, also affected by attrition of multiple PIs. While the PIs continued to participate and offer guidance as time permitted, losing these key individuals was unfortunate both for the project and for the DOE HPC community.
97 MATHEMATICS AND COMPUTING↗