Search NASA⌕ Search

SEARCH · Search NASA

Results for “Low Level Virtual Machine”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

GAHLS: an optimized graph analytics based high level synthesis framework

The urgent need for low latency, high-compute and low power on-board intelligence in autonomous systems, cyber-physical systems, robotics, edge computing, evolvable computing, and complex data science calls for determining the optimal amount and type of specialized hardware together with reconfigurability capabilities. With these goals in mind, we propose a novel comprehensive graph analytics based high level synthesis (GAHLS) framework that efficiently analyzes complex high level programs through a combined compiler-based approach and graph theoretic optimization and synthesizes them into message passing domain-specific accelerators. This GAHLS framework first constructs a compiler-assisted dependency graph (CaDG) from low level virtual machine (LLVM) intermediate representation (IR) of high level programs and converts it into a hardware friendly description representation. Next, the GAHLS framework performs a memory design space exploration while account for the identified computational properties from the CaDG and optimizing the system performance for higher bandwidth. The GAHLS framework also performs a robust optimization to identify the CaDG subgraphs with similar computational structures and aggregate them into intelligent processing clusters in order to optimize the usage of underlying hardware resources. Finally, the GAHLS framework synthesizes this compressed specialized CaDG into processing elements while optimizing the system performance and area metrics. Evaluations of the GAHLS framework on several real-life applications (e.g., deep learning, brain machine interfaces) demonstrate that it provides 14.27× performance improvements compared to state-of-the-art approaches such as LegUp 6.2.

97 MATHEMATICS AND COMPUTING↗

Greggd

greg(g)d - Global runtime for eBPF-enabled gathering (w/ gumption) daemon Recently the linux kernel has added support for low-level kernel monitoring and profiling through a in-kernel virtual machine. The tooling around these new features (the extended Berkley Packet Filter or eBPF for short) is not mature and is difficult to use. Benefits from eBPF are especially hard to realize while trying to do large scale deployments and integrate with existing metric analysis stacks. A tool was needed to enable loading and collecting data from eBPF programs on large scale HPC systems. Given the problems above it was obvious we needed some wrapper program to compile, load, and collect data from eBPF programs running in the kernel. This tool needed to be lightweight without a heavy set of dependencies, relatively stable between different kernel versions, and integrate nicely with existing widely used metric collection tools. We wrote a program that wraps the eBPF tooling and sends data to our metric gathering tool. eBPF programs are either compiled using the host compiler stack, or loaded in the kernel directly from an object file. These programs are then attached to the system calls that we want to profile. Whenever these system calls are run, the eBPF program collects information of interest and writes that to memory. Our wrapper program polls these memory locations, reads and formats the data, then sends the information to a local unix socket. Our other monitoring tools are configured to read from that socket and send it to the rest of our metric monitoring stack for analysis.

Voss, Joseph [Oak Ridge National Lab. (ORNL), Oak ↗

Advanced Tri-lab Software Environment (ATSE)

The Advanced Tri-lab Software Environment (ATSE) is an effort to build an open, modular, extensible, community-engaged, and vendor-adaptable software ecosystem that enables the prototyping of new technologies for improving the ASC computing environment. The initial target for ATSE is to accelerate the maturity of the Arm ecosystem for supporting ASC computing and the high-performance computing community more broadly. ATSE provides an integrated and optimized software stack that includes: 1) Application development environment and libraries including compilers, math libraries, tools, MPI, and OpenMP, 2) Low-level system software including optimized Linux, network stack, file systems, containers, and virtual machines, 3) Job scheduling and management including workload manager, application launcher, and user tools, and 4) System administration and management tools supporting booting, monitoring, and operating system image management. SAND2020-12377 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Younge, Andrew J.↗

Simplifying virtual machine introspection using LibVMI

Ensuring the security of a computer system requires the careful integration of many components. Key among these is security monitoring. Recent research trends show an increasing acceptance of external host-based monitoring techniques such as virtual machine introspection (VMI), a technique for viewing the runtime state of a virtual machine (VM). VMI’s primary drawbacks include performance and the semantic gap problem (i.e., understanding the low-level information available through VMI). This report describes work performed under an Early Career Laboratory Directed Research and Development (LDRD) project that aimed to address these two key challenges. Our results are promising, with significant performance improvements and a much more usable VMI programming environment. This work resulted in the creation and release of LibVMI, an open source software project based on the author’s previous work with the XenAccess library.

Payne, Bryan D.↗

Quantum Virtual Machine (QVM)

There is a lack of state-of-the-art HPC simulation tools for simulating general quantum computing. Furthermore, there are no real software tools that integrate current quantum computers into existing classical HPC workflows. This product, the Quantum Virtual Machine (QVM), solves this problem by providing an extensible framework for pluggable virtual, or physical, quantum processing units (QPUs). It enables the execution of low level quantum assembly codes and returns the results of such executions.

McCaskey, AlexanderJ.↗

Quantum Virtual Machine (QVM)

There is a lack of state-of-the-art HPC simulation tools for simulating general quantum computing. Furthermore, there are no real software tools that integrate current quantum computers into existing classical HPC workflows. This product, the Quantum Virtual Machine (QVM), solves this problem by providing an extensible framework for pluggable virtual, or physical, quantum processing units (QPUs). It enables the execution of low level quantum assembly codes and returns the results of such executions.

McCaskey, Alexander J.↗

A case for Virtual Machine based Fault Injection in a High-Performance Computing Environment

Large-scale computing platforms provide tremendous capabilities for scientific discovery. These systems have hundreds of thousands of computing cores, hundreds of terabytes of memory, and enormous high-performance interconnection networks. These systems are facing enormous challenges to achieve performance at such scale. Failures are an Achilles heel of these enormous systems. As applications and system software scale up to multi-petaflop and beyond to exascale platforms, the occurrence of failure will be much more common. This has given rise to a push in fault-tolerance and resilience research for HPC systems. This includes work on log analysis to identify types of failures, enhancements to the Message Passing Interface (MPI) to incorporate fault awareness, and a variety of fault tolerance mechanisms that span redundant computation, algorithm based fault tolerance, and advanced checkpoint/restart techniques. While there is much work to be done on the FT/Resilience mechanisms for such large-scale systems, there is also a profound gap in the tools for experimentation. This gap is compounded by the fact that HPC environments have stringent performance requirements and are often highly customized. The tool chain for these systems are often tailored for the platform and while the majority of systems on the Top500 Supercomputer list run Linux, these operating environments typically contain many site/machine specific enhancements. Therefore, it is desirable to maintain a consistent execution environment to minimize end-user (scientist) interruption. The work on system-level virtualization for HPC system offers a unique opportunity to maintain a consistent execution environment via a virtual machine (VM). Recent work on virtualization for HPC has shown that low-overhead, high performance systems can be realized. Virtualization also provides a clean abstraction for building experimental tools for investigation into the effects of failures in HPC and the related research on FT/Resilience mechanisms and policies. In this paper we discuss the motivation for tools to perform fault injection in an HPC context, and outline an approach that can leverage virtualization.

99 GENERAL AND MISCELLANEOUS↗

ROBOT: A Tool for Automating Ontology Workflows

BACKGROUND:Ontologies are invaluable in the life sciences, but building and maintaining ontologies often requires a challenging number of distinct tasks such as running automated reasoners and quality control checks, extracting dependencies and application-specific subsets, generating standard reports, and generating release files in multiple formats. Similar to more general software development, automation is the key to executing and managing these tasks effectively and to releasing more robust products in standard forms. For ontologies using the Web Ontology Language (OWL), the OWL API Java library is the foundation for a range of software tools, including the Protégé ontology editor. In the Open Biological and Biomedical Ontologies (OBO) community, we recognized the need to package a wide range of low-level OWL API functionality into a library of common higher-level operations and to make those operations available as a command-line tool. RESULTS:ROBOT (a recursive acronym for "ROBOT is an OBO Tool") is an open source library and command-line tool for automating ontology development tasks. The library can be called from any programming language that runs on the Java Virtual Machine (JVM). Most usage is through the command-line tool, which runs on macOS, Linux, and Windows. ROBOT provides ontology processing commands for a variety of tasks, including commands for converting formats, running a reasoner, creating import modules, running reports, and various other tasks. These commands can be combined into larger workflows using a separate task execution system such as GNU Make, and workflows can be automatically executed within continuous integration systems. CONCLUSIONS:ROBOT supports automation of a wide range of ontology development tasks, focusing on OBO conventions. It packages common high-level ontology development functionality into a convenient library, and makes it easy to configure, combine, and execute individual tasks in comprehensive, automated workflows. This helps ontology developers to efficiently create, maintain, and release high-quality ontologies, so that they can spend more time focusing on development tasks. It also helps guarantee that released ontologies are free of certain types of logical errors and conform to standard quality control checks, increasing the overall robustness and efficiency of the ontology development lifecycle.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Control of Low-Inertia Power Systems

Electric power systems are undergoing an unprecedented transition from fossil fuel–based power plants to low-inertia systems that rely predominantly on power electronics and renewable energy resources. This article reviews the resulting control challenges and modeling fallacies, at both the device and system level, and focuses on novel aspects or classical concepts that need to be revised in light of the transition to low-inertia systems. To this end, we survey the literature on modeling of low-inertia systems, review research on the control of grid-connected power converters, and discuss the frequency dynamics of low-inertia systems. Moreover, we discuss system-level services from a control perspective. Overall, we conclude that the system-theoretic mindset is essential to bridge different research communities and understand the complex interactions of power electronics, electric machines, and their controls in large-scale low-inertia power systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Parallel processing of filtered queries in attributed semantic graphs

Execution of complex analytic queries on massive semantic graphs is a challenging problem in big-data analytics that requires high-performance parallel computing. In a semantic graph, vertices and edges carry attributes of various types and the analytic queries typically depend on the values of these attributes. Thus, the computation must view the graph through a filter that passes only those individual vertices and edges of interest. Previous investigations have developed Knowledge Discovery Toolbox (KDT), a sophisticated Python library for parallel graph computations. In KDT, the user can write custom graph algorithms by specifying operations between edges and vertices ( semiring operations ). The user can also customize existing graph algorithms by writing filters. While the high-level language for this customization enables domain scientists to productively express their graph analytics requirements, the customized queries perform poorly due to the overhead of having to call into the Python virtual machine for each vertex and edge. In this work, we use the Selective Embedded Just-In-Time Specialization (SEJITS) approach to automatically translate semiring operations and filters defined by programmers into a lower-level efficiency language, bypassing the upcall into Python. We evaluate our approach by comparing it with the high-performance Combinatorial BLAS engine and show that our approach combines the benefits of programming in a high-level language with executing in a low-level parallel environment. We increase the system's flexibility by developing techniques that provide users with the ability to define new vertex and edge types from Python. We also present a new Roofline model for graph traversals and show that we achieve performance that is significantly closer to the bounds suggested by the Roofline. Finally, to further understand the complex interaction with the underlying architecture, we present an analysis using performance counters that quantifies the improvement in hardware behavior in the context our SEJITS methodology. Comprehensively, we demonstrate the first known solution to the problem of obtaining high performance from a productivity language when applying graph algorithms selectively on semantic graphs with hundreds of millions of edges and scaling to thousands of processors for graphs.

97 MATHEMATICS AND COMPUTING↗

Software Synthesis for High Productivity Exascale Computing

Over the three years of our project, we accomplished three key milestones: We demonstrated how ideas from generative programming and software synthesis can help support the development of bulk-synchronous distributed memory kernels. These ideas are realized in a new language called MSL, a C-like language that combines synthesis features with high level notations for array manipulation and bulk-synchronous parallelism to simplify the semantic analysis required for synthesis. We also demonstrated that these high level notations map easily to low level C code and show that the performance of this generated code matches that of handwritten Fortran. Second, we introduced the idea of solver-aided domain-specific languages (SDSLs), which are an emerging class of computer-aided programming systems. SDSLs ease the construction of programs by automating tasks such as verification, debugging, synthesis, and non-deterministic execution. SDSLs are implemented by translating the DSL program into logical constraints. Next, we developed a symbolic virtual machine called Rosette, which simplifies the construction of such SDSLs and their compilers. We have used Rosette to build SynthCL, a subset of OpenCL that supports synthesis. Third, we developed novel numeric algorithms that move as little data as possible, either between levels of a memory hierarchy or between parallel processors over a network. We achieved progress in three aspects of this problem. First we determined lower bounds on communication. Second, we compared these lower bounds to widely used versions of these algorithms, and noted that these widely used algorithms usually communicate asymptotically more than is necessary. Third, we identified or invented new algorithms for most linear algebra problems that do attain these lower bounds, and demonstrated large speed-ups in theory and practice.

97 MATHEMATICS AND COMPUTING↗

Success in commissioning a key U.S. radioactive waste burial site through the technical support of Dufrane Nuclear Shielding Incorporated (DNSI) - 15476

With the -phase out- of the South Carolina based Barnwell Radioactive Waste Burial Site, and the stockpile and storage of radioactive waste and irradiated components throughout the U.S. Nuclear Industry for decades, the opening of the Texas Low-Level Radioactive Waste Disposal Compact Facility by Waste Control Specialists (WCS), is a game changer in solving this industry-wide issue. For the first time in decades, generators now have the opportunity to send their waste to a site specifically designed to permanently sequester the waste in a licensed facility that will protect public health and the environment, better than any built to date. As history has shown through the many decades of the U.S. Commercial and Federal Nuclear Industry, site operators and management have relied heavily on contractors and vendors with exceptional expertise and decades of experience to achieve success and meet their goals. The commissioning of WCS was no exception as DNSI was contracted to design, develop, build and deploy a major component required for the opening and successful operation of the WCS site. This component, being the Modular Concrete Canister (MCC), is the -work horse- of the site. With its enormous size, weight and strength, it provides many functions that meet and comply with the site performance assessment (PA) under 10 CFR Part 61, the site WAC, and Texas Low-Level Radioactive Waste Disposal Authority. Offsite contracting the production and delivery of this critical component was a major step toward success in meeting schedule and cost for the much needed opening of the Texas Compact and Federal site. In selecting a shielding vendor, WCS partnered with a U.S. Nuclear Service company with over 30 years of experience which spans the entire U.S. Commercial, Federal, and Nuclear Industry. The task given DNSI was not a simple one, it involved every aspect from start to finish of the design, production and delivery of rectangular, cylindrical and -irradiated hardware- (IH) MCCs, that could accept waste up to 100 Sv /Hr contact dose rates. The enormity of this project was quite clear and required extensive quality control, construction of batch plants, purchase of huge quantities of raw materials, setting up a production site in a neighboring city, relocation of personnel from company headquarters, and safely transporting 8,000 Tons of MCC components 75 miles one-way on West Texas highways daily. Most important of all, this was accomplished safely with no incidents, no component failures or rejects, and on schedule. The start of receipt, of -in-compact waste- and -out-of-compact waste- was conducted virtually in a 3 month period time span. To help guarantee success and quality of product, all forms had surfaces machined, heavy duty elastomer coatings were applied to concrete surfaces, only galvanized anchors were used, and the batch plant was run to strict ASME standards thus testing every 50 cubic yards of concrete poured. With significant teamwork and success from Vendors such as DNSI, WCS and the Texas Compact has evolved as one of the leading radioactive waste sites in the U.S. and the world, providing safe, secure and compliant permanent waste disposal services by using technical expertise and innovation of the highest standards. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

: A Scalable and Transparent System for Simulating MPI Programs

is a scalable, transparent system for experimenting with the execution of parallel programs on simulated computing platforms. The level of simulated detail can be varied for application behavior as well as for machine characteristics. Unique features of are repeatability of execution, scalability to millions of simulated (virtual) MPI ranks, scalability to hundreds of thousands of host (real) MPI ranks, portability of the system to a variety of host supercomputing platforms, and the ability to experiment with scientific applications whose source-code is available. The set of source-code interfaces supported by is being expanded to support a wider set of applications, and MPI-based scientific computing benchmarks are being ported. In proof-of-concept experiments, has been successfully exercised to spawn and sustain very large-scale executions of an MPI test program given in source code form. Low slowdowns are observed, due to its use of purely discrete event style of execution, and due to the scalability and efficiency of the underlying parallel discrete event simulation engine, sik. In the largest runs, has been executed on up to 216,000 cores of a Cray XT5 supercomputer, successfully simulating over 27 million virtual MPI ranks, each virtual rank containing its own thread context, and all ranks fully synchronized by virtual time.

97 MATHEMATICS AND COMPUTING↗

MODELING OF HIGH SPEED FRICTION STIR SPOT WELDING USING A LAGRANGIAN FINITE ELEMENT APPROACH

Friction stir spot welding (FSSW) has been shown to be capable of joining steels of very high strength, while also being very flexible in terms of controlling the heat of welding and the resulting microstructure of the joint. This makes FSSW a potential alternative to resistance spot welding (RSW) if tool life is sufficiently high, and if machine spindle loads are sufficiently low so that the process can be implemented on an industrial robot. Robots for spot welding can typically sustain vertical loads of about 8kN, but FSSW at tool speeds of less than 3000 rpm cause loads that are too high, in the range of 11-14 kN. Therefore, in the current work tool speeds of 3000 rpm and higher were employed, in order to generate heat more quickly and to reduce welding loads to acceptable levels. The FSSW process was modeled using a finite element approach with the Forge® software package. An updated Lagrangian scheme with explicit time integration was employed to model the flow of the sheet material, subjected to boundary conditions of a rotating tool and a fixed backing plate [3]. The modeling approach can be described as two-dimensional, axisymmetric, but with an aspect of three dimensions in terms of thermal boundary conditions. Material flow was calculated from a velocity field which was two dimensional, but heat generated by friction was computed using a virtual rotational velocity component from the tool surface. An isotropic, viscoplastic Norton-Hoff law was used to model the evolution of material flow stress as a function of strain, strain rate, and temperature. The model predicted welding temperatures and the movement of the joint interface with reasonable accuracy for the welding of a dual phase 980 steel.

Advanced High strength steel↗

The 'Site of Things': Remediation in the Information Age - 18088

More than just a payload, machines now haul data as well. Wood Environment and Infrastructure's maiden voyage into civil engineering automation at the Port Granby Project Long-Term Waste Management Facility demonstrated enormous potential for the remediation industry. The Port Granby Project will relocate approximately 450,000 cubic meters of historic low-level radioactive waste and marginally contaminated soils, located at an existing waste management facility on the shoreline of Lake Ontario, to a new, engineered aboveground mound to be built about a kilometer north of the current site. Sounds simple, right? Just move a bunch of dirt up the road? Hardly, this is marginally contaminated soil situated near Lake Ontario in a beautiful little village an hour east of Toronto. We must relocate safely, meaning limiting the number of staff in the field and efficiently to deliver according to our agreed upon budget and schedule. As if that wasn't enough we were asked to keep track of where each truckload of dirt was excavated from (with a high degree of accuracy), where it was placed in the new engineered disposal facility, how much it weighed and the amount of radioactivity in each load... a virtual chain of custody for each load. Presented is an overview of the Information Technology that supports the Port Granby Project and how the Data Management System (DMS) is being leveraged to make the project safer, more effective and efficient. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems with High Penetration of Inverter-Based Resources: Preprint

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression- based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power- hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗

Probing Signal-Based Inertia and Frequency Response Estimation for Power Systems With High Levels of Inverter-Based Resources

Power system inertia is the inherent capability of a power system to resist changes in its frequency during disturbances. Real-time inertia estimation technology has become more important due to the low-inertia issues caused by the increasing integration levels of inverter-based resources (IBRs) from renewable energy; however, existing inertia estimation methods hardly consider multiple frequency response controls that act within the same time frame as conventional inertial response, thus making measured inertia values vary under different testing conditions. To resolve this issue, this paper proposes a novel real-time estimation method to simultaneously estimate a power system's inertia constant and frequency response droop constant using a well-designed probing signal. First, we formulate the inertia and frequency response model of a power system with IBRs. Second, through the integration and manipulation of the developed model, we propose a multivariate linear regression-based estimation method that is resilient to measurement noise. Third, we design a probing signal that can be injected by IBRs to incite the required transients for estimation. Finally, we validate the proposed estimation method through comprehensive power-hardware-in-the-loop experiments using inverter hardware and a realistic island power system model. The results demonstrate that the proposed method can accurately estimate the inertia and droop value of the power system with grid-following IBRs and grid-forming IBRs with virtual synchronous machine control.

frequency response↗