Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance tuning programming systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Autotuning in High-Performance Computing Applications

Autotuning refers to the automatic generation of a search space of possible implementations of a computation that are evaluated through models and/or empirical measurement to identify the most desirable implementation. Autotuning has the potential to dramatically improve the performance portability of petascale and exascale applications. To date, autotuning has been used primarily in high-performance applications through tunable libraries or previously tuned application code that is integrated directly into the application. This paper draws on the authors' extensive experience applying autotuning to high-performance applications, describing both successes and future challenges. If autotuning is to be widely used in the HPC community, researchers must address the software engineering challenges, manage configuration overheads, and continue to demonstrate significant performance gains and portability across architectures. In particular, tools that configure the application must be integrated into the application build process so that tuning can be reapplied as the application and target architectures evolve.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Preparing for the deployment of large scientific and engineering codes on upcoming exascale systems with GPU-dense nodes is made challenging by the unprecedented diversity of device architectures and heterogeneous programming models. In this work, we evaluate the process of porting a massively parallel, fluid dynamics code written in CUDA to SYCL, HIP, and Kokkos with a range of backends, using a combination of automated tools and manual tuning. We use a proxy application along with a custom performance model to inform the results and identify additional optimization strategies. At scale performance of the programming model implementations are evaluated on pre-production GPU node architectures for Frontier and Aurora, as well as on current NVIDIA device-based systems Summit and Polaris. Real-world workloads representing 3D blood flow calculations in complex vasculature are assessed. Our analysis highlights critical trade-offs between code performance, portability, and development time.

Martin, Aristotle↗
DOE OSTI2019

Production Application Performance Data Streaming for System Monitoring

In this article, we present an approach to streaming collection of application performance data. Practical application performance tuning and troubleshooting in production high-performance computing (HPC) environments requires an understanding of how applications interact with the platform, including (but not limited to) parallel programming libraries such as Message Passing Interface (MPI). Several profiling and tracing tools exist that collect heavy runtime data traces either in memory (released only at application exit) or on a file system (imposing an I/O load that may interfere with the performance being measured). Although these approaches are beneficial in development stages and post-run analysis, a systemwide and low-overhead method is required to monitor deployed applications continuously. This method must be able to collect information at both the application and system levels to yield a complete performance picture. In our approach, an application profiler collects application event counters. A sampler uses an efficient inter-process communication method to periodically extract the application counters and stream them into an infrastructure for performance data collection. We implement a tool-set based on our approach and integrate it with the Lightweight Distributed Metric Service (LDMS) system, a monitoring system used on large-scale computational platforms. LDMS provides the infrastructure to create and gather streams of performance data in a low overhead manner. We demonstrate our approach using applications implemented with MPI, as it is one of the most common standards for the development of large-scale scientific applications. We utilize our tool-set to study the impact of our approach on an open source HPC application, Nalu. Our tool-set enables us to efficiently identify patterns in the behavior of the application without source-level knowledge. We leverage LDMS to collect system-level performance data and explore the correlation between the system and application events. Finally, we demonstrate how our tool-set can help detect anomalies with a low latency. We run tests on two different architectures: a system enabled with Intel Xeon Phi and another system equipped with Intel Xeon processor. Our overhead study shows our method imposes at most 0.5% CPU usage overhead on the application in realistic deployment scenarios.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Exploring the use of novel programming models in land surface models

A wide range of programming models are currently under rapid development to meet the needs of application developers looking to work on more complex machines. These models fill a variety of roles. Some look to abstract supercomputer architecture, including both processors and memory, to present a strategy for portable performance across a wide range of machines. Others look to expose concurrency by explicitly constructing task-driven dependency graphs that allow a scheduler to find parallelism. Here we explore the implications for application codes of adopting two such programming models, Kokkos and Legion, one from each class of models. We specifically focus on the software design implications on refactoring existing applications, rather than the performance and performance tuning of these models. We identify a strategy for refactoring the Energy Exascale Earth System Model's Land Surface Model, an extremely complex code for climate applications, and prototype a series of mini-apps that explore the adoption of Kokkos and Legion. In doing this, we identify commonalities across the models, leading to a series of conclusions about application software design and refactoring for the adoption of novel programming models.

Coon, Ethan↗
DOE OSTI2025

Agentic AI vs ML-Based Autotuning: A Comparative Study for Loop Reordering Optimization

High Performance Computing (HPC) applications rely heavily on code optimizations to achieve good performance on modern CPU and GPU architectures. Traditional Machine Learning auto-tuning approaches have demonstrated success in exploring high-dimensional spaces, but they often require expensive compile-run evaluations and lack adaptability for large HPC applications. The recent advances in Large Language Models (LLMs) and Agentic AI systems raise intriguing questions about the potential of these approaches to address specific optimization methodologies. This work aims to answer an essential question for the HPC community: “How Agentic AI Systems Compare to Traditional ML Autotuning Techniques?” To address this question, we present a comparative analysis between a traditional ML-based optimization approach and an Agentic AI system, evaluating their respective capabilities and limitations for loop-level optimization. In addition, we introduced a new Agentic AI system named LoopGen-AI using three different Large Language Models: GPT-4.1, Claude 4.0, and Gemini 2.5. A key finding is that LoopGen-AI achieves competitive per-formance with only a few program runs, the reasoning logs from the agents revealed that their decisions rely heavily on the combination of semantic understanding of the target kernel with dynamic feedback from the environment, highlighting a promising new dimension in performance tuning. In contrast, ML-based autotuners focus on statistical exploration, and require orders of magnitude more runs to reach peak performance. Additionally, our analysis shows that prompt engineering, particularly using Persona + Context Manager patterns, significantly impacts the effectiveness of Agentic AI. Our results indicate that while Agentic AI systems are not yet a complete replacement for ML-based autotuners, it can effectively complement traditional methods.

Rosas, Miguel Romero↗
DOE OSTI2026

FOCAL Campaign II/III: Applying Active Hull Controls Using Tuned-mass Dampers/Hull Flexibility and Internal Loads

Campaign II and III of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aimed to generate a dataset enabling the validation of the performance and loads of a scaled hull, with and without structural hull control. The floating platform was subjected to a variety of wave environments and controlled using tuned-mass dampers (TMDs) tuned to two of the systems natural frequencies (Platform Pitch and Tower-bending). The floating platform is fully instrumented to record a variety of parameters in real time such as platform dynamics, accelerations, and loads at different points in the structure. The test data considered was generated at the University of Maine's Harold Alfond Wind and Wave (W2) testing facility. This testing was focused only on validation of wave loading, and wind conditions were not considered. As such the platform does not support a working turbine, and instead supports a structure designed to have the same mass properties as the 1:70 IEA 15MW Reference turbine. The Load Cases (LC) considered in this testing campaign are as follows: LC 1.X - Platform Static Offset (TMD off); LC 2.X - Platform Free-decays (TMD off); LC 3.X - Wave Cases (Regular Wave, Irregular Wave, Pink Noise Wave) with and without TMDs active. Detailed properties on the model system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaigns 2 and 3: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine and the VolturnUS-S Hull. UMaine ASCC Report Number 23-56-1183.

17 WIND ENERGY↗
DOE OSTI2019

Managing code transformations for better performance portability

Code optimization is an intricate task that is getting more complex as computing systems evolve. Managing the program optimization process, including the implementation and evaluation of code variants, is tedious, inefficient, and errors are likely to be introduced in the process. Moreover, because each platform typically requires a different sequence of transformations to fully harness its computing power, the optimization process complexity grows as new platforms are adopted. To address these issues, systems and frameworks have been proposed to automate the code optimization process. They, however, have not been widely adopted and are primarily used by experts with deep knowledge about underlying architecture and compiler intricacies. This article describes the requirements that we believe necessary for making automatic performance tuning more broadly used, especially in complex, long-lived high-performance computing applications. Besides discussing limitations of current systems and strategies to overcome these, we describe the design of a system that is able to semi-automatically generate efficient platform-specific code. In the proposed system, the code optimization is programmer-guided, separately from application code, on an external file in what we call optimization programming. The language to program the optimization process is able to represent complex collections of transformations and, as a result, generate efficient platform-specific code. A database manages different optimized versions of code regions, providing a pragmatic approach to performance portability, and the framework itself has separate components, allowing the optimized code to be used on systems without installing all of the modules required for the code generation. We present experiments on two different platforms to illustrate the generation of efficient platform-specific code that performs comparable to hand-optimized, vendor-provided code.

Computer Science↗
DOE OSTI2020

Multi-Node Program Fuzzing on High Performance Computing Resources

Significant effort is placed on tuning the internal parameters of fuzzers to explore the state space, measured as coverage, of binaries. In this work, we investigate the effects of the external environment on the resulting coverage after fuzzing two binaries with AFL for 24 hours. Parameters such as scaling to multiple nodes, node saturation, and parallel file system type on HPC resources are controlled in order to maximize coverage. It will be shown that employing a parallel file system such as IBM's General Parallel File System offers an advantage for fuzzing operations, since it contains enhancements for performance optimization. When combined with scaling to two and four nodes, while simultaneously restricting the number of coordinated AFL tasks per node on the low end (10-50% of available physical cores), coverage may be enhanced within a shorter period of time. Thus, controlling the external environment is a useful effort.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

FOCAL Campaign IV: Integrated System Control: Turbine + Hull

Campaign IV of the Floating Offshore-wind Controls Advanced Laboratory Experimental Program (FOCAL) aimed to generate a dataset enabling the validation of a floating offshore wind turbine with turbine and hull controls. The turbine considered in this campaign is the scaled IEA 15MW Reference Wind Turbine similar to the setup considered in FOCAL Campaign I. This turbine is mounted on the VolturnUS platform with integrated hull controls similar to the hull considered in FOCAL Campaign II/III. This system is deployed for a fully-coupled wind and wave testing campaign at the University of Maine's Harold Alfond Wind and Wave (W2) facility. System dynamics and turbine characteristics are measured to determine global performance and assess the effect of the control strategies employed. NREL's reference open-source controller (ROSCO) is used for active blade pitch control and hull structural control is examined through the use of tuned mass dampers (TMD's) tuned to the systems pitch and tower-bending natural frequency. The naming convention of the load cases considered are described in the data details section. Detailed properties on the modeled system are found in the following reference: Lenfest E., Floating Offshore-wind Controls Advanced Laboratory (FOCAL) Experimental Program - Campaign IV: 1:70 Model-scale Testing of the IEA-Wind 15MW Reference Turbine and the VolturnUS-S Platform. UMaine ASCC Report Number 23-57-1183.

17 WIND ENERGY↗
DOE OSTI2019

Highlights and Lessons Learned from Army Re-tuning™ Pilot Demonstrations

The Army has aggressively pursued policy and energy efficiency projects and programs in recent years to meet Federal mandates and reduction goals organizationally (EISA 2007, AR 420-1, 42 U.S.C. § 8253), resulting in a 9.6% reduction in energy use intensity (EUI) from FY2015 to FY2017. Despite these successes, the Army remains the largest consumer of electricity in the Federal government and spent approximately $1.1 billion in energy-related costs in FY2017. Many of the low-cost/no-cost conservation measures have been deployed, so finding additional savings and projects that either (a) are cost effective or (b) can be bundled with more costly capital improvement projects to improve life cycle cost effectiveness, is imperative for the Army. Leveraging building control systems (BCS) and optimizing building performance through re-tuning represents a great opportunity for the Army. In 2016, the Pacific Northwest National Laboratory (PNNL), in support of the Assistant Secretary of the Army (Installations, Energy and Environment), i.e. ASA (IEE), was tasked in 2016 with a multi-year study and pilot demonstration to develop a business case for the potential energy and cost reduction benefits from re-tuning efforts for the Army.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Final Scientific/Technical Report-FREE-piston Zero Emissions Refrigerator (FREEZER)

The FREE-piston Zero Emissions Refrigerator (FREEZER™) is a natural refrigerant Stirling-cycle cooler developed by AMSC in partnership with Heatcraft, targeted as a replacement refrigeration system for walk-in coolers or freezers found commonly in restaurants, convenience stores, supermarkets, etc. The FREEZER™, combined with a closed-loop CO2 heat-transfer system, had the goal to provides an efficient (Target COP = 1.4), zero ODP (Ozone Depletion Potential) and near zero GWP (Global Warming Potential) refrigeration solution with no synthetic, flammable, or toxic refrigerants. Other near zero GWP refrigeration systems do not exist at the scale and performance level of FREEZER. ARPA-E Continuation Funding enabled the design and fabrication of one Advanced Development Unit (ADU) cooler and two Field Test Unit (FTU) coolers, and a new revised Field Test Unit (new FTU). Heatcraft was to extensively test the various coolers at their facilities, which closely simulate real-world conditions. The original plan was to install and operate FREEZER FTUs alongside a traditional cooling solution at one or more customer locations to obtain data on direct performance comparisons with existing commercial refrigeration systems. Success in this FREEZER refinement and field-test project will establish the basis for a new class of environmentally friendly refrigeration systems that will revolutionize the industry. The hardware developed under the program is shown below in Figure 1. Five Stirling-cycle machines were built within the program, with a sixth cooler still under construction. The original DU and the ADU coolers met the performance target with a coefficient of performance (COP) of 1.2. The FTU was underperforming during the initial tuning of the free-piston Stirling cycle dynamics when there was a catastrophic failure of the fasteners on pressure boundary. This caused a pause to the program while the failure mechanism was investigated. The root cause was an inadequate flange design that allowed an excessive cyclic loading on the fasteners, leading to a fatigue failure. It was determined that existing FTU design could not be reasonably salvaged in a safe manner, and that fact, combined with the lower-than-expected performance of the new experimental heat exchanger modules lead to the design of the “new FTU” with a more conventional shell-and-tube heat exchanger design which should get close to the design target COP of 1.4, but have a higher overall machine cost. The program ran out of time before the fabrication of the new FTU was completed, but AMSC is still working on the cooler, with the majority of the parts fabricated, and hopes to have the unit under test sometime in early 2022, after which it will be shipped to Heatcraft for additional testing.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

C3F: Collaborative Container-based Model Coupling Framework

Solving complex real-world grand challenge problems requires in-depth collaboration of researchers from multiple disciplines. Such collaboration often involves harnessing multiscale and multi-dimensional data and combining models from different fields to simulate systems. However, the progress on this front has been limited mainly due to significant gaps in domain knowledge and tools that are typically employed in silos of the domains. Researchers from different fields face considerable barriers to understanding and reusing each other’s data/models in order to collaborate effectively. For example, in solving the global sustainability problems, researchers from hydrology, climate science, agriculture, and economics need to run their respective models to study different components of the global and local food, energy and water systems while, at the same time, need to interact with other researchers and integrate the results of one model with another. Developing this kind of model coupling workflow calls for (1) a large amount of data being processed and exchanged across domains and organizations, (2) identifying and processing the output of one model to make it ready for integration into another model, (3) controlling the workflow dynamically so that it runs until a certain convergence condition or other criteria is met, and (4) close collaboration among the modelers to explore, tune, and test the configuration and data transformation needed to link the models. We have developed C3F, a flexible collaborative model coupling framework to help researchers accelerate their model integration and linking efforts by leveraging advanced cyberinfrastructure such as high-performance computing and virtual containers. In this paper, we describe our experience and lessons learned in developing this cyberinfrastructure solution to support the linking of Water Balance Model (WBM) and SIMPLE-G agricultural economic model in an NSF funded INFEWS project and a DOE-funded Program on Coupled Human and Earth Systems (PCHES) to study the implications of groundwater scarcity for food-energy-water systems. The C3F model coupling framework can be extended to facilitate other model linkages as well.

containerization↗
DOE OSTI2018

Tartan: Evaluating Modern GPU Interconnect via a Multi-GPU Benchmark Suite

In this paper, we fill the gap by proposing a multi-GPU benchmark suite named Tartan, which contains microbenchmarks, scale-up and scale-out applications. We then apply Tartan to evaluate the four latest types of modern GPU interconnects, i.e., PCI- e, NVLink-V1, NVLink-V2 and InfiniBand with GPUDirect- RDMA from two recently released NVIDIA super AI platforms as well as ORNL’s exascale prototype system. Based on empirical evaluation, we observe four new types of NUMA effects: three types are triggered by NVLink’s topology, connectivity and routing, while one type is caused by PCI-e (i.e., anti-locality). They are very important for performance tuning in multi-GPU environment. Our evaluation results show that, unless the current CPU-GPU master-slave programming model can be replaced, it is difficult for scale-up multi-GPU applications to really benefit from faster intra-node interconnects such as NVLinks; while for inter-node scale-out applications, although interconnect is more crucial to the overall performance, GPUDirect-RDMA appears to be not always the optimal choice.

HPC↗
DOE OSTI2025

Calibration and Performance of the ICARUS Detector at Fermilab

ICARUS is the largest Liquid Argon Time Projection Chamber (LArTPC) in operation and serves as the Far Detector of the Short Baseline Neutrino (SBN) program at Fermilab. Precise detector calibration is essential for reliable energy reconstruction and for maximizing the physics reach of the experiment. In this talk, I will describe the energy and timing calibration procedures developed at ICARUS. Thanks to the abundant flux of cosmic ray muons at the surface, the TPC response to ionization charge has been equalized across the detector, removing non-uniformities and in-transparency effects. A novel data-driven procedure has been used to tune the simulation of ionization signals and electronics noise yielding close agreement between Monte Carlo and data with minimal residual bias in reconstructed charge. In addition, the light detection system has been calibrated to sub-nanosecond timing resolution. This precision enables efficient cosmic background rejection and accurate synchronization of neutrino interactions with the time structure of both the Booster Neutrino Beam (BNB) and Neutrinos at the Main Injector (NuMI) beam. Together, these efforts demonstrate the robust performance of the detector and provide critical experience for future large LArTPCs, such as DUNE.

Vicenzi, Matteo [Brookhaven]↗
DOE OSTI2020

Compiler and Runtime Approaches to Enable Large-Scale Irregular Programs. Final report, July 2013 - July 2019

While regular algorithms, characterized by operations on dense matrices and arrays, have long been the mainstay of scientific, high-performance computing, irregular algorithms, which feature unpredictable accesses to pointer-based data structures, are becoming increasingly common in high performance computing, arising in graph analysis, data mining and visualization, among other domains. Unfortunately, the defining characteristics of irregular applications, their dynamic, unpredictable, data-dependent access patterns and data layouts, make achieving high performance on large scale systems difficult. Scaling applications to peta- and exa-scale requires carefully controlling communication and data movement and placement, an inherently difficult task when access patterns and data layouts are unpredictable! Most irregular applications that attain high performance must be painstakingly hand-written and hand-tuned, with few common principles or paradigms uniting various implementations and easing future development. Despite the increasing importance of irregular applications, there is little programmer knowledge, and even less compiler ability, devoted to optimizing them. This project aims to solve these problems. By allowing programmers to write irregular applications in high level forms, with at most a few annotations highlighting key structural properties, programmers can focus on developing their algorithms and methods. The compiler and run-time system can take on the tedious task of optimizing the application for execution at large scales, and can automatically provide efficient implementations. This will provide portability and ease maintenance for existing irregular applications, but, more importantly, open up whole new domains of computational science to large-scale, high-performance simulation codes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Isotopic analysis of plutonium measured with very thick absorbers and high-granularity spectra

FRAM is LANL-designed software designed to extract plutonium and uranium isotopic information from gamma ray spectra. This is an important capability for NEST and STAB; however, FRAM performance has been poor when applied to field data collected in these programs. FRAM Version 5 (commercially available) was fine-tuned and validated for laboratory quality measurements but not for measurements of the high-mass and heavily shielded SNM items encountered in NEST. FRAM is untested for spectra collected with high-granularity lower resolution instruments such as the new 8-MeV Detective-X favored by STAB or the new custom electrocooled systems coming into use for NEST. FRAM Version 6.1 (unreleased) has improvements in physics capabilities, and parameter sets may be adapted that are more specific to NEST and STAB, which is what we have attempted for this assignment. Thick shielding attenuates gamma rays profoundly, especially those at low energy, making them too weak to be measured. The missing low-energy peaks force the analysis to employ only the highest-energy peaks. We adapted FRAM 6.1 for analysis of plutonium spectra obtained with very thick Pb filters (a surrogate for NEST-type configurations). New parameter sets employing only very high energy peaks were created for the analysis. High granularity and low resolution make deconvolution of the 600-keV region particularly challenging, and we have worked to optimally extract information from this region. The results shown in this paper give high confidence that we are on the right track. We used a combination of real and synthetically-modified data. Remaining work includes testing the new software and parameters against genuine data collected with Detective-X and new NEST systems, but such datasets at the moment are unavailable. It also remains to develop and test parameter sets specific to uranium and the new detectors.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2021

Evaluating MPI resource usage summary statistics

The Message Passing Interface (MPI) remains the dominant programming model for scientific applications running on today’s high-performance computing (HPC) systems. This dominance stems from MPI’s powerful semantics for inter-process communication that has enabled scientists to write applications for simulating important physical phenomena. MPI does not, however, specify how messages and synchronization should be carried out. Those details are typically dependent on low-level architecture details and the message characteristics of the application. Therefore, analyzing an application’s MPI resource usage is critical to tuning MPI’s performance on a particular platform. The result of this analysis is typically a discussion of the mean message sizes, queue search lengths and message arrival times for a workload or set of workloads. While a discussion of the arithmetic mean in MPI resource usage might be the most intuitive summary statistic, it is not always the most accurate in terms of representing the underlying data. In this paper, we analyze MPI resource usage for a number of key MPI workloads using an existing MPI trace collector and discrete-event simulator. Our analysis demonstrates that the average, while easy and efficient to calculate, is a useful metric for characterizing latency and bandwidth measurements, but may not be a good representation of application message sizes, match list search depths, or MPI inter-operation times. Additionally, we show that the median and mode are superior choices in many cases. We also observe that the arithmetic mean is not the best representation of central tendency for data that are drawn from distributions that are multi-modal or have heavy tails. Furthermore, the results and analysis of our work provide valuable guidance on how we, as a community, should discuss and analyze MPI resource usage data for scientific applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Tuning of Nacelle Feedback Gains for Floating Wind Turbine Controllers Using a Two-DOF Model

Designing a collective blade pitch controller for floating offshore wind turbines (FOWTs) poses unique challenges due to the interaction of the controller with the dynamics of the platform. The controller must also handle the competing objectives of power production performance and fatigue load management. Existing solutions either detune the controller with the result of slowed response, make use of complicated tuning methods, or incorporate a nacelle velocity feedback gain. With the goal of developing a simple control tuning method for the general FOWT researcher that is easily extensible to a wide array of turbine and hull configurations, this last idea is built upon by proposing a simple tuning strategy for the feedback gain. This strategy uses a two degree-of-freedom (DoF) turbine model that considers tower-top fore-aft and rotor angular displacements. For evaluation, the nacelle velocity term is added to an existing gain scheduled proportional-integral controller as a proportional gain. The modified controller is then compared to baseline land-based and detuned controllers on an example system for several load cases. First-pass results are favorable, demonstrating how researchers can use the proposed tuning method to efficiently schedule gains for adequate controller performance as they investigate new FOWT configurations.

49 EE - Wind and Water Power Program - Wind (EE-4W↗