Search NASA⌕ Search

SEARCH · Search NASA

Results for “algorithm design and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Taylor-Expansion-Based Robust Power Flow in Unbalanced Distribution Systems: A Hybrid Data-Aided Method

Traditional power flow methods often adopt certain assumptions designed for passive balanced distribution systems, thus lacking practicality for unbalanced operation. moreover, their computation accuracy and efficiency are heavily subject to unknown errors and bad data in measurements or prediction data of distributed energy resources (ders). to address these issues, this paper proposes a hybrid data-aided robust power flow algorithm in unbalanced distribution systems, which combines taylor series expansion knowledge with a data-driven regression technique. the proposed method initiates a linearization power flow model to derive an explicitly analytical solution by modified taylor expansion. to mitigate the approximation loss that surges due to the der integration and bad data, we further develop a data-aided robust support vector regression approach to estimate the errors efficiently. comparative analysis in the 13-bus and 123-bus ieee unbalanced feeders shows that the proposed hybrid algorithm achieves superior computational efficiency, with guaranteed accuracy and robustness against outliers.

data-driven↗

A Framework for Error-Bounded Approximate Computing, with an Application to Dot Products

Approximate computing techniques, which trade off the computation accuracy of an algorithm for better performance and energy efficiency, have been successful in reducing computation and power costs in several domains. However, error sensitive applications in high-performance computing are unable to benefit from existing approximate computing strategies that are not developed with guaranteed error bounds. While approximate computing techniques can be developed for individual high-performance computing applications by domain specialists, this often requires additional theoretical analysis and potentially extensive software modification. Hence, the development of low-level error-bounded approximate computing strategies that can be introduced into any high-performance computing application without requiring additional analysis or significant software alterations is desirable. In this paper, we provide a contribution in this direction by proposing a general framework for designing error-bounded approximate computing strategies and apply it to the dot product kernel to develop \bf qdot---an error-bounded approximate dot product kernel. Following the introduction of qdot, here we perform a theoretical analysis that yields a deterministic bound on the relative approximation error introduced by qdot. Empirical tests are performed to illustrate the tightness of the derived error bound and to demonstrate the effectiveness of qdot on a synthetic dataset, as well as two scientific benchmarks---the conjugate gradient (CG) and power methods. In some instances, using qdot for the dot products in CG can result in many components being quantized to half precision without increasing the iteration count required for convergence to the same solution as CG using a double precision dot product.

97 MATHEMATICS AND COMPUTING↗

Hybrid-RL-MPC4CLR (Hybird-Reinforcement-Learning-Model-Predictive-Control-for-Reserve-Policy-Assisted-Critical-Load-Restoration-in-Distribution-Grids)

Hybrid-RL-MPC4CLR was developed as a hybrid controller for active distribution grid critical load restoration, combining deep reinforcement learning (RL) and model predictive control (MPC) aiming at maximizing total restored load following an extreme event. The RL determines a policy for quantifying operating reserve requirements, thereby hedging against uncertainty, while the MPC models grid operations incorporating the RL policy actions (i.e., reserve requirements), renewable (wind and solar) power predictions, and load demand forecasts. The developers formulated the reserve requirement determination problem as a sequential decision-making problem based on the Markov Decision Process (MDP) and design an RL learning environment based on the OpenAI Gym framework and MPC simulation. The RL agent reward and MPC objective function aim to maximize and monotonically increase total restored load and minimize load shedding and renewable power curtailment. The software is developed using various software packages in Python. The MPC's optimal power flow (OPF) model is implemented using the Pyomo package, the RL simulation environment is implemented using the MPC simulation with various scenarios of renewable energy and load demand profiles and power outage beginning times, based on the OpenAI Gym framework. The RL agent training is performed using the RLlib Ray package. The RL algorithm is trained offline using historical forecasts of renewable generation and load demand profiles. Simulation analysis and performance tests are conducted using a modified IEEE 13-bus distribution test feeder containing wind turbine, photovoltaic, microturbine, and battery.

Eseye, Abinet Tesfaye↗

Granger Causality for prediction in Dynamic Mode Decomposition: Application to power systems

Here, the dynamic mode decomposition (DMD) technique extracts the dominant modes characterizing the innate dynamical behavior of the system within the measurement data. For appropriate identification of dominant modes from the measurement data, the DMD algorithm necessitates ensuring the quality of the input measurement data sequences. On that account, for validating the usability of the dataset for the DMD algorithm, the paper proposed two conditions: Persistence of excitation (PE) and the Granger Causality Test (GCT). The virtual data sequences are designed with the hankel matrix representation such that the dimensions of the subspace spanning the essential system modes are increased with the addition of new state variables. The PE condition provides the lower bound for the trajectory length, and the GCT provides the order of the model. Satisfying the PE condition enables estimating an approximate linear model, but the predictability with the identified model is only assured with the temporal causation among data searched with GCT. The proposed methodology is validated with the application for coherency identification (CI) in a multi-machine power system (MMPS), an essential phenomenon in transient stability analysis. The significance of PE condition and GCT is demonstrated through various case studies implemented on 22 bus six generator system.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development and Demonstration of a Risk-Informed Approach to the Regulatory Required Fuel Reload Safety Analysis

The United States (U.S.) nuclear industry is facing a strong challenge to maintain regulatory-required levels of safety while ensuring economic competitiveness to stay in business. Safety remains a key parameter for all aspects related to the operation of light water reactor (LWR) nuclear power plants (NPPs) and can be achieved more economically by using a risk-informed ecosystem such as that being developed by the Risk-Informed Systems Analysis (RISA) Pathway under the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program. The LWRS Program is promoting a wide range of research and development (R&D) activities with the goal to maximize both the safety and economically efficient performance of NPPs through improved scientific understanding, especially given that many plants are considering second license renewal. The RISA Pathway has two main goals: (1) the deployment of methodologies and technologies that enable better representation of safety margins and the factors that contribute to cost and safety; and (2) the development of advanced applications that enable cost-effective plant operation. The plant reload optimization framework development project aims to build an artificial intelligence, i.e., Genetic Algorithm (GA), based reactor core designing tool taking into account reactor safety and fuel performance analyses.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

An experimental investigation of the effectiveness of Ar-CO 2 shielding gas mixture for the wire arc additive process

Wire arc additive manufacturing (AM) is the process by which a large, metallic structure is built layer-by-layer using a welding arc to melt a wire feedstock. A novel opportunity exists to alter the shielding gas composition to fabricate distinct geometrical features without altering the other AM parameters. In this paper, shielding gases with varied concentrations of Argon (Ar) and CO 2 was used to deposit three distinct geometric shapes (walls, infill, and overhang) using a wire-based additive manufacturing system utilizing the gas metal arc welding (GMAW) surface tension transfer (STT) process. Computer-aided design (CAD) models were sliced with a custom-built slicer, and the sliced algorithm was converted into optimal robotic toolpaths. A custom virtual instrument (VI) was built in LabVIEW to compare the temperature profiles on the surface during each deposition process. After each deposition, the geometric features were scanned, and the surface waviness value was evaluated. Tensile and Charpy impact coupons were extracted from the wall geometries in the longitudinal and transverse directions and tested. The results indicated that a higher CO 2 content produced higher melt pool temperatures to an extent, while lower contents of CO 2 resulted in a dimensionally accurate geometry. The data also indicated that the 2%/98% CO 2 /Ar blend produced scatter in tensile strength and the analysis of variance (ANOVA) shows significant difference. However, the intermediate range of CO 2 (5–10%) resulted in uniform tensile properties. Altogether, these results indicate that a 5%/95% CO 2 /Ar blend is the ideal shielding gas for lowering process temperatures and improving mechanical properties in wire arc additive manufacturing using the gas metal arc welding surface tension transfer process. Additionally, varying concentrations of Ar/CO 2 can be used within the same part in order to modify the local properties or process parameters such as strength, toughness, temperature, or dimensional features. This may improve overall manufacturing quality without sacrificing specific properties.

42 ENGINEERING↗

Comparative study between experimental measurements and model predictions of bubble rise velocity in molten LiCl-KCl

This research investigated the shape and rise velocities of gas bubbles (helium, nitrogen, argon, and krypton) in molten LiCl-KCl at 500 °C using a specialized optical visualization apparatus. The apparatus features a custom quartz rectangular prism cell housed in a furnace, enabling the application of the shadowgraph measurement technique. Bubbles with diameters between 0.45 and 3.2 mm were produced via a capillary, and their equivalent diameters and rise velocities were analyzed using high-resolution imaging and centroid tracking algorithms. Important non-dimensional parameters were calculated to characterize behavior. Bubbles with 0.03 < Eo < 1.32, 17 < Re < 718, and Mo order of 10 -11 were generated in the molten LiCl-KCl, revealing that bubbles with diameters less than 1.46 mm remain spherical, whereas those with larger diameters are ellipsoidal. The transition and oscillation onset for bubble shape occurred at larger diameters than those previously observed in air–water systems. Comparative analysis of the gas-molten salt data against existing air–water bubble rise velocity correlations highlighted inaccuracies in predictions, particularly across the different bubble regimes. An existing correlation was calibrated to the molten salt data to improve the bubble velocity predictions. In conclusion, this study contributes essential experimental data for the design and safety evaluation of molten salt reactors and offers insights for the optimization of sparge systems for fission product removal.

Bubble rise velocity↗

Exploring temporal community evolution: algorithmic approaches and parallel optimization for dynamic community detection

Abstract Dynamic (temporal) graphs are a convenient mathematical abstraction for many practical complex systems including social contacts, business transactions, and computer communications. Community discovery is an extensively used graph analysis kernel with rich literature for static graphs. However, community discovery in a dynamic setting is challenging for two specific reasons. Firstly, the notion of temporal community lacks a widely accepted formalization, and only limited work exists on understanding how communities emerge over time. Secondly, the added temporal dimension along with the sheer size of modern graph data necessitates new scalable algorithms. In this paper, we investigate how communities evolve over time based on several graph metrics under a temporal formalization. We compare six different algorithmic approaches for dynamic community detection for their quality and runtime. We identify that a vertex-centric (local) optimization method works as efficiently as the classical modularity-based methods. To its advantage, such local computation allows for the efficient design of parallel algorithms without incurring a significant parallel overhead. Based on this insight, we design a shared-memory parallel algorithm DyComPar , which demonstrates between 4 and 18 fold speed-up on a multi-core machine with 20 threads, for several real-world and synthetic graphs from different domains.

97 MATHEMATICS AND COMPUTING↗

The impact of urban configuration types on urban heat islands, air pollution, CO 2 emissions, and mortality in Europe: a data science approach

The world is becoming increasingly urbanized. As cities around the world continue to grow, it is important for urban planners and policymakers to understand how different urban configuration patterns affect the environment and human health. We aimed at identifying European urban configuration types, based on the Local Climate Zones categories and street design variables from Open Street Map, and evaluating their association with motorized traffic flows, Surface Urban Heat Island (SUHI) intensities, tropospheric nitrogen dioxide (NO 2 ), CO 2 per capita emissions and age-standardized mortality. We considered 946 European cities from 31 countries for the analysis defined in the 2018 Urban Audit database, of which 919 European cities were analysed. Data were collected at a 250 m × 250 m grid cell resolution. We divided all cities into five concentric rings based on the Burgess concentric urban planning model and calculated the mean values of all variables for each ring. First, to identify distinct urban configuration types, we applied the Uniform Manifold Approximation and Projection for Dimension Reduction method, followed by the k-means clustering algorithm. Next, statistical differences in exposures (including SUHI) and mortality between the resulting urban configuration types were evaluated using a Kruskal–Wallis test followed by a post-hoc Dunn's test. We identified four distinct urban configuration types characterising European cities: compact high density (n=246), open low-rise medium density (n=245), open low-rise low density (n=261), and green low density (n=167). Compact high density cities were a small size, had high population densities, and a low availability of natural areas. In contrast, green low-density cities were a large size, had low population densities, and a high availability of natural areas and cycleways. The open low-rise medium and low-density cities were a small to medium size with medium to low population densities and low to moderate availability of green areas. Motorised traffic flows and NO 2 exposure were significantly higher in compact high density and open low rise medium density cities when compared with green low density and open low-rise low density cities. Additionally, green low-density cities had a significantly lower SUHI effect compared with all other urban configuration types. Per person CO 2 emissions were significantly lower in compact high density cities compared with green low density cities. Lastly, green low density cities had significantly lower mortality rates when compared with all other urban configuration types. Our findings indicate that, although the compact city model is more sustainable, European compact cities still face challenges related to poor environmental quality and health. Our results have notable implications for urban and transport planning policies in Europe and contribute to the ongoing discussion on which city models can bring the greatest benefits for the environment, climate, and health.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Dynamic Differential Image Circle Diameter Measurement Precision Assessment: Application to Burning Droplets

Dynamic measurement precision assessment has been achieved for a differential circle measurement application. Differential circle diameter measurement, in image analysis, typically requires fitting a circle model that optimizes for image distortions, defects or occlusions. The differential task occurs when precise measurements of diameter change are required given object size variation with time. An automated system was designed to provide diameter measurements and associated measurement precision of images of a fuel droplet undergoing combustion in zero gravity for the FLEX-2 dataset. An image gradient-based, least-squares boundary point fitting method to a circle or ellipse model is used for diameter measurement. The presence of soot aggregates poses significant challenges for diameter measurements when it occludes part of the droplet boundary. The precision of the diameter measurements depends upon the image quality. Using synthetic image simulations that model the soot behavior, we developed a model based on image quality measures that assesses the measurement precision for each individual diameter measurement. Thus, diameter measurements with precision assessments were made available for follow-up scientific analysis. As a result, the algorithm's success rate for measurable runs was 98%. In cases of limited occlusion, a measurement precision of ±0.2 pixels for the FLEX-2 dataset was achieved.

42 ENGINEERING↗

SAM Finite Volume Method Development Status Update: GCR Application, Restart, and MultiApp

The System Analysis Module (SAM) is being developed as a modern system analysis code for advanced non-light-water-reactor safety analysis under the U.S. DOE NEAMS program. Previous feasibility studies have demonstrated that a staggered-grid finite volume method (SG-FVM), implemented under the MOOSE framework, can deliver more than an order of magnitude speedup over the existing continuous Galerkin finite element method (CG-FEM) solver for liquid-cooled, incompressible but thermally expandable flow systems. This work extends the previous effort to compressible, gas-cooled reactor applications, where pressure couples directly into the mass equation adding additional nonlinearity into the equation system. New code capabilities are implemented for pebble bed high-temperature gas-cooled reactor (PB-HTGR) analysis, including a pebble bed CoreChannel component, built-in pebble bed effective thermal conductivity model and channel-to-channel crossflow model. The capabilities are tested, benchmarked, and demonstrated for problems with increased level of model and physical complexities, including the HTTU effective thermal conductivity test, the SANA passive cooling test, and a demonstration case using the GPBR200 reactor design covering steady-state operation, DLOFC and PLOFC transients. Across all cases, the SG-FVM solver demonstrated strong robustness and efficiency, and the solutions agree well with reference results and data. The finding of this work proves that SG-FVM is a viable and efficient solver pathway for compressible, gas-cooled reactor system analysis in SAM. In addition, work has been done to successfully support SAM-FVM recover/restart code feature that is essential to reactor safety analysis applications, and MultiApp code feature that is essential to multi-scale and multi-physics simulations. In summary, this work continued from previous feasibility studies, and further demonstrated that the SG-FVM will serve as a strong foundation for SAM’s advanced solver algorithm for future deployment.

Zou, Ling↗

Accelerating engineered microbe optimization through machine learning and multi-omics datasets

This project demonstrated the use of a combination of multi-omics data with deep learning and a high-throughput Design- Build-Test-Learn (DBTL) cycle to improve the production of malonic acid, a versatile product with a large market. The project leveraged the unique capabilities of both Lygos and the Agile BioFoundry (ABF): Lygos provided its expertise efficiently designing, building, and cultivating P. kudriavzevii strains; LBNL, PNNL, and NTESS provided multi-omics analysis in the Test phase, LBNL provided machine learning techniques in the Learn phase to analyze the -omics datasets and make recommendations so as to increase malonic acid production in the next DBTL cycle. This project is the first to use large amounts of multi-omics time-series data to feed deep learning models, creating around 80,000 data points in a single DBTL cycle. This project has 1) demonstrated the utility of combining deep learning and multi-omics data sets by improving the production of malonic acid two fold, 2) created a large time-series datasets to be released publicly for external development of new machine learning algorithms, and 3) shown that supply chain problems, strain building bottlenecks, and adaptation times for new ML approaches are key obstacles for fast DBTL cycle times.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

OpenCSP v.1.0

SAND2024-08987O OpenCSP analyzes and improves the performance of optical mirrors that reflect sunlight and concentrate it onto a receiver. The algorithms in this library analyze the flow of light from an original source—such as the sun—reflecting off one or more mirrors, and onto a receiver, optical screen, or camera. OpenCSP also analyzes optical systems using other techniques, such as shape or slope comparison. The software calculates aggregate properties of the optical system, such as its efficiency, manufacturing error, pointing control error, expected performance, and other useful parameters. OpenCSP also includes high-level tools, such as Open SOFAST, a program that obtains high-resolution measurement of CSP mirrors, full heliostats, and other CSP collectors. OpenCSP supports producing meaningful output data to help CSP designers and field operators improve the performance of their systems. OpenCSP also includes classes and functions that support these calculations, including input utilities, analysis output libraries, geometric constraint analysis for drone flight planning, and more. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Brost, Randolph↗

A Nonintrusive Optical Approach to Characterize Heliostats in Utility-Scale Power Tower Plants: Camera Position Sensitivity Analysis

Optics plays a major role in the effectiveness of concentrating solar power (CSP) technologies. The nonintrusive optical (NIO) approach developed by the National Renewable Energy Laboratory uses uncrewed aircraft system (UAS)-based imaging to survey heliostats in a commercial-scale power tower CSP plant and characterize their optical errors. The image processing algorithm uses photogrammetry to calculate the camera position for each image frame, and the accuracy of the estimated optical errors is highly sensitive to the calculated camera position accuracy. In this study, we simulate a series of case studies in python to examine the impact of different parameters of the sensitivity of the camera calculation, including the number of facet corners used as control points for the photogrammetric calculation, precision error in the detected pixel locations of the facet corners in the image, and precision error of the canting and mounting positions of the facets of the heliostat. The case studies consider heliostat geometry based on three commercial designs to serve as representative examples of different possible sizes of heliostats that the NIO method could be applied to. The results show that increasing the number of control points can improve accuracy for heliostats with many facets, pixel precision has a significantly larger impact on camera calculation accuracy than facet canting and mounting errors, and the camera distance and focal length must be chosen to ensure adequate pixel accuracy on the heliostat surface depending on the size of heliostat. In conclusion, based on the results, recommendations for the allowable values of each parameter are provided to achieve the required NIO optical error estimation accuracy depending on the size of heliostat.

14 SOLAR ENERGY↗

Respiration Signal Pattern Analysis for Doppler Radar Sensor with Passive Node and Its Application in Occupancy Sensing of a Stationary Subject

Doppler radar node occupancy sensors are promising for applications in smart buildings due to their simple circuits and price advantage compared to quadrature radar sensors. However, single-channel sensitivity limitations may result in low sensitivity and misinterpreted motion rates if the detected subject is at or close to “null” points. We designed and tested a novel method to eliminate such limits, demonstrating that passive nodes can be used to detect a sedentary person regardless of position. This method is based on characteristics of chest motion due to respiration, found via both simulations and experiments based on a sinusoidal model and a more realistic model of cardiorespiratory motion. In addition, respiratory rate variability is considered to distinguish a true human presence from a mechanical target. Sensor node data were collected simultaneously with an infrared camera system, which provided a respiration signal reference, to test the algorithm with 19 human subjects and a mechanical target. The results indicate that a human presence was detected with 100% accuracy and successfully differentiated from a mechanical target in a controlled environment. The developed method can greatly improve the occupancy detection accuracy of single-channel radar-based occupancy sensors and facilitate their adoption in smart building applications.

Song, Chenyan↗

MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis

Deep neural networks have demonstrated impressive results in medical image analysis, but designing suitable architectures for each specific task is expertise dependent and time consuming. Neural architecture search (NAS) offers an effective means of discovering architectures. It has been highly successful in numerous applications, particularly in natural image classification. Yet, medical images possess unique characteristics, such as small regions and a wide variety of lesion sizes, that differentiate them from natural images. Furthermore, most current NAS methods struggle with high computational costs, especially when dealing with high-resolution image datasets. In this article, we present a novel evolutionary NAS method called multiscale training-free neural architecture search (MSTF-NAS) to address these challenges. Specifically, to accommodate the broad range of lesion region sizes in disease diagnosis, we develop a new reduction cell search space that enables the search algorithm to explicitly identify the optimal scale combination for multiscale feature extraction. Further, to overcome the issue of high computational costs, we utilize training-free indicators as performance measures for candidate architectures, which allows us to search for the optimal architecture more efficiently. More specifically, by considering the capability and simplicity of various networks, we formulate a multiobjective optimization problem that involves two training-free indicators and model complexity for candidate architectures. Extensive experiments on a large medical image benchmark and a publicly available breast cancer detection dataset are conducted. The empirical results demonstrate that our MSTF-NAS outperforms both human-designed architectures and current state-of-the-art NAS algorithms on both datasets, indicating the effectiveness of our proposed method.

60 APPLIED LIFE SCIENCES↗

FORCE Regression Testing

Via programs including the Light Water Reactor Sustainability and Integrated Energy Systems, the U.S. Department of Energy has invested in the Framework for Optimization of ResourCes and Economics (FORCE) software framework (Idaho National Laboratory 2024a) for the technical and economic analysis of nuclear-integrated energy systems (IES). Nuclear IES expand the use of nuclear from traditional baseload electricity generation to a flexible and adaptive source of combined heat and power. Nuclear heat can be used in the production of a variety of energy currencies such as hydrogen and ammonia as well as other heat applications including water desalination and district heating. FORCE is designed with the intent to provide interconnected analysis tools that enable the accurate technical and economic assessment of specific nuclear IES configurations for individual energy markets. FORCE consists of three main analysis pathways: HYBRID (Idaho National Laboratory 2024b), which contains high-resolution physical models for IES; Holistic Energy Resource Optimization Network (HERON) (Idaho National Laboratory 2024c), which analyzes IES long-term economic viability; and Optimization of Real-time Capacity Allocation (ORCA) (Idaho National Laboratory 2024d), designed for real-time control of IES via digital twins and optimal decision making, including autonomous and remote operation research. Development of the FORCE ecosystem is guided by three pillars: capability, which assures that the computational requirements of IES analysis are met by the software tools; reliability, which provides for consistent code performance and expected behaviors; and accessibility, which lowers the barrier to entry for using the software and accelerates analysis by users beyond the FORCE primary developers. Reliability of the FORCE ecosystem is established according to the American Nuclear Society?s Nuclear Quality Assurance (NQA-1) program [American Society of Mechanical Engineers 1982], with specific levels of software quality assurance (SQA) within NQA-1 applied to each software tool in FORCE. As the tools within FORCE have matured, some integration algorithms to accurately connect the software tools for holistic analysis have been developed and deployed within the FORCE software repository. In accordance with NQA-1 standards, regression tests are required to guarantee the software performs consistently even when new capabilities are added to the software. In this report, we document the deployment of both unit tests, which test the consistent behavior of small pieces of the FORCE code base, as well as integration tests, which test the consistent performance of full use cases for the FORCE integration algorithms. We further document the encapsulation of these tests within a test harness, which collectively checks for each successful test completion on demand. Finally, we document the automation of the test harness using GitHub Actions [GitHub 2024], which require all tests succeed before any new capability or other changes can be added to the FORCE integration software

97 MATHEMATICS AND COMPUTING↗

Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

97 MATHEMATICS AND COMPUTING↗