Search NASA⌕ Search

SEARCH · Search NASA

Results for “profiling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

A Physical Model Enhanced Data Driven Method for High-Resolution Residential Load Profile Generation

Residential buildings account for significant energy consumption, creating opportunities to offer grid services. As electric utilities seek to implement effective system operation strategies, understanding residential energy consumption patterns becomes essential; However, the time intervals of load profiles measured by utilities' smart meters are typically from 15 minutes to 60 minutes. The low-resolution data make it hard to extract appliance-level load information, which is critical for providing grid services. This paper presents a load profile generator designed to produce synthetic load profiles for residential buildings that emphasizes the importance of accurate representations of realistic energy consumption patterns. The generator takes realistic low-resolution residential load measurements and weather data as inputs, producing 1-minute interval profiles that match the characteristics of the original profiles. Further, this generator can be used to populate load profiles in areas where actual measurements are limited to improve the ability of utilities to analyze their distribution systems. By providing more high-resolution residential building load profiles, this tool supports electric utilities to enhance their residential building load control strategies and improve overall grid stability.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Reconstruction of current profiles from external magnetic and MSE measurements on DIII-D

This work introduces a new current model into the EFIT code for plasma current profile reconstruction. Using this model, edge-localized current density profiles are reconstructed solely from external magnetic measurements. Quantitative comparisons show that edge current profiles obtained with the new current model align closely with those from kinetic equilibrium reconstruction. The new model enables current density reconstruction with fewer diagnostics than kinetic equilibrium reconstruction (Lao et al 1990 Nucl. Fusion 30 1035–49), demonstrating that edge-localized current density information can be obtained from external magnetic measurements only, without the help of kinetic profiles and internal diagnostics, and without using the bootstrap current model. Furthermore, with the constraints of external magnetic and MSE measurements, current profiles in full radius obtained from the new model are in good agreement with the results of kinetic equilibrium reconstruction, which not only improves the efficiency of current reconstruction but also helps avoid possible errors caused by different kinds of diagnoses. Possible applications are also discussed, and a brief analysis of the evolution of the full-radius current density is performed. Noticeable decreases in both the magnitude and gradient of the edge current around the time of ELM bursts are observed. Moreover, analysis of the full radius current density profiles ( ρ N = 0 − 1.0, ρN denotes to square root of the normalized toroidal flux) reveals that as the edge current changes, the inner current also changes following a sinusoidal-like pattern at almost all time slices during four type-I ELMs in discharge 161493. The current evolution in the inner region ( ρ N = 0.2 − 0.6) is synchronized with the boundary region ( ρ N = 0.89 − 1.0), while the intermediate region ( ρ N = 0.6 − 0.89) shows opposite behavior. This sinusoidal-like variations in full-radius current density profile indicates strong core-pedestal coupling, suggesting ELMs significantly affect core plasmas, though current changes manifest differently across radial regions.

EFIT↗
DOE OSTI2024

A typology of organizational readiness for change based on a latent profile analysis

Companies have to undergo many change processes to succeed in the transforming economy. However, many change processes fail because employees are insufficiently accompanied through the process in a targeted manner. This study of N = 427 employees from a steel industry company undergoing a transformation process examines whether the organizational readiness for change (ORC) of highly affected employees can be classified into profiles, how these profiles can be predicted by various antecedents, and whether outcome variables such as job satisfaction can be explained by profile membership. Based on five facets of ORC (i.e., individual valence and positive affect), a total of six ORC profiles were identified: Proactives , Acceptors , Opens , Neutrals , Reluctants and Deniers . Employees’ optimism and the degree of perceived interpersonal and informational fairness can predict profile membership. It was shown that profiles significantly differ in relevant outcome variables satisfaction and intention to leave. These results contribute to the basic understanding of ORC and provide an initial approach for improving ORC profiles which could increase the success rate of change processes in companies.

Köhler, Alina↗
DOE OSTI2024

Stochastic machine learning via sigma profiles to build a digital chemical space

This work establishes a different paradigm on digital molecular spaces and their efficient navigation by exploiting sigma profiles. To do so, the remarkable capability of Gaussian processes (GPs), a type of stochastic machine learning model, to correlate and predict physicochemical properties from sigma profiles is demonstrated, outperforming state-of-the-art neural networks previously published. The amount of chemical information encoded in sigma profiles eases the learning burden of machine learning models, permitting the training of GPs on small datasets which, due to their negligible computational cost and ease of implementation, are ideal models to be combined with optimization tools such as gradient search or Bayesian optimization (BO). Gradient search is used to efficiently navigate the sigma profile digital space, quickly converging to local extrema of target physicochemical properties. While this requires the availability of pretrained GP models on existing datasets, such limitations are eliminated with the implementation of BO, which can find global extrema with a limited number of iterations. A remarkable example of this is that of BO toward boiling temperature optimization. Holding no knowledge of chemistry except for the sigma profile and boiling temperature of carbon monoxide (the worst possible initial guess), BO finds the global maximum of the available boiling temperature dataset (over 1,000 molecules encompassing more than 40 families of organic and inorganic compounds) in just 15 iterations (i.e., 15 property measurements), cementing sigma profiles as a powerful digital chemical space for molecular optimization and discovery, particularly when little to no experimental data is initially available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Galaxy cluster profiles: a Gaussian mixture model approach to halo miscentering

Measurements of the galaxy density and weak-lensing profiles of galaxy clusters typically rely on an assumed cluster center, which is taken to be the brightest cluster galaxy or other proxies for the true halo center defined as the minimum in the potential well. Departure of the assumed cluster center from the true halo center bias the resultant profile measurements, an effect known as miscentering bias. Currently, miscentering is typically modeled in stacked profiles of clusters with a two parameter model. We use an alternate approach in which the profiles of individual clusters are used with the corresponding likelihood computed using a Gaussian mixture model. We test the approach using halos and the corresponding subhalo profiles from the IllustrisTNG hydrodynamic simulations. We obtain significantly improved estimates of the miscentering parameters for both 3D and projected 2D profiles relevant for imaging surveys. We discuss applications to upcoming cosmological surveys. Our Python package for the Gaussian mixture model is publicly available at https://github.com/KyleMiller1/Halo-Miscentering-Mixture-Model.

Bayesian reasoning↗
DOE OSTI2024

Prediction of performance and turbulence in ITER burning plasmas via nonlinear gyrokinetic profile prediction

Burning plasma performance, transport, and the effect of hydrogen isotope (H, D, D-T fuel mix) on confinement has been predicted for ITER baseline scenario (IBS) conditions using nonlinear gyrokinetic profile predictions. Accelerated by surrogate modeling (Rodriguez-Fernandez et al 2022 Nucl. Fusion 62 076036), high fidelity, nonlinear gyrokinetic simulations performed with the CGYRO code (Candy et al 2016 J. Comput. Phys. 324 73), were used to predict profiles of T i , T e , and n e while including the effects of alpha heating, auxiliary power (NBI + ECH), collisional energy exchange, and radiation losses inside of $r/a$ = 0.9. Predicted profiles and resulting energy confinement are found to produce fusion power and gain that are approximately consistent with mission goals ($P_\textrm{fusion} = 500$ MW at Q = 10) for the baseline scenario and exhibit energy confinement that is within 1σ of the H-mode energy confinement scaling. The power of the surrogate modeling technique is demonstrated through the prediction of alternative ITER scenarios with reduced computational cost. These scenarios include conditions with maximized fusion gain and an investigation of potential resonant magnetic perturbation (RMP) effects on performance with a minimal number of gyrokinetic profile iterations required (3–6). These predictions highlight the stiff ITG nature of the core turbulence predicted in the ITER baseline and demonstrate that $Q \gt$ 17 conditions may be accessible by reducing auxiliary input power while operating in IBS conditions. Prediction of full kinetic profiles allowed for the projection of hydrogen isotope effects around ITER baseline conditions. The gyrokinetic fuel ion species was varied from H, D, and 50/50 D-T and kinetic profiles were predicted. Results indicate that a weak or negligible isotope effect will be observed to arise from core turbulence in IBS conditions. The resulting energy confinement, turbulence, and density peaking, and the implications for ITER operations will be discussed.

gyrokinetics↗
DOE OSTI2024

DESI Emission-line Galaxies: Unveiling the Diversity of [O II ] Profiles and Its Links to Star Formation and Morphology

We study the [O II ] profiles of emission-line galaxies (ELGs) from the Early Data Release of the Dark Energy Spectroscopic Instrument (DESI). To this end, we decompose and classify the shape of [O II ] profiles with the first two eigenspectra derived from principal component analysis. Our results show that DESI ELGs have diverse line profiles, which can be categorized into three main types: (1) narrow lines with a median width of ∼50 km s −1 , (2) broad lines with a median width of ∼80 km s −1 , and (3) two redshift systems with a median velocity separation of ∼150 km s −1 , i.e., double-peak galaxies. To investigate the connections between the line profiles and galaxy properties, we utilize the information from the COSMOS data set and compare the properties of ELGs, including star formation rate (SFR) and galaxy morphology, with the average properties of reference star-forming galaxies with similar stellar mass, sizes, and redshifts. Our findings show that, on average, DESI ELGs have a higher SFR and more asymmetrical/disturbed morphology than the reference galaxies. Moreover, we uncover a relationship between the line profiles, the excess SFR, and the excess asymmetry parameter, showing that DESI ELGs with broader [O II ] line profiles have more disturbed morphology and higher SFR than the reference star-forming galaxies. Finally, we discuss possible physical mechanisms giving rise to the observed relationship and the implications of our findings on the galaxy clustering measurements, including the halo occupation distribution modeling of DESI ELGs and the observed excess velocity dispersion of the satellite ELGs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

A new technique to retrieve aerosol vertical profiles using micropulse lidar and ground-based aerosol measurements

Accurately characterizing the vertical distribution of aerosols and their cloud-forming properties is crucial for understanding aerosol-cloud interactions and their impact on climate. This study presents a novel technique for retrieving vertical profiles of aerosols, cloud condensation nuclei (CCN), and ice nucleating particles (INP) by combining micropulse lidar, radiosonde, and ground-based aerosol measurements. Herein, the technique is applied to data collected by our team at Texas A&M University during the Tracking Aerosol Convection Interactions ExpeRiment (TRACER) campaign. Ground-based aerosol size distribution and CCN counter data are used to estimate the value of the aerosol hygroscopicity parameter, κ. The derived κ, together with Mie scattering theory and the relative humidity profile from the radiosonde, is used to estimate aerosol size growth and the associated increase in backscatter at each altitude. We then correct the lidar backscatter to dry conditions to produce the dry aerosol backscatter coefficient profile. The dry aerosol backscatter coefficient profile is linearly scaled to collocated surface measurements of aerosols, CCN, and INP to produce corresponding vertical profiles. Combining lidar backscatter profiles with aerosol and cloud nucleation measurements leads to a more realistic representation of vertical distributions of aerosol properties. The method could be readily applied to lidar measurements in future field campaigns.

Chen, Bo [Texas A & M Univ., College Station, TX (↗
DOE OSTI2024

Tilted lidar profiling: Development and testing of a novel scanning strategy for inhomogeneous flows

The most common profiling techniques for the atmospheric boundary layer based on a monostatic Doppler wind lidar rely on the assumption of horizontal homogeneity of the flow. This assumption breaks down in the presence of either natural or human-made obstructions that can generate significant flow distortions. The need to deploy ground-based lidars near operating wind turbines for the American WAKE experimeNt (AWAKEN) spurred a search for novel profiling techniques that could avoid the influence of the flow modifications caused by the wind farms. With this goal in mind, two well-established profiling scanning strategies have been retrofitted to scan in a tilted fashion and steer the beams away from the more severely inhomogeneous region of the flow. Results from a field test at the National Renewable Energy Laboratory's 135-m meteorological tower show that the accuracy of the horizontal mean flow reconstruction is insensitive to the tilt of the scan, although higher-order wind statistics are severely deteriorated at extreme tilts mainly due to geometrical error amplification. A numerical study of the AWAKEN domain based on the Weather Research and Forecasting Model and large-eddy simulation are also conducted to test the effectiveness of tilted profiling. It is shown that a threefold reduction of the error on inflow mean wind speed can be achieved for a lidar placed at the base of the turbine using tilted profiling.

17 WIND ENERGY↗
DOE OSTI2025

High-field side scrape-off layer density profile measurements and implications for high-field side LHCD coupling in DIII-D

The high-field side (HFS) scrape-off layer (SOL) is an often under-diagnosed region of tokamak plasmas. Situated in a region with favorable curvature, the HFS SOL has minimal turbulence-induced radial transport compared to the low-field side. Using profile reflectometry, the HFS SOL density profile is measured with high temporal resolution for a wide range of DIII-D plasma discharges for the first time. The magnetic configuration, particularly the location of the secondary separatrix (SS) largely determines the HFS SOL density profile. Additionally, density perturbations induced by edge-localized modes (ELMs) are observed in the HFS SOL, and the impact of ELMs on the SOL density profile is characterized for a range of magnetic configurations. It is found that ELM-induced HFS SOL perturbations are generally localized to within the SS and ELM-induced changes to the HFS wall density are minimized in near double-null configurations. The characterization of the HFS SOL density profile on DIII-D is crucial for the effective coupling of the planned HFS lower hybrid current drive (LHCD) launcher. Experimental HFS SOL measurements are used as input to full-wave simulations of LHCD coupling. Furthermore, this work simulates the effect of the magnetic configuration on LHCD coupling. It also simulates LHCD coupling in ELMs and high q min discharges. During such discharges, the LHCD coupling is predicted to be resilient to ELM-induced SOL density perturbations.

high-field side↗
DOE OSTI2024

Methods to Evaluate Subcolumn Profiles Based on Two-Point Diagnostics

In atmospheric models, stochastic generation of subgrid-scale profiles or “subcolumns” has been used for a variety of purposes. Such subcolumns can be generated from subgrid probability density functions (PDFs) at different vertical levels, when such PDFs are available. To do so, the generator needs to decide how strongly points should be correlated in the vertical, that is, how much the values should be overlapped. This is sometimes called “PDF overlap.” To assess vertical correlation in a simplified, observable setting, here the vertical correlation of vertical velocity in subcloud layers is examined. Doppler lidar is used to evaluate the vertical profiles of vertical velocity produced by a large-eddy simulation (LES) model and the Subgrid Importance Latin Hypercube Sampler (SILHS) subcolumn generator. In order to diagnose unrealistic features in subcolumn profiles, various statistical diagnostics are examined here, including the bivariate PDF of vertical velocity at two separated points (i.e., altitudes), the two-point velocity correlation, the integral correlation length, the PDF of two-point velocity differences, and the skewness and kurtosis of two-point velocity differences. The profiles produced by LES match lidar well, except that they are too smooth at small scales. The profiles produced by SILHS exhibit sharp jumps from updraft to downdraft that are not observed in the lidar data. To reduce the generation of these unrealistically sharp jumps, the SILHS sampling method is revised. The diagnostics confirm that the revised sampling method reduces the overprediction of sharp jumps.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Open-source generation of sigma profiles: impact of quantum chemistry and solvation treatment on machine learning performance

The combination of machine learning (ML) models with chemistry-related tasks requires the description of molecular structures in a machine-readable way. The nature of these so-called molecular descriptors has a direct and major impact on the performance of ML models and remains an open problem in the field. Structural descriptors like SMILES strings or molecular graphs lack size-independence and can be memory intensive. Machine-learned descriptors can be of low dimensionality and constant size but lack physical significance and human interpretability. Sigma profiles, which are unnormalized histograms of the surface charge distributions of solvated molecules, combine physical significance with low dimensionality and size-independence, making them a suitable candidate for a universal molecular descriptor. However, their widespread adoption in ML applications requires open access to sigma profile generation, which is currently not available. This work details the development of OpenSPGen – an open-source tool for generating sigma profiles. Also presented are studies on the effect of different settings on the efficacy of the generated sigma profiles at predicting thermophysical material properties when used as inputs to a Gaussian process as a simple surrogate ML model. We find that a higher level of theory does not translate to more accurate results. We also provide further recommendations for sigma profile calculation and use in ML models.

Salih, Fathya Y. M. [University of Notre Dame, IN ↗
DOE OSTI2025

High-compression implosions based on high density carbon ablator using modified drive and capsule dopant profiles

Laser-driven inertial fusion experiments have, for the first time, achieved a target gain greater than unity in a laboratory setting [Abu-Shawareb et al., Phys. Rev. Lett. 132, 065102 (2024)]. Despite this breakthrough, the burn-up fraction remains limited to about one-fourth of ideal estimates due to insufficient areal density, highlighting the potential for greater gains through enhanced compression. In our previous work, we demonstrated record-high compression of stagnated fuel in indirectly driven implosions using high-density carbon ablators. This was achieved by combining a continuous ramped pulse drive with a modified ablator dopant profile, which reduced mixing at the fuel–ablator interface and improved stability [Tommasini et al., Phys. Rev. Res. 5, L042034 (2023)]. Based on this foundation, the study presented here investigates the limits of compression achievable by combining the continuous ramped pulse drive with different dopant profiles to further minimize unstable interfaces and gradient discontinuities, thereby reducing fuel–ablator mixing. Our results demonstrate that the continuous ramped pulse consistently outperforms designs based on 3-shock drive pulses across all ablator profiles studied, with compression showing only a relatively modest dependence on dopant configurations that reduce the number of interfaces or eliminate discontinuities in the dopant gradient profile. Sub-scale experiments using the continuous ramped pulse achieved compression levels exceeding those of full-scale “HyE” implosions [Kritcher et al., Phys. Plasmas 28, 072706 (2021)] at similar adiabat, anticipating significant performance gains with increased scale, as supported by models and simulations. These findings underscore the critical role of the continuous ramped pulse in reducing mix and achieving improved compression. They also provide a foundation for future large-scale experiments to test the continuous ramped pulse design on deuterium–tritium fuel in the burn-wave propagation regime, leveraging the most effective combinations of continuous ramped pulse and dopant profiles identified in this study.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Sensitivities of time-dependent temperature profile predictions for NSTX with the multi-mode model

The Multi-Mode Model (MMM) for turbulent transport was applied to a large set of well-analyzed discharges from the National Spherical Torus Experiment (NSTX) in order to evaluate its sensitivities to a wide range of plasma conditions. MMM calculations were performed for hundreds of milliseconds in each discharge by performing time-dependent predictive simulations with the 1.5D tokamak integrated modeling code TRANSP. A closely related study (Lestz et al 2025 Plasma Phys. Control. Fusion 67 105029) concluded that MMM predicted electron and ion temperature profiles that were in reasonable agreement with NSTX observations, generally outperforming a different reduced transport model, TGLF. This finding motivates the more thorough investigation of the characteristics of the MMM predictions conducted in this work. The simulations with MMM have electron energy transport dominated by electron temperature gradient modes in the examined discharges with relatively low plasma β (ratio of kinetic plasma pressure to magnetic field pressure) and high collisionality, transitioning to a mixture of different modes for higher β and lower collisionality. The thermal ion diffusivity predicted by MMM is much smaller than the neoclassical contribution, in line with previous experimental analysis of NSTX. Nonetheless, the electron and ion temperature profiles are coupled via collisional energy exchange and thus sensitive to which transport channels are predicted. The time-dependent simulations with MMM are robust to the simulation start time, converging to remarkably similar temperature profiles later during the discharge. MMM typically overpredicts confinement relative to NSTX observations, leading to the prediction of overly steep temperature profiles. Plasmas with spatially broader temperature profiles, higher plasma β, and longer energy confinement times tend to be predicted by MMM with better agreement with the experiment. As a result, these findings provide useful context for understanding the regime-dependent tendencies of MMM in anticipation of self-consistent, time-dependent predictive simulations of NSTX-U discharges with these same modeling tools.

MMM↗
DOE OSTI2024

Hybrid model predictive control techniques for safety factor profile and stored energy regulation while incorporating NBI constraints

Abstract A novel hybrid Model Predictive Control (MPC) algorithm has been designed for simultaneous safety factor ( q ) profile and stored energy ( w ) control while incorporating the pulse-width-modulation constraints associated with the neutral beam injection (NBI) system. Regulation of the q -profile has been extensively shown to be a key factor for improved confinement as well as non-inductive sustainment of the plasma current. Simultaneous control of w is necessary to prevent the triggering of pressure-driven magnetohydrodynamic instabilities as the controller shapes the q profile. Conventional MPC schemes proposed for q -profile control have considered the NBI powers as continuous-time signals, ignoring the discrete-time nature of these actuators and leading in some cases to performance loss. The hybrid MPC scheme in this work has the capability of incorporating the discrete-time actuator dynamics as additional constraints. In nonlinear simulations, the proposed hybrid MPC scheme demonstrates improved q -profile+ w control performance for NSTX-U operating scenarios.

Physics↗
DOE OSTI2024

The mass profiles of dwarf galaxies from Dark Energy Survey lensing

We present a novel approach to extracting dwarf galaxies from photometric data to measure their average halo mass profile with weak lensing. We characterize their stellar mass and redshift distributions with a spectroscopic calibration sample. By combining the ${\sim} 5000\,\mathrm{deg}^2$ multiband photometry from the Dark Energy Survey and redshifts from the Satellites Around Galactic Analogs Survey with an unsupervised machine learning method, we select a low-mass galaxy sample spanning redshifts $z\lt 0.3$ and divide it into three mass bins. From low to high median mass, the bins contain [146 420, 330 146, 275 028] galaxies and have median stellar masses of $\log _{10}(M_*/\text{M}_\odot)=\left[8.52\substack{+0.57 -0.76},\, 9.02\substack{+0.50 -0.64},\, 9.49\substack{+0.50 -0.58}\right]$ . We measure the stacked excess surface mass density profiles, $\Delta \Sigma (R)$, of these galaxies using galaxy–galaxy lensing with a signal-to-noise ratio of [14, 23, 28]. Through a simulation-based forward-modelling approach, we fit the measurements to constrain the stellar-to-halo mass relation and find the median halo mass of these samples to be $\log _{10}(M_{\rm halo}/\text{M}_\odot)$ = [$10.67\substack{+0.2 -0.4}$, $11.01\substack{+0.14 -0.27}$, $11.40\substack{+0.08 -0.15}$]. The cold dark matter profiles are consistent with NFW (Navarro, Frenk, and White) profiles over scales ${\lesssim} 0.15 \, {h}^{-1}$ Mpc. We find that ${\sim} 20$ per cent of the dwarf galaxy sample are satellites. This is the first measurement of the halo profiles and masses of such a comprehensive, low-mass galaxy sample. The techniques presented here pave the way for extracting and analysing even lower mass dwarf galaxies and for more finely splitting galaxies by their properties with future photometric and spectroscopic survey data.

dark matter↗
DOE OSTI2026

Using strong lensing to detect subhaloes with steep inner density profiles

ABSTRACT The inner region of a subhalo’s density distribution is particularly sensitive to dark matter microphysics, with alternative dark matter models leading to both cored and steeply-rising inner density profiles. This work investigates how the lensing signature and detectability of dark matter subhaloes in mock HST-, Euclid-, and JWST-like strong lensing observations depend on the subhalo’s radial density profile, especially with regards to the inner power-law slope, $\beta$. We demonstrate that the minimum subhalo mass detectable along the Einstein ring of a system is strongly dependent on $\beta$. In particular, we show that subhaloes with $\beta = 2.2$ can be detected down to masses over an order-of-magnitude lower than their Navarro–Frenk–White (NFW) counterparts with $\beta = 1$. Importantly, we find that the detectability of subhaloes with steep inner profiles is minimally affected by increasing the complexity of the main lens galaxy’s mass model. This is a notable characteristic of these subhaloes, as those with NFW or shallower profiles become essentially undetectable when multipole perturbations are added to the lens model. The results of this work highlight how the underlying dark matter physics can significantly impact the expected number of subhalo detections from strong gravitational lensing observations. This is important for testing Cold Dark Matter against alternative models, such as Self-Interacting Dark Matter, that predict a diverse range of subhalo inner density profiles.

dark matter↗
DOE OSTI2024

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

The power & energy demands of HPC machines have grown significantly. Modern exascale HPC systems require tens of megawatts of combined power for computing resources and cooling facilities at full capacity. The current energy trend is not sustainable for future HPC systems, and there is a need to work toward the energy efficiency aspect of HPC performance. Energy awareness of the HPC applications at the job level is essential for running an efficient HPC system. This work aims to develop a pipeline to provide a production-level system-wide overview of the HPC workloads' power profile while handling evolving workloads exhibiting new power trends. We developed an open-set classification model for HPC jobs based on the properties of power profiles to continuously provide a system-wide holistic view of recently completed jobs. The pipeline helps continuously monitor the job-level power usage pattern of HPC and enables us to capture the new trends in applications' power behavior. We employed a comprehensive set of techniques to generate job-level data, custom-designed feature extraction methods to extract critical features from jobs' power profiles, clustering techniques powered by generative modeling, and open-set classification for identifying job profiles into known classes or an unknown set. With extensive evaluations, we demonstrate the effectiveness of each component in our pipeline. We provide an analysis of the resulting clusters that characterize the power profile landscape of the Summit supercomputer from more than 60K jobs executed in a year. The open-set classification classifies the known data sets into known classes with high accuracy and identifies unknown data noints with over 85% accuracy.

Karimi, Ahmad Maroof↗