Search NASA⌕ Search

SEARCH · Search NASA

Results for “program analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

AI for nuclear physics: the EXCLAIM project

An overview of the recent activity of the newly funded EXCLusives with AI and Machine learning (EXCLAIM) collaboration is presented. The main goal of the collaboration is to develop a framework to implement AI and machine learning techniques in problems emerging from the phenomenology of high energy exclusive scattering processes from nucleons and nuclei, maximizing the information that can be extracted from various sets of experimental data, while implementing theoretical constraints from lattice QCD. A specific perspective embraced by EXCLAIM is to use the methods of theoretical physics to understand the working of ML, beyond its standardized applications to physics analyses which most often rely on industrially provided tools, in an automated way.

Analysis and statistical methods↗

Bridging the Gap on Data and Analysis for Distribution System Planning: Information That Utilities Can Provide Regulators, State Energy Offices and Other Stakeholders

Electric utilities conduct planning annually to ensure their distribution system meets technical standards, policies, and regulations; addresses forecasted grid conditions; satisfies customer needs; and advances utility priorities. The plan identifies grid deficiencies, analyzes potential solutions, and prioritizes capital investments and other expenditures. About 20 U.S. states and jurisdictions require regulated utilities to file some type of distribution system plan with the public utility commission for review. Requirements for sharing distribution system data and analyses vary widely, from few specific requirements to a detailed list of information that must be provided. While utilities conduct extensive analysis to develop distribution system plans, in most jurisdictions regulators and stakeholders do not know what data are available and how the utility uses the data in planning and investing. This report aims to bridge the gap by increasing understanding of the types of data and analyses utilities employ to develop distribution system plans and how the information affects their decision-making. The report describes information that states and stakeholders can ask for related to 11 data categories: -Forecasting loads and distributed energy resources (DERs) -Scenario analysis -Worst-performing circuits -Asset management strategy -Hosting capacity analysis -Value of DERs -Grid needs assessment -Cost-effectiveness framework for investments -Distribution system investment strategy and implementation -Geotargeted programs -Non-wires alternatives procurements.

24 POWER TRANSMISSION AND DISTRIBUTION↗

CONNECT Neutronics Initial Report

This report represents the first status update from the Creation of Next-generation Nuclear Energy Computational Technology (CONNECT) effort within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program and is intended to satisfy the reporting requirements of the following milestones: • M3MS-24OR0101321: Assess needs, requirements and opportunities for high-fidelity neutronics and transport as used in DOE-NE program. • M3MS-24AN0101301: Generate a community report on the needs, requirements, and opportunities for high-fidelity neutronics and transport as used in DOE-NE programs and industry. • M3MS-24OR0202433: Implement and assess numerical strategies leveraging Monte Carlo neutron transport on GPUs for production analysis. In particular, Sections 1, 2, and 3 detail the assessment of the current state of practice and the landscape of the broader advanced computing world to meet the objectives of M3MS-24OR0101321 and M3MS-24AN0101301, while Sections 4 and 5 describe new work during FY24 to extend current GPU Monte Carlo capabilities in areas relevant to active NEAMS development to satisfy M3MS-24OR0202433. Section 6 offers some thoughts about the potential future impact of Monte Carlo neutronics on NEAMS and the nuclear industry.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Abstract for CRADA between NETL and Rivalia Chemical Co

The National Energy Technology Laboratory (NETL) will assist Rivalia Chemical Co (Participant) with system analyses to aid the Participant with setting priorities and securing funding. The Participant is an early-stage startup pioneering new chemical extraction technology to solve two important problems: critical mineral scarcity and coal ash waste management. The U.S. generates coal fly ash from coal combustion for power generation and has amassed over two billion metric tons of ash, which contains valuable rare earth elements. The ash is often stored in unlined ponds and frequently contaminates the local environment. The Participant’s patent-pending process harvests rare earths from ash, then transforms the residual ash for use in green concrete, providing an economic pathway for utilities to empty and remediate the ash ponds. Founder Laura Stoy created the company in July 2022 after developing the core intellectual property during her Ph.D. at the Georgia Institute of Technology. Stoy is currently participating in the Chain Reactions Innovations (CRI) program at the U.S. Department of Energy (DOE) Argonne National Laboratory (ANL) where she will be optimizing the core technology and scaling from bench scale to demonstration scale. The technology has been validated at bench scale (TRL3); the goal is to approach TRL5 by the conclusion of the CRI program and prepare to raise capital investment for a pilot facility. NETL and the Participant will develop an updated technoeconomic analysis (TEA) and identify key sustainability performance parameters to inform ’s research and development priorities and de-risk the technology. NETL will also provide the Participant with guidance to prepare a more detailed life cycle assessment (LCA), and a narrative on the Participant’s product markets. These tools will aid the Participant with the next steps of commercialization.

01 COAL, LIGNITE, AND PEAT↗

Convergent Manufacturing of Large-Scale Components for Nuclear Applications, via Additive Manufacturing and Powder Metallurgy Hot Isostatic Pressing

Powder metallurgy (PM)–hot isostatic pressing (PM-HIP) has long been recognized as a powerful route for producing fully dense, near net shape metallic components. By consolidating powders under high temperature and pressure, HIP provides isotropic properties, uniform microstructures, and scalability to complex geometries that are vital for sectors such as aerospace, energy, and nuclear power. Yet despite these advantages, the technology has remained constrained by costly trial and error canister fabrication, limitations of conventional forging, and incomplete knowledge about how the canister design influences final part properties. Additive manufacturing (AM), by contrast, thrives on design freedom and geometric flexibility but struggles with speed, scalability, and cost when applied to very large structures. The research presented in this report investigated how a convergent manufacturing approach, combining AM with PM-HIP, can merge the strengths of both technologies, leveraging AM’s flexibility for canister design and HIP’s consolidation capability to deliver reliable, large, and complex parts. The work progressed through three case studies that built on one another in scale and complexity. Small cylindrical canisters fabricated by conventional methods, laser powder bed fusion, and directed energy deposition were filled with stainless steel powders and subjected to HIP. The resulting parts demonstrated near-full density and mechanical properties on par with wrought stainless steel, showing for the first time that AM canisters can be a direct substitute for conventional ones without sacrificing quality. The next step involved a medium-scale, noncentrosymmetric T-valve, which is an enclosed, multibranch geometry that tested the limits of AM + PM-HIP integration. The T-valve achieved predictable shrinkage and uniform densification, confirming feasibility for enclosed designs. However, this study also revealed oxide inclusions and interfacial challenges at the AM + HIP boundary, underscoring the critical importance of controlling interface chemistry and employing robust, in situ strategies, such as melt pool monitoring and thermal monitoring, coupled with nondestructive evaluation techniques such as x-ray computed tomography. Finally, the effort culminated in fabricating a large-scale impeller weighing nearly 2000 lb and spanning 5 ft in diameter. Produced via multirobot wire arc AM and hot isostatic pressed to near-full density, the impeller validated industrial-scale feasibility. Predictive models closely matched experimental shrinkage, tensile properties were spatially uniform across the component, and the AM + PM-HIP interface proved mechanically sound despite the presence of oxide-decorated prior particle boundaries. This large-scale demonstration is a major milestone, showing that hybrid AM + PM‑HIP can reliably deliver components at reactor-relevant scales. Collectively, these studies charted a logical pathway: small-scale work built scientific confidence, medium-scale work highlighted opportunities and challenges, and large-scale work proved industrial impact. The overarching conclusion of this report is that AM + PM-HIP should not be seen as a replacement for forging but as a complementary pathway that provides the US with flexibility, resilience, and new options for manufacturing nuclear-grade components. Looking ahead, several directions emerge as critical to sustaining progress. Predictive modeling must become faster, more accessible, and more accurate, with digital twins and machine learning reducing reliance on trial and error. Powders and alloys must be optimized for HIP, with improved cleanliness, reduced oxides, and tailored chemistries that enhance creep, fatigue, and irradiation resistance. Interfaces between AM and HIP regions must be better engineered through coatings, machining strategies, and surface treatments to mitigate oxide formation and ensure reliable bonding to explore opportunities for HIP of targeted compositional parts, as well as multimaterial HIP cladding applications. Monitoring and nondestructive evaluation need to expand, incorporating multimodal sensors, x-ray computed tomography, and real-time data integration through platforms such as Pelican. At the same time, the pathway to industrial adoption requires techno-economic analysis, machinability studies, and qualification frameworks aligned with industry and regulatory standards. Finally, workforce and academic engagement must be strengthened. Programs that train technicians and engineers for US Navy and US Department of Energy manufacturing challenges should be paired with academic partnerships to support fundamental research, with open sharing of non-export-controlled data to accelerate innovation and build the next generation of experts. In conclusion, this report demonstrates that hybrid AM + PM-HIP is scientifically viable and strategically important. By combining the design agility of AM with the consolidation strength of HIP and embedding modeling, monitoring, and workforce development, this approach provided a transformative new capability for US manufacturing. The path forward is clear: hybrid AM + PM-HIP is not just a promising research direction but is also potentially an industrially relevant pathway that can reshape how nuclear-grade components are designed, qualified, and deployed.

36 MATERIALS SCIENCE↗

ICARUS at the Short-Baseline Neutrino Program: First Results

First results from ICARUS experiment are presented at FNAL. The selection of nu_mu CC events with 1muon+ N Protons from BNB targeted at numu disappearance analysis is presented for a subset of the collected statistics, , compared with MC predictions. A similar selection of nu_mu CC events 1muon+ N Protons + 0 pions in the NuMI beam aiming at the neutrino-Argon cross section measurement is also presented, together with a control sideband requiring in addition at least a pion candidate. Finally the result of a BSM search for a new particle decaying into two muons is also presented, showing no evidence within the studied sample of new physics.

43 PARTICLE ACCELERATORS↗

Cost Benefit Analysis of Solar PV for the City of Oldsmar, FL

The City of Oldsmar is in the early stages of exploring renewable energy opportunities as a part of their initiative to reduce energy costs, improve backup power capacity, and begin the transition to more sustainable operations. The city is particularly interested in deploying a floating or ground-mounted solar PV system at its wastewater treatment plant. Currently, there are no solar PV installations in Oldsmar and there has been hesitancy to implement such a project due to the possible capital costs and limited technical capacity. Despite this the initiative has gained internal buy-in among staff working for the city. To assist with gaining more buy-in and making future decisions the city sought technical assistance (TA) from the Energy to Communities (E2C) Expert Match Program. Through the Expert Match Program, the city received TA provided by the Pacific Northwest National Lab (PNNL) to evaluate the cost effectiveness of several solar options. This report details the analysis and results of the work performed for TA.

14 SOLAR ENERGY↗

Curating Carbon Storage Data for Reuse: Enabling Research and Modeling from Earth’s Surface to Subsurface

The volume of public geologic carbon storage (GCS) data resources has continued to increase in recent years as the result of an increase in funding from government, industry, and academia towards national, basin, regional and field scale studies to ensure carbon capture and storage becomes a commercially viable operation. Despite the increasing volume of data, GCS data applied towards analyses such as geologic, cost, and risk modeling continues to be multi-sourced and often disparate in nature, published across government agencies, websites, data repositories and buried in derivative reports and documents. Much of the time preparing for an analysis and derivative product development is spent collecting, aggregating, transforming and preparing input data. There have been significant efforts within the DOE National Energy Technology Laboratory’s Carbon Storage Program to optimize multi-source, multi-scale subsurface geologic data curation and aggregation to support data discovery, interoperability, and reuse. Methods include the use of artificial intelligence, machine learning, and data science techniques. This talk will discuss the workflows, best practices, and processes developed to support the aggregation and curation of data through the whole system – surface to subsurface data - that support multi-scale, multi-purpose analysis for carbon storage research.

Morkner, Paige↗

Primary System Thermal Fluids Analysis Model Development for the Compact High Temperature Gas Reactor (HC-HTGR) (Final Report)

Horizontal Compact High Temperature Gas Reactor (HC-HTGR) is being designed by a multi-disciplinary team of nuclear, mechanical, and structural engineers under the support of a DOE-NE Advanced Reactor Demonstration Program’s Advanced Reactor Concepts-20 (ARC-20) award. The objective of this ARC-20 project is to deliver a conceptual design for the proposed HC-HTGR and support its commercialization as a safe, low-cost HTGR. Argonne National Laboratory (Argonne) is collaborating on the thermal hydraulic design and analysis of HC-HTGR reactor pressure vessel internals to ensure the reactor maintains sufficient safety margins during normal operation, shutdown, and accident conditions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Paired Hydro-Battery Hybrid System Operations Using MIQP Based Multi-Objective Optimization

Hybridizing a hydropower plant with a battery energy storage system is often a very expensive decision. So to make the case for feasibility of hybridization the cost benefit analysis must be comprehensive. Most literature found on this subject only uses one out of many different available value streams to carry out a feasibility analysis. To that end, in this study we propose a multi-objective optimization formulation and a mixed-integer quadratic programming optimization engine that considers multiple different value streams and optimizes hydro-battery hybrid system paired operations to maximize revenue generated from energy arbitrage while simultaneously minimizing the total hydro turbine mileage thus reducing turbine starts and stops and improving turbines life all while following all environmental constraints and not violating any limitations either regulatory or preferential (i.e., to support recreational activities like white water rafting, etc.). In this study we also implemented the developed optimization methodology to a real-world case study of Bagnell dam hydropower facility (8 units totaling 240 MW rated power capacity) which is owned and operated by our industry partner Ameren Energy Inc. The case study outcomes shows that by hybridizing the Bagnell dam hydropower facility with a 60 MW x 2-hr battery energy storage system, the annual benefits can be increased over \$6 million while reducing the annual mileage averaged per turbine and number of start/stops by over 98\% and 85\% respectively.

Chalishazar, Vishvas H.↗

Finite Element Analysis of the TRUST Nonlinear Dynamics Testbed

This paper builds on prior work conducted within the Los Alamos National Laboratory (LANL) Testbeds to Reduce Uncertainty in Simulations and Tests (TRUST) program. Specifically, it builds on finite element (FE) modeling efforts for the TRUST program’s Nonlinear Dynamics (ND) testbed. Historically, the FE model for the ND testbed has exclusively utilized a Lanczos eigensolver that linearly extracts the system’s natural frequencies. This paper investigates the Abaqus 2024’s explicit dynamic solver, which implements a central difference explicit solver. The central difference method used in Abaqus can capture nonlinear material responses in structural dynamic simulations making it suitable for the ND FE model.

42 ENGINEERING↗

Wind and Temperature Consensus at Horn Point, HU-Beltsville, Piney Run (Maryland) in support of CoURAGE

The Maryland Department of the Environment (MDE) operates a ground-based atmospheric profiling network consisting of collocated radar wind profilers (RWP) and radio acoustic sounding systems (RASS) as part of its Ambient Air Monitoring Program. This network provides continuous observations of wind and temperature structure in the lower troposphere to support air quality forecasting, regulatory analysis, and atmospheric research. The network currently includes three fixed sites across Maryland: Horn Point (HP, lower eastern shore) [38.587525°,-76.141006°], Howard University-Beltsville (HUB, central Maryland) [39.055277°, -76.878632°], and Piney Run (PR, western Maryland) [39.705950°, -79.012000°] The network is designed to capture regional variability in atmospheric transport and boundary-layer processes. These systems measure vertical profiles of horizontal wind speed and direction using Doppler radar techniques, with observations typically spanning from ~100 m above ground level up to approximately 2.5–4 km. Measurements are derived from the Doppler shift of backscattered electromagnetic signals, enabling retrieval of wind vectors at multiple altitudes with high temporal resolution (e.g., 30-minute averages reported every 6 minutes). Each radar wind profiler is paired with a Radio Acoustic Sounding System (RASS) to provide profiles of virtual temperature in the lower atmosphere (~100–200 m AGL) by measuring the propagation speed of acoustic waves. Together, the RWP/RASS system yields a coupled data set of thermodynamic and kinematic atmospheric structure, including additional parameters such as vertical velocity, radial velocity, signal-to-noise ratio, and spectral width for advanced analysis. There are two types of files for each station: wind data (files with a "w" prefix) and virtual temperature RASS data (files with a "t" prefix). The wind data files are in the format wYYDDD.cns, where YY is the 2-digit year and DDD is the day of the year. The RASS virtual temperature data files are in the format tYYDDD.cns. Each record has the following header structure: Line 1 : Station Name RASS files Line 2 : RASS rev DeTect_2.0, WINDS files Line 2 : WINDS rev ATI 5.1 Line 3 : N latitude, W longitude, and site elevation (m) Line 4 : Date and begin time of consensus: yy mm dd hh mn ss plus # minutes to add to get UTC Line 5 : Consensus averaging time (minutes); number of beams; number of range gates Line 6 : Number of records required to make consensus (num) total number of records (tot) and the consensus window size (m/s) in the format: num:tot (window) RASS files Line 7 : no. of coded cells, no. of spec, pulse width (ns), and inter-pulse period (µs), WINDS files Line 7 : No. of coded cells, no. of spectra, pulse width (ns), and inter-pulse period (µs), each with a pair of values: first value is for oblique beams, second for vertical RASS files Line 8 : Full scale Doppler value (m/s) Delay to first gate (ns) Number of gates Spacing of gates (ns), WINDS files Line 8 : Full scale Doppler velocity (m/s), oblique and vertical Vertical correction applied to oblique beams? (0 = no, 1 = yes) Delay to first gate (ns), oblique and vertical Number of gates, oblique and vertical Spacing of gates (ns), oblique and vertical Line 9 : Azimuth and elevation (9s indicate vertical beam not used) RASS files Line 10, values : HT = Height above ground (km), T = Uncorrected virtual temperature consensus (deg C), Tc = Corrected virtual temperature consensus (deg C), W = Vertical wind consensus (9s indicate vertical beam not used, w-component, positive upward, m/s), CNT = Number of records that made consensus (for the 3 values in same order), SNR = Average signal to noise ratio (dB) of records in consensus (same order) WINDS files Line 10, values : HT = Height above ground (km), SPD = Wind speed (m/s), DIR = Wind direction (deg E of N from N), RAD = Radial velocities for each beam (m/s) in order given in azimuth and elevation line (positive toward radar; 9s indicate vertical beam not used, CNT = Number of records that made consensus, SNR = Average signal to noise ratio (dB) of records in consensus

{"wind speed and direction",temperature}↗

GeoBridge: Connecting Communities to Geothermal Information and Opportunities: Preprint

The geothermal community is well established with long-standing events, organizations, and tools that are known across the geothermal community. But many of these tools and resources are located behind pay walls, require memberships, or are otherwise difficult to find, especially for people looking to join the geothermal community. These barriers to access can prevent outsiders from discovering valuable geothermal resources, limiting the geothermal community's potential for collaboration with other communities, such as clean energy entrepreneurs looking to expand into geothermal energy. The Department of Energy's (DOE) GeoBridge serves to bring these communities together by acting as a single, publicly accessible, searchable portal that facilitates easy access to available geothermal knowledge and information. It works to expand and diversify the pool of geothermal stakeholders by providing in-roads to geothermal information and community resources. It helps build a stronger geothermal community; one inclusive of individuals and groups from a variety of different backgrounds, including potential investors and start-up companies looking to accelerate innovation in geothermal technologies. By linking communities to geothermal information, analysis and expertise, GeoBridge serves as a launch point, directing interested parties to existing data and tools, events, educational resources, STEM programs, permitting and regulatory information, and other resources that can be used to evaluate, promote, and discover geothermal opportunities.

access↗

GeoBridge: Connecting Communities to Geothermal Information and Opportunities

The geothermal community is well established with long-standing events, organizations, and tools that are known across the geothermal community. But many of these tools and resources are located behind pay walls, require memberships, or are otherwise difficult to find, especially for people looking to join the geothermal community. These barriers to access can prevent outsiders from discovering valuable geothermal resources, limiting the geothermal community's potential for collaboration with other communities, such as clean energy entrepreneurs looking to expand into geothermal energy. The Department of Energy's (DOE) GeoBridge serves to bring these communities together by acting as a single, publicly accessible, searchable portal that facilitates easy access to available geothermal knowledge and information. It works to expand and diversify the pool of geothermal stakeholders by providing in-roads to geothermal information and community resources. It helps build a stronger geothermal community; one inclusive of individuals and groups from a variety of different backgrounds, including potential investors and start-up companies looking to accelerate innovation in geothermal technologies. By linking communities to geothermal information, analysis and expertise, GeoBridge serves as a launch point, directing interested parties to existing data and tools, events, educational resources, STEM programs, permitting and regulatory information, and other resources that can be used to evaluate, promote, and discover geothermal opportunities.

access↗

ANALYSIS OF SUITABLE METHODOLOGIES FOR COMPRESSOR MASS FLOW RATE CORRECTION TO OTHER SUPERHEAT LEVELS AND REFRIGERANTS

This paper investigates the impact of suction conditions and refrigerant on scroll compressor mass flow rate by using calorimeter tests from AHRI-11 and AHRI-21 reports, published by AHRI's Low-GWP Alternative Refrigerants Evaluation program. Two Copeland scroll compressors (20 and 51 cm3) have been analyzed including different suction conditions (SH = 11K, SH = 22K, Ti = 18ºC) and several refrigerants (R134a, R32, R410A, R404A, etc.). Previous studies have explored response surfaces for energy consumption and mass flow rate variables. This study aims to expand the analysis by identifying the optimal approach to extrapolate mass flow rate from specific suction conditions to others SH or suction temperature levels and refrigerants. The current compressor characterization standard relies on the 1981 Dabiri correlation to correct compressor mass flow rate with suction conditions. Thus, this study aims to assess the adequacy of this correction and explore alternative correction methods for improved results.

Marchante Avellaneda, Javier↗

TEAMER - Extreme Events Modeling for the MARMOK-OWC Wave Energy Converter

Through the TEAMER program, Sandia National Laboratories (SNL) collaborated with IDOM Incorporated to study their MARMOK-Oscillating Water Column (MARMOK-OWC) wave energy conversion device. The study yielded a quantitative understanding of hydrodynamic pressures on the oscillating water column (OWC) device surfaces, the mooring tensions, and the dynamic performance of the device under extreme ocean wave conditions. This project utilized a comprehensive multi-phase Navier-Stokes flow solver with an overset body-fit mesh to predict fluid velocities and hydrodynamic forces on the MARMOK-OWC device. Computational Fluid Dynamics (CFD) analysis were conducted using OpenFOAM. This data includes the OpenFOAM cases (setup and data) to run the extreme events developed during the project. This project is part of the TEAMER RFTS 4 (request for technical support) program.

16 TIDAL AND WAVE POWER↗

The Dark Energy Bedrock All-sky Supernova Program: Motivation, Design, Implementation, and Preliminary Data Release

Precise measurements of Type Ia supernovae (SNe Ia) at low redshifts (z) serve as one of the most viable keys to unlocking our understanding of cosmic expansion, isotropy, and growth of structure. The Dark Energy Bedrock All-Sky Supernovae (DEBASS) program will deliver a uniformly calibrated low-z dataset of more than 400 spectroscopically confirmed SNe Ia in the Southern Hemisphere. DEBASS utilizes the Dark Energy Camera to image supernovae in conjunction with the Wide-Field Spectrograph to gather comprehensive host-galaxy information. By using the same photometric instrument as both the Dark Energy Survey (DES) and the DECam Local Volume Exploration Survey, DEBASS not only benefits from a robust photometric pipeline and well-calibrated images across the Southern sky, but can replace the historic and external low-z samples that were used in the final DES supernova analysis. In this paper, along with a companion paper, we present an early data release of 77 DEBASS SNe within the DES footprint. We introduce the DEBASS program, discuss its scientific goals and the advantages it offers for supernova cosmology, and present our initial results demonstrating data quality. With this early data release, we find a robust median absolute standard deviation of Hubble diagram residuals of ∼0.10 mag and an initial measurement of the host-galaxy mass step of 0.06 ± 0.04 mag, both before performing bias corrections. This low scatter shows the promise of a low-z SN Ia program with a well-calibrated telescope and high signal-to-noise ratio across multiple bands.

Sherman, Nora F. [Boston U.] (ORCID:00000001539901↗

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗