Search NASA⌕ Search

SEARCH · Search NASA

Results for “Scientific Programming”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Undergraduate Women in STEM Internship Program

In collaboration with the Universities Research Association, Inc. (URA), establishment of the Undergraduate Women in STEM Internship pilot program assists Fermi Research Alliance, LLC (FRA) with honoring its commitment to increasing gender, racial and ethnic workforce diversity. This focused initiative is intended to invite, support and yield a qualified pipeline of alumnae underrepresented in FRA’s science and technology management and technical staff positions. Interns in this program spend 10-12 weeks at Fermilab working under the direct leadership, guidance and supervision of scientists, engineers, computing professionals, technicians and staff across all directorates performing hands-on research. In addition, the intern cohort meets with mentors and advisors to grow their professional networks, to take part in engaging and inclusive intellectual discussions, to directly benefit from workplace resources, and to participate in professional development and social engagement opportunities. The design of each research project and the supervision, mentorship and evaluation is conducted by a scientific, engineering, computing professional at Fermilab.

99 GENERAL AND MISCELLANEOUS↗

Neutrino Physics and Astrophysics at Colliders

Nonzero neutrino masses guarantee new physics and neutrinos are excellent probes of extreme environments in the Universe. The recent collider neutrino experimental program, including FASER$ν$ and SND@LHC, along with the planned Forward Physics Facility at the High-Luminosity Large Hadron Collider, is opening a new window into neutrino physics and astrophysics. In this article, we review recent achievements and prospects of collider neutrino experiments, including key achievements such as the first measurements of collider neutrino interactions at unprecedented energies and the exploration of new physics scenarios, like dark matter candidates, sterile neutrinos, and non-standard neutrino interactions. For concreteness, we will focus on the significant scientific opportunities presented by the Forward Physics Facility, which will enable precision measurements of neutrino cross sections and proton structure at low parton momentum fraction. Furthermore, collider neutrino studies will substantially reduce systematic uncertainties in calculating atmospheric neutrino fluxes, thereby improving astrophysical neutrino observations as well as advancing our understanding of cosmic-ray interactions.

Machado, Pedro [Fermilab] (ORCID:0000000291187354)↗

Environmental Extremes: Building a New Research Partnership between the University of Nevada Reno and the Pacific Northwest National Laboratory (Final Report)

This project focused on strengthening research partnership and collaboration between the University of Nevada, Reno (UNR) and the Pacific Northwest National laboratory (PNNL) in two focused areas: wildfires and hydrology in the context of environmental extremes. The goal was to overcome barriers and bring UNR university researchers, students, and postdocs up to speed and entrained into DOE/SC/BER /Earth and Environmental System Science Division’s (EESSD) environmental research enterprise. UNR continues to work with the Earth and Biological Sciences Directorate (EBSD) at PNNL to create a broad new collaborative research program connecting scientists and research faculty at the two institutions. This research partnership has been designed to increase the capabilities and velocities of both institutions by developing long-term relationships between researchers from each institution, exposing university researchers to the deep capabilities in the DOE National Laboratories and user facilities, and establishing a pipeline of skilled and experienced graduate students and postdoctoral researchers ready to work alongside DOE scientists to take on grand challenge science problems. These collaborations are intended to ultimately benefit the public by advancing scientific discovery, unleashing the scientific potentials through collaboration and connection, enriching the technical and scientific competitiveness of our nation, and enabling the development of a skilled workforce to tackle the critical scientific challenges that face our nation’s security, infrastructure, and prosperity.

54 ENVIRONMENTAL SCIENCES↗

Bridging paradigms: Designing for HPC-Quantum convergence

Here, this paper presents a comprehensive software stack architecture for integrating quantum computing (QC) capabilities with High-Performance Computing (HPC) environments. While quantum computers show promise as specialized accelerators for scientific computing, their effective integration with classical HPC systems presents significant technical challenges. We propose a hardware-agnostic software framework that supports both current noisy intermediate-scale quantum devices and future fault-tolerant quantum computers, while maintaining compatibility with existing HPC workflows. The architecture includes a quantum gateway interface, standardized APIs for resource management, and robust scheduling mechanisms to handle both simultaneous and interleaved quantum–classical workloads. Key innovations include: (1) a unified resource management system that efficiently coordinates quantum and classical resources, (2) a flexible quantum programming interface that abstracts hardware-specific details, (3) A Quantum Platform Manager API that simplifies the integration of various quantum hardware systems, and (4) a comprehensive tool chain for quantum circuit optimization and execution. We demonstrate our architecture through implementation of quantum–classical algorithms, including the variational quantum linear solver, showcasing the framework’s ability to handle complex hybrid workflows while maximizing resource utilization. This work provides a foundational blueprint for integrating QC capabilities into existing HPC infrastructures, addressing critical challenges in resource management, job scheduling, and efficient data movement between classical and quantum resources.

97 MATHEMATICS AND COMPUTING↗

Equilipy: a python package for calculating phase equilibria

The CALPHAD (CALculation of PHAse Diagram) approach (Nigel Saunders & Miodownik, 1998) provides predictions for thermodynamically stable phases in multicomponent-multiphase materials across a wide range of temperatures. Consequently, the CALPHAD calculations became an essential tool in materials and process design (Luo, 2015). Such design tasks frequently require navigating a high-dimensional space due to multiple components involved in the system. This increasing complexity demands high-throughput CALPHAD calculations, especially in the rapidly evolving field of alloy design. In response to the need, we developed Equilipy an open-source Python package designed for calculating phase equilibria of multicomponent-multiphase systems. Equilipy is specifically tailored for high-throughput CALPHAD calculations, offering parallel computations across multiple processors and nodes with the given NPT input conditions namely elemental compositions (N), pressure (P), and temperature (T). Equilipy utilizes the program structure and Gibbs energy functions from the Fortran-based program, Thermochimica (Piro et al., 2013), with incorporating a new Gibbs energy minimization algorithm. This algorithm, originally developed by Capitani and Brown in 1987 (Capitani & Brown, 1987), has been revised and implemented to enhance the stability and performance of calculations. The Fortran codes are precompiled and interfaced with Python via F2PY, ensuring high computation speed. Benchmark tests shown in Figure 1 demonstrate that Equilipy’s computation speed is comparable to those of established commercial software, TC-Python and PanPython. This result highlights its efficiency and potential applications in various scientific and industrial fields.

97 MATHEMATICS AND COMPUTING↗

Global Corn Heat Stress: Mean and SD of Degree Days Above 29°C based on NEX-GDDP-CMIP6 Climate Projections

Description This global dataset provides the estimated mean and standard deviation (SD) of corn heat stress (degree days above 29°C) for a set of climate models in NEX-GDDP-CMIP6 at 0.25-degree resolution. The NEX-GDDP-CMIP6 dataset is comprised of global downscaled climate scenarios derived from the General Circulation Model (GCM) runs conducted under the Coupled Model Intercomparison Project Phase 6 (CMIP6). The current dataset includes: Long-Term Average Degree Days Above 29°C- Historical Long-Term Average Degree Days Above 29°C- SSP245 Long-Term Standard Deviation of Degree Days Above 29°C- Historical Long-Term Standard Deviation of Degree Days Above 29°C- SSP245 The mean and SD are calculated over 1985-2014 for the historical period and over 2035-2064 for future projections. A full description of methods, including growing season, daily temperature distribution, and statistical coefficients, can be found in Haqiqi (2024). The source climate data are obtained from https://ds.nccs.nasa.gov/thredds2/catalog/catalog.html and are described in Thrasher et al (2022). The codes used to create this dataset are available at https://github.com/ihaqiqi/dd29c_nex_cmip6. Acknowledgments This work was supported by the US Department of Energy, Office of Science, Biological and Environmental Research Program, Earth and Environmental Systems Modeling, MultiSector Dynamics under Cooperative Agreement DE-SC0022141. The data processing, computation, and storage were completed on Purdue Anvil supercomputer and cyberinfrastructure supported by the National Science Foundation HDR award # 2118329: "NSF Institute for Geospatial Understanding through an Integrative Discovery Environment (I-GUIDE)". References Haqiqi. I. (2024). Trade can buffer climate-induced risks and volatilities in crop supply. Environmental Research: Food Systems. https://doi.org/10.1088/2976-601X/ad7d12 Thrasher, B., Wang, W., Michaelis, A., Melton, F., Lee, T., & Nemani, R. (2022). NASA global daily downscaled projections, CMIP6. Scientific Data, 9(1), 262. https://doi.org/10.1038/s41597-022-01393-4

Climate Change↗

An open-access simulated earthquake ground-motion database for an M7 Hayward Fault earthquake in the San Francisco Bay Region

Comprehensive understanding of earthquake ground motions, particularly in the near-fault region of large-magnitude events, is limited by gaps in strong-motion data. This challenge is prominent in areas with high seismic hazard but infrequent large earthquakes where data is sparse and difficult to interpret. These data limitations lead to uncertainties in the development of site-specific ground motions, which are crucial for engineering risk assessments. To address these challenges, physics-based regional-scale ground-motion simulations have been developed. With the emergence of exaflop-scale computing ecosystems, it is now possible to simulate regional earthquake processes at unprecedented fidelity and generate the large number of fault rupture realizations necessary to characterize both intra- and inter-event ground-motion variability. This article introduces a new database of simulated earthquake ground motions, created for applications in earthquake engineering, earthquake planning, and emergency response. The inaugural version of the database features simulated ground motions for a magnitude 7 Hayward Fault earthquake in the San Francisco Bay Region (SFBR), using the EarthQuake SIMulation (EQSIM) simulation framework and the Graves–Pitarka kinematic rupture model. The aim is to provide high-fidelity, spatially dense, three-component motions generated on the Department of Energy’s (DOE) newest generation of graphics processing unit (GPU)-accelerated supercomputers. These motions are being made openly available to the engineering, scientific, and disaster planning communities. In addition, this work develops protocols for the efficient dissemination of these large data sets and emphasizes community engagement to build confidence in their application. This article discusses the methodology behind the data, underlying software verification and validation, scalable data management, and a user interface for data access. The goal is to facilitate widespread use and elicit expert feedback to maximize the utility and exploitation of simulated motions. While the initial focus is on the San Francisco Region, simulations for additional regions will be added as the DOE program progresses.

Simulated ground-motion database↗

DUNE Phase II: scientific opportunities, detector concepts, technological solutions

The international collaboration designing and constructing the Deep Underground Neutrino Experiment (DUNE) at the Long-Baseline Neutrino Facility (LBNF) has developed a two-phase strategy toward the implementation of this leading-edge, large-scale science project. The 2023 report of the US Particle Physics Project Prioritization Panel (P5) reaffirmed this vision and strongly endorsed DUNE Phase I and Phase II, as did the European Strategy for Particle Physics. While the construction of the DUNE Phase I is well underway, this White Paper focuses on DUNE Phase II planning. DUNE Phase-II consists of a third and fourth far detector (FD) module, an upgraded near detector complex, and an enhanced 2.1 MW beam. The fourth FD module is conceived as a “Module of Opportunity”, aimed at expanding the physics opportunities, in addition to supporting the core DUNE science program, with more advanced technologies. This document highlights the increased science opportunities offered by the DUNE Phase II near and far detectors, including long-baseline neutrino oscillation physics, neutrino astrophysics, and physics beyond the standard model. It describes the DUNE Phase II near and far detector technologies and detector design concepts that are currently under consideration. A summary of key R&D goals and prototyping phases needed to realize the Phase II detector technical designs is also provided. DUNE's Phase II detectors, along with the increased beam power, will complete the full scope of DUNE, enabling a multi-decadal program of groundbreaking science with neutrinos.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Brochure for the DOE Office of Science Workshop on Envisioning Frontiers in AI and Computing for Biological Research

In February of 2025 a joint ASCR/BER workshop was held to identify key transformational research directions for understanding biology using artificial intelligence (AI), digital twins and high-performance (HPC) computational methods to facilitate scientific discovery and innovation in support of the Department of Energy mission. AI technologies offer exciting new groundbreaking methods to analyze large volumes of complex biological data, thereby greatly accelerating the ability to understand, predict, and design biological processes for beneficial purposes. In the laboratory, the bridging of AI-enabled automated experimental technologies, HPC and digital twins will provide potent tools for researchers to explore the fundamental nature of biology and harness its inherent metabolic potential for a variety of beneficial purposes. The focus of this workshop was on how high-performance computational methods can impact this objective by exploring digital twins, foundational models, and data-driven approaches with applications to advance automated laboratory experiments, modeling of complex living systems and engineering new functions into plants and microbial systems relevant to DOE mission. Workshop attendees with expertise in plant science, microbiology, mathematics, computer science, and AI assessed the current state of the science, trends, and AI challenges at the interface of plant and microbial systems biology and computational science to identify opportunities for high-impact research. This collaborative effort capitalized on ASCR's advancements in applied mathematics, computer science, and Exascale systems, and BER's expertise in basic genomics-enabled research on DOE relevant plant and microbial systems. The workshop culminated in four key priority research directions to guide future research and development within DOE Office of Science programs.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying Climate Change Effects of Bioenergy and BECCS: Critical Considerations and Guidance on Methodology

Bioenergy is a critical element in many national and international climate change mitigation efforts, including as a carbon dioxide removal strategy combined with the capture and durable geological storage of flue gas emissions (BECCS). However, divergent results on the effectiveness of bioenergy as a climate change mitigation measure are reported in the scientific literature. Climate impacts of bioenergy depend on case-specific factors, primarily biophysical features of the biomass production system, and the design and efficiency of conversion and capture processes. Estimates of climate impacts are also strongly affected by methodological choices and assumptions, and much of the divergence between studies derives from differences in the assumed alternate use of the land or feedstock, the alternate energy source and the system boundaries applied. We present a methodology to support robust estimates of the climate change effects of bioenergy systems, updating the standard methodology developed by the International Energy Agency's Technology Collaboration Program on Bioenergy. We provide guidance on the key choices including the reference land use and energy system that bioenergy is assumed to displace, spatial and temporal system boundaries, co-product handling, climate forcers considered, metrics applied and time horizon of impact assessment. Researchers should consider the whole bioenergy system including all life cycle stages, and choose system boundaries, reference systems and treatment of co-products that are consistent with the intended application of the results. The assessment should be normalised to a functional unit that can be compared with other systems delivering an equivalent quantity of the same function. All significant climate forcers should be included, and climate effects should be quantified using appropriate impact assessment methods that distinguish the impact of time. Consistency in methodology and interpretation will facilitate comparison between studies of different bioenergy systems.

09 BIOMASS FUELS↗

Measure this, not that: Optimizing the cost and model-based information content of measurements

Model-based design of experiments (MBDoE) is a powerful framework for selecting and calibrating science-based mathematical models from data. Here, this work extends popular MBDoE workflows by proposing a convex mixed integer (non)linear programming (MINLP) to optimize the selection of measurements. The solver MindtPy is modified to support calculating the D-optimality objective and its gradient via an external package, scipy, using the grey-box module in Pyomo. The new approach is demonstrated in two case studies: estimating highly correlated kinetics from a batch reactor and estimating transport parameters in a large-scale rotary packed bed for CO 2 capture. Both case studies show how examining the Pareto optimal trade-offs between information content measured by A- and D-optimality versus measurement budget offers practical guidance for selecting measurements for scientific experiments.

97 MATHEMATICS AND COMPUTING↗

Microscopic Measurement: Need for Nuclear Material Sample Specimen Characterization Capability

The Surveillance, Fabrication, and Off-Site Operations team at Lawrence Livermore National Laboratory is beginning an update to the nuclear material machining lab in Superblock. Plutonium and other nuclear materials tend to accelerate the aging process for equipment and machines that would otherwise be maintainable for long lives. They have their lifespans shortened from deteriorated seals, embrittled polymer components, accelerated corrosion, and damage to electronics from exposure to radioactive materials. The cost of installation of equipment into a glove box (GB) tends to outstrip the cost of the equipment itself. Due to the magnification of cost, the historical approach to equipment installs has been to purchase and install the highest-quality and most robust equipment available to maximize time between failures and updates. To make room for the installation of a new lathe, the inspection GB is being moved to a different location within the machining lab. As part of the overall effort, the equipment within the inspection GB is being revisited. Current measurement capabilities are antiquated and starting to become problematic due to age. Advances in metrology are sought for more comprehensive characterization of scientific samples. This document aims to identify several options for the replacement of current measurement equipment and identify a system for purchase and eventual installation. The intention is not to select the cheapest system, but rather to identify a system that best meets the needs of both the operators and principal investigators (PI). Following the convention of the SYSM-5620 Design Thinking and System Engineering, it was determined that a laser confocal measurement system from Keyence is the most suitable option for our programmatic need. Form factor, capability, and maintainability were considered. Along with stakeholder input, to ensure the best decision for the Nuclear Material Technology Program.

36 MATERIALS SCIENCE↗

Integrating science for water security governance

Hydrological extremes are intensifying globally, increasing the complexity of decisions required to ensure water security. Advances in hydrological science, modeling, and data systems have expanded the technical frontier of water research, yet uptake of scientific insights in policy and management decisions remains limited. This persistent science–policy gap is not primarily a failure of knowledge generation or robustness, but an institutional challenge shaped by how scientific and governance systems are organized, coordinated, and connected to support the effective use of scientific knowledge. These challenges are particularly pronounced in multi-level and transboundary water governance, where decisions span jurisdictions and require coordination across institutional and political boundaries. We synthesize research at the science–policy interface and evidence from water security initiatives to show how institutional arrangements, scientific tool development, and research practices enable or constrain the sustained use of scientific knowledge in water-security governance processes. Building on these insights, we develop ‘shared decision infrastructure’ as a framing to describe how scientific knowledge is embedded within the institutional, relational, and procedural arrangements that connect science to decision-making processes over time. We translate this framing into a practical intervention roadmap centered on institutional design, tool translation, sustained co-production, and outcome-oriented evaluation to support the integration of science into ongoing governance processes. By positioning science as shared decision infrastructure, the roadmap clarifies how researchers can design scientific efforts that support more coordinated, accountable, and adaptive water security decisions amid deepening uncertainty.

M whitney, Kristen [NASA Goddard Space Flight Cent↗

Journey over Destination: Dynamic Sensor Placement Enhances Generalization

Reconstructing complex, high-dimensional global fields from limited data points is a challenge across various scientific and industrial domains. This is particularly important for recovering spatio-temporal fields using sensor data from, for example, laboratory-based scientific experiments, weather forecasting, or drone surveys. Given the prohibitive costs of specialized sensors and the inaccessibility of
certain regions of the domain, achieving full field coverage is typically not feasible. Therefore, the development of machine learning algorithms trained to reconstruct fields given a limited dataset is of critical importance. In this study, we introduce a general
approach that employs moving sensors to enhance data exploitation during the training of an attention based neural network, thereby improving field reconstruction. The training of sensor locations is accomplished using an end-to-end workflow, ensuring
differentiability in the interpolation of field values associated to the sensors, and is simple to implement using differentiable programming. Additionally, we have incorporated a correction mechanism to prevent sensors from entering invalid regions within the domain. We evaluated our method using two distinct datasets; the results show that our approach enhances learning, as evidenced by improved test scores.

54 ENVIRONMENTAL SCIENCES↗

Jackson, L., Johnson, M.B., Latrach, A., Grimes, D., Martinez, C., and Mclaughlin, J.F., 2024, Multidisciplinary geotechnical data collection, curation, and analysis for conformity with the regulatory framework for geologic carbon storage in Wyoming, USA: Geological Society of America Abstracts with Programs. Vol. 56, No. 5, 2024, doi: 10.1130/abs/2024AM-405024

Title: Multidisciplinary Geotechnical Data Collection, Curation, and Analysis for Conformity with the Regulatory Framework for Geologic Carbon Storage in Wyoming, USA. Text: Construction and operation of wells for geologic sequestration of carbon dioxide necessitate that they are permitted under the Environmental Protection Agency’s Underground Injection Control Class VI requirements. Class VI wells conform to stringent requirements to ensure long-term safety and integrity of the storage site and the protection of Underground Sources of Drinking Water. Entities pursuing Class VI permitting must provide comprehensive geologic site characterization, including regional geologic structure and stratigraphy, aquifer information, reservoir and confining unit geomechanical properties, geochemical analyses, assessment of trapping capacity and mechanisms, and a variety of other of multidisciplinary geotechnical data. The Wyoming Class VI Site Characterization Database Project is focused on developing a geologic site characterization database of geotechnical information, which has been compiled and verified from established, public databases/entities and scientific literature to expedite Class VI permitting in Sweetwater County within the Greater Green River Basin of southern Wyoming. The preliminary suite of compiled data from 14,000 wells includes 8,000 wells with logs and 7,250 wells with formation tops, ~70 wells with core data (e.g., X-Ray diffraction, petrographic, and petrophysical data), ~2,500 water analyses, ~740 seismic events data, and ~520 bottom-hole temperature measurements. Future work on—and stemming from—this project will include new core analyses, calculation and interpolation of subsurface temperature gradients, mechanical earth models, geochemical simulations, storage capacity estimation, stratigraphic column generation and correlation, and construction of subsurface maps. Finally, this work will help to inspire and facilitate subsurface data compilation and curation beyond Sweetwater County, Wyoming.

42 ENGINEERING↗

2023 Site Environmental Report: Volume 1

Brookhaven National Laboratory (BNL) is managed on behalf of the Department of Energy (DOE) by Brookhaven Science Associates (BSA), a partnership between Stony Brook University and Battelle, and six core universities: Columbia, Cornell, Harvard, Massachusetts Institute of Technology, Princeton, and Yale. For over 75 years, the Laboratory has played a lead role in the DOE Science and Technology mission and continues to contribute to the DOE’s missions in energy resources, environmental quality, and national security. BNL manages its world-class scientific research operations with sensitivity to environmental issues and community concerns. The Laboratory’s Environmental, Safety, Security, and Health (ESSH) Policy reflects the commitment of BNL’s management to fully integrate environmental stewardship into all facets of its mission and operations. BNL prepares an annual Site Environmental Report (SER) in accordance with DOE Order 231.1B, Environment, Safety, and Health Reporting. The report is written to inform the public, regulators, employees, and other stakeholders of the Laboratory’s environmental performance during the calendar year in review. Volume I of the SER summarizes environmental data; environmental management performance; compliance with applicable DOE, federal, state, and local regulations; and performance in restoration and surveillance monitoring programs. BNL has prepared annual SERs since 1971 and has documented nearly all its environmental history since the Laboratory’s inception in 1947. Volume II of the SER, the Groundwater Status Report, is also prepared annually to report on the status of groundwater protection and restoration efforts. Volume II includes detailed technical summaries of groundwater data and treatment system operations and is intended for regulators and other technically oriented stakeholders. A summary of the information contained in Volume II is included in Chapter 7, Groundwater Protection, of this volume.

54 ENVIRONMENTAL SCIENCES↗

Irradiation Testing of Ultrasonic Transducers

Ultrasonic technologies offer the potential for high accuracy and resolution in-pile measurement of numerous parameters, including geometry changes, temperature, crack initiation and growth, gas pressure and composition, and microstructural changes. Many Department of Energy-Office of Nuclear Energy (DOE-NE) programs are exploring the use of ultrasonic technologies to provide enhanced sensors for in-pile instrumentation during irradiation testing. For example, the ability of single, small diameter ultrasonic thermometers (UTs) to provide a temperature profile in candidate metallic and oxide fuel would provide much needed data for validating new fuel performance models. Other efforts include an ultrasonic technique to detect morphology changes (such as crack initiation and growth) and acoustic techniques to evaluate fission gas composition and pressure. These efforts are limited by the lack of existing knowledge of ultrasonic transducer material survivability under irradiation conditions. To address this need, the Pennsylvania State University (PSU) was awarded an Advanced Test Reactor National Scientific User Facility (ATR NSUF) project to evaluate promising magnetostrictive and piezoelectric transducer performance in the Massachusetts Institute of Technology Research Reactor (MITR) up to a fast fluence of at least 1021 n/cm2 (E> 0.1 MeV). This test will be an instrumented lead test; and real-time transducer performance data will be collected along with temperature and neutron and gamma flux data. By characterizing magnetostrictive and piezoelectric transducer survivability during irradiation, test results will enable the development of novel radiation tolerant ultrasonic sensors for use in Material and Test Reactors (MTRs). The current work bridges the gap between proven out-of-pile ultrasonic techniques and in-pile deployment of ultrasonic sensors by acquiring the data necessary to demonstrate the performance of ultrasonic transducers

Daw, J.↗

CG-Kit: Code Generation Toolkit for performant and maintainable variants of source code applied to Flash-X hydrodynamics simulations

CG-Kit is a new Code Generation tool-Kit that we have developed as a part of the solution for portability and maintainability for multiphysics computing applications. The development of CG-Kit is rooted in the urgent need created by the shifting landscape of high-performance computing platforms and the algorithmic complexities of a particular large-scale multiphysics application: Flash-X. To efficiently use computing resources on a heterogeneous node, an application must have a map of computation to resources and a mechanism to move the data and computation to the resources according to the map. Most existing performance portability solutions are focussed on abstracting the expression of computations so that a unified source code can be specialized to run on different resources. However, such an approach is insufficient for a code like Flash-X, which has a multitude of code components that can be assembled in various permutations and combinations to form different instances of applications. Similar challenges apply to any code that has composability, where a single specified way of apportioning work among devices may not be optimal. Additionally, use cases arise where the optimal control flow of computation may differ for different devices while the underlying numerics remain identical. This combination leads to unique challenges including handling an existing large code base in Fortran and/or C/C++, subdivision of code into a great variety of units supporting a wide range of physics and numerical methods, different parallelization techniques for distributed and shared memory systems and accelerator devices, and heterogeneity of computing platforms requiring coexisting variants of parallel algorithms. All of these challenges demand that scientific software developers apply existing knowledge about domain applications, algorithms, and computing platforms to determine custom abstractions and granularity for code generation. There is a critical lack of tools to tackle those problems. CG-Kit is designed to fill this gap by providing a user with the ability to express their desired control flow and computation-to-resource map in the form a pseudocode-like recipe. It consists of standalone tools that can be combined into highly specific and, we argue, highly effective portability and maintainability toolchains. Here we present the design of our new tools: parametrized source trees, control flow graphs, and recipes. The tools are implemented in Python. They are agnostic to the programming language of the source code targeted for code generation. In conclusion, we demonstrate the capabilities of the toolkit with two examples, first, multithreaded variants of the basic AXPY operation, and second, variants of parallel algorithms within a hydrodynamics solver, called Spark, from Flash-X that operates on block-structured adaptive meshes.

Algorithmic portability↗