Search NASASearch

SEARCH · Search NASA

Results for “code review”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Review of Regulations, Codes, and Standards for Hydrogen Fuel Cell Electric Bus Use on Airports

This report reviews regulations, codes, and standards to be considered for FCEB operations on airports governing vehicle safety, hydrogen infrastructure, and airport operations. Overall, the review found the existing regulatory framework largely suitable for FCEB operations on airports, with only minor gaps identified pertaining to heavy-duty vehicle fueling, operation and fire safety on airport aprons, and authorization for emergency power use.

08 HYDROGEN

Safety Codes and Standards Review and Gap Analysis for Applicability to Hydrogen Rail Refueling, Defueling, Maintenance, and Storage

Hydrogen-powered locomotives may present an alternative to diesel for achieving transportation-related decarbonization, energy security, and resilience goals. As an emerging technology, hydrogen locomotives may not have adequate representation in current safety codes and standards. NFPA 2 and other appropriate codes and standards were reviewed to identify technical gaps in the code for hydrogen rail defueling, refueling, maintenance, and storage. Several technical gaps pertaining to setback distances, allowable quantities, ventilation rates, and grounding have been identified. Fueling requirements can be informed by road vehicle standards but may need to be revised for larger quantity hydrogen locomotive systems. Since there are no hydrogen-specific locomotive design and safety standards, some aspects of diesel-based locomotive standards may apply. CGA G- 5.5 currently provides the most guidance on height, placement, orientation, and design of vent systems, while other standards emphasize the importance of shielding vent stacks and provide requirements for orientation of their discharge.

08 HYDROGEN

Thoroughly testing and integrating hundreds of Pull Requests per month: ROOT’s new Cost-efficient and Feature Rich GitHub-based CI

ROOT is an open source framework, freely available on GitHub, at the heart of data acquisition, processing and analysis of HE(N)P experiments, and beyond. It is developed collaboratively: contributions are not authored only by ROOT team members, but also by the user community at large: developers and scientists from universities, labs as well as the private sector. More than 1500 GitHub Pull Requests are merged on average per year. It is in this context that code integration acquires a primary role. The review of code contributions isn’t enough: not only they need to be thoroughly reviewed, they also need to be thoroughly tested through a powerful CI infrastructure on several different platforms to comply with the high code quality standards of the project. Since the end of 2023, ROOT moved its continuous integration system from Jenkins to GitHub Actions. In this contribution, we characterise the transition to the GitHub CI, focussing on our strategy, its implementation and the lessons learned, as well as the advantages the new system offers with respect to the previous one. Particular emphasis will be given to the evaluation of the cost-benefit ratio for Jenkins and GitHub Actions for the ROOT project. We also describe how we manage to run in less than one hour thousands of unit, integration, functional and end-to-end tests on different flavours of Windows, four versions of macOS, as well as about ten of the most used Linux distributions, taking advantage of the CERN computing infrastructure.

Piparo, Danilo [CERN]

SolarAPP+ Performance Review (2024 Data)

The Solar Automated Permit Processing Plus (SolarAPP+) platform is an online portal to facilitate and expedite rooftop solar photovoltaic (PV) and battery storage permitting processes. SolarAPP+ allows PV contractors to upload system specifications, have that information automatically reviewed for code compliance, and receive instant approval for code-compliant systems, reducing authority having jurisdiction (AHJ) staff time needed for review. SolarAPP+ also provides inspection checklists to verify installation practices and adherence to approved designs. This report is part of an ongoing series of reviews of SolarAPP+ performance. Consistent with previous performance reviews, we summarize SolarAPP+ adoption trends to date and compare various metrics for PV systems permitted through SolarAPP+ versus systems permitted through traditional AHJ permitting processes. As of the end of 2024, 799 AHJs had expressed interest in the platform, with 264 fully adopting (215) or piloting (49) the platform. In 2024, 861 installers submitted 37,393 permits through the SolarAPP+ platform, including 27,375 permits for PV+storage systems. SolarAPP+ permits accounted for around 43% of all permits issued in all participating AHJs, and more than 60% of all permits in several participating AHJs. We compare permitting timelines through SolarAPP+ to traditional AHJ permitting processes to assess the platform's performance. Consistent with previous SolarAPP+ performance reviews, we find that permitting timelines are significantly shorter for SolarAPP+ projects. Based on median timelines, a typical SolarAPP+ project is permitted and inspected 12 business days sooner than traditional projects. We estimate that automatic SolarAPP+ permitting saved around 18,400 hours of AHJ staff time in 2024. Finally, we estimate that SolarAPP+ eliminated over 100,000 business days in permitting-related delays in 2024.

14 SOLAR ENERGY

Safety Review of the Hydrogen Components of a Reference Design of the Wind-H2-Green Steel/Ammonia Project

The Department of Energy Hydrogen Fuel Cell Technology Office and Wind Energy Technologies Office’s Wind-H2-Green Steel/Ammonia project is an initiative to demonstrate the feasibility and efficacy of GW-scale integrated energy systems. The team designed reference facilities that utilize wind- and solar-produced hydrogen for industrial steel and ammonia production. This novel concept warranted review of safety codes and standards as they apply to the designs and the identification of codes and standards as they apply to the designs and the identification of codes and standards gaps. This report reviews hydrogen production and storage codes and standards using reference design specifications from a Minnesota steel plant. Requirements, recommendations, and exclusions for the system were identified. Observed gaps included non-specific salt cavern storage requirements, electrolyzer capacity beyond regulated ranges, and lack of requirements for iron reduction via hydrogen. This report will aide future project design efforts and may provide a basis for safety reviews in new designs for industrial facilities with hydrogen production integration.

08 HYDROGEN

Safety Review of the Hydrogen Components of a Reference Design of the Wind-H2-Green Steel/Ammonia Project

The Department of Energy Hydrogen Fuel Cell Technology Office and Wind Energy Technologies Office's Wind-H2-Green Steel/Ammonia project is an initiative to demonstrate the feasibility and efficacy of GW-scale integrated energy systems. The team designed reference facilities that utilize wind- and solar-produced hydrogen for industrial steel and ammonia production. This novel concept warranted review of safety codes and standards as they apply to the designs and the identification of codes and standards gaps. This report reviews hydrogen production and storage codes and standards using reference design specifications from a Minnesota steel plant. Requirements, recommendations, and exclusions for the system were identified. Observed gaps included non-specific salt cavern storage requirements, electrolyzer capacity beyond regulated ranges, and lack of requirements for iron reduction via hydrogen. This report will aide future project design efforts and may provide a basis for safety reviews in new designs for industrial facilities with hydrogen production integration.

08 HYDROGEN

Non-linear MHD modelling of transients in tokamaks: a review of recent advances with the JOREK code

Transient magneto-hydrodynamic (MHD) events like edge localized modes (ELMs) or disruptions are a concern for magnetic confinement fusion power plants. Research with the MHD code JOREK towards understanding control of such instabilities is reviewed here in a concise way to provide a complete overview, while we refer to the original publications for details. Experimental validation for unmitigated vertical displacement events progressed. The mechanism of vertical force mitigation by impurity injection was identified. Two-way eddy current coupling to CARIDDI was completed. Shattered pellet injection was simulated in JET, KSTAR, ASDEX Upgrade (AUG) and ITER. Benign runaway electron beam termination in JET and ITER was studied. Coupling of kinetic REs to the MHD is ongoing and a virtual RE synchrotron radiation diagnostic was developed. Regarding pedestal physics, regimes devoid of large ELMs in AUG were simulated and predictive JT60-SA simulations are ongoing. For ELM suppression by resonant magnetic perturbations (RMPs), AUG, ITER and EAST simulations were performed. A free boundary RMP model was validated against experiments. Evidence for penetrated magnetic islands at the pedestal top based on AUG experiments and simulations was found. Simulations of the naturally ELM-free quiescent H-mode in AUG and HL-3 show external kink mode formation prevents pedestal build-up towards an ELM within windows of the edge safety factor. With kinetic neutral particles, high field side high density formation in ITER was simulated and with kinetic impurities, tungsten transport in AUG RMP plasmas was studied. To capture turbulent transport, electro-static full-f particle in cell models for ion temperature gradient and trapped electron modes were established and benchmarked. Application to RMP plasmas shows enhanced turbulence in comparison to unperturbed states. Energetic particle interactions with MHD were studied. Flux pumping that prevents the safety factor on axis from dropping below unity was simulated. First non-linear stellarator applications include current relaxation in $l$ = 2 stellarators, while verification for advanced stellarators progresses.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

EMPOWERED Distributed Energy Resources Permit Accelerator Pilot

This report summarizes the EMPOWERED Distributed Energy Resources (DER) Permit Accelerator Pilot project. Its primary objective was to streamline the design, installation, permitting, and inspections of targeted Distributed Energy Resource (DER) solutions. Streamlining these processes is critical to strengthening and accelerating the adoption of DER solutions nationwide. Moreover, streamlined processes help expedite the clean energy transition and expand energy resilience by improving understanding and capability among key stakeholders like property owners, code officials, and the general workforce. The project team accomplished this by developing and deploying a set of design and permitting guides for simple DER solutions, which they rolled out via a permitting pilot program. The project team developed nine permitting and inspection guides for simple DER solutions, as follows: 1. Single-Family and Duplex: Electric Vehicle Service Equipment (EVSE), and Storage, Solar + Storage (each in two code cycles) 2. Multi-family and Office: EVSE, Storage, Solar + Storage (each in two code cycles) 3. A permitting process guide to support the implementation of the permitting guides. The guides cover key code requirements via plan review and field inspection checklists for code officials and building owners to follow to streamline the permitting and inspections process for DER solutions. Following the development of the initial set of guides, the project team formed two cohorts, each made up of four jurisdictions, to participate in the Permit Accelerator Pilot. Each cohort received training and technical assistance to support them in incorporating the guides into use. The project successfully engaged jurisdictions in two disparate US regions: Chelsea, Somerville, Natick, and Norwood in metro Boston; and Pima County, Town of Gilbert, Flagstaff, and Sedona in Arizona. Feedback gathered from the project was valuable in refining the guides to better address jurisdictional needs. After the pilot period, the project team developed final versions of the guides based on extensive feedback from the cohorts and from external technical peer review. Feedback included needs and barriers related to implementation, as well as detailed technical improvements from external peer review. The final guides were presented in a series of webinars with a national reach, with 192 attendees from 35 states in the live session of the final webinar, and the final guides are posted online and available for use nationwide. Key findings: • The most receptive jurisdictions were those adjacent to other jurisdictions that had already adopted similar initiatives. The least receptive jurisdictions were those in the midst of adopting new code cycles. • The most common barrier to jurisdictional adoption of new guidelines were internal administrative and process delays, more so than technical barriers. • The main technical barrier to adoption proved to be the concern of fire hazard risks posed by energy storage systems. There is some apprehension in the code enforcement community about the safety of the batteries. Education coordinated with fire and safety services will help alleviate concerns and increase confidence in the acceptance of innovative technologies. • Opportunities to further leverage and advance the guides and related resources include outreach, education, and jurisdictional support; updates to the resources to align with code cycle changes and local requirements; and advancements supporting emerging technologies.

14 SOLAR ENERGY

TRANSP integrated modeling code for interpretive and predictive analysis of tokamak plasmas

This paper provides a comprehensive review of the TRANSP code, a sophisticated tool for interpretive and predictive analysis of tokamak plasmas, detailing its major capabilities and features. It describes the equations for particle, power, and momentum balance analysis, as well as the poloidal field diffusion equations. The paper outlines the spatial and time grids used in TRANSP and details the equilibrium assumptions and solvers. Various models for heating and current drive and radiation, including updates to the NUBEAM model, are discussed. The handling of large-scale events such as sawtooth crashes and pellet injections is examined, along with the predictive capabilities for advancing plasma profiles. The integration of TRANSP with the ITER Integrated Modeling and Analysis Suite (IMAS) is highlighted, demonstrating enhanced data access and analysis capabilities. Additionally, the paper discusses best practices and continuous integration techniques to enhance TRANSP's robustness. The suite of TRANSP tools, designed for efficient data analysis and simulation, further supports the optimization of tokamak operations and coupling with other tokamak codes. Continuous development and support ensure that TRANSP remains a major code for the analysis of experimental data for controlled thermonuclear fusion, maintaining its critical role in supporting the optimization of tokamak operations and advancing fusion research.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

Review of Grey Box/Black Box Data Contamination Metrics on Open and Commercial Models

Dataset contamination is a problem where benchmarks and tasks used to evaluate the capabilities of Large Language Models (LLMs) have been incorporated into the training dataset of the models. This gives a false sense of performance that can overestimate how these models will function on truly unseen data. This problem becomes worse with commercial LLMs with larger and non-accessible training data, so techniques have been developed to try to measure the degree to which a model is contaminated with a benchmark’s data. To understand the effectiveness of these techniques, particularly when evaluating contamination on coding tasks, we review trends and categorize techniques by the degree of access to the model that is required. The research literature on this topic has reported mixed effectiveness of these techniques, so we select a set of black box (text access only) and grey box (access to model loss/probabilities required) techniques and apply them to both commercial and non-commercial models. We implement these metrics as part of a framework to test the contamination of Python code in LLMs to see to what extent we can replicate the effectiveness (or ineffectiveness) of these contamination detection techniques. Though we find mixed results in the capabilities of these metrics to identify contamination, we do observe evidence that they can identify contamination (broadly) in fine-tuned models when both a baseline and fine-tuned model is present. Additionally, similarity metrics were able to identify between contaminated and uncontaminated data even in situations where the data is distributionally similar (e.g., drawn from the same set of code projects).

97 MATHEMATICS AND COMPUTING

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger

pnnl/90.1-PRM_ECB-ReviewManual

The 90.1 Energy Cost Budget and Performance Rating Method Submittal Review Manual (the Manual) is a comprehensive reference for reviewing modeling based energy code compliance submittals.

Xu, Weili [PNNL]

DUNE Rucio Server Scalabiilty Studies

The DUNE collaboration has an ongoing production effort to simulate the full detectors and to analyze the various prototypes that are currently running. Rucio is used to manage the 40PB of files made to date. When 500 or more jobs were sending output to Rucio simultaneously via Rucio upload, we observed timeouts, unhandled exceptions, and Rucio server restarts due to slow performance. In collaboration with the core Rucio team we did a full review of the Rucio upload code and identified several optimizations that can be made. We also have deployed the Ingress load balancer in front of our Rucio servers and added a database connection pooling utility. These changes led to significant improvement both in reliability and scalability, yet we anticipate even better performance will eventually be required. We describe in this paper the initial state of the system, the various debugging processes that were used, and our plans to further improve scalability.

Calcutt, J. [Brookhaven Natl. Lab.]

LANL Meteorological Program: 2023 Data Completeness/Quality Report

Los Alamos National Laboratory (LANL) operates seven mesa-top instrumented meteorology towers: Technical Area (TA) 6, TA-49, TA-53, TA-54, TA-63, TA-54B, and TA-16B. An additional instrumented tower is located in Mortandad Canyon (TA-5 MDCN), and there is a rain gauge at North Community (NCOM), located within the town of Los Alamos. The 10 meter (m) towers at TA-63, TA-54B, and TA-16B have been in testing since they were installed in 2021, and will be included in a future data completeness report. A description of the meteorology monitoring network, prior to the installation of the TA-63, TA-54B, and TA-16B is found in Dewart and Boggs (2014). Four of the mesa-top towers (e.g., TA-6, TA-49, TA-53, and TA-54) are instrumented at the 1.2 m, 11.5 m, 23 m, and 46 m levels. In addition, the TA-6 tower is instrumented at the 92 m level. The TA-5 MDCN tower is 10 m in height and is instrumented at 1.2 m and 10 m. Data are collected and averaged every 15 minutes. Range checking is performed on each measurement every 15 minutes; data that are beyond normal ranges are eliminated from the data set and replaced by a code for missing data. In addition, data are reviewed weekly by qualified meteorologists to identify bad data not identified by the range checking technique. The data steward eliminates these data from the data set and replaces them with a code for missing data. The instrument technicians also review that data and schedule instrument replacement, as required. All instruments are calibrated at a frequency that meets the criteria identified in ANSI/ANS-3.11-2015. Data completeness is determined by the number of total 15-minute records available versus the number of possible measurements for the entire year. As a rule, the meteorologists do not attempt to estimate data that are eliminated as bad data. Original datalogger records, including bad data, can be recalled from program archival storage.

54 ENVIRONMENTAL SCIENCES

NDE of Novel Materials (CFRP) [Slides]

CFRP composites have not been used for nuclear safety-related applications until recently. In 2019, the ASME Boiler and Pressure Vessel Code Committee approved a new Code Case N-871 for internal repairs of Class 2 and 3 safety-related piping using CFRP for Service Levels A, B, C, and D for a service life of 50 years. The NRC did not review N-871 for inclusion in the Code Case Regulatory Guides. This project focuses on evaluating the capabilities and limitations of Nondestructive Evaluation (NDE) methods for examining the Carbon Fiber Reinforced Polymer (CFRP) repairs in commercial nuclear power plants (NPPs). This Report summarizes the work done on this project until the end of FY24.

36 MATERIALS SCIENCE

Urban weather modeling using WRF: linking physical assumptions, code implementation, and observational needs

The Weather Research and Forecasting (WRF) model includes urban schemes that simulate the influence of urban surfaces on the atmosphere using parameterizations for flux, and radiative exchanges. Three core schemes – the Bulk urban parameterization, Single-Layer Urban Canopy Model (SLUCM), and Multi-Layer Urban Canopy Model (MLUCM) – represent increasing levels of complexity. Although the parameterizations within these urban schemes are described in the literature, their specific implementation remains poorly documented, thus slowing down model development efforts. This manuscript provides a roadmap to the three urban schemes in WRF version 4.5.2, presenting equations using the same symbols as in the model code, along with references to code lines, and including graphics and explanations that connect the code to its physical foundations. Our thorough review of the urban parameterizations implemented in WRF version 4.5.2 highlighted a handful of parameters that may introduce discontinuities in simulations: (i) in the SLUCM, a 1 mm h −1 rain rate threshold is employed to switch between two minimum moisture availability parameterizations, thus impacting latent heat flux calculations; (ii) in the SLUCM a threshold is used to partition shortwave radiation into direct and diffuse components; (iii) in all three urban schemes, the bulk Richardson number is employed to select the similarity function, which influences the vertical distribution of heat and momentum. We also identified a highly simplified treatment of the radiative balance on roof surfaces. The implications of these simplifications can be assessed through targeted observations across relevant conditions, including varying precipitation rates, cloud cover, and transitions between stability regimes. Furthermore, the widespread application of the Monin-Obukhov similarity theory in these urban schemes warrants model evaluation under highly stable and unstable conditions and in heterogeneous urban settings with variable land cover and building heights on scales finer than model resolution. To address these challenges, we offer guidance on observational strategies, emphasizing the need for multi-parametric measurements to capture potential compensating biases and multi-height measurements that align with the levels where quantities are diagnostic and prognosed in the model (i.e., the lowest atmospheric level of the WRF model). Finally, our inspection of the code revealed implementation bugs that have now been corrected in WRF versions 4.6.0 and 4.6.1. Sensitivity tests over the Atlanta urban area show that these corrections affect surface temperatures, underscoring the importance of performing rigorous documentation and verification of the implementation of parameterizations in model code.

54 ENVIRONMENTAL SCIENCES

SCALE Input and Result Files Supporting SCALE Inventory and Reactivity Analysis as Part of the Hermes 2021 PSAR Review

This dataset contains input and result files of computational simulations with the SCALE code system. The simulations cover radionuclide inventory and reactivity analyses of a fluoride salt-cooled high temperature pebble-bed reactor (PB-FHR), specifically the Hermes low-power PB-FHR demonstration reactor. Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases

equilibrium core

Documentation, assessment, and improvements of fission gas modeling capabilities in BISON

Fission gas behavior critically affects nuclear fuel performance, influencing thermal conductivity, microstructure, swelling, and fuel-cladding interactions. The Simple Integrated Fission Gas Release and Swelling (Sifgrs) model, implemented within the BISON fuel performance code, provides advanced capabilities for modeling these phenomena. This manuscript reviews and assesses Sifgrs’ modular structure and submodels describing intragranular, intergranular, and release mechanisms. The modular implementation enables rapid improvements as our understanding advances and new fuel forms emerge. After an overview of capabilities, we present a comprehensive validation suite, comparing predictions to experimental data from tests under normal and transient conditions, including reproduction of the Vitanza curve. Results demonstrate Sifgrs’ accuracy, robustness, and applicability. Current limitations and ongoing efforts are discussed, including mechanistic, multiscale modeling, uncertainty quantification, and validation within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, supporting the safe and efficient use of nuclear fuels.

BISON