Detection of Random Test Failures and their Impact on CI Testing Pipelines
Explore the source record for details and available documents.
Bartlett, Roscoe [Sandia National Laboratories (SN↗
SEARCH · Search NASA
Results for “CI testing”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Software Quality Assurance for the MOOSE-Based Open-Source Multiphysics Code Cardinal - An Expanded CI Testing Suite
Cardinal is a wrapping of the GPU-oriented spectral element Computational Fluid Dynamics (CFD) code NekRS and the Monte Carlo particle transport code OpenMC within the Multiphysics Object-Oriented Simulation Environment (MOOSE). Cardinal provides high-resolution thermal-hydraulics and/or radiation transport feedback to MOOSE multiphysics simulations. Multiphysics feedback is implemented in a geometry-agnostic manner which eliminates the need for rigid one-to-one mappings. A generic data transfer implementation also allows NekRS and OpenMC to couple to any MOOSE application, enabling a broad set of multiphysics capabilities. Cardinal simulations can also leverage combinations of MPI, OpenMP, and GPU resources. Cardinal continuous development and improvement efforts have led to the software being considered as a high-fidelity design and licensing tool for key areas of nuclear reactor relevant physics, including neutron transport, fluid flow, heat transfer, and mechanical processes. The fast development and expansion of the software from a pure R&D framework towards its application in the nuclear industry and regulation require a focus on developing, enhancing and, maintaining Cardinal’s software quality through strict adherence to a Software Quality Assurance (SQA) framework and SQA program. To facilitate compliance with SQA standards, the Cardinal SQA Program has been initiated during Fiscal Year 2023 (FY23). During the development of the Cardinal SQA Program, multiple gaps have been identified. These gaps are primarily related to model verification and code pedigree as they relate to the use of Cardinal as a safety analysis tool. These gaps have been captured in a report published in 2023. A second report highlighted the progress made during Fiscal Year 2024 (FY24) and described Argonne’s effort to document and integrate software verification within Cardinal’s software development process. This report documents a snapshot of the verification test cases currently available for Cardinal and NekRS in their assimilation into a Continuous Integration (CI) platform. Following the CI practice permits the integrating of source code changes frequently and ensuring that the integrated codebase clears the verification testing for the software. It should be noted that the SQA program itself, including the program plans, procedures, configuration management, and testing strategies, need to be developed in a future step of this task.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Hybrid gausslet/Gaussian basis sets
We introduce hybrid gausslet/Gaussian basis sets, where a standard Gaussian basis is added to a gausslet basis in order to increase accuracy near the nuclei while keeping the spacing of the grid of gausslets relatively large. The Gaussians are orthogonalized to the gausslets, which are already orthonormal, and approximations are introduced to maintain the diagonal property of the two electron part of the Hamiltonian so that it continues to scale as the second power of the number of basis functions rather than the fourth. We introduce several corrections to the Hamiltonian designed to enforce certain exact properties, such as the values of certain two-electron integrals. We also introduce a simple universal energy correction that compensates for the incompleteness of the basis stemming from the electron–electron cusps based on the measured double occupancy of each basis function. We perform a number of Hartree Fock and full configuration interaction (full-CI) test calculations on two electron systems and Hartree Fock on a ten-atom hydrogen chain to benchmark these techniques. The inclusion of the cusp correction allows us to obtain complete basis set full-CI results for the two electron cases at the level of several micro-Hartrees, and we see similar apparent accuracy for Hartree Fock on the ten-atom hydrogen chain.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
HydraGNN 2.0
HydraGNN is an Oak Ridge National Laboratory (ORNL)-branded implementation of distributed multi-tasking graph neural networks that supports several scientific applications within the ORNL portfolio to support the US-DOE mission. New or improved capabilities included in v2.0.0 release are as follows: 1) Enhancement in message passing layers through class inheritance 2) Adding transformation to ensure translation and rotation invariance 3) Supporting various optimizers 4) Atomic descriptors 5) Integration with continuous CI test 6) Distributed printouts and timers 7) Profiling 8) Support of ADIOS2 for scalable data loading 9) Large-scale system support, including Summit (ORNL) and Perlmutter (NERSC)
Lupo Pasini, Massimiliano [Oak Ridge National Labo↗
Irradiation of Mo-100 Targets and Testing Fe(ll)CI 2 Precipitation for Tc-99 Removal
The production of molybdenum-99 (Mo-99) is a critical step in the generation of technetium-99m (Tc-99m), a radioisotope widely used in medical imaging. NorthStar Medical Radioisotopes, LLC is planning to produce the important medical radioisotope Mo-99 through a photonuclear reaction on molybdenum-100 (Mo-100). Accelerator production of Mo-99 using enriched Mo-100 targets yields undesirable isotopes, such as niobium-95 (Nb-95) and zirconium-95 (Zr-95). Previous studies reported that Nb and Zr isotopes can be effectively removed from Mo-99 products through coprecipitation with Fe(III). To enable the potential utilization of the first milking of Tc-99m from a Mo-99/Tc-99m generator, it is desirable to remove long-lived Tc-99. This can be accomplished by substituting Fe(III) with Fe(II) during the precipitation step, without affecting the removal of Zr and Nb isotopes. Previous experiments demonstrated up to 99+% removal of Tc using this method. It was also observed that the presence of hydrogen peroxide significantly impacts Tc removal. This was evident in the processing of enriched Mo-100 targets, where only 25% of Tc was removed. To further investigate this, another irradiation of enriched Mo-100 disks was conducted, followed by Tc-99 removal using Fe(II). Prior to irradiation, experimental conditions for Tc removal were optimized through several test runs using Mo-100 disks spiked with Tc-99. The results of these tests are discussed in this report.
07 ISOTOPE AND RADIATION SOURCES↗
MTT/Gitlab CI ongoing Open MPI testing - Focus on GPU/OFI and OpenPMIx (Quadchart for ECP OMPI-X milestone STPR17-80)
Further work for this milestone confirmed that using ECP Gitlab CI does not work with PR based work flow used by the Open MPI.
97 MATHEMATICS AND COMPUTING↗
Investigation of Spiral Bevel Gear Condition Indicator Validation Via AC-29-2C Using Damage Progression Tests
This report documents the results of spiral bevel gear rig tests performed under a NASA Space Act Agreement with the Federal Aviation Administration (FAA) to support validation and demonstration of rotorcraft Health and Usage Monitoring Systems (HUMS) for maintenance credits via FAA Advisory Circular (AC) 29-2C, Section MG-15, Airworthiness Approval of Rotorcraft (HUMS) (Ref. 1). The overarching goal of this work was to determine a method to validate condition indicators in the lab that better represent their response to faults in the field. Using existing in-service helicopter HUMS flight data from faulted spiral bevel gears as a "Case Study," to better understand the differences between both systems, and the availability of the NASA Glenn Spiral Bevel Gear Fatigue Rig, a plan was put in place to design, fabricate and test comparable gear sets with comparable failure modes within the constraints of the test rig. The research objectives of the rig tests were to evaluate the capability of detecting gear surface pitting fatigue and other generated failure modes on spiral bevel gear teeth using gear condition indicators currently used in fielded HUMS. Nineteen final design gear sets were tested. Tables were generated for each test, summarizing the failure modes observed on the gear teeth for each test during each inspection interval and color coded based on damage mode per inspection photos. Gear condition indicators (CI) Figure of Merit 4 (FM4), Root Mean Square (RMS), +/- 1 Sideband Index (SI1) and +/- 3 Sideband Index (SI3) were plotted along with rig operational parameters. Statistical tables of the means and standard deviations were calculated within inspection intervals for each CI. As testing progressed, it became clear that certain condition indicators were more sensitive to a specific component and failure mode. These tests were clustered together for further analysis. Maintenance actions during testing were also documented. Correlation coefficients were calculated between each CI, component, damage state and torque. Results found test rig and gear design, type of fault and data acquisition can affect CI performance. Results found FM4, SI1 and SI3 can be used to detect macro pitting on two more gear or pinion teeth as long as it is detected prior to progressing to other components or transitioning to another failure mode. The sensitivity of RMS to system and operational conditions limit its reliability for systems that are not maintained at steady state. Failure modes that occurred due to scuffing or fretting were challenging to detect with current gear diagnostic tools, since the damage is distributed across all the gear and pinion teeth, smearing the impacting signatures typically used to differentiate between a healthy and damaged tooth contact. This is one of three final reports published on the results of this project. In the second report, damage modes experienced in the field will be mapped to the failure modes created in the test rig. The helicopter CI data will then be re-processed with the same analysis techniques applied to spiral bevel rig test data. In the third report, results from the rig and helicopter data analysis will be correlated. Observations, findings and lessons learned using sub-scale rig failure progression tests to validate helicopter gear condition indicators will be presented.
gears↗
Modifying and Testing ATC Controller Interface (CI) for Data Link Clearances
The Controller-Pilot Data Link Communications (CPDLC) and Air Traffic Control workstation research was conducted as part of the 1997 NASA Low Visibility Landing and Surface Operations (LVLASO) demonstration program at Atlanta Hartsfield airport. Research activity under this grant increased the sophistication of the Controllers' Communication and Situational Awareness Terminal (C-CAST) and developed a VHF Data Link -Mode 2 communications platform. The research culminated with participation in the 2000 NASA Aviation Safety Program's Synthetic Vision System (SVS) / Runway Incursion Prevention System (RIPS) flight demonstration at Dallas-Fort Worth Airport.
Source record↗
Large-scale survey of prion protein genetic variability in scrapie disease-free goats from the United States
Scrapie is a slowly progressive neurodegenerative disease of small ruminants caused by an accumulation of an abnormal isoform of prion protein in the central nervous system. Polymorphisms of the prion protein gene (PRNP) strongly modulate scrapie resistance and incubation period in goats. The aim of this study was to identify PRNP genetic variability in goats across the United States. Blood from a total of 6,029 apparent scrapie disease-free goats from 654 operations and 19 breeds were analyzed. Sequencing of PRNP revealed 26 genotypes with different rates based on eight codons. The GG127, RR154, and QQ222 genotypes were predominant and showed a remarkably high rate across all goats. The QK222 and NS146 genotypes, known to be protective against scrapie, were found in 0.6% [with 95% CI = (0.3, 1.2)] and 22.0% [95% CI = (19.1, 25.2)] of goats, respectively. The QK222 genotype was found in 23.1% of Oberhasli goats tested, with 95%CI = (3.9, 68.7)] and 22.0% of Toggenburg goats tested with 95%CI = (9.7, 42.5)], while NS146 was found in 65.5% of Savannah goats tested, with 95%CI = (30.8, 89.9), 36.7% of Boer goats tested, with 95%CI = (33.1, 40.4), 36.3% of Nubian goats tested, with 95%CI = (27.0, 46.7)], and 35.6% of LaMancha goats tested, with 95%CI = (22.8, 50.8%). The MM142 and IM142 genotypes were found more frequently in goats on dairy operations, while the HR143, NS146, and ND146 genotypes were found more frequently in goats on meat operations. Goats in the east region had a higher percentage of goats with RH154, RQ211, and QK222 genotypes than goats in the west region. The results of this study showed high genetic variability of PRNP among the U.S. goat population, with differences by location and breed, and may serve as a rationale for development of goat breeding programs at the national level to mitigate the risk of scrapie.
59 BASIC BIOLOGICAL SCIENCES↗
Performance of a machine learning-based decision model to help clinicians decide the extent of lymphadenectomy (D1 vs. D2) in gastric cancer before surgical resection
Background: Controversy still exists on the optimal surgical resection for potentially curable gastric cancer (GC). Use of radiologic evaluation and machine learning algorithms might predict extent of lymphadenectomy to limit unnecessary surgical treatment. We purposed to design a machine learning-based clinical decision-support model for predicting extent of lymphadenectomy (D1 vs. D2) in local advanced GC. Methods: Clinicoradiologic features available from routine clinical assignments in 557 patients with GCs were retrospectively interpreted by an expert panel blinded to all histopathologic information. All patients underwent surgery using standard D2 resection. Decision models were developed with a logistic regression (LR), support vector machine (SVM) and auto-encoder (AE) algorithm in 371 training and tested in 186 test data, respectively. The primary end point was to measure diagnostic performance of decision model and a Japanese gastric cancer treatment guideline version 4th (JPN 4th) criteria for discriminate D1 (pT1 + pN0) versus D2 (≥ pT1 + ≥ pN1) lymphadenectomy. Results: The decision model with AE analysis produced highest area under ROC curve (train: 0.965, 95% confidence interval (CI) 0.948–0.978; test: 0.946, 95% CI 0.925–0.978), followed by SVM (train: 0.925, 95% CI 0.902–0.944; test: 0.942, 95% CI 0.922–0.973) and LR (train: 0.886, 95% CI 0.858–0.910; test: 0.891, 95% CI 0.891–0.952). By this improvement, overtreatment was reduced from 21.7% (121/557) by treat-all pattern, to 15.1% (84/557) by JPN 4th criteria, and to 0.7–0.9% (4–5/557) by the new approach. Conclusions: The decision model with machine learning analysis demonstrates high accuracy for identifying patients who are candidates for D1 versus D2 resection. Its approximate 14–20% improvements in overtreatment compared to treat-all pattern and JPN 4th criteria potentially increase the number of patients with local advanced GCs who can safely avoid unnecessary lymphadenectomy.
62 RADIOLOGY AND NUCLEAR MEDICINE↗
MTT/Gitlab CI Open MPI and PMIx/PRRTe testing [Slides]
Abstract not provided.
97 MATHEMATICS AND COMPUTING↗
Leveraging the Cloud for HDF1 Software Testing
In this talk we will discuss how we leverage the Cloud for HDF software daily regression testing including testing of the HDF5 parallel library on the Cloud cluster using Orange FS.
CI testing↗
BeeSwarm: Enabling Parallel Scaling Performance Measurement in Continuous Integration for HPC Applications
Testing is one of the most important steps in software development–it ensures the quality of software. Continuous Integration (CI) is a widely used testing standard that can report software quality to the developer in a timely manner during development progress. Performance, especially scalability, is another key factor for High Performance Computing (HPC) applications. There are many existing profiling and performance tools for HPC applications, but none of these are integrated into CI tools. In this work, we propose BeeSwarm, an HPC container based parallel scaling performance system that can be easily applied to the current CI test environments. BeeSwarm is mainly designed for HPC application developers who need to monitor how their applications can scale on different compute resources. We demonstrate BeeSwarm using a multi-physics HPC application with Travis CI, GitLab CI and GitHub Actions while using ChameleonCloud and Google Compute Engine as the compute backends. Finally, our results show that BeeSwarm can be used for scalability and performance testing of HPC applications.
97 MATHEMATICS AND COMPUTING↗
TRACER-Coastal Urban Boundary-Layer Interactions with Convection (TRACER-CUBIC) Field Campaign Report
To better understand the complicated web of processes governing convective cloud life cycle and aerosol-convection interactions, the U.S. Department of Energy (DOE)’s Atmospheric Radiation Measurement (ARM) user facility supported deployment of a variety of advanced atmospheric measurement systems to the greater Houston, Texas, area from 1 October 2021 to 30 September 2022 as part of the Tracking Aerosol Convection Interactions Experiment (TRACER). Houston was selected as a study area because isolated convection and a variety of aerosol conditions are common in this region. This one-year ARM Mobile Facility (AMF) deployment featured a four-month intensive operational period (IOP) during summer 2022 (1 June–30 September). The ARM instrumentation was deployed at three sites along an east-west transect from La Porte, Texas to an ancillary site in a less-polluted rural region southwest of downtown Houston (Figure 1). At the La Porte Site, which is located near the Houston ship channel in an area that experiences significant pollution, the first ARM Mobile Facility (AMF1) was deployed. During the IOP, the ARM tethered balloon system (TBS) operated at the ancillary site. The second-generation C-Band Scanning ARM Precipitation Radar (CSAPR) operated near Pearland, Texas, roughly halfway between the Laporte and ancillary sites. As part of the TRACER- Coastal Urban Boundary-Layer Interactions with Convection (CUBIC) project, three boundary-layer profiling systems) were deployed along a north-south transect spanning from the University of Houston Coastal Center to the Aldine site north of downtown Houston (also blue dot in Figure 1) during the TRACER IOP. These systems included the National Oceanic and Atmospheric Administration (NOAA) National Severe Storms Laboratory CLAMPS2 (C2), which was deployed at the UHCC, the University of Wisconsin SPARC, which was deployed at the ARM CSAPR site near Pearland (orange diamond in middle of map in Figure 1), and the University of Oklahoma CLAMPS1 (C1), which was deployed at Aldine. These three systems have been successfully operated in various field campaigns, providing data sets that collectively offer new insights into atmospheric-boundary-layer (ABL) processes, sea-breeze (SB) circulations, and convection initiation (CI). For the TRACER IOP window, these systems ran continuously between 1 June and 26 September, 2022. Due to commitments to NOAA projects, the Doppler lidar at the UHCC site was not available until 24 June 2022. The CLAMPS and SPARC profiling systems are self-contained platforms that have benefited from several years of development and deployment. Instruments and data processing were maintained remotely, which made the 4-month deployment for the TRACER-CUBIC IOP period possible. The same basic instrument configuration comprises each system: a scanning Doppler wind lidar for flow characterization and passive profiler(s) for characterizing planetary-boundary-layer (PBL) thermodynamic properties. Each platform includes a Halo Streamline Doppler wind lidar, an Atmospheric Emitted Radiance Interferometer (AERI), and a surface meteorology station. CLAMPS1 and CLAMPS2 each also include a microwave radiometer (MWR, Figure 1d). The TRACER-CUBIC hypotheses included (i) Interactions of SB and urban circulations and how they affect the PBL structure in the Houston environment, causing spatially (horizontally and vertically) and temporally highly variable flow patterns, (ii) heat, moisture, and aerosol transport and mixing depend on these flow dynamics, and (iii) an improved understanding of the flow patterns and PBL structure are critical for investigating the processes leading to CI. To test these hypotheses, the project aimed at (i) characterizing SB circulations and their impacts on the diurnal evolution of the structure of the ABL, (ii) studying the evolution of Houston’s complex urban boundary layer, and (iii) identifying effects of urban-induced circulations on pre-convective environments. TRACER-CUBIC observations generally provide good coverage during the summer IOP. Initial screening of the data indicates a good number of cases with bay-breeze (BB) and/or SB signatures, local CI, and interesting boundary-layer features such as strong nocturnal low-level jets (LLJs, Table 1). The numbers listed in rows 3-5 in this table will be further updated as part of ongoing in-depth analyses and systematic identification of local circulations and CI events. More detailed information about the data availability and quality for each instrument is provided in the “readme” files that were submitted to the ARM Data Center along with each archived data sets. These “readme” files also provide instrument descriptions, information about the data collection and processing procedures, data formats, and any additional information relevant for further data analysis.
54 ENVIRONMENTAL SCIENCES↗
Relativistic configuration interaction plus linearized-coupled-cluster calculations of U 2 + energies, g factors, transition rates, and lifetimes
In this study, excitation energies, term designations, g factors, transition rates, and lifetimes of U 2+ are determined using a relativistic configuration interaction (CI) + linearized-coupled-cluster (LCC) approach. The CI-LCC energies are compared with CI + many-body-perturbation-theory (MBPT) and available experimental energies. Close agreement has been found with experiment, within hundreds of cm -1 . In addition, lifetimes of higher levels have been calculated for comparison with three experimentally measured lifetimes, and close agreement has been found within the experimental error. CI-LCC calculations constitute a benchmark test of the CI + all-order method in complex relativistic systems such as actinides and their ions with many valence electrons. The theory yields many energy levels, g factors, transition rates, and lifetimes of U 2+ that are not available from experiment. Lastly, the theory can be applied to other multivalence atoms and ions, which would be of interest to many applications.
74 ATOMIC AND MOLECULAR PHYSICS↗
Cholla-MHD: An Exascale-capable Magnetohydrodynamic Extension to the Cholla Astrophysical Simulation Code
Abstract We present an extension of the massively parallel, GPU native, astrophysical hydrodynamics code Cholla to magnetohydrodynamics (MHD). Cholla solves the ideal MHD equations in their Eulerian form on a static Cartesian mesh utilizing the Van Leer + constrained transport integrator, the HLLD Riemann solver, and reconstruction methods at second and third order. Cholla’s MHD module can perform ≈260 million cell updates per GPU-second on an NVIDIA A100 while using the HLLD Riemann solver and second order reconstruction. The inherently parallel nature of GPUs combined with increased memory in new hardware allows Cholla’s MHD module to perform simulations with resolutions ∼500 3 cells on a single high-end GPU (e.g., an NVIDIA A100 with 80 GB of memory). We employ GPU direct Message Passing Interface to attain excellent weak scaling on the exascale supercomputer Frontier, while using 74,088 GPUs and simulating a total grid size of over 7.2 trillion cells. A suite of test problems highlights the accuracy of Cholla’s MHD module and demonstrates that zero magnetic divergence in solutions is maintained to round off error. We also present new testing and CI tools using GoogleTest, GitHub Actions, and Jenkins that have made development more robust and accurate and ensure reliability in the future.
Astronomy & Astrophysics↗
IDAES-PSE 2.3.0 Release
The Institute for the Design of Advanced Energy Systems (IDAES) Integrated Platform is a versatile computational environment offering extensive process systems engineering (PSE) capabilities for optimizing the design and operation of complex, interacting technologies and systems. IDAES enables users to efficiently search vast, complex design spaces to discover the lowest cost, most environmentally sustainable solutions while supporting the full process modeling lifecycle, from conceptual design to dynamic optimization and control. The extensible, open platform empowers users to create models of novel processes and rapidly develop custom analyses, workflows, and end-user applications.. New Features and Models • New diagnostics toolboxes and examples o Tutorial for using the DiagnosticsToolbox o Methods to identify potential evaluation errors in models o SVDToolbox for performing singular value decomposition analysis on models to identify possible degeneracies and poor scaling o DegeneracyHunter for identifying irreducible degenerate sets in models • Model for solid-liquid separation which takes two inputs (solid and liquid streams) and produces three outlets (solids, liquid entrained with solids and pure liquid) • Example of temperature swing adsorption in models_extra Deprecation Warnings • With the update to Pyomo 6.7.0, the plate heat exchanger model has begun failing tests on some CI platforms. If this is not addressed by the February release, this model may be removed due to failing tests. See #1294. Offers to help identify the cause and fix this issue are welcome. Improvements and bug fixes • Fixed oversight which precluded using Mixer and Separator models when inherent reactions were present in property package • Added reporting methods to the MSContactor model • Minor corrections in some examples where values were being fixed outside of declared variable bounds
DiagnosticsToolbox,IDAES,PSE,Process Systems Engin↗
Configuration–Interaction Perturbation Theory Calculations of Pu II
Configuration–interaction perturbation theory (CI–PT) is applied to calculations of low-energy states of Pu II. This ion is quite challenging due to a large number of possible determinants arising from seven valence electrons and strong relativistic effects. The CI–PT calculations agree with experiments for the energies and g-factors for many low-energy states that allowed positive identification of the theoretical levels. Isotope shifts were also used to aid in identification, and, in case of the odd states, fitting with three independent parameters was used to match theoretical isotope shifts to the experimental values with good accuracy. The CI–PT approach tested here on the Pu II ion can be generally used to calculate properties of many complex atoms, including U I that can find application in fundamental and applied science.
74 ATOMIC AND MOLECULAR PHYSICS↗