Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Checking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Predicting Metabolic Reaction Networks with Perturbation-Theory Machine Learning (PTML) Models

Background: Checking the connectivity (structure) of complex Metabolic Reaction Networks(MRNs) models proposed for new microorganisms with promising properties is an importantgoal for chemical biology. Objective: In principle, we can perform a hand-on checking (Manual Curation). However, this is achallenging task due to the high number of combinations of pairs of nodes (possible metabolic reactions). Results: The CPTML linear model obtained using the LDA algorithm is able to discriminate nodes(metabolites) with the correct assignation of reactions from incorrect nodes with values of accuracy,specificity, and sensitivity in the range of 85-100% in both training and external validation dataseries. Methods: In this work, we used Combinatorial Perturbation Theory and Machine Learning techniquesto seek a CPTML model for MRNs >40 organisms compiled by Barabasis’ group. First, wequantified the local structure of a very large set of nodes in each MRN using a new class of node indexcalled Markov linear indices fk. Next, we calculated CPT operators for 150000 combinationsof query and reference nodes of MRNs. Last, we used these CPT operators as inputs of differentML algorithms. Conclusion: Meanwhile, PTML models based on Bayesian network, J48-Decision Tree and RandomForest algorithms were identified as the three best non-linear models with accuracy greaterthan 97.5%. The present work opens the door to the study of MRNs of multiple organisms usingPTML models.

Pharmacology & Pharmacy↗

An analysis of the control hierarchy modelling of the CMS detector control system

The supervisory level of the Detector Control System (DCS) of the CMS experiment is implemented using Finite State Machines (FSM), which model the behaviours and control the operations of all the sub-detectors and support services. The FSM tree of the whole CMS experiment consists of more than 30.000 nodes. An analysis of a system of such size is a complex task but is a crucial step towards the improvement of the overall performance of the FSM system. This paper presents the analysis of the CMS FSM system using the micro Common Representation Language 2 (mcrl2) methodology. Individual mCRL2 models are obtained for the FSM systems of the CMS sub-detectors using the ASF+SDF automated translation tool. Different mCRL2 operations are applied to the mCRL2 models. A mCRL2 simulation tool is used to closer examine the system. Visualization of a system based on the exploration of its state space is enabled with a mCRL2 tool. Requirements such as command and state propagation are expressed using modal mu-calculus and checked using a model checking algorithm. For checking local requirements such as endless loop freedom, the Bounded Model Checking technique is applied. This paper discusses these analysis techniques and presents the results of their application on the CMS FSM system.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Hydrothermal Liquefaction and Upgrading of Municipal Wastewater Treatment Plant Sludge: A Preliminary Techno-Economic Analysis

A preliminary process model and techno-economic analysis (TEA) was completed for fuel produced from hydrothermal liquefaction (HTL) of sludge waste from a municipal wastewater treatment plant (WWTP) and subsequent biocrude upgrading. The model is adapted from previous work by Jones et al. (2014) for algae HTL, using experimental data generated in fiscal year 2015 (FY15) bench-scale HTL testing of sludge waste streams. Testing was performed on sludge samples received from MetroVancouver’s Annacis Island WWTP (Vancouver, B.C.) as part of a collaborative project with the Water Environment and Reuse Foundation (WERF). The full set of sludge HTL testing data from this effort will be documented in a separate report to be issued by WERF. This analysis is based on limited testing data and therefore should be considered preliminary. Future refinements are necessary to improve the robustness of the model, including a cross-check of modeled biocrude components with the experimental GCMS data and investigation of equipment costs most appropriate at the smaller scales used here. Environmental sustainability metrics analysis is also needed to understand the broader impact of this technology pathway. The base case scenario for the analysis consists of 10 HTL plants, each processing 100 dry U.S. ton/day (92.4 ton/day on a dry, ash-free basis) of sludge waste and producing 234 barrel per stream day (BPSD) biocrude, feeding into a centralized biocrude upgrading facility that produces 2,020 barrel per standard day of final fuel. This scale was chosen based upon initial wastewater treatment plant data collected by the resource assessment team from the EPA’s Clean Watersheds Needs Survey database (EPA 2015a) and a rough estimate of what the potential sludge availability might be within a 100-mile radius. In addition, we received valuable feedback from the wastewater treatment industry as part of the WERF collaboration that helped form the basis for the selected HTL and upgrading plant scales and feedstock credit (current cost of disposal). It is assumed that the sludge is currently disposed of at $16.20/wet ton ($46/dry ton at 35% solids; $50/ton dry, ash-free basis) and this is included as a feedstock credit in the operating costs. The base case assumptions result in a minimum biocrude selling price of $3.8/gge and a minimum final upgraded fuel selling price of $4.9/gge. Several areas of process improvement and refinements to the analysis have the potential to significantly improve economics relative to the base case: • Optimization of HTL sludge feed solids content • Optimization of HTL biocrude yield • Optimization of HTL reactor liquid hourly space velocity (LHSV) • Optimization of fuel yield from hydrotreating • Combined large and small HTL scales specific to regions (e.g., metropolitan and suburban plants) Combined improvements believed to be achievable in these areas can potentially reduce the minimum selling price of biocrude and final upgraded fuel by about 50%. Further improvements may be possible through recovery of higher value components from the HTL aqueous phase, as being investigated under separate PNNL projects. Upgrading the biocrude at an existing petroleum refinery could also reduce the MFSP, although this option requires further testing to ensure compatibility and mitigate risks to a refinery. And finally, recycling the HTL aqueous phase product stream back to the headworks of the WWTP (with no catalytic hydrothermal gasification treatment) can significantly reduce cost. This option is uniquely appropriate for application at a water treatment facility but also requires further investigation to determine any technical and economic challenges related to the extra chemical oxygen demand (COD) associated with the recycled water.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hydrothermal Liquefaction and Upgrading of Municipal Wastewater Treatment Plant Sludge: A Preliminary Techno-Economic Analysis, Rev.1

A preliminary process model and techno-economic analysis (TEA) was completed for fuel produced from hydrothermal liquefaction (HTL) of sludge waste from a municipal wastewater treatment plant (WWTP) and subsequent biocrude upgrading. The model is adapted from previous work by Jones et al. (2014) for algae HTL, using experimental data generated in fiscal year 2015 (FY15) bench-scale HTL testing of sludge waste streams. Testing was performed on sludge samples received from Metro Vancouver’s Annacis Island WWTP (Vancouver, B.C.) as part of a collaborative project with the Water Environment and Reuse Foundation (WERF). The full set of sludge HTL testing data from this effort will be documented in a separate report to be issued by WERF. This analysis is based on limited testing data and therefore should be considered preliminary. In addition, the testing was conducted with the goal of successful operation, and therefore does not represent an optimized process. Future refinements are necessary to improve the robustness of the model, including a cross-check of modeled biocrude components with the experimental GCMS data and investigation of equipment costs most appropriate at the relatively small scales used here. Environmental sustainability metrics analysis is also needed to understand the broader impact of this technology pathway. The base case scenario for the analysis consists of 10 HTL plants, each processing 100 dry U.S. ton/day (92.4 ton/day on a dry, ash-free basis) of sludge waste and producing 234 barrel per stream day (BPSD) biocrude, feeding into a centralized biocrude upgrading facility that produces 2,020 barrel per standard day of final fuel. This scale was chosen based upon initial wastewater treatment plant data collected by PNNL’s resource assessment team from the EPA’s Clean Watersheds Needs Survey database (EPA 2015a) and a rough estimate of what the potential sludge availability might be within a 100-mile radius. In addition, we received valuable feedback from the wastewater treatment industry as part of the WERF collaboration that helped form the basis for the selected HTL and upgrading plant scales and feedstock credit (current cost of disposal). It is assumed that the sludge is currently disposed of at $16.20/wet ton ($46/dry ton at 35% solids; $50/ton dry, ash-free basis) and this is included as a feedstock credit in the operating costs. The base case assumptions result in a minimum biocrude selling price of $3.8/gge and a minimum final upgraded fuel selling price of $4.9/gge. Several areas of process improvement and refinements to the analysis have the potential to significantly improve economics relative to the base case: •Optimization of HTL sludge feed solids content •Optimization of HTL biocrude yield •Optimization of HTL reactor liquid hourly space velocity (LHSV) •Optimization of fuel yield from hydrotreating •Combined large and small HTL scales specific to regions (e.g., metropolitan and suburban plants) Combined improvements believed to be achievable in these areas can potentially reduce the minimum selling price of biocrude and final upgraded fuel by about 50%. Further improvements may be possible through recovery of higher value components from the HTL aqueous phase, as being investigated under separate PNNL projects. Upgrading the biocrude at an existing petroleum refinery could also reduce the MFSP, although this option requires further testing to ensure compatibility and mitigation of risks to a refinery. And finally, recycling the HTL aqueous phase product stream back to the headworks of the WWTP (with no catalytic hydrothermal gasification treatment) can significantly reduce cost. This option is uniquely appropriate for application at a water treatment facility but also requires further investigation to determine any technical and economic challenges related to the extra chemical oxygen demand (COD) associated with the recycled water.

09 BIOMASS FUELS↗

Nanosecond Transient Validation of Surge Arrester Models to Predict Electromagnetic Pulse Response

The impact of high-altitude electromagnetic pulse events on the electric grid is not fully understood, and validated modeling of mitigations, such as lightning surge arresters (LSAs) is necessary to predict the propagation of very fast transients on the grid. Experimental validation of high frequency models for surge arresters is an active area of research. Further, this article serves to experimentally validate a previously defined ZnO LSA model using four metal-oxide varistor pucks and nanosecond scale pulses to measure voltage and current responses. The SPICE circuit models of the pucks showed good predictability when compared to the measured arrester response when accounting for a testbed inductance of approximately 100 nH. Additionally, the comparatively high capacitance of low-profile arresters show a favorable response to high-speed transients that indicates the potential for effective electromagnetic pulse mitigation with future materials design.

42 ENGINEERING↗

Preliminary Gap Analysis of Existing IEEE 1547 and IEEE 2800 Standards Towards GFM Technology

This document describes the tests that are conducted on generic grid-forming (GFM) distributed energy resource (DER) and inverter-based resource (IBR) models to check if the performance of the model aligns respectively with the IEEE Std 1547 TM -2018 and IEEE Std 2800 TM -2022 requirements. For the IEEE Std 1547 TM -2018 requirements, specifically the tests related to volt-var requirements and frequency droop requirements are conducted. For the IEEE Std 2800 TM -2022 requirements, specifically the tests conducted are related to reactive- power-voltage control requirements, active-power-frequency response requirements, voltage disturbance ride through requirements and phase jump ride through requirements. This is an initial draft/document. There are many more tests still yet to be done to further verify if the existing standards have a gap or inadvertent barrier to GFM technology.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Verification of Electromagnetic Physics Models for Parallel Computing Architectures in the GeantV Project

An intensive R&D and programming effort is required to accomplish new challenges posed by future experimental high-energy particle physics (HEP) programs. The GeantV project aims to narrow the gap between the performance of the existing HEP detector simulation software and the ideal performance achievable, exploiting latest advances in computing technology. The project has developed a particle detector simulation prototype capable of transporting in parallel particles in complex geometries exploiting instruction level microparallelism (SIMD and SIMT), task-level parallelism (multithreading) and high-level parallelism (MPI), leveraging both the multi-core and the many-core opportunities. We present preliminary verification results concerning the electromagnetic (EM) physics models developed for parallel computing architectures within the GeantV project. In order to exploit the potential of vectorization and accelerators and to make the physics model effectively parallelizable, advanced sampling techniques have been implemented and tested. In this paper we introduce a set of automated statistical tests in order to verify the vectorized models by checking their consistency with the corresponding Geant4 models and to validate them against experimental data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

EMT data generation

The integration of inverter-based resources (IBRs) in power systems is accelerating, bringing with it significant benefits such as reduced greenhouse gas emissions, improved grid resilience, and increased energy independence. Despite these advantages, the widespread adoption of IBRs introduces several challenges, including issues related to grid stability, increased operational complexity, and the need for updated regulatory frameworks. To address these challenges, IEEE released Standard 2800 in 2022, which sets forth the necessary interconnection capabilities and performance criteria for IBRs connected to transmission and sub-transmission systems. This standard outlines the performance requirements to ensure the reliable integration of IBRs into the bulk power system. Furthermore, in 2023, the North American Electric Reliability Corporation (NERC) published a reliability guideline for electromagnetic transient (EMT) modeling of BPS-connected IBRs. This guideline provides recommendations for developing EMT model requirements, performing model quality checks, and implementing verification practices specifically for EMT models representing BPS-connected inverter-based resources in reliability studies conducted by transmission planners and planning coordinators. These standards and guidelines have a profound impact on EMT studies for transmission networks, influencing system stability analyses, grid recovery and resynchronization processes, fault ride-through evaluations, protection and coordination strategies, advanced control methodologies, and the inclusion of IBRs in transient models of transmission networks. As a result, the generation of EMT data is crucial for conducting various transient-based studies to understand the impact of IBRs. EMT data generation use cases serve as the basis for scenarios in event detection and identification use cases, providing comprehensive details about EMT data generation for transmission grids with inverter-based resources. These use cases supply sufficient training and validation datasets for subsequent EMT analysis algorithms.

Xia, Qianxue↗

CSEM Fluid Monitoring Methodology Using Real Data Examples

Conference presentation at International Meeting for Applied Geoscience & Energy (IMAGE), Houston, Texas, August 28 – September 1, 2023. Using field data from hydrocarbon and CO 2 applications, we illustrate the importance of a workflow and adaption to the target on hand. Verifying the geophysical acquisition and processing steps with 3D modeling and checking them against a 3D anisotropic log-derived model maintains confidence in the workflow and minimizes the influence on the data. This allows us to predict data validity and to certify the data with respect to the borehole logs.

20 FOSSIL-FUELED POWER PLANTS↗

Electrical and kinetical aspects of homogeneous dielectric-barrier discharge in xenon for excimer lamps

A pulsed dielectric-barrier discharge in xenon has been simulated for operating conditions typical to excimer lamps, in which the discharge is considered spatially homogeneous. The computer model developed is based on the xenon plasma chemistry, the circuit, and the Boltzmann equations. First, the validity of the physical model was checked and compared to experimental and theoretical works, and then the model is applied in the case of a sinusoidal voltage at period frequencies in the range of 50 kHz-2 MHz. The results obtained with the present description are in good agreement with experimental measurements and one-dimensional fluid prediction in terms of electrical characteristics and vacuum ultraviolet (vuv) emission. The effect of operation voltage, power source frequency, dielectric capacitance, as well as gas pressure on the discharge efficiency and the 172, 150, and 147 nm photon generation, under the typical experimental operating conditions and for the case of a sinusoidal applied voltage, have been investigated and discussed. Calculations suggest that the overall conversion efficiency from electrical energy to vuv emission in the lamp is greater than 38%, and it will be very affected at high power source frequency and high gas pressure with a significant dependence on the dielectric capacitance.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SAM Plug-in Development (Phase I Final Report)

The DOE Office of Nuclear Energy (NE) has created an extensive set of advanced modeling and simulation tools for nuclear engineering analysis. The advanced capabilities of these newer analysis codes require more in-depth training, skills, and knowledge in order to effectively utilize them for the design, analysis, and licensing of advanced nuclear systems and experiments. A high learning curve for inexperienced users may deter organizations from incorporating these tools into their internal processes. This project involved development of a plug-in to the Symbolic Nuclear Analysis Package (SNAP) for the System Analysis Module (SAM) tool. SAM is an advanced system analysis tool for reactor transient analyses being developed at Argonne National Laboratory under the U.S. DOE Office of Nuclear Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. SAM utilizes an object-oriented application framework (MOOSE), and its underlying meshing and finite-element library (libMesh) and linear and non-linear solvers (PETSc), to leverage modern advanced software environments and numerical methods. SNAP provides a highly flexible framework for creating, modifying and documenting input for engineering analysis codes such as SAM as well as extensive functionality for submitting, monitoring, and interacting with the codes through an intuitive graphical user interface (GUI). The common user interface provided by SNAP minimizes the learning curve for engineers starting with a new analysis code and provides an intuitive framework for transitioning between different analysis codes. SNAP provides a powerful but intuitive interface to facilitate access to advanced modeling and simulation tools for inexperienced users. Unlike many “form based” GUI’s, SNAP maps each engineering code’s component input to an internal database which manages all component input parameters along with component interconnections. This level of abstraction permits SNAP to support several advanced capabilities such as renodalization, model validation and consistency checks, embedded documentation, model notebook generation, data ownership and reviewer tracking, and variable assignment for inputs to name a few. SNAP includes a built-in Python interpreter and is interfaced to several commercial and open source packages including CPython, MATLAB/OCTAVE, Microsoft Office, Open Office, and SANDIA’s DAKOTA package which provides Uncertainty Quantification analysis through the SNAP plug-ins. Phase I of this project involved development a fully functional basic SAM plug-in to SNAP. This plug-in provides the ability to import existing models, graphically construct, edit and submit models using SNAP’s extensive functionality.

99 GENERAL AND MISCELLANEOUS↗

Influence of dissolved salts and impurities on seawater on heat transfer and fluid flow through fuel channels and debris bed

This project aims to better understand this mechanism and its effect on heat transfer. Specifically, experimental research was conducted to investigate the long term coolability issues in scaled test setups. Advanced diagnostic and measurement techniques were investigated and incorporated into an annular test facility and a debris bed test facility. The diagnostic techniques investigated included: radioactively tagged salt solution, Frisch collar radiation detector array, neutron and x-ray imaging systems, and a Rayleigh backscatter-based fiber-optic temperature system. Models were checked against the in-situ experimental data and recommendations were made for modeling purposes.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

BAO Cosmography

Cosmography provides a model-independent way to map the expansion history of the Universe. In this paper we simulate a Euclid-like survey and explore cosmographic constraints from future Baryonic Acoustic Oscillations (BAO) observations. We derive general expressions for the BAO transverse and radial modes and discuss the optimal order of the cosmographic expansion that provides reliable cosmological constraints. Through constraints on the deceleration and jerk parameters, we show that future BAO data have the potential to provide a model-independent check of the cosmic acceleration as well as a discrimination between the standard ΛCDM model and alternative mechanisms of cosmic acceleration.

79 ASTRONOMY AND ASTROPHYSICS↗

Guiding Principles for Geochemical/Thermodynamic Model Development and Validation in Nuclear Waste Disposal: A Close Examination of Recent Thermodynamic Models for H + —Nd 3+ —NO 3 - (—Oxalate) Systems

Development of a defensible source-term model (STM), usually a thermodynamical model for radionuclide solubility calculations, is critical to a performance assessment (PA) of a geologic repository for nuclear waste disposal. Such a model is generally subjected to rigorous regulatory scrutiny. In this article, we highlight key guiding principles for STM model development and validation in nuclear waste management. We illustrate these principles by closely examining three recently developed thermodynamic models with the Pitzer formulism for aqueous H + —Nd 3+ —NO 3 - (—oxalate) systems in a reverse alphabetical order of the authors: the XW model developed by Xiong and Wang, the OWC model developed by Oakes et al., and the GLC model developed by Guignot et al., among which the XW model deals with trace activity coefficients for Nd(III), while the OWC and GLC models are for concentrated Nd(NO 3 ) 3 electrolyte solutions. The principles highlighted include the following: (1) Principle 1. Validation against independent experimental data: A model should be validated against experimental data or field observations that have not been used in the original model parameterization. We tested the XW model against multiple independent experimental data sets including electromotive force (EMF), solubility, water vapor, and water activity measurements. The results show that the XW model is accurate and valid for its intended use for predicting trace activity coefficients and therefore Nd solubility in repository environments. (2) Principle 2. Testing for relevant and sensitive variables: Solution pH is such a variable for an STM and easily acquirable. All three models are checked for their ability to predict pH conditions in Nd(NO 3 ) 3 electrolyte solutions. The OWC model fails to provide a reasonable estimate for solution pH conditions, thus casting serious doubt on its validity for a source-term calculation. In contrast, both the XW and GLC models predict close-to-neutral pH values, in agreement with experimental measurements. (3) Principle 3. Honoring physical constraints: Upon close examination, it is found that the Nd(III)-NO 3 association schema in the OWC model suffers from two shortcomings. Firstly, its second stepwise stability constant for Nd(NO 3 ) 2+ (log K 2 ) is much higher than the first stepwise stability constant for NdNO 3 2+ (log K 1 ), thus violating the general rule of (log K 2 –log K 1 ) < 0, or $\frac{K1}{K2}$>1. Secondly, the OWC model predicts abnormally high activity coefficients for Nd(NO 3 ) 2 + (up to ~900) as the concentration increases. (4) Principle 4. Minimizing degrees of freedom for model fitting: The OWC model with nine fitted parameters is compared with the GLC model with five fitted parameters, as both models apply to the concentrated region for Nd(NO 3 ) 3 electrolyte solutions. The latter appears superior to the former because the latter can fit osmotic coefficient data equally well with fewer model parameters. The work presented here thus illustrates the salient points of geochemical model development, selection, and validation in nuclear waste management.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

HPC Software Verification in Action: A Case Study with Tensor Transposition

As HPC platforms get increasingly complex, the complexity of software optimized for these platforms has also increased. There is a pressing need to ensure correctness of scientific applications to enhance our confidence in the results they produce. In this paper, we focus on checking the correctness of libraries providing a small but important functionality— tensor transposition—used in computational chemistry applications. While several correctness tools have been developed and deployed, there are several practical challenges in using them to verify production HPC software. We present our experiences using two tools—CIVL and CodeThorn—in checking the correctness of two index permutation libraries.

Model checking, equivalence checking, index permut↗