Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deterministic approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

FAIR to WISE (F2W) v1.0.0

FAIR to WISE (F2W) is an iterative, large-language model (LLM) driven pipeline that turns unstructured research PDFs into structured, queryable knowledge graphs (KGs). Core features include schema-driven extraction to a LinkML model; full provenance capture; ontology-grounded enrichment (e.g., chemical validation and ChEBI lookup); graph construction to JSON-LD with stable IDs; and KG-RAG question answering with evidence-aware retrieval. The system is engineered for reproducibility and accessibility (open-source Ollama models, temperature=0, NVTX/Nsight profiling) with robust QA (relation verification, deduplication, and deterministic outputs). Primary uses are literature-to-KG automation, knowledge-grounded Q&A, and experimental steering support. We demonstrate the approach in organic photovoltaics, where the pipeline ingests papers, builds a domain KG, and evaluates answers against expert competency questions to guide experimental planning and interpretation. Compared with off-the-shelf LLMs and ad-hoc NLP tools, F2W addresses ontology gaps and reduces hallucination risk by grounding responses in extracted evidence and enforcing schema constraints; it also offers deterministic, provenance-linked outputs and open, cost-aware deployment. Evidence-aware ranking further improves answer quality over pure vector search.

Abramov, David [Lawrence Berkeley National Laborat↗

Chemical classification program synthesis using generative artificial intelligence

Accurately classifying chemical structures is essential for cheminformatics and bioinformatics, including tasks such as identifying bioactive compounds of interest, screening molecules for toxicity to humans, finding non-organic compounds with desirable material properties, or organizing large chemical libraries for drug discovery or environmental monitoring. However, manual classification is labor-intensive and difficult to scale to large chemical databases. Existing automated approaches either rely on manually constructed classification rules, or are deep learning methods that lack explainability. This work presents an approach that uses generative artificial intelligence to automatically write chemical classifier programs for classes in the Chemical Entities of Biological Interest (ChEBI) database. These programs can be used for efficient deterministic run-time classification of SMILES structures, with natural language explanations. The programs themselves constitute an explainable computable ontological model of chemical class nomenclature, which we call the ChEBI Chemical Class Program Ontology (C3PO). We validated our approach against the ChEBI database, and compared our results against deep learning models and a naive SMARTS pattern based classifier. C3PO outperforms the naive classifier, but does not reach the performance of state of the art deep learning methods. However, C3PO has a number of strengths that complement deep learning methods, including explainability and reduced data dependence. C3PO can be used alongside deep learning classifiers to provide an explanation of the classification, where both methods agree. The programs can be used as part of the ontology development process, and iteratively refined by expert human curators.

Artificial Intelligence↗

3D oxygen vacancy distribution and defect-property relations in an oxide heterostructure

Oxide heterostructures exhibit a vast variety of unique physical properties. Examples are unconventional superconductivity in layered nickelates and topological polar order in (PbTiO 3 ) n /(SrTiO 3 ) n superlattices. Although it is clear that variations in oxygen content are crucial for the electronic correlation phenomena in oxides, it remains a major challenge to quantify their impact. Here, we measure the chemical composition in multiferroic (LuFeO 3 ) 9 /(LuFe 2 O 4 ) 1 superlattices, mapping correlations between the distribution of oxygen vacancies and the electric and magnetic properties. Using atom probe tomography, we observe oxygen vacancies arranging in a layered three-dimensional structure with a local density on the order of 10 14 cm -2 , congruent with the formula-unit-thick ferrimagnetic LuFe 2 O 4 layers. The vacancy order is promoted by the locally reduced formation energy and plays a key role in stabilizing the ferroelectric domains and ferrimagnetism in the LuFeO 3 and LuFe 2 O 4 layers, respectively. The results demonstrate pronounced interactions between oxygen vacancies and the multiferroic order in this system and establish an approach for quantifying the oxygen defects with atomic-scale precision in 3D, giving new opportunities for deterministic defect-enabled property control in oxide heterostructures.

36 MATERIALS SCIENCE↗

Algorithm 1049: The Delaunay Density Diagnostic

Accurate approximation of a real-valued function depends on two aspects of the available data: the density of inputs within the domain of interest and the variation of the outputs over that domain. There are few methods for assessing whether the density of inputs is sufficient to identify the relevant variations in outputs—i.e., the “geometric scale” of the function—despite the fact that sampling density is closely tied to the success or failure of an approximation method. In this article, we introduce a general purpose, computational approach to detecting the geometric scale of real-valued functions over a fixed domain using a deterministic interpolation technique from computational geometry. The algorithm is intended to work on scalar data in moderate dimensions (2–10). Our algorithm is based on the observation that a sequence of piecewise linear interpolants will converge to a continuous function at a quadratic rate (in L 2 norm) if and only if the data are sampled densely enough to distinguish the feature from noise (assuming sufficiently regular sampling). We present numerical experiments demonstrating how our method can identify feature scale, estimate uncertainty in feature scale, and assess the sampling density for fixed (i.e., static) datasets of input–output pairs. Finally, we include analytical results in support of our numerical findings and have released lightweight code that can be adapted for use in a variety of data science settings.

97 MATHEMATICS AND COMPUTING↗

Leveraging large language models to automate the identification of healthcare access barriers for veterans

Objective: To develop and evaluate an automated system for identifying healthcare barriers focusing on transportation issues in veterans’ clinical notes using large language models (LLMs) and to assess the impact of different prompting strategies on classification performance and explanation consistency. Methods: We developed a hybrid system combining pattern matching for templated notes with LLM analysis for free-text notes. Using 2000 manually annotated clinical notes, we compared four prompting strategies (dual-role short, dual-role long, analysis-first, analysis-only) across Mistral-7B and Llama-3.1 models. We evaluated classification performance using standard metrics and assessed explanation consistency through embedding similarity analysis. Results: The analysis-first strategy achieved superior performance, with Mistral-7B reaching an F1 score of 0.914, outperforming traditional machine learning approaches (GBM: 0.786, BERT: 0.811). LLMs demonstrated higher explanation consistency within models (mean cosine similarity 0.887–0.908) compared to cross-model similarities (0.767–0.872). Pattern matching successfully handled 6.7% of templated notes deterministically. Mistral-7B showed greater internal consistency but higher abstention rates compared to Llama-3.1. Conclusion: Requiring LLMs to analyze evidence before classification improves both accuracy and explanation consistency for identifying transportation barriers in clinical notes. This approach enables automated barrier detection at scale while providing clinically relevant explanations, supporting both population-level healthcare planning and individual patient care decisions.

Healthcare access barriers↗

Hybrid Quantum Networks with Discrete Polarizations and Continuous Quadrature Variables

Final Scientific/Technical Report for DOE Project DE-SC0022069. Quantum communication and computation systems have evolved along two largely independent paradigms: discrete-variable (DV) systems that encode information in qubits such as photon polarizations or photon-number states, and continuous-variable (CV) systems that encode information in optical field quadratures. Each approach offers distinct advantages—DVs provide low error rates and compatibility with single-photon platforms, while CVs support deterministic operations and efficient quantum state manipulation. A fundamental challenge for building a scalable Quantum Internet lies in interfacing these two regimes into a unified hybrid architecture that can coherently distribute and process quantum information across heterogeneous quantum nodes. This project aims to develop and demonstrate a hybrid optical quantum network that seamlessly integrates DV and CV systems. Specifically, we investigate a new class of hybrid entanglement between the discrete polarizations of single photons and the continuous quadrature variables of optical cat states, overcoming incompatibilities in existing DV–CV demonstrations. Using this new entanglement resource, the team investigates a multi-node hybrid quantum local area network (Q-LAN) testbed capable of DV–CV entanglement generation, swapping, and distribution across fiber links.

74 ATOMIC AND MOLECULAR PHYSICS↗

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗

Automation for Electric Vehicle Battery Pack Disassembly

Battery‐electric vehicles (EVs) are growing exponentially. The demand for these batteries is expected to increase sevenfold by 2035. The EV batteries reach their end of life when the capacity fades to 70%–80% of new, with some being removed from the primary applications with even lower levels of degradation. These batteries can be used in less demanding applications. The disassembly process is currently manual, slow, unsafe, and expensive. Automation is needed to increase the throughput. EV battery packs feature various continually changing designs and form factors, which limit the usefulness of deterministically programmed robotic solutions. The conceptual robotic disassembly of EV batteries has attracted the attention of researchers. However, while many approaches have been proposed, practical implementations are lacking. Here, we review proposed concepts for EV battery disassembly and describe the selected approach, with elements of partial solutions validated in a laboratory setting, including the selection of commercial solutions, the development of custom end effectors, and methodologies for detection, localization, and classification of fasteners. The computer vision tasks employed an overhead 2D camera to detect the type of battery pack and approximate localization of fasteners, and a 3D camera mounted on the robotic arm for precise localization (position and tilt) and classification.

Islam, Abu [Rochester Inst. of Technology, Rochest↗

Uncertainty Quantification and Sensitivity Analysis of Nuclear Construction Cost Reduction Pathways

High construction costs have plagued recent nuclear projects and they hamper the widespread deployment of nuclear technology. The Nuclear Cost Reduction Tool is a plant economic framework that quantifies the impact that various plant design and construction attributes have on construction costs and cost overruns and shows the positive effects of learning over a series of deployments. However, a downside of the current model is that all model outputs and capabilities are deterministic. To provide a more comprehensive view, this study evaluated the impact of model parameter uncertainty through a sensitivity analysis applied to 18 model parameters. This approach quantified the impact of model uncertainty on the output variables of Net Overnight Capital Cost (Net OCC), Construction Duration (CD), and Levelized Cost of Electricity (LCOE). Monte Carlo analysis revealed uncertainty distributions for these variables, showing that absolute uncertainty decreases over a series of deployments. A local sensitivity analysis showed that even small parameter perturbations (5%) can have a significant impact on project execution, highlighting areas that could reduce costs by billions across an order book of plants. The results of this study have improved the understanding of the model and identified the most impactful model parameters and construction attributes.

Levelized Cost of Electricity↗

Real-time plasma monitoring framework for advanced plasma control and ML-research in DIII-D

Real-time and adaptive plasma control is crucial for robust tokamak operation, requiring sensitivity and tolerance measurements of the plasma state. This paper presents the implementation of an integrated real-time plasma monitoring framework on the DIII-D tokamak to support advanced control approaches, including machine-learning (ML) methods. The system is built on the SHIELD framework, a high-performance modular architecture that provides a unified pipeline for integrating diverse diagnostics. The framework leverages high-bandwidth digitizers, fast numerical processing, and deterministic, low-latency interconnects to stream high-fidelity data from diagnostics such as electron cyclotron emission (ECE), beam emission spectroscopy (BES), CO interferometers, and a visible tangential divertor camera (TangTV). The system’s validity is demonstrated through direct comparisons of real-time and offline data. Furthermore, we present two key applications of the developed plasma monitoring system with ML-based plasma control strategies, including real-time divertor detachment and active Alfvén Eigenmode control. As a result, this work presents a robust and scalable approach for integrating high-frequency, multidimensional diagnostics into advanced control algorithms for future fusion devices.

AI/ML↗

Hardware Implementation of Grover's Search Algorithm

Grover's algorithm searches through an unstructured database, offering a quadratic speedup over classical search algorithms. We implement it, as well as two deterministic variants, on IBM (Kingston) and IQM (Garnet) hardware. Additionally, we test dynamical decoupling as an error mitigation technique. We compare our results to a classical, brute force approach to evaluate current hardware capabilities.

Pressman, Daniel [Fermilab]↗

Serpent - Bison - THM Preliminary Multiphysics Modeling of a Nuclear Thermal Propulsion System Fuel Assembly

This work demonstrates the Monte Carlo neutronic and Thermo-Hydraulic coupling scheme using the Serpent code and MOOSE application Bison and Thermo Hydraulic Module. The coupling scheme is then applied to the reference BWX Technologies Nuclear Ther- mal Propulsion system at he fuel assembly level where it’s used to perform an analysis of the isothermal material coefficients and potential material reactivity worth. A method is developed to isolate which feedback effects should be considered for proceeding with reduced order deterministic neutronic modeling where branch off analysis must be con- ducted. The convergence behavior of the coupling scheme is demonstrated where it fol- lows the standard Picard iteration approach. Verification studies for the method of deduc- ing relevant feedback effects is also demonstrated.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Probabilistic machine learning for battery health diagnostics and prognostics—review and perspectives

Abstract Diagnosing lithium-ion battery health and predicting future degradation is essential for driving design improvements in the laboratory and ensuring safe and reliable operation over a product’s expected lifetime. However, accurate battery health diagnostics and prognostics is challenging due to the unavoidable influence of cell-to-cell manufacturing variability and time-varying operating circumstances experienced in the field. Machine learning approaches informed by simulation, experiment, and field data show enormous promise to predict the evolution of battery health with use; however, until recently, the research community has focused on deterministic modeling methods, largely ignoring the cell-to-cell performance and aging variability inherent to all batteries. To truly make informed decisions regarding battery design in the lab or control strategies for the field, it is critical to characterize the uncertainty in a model’s predictions. After providing an overview of lithium-ion battery degradation, this paper reviews the current state-of-the-art probabilistic machine learning models for health diagnostics and prognostics. Details of the various methods, their advantages, and limitations are discussed in detail with a primary focus on probabilistic machine learning and uncertainty quantification. Last, future trends and opportunities for research and development are discussed.

25 ENERGY STORAGE↗

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗

Nuclear Safety [Vol. 34, No. 1, January-March 1993]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 1 An Integrated Regional Approach To Risk Management of Industrial Systems, S. Chakraborty and R. Stratton; 9 Annual Technical Meeting of the NRC Cooperative Severe Accident Research Program, E. G. Silver; ACCIDENT ANALYSIS: 13 Deterministic Severe Accident Criteria as Severe Accident Design Criteria and Policy for the New Production Reactor-Heavy Water Reactor, P. T. Rhoads; 20 Proposed Deterministic Severe Accident Criteria for the Heavy Water Reactor-New Production Reactor Containment, K. D. Bergeron, S. E. Slezak, and C. E. Leach; 33 Quasi-Static Core Liquid Level Depression and Long-Term Core Uncovery During a PWR LOCA, Y. Kukita, R. R. Schultz, H. Nakamura, and J. Katayama; 49 LIRA: An Advanced Containment System to Minimize the Accidental Radioactivity Releases, A. Turricchia; 63 Errata to “A Review of Hydrogen Production During Melt/Water Interaction in LWRs,” Vol. 33, No. 4; CONTROL AND INSTRUMENTATION: 64 The Nuplex 80+™ Advanced Control Complex from ABB Combustion Engineering, F. Ridolfo, D. Harmon, and K. Scarola; DESIGN FEATURES: 76 A Scheme for Passive Isolation of the Containment of a Reactor, A. K. Ghosh, V. V. Raj, and K. Kakodkar; 84 Utility Requirements for Safety in the Passive Advanced Light-Water Reactor, T. U. Marston, W. H. Layman, and G. Bockhold, Jr.; WASTE AND SPENT FUEL MANAGEMENT: 91 Activities Related to Waste and Spent Fuel Management, Compiled by M. D. Muhlheim and E. G. Silver; OPERATING EXPERIENCES: 103 Testing Deficiencies in Auxiliary Systems Feedwater Systems, J. D. Kueck; 110 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 113 Selected Safety-Related Events, Compiled by G. A. Murphy; 115 Operating U.S. Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver; RECENT DEVELOPMENTS: 133 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 145 Reports, Standards, and Safety Guides, D. S. Queener; 150 Proposed Rule Changes as of Sept. 30, 1992; ANNOUNCEMENTS: 75 Harvard Short Course on Risk: Science, Assessment, and Management; 102 International Conference on Reactor Physics and Reactor Computations; 102 The Fourth International Conference on Nuclear Waste Reprocessing and Waste Management [RECOD ’94]; 132 International Symposium on the Radiological Exposure of the Population of the European Community from Radioactivity in the Mediterranean Sea [MARINA-MED]; 162 International High-Level Radioactive Waste Conference ‘Technology Integration—Above and Below”; 154 The Authors; 158 Indexes to Nuclear Safety, Volume 33.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Nuclear Safety [Vol. 34, No. 1, January-March 1993]

Nuclear Safety is a review journal that covers significant developments in the field of nuclear safety. Its scope includes the analysis and control of hazards associated with nuclear energy, operations involving fissionable materials, and the products of nuclear fission and their effects on the environment. Primary emphasis is on safety in reactor design, construction, and operation; however, the safety aspects of the entire fuel cycle, including fuel fabrication, spent-fuel processing, nuclear waste disposal, handling of radioisotopes, and environmental effects of these operations, are also treated. Table of Contents for this issue follows. GENERAL SAFETY CONSIDERATIONS: 1 An Integrated Regional Approach To Risk Management of Industrial Systems, S. Chakraborty and R. Stratton; 9 Annual Technical Meeting of the NRC Cooperative Severe Accident Research Program, E. G. Silver; ACCIDENT ANALYSIS: 13 Deterministic Severe Accident Criteria as Severe Accident Design Criteria and Policy for the New Production Reactor-Heavy Water Reactor, P. T. Rhoads; 20 Proposed Deterministic Severe Accident Criteria for the Heavy Water Reactor-New Production Reactor Containment, K. D. Bergeron, S. E. Slezak, and C. E. Leach; 33 Quasi-Static Core Liquid Level Depression and Long-Term Core Uncovery During a PWR LOCA, Y. Kukita, R. R. Schultz, H. Nakamura, and J. Katayama; 49 LIRA: An Advanced Containment System to Minimize the Accidental Radioactivity Releases, A. Turricchia; 63 Errata to “A Review of Hydrogen Production During Melt/Water Interaction in LWRs,” Vol. 33, No. 4; CONTROL AND INSTRUMENTATION: 64 The Nuplex 80+™ Advanced Control Complex from ABB Combustion Engineering, F. Ridolfo, D. Harmon, and K. Scarola; DESIGN FEATURES: 76 A Scheme for Passive Isolation of the Containment of a Reactor, A. K. Ghosh, V. V. Raj, and K. Kakodkar; 84 Utility Requirements for Safety in the Passive Advanced Light-Water Reactor, T. U. Marston, W. H. Layman, and G. Bockhold, Jr.; WASTE AND SPENT FUEL MANAGEMENT: 91 Activities Related to Waste and Spent Fuel Management, Compiled by M. D. Muhlheim and E. G. Silver; OPERATING EXPERIENCES: 103 Testing Deficiencies in Auxiliary Systems Feedwater Systems, J. D. Kueck; 110 Reactor Shutdown Experience, Compiled by J. W. Cletcher; 113 Selected Safety-Related Events, Compiled by G. A. Murphy; 115 Operating U.S. Power Reactors, Compiled by M. D. Muhlheim and E. G. Silver; RECENT DEVELOPMENTS: 133 General Administrative Activities, Compiled by M. D. Muhlheim and E. G. Silver; 145 Reports, Standards, and Safety Guides, D. S. Queener; 150 Proposed Rule Changes as of Sept. 30, 1992; ANNOUNCEMENTS: 75 Harvard Short Course on Risk: Science, Assessment, and Management; 102 International Conference on Reactor Physics and Reactor Computations; 102 The Fourth International Conference on Nuclear Waste Reprocessing and Waste Management [RECOD ’94]; 132 International Symposium on the Radiological Exposure of the Population of the European Community from Radioactivity in the Mediterranean Sea [MARINA-MED]; 162 International High-Level Radioactive Waste Conference ‘Technology Integration—Above and Below”; 154 The Authors; 158 Indexes to Nuclear Safety, Volume 33.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Recurrent convolutional neural networks for modeling nonadiabatic dynamics of quantum-classical systems

Recurrent neural networks (RNNs) have recently been extensively applied to model the time evolution in fluid dynamics, weather predictions, and even chaotic systems due to their ability to capture temporal dependencies and sequential patterns in data. Here we present an RNN model based on convolutional neural networks for modeling the nonlinear nonadiabatic dynamics of hybrid quantum-classical systems. The dynamical evolution of the hybrid systems is governed by equations of motion for classical degrees of freedom and von Neumann equation for electrons. The Physics-Aware Recurrent Convolution (PARC) neural network structure incorporates a differentiator-integrator architecture that inductively models the spatiotemporal dynamics of generic physical systems. Here, we apply our RNN approach to learn the space-time evolution of a one-dimensional semiclassical Holstein model after an interaction quench. For shallow quenches (small changes in electron-lattice coupling), the deterministic dynamics can be accurately captured using a single-CNN-based recurrent network. In contrast, deep quenches induce chaotic evolution, making long-term trajectory prediction significantly more challenging. Nonetheless, we demonstrate that the PARC-CNN architecture can effectively learn the statistical climate of the Holstein model under deep-quench conditions.

Holstein model↗

Testing convolutional neural network based deep learning systems: a statistical metamorphic approach

Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.

Computer Science↗