Search NASA⌕ Search

SEARCH · Search NASA

Results for “parameter sensitivity analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Development and application of two-step uncertainty propagation and sensitivity analysis methodology for fast reactor safety analysis

Uncertainty quantification (UQ) in nuclear reactors for transients is directly linked with safety assessment through the cross-sections uncertainties, provided as a covariance matrix, which are propagated through the reactor system to output of interest pertaining to reactor safety, such as peak temperatures in fuel/clad/coolant. Using a two-step approach, uncertainties are first quantified and propagated from basic input variables (such as reaction cross-sections) to intermediate quantities (such as reactivity feedback coefficients) through lattice level calculations. Uncertainties of intermediate quantities (from the first step) are then propagated through the system transient calculations, in the second step, to obtain uncertainties on reactor safety output parameters of interest. The scope of this work consists of Uncertainty Quantification & Propagation of nuclear data uncertainties that are highly correlated through unprotected transient overpower and unprotected loss of flow to assess their impact on core safety parameters. This two-step approach in the presence of covariance renders the sensitivity analysis very challenging. In fact, usually the sensitivity analysis is restricted to each step, which limits its application since the sensitivities between the system output quantities and the basic input variables are difficult to obtain. Here, in this work, we address this issue by proposing a simple, general methodology to combine the sensitivity indices obtained in each step by assuming the model behavior being linear. For the first step Generalized Perturbation theory based indices are used while in the second step the recently studied Johnson indices. The uncertainty quantification and sensitivity methodologies discussed here are demonstrated on a generic LFR design which is based on the 500 MWth demonstration Lead-cooled fast reactor (DLFR) using oxide fuel, developed by Westinghouse Electric Company (WEC).

42 - ENGINEERING↗
DOE OSTI2024

Insights into the soft brittle-to-ductile transition from discrete dislocation dynamics

The Brittle-to-ductile transition (BDT) in body centered cubic metals exhibits a soft transition wherein the fracture toughness gradually rises to before the onset of ductility. The resultant brittle-to-ductile transition temperature can be described with an Arrhenius relationship whose activation energy is related to plasticity in the material. To provide further insight into the nature of the BDTT, in this work we utilized a discrete dislo- cation dynamics model with a crack to simulate the BDT and how it depends on the thermally activated nature of plasticity. The interrelationship between the BDT activation energy and the dislocation mobility parameters were determined via the calculation of first order sensitivity coefficients. This analysis allows us to demonstrate that the activation energy for the BDT is directly related to the activation energy for plasticity through an effective stress that defines this relationship. This effective stress physically is the average stress on the dislocations that move out of the crack. Lastly, we are able to show that this effective stress is dictated by the low temperature fracture toughness or cleave energy of the material and the source position, the latter of which can be affected by processing. Collectively, these results provide new insight into what controls the thermal activation of the BDT and what are the important parameters to control it.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Transient uncertainty quantification and Global Sensitivity Analysis of the open-source Molten Chloride Reactor Experiment (MCRE) using GP-PCA surrogate models

Uncertainties in the thermophysical properties of molten salts impact both the steady-state and transient behavior of Molten Salt Reactors (MSRs). In this work, we aim to quantify the influence of such uncertainties on the transient operation of the Molten Chloride Reactor Experiment (MCRE), utilizing the open-source specifications provided for this reactor. Seven representative transient scenarios are considered. For each scenario, we evaluate the impact of thermophysical property uncertainties on four key multiphysics model output variables of interest (VoIs): maximum power density, maximum fuel temperature, maximum reflector temperature, and average fuel velocity magnitude. In addition, we perform a Global Sensitivity Analysis (GSA) by computing Sobol’ indices for the uncertain input parameters to determine their contribution to the variability of each VoI. Conducting GSA is computationally intensive due to the large number of required evaluations of the high-fidelity multiphysics model. To mitigate this cost, we develop a surrogate modeling framework that combines Gaussian Process (GP) regression with Principal Component Analysis (PCA), enabling efficient sample generation for the GSA. Our results show that for energy-related VoIs, thermal conductivity is the dominant contributor to uncertainty. In contrast, for flow-related VoIs, density and dynamic viscosity are the primary sources of uncertainty. The specific heat of the fuel salt was found to play a secondary role in the transient analyses.

42 - ENGINEERING↗
DOE OSTI2025

Assessing the Heat Transfer Modeling Capabilities of CFD Software for Involute-Shaped Plate Research Reactors

The ongoing efforts to convert High-Performance Research Reactors (HPRRs) using Highly Enriched Uranium (HEU) to Low-Enriched Uranium (LEU) fuel require reliable thermal–hydraulic assessments of modified core designs. The involute-shaped fuel plates used in several major HPRRs present unique modeling challenges due to their compact core geometries and high heat flux conditions. This study evaluates the capability of three commercial CFD tools, STAR-CCM+, COMSOL, and ANSYS CFX, to predict cladding-to-coolant heat transfer using Reynolds-Averaged Navier–Stokes (RANS) methods within the thermal–hydraulic regimes of involute-shaped plate reactors. Broad sensitivity analysis was conducted across a range of reactor-relevant parameters using two turbulence models (k−ϵ and k−ω SST) and different near-wall treatment strategies. The results were benchmarked against the Sieder–Tate correlation and experimental data from historic studies. The codes produced consistent results, showing good agreement with the empirical correlation of Sieder–Tate and the experimental measurements. The findings support the use of these commercial CFD codes as effective tools for assessing the thermal–hydraulic performance of involute-shaped plate HPRRs and guide future LEU core development.

CFD↗
DOE OSTI2025

Modeling the differential rate for signal interactions in coincidence with noise fluctuations or large rate backgrounds

The characteristic energy of a relic dark matter interaction with a detector scales strongly with the putative dark matter mass. Consequently, experimental search sensitivity at the lightest masses will always come from interactions whose size is similar to noise fluctuations and low energy backgrounds in the detector. In this paper, we correctly calculate the net change in measured differential event rate due to low rate signal interactions that overlap in time with noise and backgrounds, accounting for both periods of time when the signal is coincident with noise/backgrounds and for the decreased amount of time in which only noise/backgrounds occur and we show that the introduction of random simulated signal events into the continuous raw data stream (a form of “salting”) provides a correct and practical implementation to estimate this net linear signal sensitivity. Unfortunately this does not apply to the situation with non negligible pileups as we show through explicit examples. Consequently, this exclusion technique should be complemented by less sensitive techniques that can separately exclude large rate, high pileup signal parameter space. An analysis threshold above the Gaussian-like noise component of the measured differential rate spectrum should also likely produce conservative limits. Though previous light mass dark matter searches did not correctly account for decreased background only live time effects in their signal sensitivity, conservative analysis choices likely protected their published limits from being nonconservative.

Li, Xinran↗
DOE OSTI2025

Aerodynamic Sensitivities over Separable Shape Tensors

Here, we present a comprehensive aerodynamic sensitivity analysis of airfoil parameterization informed by separable shape tensors. This parameterization approach uniquely benefits the design process by isolating various well-studied shape characteristics, such as airfoil thickness, and providing a well-regulated low-dimensional parameter domain for aerodynamic designs. Exploring the aerodynamic sensitivities of this novel parameterization can provide valuable insights for more robust designs and future manufacturing efforts. We construct a data-driven parameter space of airfoils using principal geodesic analysis of separable shape tensors informed by a curated database containing almost 20,000 suitable engineering airfoils. Analyzing the shape reconstruction error and the maximum mean discrepancy between joint distributions of aerodynamic quantities, we study the dimensionality of the learned parameter space. This simple numerical experiment demonstrates a dramatic dimension reduction that retains design effectiveness and promotes regularity of the shape representations. Finally, we generate new airfoils and use the HAM2D Reynolds-averaged Navier–Stokes solver to predict lift, drag, and moment coefficients. We compute multiple sensitivity metrics to quantify and assert the consistency of parameter influence on the aerodynamic quantities. We also explore low-dimensional polynomial ridge approximations to motivate physical intuitions and offer explanations of the approximated sensitivities.

17 WIND ENERGY↗
DOE OSTI2025

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Revisiting a minimally destructive analytic approach for determining electrochemical kinetic parameters: Measuring aluminum corrosion across a wide pH range based on the Butler-Volmer equation

Here, this study revisits the three-point sampling of the simplified Butler-Volmer equation to address the limitations of strong potentiodynamic polarization, which can introduce irreversible damage and uncertainty in corrosion analysis. The method extracts electrochemical kinetic parameters while minimizing polarization effects, evaluates noise sensitivity relative to overpotential, and accounts for errors from signal noise, OCP drift, ohmic resistance, and mass-transfer constraints. Verified against the Tafel extrapolation method for aluminum corrosion across a wide pH range, this low-polarization approach enables accurate evaluations with specific error estimates, offering a robust alternative to linear polarization resistance methods that assume constant Tafel slopes.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Energy, greenhouse gas, and water life cycle analysis of synthetic graphite anode production in the United States

This study presents a comprehensive life cycle analysis of potential synthetic graphite battery anode material (BAM) production in the U.S. based on industrial-scale data. The analysis focuses on three impacts: greenhouse gas (GHG) emissions, total energy use, and water consumption. We also conducted sensitivity analyses to evaluate the effect of variation in process parameters and energy sources used for synthetic graphite BAM production on its life cycle GHG emissions. A detailed supply chain analysis of graphite BAM in the U.S. was also undertaken, along with a study of its associated GHG emissions. The results show GHG emissions of 29.7 kg CO 2 -eq. per kg BAM, total energy use of 580 MJ kg −1 BAM, and water consumption of 121 L kg −1 BAM for the baseline condition. The graphitization step is a major process hotspot, contributing to over 74% of all impacts. This is attributed to the energy and material input requirements for this step, particularly through the use of crucibles. Across the entire synthetic graphite production process, electricity is the primary contributor, followed by crucibles used in graphite block production, and then calcined petroleum coke. Sensitivity analyses indicate that improvement in micronization yield, reuse of crucibles, and use of low-carbon nuclear energy can significantly reduce GHG emissions of potential domestic graphite production (by ∼70%). Supply chain analysis identified major graphite BAM sources in the U.S. and showed that the U.S. has a competitive advantage in domestic production of synthetic graphite BAM in terms of reduced life cycle GHG emissions compared to present-day imported sources (by ∼20%).

Battery anode↗
DOE OSTI2024

Comprehensive review of combustion ion chromatography for the analysis of total, adsorbable, and extractable organic fluorine

Poly‐ and perfluoroalkyl substances (PFAS) are a class of persistent organic pollutants whose high stability and appreciable water solubility have led to near‐global contamination. PFAS are bioaccumulative toxins that have been linked to a myriad of disorders and have been detected nearly universally in human blood. Liquid chromatography‐tandem mass spectrometry is the most frequent method used for quantitation, though this typically only measures a few dozen of the >14 000 known PFAS and has been shown to account for a small portion of the total organic fluorine present. Sum parameter methods such as total, extractable, and adsorbable organic fluorine have emerged as alternative measurements for PFAS determination. Combustion ion chromatography has become the preferred method for organofluorine measurement where the sorbent or extract containing PFAS is combusted and the emitted hydrofluoric acid (HF) is a measure of the cumulative organofluorine present. Herein we critically review the types of organofluorine measurement, their separation from the sample matrix, and key parameters of the analytical instrument that affect sensitivity, reproducibility, and recovery with regards to PFAS analysis.

Chemistry↗
DOE OSTI2025

Establishing model credibility for process-microstructure-property relationships in additive manufacturing using exascale computing

Additive Manufacturing (AM) of alloys holds significant promise as a disruptive technology in various industries, yet its adoption is often hindered by challenges in achieving consistent part quality. These issues are primarily due to the complex process-microstructure-property (PSP) relationships inherent to AM. Computational models can greatly aid in understanding these relationships, but their widespread impact and adoption has been limited by a lack of validated, open-source, and computationally efficient PSP modeling frameworks and hardware limitations. Here, this study leverages the ExaAM software suite and data from the AMBench-2018 series of laser powder bed fusion (LPBF) benchmark experiments to perform a comprehensive model assessment, including verification, validation, sensitivity analysis, and uncertainty quantification. The RADICAL-EnTK workflow manager was used to perform an ensemble of heat transport, solidification, and mechanical response simulations on the exascale computer Frontier, considering uncertainties in critical model inputs such as laser spot size and nucleation parameters, and consisting of 125 explicit grain structure simulations and 7875 crystal plasticity simulations. For a selected location within the Inconel 625 AMBench-2018 test artifact, sensitivity analysis and uncertainty quantification were performed using the predicted distributions of grain structure and mechanical properties. Qualitative agreement was found between the predicted grain size and texture and the observed AMBench-2018 microstructure, the mean predicted yield stress was within 5% of the experimental measurement mean, and the mean predicted engineering stress at 5% strain was within 10% of the experimental measurement mean. The insights gained from development and validation of the ExaAM PSP modeling framework will help guide future directions for enhancing the credibility and reliability of PSP models in AM, thereby accelerating the adoption of AM technologies in various industries.

Additive manufacturing↗
DOE OSTI2025

Steam generator model design parameter sensitivity study for small modular reactor system

Here, this study focuses on design parameter sensitivity studies pertaining to several Once-Through Steam Generator (OTSG) model cases both with and without a riser using python and advanced risk assessment and optimization tool, i.e. Risk Analysis Virtual Environment (RAVEN) developed at Idaho National Laboratory (INL), to support a Small Modular Reactor (SMR) system. The presented Steam Generator (SG) python-based model is a mathematical representation of a steam-generating unit for a Pressurized Water Reactor (PWR)-type SMR system, including fluid flow and heat transfer equations, models, and correlations. Design studies involve changing the model’s input design parameters (e.g., temperature, pressure, mass flow rate) to observe the resulting effects on the output of the system, such as the Heat Transfer Coefficient (HTC), Reynolds number, Nusselt number, and heat transfer performance. Sensitivity studies analyze the degree to which system output and/or desired parameters (e.g., HTC or heat transfer performance) are sensitive to changes in the input parameters. By using RAVEN, detailed design parametric sensitivity studies. Six input parameters—namely, the pressure, temperature, and mass flow rate for the inlet of the primary-side (hot fluid) and secondary-side (cold fluid) of the SG—were randomly perturbed via RAVEN’s Monte Carlo Sampler module, using uniform distributions (i.e., ±1%, ±5% and ±10 % relative changes) for 600 samples. The analysis results give valuable insights into SG system performance, and provide justification for further research and development such as optimized sensor placement, design verification, validation, and optimization.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Sensitivity analysis of thermal contact conductance modeling to inform MiniFuel irradiation capsule designs

The MiniFuel irradiation platform has been developed by Oak Ridge National Laboratory as a flexible, high-throughput separate effects testing capability within the High Flux Isotope Reactor (HFIR). Finite element thermal models are relied upon to design MiniFuel experiments to achieve a specific time-averaged irradiation temperature for experimental objectives. A previous study identified that uncertainty in the component heat generation rates and thermal contact conductance (TCC) model are the most significant contributors to predicted fuel temperature variance. To address both sources of uncertainty, this work performs sensitivity analysis on the TCC model to identify high-impact, high-uncertainty parameters that contribute to fuel temperature variance. The TCC model is analyzed in increasing detail, first using a standalone Python code, then again after coupling Python to the BISON fuel performance code. Furthermore, the parameters with the largest contributions to fuel temperature variance which can be reduced through design changes are identified as the initial subcapsule gas pressure, contact pressure between the fuel and dish, and the effective surface roughness of the interface. A set of design recommendations for future capsule designs has been established and applied to reduce the previously quantified average fuel temperature uncertainty ranges of ± 40 °C in the HFIR vertical experiment facilities (VXF) and ± 80 °C in the removable beryllium (RB) reflector to approximately ± 32 °C and ± 53 °C, respectively. This equates to a 21 % and 33 % reduction in the uncertainty range of the average fuel temperature for VXF and RB, respectively.

BISON↗
DOE OSTI2025

Understanding latent timescales in neural ordinary differential equation models of advection-dominated dynamical systems

The neural ordinary differential equation (ODE) framework has shown considerable promise in recent years in developing highly accelerated surrogate models for complex physical systems characterized by partial differential equations (PDEs). For PDE-based systems, state-of-the-art neural ODE strategies leverage a two-step procedure to achieve this acceleration: a nonlinear dimensionality reduction step provided by an autoencoder, and a time integration step provided by a neural-network based model for the resultant latent space dynamics (the neural ODE). This work explores the applicability of such autoencoder-based neural ODE strategies for PDEs in which advection terms play a critical role. More specifically, alongside predictive demonstrations, physical insight into the sources of model acceleration (i.e., how the neural ODE achieves its acceleration) is the scope of the current study. Such investigations are performed by quantifying the effects of both autoencoder and neural ODE components on latent system time-scales using eigenvalue analysis of dynamical system Jacobians. To this end, the sensitivity of various critical training parameters – de-coupled versus end-to-end training, latent space dimensionality, and the role of training trajectory length, for example – to both model accuracy and the discovered latent system timescales is quantified. Furthermore, this work specifically uncovers the key role played by the training trajectory length (the number of rollout steps in the loss function during training) on the latent system timescales: larger trajectory lengths correlate with an increase in limiting neural ODE time-scales, and optimal neural ODEs are found to recover the largest time-scales of the full-order (ground-truth) system. Demonstrations are performed across fundamentally different unsteady fluid dynamics configurations influenced by advection: (1) the Kuramoto–Sivashinsky equations (2) Hydrogen-Air channel detonations (the compressible reacting Navier–Stokes equations with detailed chemistry), and (3) 2D Atmospheric flow.

Advection-dominated dynamical systems↗
DOE OSTI2026

Techno-Economic Analysis of Repurposing Natural Gas Transmission Pipeline Networks to Accommodate Hydrogen Blends

Blending hydrogen into natural gas infrastructure could supplement natural gas supply and increase resilience for applications such as ammonia production, peaking and load-following power plants, and heating. The United States has an extensive network of natural gas pipelines, but the feasibility of employing this infrastructure to transport hydrogen is unclear. We analyze the costs associated with repurposing three distinct natural gas transmission pipelines in different locations within the United States to carry blends of hydrogen up to 100% via three different pipeline network modification methods and compare against the cost of building a new dedicated hydrogen pipeline. We conduct a sensitivity analysis on the hoop stress limit of the existing pipe, techno-economic parameters, emissions, and relative capacity. The results show that the capital costs required to upgrade a pipeline can vary from tens of millions to billions of dollars depending on the length and capacity of the existing pipeline section, whether the existing pipeline already operates at or below its maximum allowable operating pressure, whether future demand is expected to increase or decrease, the network modification method selected, and pipe material costs. The delivered cost of energy to end users is impacted less by the levelized cost of transporting hydrogen blends than by the cost of the natural gas and hydrogen fuels being transported. The emissions impact of blending hydrogen into natural gas transmission networks scales proportionally with the amount of energy displaced with low-emission hydrogen (such as from natural gas with carbon capture and sequestration or electrolysis powered by nuclear, renewable, or geothermal electricity), therefore low blend ratios (e.g., < 20% vol. hydrogen) will result in low emissions impacts. Factors such as permitting and right-of-way costs, the proximity of the pipeline to hydrogen demand and production, and the compatibility of and/or retrofitting costs of end-use gas-fueled technologies will likely be greater drivers in determining whether converting a particular natural gas pipeline to carry hydrogen makes economic sense.

08 HYDROGEN↗
DOE OSTI2025

VARI3D & PERSENT: Perturbation and Sensitivity Analysis

The nodal diffusion method is one of the most widely used approaches in modern reactor analysis. In the nodal diffusion method, a coarse multi-group set of “homogenized” parameters is constructed such that the complex geometry of a reactor core along with the energy dependence of neutron and gamma ray cross sections in a nuclear reactor are conserved in the simpler geometry. The homogenization is typically done on a fuel assembly level as is the case in the DIF3D code developed at Argonne National Laboratory. The nodal methodology is used primarily to predict fuel cycle behavior of nuclear systems of which there is a substantial amount of validation in the literature. Another use of the nodal method is to obtain reactivity coefficients and kinetics parameters for use in a safety analysis of a given nuclear reactor. While there are many ways to obtain reactivity worth and kinetics parameters, the work presented in this manuscript is unique as it provides the user with the ability to compute reactivity worths, kinetics parameters, and cross section sensitivities with a Cartesian and hexagonal geometry based transport code. This manuscript serves as a single manual for two separate codes: VARI3D and PERSENT. The VARI3D code (VARIational 3D) is based upon the classic finite difference diffusion theory solver available in DIF3D. The PERSENT code (PERturbation and SENitivity for Transport) is based upon the variational nodal method employed in DIF3D termed VARIANT. The VARIANT solver was added to DIF3D in 1995 and has seen continued development and use for the last 18 years. Because VARI3D primarily uses deprecated coding practices, rather than incorporating the perturbation and sensitivity treatments for transport within VARI3D, a new coding development was built using modern Fortran coding. The primary purpose of this manual is to describe the theory behind PERSENT (and by convenience, that of VARI3D) and discuss the input and output of PERSENT along with giving potential users an idea of how to use it. While this manuscript does describe the input and output of VARI3D, the PERSENT code is intended to be the replacement capability of VARI3D as PERSENT can generate nearly identical (if not superior) diffusion theory results. In this manuscript, the relevant aspects of generalized perturbation theory and exact perturbation theory that apply to both VARI3D and PERSENT are covered. The input and output of VARI3D is displayed by excerpting several of the example problems. Similarly, the input and output of PERSENT is displayed along with tips on how best to use the code. Note that the input and output of the inhomogeneous solver wrapped around DIF3D (DIF3D_IFS) is also discussed as it is needed to carry out some of the sensitivities in PERSENT such as reaction rate ratios. This manuscript describes several perturbation and sensitivity problems, and the results computed using PERSENT. From these sections, potential users should find that PERSENT provides not only the typical tables of numbers desired in perturbation and sensitivity analysis work, but also can visually plot the result for a more thorough understanding of the space and energy distribution (Section 5). Overall, PERSENT is observed to produce accurate reactivity worths and sensitivities for the displayed set of test problems and clearly demonstrates the need to have a transport-based sensitivity capability as evident from the thousands of percent errors observed in the 21-group hexagonal fast reactor problem (covered in Section 7). The uncertainty calculation capability is described in Section 3 and demonstrated in Section 7.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Sensitivity analysis of a parameterization of coagulation in an aqueous transport model

A three-dimensional aqueous transport model, ALGE, was developed at the Savannah River National Laboratory (SRNL) as a tool for emergency response. Recently, coagulation and break-up of sediment and particulate (contaminant adhered to sediment) matter has been added as a new model capability, representing both processes as functions of salinity and turbulence. A sensitivity analysis was performed by comparing time series of sediment and particulate concentrations at various locations when the model’s parameters (particle size and density) are altered. The results show significant differences between experiments in both freshwater and saltwater systems parameters vary (P-values < 0.05). From this sensitivity study, we have concluded the importance of incorporating both salinity and turbulent effects, as they have a large role in the physical process of coagulation and breakup of sediment. By accounting for these physical processes, we have made the ALGE model a more robust tool for emergency response.

Aqueous fate and transport↗
DOE OSTI2025

Are light curve classification metrics good proxies for SN Ia cosmological constraining power?

Context. When selecting a light curve classifier for use as part of a photometric supernova Ia (SN Ia) cosmological analysis, it is common to make decisions based on metrics of classification performance, such as the contamination within the photometrically classified SN Ia sample, rather than a measure of cosmological constraining power. If the former is an appropriate proxy for the latter, this practice would eliminate the computational expense of a full cosmology forecast in the analysis pipeline design process. Aims. This study tests the assumption that light curve classification metrics are an appropriate proxy for cosmology metrics. Methods. We emulated photometric SN Ia cosmology light curve samples with controlled contamination rates of individual contaminant classes and evaluated each of them under a set of classification metrics. We then derived cosmological parameter constraints from all samples under two common analysis approaches and quantified the impact of contamination by each contaminant class on the resulting cosmological parameter estimates. Results. We observe that cosmology metrics are sensitive to both the contamination rate and the class of the contaminating population, whereas the classification metrics are shown to be insensitive to the latter. Conclusions. Based on these findings, we discourage any exclusive reliance on light curve classification-based metrics for analysis design decisions, which (counterintuitively) include but are not limited to the classifier choice. Instead, we recommend optimising science analysis pipeline design choices using a metric of the information gained about the physical parameters of interest.

79 ASTRONOMY AND ASTROPHYSICS↗