Search NASA⌕ Search

SEARCH · Search NASA

Results for “science metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Hemispherically symmetric strategies for stratospheric aerosol injection

Stratospheric aerosol injection (SAI) comes with a wide range of possible design choices, such as the location and timing of the injection. Different stratospheric aerosol injection strategies can yield different climate responses; therefore, understanding the range of possible climate outcomes is crucial to making informed future decisions on SAI, along with the consideration of other factors. Yet, to date, there has been no systematic exploration of a broad range of SAI strategies. This limits the ability to determine which effects are robust across different strategies and which depend on specific injection choices. This study systematically explores how the choice of SAI strategy affects climate responses in one climate model. Here, we introduce four hemispherically symmetric injection strategies, all of which are designed to maintain the same global mean surface temperature: an annual injection at the Equator (EQ), an annual injection of equal amounts of SO 2 at 15° N and 15° S (15N+15S), an annual injection of equal amounts of SO 2 at 30° N and 30° S (30N+30S), and a polar injection strategy that injects equal amounts of SO 2 at 60° N and 60° S only during spring in each hemisphere (60N+60S). We compare these four hemispherically symmetric SAI strategies with a more complex injection strategy that injects different quantities of SO 2 at 30° N, 15° N, 15° S, and 30° S in order to maintain not only the global mean surface temperature but also its large-scale horizontal gradients. All five strategies are simulated using version 2 of the Community Earth System Model with the middle atmosphere version of the Whole Atmosphere Community Climate model, version 6, as the atmospheric component, CESM2(WACCM6-MA), with the global warming scenario, Shared Socioeconomic Pathway (SSP)2-4.5. We find that the choice of SAI strategy affects the spatial distribution of aerosol optical depths, injection efficiency, and various surface climate responses. In addition, injecting in the subtropics produces more global cooling per unit injection, with the EQ and the 60N+60S cases requiring, respectively, 59 % and 50 % more injection than the 30N+30S case to meet the same global mean temperature target. Injecting at higher latitudes results in larger Equator-to-pole temperature gradients. While all five strategies restore Arctic September sea ice, the high-latitude injection strategy is more effective due to the SAI-induced cooling occurring preferentially at higher latitudes. These results suggest trade-offs wherein different strategies appear better or worse, depending on which metrics are deemed important.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Multi-scale Multi-physics Scientific Machine Learning for Water Cycle Extreme Events Identification, Labelling, Representation, and Characterization

Impacts of climate are usually felt through extreme events such as droughts, floods, thunderstorms, windstorms, wildfires, and so on, that are intimately tied to the water cycle. Predicting the frequency and severity of extreme events under climate change remains a significant challenge; meanwhile, the mechanisms and impacts of these extremes are far from well understood. There are several major science challenges: (1) Lack of labelled extreme events data and missing standards in defining extremes; (2) Computational demand of high-resolution ensemble climate modeling; (3) Modeling the multiscale multi-physics hierarchical structure of compound extremes; (4) Lack of understanding of mechanisms of extreme events; (5) Large uncertainty in extreme events impacts on infrastructure; (6) Subjective assessment of weather-related risk from seasonal to multi-decadal time scales and lack of metrics for risk assessment and mitigation control.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Intracardiac Electrical Imaging using the 12-lead ECG: A Machine Learning Approach using Synthetic Data

Current state-of-the-art techniques for non-invasive imaging of cardiac electrical phenomena require voltage recordings from dozens of different torso locations and anatomical models built from expensive medical diagnostic imaging procedures. Here this study aimed to assess if recent machine learning advances could alternatively reconstruct electroanatomical maps at clinically relevant resolutions using only the standard 12-lead electrocardiogram (ECG) as input. To that end, a computational study was conducted to generate a dataset of over 16000 detailed cardiac simulations, which was then used to train neural network (NN) architectures designed to exploit both spatial and temporal correlations in the ECG signal. Analysis over a validation set showed average errors in activation map reconstruction below 1.7 msec over 75 intracardiac locations. Furthermore, phenotypical patterns of activation and the morphology of the activation potential were correctly reconstructed. The approach offers opportunities to stratify patients non-invasively, both retrospectively and prospectively, using metrics otherwise only available through invasive clinical procedures.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Aligned FTICR-MS, Respiration, and Biochemical Transformation Data from Columbia River Sediment Incubations Associated with: “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism”

Columbia River hyporheic zone sediments from the Hanford Site 300 Area in eastern Washington were incubated in a full factorial design with different organic matter (OM) amendments. The aim of the experiment was to test the influence of OM thermodynamics on aerobic respiration across different organic carbon pools and concentrations. This dataset is comprised of (1) a csv with high resolution characterization of dissolved organic matter via 12 Tesla Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) analyzed through the Environmental Molecular Sciences Laboratory (EMSL; https://www.pnnl.gov/environmental-molecular-sciences-laboratory), (2) a csv with sample IDs, replicates, amendments, dissolved oxygen (DO) measurements, and sampling time points, (3) a csv with sample IDs, replicates, respiration rates, FTICR summary metrics, and relative abundance of chemical classes; and (4) a csv with the number of chemical transformations in each sample replicate (microcosm). The data are associated with the publication “Carbon Limitation Leads to Thermodynamic Regulation of Aerobic Metabolism” published in ES&T Letters (Garayburu-Caruso et al., 2020). Please use the data package’s DOI to cite the data package. We ask that you acknowledge the U.S. Department of Energy (DOE) Biological and Environmental Research (BER) Subsurface Biogeochemical Research (SBR) program when using the data. All data are free to be used for any purpose, such as for manuscripts, presentations, and grant proposals. There is no obligation to include data package authors as co-authors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

MPEX AI Digital Twins

All magnetically confined plasma fusion power plant concepts (Tokamak, Spherical Tokamak, Stellarator, Mirror, ...) must exhaust the heat and plasma from the core confinement region to the material walls. The primary channel for this exhaust is through a plasma divertor which directs plasma along open magnetic field lines to a material target. The Material Plasma Exposure eXperiment (MPEX) illustrated in Figure 1, is a high-power, steady-state linear plasma device designed to produce the plasma material interaction (PMI) conditions of the divertor of future magnetic confinement fusion power plants: energy flux 20MW/m 2 , ion fluence 1031/m 2 , pulse duration 106 sec. These goals of plasma exposure in MPEX are well beyond those achieved in magnetic fusion experimental devices. Successfully achieving these high power steady state conditions for long pulses requires operational control of the heating and particle sources and the plasma flux to the walls and target. The MPEX AI Hot Spot Controller, proposed in this project, will help achieve the operational milestones of MPEX. The MPEX device will begin commissioning at the end of FY26. A smaller proto-MPEX was operated for 14,666 plasma discharges and will resume operation in September of 2025 as proto-MPEX-lite, with reduced capability, to test a new window for the Helicon plasma source. The proto-MPEX data has undergone surrogate modeling with machine learning methods (R. Archibald, 2022 IEEE International Conference on Big Data). This proto-MPEX data will be used to begin development of the AI digital twins described in this white paper. The scientific mission of MPEX is to qualify materials of different composition for use in the high energy and plasma flux conditions of a fusion power plant. The materials exposed in MPEX will in some cases be exposed to high neutron fluxes at other ORNL facilities to measure the changes to their PMI properties. The targets exposed in MPEX will be transported under vacuum to a Surface Analysis Station (SAS). The SAS will be equipped with the following diagnostics: Focused Ion Beam (FIB) for trench milling, 100-400 angstrom resolution scanning electron microscope (SEM), surface mapping x-ray spectrometer, high resolution camera, and a future upgrade to a laser induced breakdown spectroscopy quadruple mass spectrometer (LIBS-QMS). The MPEX experiments will generate diverse pre- and post-exposure measurement data of detailed material properties down to the crystal grain level in 3D for post-exposure assessment of PMI damage (e.g. cracking, melting, erosion and redeposition of the material). Physics models for the PMI, and how the material composition and manufacturing impact its performance under high energy plasma exposure, need to be validated with MPEX data to guide the selection of new candidate materials. Our vision for the MPEX AI Digital Twins project is to supply experimental and physics model simulation data to train Artificial Intelligence (AI) models for data processing, analysis, operational control, PMI and materials simulation to maximize the scientific output of the MPEX device. Ultimately, an AI digital twin of MPEX material assessment metrics for tested and synthetic material types with simulated PMI will be trained by the AI Modeling Teams on the experimental and physics simulation data submitted to the American Science Cloud by this project. A purely empirical search for the best material is inefficient given the finite number of samples that can be tested on MPEX. In order to expand the material properties database for training the MPEX Material Assessment AI Digital Twin, and to gain physics understanding of the PMI processes, physics models of the material properties and PMI processes are required. The physics simulations provide detailed simulation data, like impact angles for plasma ions, sputtering yields, transport of the ionized sputtered target material in the plasma, and redeposition locations. This simulation data expands the measurement data for deeper physics understanding. The experimental data is essential to validate the PMI and material structure simulation models. The validated models can then be used to generate new simulation data of MPEX material assessments for synthetic material compositions that have not been exposed in MPEX. These predictive simulations, plus the whole experimental dataset, will be used to train the MPEX Material Assessment AI Digital Twin allowing a rapid generative AI search for new materials with reduced PMI damage by interpolating the domain of the training set. These new optimum materials can be simulated with the physics codes and/or tested in MPEX. The ability of AI neural networks to interpolate multi-dimensional parameter spaces and generate virtual data is exploited for a more efficient search for optimum materials. The advent of the Transformational AI Models Consortium (TAIMC) is an opportunity to engage with state of the art private and public AI developers to achieve the goals of the AI digital twins and AI accelerated physics models proposed in this project. Our partners at ORNL from the Advance Scientific Computing Research (ASCR) organization will collaborate in accelerating the integrated plasma material interaction simulation framework. This simulation framework will provide a platform for generating simulation data across a range of physical fidelities, including hybrid methods that produce multi-fidelity results. This data will be leveraged for AI model development, both for generation of surrogates and the automation of simulation campaigns. A part of the research below will include collaborative efforts with the TAIMC to (i) adapt data storage approaches to ensure AI-readiness, (ii) provide a protypical exemplar to inform and exercise constructed workflows, and (iii) generate and share data, using the TAIMC unified AI data standard, for foundational models that will be trained from multiple sources across the DOE complex. We will also collaborate with the TAIMC, as well as the planned AI modeling teams, to develop approaches for reducing the cost of data generation. These include tailored multi-fidelity approaches as well as fine-tuning strategies to augment general, large-scale foundational models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

The Impact of Observing Strategy on Cosmological Constraints with LSST

The generation-defining Vera C. Rubin Observatory will make state-of-the-art measurements of both the static and transient universe through its Legacy Survey for Space and Time (LSST). With such capabilities, it is immensely challenging to optimize the LSST observing strategy across the survey's wide range of science drivers. Many aspects of the LSST observing strategy relevant to the LSST Dark Energy Science Collaboration, such as survey footprint definition, single-visit exposure time, and the cadence of repeat visits in different filters, are yet to be finalized. Here, we present metrics used to assess the impact of observing strategy on the cosmological probes considered most sensitive to survey design; these are large-scale structure, weak lensing, type Ia supernovae, kilonovae, and strong lens systems (as well as photometric redshifts, which enable many of these probes). We evaluate these metrics for over 100 different simulated potential survey designs. Our results show that multiple observing strategy decisions can profoundly impact cosmological constraints with LSST; these include adjusting the survey footprint, ensuring repeat nightly visits are taken in different filters, and enforcing regular cadence. We provide public code for our metrics, which makes them readily available for evaluating further modifications to the survey design. We conclude with a set of recommendations and highlight observing strategy factors that require further research.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Landscape composition and configuration have scale-dependent effects on agricultural pest suppression

Increasing landscape heterogeneity (composition and configuration) can enhance natural enemy populations and support pest suppression in agricultural landscapes. Using a network-based data mining approach, we examined independent gradients of landscape composition and configuration at six spatial scales that were associated with pest suppression services measured at 32 sites in Michigan and Wisconsin, USA. We compared the relative effects of landscape composition and configuration across scales with those of local crop type (corn or grassland). We found that multiple gradients of configurational heterogeneity were independent of composition and strongly associated with pest suppression, with different configuration metrics being predictive of pest suppression depending on the spatial scales and regions considered. Landscapes that were more configurationally heterogeneous at smaller spatial scales consistently supported higher pest suppression. In Michigan, pest suppression increased in landscapes with high edge contrast between annual crops and surrounding habitats and high edge density of grassland within 250-500 m radii. In Wisconsin, pest suppression increased with large core area of grassland and high field density within a 250 m radius. The main compositional effect we found was a positive relationship between grassland cover and pest suppression occurring at larger spatial scales (1000-1500 m) and occurring in Wisconsin but not in Michigan. Our findings demonstrate that effects of landscape composition and configuration on pest suppression differ across spatial scales and vary regionally. The network-based data mining techniques used here could be useful for disentangling intercorrelated landscape metrics in a variety of other contexts in landscape ecology.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Dynamics of virtual water networks: Role of national socio-economic indicators across the world

Intensified water usage due to rapid industrialization is often dictated by economic policies based on monetary growth rather than sustainable use of environmental resources. In addition, interdependence within economic sectors further interweaves water usage through product transactions, which further makes it difficult to quantify the dynamics of hydro-economic systems at regional, national and global scale. In this study, we investigated the dynamics of domestic virtual water networks (VWN) of 189 countries based on concept of information theory by quantifying network metrics that describes VWN flow capacity, robustness, efficiency and flexibility. These networks represent virtual water interconnected through economic sectors within a specified country built based on environmentally extended multi region input output (EE-MRIO) approach. We further estimated trends associated with network metrics, as well as coupling intensity between metrics with respect to socio-economic indicators, such as, population, Gross Domestic Product (GDP) and Gross National Income (GNI). It was observed that capacity and flexibility of VWNs are strongly and positively correlated indicating that a high capacity VWN can be more flexible. Our results also indicate that, in general a higher percentage of developing countries (i.e. both least developing and developing nations) have exhibited increasing trends in capacity, robustness, efficiency and flexibility of VWN compared to developed nations. It was revealed that the dynamics of VWNs are positively coupled with socio-economic growth for few countries, which indicates the sustainable behavior of VWN with socio-economic growth. Our results argue that the information theory-based metrics by embedding water footprints can holistically capture sustainability aspect of the VWN dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Drivers of Future Physical Water Scarcity and Its Economic Impacts in Latin America and the Caribbean

Future water scarcity is a global concern with significant impacts on the energy, water, and land (EWL) sectors. Countries in Latin America and the Caribbean (LAC) are significant producers of agricultural goods consumed around the world, so disruptions resulting from land and water scarcity in LAC are a source of global supply chain risk. Understanding where water scarcity in LAC could occur and what could drive that scarcity to emerge is critical for strategic resource management and planning, both regionally and globally. Assessing future water scarcity impacts in LAC is challenging given the multisector dynamic interactions among the EWL sectors and the multiple uncertainties acting across different spatial scales. We use scenario discovery to explore the drivers of future water scarcity, considering assumptions related to climate, socioeconomics, and the EWL sectors. Understanding what factors drive uncertainty across outcomes can help stakeholders in targeting long-term solutions and future data collection efforts. To illuminate these dynamics, we use a database consisting of a large ensemble of scenarios representing diverse worlds simulated using the Global Change Analysis Model. We quantify future water scarcity and its economic impacts across the scenarios using three metrics: (1) physical water scarcity, (2) water price, and (3) crop profit. We find that physical water scarcity and water price are driven primarily by reservoir storage capacity assumptions, highlighting the importance of strategic water infrastructure development in maintaining future water availability and accessibility. Crop profit is driven by a combination of water supply and demand assumptions, which emphasizes the complex nature of EWL multisector dynamics. While most of LAC is poised to have abundant land and water resources available for development, water basins in Mexico and along the Pacific coast of South America experience high levels of severity and uncertainty across the future scenarios for at least one of the metrics. We find that the drivers of extreme scarcity vary spatially and across the metrics, further highlighting the heterogeneity of the region and the importance of considering multiple metrics to assess water scarcity vulnerability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A Pseudoreversible Normalizing Flow for Stochastic Dynamical Systems with Various Initial Distributions

Here, we present a pseudoreversible normalizing flow method for efficiently generating samples of the state of a stochastic differential equation (SDE) with various initial distributions. The primary objective is to construct an accurate and efficient sampler that can be used as a surrogate model for computationally expensive numerical integration of SDEs, such as those employed in particle simulation. After training, the normalizing flow model can directly generate samples of the SDE’s final state without simulating trajectories. The existing normalizing flow model for SDEs depends on the initial distribution, meaning the model needs to be retrained when the initial distribution changes. The main novelty of our normalizing flow model is that it can learn the conditional distribution of the state, i.e., the distribution of the final state conditional on any initial state, such that the model only needs to be trained once and the trained model can be used to handle various initial distributions. This feature can provide a significant computational saving in studies of how the final state varies with the initial distribution. Additionally, we propose to use a pseudoreversible network architecture to define the normalizing flow model, which has sufficient expressive power and training efficiency for a variety of SDEs in science and engineering, e.g., in particle physics. We provide a rigorous convergence analysis of the pseudoreversible normalizing flow model to the target probability density function in the Kullback–Leibler divergence metric. Numerical experiments are provided to demonstrate the effectiveness of the proposed normalizing flow model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

RivGraph: Automatic extraction and analysis of river and delta channel network topology

River networks sustain life and landscapes by carrying and distributing water, sediment, and nutrients throughout ecosystems and communities. At the largest scale, river networks drain continents through tree-like tributary networks. At typically smaller scales, river deltas and braided rivers form loopy, complex distributary river networks via avulsions and bifurcations.In order to model flows through these networks or analyze network structure, the topology, or connectivity, of the network must be resolved. Additionally, morphologic properties of each river channel as well as the direction of flow through the channel inform how fluxes travel through the network’s channels. Riv Graphis a Python package that automates the extraction and characterization of river channel networks from a user-provided binary image, or mask, of a channel network (Fig. 1). Masks may be derived from (typically remotely-sensed) imagery, simulations, or even hand-drawn. RivGraph will create explicit representations of the channel network by resolving river centerlines as links, and junctions as nodes. Flow directions are solved for each link of the network without using auxiliary data, e.g., a digital elevation model (DEM). Morphologic properties are computed as well, including link lengths, widths, sinuosities, branching angles,and braiding indices. If provided,RivGraph will preserve georeferencing information of the mask and will export results as ESRI shapefiles, GeoJSONs, and GeoTIFFs for easy import into GIS software.RivGraph can also return extracted networks as networkx objects for convenient interfacing with the full-featured networkx package (Hagberg et al., 2008). Finally, RivGraph offers a suite of topologic metrics that were specifically designed for river channel network analysis (Tejedor et al., 2015b).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An Assessment of Evaluation Practices of Low- And Moderate-Income Solar Programs

As concerns about social equity and clean energy rise, state and local governments, utilities, and non-profit organizations are offering at least 41 active programs in 21 states to promote solar adoption as a way to reduce energy bills for low- and moderate-income (LMI) households while meeting other policy goals such as job creation and clean energy generation. A new study from Berkeley Lab looks at how those programs are being evaluated. The report provides background on how they seek to address LMI household energy burdens and gives a brief discussion of the art and science of program evaluation, drawn from decades of experience in energy efficiency programs. It then turns to how LMI solar programs are currently being evaluated, highlighting trends among evaluation methods, metrics tracked, and best practices employed. A few programs are explored in more depth to illustrate notable practices that could be applied to other program evaluations. These LMI solar programs are mostly young, operate on tight budgets, and vary considerably in their design and stated goals. Consequently, well-designed program evaluation is critical to better understand what works, what could be improved, and how to maximize program impacts under budget constraints.

14 SOLAR ENERGY↗
DOE OSTI2023

LANL HPC Data Center Monitoring: Summer 2023 Talk [Slides]

Data Center Monitoring is the understanding of everything that happens in the Data Center. Our Ultimate (and probably unreachable) Goal is a holistic view of the Data Center and an understanding of how everything is correlated. We get to that Understanding by collecting logs and metrics, analyzing data, displaying information for customers, and staying alert on events.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Ultimate FY23 Vacuum Creep Testing Facility Operation Report

This facility operation report covers the refurbishment and initial testing of a vacuum creep frame used to conduct 1300°C tensile and creep tests on Mo- and Nb-based alloys. The report details the refurbishment of the frame and initial operation including 100 h creep experiments compared to similar tests in argon. Unlike the 25 mm dogbone specimens tested in argon, the vacuum load train requires 76 mm dog bone specimens. Testing in vacuum has eliminated concern of O embrittlement in argon and Nb alloy CB103 showed >120% tensile elongation at 1300°C and 1450°C. Also, a window in the vacuum chamber allows the use of digital image correlation (DIC) to measure strain rather than the load train displacement used in the argon frames. Comparison of the displacement and DIC results in the vacuum frame showed significant variation in primary creep deformation, likely due to the machine compliance, but similar secondary creep rates. Recently, ULTIMATE teams have submitted specimens for testing in vacuum. With the relatively low volume of creep testing, the facility performance metric of testing within 4 weeks of receiving specimens has been met.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Development of a Comparison Framework for Evaluating Environmental Contours of Extreme Sea States

Environmental contours of extreme sea states are often utilized for the purposes of reliability-based offshore design. Many methods have been proposed to estimate environmental contours of extreme sea states, including, but not limited to, the traditional inverse first-order reliability method (I-FORM) and subsequent modifications, copula methods, and Monte Carlo methods. These methods differ in terms of both the methodology selected for defining the joint distribution of sea state parameters and in the method used to construct the environmental contour from the joint distribution. It is often difficult to compare the results of proposed methods to determine which method should be used for a particular application or geographical region. The comparison of the predictions from various contour methods at a single site and across many sites is important to making environmental contours of extreme sea states useful in practice. The goal of this paper is to develop a comparison framework for evaluating methods for developing environmental contours of extreme sea states. This paper develops generalized metrics for comparing the performance of contour methods to one another across a collection of study sites, and applies these metrics and methods to develop conclusions about trends in the wave resource across geographic locations, as demonstrated for a pilot dataset. These proposed metrics and methods are intended to judge the environmental contours themselves relative to other contour methods, and are thus agnostic to a specific device, structure, or field of application. The metrics developed and applied in this paper include measures of predictive accuracy, physical validity, and aggregated temporal performance that can be used to both assess contour methods and provide recommendations for the use of certain methods in various geographical regions. The application and aggregation of the metrics proposed in this paper outline a comparison framework for environmental contour methods that can be applied to support design analysis workflows for offshore structures. This comparison framework could be extended in future work to include additional metrics of interest, potentially including those to address issues pertinent to a specific application area or analysis discipline, such as metrics related to structural response across contour methods or additional physics-based metrics based on wave dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluating the factors influencing accuracy, interpretability, and reproducibility in the use of machine learning classifiers in biology to enable standardization

The complexity and variability of biological data has promoted the increased use of machine learning methods to understand processes and predict outcomes. These same features complicate reliable, reproducible, interpretable, and responsible use of such methods, resulting in questionable relevance of the derived. outcomes. Here we systematically explore challenges associated with applying machine learning to predict and understand biological processes using a well- characterized in vitro experimental system. We evaluated factors that vary while applying machine learning classifers: (1) type of biochemical signature (transcripts vs. proteins), (2) data curation methods (pre- and post-processing), and (3) choice of machine learning classifier. Using accuracy, generalizability, interpretability, and reproducibility as metrics, we found that the above factors significantly mod- ulate outcomes even within a simple model system. Our results caution against the unregulated use of machine learning methods in the biological sciences, and strongly advocate the need for data standards and validation tool-kits for such studies.

59 BASIC BIOLOGICAL SCIENCES↗