Search NASA⌕ Search

SEARCH · Search NASA

Results for “leverage”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

MultiSector Dynamics: Advancing the Science of Complex Adaptive Human-Earth Systems

The field of MultiSector Dynamics (MSD) explores the dynamics and co-evolutionary pathways of human and Earth systems with a focus on critical goods, services, and amenities delivered to people through interdependent sectors. This commentary lays out core definitions and concepts, identifies MSD science questions in the context of the current state of knowledge, and describes ongoing activities to expand capacities for open science, leverage revolutions in data and computing, and grow and diversify the MSD workforce. Central to our vision is the ambition of advancing the next generation of complex adaptive human-Earth systems science to better address interconnected risks, increase resilience, and improve sustainability. This will require convergent research and the integration of ideas and methods from multiple disciplines. Understanding the tradeoffs, synergies, and complexities that exist in coupled human-Earth systems is particularly important in the context of energy transitions and increased future shocks.

Reed, Patrick↗

Deep Learning Estimation of Daily Ground–Level NO 2 Concentrations from Remote Sensing Data

The limited number of nitrogen dioxide (NO 2 ) surface measurements calls for the development of highly accurate approaches to estimating surface NO 2 concentrations. In this study, we leverage a new satellite instrument, the TROPOspheric Monitoring Instrument (TROPOMI), along with other predictor variables, to estimate daily surface NO 2 concentrations over Texas in 2019. We use the deep convolutional neural network (Deep-CNN), an advanced deep learning algorithm, to obtain estimates and achieve a correlation coefficient (R) of 0.91, an index of agreement (IOA) of 0.95, and a mean absolute bias (MAB) of 1.75 ppb in surface NO 2 estimation. Additionally, we leverage a novel approach, SHapley Additive exPlanations (SHAP), to describe how Deep-CNN understands each predictor variable. The SHAP results show that the Deep-CNN model has an advanced understanding of the dataset, revealing that TROPOMI closely captures levels of NO 2 . In addition, we show the superiority of our Deep-CNN model at estimating surface NO 2 over other well-known machine learning and regression models in the field, including the support vector machines (SVM), random forest (RF), and multiple linear regression (MLR). Although SVM and RF show strong capabilities at estimating surface NO 2 concentrations, their accuracy is inferior to that of the Deep-CNN model, ranking second and third in model accuracy in this study. The MLR, however, shows a poor ability at NO 2 estimation and ranks last among all models. Furthermore, testing the impact of sample size on model performance, we also show that, compared to other models, Deep-CNN needs more samples to trigger its strength at surface NO 2 estimation.

54 ENVIRONMENTAL SCIENCES↗

Future Intensity‐Duration‐Frequency Curves of Extreme Precipitation in the Midwest United States From Convection‐Permitting Modeling

Abstract During the last four decades, global warming has statistically significant intensified extreme precipitation events in the Midwestern United States (defined here as the region covering Illinois, Indiana, Ohio, and Kentucky), leading to increased risks to human life, property, and infrastructure. To enable climate change adaptation and resilience across various economic and social sectors in this region, updated information about future climate changes, specifically at finer spatial scales, is essential. Leveraging a new 150‐year dynamical downscaling data set at convection‐permitting resolution, this study introduces a framework to construct the projected future intensity‐duration‐frequency (IDF) curves of heavy precipitation, which are prominent tools for infrastructure design and water resources management. This framework generates IDF curves at both sub‐daily and multi‐day duration utilizing hourly in situ observations as well as quantile‐based statistical techniques in bias‐correction and return levels selection. The assumption of non‐stationarity in the distribution parameter fitting process is also implemented in this workflow. Compared to historical IDF curves for 1980–2022, future projected IDF curves for 2058–2100 under Representative Concentration Pathway (RCP) 4.5 and RCP 8.5 scenarios indicate an average intensity increase of approximately 15% and 25%, respectively, across 74 stations, considering both annual and seasonal timescales. Future projections suggest that extreme precipitation events may become more severe across six investigated return periods, with longer return periods showing a greater increase. The frequency of future extreme precipitation events in the Midwest region is also projected to double. Furthermore, current results reveal spatial heterogeneity of future trends across stations owing to the high‐resolution input data set. Plain Language Summary This study investigates the evolving nature of extreme precipitation events in the Midwestern United States under a changing climate. By leveraging a high‐resolution dynamical downscaling data set, we construct projected intensity‐duration‐frequency (IDF) curves for future extreme rainfall events. These curves serve as vital tools for infrastructure planning and water resource management. Our analysis reveals a significant increase in both the intensity and frequency of extreme precipitation events in the region. Future projected IDF curves for the late century indicate an average intensity increase of approximately 15%–25% compared to historical values. Moreover, the frequency of such events is expected to double. Spatial heterogeneity in future trends is observed across different stations within the Midwest, highlighting the importance of high‐resolution modeling in capturing localized climate variability. These findings underscore the urgent need for climate adaptation strategies to mitigate the increasing risks associated with extreme precipitation events in the region. Key Points This study introduces a workflow to construct future intensity‐duration‐frequency (IDF) curves over the Midwest United States using a new convection‐permitting modeling data set The current IDF construction workflow reproduces well the historical observed IDF 30 curves in summer months with median relative errors of 2.4% among 74 stations and 6 investigated durations The projected IDF curves show diverse future trends of extreme precipitation across stations, with intensity increases of approximately 15% and 25% under RCP4.5 and RCP8.5 climate scenarios, respectively, and a doubling of frequency on average

Nguyen, Trung↗

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗

Colossal barocaloric effects with ultralow hysteresis in two-dimensional metal–halide perovskites

Pressure-induced thermal changes in solids—barocaloric effects—can be used to drive cooling cycles that offer a promising alternative to traditional vapor-compression technologies. Efficient barocaloric cooling requires materials that undergo reversible phase transitions with large entropy changes, high sensitivity to hydrostatic pressure, and minimal hysteresis, the combination of which has been challenging to achieve in existing barocaloric materials. Here, we report a new mechanism for achieving colossal barocaloric effects that leverages the large volume and conformational entropy changes of hydrocarbon order–disorder transitions within the organic bilayers of select two-dimensional metal–halide perovskites. Significantly, we show how the confined nature of these order–disorder phase transitions and the synthetic tunability of layered perovskites can be leveraged to reduce phase transition hysteresis through careful control over the inorganic–organic interface. The combination of ultralow hysteresis and high pressure sensitivity leads to colossal reversible isothermal entropy changes (>200 J kg -1 K -1 ) at record-low pressures (<300 bar).

36 MATERIALS SCIENCE↗

Predicting the heat release variability of Li-ion cells under thermal runaway with few or no calorimetry data

Accurate measurement of the variability of thermal runaway behavior of lithium-ion cells is critical for designing safe battery systems. However, experimentally determining such variability is challenging, expensive, and time-consuming. Here, we utilize a transfer learning approach to accurately estimate the variability of heat output during thermal runaway using only ejected mass measurements and cell metadata, leveraging 139 calorimetry measurements on commercial lithium-ion cells available from the open-access Battery Failure Databank. We show that the distribution of heat output, including outliers, can be predicted accurately and with high confidence for new cell types using just 0 to 5 calorimetry measurements by leveraging behaviors learned from the Battery Failure Databank. Fractional heat ejection from the positive vent, cell body, and negative vent are also accurately predicted. We demonstrate that by using low cost and fast measurements, we can predict the variability in thermal behaviors of cells, thus accelerating critical safety characterization efforts.

25 ENERGY STORAGE↗

A fault-tolerant neutral-atom architecture for universal quantum computation

Quantum error correction (QEC) is essential for the realization of large-scale quantum computers. However, owing to the complexity of operating on the encoded ‘logical’ qubits, understanding the physical principles for building fault-tolerant quantum devices and combining them into efficient architectures is an outstanding scientific challenge. Here we use reconfigurable arrays of up to 448 neutral atoms to implement the key elements of a universal, fault-tolerant quantum processing architecture and experimentally explore their underlying working mechanisms. We first use surface codes to study how repeated QEC suppresses errors, demonstrating 2.14(13)x below-threshold performance in a four-round characterization circuit by leveraging atom loss detection and machine learning decoding. We then investigate logical entanglement using transversal gates and lattice surgery and extend it to universal logic through transversal teleportation with three-dimensional [[15,1,3]] codes, enabling arbitrary-angle synthesis with polylogarithmic overhead. Finally, we develop mid-circuit qubit reuse16, increasing experimental cycle rates by two orders of magnitude and enabling deep-circuit protocols with dozens of logical qubits and hundreds of logical teleportations with [[7,1,3]] and high-rate [[16,6,4]] codes while maintaining constant internal entropy. Our experiments show key principles for efficient architecture design, involving the interplay between quantum logic and entropy removal, judiciously using physical entanglement in logic gates and magic state generation, and leveraging teleportations for universality and physical qubit reset. These results establish foundations for scalable, universal error-corrected processing and its practical implementation in neutral atom systems.

atomic and molecular physics↗

Protein model accuracy estimation empowered by deep learning and inter-residue distance prediction in CASP14

Abstract The inter-residue contact prediction and deep learning showed the promise to improve the estimation of protein model accuracy (EMA) in the 13th Critical Assessment of Protein Structure Prediction (CASP13). To further leverage the improved inter-residue distance predictions to enhance EMA, during the 2020 CASP14 experiment, we integrated several new inter-residue distance features with the existing model quality assessment features in several deep learning methods to predict the quality of protein structural models. According to the evaluation of performance in selecting the best model from the models of CASP14 targets, our three multi-model predictors of estimating model accuracy (MULTICOM-CONSTRUCT, MULTICOM-AI, and MULTICOM-CLUSTER) achieve the averaged loss of 0.073, 0.079, and 0.081, respectively, in terms of the global distance test score (GDT-TS). The three methods are ranked first, second, and third out of all 68 CASP14 predictors. MULTICOM-DEEP, the single-model predictor of estimating model accuracy (EMA), is ranked within top 10 among all the single-model EMA methods according to GDT-TS score loss. The results demonstrate that inter-residue distance features are valuable inputs for deep learning to predict the quality of protein structural models. However, larger training datasets and better ways of leveraging inter-residue distance information are needed to fully explore its potentials.

59 BASIC BIOLOGICAL SCIENCES↗

Preparing for the next pandemic via transfer learning from existing diseases with hierarchical multi-modal BERT: a study on COVID-19 outcome prediction

Abstract Developing prediction models for emerging infectious diseases from relatively small numbers of cases is a critical need for improving pandemic preparedness. Using COVID-19 as an exemplar, we propose a transfer learning methodology for developing predictive models from multi-modal electronic healthcare records by leveraging information from more prevalent diseases with shared clinical characteristics. Our novel hierarchical, multi-modal model ( $${\textsc {TransMED}}$$ T R A N S MED ) integrates baseline risk factors from the natural language processing of clinical notes at admission, time-series measurements of biomarkers obtained from laboratory tests, and discrete diagnostic, procedure and drug codes. We demonstrate the alignment of $${\textsc {TransMED}}$$ T R A N S MED ’s predictions with well-established clinical knowledge about COVID-19 through univariate and multivariate risk factor driven sub-cohort analysis. $${\textsc {TransMED}}$$ T R A N S MED ’s superior performance over state-of-the-art methods shows that leveraging patient data across modalities and transferring prior knowledge from similar disorders is critical for accurate prediction of patient outcomes, and this approach may serve as an important tool in the early response to future pandemics.

59 BASIC BIOLOGICAL SCIENCES↗

Progress and roadmap for electro-privileged transformations of bio-derived molecules

Biomass incorporates carbon captured from the atmosphere and can serve as a renewable feedstock for producing valuable chemicals and fuels. Here we look at how electrochemical approaches can impact biomass valorization, focusing on identifying chemical transformations that leverage renewable electricity and feedstocks to produce valorized products via electro-privileged transformations. First, we recommend that the field should explore widening the spectrum of platform chemicals derived from bio-feedstocks, thus offering pathways to molecules that have historically been derived from petroleum. Second, we identify opportunities in electrocatalytic production of energy-dense fuels from biomass that utilize water as the hydrogen source and renewable electricity as the driving force. Finally, we look at the potential in electrochemical depolymerization to preserve key functional groups in raw feedstocks that would otherwise be lost during harsh pre-treatments in traditional depolymerization routes. Finally, on the basis of these priorities, we suggest a roadmap for the integration of biomass and electrochemistry and offer milestones required to tap further into the potential of electrochemical biomass valorization.

electrocatalysis↗

CryoTRANS: predicting high-resolution maps of rare conformations from self-supervised trajectories in cryo-EM

Cryogenic electron microscopy (cryo-EM) has revolutionized structural biology, enabling efficient determination of structures at near-atomic resolutions. However, a common challenge arises from the severe imbalance among various conformations of vitrified particles, leading to low-resolution reconstructions in rare conformations due to a lack of particle images in these quasi-stable states. We introduce CryoTRANS, a method that predicts high-resolution maps of rare conformations by constructing a self-supervised pseudo-trajectory between density maps of varying resolutions. This trajectory is represented by an ordinary differential equation parameterized by a deep neural network, ensuring retention of detailed structures from high-resolution density maps. By leveraging a single high-resolution density map, CryoTRANS significantly improves the reconstruction of rare conformations and has been validated on four real-world datasets: alpha-2-macroglobulin, actin-binding protein complexes, SARS-CoV-2 spike glycoprotein, and the 70S ribosome. CryoTRANS can also predict high-resolution structures in cryogenic electron tomography maps using a high-resolution cryo-EM map.Cryogenic electron microscopy (cryo-EM) has revolutionized structural biology, enabling efficient determination of structures at near-atomic resolutions. However, a common challenge arises from the severe imbalance among various conformations of vitrified particles, leading to low-resolution reconstructions in rare conformations due to a lack of particle images in these quasi-stable states. We introduce CryoTRANS, a method that predicts high-resolution maps of rare conformations by constructing a self-supervised pseudo-trajectory between density maps of varying resolutions. This trajectory is represented by an ordinary differential equation parameterized by a deep neural network, ensuring retention of detailed structures from high-resolution density maps. By leveraging a single high-resolution density map, CryoTRANS significantly improves the reconstruction of rare conformations and has been validated on four real-world datasets: alpha-2-macroglobulin, actin-binding protein complexes, SARS-CoV-2 spike glycoprotein, and the 70S ribosome. CryoTRANS can also predict high-resolution structures in cryogenic electron tomography maps using a high-resolution cryo-EM map.

47 OTHER INSTRUMENTATION↗

Engineered plants provide a photosynthetic platform for the production of diverse human milk oligosaccharides

Human milk oligosaccharides (HMOs) are a diverse class of carbohydrates which support the health and development of infants. The vast health benefits of HMOs have made them a commercial target for microbial production; however, producing the approximately 200 structurally diverse HMOs at scale has proved difficult. Here we produce a diversity of HMOs by leveraging the robust carbohydrate anabolism of plants. This diversity includes high-value and complex HMOs, such as lacto-N-fucopentaose I. HMOs produced in transgenic plants provided strong bifidogenic properties, indicating their ability to serve as a prebiotic supplement with potential applications in adult and infant health. Technoeconomic analyses demonstrate that producing HMOs in plants provides a path to the large-scale production of specific HMOs at lower prices than microbial production platforms. Our work demonstrates the promise in leveraging plants for the low-cost and sustainable production of HMOs.

59 BASIC BIOLOGICAL SCIENCES↗

Unlocking the potential: machine learning applications in electrocatalyst design for electrochemical hydrogen energy transformation

Machine learning (ML) is rapidly emerging as a pivotal tool in the hydrogen energy industry for the creation and optimization of electrocatalysts, which enhance key electrochemical reactions like the hydrogen evolution reaction (HER), the oxygen evolution reaction (OER), the hydrogen oxidation reaction (HOR), and the oxygen reduction reaction (ORR). This comprehensive review demonstrates how cutting-edge ML techniques are being leveraged in electrocatalyst design to overcome the time-consuming limitations of traditional approaches. ML methods, using experimental data from high-throughput experiments and computational data from simulations such as density functional theory (DFT), readily identify complex correlations between electrocatalyst performance and key material descriptors. Leveraging its unparalleled speed and accuracy, ML has facilitated the discovery of novel candidates and the improvement of known products through its pattern recognition capabilities. This review aims to provide a tailored breakdown of ML applications in a format that is readily accessible to materials scientists. Hence, we comprehensively organize ML-driven research by commonly studied material types for different electrochemical reactions to illustrate how ML adeptly navigates the complex landscape of descriptors for these scenarios. We further highlight ML's critical role in the future discovery and development of electrocatalysts for hydrogen energy transformation. Potential challenges and gaps to fill within this focused domain are also discussed. As a practical guide, we hope this work will bridge the gap between communities and encourage novel paradigms in electrocatalysis research, aiming for more effective and sustainable energy solutions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Room temperature chemical transformation of SnSe to Ag 2 Se nanocrystals via cation exchange

Atomic-scale control of the chemical composition of semiconductor nanocrystals through a cation exchange reaction affords greater tunability in the design of multifunctional semiconductor composite nanocrystals. Here, we report a facile route to SnSe–Ag 2 Se composite nanocrystals using cation exchange at room temperature. Starting from freshly synthesized SnSe nanorods, we leverage the strong distortion of the Sn 2+ octahedral coordination in SnSe and the hard–soft acid–base (HSAB) principle, to promote the exchange of an Sn 2+ ion with two Ag + ions in methanol leading to Ag 2 Se/SnSe nanocomposites. The morphology and chemistry of the nanocrystals evolve from nanorods with SnSe@Ag 2 Se (core@shell) structures for SnSe-rich composites to nanorods with a random distribution of Sn 2+ and Ag + ions for nearly equimolar composites, and finally to irregular fragmented nanocrystals for Ag 2 Se-rich composites. A mechanistic understanding of the observed morphology evolution is discussed using the change in the cation coordination from octahedral (Sn 2+ ) to tetrahedral (Ag + ) geometry and the accompanying expansion of the hcp Se 2– sublattice. Interestingly, the synthesized composite nanocrystals exhibit an optical band gap value tunable within a wide energy range by increasing the Ag 2 Se/SnSe ratio. This work provides a useful and facile strategy to modify the optical behavior of semiconductor nanomaterials, which can be leveraged for the design of better optical and/or photovoltaic devices.

36 MATERIALS SCIENCE↗

Illuminating the mechanistic impacts of an Fe-quaterpyridine functionalized crystalline poly(triazine imide) semiconductor for photocatalytic CO 2 reduction

The strategy of incorporating earth-abundant catalytic centers into light-absorbing architectures is desirable from the viewpoint of low cost, low toxicity, and versatility for activating small molecules to produce solar-based fuels. Herein, we show that an Fe-quaterpyridine molecular catalyst can be anchored to a light-absorbing, crystalline, carbon nitride (PTI), to yield a molecular-catalyst/material hybrid, Fe-qpy-PTI, capable of facilitating CO 2 reduction to CO selectively (up to ∼97–98%) in aqueous solution under low-intensity light irradiation. This hybrid material leverages the ability of the Fe-qpy catalyst to bind CO 2 upon a one-electron reduction, as achieved by transfer of excited electrons from the carbon-nitride semiconductor. At a low incident power density of only 50 mW cm −2 , the catalytic activity of the hybrid material was measured across a range of catalyst loadings from 0.1–3.8 wt%, yielding CO rates of up to 596 μmol g −1 h −1 for a 3.8 wt% loading during a 3 h experiment. Over the course of 8 h, the hybrid material attained a CO evolution rate of 608 μmol g −1 h −1 and 305 turnovers for a TOF of ∼38 h −1 and an apparent quantum yield of 2.6%. Higher light intensities provided an initial increase in activity but negatively impacted photocatalytic rates with time, with an AQY of 0.6% at 150 mW cm −2 and 0.4% at 250 mW cm −2 . Transient absorption spectroscopy results showed electron survival probabilities consistent with the trends in observed product rates. Computational modeling was also used to evaluate and understand the mechanistic pathway of the high product selectivity for CO versus H 2 . These results thus help unveil key factors for leveraging the mechanistic understanding of molecular catalysts for CO 2 reduction for pairing with light absorbing semiconductors and establishing optimal conditions to attain maximal rates in aqueous solution.

McGuigan, Scott [Baylor University, Waco, TX (Unit↗

Machine learning inversion of interatomic force constants from single-crystal inelastic neutron scattering

Atomic vibrations govern many macroscopic properties of materials, but experiments to comprehensively probe them remain challenging. Inelastic neutron scattering (INS) is a powerful technique to map phonon dispersions in crystals, especially when leveraging modern time-of-flight (ToF) spectrometers with large detectors. However, efficiently and robustly extracting interatomic force constants (FCs) parameterizing phonon dynamics from experimental spectra remains a bottleneck due to the complexity and high dimensionality of ToF INS datasets. Here, we present a machine learning approach for the direct inversion of FCs from single-crystal INS measurements. The framework leverages synthetic training data generated using universal machine-learned force fields and an efficient physics-based forward model. We benchmark two neural architectures–one emphasizing structured latent representation learning and the other direct, supervised spectral regression–across simulated datasets for two materials under idealized and noisy conditions. The latent-representation model is subsequently applied to experimental single-crystal INS data on germanium. The model is shown to reproduce FCs derived from both first-principles simulations and from iterative optimization, and furthermore achieves reliable inference even from sparse, single-orientation measurements representing short data acquisitions. Analysis of the learned latent space reveals semantically continuous and physically interpretable encodings that support strong cross-domain generalization. By bridging theoretical and experimental domains, we establish a path toward rapid inversion of experimental spectra and data-driven interpretation of temperature-dependent lattice dynamics.

42 ENGINEERING↗

The Carnegie Supernova Project I: Spectroscopic analysis of stripped-envelope supernovae

An analysis leveraging 170 optical spectra of 35 stripped-envelope (SE) core-collapse supernovae (SNe) observed by the Carnegie Supernova Project I and published in a companion paper is presented. Mean template spectra were constructed for the SNe IIb, Ib, and Ic subtypes, and parent ions associated with designated spectral features are identified with the aid of the spectral synthesis code SYNAPPS. Our modeled mean spectra suggest the ~6150 Å feature in SNe IIb may have an underlying contribution due to silicon, while the same feature in some SNe Ib may have an underlying contribution due to hydrogen. Standard spectral line diagnostics consisting of pseudo-equivalent widths (pEWs) and blue-shifted Doppler velocity were measured for each of the spectral features. Correlation matrices and rolling mean values of both spectral diagnostics were constructed. A principle component analysis (PCA) was applied to various wavelength ranges of the entire dataset and suggests clear separation among the different SE SN subtypes, which follows from trends previously identified in the literature. In addition, our findings reveal the presence of two SNe IIb subtypes, a select number of SNe Ib displaying signatures of weak, high-velocity hydrogen, and a single SN Ic with evidence of weak helium features. Our PCA results can be leveraged to obtain robust subtyping of SE SNe based on a single spectrum taken during the so-called photospheric phase, separating SNe IIb from SNe Ib with ~80% completion.

79 ASTRONOMY AND ASTROPHYSICS↗

Automated Network Services for Exascale Data Movement

The Large Hadron Collider (LHC) experiments distribute data by leveraging a diverse array of National Research and Education Networks (NRENs), where experiment data management systems treat networks as a “blackbox” resource. After the High Luminosity upgrade, the Compact Muon Solenoid (CMS) experiment alone will produce roughly 0.5 exabytes of data per year. NREN Networks are a critical part of the success of CMS and other LHC experiments. However, during data movement, NRENs are unaware of data priorities, importance, or need for quality of service, and this poses a challenge for operators to coordinate the movement of data and have predictable data flows across multi-domain networks. The overarching goal of SENSE (The Software-defined network for End-to-end Networked Science at Exascale) is to enable National Labs and universities to request and provision end-to-end intelligent network services for their application workflows leveraging SDN (Software-Defined Networking) capabilities. This work aims to allow LHC Experiments and Rucio, the data management software used by CMS Experiment, to allocate and prioritize certain data transfers over the wide area network. In this paper, we will present the current progress of the integration of SENSE, Multi-domain end-to-end SDN Orchestration with QoS (Quality of Service) capabilities, with Rucio, the data management software used by CMS Experiment.

Balcas, Justas↗