Search NASA⌕ Search

SEARCH · Search NASA

Results for “decision analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Next Generation System Analysis Model: Recently Added Features and Future Plans

To better enable informed decision-making regarding the back-end of the nuclear fuel cycle, the Integrated Waste Management System (IWMS) program within the U.S. Department of Energy, Office of Nuclear Energy (DOE-NE) has been sponsoring the development and application of system analysis tools capable of analyzing various system options for the management of spent nuclear fuel (SNF) and high-level radioactive waste (HLW).With these tools, IWMS architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). The Next Generation System Analysis Model (NGSAM) is an agent-based simulation software tool expressly designed to be capable of modeling features within various IWMS architectures. NGSAM imports data from Oak Ridge National Laboratory (ORNL)’s unified database (e.g., historic assembly information, thermal profiles for assembly heat, and at-reactor dry storage loadings) to ensure that each simulation initializes with a realistic representation of the state of commercial SNF in the U.S. Recent major enhancements implemented into NGSAM in the period since NGSAM was last presented at the WM2019 conference include: • Tracking of railroad escort car acquisition and buffer car acquisition • The addition of heavy haul truck (HHT) and barge routes for some sites, as well as support for user-defined inter-modal routes • Updates to the logic that checks the transportation cask thermal limit maps prior to package transport • An allocation method that predicts when reactor sites would pack assemblies from their spent fuel pools for dry storage, and prioritizes shipments directly from the pools of those reactor sites in the preceding periods (before the predicted loadings to dry storage), thus reducing the number of casks loaded into dry storage at reactor sites • The addition of “reactor site family” operational limits to restrict the number of loads of SNF taken from the pool and from dry storage at a given reactor site each year • Added support for multiple canister loading map options and packages with multiple compatible transportation overpacks • Updates to the handling of non-commercial SNF, including a new database that contains data to support the updates • Updates to allow analysis of hypothetical scenarios which include repackaging at reactor sites, e.g., for possible comparative analysis with other scenarios • Implementation of additional output reports, or modification of existing ones • The ability to generate and implement user edits via the NGSAM website • The ability to model loading SNF from pool storage at an interim storage facility (ISF) into dry storage at the ISF • The ability to model consolidating SNF from different existing storage containers at a DOE site into the same DOE standard canister • The ability to model transferring SNF casks from one transportation mode to another, e.g., from HHT to rail, referred to as transloading. These new features have improved NGSAM capabilities and users’ experience with the model. Preliminary NGSAM requirements for modeling advanced reactor fuels, reprocessing, treatment, and conditioning were considered, and this paper describes them at a high level. Other nuclear fuel cycle system analysis tools developed under sponsorship of DOE-NE, like the VISION code developed at Idaho National Laboratory, might be better suited for initial high-level analysis of those technologies and advanced fuel cycles. As technologies are developed and system concepts evolve, NGSAM could provide value by providing more detailed modeling of transport, storage, and disposal of spent fuel and wastes from advanced reactors and advanced fuel cycles at the fuel element and waste container level.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

National Virtual Biotechnology Laboratory: Report on Rapid R&D Solutions to the COVID-19 Crisis

With funding from the CARES Act, the U.S Department of Energy (DOE) established the National Virtual Biotechnology Laboratory (NVBL) in March 2020 to address key challenges associated with the COVID-19 crisis. NVBL brought together the broad scientific and technical expertise and resources of DOE’s 17 national laboratories to help tackle medical supply short ages, discover potential drugs to fight the virus, develop and validate COVID-19 testing methods, model disease spread and impact across the nation, and understand virus transport in buildings and the environment. National laboratory resources leveraged for this effort include a suite of world-leading user facilities broadly available to the research community, such as light and neutron sources, nanoscale science research centers, sequencing and biocharacterization facilities, and high-performance computing facilities. Within months, NVBL teams produced innovations in materials and advanced manufacturing that mitigated shortages in test kits and personal protective equipment (PPE), creating nearly 1,000 new jobs. They used DOE’s high-performance computers and light and neutron sources to identify promising candidates for antibodies and antivirals that universities and drug companies are now evaluating. NVBL researchers also developed new diagnostic targets and sample collection approaches, and supported U.S. Food and Drug Administration (FDA), Centers for Disease Control and Prevention (CDC), and U.S. Department of Defense (DoD) efforts to establish national guidelines used in administering millions of tests. Researchers used artificial intelligence and high-performance computing to produce near-real-time data analysis to forecast disease transmission, stress on public health infrastructure, and economic impact, which supported decision-makers at the local, state, and national levels. NVBL teams also studied how to control indoor virus movement to minimize uptake and protect human health. NVBL’s accomplishments demonstrate not only the powerful resource represented by DOE’s national laboratories working together to meet national needs, but also the effectiveness of the integrated NVBL framework for rapidly responding to emergencies with research and development (R&D) solutions. As the fight against COVID continues, sustained efforts are needed to confront this pandemic as well as future threats. Examples include: 1) Establishing “supply chains on demand” to meet emergency production needs by leveraging the materials and manufacturing expertise of DOE national laboratories and developing advances in electronics, sensing, robotics, and automation capabilities; 2) Improving the speed and robustness of drug discovery by integrating experimental platforms with DOE’s computational and experimental user facilities, which provide unique resources to support the discovery of high-potential therapeutic agents; 3) Protecting public, environmental, and animal health by developing new testing protocols and instrumentation adaptable to diverse sample types (both physiological and environmental) to quickly detect a wide range of pathogens and monitor other biorisks; 4) Supporting near-real-time data needs of decision-makers at the local, regional, state, and national levels by advancing data curation, analysis, and modeling using artificial intelligence and new data science tools for managing and evaluating large diverse datasets; 5) Harnessing DOE’s expertise in environmental modeling to design rooms and air handling for offices, classrooms, restaurants, and other structures to minimize biorisk transmissions. Going forward, NVBL is poised to apply the unique capabilities and expertise of the national laboratory complex to future national and international emergencies, both natural and engineered. Through this framework, the Office of Science will continue to be an integral component of agency wide efforts to prepare for and respond to biorisks and other crises.

42 ENGINEERING↗
DOE OSTI2023

The role of social support on midwestern farmers’ willingness to grow perennial bioenergy crops

The lack of farmers' willingness to grow perennial bioenergy crops (PBCs) presents a critical barrier to the emergence of cellulosic biofuel production. The willingness relies on a complex network of economic, environmental, and social drivers, among which the influence of social factors (e.g., the influence of neighborhood, community, and communication) is less understood. This study addresses this knowledge gap via a survey analysis of midwestern farmers. The survey data are analyzed through ordinary least square regression and structural equation model, which together investigate the individual and interactive impacts of multiple factors on farmers' decisions to adopt PBCs. Based on a farm-scale analysis, six statistically significant predictors of farmer willingness to grow PBCs are identified: perception of PBCs' environment benefits, education level, willingness to take risks, familiarity with PBCs, portion of peers already growing PBCs, and support of biorefineries locating in the local community. Among these, the latter three predictors are social support variables. It is found that familiarity with the crops is the most significant predictor of willingness; familiarity is also an important intermediate variable that mediates the influence of many other predictors. In addition, peer adoption can both directly and indirectly affect willingness via its influence on familiarity. Furthermore, these findings suggest that it is a pressing need to improve farmers’ knowledge of PBCs to promote the adoption of such crops.

09 BIOMASS FUELS↗
DOE OSTI2023

Data for The Role of Social Support on Midwestern Farmers’ Willingness to Grow Perennial Bioenergy Crops

The lack of farmers’ willingness to grow perennial bioenergy crops (PBCs) presents a critical barrier to the emergence of cellulosic biofuel production. The willingness relies on a complex network of economic, environmental, and social drivers, among which the influence of social factors (e.g., the influence of neighborhood, community, and communication) is less understood. This study addresses this knowledge gap via a survey analysis of midwestern farmers. The survey data are analyzed through ordinary least square regression and structural equation model, which together investigate the individual and interactive impacts of multiple factors on farmers’ decisions to adopt PBCs. Based on a farm-scale analysis, six statistically significant predictors of farmer willingness to grow PBCs are identified: perception of PBCs’ environment benefits, education level, willingness to take risks, familiarity with PBCs, portion of peers already growing PBCs, and support of biorefineries locating in the local community. Among these, the latter three predictors are social support variables. It is found that familiarity with the crops is the most significant predictor of willingness; familiarity is also an important intermediate variable that mediates the influence of many other predictors. In addition, peer adoption can both directly and indirectly affect willingness via its influence on familiarity. These findings suggest that it is a pressing need to improve farmers’ knowledge of PBCs to promote the adoption of such crops.

Economics↗
DOE OSTI2022

FIC Vulnerability Profile

The FIC team is engaged with Pacific Northwest National Laboratory’s (PNNL’s) Shamrock Cyber Team to provide cybersecurity analyses of the FIC software. Shamrock offers both Threat-Based Analysis services and Secure Software Development services. These services are ultimately used to understand and mitigate threats against software and to reduce vulnerabilities in software, thus improving overall cybersecurity and informing decision makers. Shamrock’s Secure Software Development services, specifically Static Analysis Security Testing (SAST) and Open-Source Analysis (OSA), produced this Vulnerability Profile.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Uncertainty Analysis of Consequence Management Data Products

An interlaboratory effort has developed a probabilistic framework to characterize uncertainty in data products that are developed by the US Department of Energy Consequence Management Program in support of the Federal Radiological Monitoring and Assessment Center. The purpose of this paper is to provide an overview of the probability distributions of input variables and the statistical methods used to propagate and quantify the overall uncertainty of the derived response levels that are used as contours on data products due to the uncertainty in input parameters. Uncertainty analysis results are also presented for several study scenarios. This paper includes an example data product to illustrate the potential real-world implications of incorporating uncertainty analysis results into data products that inform protective action decisions. Data product contours that indicate areas where public protection actions may be warranted can be customized to an acceptable level of uncertainty. Finally, the investigators seek feedback from decision makers and the radiological emergency response community to determine how uncertainty information can be used to support the protective action decision-making process and how it can be presented on data products.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2025

Land-use analysis using infrastructure representations and high-resolution flood inundation mapping techniques

In the face of climate change and population growth in coastal regions, land-use analysis efforts are more challenging than ever. Land-use decision-makers in coastal communities are burdened with the difficult choices of where to place new homes versus other assets. While there has been an increased focus on hazard mitigation and disaster resilience in the field of planning, evidence points towards continued development in risk-prone areas including flood zones. Residential development within flood zones specifically continues to be a major issue. To help counter this trend, this study introduces a novel land-use analysis method, coupling topographic flood inundation mapping techniques with digital elevation model (DEM) adaptations. This Topographic Model Scenario Generation workflow can be used by planners early in the land-use decision making process and provides an alternative to high-computational hydraulic models. The analysis also includes the identification of strengths and weaknesses of topographic models' recognition of built infrastructure assets, adding to a limited body of knowledge addressing recommended uses of such models. Levees and canals prove particularly functional in this context while detention ponds less so, likely due to a lack of total water mass accountability. Lastly, we provide a functional demonstration in Southeast Texas to illustrate the workflow's ability to create multiple infrastructure scenarios and visualize their effects across different flood events.

42 ENGINEERING↗
DOE OSTI2022

Benefit Analysis of CO 2 Delivery Options for Offshore Storage or Enhanced Oil Recovery

The analysis presented in this report evaluates the benefits of CO₂ offshore transport via pipeline or ship within the GOM. It takes a top-down framework to estimate the costs. First, this analysis designed a reduced-order model (ROM) based on the cash flows in the FECM/NETL CO₂ Transport Cost Model (also known as CO2_T_COM). The ROM takes capital expenses (CAPEX) and operating expenses (OPEX) to calculate the CO₂ breakeven price based on the cash flows. Second, this analysis developed regression models utilizing published data from other analyses to estimate CAPEX and OPEX. Since the ROM is a simplified cash flow calculation, it is easy to exchange the core regression models to estimate various costs. The ROM and regression models provided a framework that can be easily used by other researchers, decision-makers, operators, and regulators. The objective of this analysis is to assess the CO₂ breakeven cost range for pipeline and ship transport of captured CO₂ given the CO₂ source and storage reservoir located in the GOM.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Supporting Bioproducts Industry Growth with a System Dynamics Decision-Support Tool

A bio-based economy requires chemical products as well as fuels to be produced from biomass. Although a variety of universities, government agencies, start-ups and established firms have engaged in bioproduct development, many projects have failed to reach the point of commercialization and commercialized bioproducts struggle to capture and maintain market share. To date, there has been no general research into the factors that contribute to bioproduct failure or success. This work presents the Bioproduct Transition Dynamics (BTD) system dynamics model, a decision-support tool that simulates the bioproduct development process from pre-piloting research through construction of the first commercial-scale plant, as well as the processes of obtaining funding from investors and government agencies. The core of the BTD is a feedback loop between bioproduct developers and funders, which relates development progress measured with indicators such as net present value to funders’ decisions to continue investing. External factors such as feedstock prices, market size and growth, and the existence of bioproduct consumers also influence a development project’s chances of receiving follow-on funding. Virtually any bioproduct can be represented with the BTD: direct replacements, performance-advantaged products, niche and commodity markets can all be modeled. The goal of the BTD project is to inform decisions made by developers in both established firms and start-ups, investors, government agencies, and other stakeholders interested in growing the nascent U.S. bioproducts industry. This talk will cover the general structure and functionality of the BTD, and present results from an analysis performed with the BTD to demonstrate its use as a decision-support tool and the insights it can provide. The goal of the analysis is to identify the most critical factors that lead to direct replacement and performance-advantaged bioproduct projects emerging successfully from the “Valley of Death”, and to determine if these factors differ between the two bioproduct types.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Machine Learning-Based Classification of Lignocellulosic Biomass from Pyrolysis-Molecular Beam Mass Spectrometry Data

High-throughput analysis of biomass is necessary to ensure consistent and uniform feedstocks for agricultural and bioenergy applications and is needed to inform genomics and systems biology models. Pyrolysis followed by mass spectrometry such as molecular beam mass spectrometry (py-MBMS) analyses are becoming increasingly popular for the rapid analysis of biomass cell wall composition and typically require the use of different data analysis tools depending on the need and application. Here, the authors report the py-MBMS analysis of several types of lignocellulosic biomass to gain an understanding of spectral patterns and variation with associated biomass composition and use machine learning approaches to classify, differentiate, and predict biomass types on the basis of py-MBMS spectra. Py-MBMS spectra were also corrected for instrumental variance using generalized linear modeling (GLM) based on the use of select ions relative abundances as spike-in controls. Machine learning classification algorithms e.g., random forest, k-nearest neighbor, decision tree, Gaussian Naïve Bayes, gradient boosting, and multilayer perceptron classifiers were used. The k-nearest neighbors (k-NN) classifier generally performed the best for classifications using raw spectral data, and the decision tree classifier performed the worst. After normalization of spectra to account for instrumental variance, all the classifiers had comparable and generally acceptable performance for predicting the biomass types, although the k-NN and decision tree classifiers were not as accurate for prediction of specific sample types. Gaussian Naïve Bayes (GNB) and extreme gradient boosting (XGB) classifiers performed better than the k-NN and the decision tree classifiers for the prediction of biomass mixtures. The data analysis workflow reported here could be applied and extended for comparison of biomass samples of varying types, species, phenotypes, and/or genotypes or subjected to different treatments, environments, etc. to further elucidate the sources of spectral variance, patterns, and to infer compositional information based on spectral analysis, particularly for analysis of data without a priori knowledge of the feedstock composition or identity.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Glucuronidase Function in Clinical Samples

The purpose of this CRADA is to expand upon the work previously performed through CRADA No. PNNL/381. As explained in the previous CRADA, Glucuronidase enzymes are important for contributing to enterohepatic recycling of numerous therapeutic drug compounds, resulting in impaired or prolonged drug activity. Further, other pathways within the gut, such as bile acid metabolism through the action of bile salt hydrolase enzymes (BSH), have shown to impact both the development of colon cancers and impact recovery. Adapting the activity-based protein profiling (ABPP) technologies developed at PNNL to a microtiter plate-based chemical probe assay was the first step in demonstrating the clinical usability of the technology. With assay proof-of-concept complete through CRADA No. PNNL/381, clinical cohort testing using the developed assay is the next step towards commercialization of this technology. Some chemotherapeutic agents are mediated by gut-produced microbiota through enterohepatic circulation. For example, irinotecan, the first line treatment for many colon and other cancers, can be recycled into a patient’s system through gut microbiota produced glucuronidase enzymes. A significant percentage of patients subjected to irinotecan treatment experience dose-limiting diarrhea and gastric distress that limits treatment options and delays effective intervention. Relatedly, bile salt hydrolases modify ratios of bile acids in the gut, which alter nutrient and pharmaceutical uptake by the intestines and impact patient response to treatment. Coupled together these gut-mediated disorders can significantly decrease patient outcomes. In this project, we propose to investigate a clinical cohort of samples from colon cancer patients to better understand gut microbiome activities surrounding microbiota produced glucuronidases to aid clinician decisions and enhance therapeutic intervention. Our project will measure glucuronidase activity of individual patients and compare this activity to a variety of factors, including patient medical history, treatment response, and overall outcomes. Data will be compared with metagenomic, metabolomic, and proteomic analyses to fully defined the entire gut microbiome space and correlate results with the glucuronidase activity. Resultant analysis is expected to provide actionable information to direct decision making towards therapeutic intervention.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Cyber-physical Architecture For Automated Responses (cyphar) In Adversarial Ot Environments

The ability to react to a malicious attack starts with high fidelity recognition, and with that, an agile response to the attack. The current operational technology (OT) systems for a critical infrastructure may include an intrusion detection system (IDS), but the ability to adapt to an intrusion is a human initiated response. Orchestrators, which are coming of age in the financial sector and allow for levels of automated response, are not prevalent in the OT space. To evolve to such responses in the OT space, a tradeoff analysis is first needed, The tradeoff analysis, which evaluates the mitigation benefits of responses versus the physical affects that result, inform an automated response decision. The intent of this paper is to provide a formulation of a tradeoff analysis and its use in advancing automated, agile responses.

Rieger, CraigG.↗
DOE OSTI2021

Quantifying the Solar Energy Resource for Puerto Rico

After Hurricane Maria, multiple U.S. Department of Energy laboratories studied the state of the electric grid in Puerto Rico and analyzed grid resilience and grid integration of renewable energy. As part of the work done at the National Renewable Energy Laboratory, researchers created new solar resource data, conducted a technical potential and supply curve analysis, and studied the interannual variability of the solar resource. A new methodology was developed to downscale solar resource data from the National Solar Radiation Data Base (NSRDB) from a 4-km x 4-km spatial and 30-minute temporal resolution to a 2 km x 2 km and 5-minute resolution. This methodology primarily used simple physical principles to develop high-resolution cloud properties which were then used to compute solar radiation. The high-resolution datasets were validated against ground measurements and the error metrics were found to be similar to the original lower resolution dataset. Using 20 years of downscaled data from the NSRDB multi-year capacity factors for photovoltaics (PV) were developed for both single-axis tracking and fixed latitude-tilt configurations. Use of the multi-year data provides the ability to understand variability in capacity factors due to variability in weather over a long period of time. For Puerto Rico the coastal regions were found to have significant higher capacity factors than inland. Using land-use and terrain information a technical potential analysis was conducted for Puerto Rico. This analysis restricted single PV plant development to a maximum of 100 MW nameplate capacity. The nameplate capacity for each municipality were then determined. Based on our assumptions, 56 of the 78 total municipalities of Puerto Rico contain some level of solar capacity. Most of the interior municipalities did not have any capacity because of the geographic exclusions used in this study. The lowest capacity for a PV plant observed in a municipality was 10 MW. The maximum capacity within a county was 2,000 MW. Further a supply curve analysis was conducted by taking the results of the technical potential and quantifying system and transmission costs. The levelized cost of energy (LCOE) was calculated for each theoretical PV plant site, and the levelized cost of transmission was added to the LCOE to produce a total cost estimate for each site. The results of the supply curve analysis allow for a relative comparison of the cost for integrating new PV capacity into the grid. This analysis indicates that cheaper total LCOE sites tend to be larger in capacity. The total capacity in this study was found to be far beyond the maximum peak load for the island. However, this study does not consider the economic and market potential for development. The cumulative capacity presented in this study assumes that the best locations are developed first and ignores the complex decision paths for new power plant development. Therefore, this analysis can only be treated as illustrative. Finally this study investigates the impact of inter-annual variability of resource using a variety of metrices including probability of exceedance and variation in capacity factor and LCOE. This study demonstrates that the capacity factor or LCOE could vary by over 10% year to year. This clearly indicates the risks involved in using any particular year of data and clearly points to the use of multi-year data to reduce some of the risks related to variability in weather.

14 SOLAR ENERGY↗
DOE OSTI2020

Complementary workflows for identifying one-hop network behavior and multi-hop network dependencies

A network analysis tool evaluates network flow information in complementary workflows to identify one-hop behavior of network assets and also identify multi-hop dependencies between network assets. In one workflow (e.g., using association rule learning), the network analysis tool can identify significant one-hop communication patterns to and/or from network assets, taken individually. Based on the identified one-hop behavior, the network analysis tool can discover patterns of similar communication among different network assets, which can inform decisions about deploying patch sets, mitigating damage, configuring a system, or detecting anomalous behavior. In a different workflow (e.g., using deep learning or cross-correlation analysis), the network analysis tool can identify significant multi-hop communication patterns that involve network assets in combination. Based on the identified multi-hop dependencies, the network analysis tool can discover functional relationships between network assets, which can inform decisions about configuring a system, managing critical network assets, or protecting critical network assets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The impacts of training on change deafness and build-up in a flicker task

Performance on auditory change detection tasks can be improved by training. We examined the stimulus specificity of these training effects in behavior and ERPs. A flicker change detection task was employed in which spatialized auditory scenes were alternated until a "change" or "same" response was made. For half of the trials, scenes were identical. The other half contained changes in the spatial locations of objects from scene to scene. On Day 1, participants were either trained on this auditory change detection task (trained group), or trained on a non-auditory change detection task (control group). On Day 2, all participants were tested on the flicker task while EEG was recorded. The trained group showed greater change detection accuracy than the control group. They were less biased to respond "same" and showed full generalization of learning from trained to novel auditory objects. ERPs for "change" compared to "same" trials showed more negative going P1, N1, and P2 amplitudes, as well as a larger P3b amplitude. The P3b amplitude also differed between the trained and control group, with larger amplitudes for the trained group. Analysis of ERPs to scenes viewed prior to a decision revealed build-up of a difference between "change" and "same" trials in N1 and P2. Results demonstrate that training has an impact early in the "same" versus "change" decision-making process, and that the flicker paradigm combined with the ERP method can be used to study the build-up of change detection in auditory scenes.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics

Abstract Artificial intelligence (AI) promises to reshape scientific inquiry and enable breakthrough discoveries in areas such as energy storage, quantum computing, and biomedicine. Scanning transmission electron microscopy (STEM), a cornerstone of the study of chemical and materials systems, stands to benefit greatly from AI-driven automation. However, present barriers to low-level instrument control, as well as generalizable and interpretable feature detection, make truly automated microscopy impractical. Here, we discuss the design of a closed-loop instrument control platform guided by emerging sparse data analytics. We hypothesize that a centralized controller, informed by machine learning combining limited a priori knowledge and task-based discrimination, could drive on-the-fly experimental decision-making. This platform may unlock practical, automated analysis of a variety of material features, enabling new high-throughput and statistical studies.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Near real-time streaming analysis of big fusion data

Experiments on fusion plasmas produce high-dimensional data time series with ever-increasing magnitude and velocity, but turn-around times for analysis of this data have not kept up. For example, many data analysis tasks are often performed in a manual, ad-hoc manner some time after an experiment. In this article, we introduce the Delta framework that facilitates near real-time streaming analysis of big and fast fusion data. By streaming measurement data from fusion experiments to a high-performance compute center, Delta allows computationally expensive data analysis tasks to be performed in between plasma pulses. This article describes the modular and expandable software architecture of Delta and presents performance benchmarks of individual components as well as of an example workflow. Focusing on a streaming analysis workflow where electron cyclotron emission imaging (ECEi) data is measured at KSTAR on the National Energy Research Scientific Computing Center's (NERSC's) supercomputer we routinely observe data transfer rates of about 4 Gigabit per second. In NERSC, a demanding turbulence analysis workflow effectively utilizes multiple nodes and graphical processing units and executes them in under 5 min. We further discuss how Delta uses modern database systems and container orchestration services to provide web-based real-time data visualization. For the case of ECEi data we demonstrate how data visualizations can be augmented with outputs from machine learning models. Here, by providing session leaders and physics operators, results of higher-order data analysis using live visualizations may make more informed decisions on how to configure the machine for the next shot.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗