Search NASA⌕ Search

SEARCH · Search NASA

Results for “Knowledge Transfer”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Privacy-Preserving Knowledge Transfer with Bootstrap Aggregation of Teacher Ensembles

There is a need to transfer knowledge among institutions and organizations to save effort in annotation and labeling or in enhancing task performance. However, knowledge transfer is difficult because of restrictions that are in place to ensure data security and privacy. Institutions are not allowed to exchange data or perform any activity that may expose personal information. With the leverage of a differential privacy algorithm in a high-performance computing environment, we propose a new training protocol, Bootstrap Aggregation of Teacher Ensembles (BATE), which is applicable to various types of machine learning models. The BATE algorithm is based on and provides enhancements to the PATE algorithm, maintaining competitive task performance scores on complex datasets with underrepresented class labels.We conducted a proof-of-the-concept study of the information extraction from cancer pathology report data from four cancer registries and performed comparisons between four scenarios: no collaboration, no privacy-preserving collaboration, the PATE algorithm, and the proposed BATE algorithm. The results showed that the BATE algorithm maintained competitive macro-averaged F1 scores, demonstrating that the suggested algorithm is an effective yet privacy-preserving method for machine learning and deep learning solutions.

Yoon, Hong-Jun↗

Multi-Level Structural Damage Characterization Using Sparse Acoustic Sensor Networks and Knowledge Transferred Deep Learning

Standard structural health monitoring techniques face well-known difficulties for comprehensive defect diagnosis in real-world structures that have structural, material, or geometric complexity. This motivates the exploration of machine-learning-based structural health monitoring methods in complex structures. However, creating sufficient training data sets with various defects is an ongoing challenge for data-driven machine (deep) learning algorithms. The ability to transfer the knowledge of a trained neural network from one component to another or to other sections of the same component would drastically reduce the required training data set. Also, it would facilitate computationally inexpensive machine learning based inspection systems. In this work, a machine-learning-based multi-level damage characterization is demonstrated with the ability to transfer trained knowledge within the sparse sensor network. A novel network spatial assistance and an adaptive convolution technique are proposed for efficient knowledge transfer within the deep learning algorithm. Proposed structural health monitoring method is experimentally evaluated on an aluminum plate with artificially induced defects. It was observed that the method improves the performance of knowledge transferred damage characterization by 50% during localization and 24% during severity assessment. Further, experiments using time windows with and without multiple edge reflections are studied. Results reveal that multiply scattered waves contain rich and deterministic defect signatures that can be mined using deep learning neural networks, improving the accuracy of both identification and quantification. In the case of a fixed sensor network, using multiply scattered waves shows 100% prediction accuracy at all levels of damage characterization.

36 MATERIALS SCIENCE↗

Using Digital and Web-Based Platforms to Enhance Nuclear Power Plant Knowledge Transfer - 20203

As the workforce ages, the loss of experienced personnel can result in a loss of important knowledge. Updating Electric Power Research Institute (EPRI) research and guidance with the latest technology developments and operating experience is an important method to transfer knowledge between the retiring and incoming workforce. Studies suggest that the incoming workforce is accustomed to using digital and/or internet-based platforms to find information and may have a higher comfort with these types of platforms than they have with static, written reports. Additionally, the ease and speed of updating and delivering content through digital formats may offer an effective method for knowledge transfer and combining information from multiple reports into a single access point. EPRI has recently produced an online Decommissioning Hub available to members and is working on replicating the effort in the area of radioactive waste management called the Radwaste Web References. EPRI has extensive guidance in both disciplines. The Decommissioning Hub uses a wiki format to provide a platform that allows for both the updating of that guidance resulting from new research and new operating experiences, and combining related topical information from multiple reports. It also allows users to access the information based on key words and topical searches, and can be a tool for users to input experience to share with others. The Decommissioning Hub is accessed via a web-based portal and includes topical pages; experience summaries; a question and answer capability; and a smart search function of all EPRI decommissioning reports. Use of a wiki format allows users to input new experiences or modify existing experience summaries to add additional detail. EPRI moderates all content. The experience data base has been initially populated with information available in published EPRI reports and unpublished information currently available within EPRI. Moving forward, population of the database will continue with information available within the open literature, new information developed from current decommissioning projects, and user inputs. The web site became active in late 2017, and a major update will be issued in early 2020. Larger scale updates are planned biannually, and smaller-scale updates will occur continuously. Capturing and applying lessons learned from industry experiences is a hallmark of the global nuclear industry. This is even more important in the decommissioning technology area since very few plant staff have relevant experience and thus there is a steep learning curve. Moreover, decommissioning involves a number of complex, non-routine and specialized tasks. The web-accessible and searchable experience database provides an easy-to-use resource for capturing and disseminating practical experiences from completed and ongoing decommissioning projects. The EPRI Radwaste Web References will build upon the philosophy and objectives of the Radwaste Desk References that were published in the 1990's. The purpose of the original Radwaste Desk References was to provide nuclear power plant professionals with a how-to manual for managing radioactive waste. The Radwaste Web References will adopt this original purpose and will be a wiki type web site that provide fundamental practical and theoretical information, operating experience (OE), and information about advanced technologies and methods. As much as practicable, features that allow for interaction between users to share OE, best practices, and benchmarking will be added. Where they exist and are appropriate, the various EPRI Guidelines documents on radwaste topics will be updated and incorporated into the Radwaste Web References. The first Radwaste Web Reference will be on Low Level Waste Characterization and will build upon the EPRI Low Level Waste Characterization Guidelines (EPRI Report TR-107201, 1996) and will be available in 2020. The next Radwaste Web Reference will be on the topic of liquid radioactive waste processing and management, tentatively set for unveiling in 2021. This paper summarizes the EPRI's previous experiences with web-based platforms and future plans in this area. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

An Online Search Method for Representative Risky Fault Chains Based on Reinforcement Learning and Knowledge Transfer

In the analysis of cascading outages and blackouts in power systems, risky cascading fault chains should be accurately identified in order to do further block or alleviate blackouts. However, the huge computational burden makes online analysis difficult. In this paper, an online search method for representative risky fault chains based on reinforcement learning and knowledge transfer is proposed. This method aims at promoting efficiency by exploiting similarities of adjacent power flow snapshots in operations. After the “representative risky fault chain” is defined, a framework of tree search based on Markov Decision Process and Q-learning is constructed. The knowledge in past runs is accumulated offline and then applied online, with a mechanism of knowledge transition and extension. The proposed learning based approach is verified on an illustrative 39-bus system with different loading levels, and simulations are carried out on a realworld 1000-bus power grid in China to show the effectiveness and efficiency of the proposed approach.

Blackout↗

Challenges and Opportunities in Staffing and Knowledge Transfer at Research Reactors

University research reactors have been a cornerstone of nuclear engineering research and education since the first reactor was deployed at North Carolina State University in the 1950s. The population of university reactors grew to a high of almost 80 in 1970 but has dropped to 24 operating today. The US Department of Energy – Office of Nuclear Energy supports the remaining reactors through fuel and infrastructure funding. The Nuclear Science User Facilities (NSUF) collaborated with the National Organization of Test, Research, and Training Reactors (TRTR) to study the needs of the university research reactor community. Staffing and knowledge transfer were identified as critical areas. The panel will discuss challenges and opportunities in these areas including how COVID-19 has affected their facilities.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Gene-Metabolite Association Prediction with Interactive Knowledge Transfer Enhanced Graph for Metabolite Production

Identifying gene targets for enhancing metabolite production in metabolic engineering is challenging due to the vast research literature and the approximation in genome-scale metabolic model (GEM) simulations. Here, to address this, we propose the Gene-Metabolite Association Prediction task, which automates gene discovery for given metabolite-gene pairs, accompanied by a benchmark dataset of 2474 metabolites and 1947 genes for Saccharomyces cerevisiae (SC) and Issatchenkia orientalis (IO). This task is complicated by incomplete metabolic graphs and metabolic heterogeneity. We introduce an Interactive Knowledge Transfer mechanism based on Metabolism Graphs (IKT4Meta) to enhance prediction accuracy by integrating cross-metabolism knowledge. Using Pretrained Language Models (PLMs) to generate inter-graph links mitigates heterogeneity issues, while intra-graph links are propagated via these anchors. Gene-metabolite predictions are then performed on the enriched graphs integrating multiple microorganisms’ knowledge. Experiments show that IKT4Meta outperforms baselines by up to 12.3% in link prediction.

59 BASIC BIOLOGICAL SCIENCES↗

A Study on Efficient Reinforcement Learning Through Knowledge Transfer

Although Reinforcement Learning (RL) algorithms have made impressive progress in learning complex tasks over the past years, there are still prevailing short-comings and challenges. Specifically, the sample-inefficiency and limited adaptation across tasks often make classic RL techniques impractical for real-world applications despite the gained representational power when combining deep neural networks with RL, known as Deep Reinforcement Learning (DRL). Recently, a number of approaches to address those issues have emerged. Many of those solutions are based on smart DRL architectures that enhance single task algorithms with the capability to share knowledge between agents and across tasks by introducing Transfer Learning (TL) capabilities. Here this survey addresses strategies of knowledge transfer from simple parameter sharing to privacy preserving federated learning and aims at providing a general overview of the field of TL in the DRL domain, establishes a classification framework, and briefly describes representative works in the area.

97 MATHEMATICS AND COMPUTING↗

Knowledge Transfer Program for International Nuclear Safeguards

Nuclear safeguards were first announced in 1945 by the U.S., Canadian and British governments as a means to exchange scientific information about peaceful uses of atomic energy and prevent the use of nuclear material for weapons. International nuclear safeguards, now under the provision of the International Atomic Energy Agency (IAEA), serves to hold accountable the 140 member countries (States) that have entered into treaties and agreements against the spread of nuclear weapons. Most notably, the IAEA acts as a nuclear materials inspectorate under the global Nuclear Non-Proliferation Treaty, brought about in 1968, that specifies commitments member States make to the world?s non-proliferation regime. The Office of International Nuclear Safeguards (OINS) is part of the National Nuclear Security Administration, a semi-autonomous agency within the U.S. Department of Energy. Within OINS, the Human Capital Development program recognizes the need to build workforce capacity and safeguards expertise. This includes supporting the education and training of younger generations working in international nuclear safeguards. One of the program?s main concerns is core competencies being lost to retirement or attrition and building knowledge retention pipelines from senior to new professionals. One identified core competency is knowledge gained by individuals who have completed IAEA assignments such as missions to member States to conduct safeguards inspections. Such individuals possess unique knowledge, and efforts are being put forth to effectively capture this knowledge within the national laboratories complex. To this end, we report findings from a one-year mentor-mentee knowledge retention program in which an international safeguards subject matter expert imparted knowledge and skills to a willing professional mentee. The knowledge and skills stem from the mentor?s multi-year assignment at the IAEA in Vienna, Austria.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

Knowledge Transfer and Training in Safeguards for Decommissioned Nuclear Facilities (Project Final Report for FY2022)

The International Atomic Energy Agency (IAEA) applies safeguards to nuclear facilities that are not operating, including those undergoing decommissioning, and the IAEA’s effort in this area is both considerable and increasing. Specifically, the IAEA Department of Safeguards’ Division of Concepts and Planning (SGCP-003: Safeguards Approaches) identified an R&D need to “Develop safeguards implementation guidelines for facilities under decommissioning and safeguards concepts for post-accident facilities under decommissioning”. Nuclear facilities undergoing decommissioning are not exempt from safeguards agreements between the IAEA and Host State, and, accordingly, the requirement for verification of no diversion of nuclear material and detection of undeclared activities at decommissioned facilities remain even after facility shutdown. However, the effort required to meet safeguards objectives diminishes as nuclear material and essential equipment are removed during the decommissioning process which shifts the emphasis from verification of ever-diminishing fissile or source material inventories to verification of changes in facility design and equipment operability.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Distilling particle knowledge for fast reconstruction at high-energy physics experiments

Knowledge distillation is a form of model compression that allows artificial neural networks of different sizes to learn from one another. Its main application is the compactification of large deep neural networks to free up computational resources, in particular on edge devices. In this article, we consider proton-proton collisions at the High-Luminosity Large Hadron Collider (HL-LHC) and demonstrate a successful knowledge transfer from an event-level graph neural network (GNN) to a particle-level small deep neural network (DNN). Our algorithm, DistillNet, is a DNN that is trained to learn about the provenance of particles, as provided by the soft labels that are the GNN outputs, to predict whether or not a particle originates from the primary interaction vertex. The results indicate that for this problem, which is one of the main challenges at the HL-LHC, there is minimal loss during the transfer of knowledge to the small student network, while improving significantly the computational resource needs compared to the teacher. This is demonstrated for the distilled student network on a CPU, as well as for a quantized and pruned student network deployed on a field programmable gate array. Our study proves that knowledge transfer between networks of different complexity can be used for fast artificial intelligence (AI) in high-energy physics that improves the expressiveness of observables over non-AI-based reconstruction algorithms. Such an approach can become essential at the HL-LHC experiments, e.g. to comply with the resource budget of their trigger stages.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Progressive transfer learning for advancing machine learning-based reduced-order modeling

Abstract To maximize knowledge transfer and improve the data requirement for data-driven machine learning (ML) modeling, a progressive transfer learning for reduced-order modeling (p-ROM) framework is proposed. A key concept of p-ROM is to selectively transfer knowledge from previously trained ML models and effectively develop a new ML model(s) for unseen tasks by optimizing information gates in hidden layers. The p-ROM framework is designed to work with any type of data-driven ROMs. For demonstration purposes, we evaluate the p-ROM with specific Barlow Twins ROMs (p-BT-ROMs) to highlight how progress learning can apply to multiple topological and physical problems with an emphasis on a small training set regime. The proposed p-BT-ROM framework has been tested using multiple examples, including transport, flow, and solid mechanics, to illustrate the importance of progressive knowledge transfer and its impact on model accuracy with reduced training samples. In both similar and different topologies, p-BT-ROM achieves improved model accuracy with much less training data. For instance, p-BT-ROM with four-parent (i.e., pre-trained models) outperforms the no-parent counterpart trained on data nine times larger. The p-ROM framework is poised to significantly enhance the capabilities of ML-based ROM approaches for scientific and engineering applications by mitigating data scarcity through progressively transferring knowledge.

97 MATHEMATICS AND COMPUTING↗

Technology Transfer from Fermi Research Alliance to Itasca Plastics for the purpose of Commercializing Scintillator Material

Researchers at the Fermi National Accelerator Laboratory (Fermilab) developed extruded plastic scintillator in the late 1990s, which was first used in the D-Zero experiment. Extruded plastic scintillator is currently produced at Fermilab and is used in particle detectors worldwide. The purpose of this CRADA is to transfer the knowledge related to the Fermilab extrusion process to Itasca Plastics, Inc. (Itasca Plastics). Much of this knowledge is contained in documentation that is in the public domain, although it is distributed over several communications (papers, conference records, etc.) and over several years. Under this CRADA Fermilab will assemble the information, provide it to Itasca Plastics and provide limited consulting to complete the knowledge transfer. If the transfer is successful, Itasca Plastics will be able to establish a U.S. commercial manufacturing capability for extruded scintillator material that can be used for high energy physics and commercial applications.

36 MATERIALS SCIENCE↗

Systematic Analysis of Drivers and Barriers of Cross-Sectorial Learning Between Nuclear and Oil and Gas Decommissioning Projects - 20139

Project and megaproject management in the energy sector have historically focused on the planning and delivery of the construction of infrastructure. Therefore, policies are predominantly oriented to support the construction of infrastructure rather than its decommissioning. However, globally, several facilities have reached (or will soon reach) their end-of-life and need to be decommissioned. These facilities span across the energy sector, including nuclear power plants and oil and gas rigs, whose decommissioning present unprecedented techno-socio-economic challenges. Moreover, globally, their decommissioning cost is estimated to reach hundreds of billions of US dollars and this budget keeps increasing, with limited knowledge-transfer across industries to mitigate the spiraling increase of this figure. Cross-sectorial knowledge-transfer is a way to tackle this matter and improve the planning and delivery of decommissioning and waste management projects. The aim of this research is to build a road-map based on cross-sectorial industrial experience, designed to promote the sharing of good practices between projects both within and across industries dealing with major decommissioning and waste management challenges. To reach this aim, the tacit knowledge of senior practitioners on several large scale nuclear and oil and gas decommissioning projects is made explicit by the means of semi-structured interviews, systematically analyzed through directed content analysis. The results of this analysis include a list of good practices that could and should be transferred to nuclear decommissioning projects, including the need to promote the adoption of incentives explicitly linked to the project deliverables, and to develop long-term plans to support smooth transition from operations to decommissioning. Suggestions about how the knowledge-transfer can be promoted within and across organizations are also discussed. In this way, this research provides practical guidance for project managers and policymakers on how to support the planning and delivery of projects with improved performance. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Grimsel Test Site - A Successful International Underground Research Laboratory for Many Decades - 20429

For more than 35 years, Nagra and its partners from around the world have been conducting underground research projects at the Grimsel Test Site (GTS, www.grimsel.com) to contribute to the development and confirmation of safe geological disposal concepts and for the characterization of suitable host rock formations. Over the years, the results of this internationally recognized research program have been, and continue to be, incorporated directly into exploration programs, modelling, safety, and engineering feasibility studies on options for deep geological repositories. Each project of the GTS program involves field-testing, laboratory studies, design and modelling tasks, and integrates all scientific and technical aspects. Each project phase is planned with a duration of three to five years to facilitate practical and administrative aspects and allow flexibility for updating the overall project plans with the latest findings. Scientific and engineering interaction among the different projects is ensured via an international steering committee meeting. Hosting an IAEA level C radiation- controlled zone, which allows use of radionuclides, including actinides such as thorium, uranium, neptunium, plutonium and americium, in in-situ experiments is one of the reasons why GTS also developed as a center of excellence for work with radioactive tracers under realistic in-situ boundary conditions. Last year, a new five-year program (2019 to 2023) started which includes projects with a planning horizon of decades. The new five-year program includes a new phase of in-situ experiments using radionuclides such as migration experiments in the Colloid Formation and Migration project (CFM), the Long-Term Diffusion experiment (LTD) and the newly established C-14 and I-129 Migration in cement project (CIM). The 'High Temperature effects on Bentonite' (HotBENT) project is starting in the current phase and is studying the effects of elevated temperatures (>175 deg. C) on bentonite materials. As a generic underground research laboratory (URL) it is expected that the GTS will provide in the coming years a platform for international collaboration, knowledge development and knowledge transfer for the next generation of scientists and engineers in the area of radioactive waste disposal and geosciences. A key role regarding knowledge transfer and training is provided by the well-established Grimsel Training Center (GTC), which (beside many URL related issues) also covers many general aspects of radioactive waste management. In this paper we provide an overview of the current program at the GTS, focusing on the experiments that study the migration of radionuclides through engineered barrier materials and the geosphere. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

CRADA Number NFE-22-09333 with Holocene Climate Corporation (CRADA Final Report:)

Holocene Climate Corporation has developed and scaled up a novel technology for Direct Air Capture (DAC) that is based on cutting-edge research initiated at Oak Ridge National Laboratory (ORNL). According to the IPCC, carbon dioxide capture from the air and its sequestration are necessary to keep global temperature rise below 1.5°C by 2050. DAC is a viable and practical way to reach this goal. DAC can happen anywhere in the world, takes up a fraction of the land of forests, and along with the sequestration of CO 2 , provides permanent and verifiable removal of carbon from the atmosphere. The proposed project aimed to facilitate knowledge transfer from ORNL to Holocene focusing on (i) the synthesis of the ORNL patented material which builds the cornerstone of the DAC technology, and (ii) required analytical methods needed to conduct crystallization bench-scale experimentation and technology development. Furthermore, ORNL conducted research centered around CO 2 absorption using an air-liquid contacting structure with an aqueous amino acid solution. The achievements under this project comprise successful knowledge transfer from ORNL to the entire Holocene team to jump-start their internal R&D and technological development activities.

54 ENVIRONMENTAL SCIENCES↗

Suppressing simulation bias in multi-modal data using transfer learning

Abstract Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗