Search NASA⌕ Search

SEARCH · Search NASA

Results for “Collaborative Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Decentralized Collaborative Learning with Probabilistic Data Protection

We discuss future directions of Blockchain as a collaborative value co-creation platform, in which network participants can gain extra insights that cannot be accessed when disconnected from the others. As such, we propose a decentralized machine learning framework that is carefully designed to respect the values of democracy, diversity, and privacy. Specifically, we propose a federated multi-task learning framework that integrates a privacy-preserving dynamic consensus algorithm. We show that a specific network topology called the expander graph dramatically improves the scalability of global consensus building. We conclude the paper by making some remarks on open problems.

Ide, Tsuyoshi↗

Facilitating Machine Learning Collaborations Between Labs, Universities, And Industry

It is clear from numerous recent community reports, papers, and proposals that machine learning is of tremendous interest for particle accelerator applications. The quickly evolving landscape continues to grow in both the breadth and depth of applications including physics modeling, anomaly detection, controls, diagnostics, and analysis. Consequently, laboratories, universities, and companies across the globe have established dedicated machine learning (ML) and data science efforts aiming to make use of these new state-of-the-art tools. The current funding environment in the U.S. is structured in a way that supports specific application spaces rather than larger collaboration on community software. Here, we discuss the existing collaboration bottlenecks and how a shift in the funding environment, and how we develop collaborative tools, can help fuel the next wave of ML advancements for particle accelerators.

Edelen, J.P.↗

FL‐ADS: Federated learning anomaly detection system for distributed energy resource networks

Abstract With the ongoing development of Distributed Energy Resources (DER) communication networks, the imperative for strong cybersecurity and data privacy safeguards is increasingly evident. DER networks, which rely on protocols such as Distributed Network Protocol 3 and Modbus, are susceptible to cyberattacks such as data integrity breaches and denial of service due to their inherent security vulnerabilities. This paper introduces an innovative Federated Learning (FL)‐based anomaly detection system designed to enhance the security of DER networks while preserving data privacy. Our models leverage Vertical and Horizontal Federated Learning to enable collaborative learning while preserving data privacy, exchanging only non‐sensitive information, such as model parameters, and maintaining the privacy of DER clients' raw data. The effectiveness of the models is demonstrated through its evaluation on datasets representative of real‐world DER scenarios, showcasing significant improvements in accuracy and F1‐score across all clients compared to the traditional baseline model. Additionally, this work demonstrates a consistent reduction in loss function over multiple FL rounds, further validating its efficacy and offering a robust solution that balances effective anomaly detection with stringent data privacy needs.

Purohit, Shaurya [Iowa State University Ames Iowa ↗

Fair Concurrent Training of Multiple Models in Federated Learning

Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be trained simultaneously, sharing clients’ computing resources, which we call Multiple-Model Federated Learning (MMFL). Current MMFL algorithms use naïve average-based client-task allocation schemes that often lead to unfair performance when FL tasks have heterogeneous difficulty levels, as the more difficult tasks may need more client participation to train effectively. Furthermore, in the MMFL setting, we face a further challenge that some clients may prefer training specific tasks to others, and may not even be willing to train other tasks, e.g., due to high computational costs, which may exacerbate unfairness in training outcomes across tasks. We address both challenges by firstly designing FedFairMMFL, a difficulty-aware algorithm that dynamically allocates clients to tasks in each training round, based on the tasks’ current performance levels. We provide guarantees on the resulting task fairness and FedFairMMFL’s convergence rate. We then propose novel auction designs that incentivizes clients to train multiple tasks, so as to fairly distribute clients’ training efforts across the tasks, and extend our convergence guarantees to this setting. Here, we finally evaluate our algorithm with multiple sets of learning tasks on real world datasets, showing that our algorithm improves fairness by improving the final model accuracy and convergence speed of the worst performing tasks, while maintaining the average accuracy across tasks.

Federated learning↗

Benchmark for two-dimensional large scale coherent structures in partially magnetized E × B plasmas—community collaboration & lessons learned

Low-temperature plasmas (LTPs) are essential to both fundamental scientific research and critical industrial applications. As in many areas of science, numerical simulations have become a vital tool for uncovering new physical phenomena and guiding technological development. Code benchmarking remains crucial for verifying implementations and evaluating performance. This work continues the Landmark benchmark initiative, a series specifically designed to support the verification of LTP codes. In this study, seventeen simulation codes from a collaborative community of nineteen international institutions modeled a partially magnetized E × B Penning discharge. The emergence of large scale coherent structures, or rotating plasma spokes, endows this configuration with an enormous range of time scales, making it particularly challenging to simulate. The codes showed excellent agreement on the rotation frequency of the spoke as well as key plasma properties, including time-averaged ion density, plasma potential, and electron temperature profiles. Achieving this level of agreement came with challenges, and we share lessons learned on how to conduct future benchmarking campaigns. Comparing code implementations, computational hardware, and simulation runtimes also revealed interesting trends, which are summarized with the aim of guiding future plasma simulation software development.

benchmarking↗

Prospects of federated machine learning in fluid dynamics

Physics-based models have been mainstream in fluid dynamics for developing predictive models. In recent years, machine learning has offered a renaissance to the fluid community due to the rapid developments in data science, processing units, neural network based technologies, and sensor adaptations. So far in many applications in fluid dynamics, machine learning approaches have been mostly focused on a standard process that requires centralizing the training data on a designated machine or in a data center. In this article, we present a federated machine learning approach that enables localized clients to collaboratively learn an aggregated and shared predictive model while keeping all the training data on each edge device. We demonstrate the feasibility and prospects of such a decentralized learning approach with an effort to forge a deep learning surrogate model for reconstructing spatiotemporal fields. Our results indicate that federated machine learning might be a viable tool for designing highly accurate predictive decentralized digital twins relevant to fluid dynamics.

36 MATERIALS SCIENCE↗

Community Solar Policy Screening Workbook for Multifamily Affordable Housing Building Portfolios

This workbook provides a framework to help Multifamily Affordable Housing (MFAH) housing providers evaluate state-level policy landscapes as they relate to MFAH community solar development. By exploring which programs and policies aid in the technical and economic feasibility of MFAH solar projects, building owners can gain an understanding of where in their portfolios to begin developing solar. This workbook also walks through the steps necessary for MFAH building owners to assess their portfolios using this framework. It was developed by the National Renewable Energy Laboratory for the National Community Solar Partnership (NCSP) Multifamily Affordable Housing Collaborative. Learn more about the NCSP and the Collaborative at https://www.energy.gov/communitysolar/community-solar.

14 SOLAR ENERGY↗

A New Approach to Distributed Hypothesis Testing and Non-Bayesian Learning: Improved Learning Rate and Byzantine-Resilience

Here, we study a setting where a group of agents, each receiving partially informative private signals, seek to collaboratively learn the true underlying state of the world (from a finite set of hypotheses) that generates their joint observation profiles. To solve this problem, we propose a distributed learning rule that differs fundamentally from existing approaches, in that it does not employ any form of “belief-averaging”. Instead, agents update their beliefs based on a min-rule. Under standard assumptions on the observation model and the network structure, we establish that each agent learns the truth asymptotically almost surely. As our main contribution, we prove that with probability 1, each false hypothesis is ruled out by every agent exponentially fast, at a network-independent rate that is strictly larger than existing rates. We then develop a computationally-efficient variant of our learning rule that is provably resilient to agents who do not behave as expected (as represented by a Byzantine adversary model) and deliberately try to spread misinformation.

42 ENGINEERING↗

Examining professional emergency managers in Korea

Although the number of emergency managers has risen in South Korea (hereafter referred to as Korea) over the years, their role is not yet as defined and noteworthy compared to other professions because of its unidisciplinary approach. This article investigates how Korea has to improve emergency managers' disciplinary approach to ultimately contribute to the goal of effective transnational disaster management. This study uses qualitative content analysis of government policies, college curricula, nongovernmental organizations' (NGOs') emergency-manager certification, and mass media coverage to compare emergency managers' unidisciplinary and multidisciplinary approaches. The key tenet is that Korea must change its emergency managers' unidisciplinary approach into a multidisciplinary approach because the former is less effective when dealing with complicated disaster management systems. To achieve this change, the stakeholders must carry out their assigned responsibilities under risk-oriented management. As for the study's international implications, developing nations may consider the enhancement of related educational curricula, collaborative learning, continuous evaluation, disaster awareness, and disaster prevention for the emergency managers' multidisciplinary approach.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Knowledge to Support Climate Action: A Framework for Sustained Assessment. Report of an Independent Advisory Committee on Applied Climate Assessment

As states, cities, tribes, and private interests cope with climate damages and seek to increase preparedness and resilience, they will need to navigate myriad choices and options available to them. Making these choices in ways that identify pathways for climate action that support their development objectives will require constructive public dialogue, community participation, and flexible and ongoing access to science- and experience-based knowledge. In 2016, a Federal Advisory Committee (FAC) was convened to recommend how to conduct a sustained National Climate Assessment (NCA) to increase the relevance and usability of assessments for informing action. The FAC was disbanded in 2017, but members and additional experts reconvened to complete the report that is presented here. A key recommendation is establishing a new nonfederal ‘‘climate assessment consortium’’ to increase the role of state/local/tribal government and civil society in assessments. The expanded process would 1) focus on applied problems faced by practitioners, 2) organize sustained partnerships for collaborative learning across similar projects and case studies to identify effective tested practices, and 3) assess and improve knowledge-based methods for project implementation. Specific recommendations include evaluating climate models and data using user-defined metrics; improving benefit–cost assessment and supporting decision-making under uncertainty; and accelerating application of tools and methods such as citizen science, artificial intelligence, indicators, and geospatial analysis. The recommendations are the result of broad consultation and present an ambitious agenda for federal agencies, state/local/tribal jurisdictions, universities and the research sector, professional associations, nongovernmental and community-based organizations, and private-sector firms.

54 ENVIRONMENTAL SCIENCES↗

Abstract for CRADA between NETL and Equinor U.S. Holdings Inc.

The focus of this collaboration is to offer narrative and analysis across life cycle GHG emissions of the proposed hydrogen hub, techno-economic and market factor analyses informed insights on transportation and storage for hydrogen, and the development of social justice and workforce readiness plans to introduce the hydrogen economy to Appalachia. The proposed work also includes supporting narrative and analysis to achieve market adoption of hydrogen and follow-on investments to build out a national clean hydrogen network. The outcome of this collaboration will enable Equinor to respond to the Region Clean Hydrogen Hub FOA 2779 most effectively and to decarbonize and effectively develop a hydrogen market in Appalachia, while enhancing NETL’s modeling through direct industry collaboration. Learnings and improvements will be incorporated into future updates of NETL’s mechanisms, tools, and insights.

08 HYDROGEN↗

CHISSL: A Human-Machine Collaboration Space for Unsupervised Learning

We developed CHISSL, a human-machine interface that utilizes supervised machine learning in an unsupervised context to help the user group unlabeled instances by her own mental model. The user primarily interacts via correction (moving a misplaced instance into its correct group) or confirmation (accepting that an instance is placed in its correct group). Concurrent with the user's interactions, CHISSL trains a classification model guided by the user's grouping of the data. It then predicts the group of unlabeled instances and arranges some of these alongside the instances manually organized by the user. We hypothesize that this mode of human and machine collaboration is more effective than Active Learning, wherein the machine decides for itself which instances should be labeled by the user. We found supporting evidence for this hypothesis in a pilot study where we applied CHISSL to organize a collection of handwritten digits.

Active Learning↗

AI for nuclear physics: the EXCLAIM project

An overview of the recent activity of the newly funded EXCLusives with AI and Machine learning (EXCLAIM) collaboration is presented. The main goal of the collaboration is to develop a framework to implement AI and machine learning techniques in problems emerging from the phenomenology of high energy exclusive scattering processes from nucleons and nuclei, maximizing the information that can be extracted from various sets of experimental data, while implementing theoretical constraints from lattice QCD. A specific perspective embraced by EXCLAIM is to use the methods of theoretical physics to understand the working of ML, beyond its standardized applications to physics analyses which most often rely on industrially provided tools, in an automated way.

Analysis and statistical methods↗

Adversarial Training for Privacy-Preserving Deep Learning Model Distribution

Collaboration among cancer registries is essential to develop accurate, robust, and generalizable deep learning models for automated information extraction from cancer pathology reports. Sharing data presents a serious privacy issue, especially in biomedical research and healthcare delivery domains. Distributing pretrained deep learning (DL) models has been proposed to avoid critical data sharing. However, there is growing recognition that collaboration among clinical institutes through DL model distribution exposes new security and privacy vulnerabilities. These vulnerabilities increase in natural language processing (NLP) applications, in which the dataset vocabulary with word vector representations needs to be associated with the other model parameters. In this paper, we propose a novel privacy-preserving DL model distribution across cancer registries for information extraction from cancer pathology reports with privacy and confidentiality considerations. The proposed approach exploits the adversarial training framework to distinguish private features from shared features among different datasets. It only shares registry-invariant model parameters, without sharing raw data nor registry-specific model parameters among cancer registries. Thus, it protects both the data and the trained model simultaneously. We compare our proposed approach to single-registry models, and a model trained on centrally hosted data from different cancer registries. The results show that the proposed approach significantly outperforms the single-registry models and achieves statistically indistinguishable micro and macro F1-score as compared to the centralized model.

Alawad, Mohammed↗

Challenges and priorities for modelling livestock health and pathogens in the context of climate change

Climate change has the potential to impair livestock health, with consequences for animal welfare, productivity, greenhouse gas emissions, and human livelihoods and health. Modelling has an important role in assessing the impacts of climate change on livestock systems and the efficacy of potential adaptation strategies, to support decision making for more efficient, resilient and sustainable production. However, a coherent set of challenges and research priorities for modelling livestock health and pathogens under climate change has not previously been available. To identify such challenges and priorities, researchers from across Europe were engaged in a horizon-scanning study, involving workshop and questionnaire based exercises and focussed literature reviews. Eighteen key challenges were identified and grouped into six categories based on subject-specific and capacity building requirements. Across a number of challenges, the need for inventories relating model types to different applications (e.g. the pathogen species, region, scale of focus and purpose to which they can be applied) was identified, in order to identify gaps in capability in relation to the impacts of climate change on animal health. The need for collaboration and learning across disciplines was highlighted in several challenges, e.g. to better understand and model complex ecological interactions between pathogens, vectors, wildlife hosts and livestock in the context of climate change. Collaboration between socio-economic and biophysical disciplines was seen as important for better engagement with stakeholders and for improved modelling of the costs and benefits of poor livestock health. The need for more comprehensive validation of empirical relationships, for harmonising terminology and measurements, and for building capacity for under-researched nations, systems and health problems indicated the importance of joined up approaches across nations. The challenges and priorities identified can help focus the development of modelling capacity and future research structures in this vital field. Well-funded networks capable of managing the long-term development of shared resources are required in order to create a cohesive modelling community equipped to tackle the complex challenges of climate change. - Highlights: • Experts identified challenges for health and pathogen modelling under climate change. • Eighteen key challenges and associated research priorities were identified. • Increasing capacity will require improved organisation and sharing knowledge. • Better communication across the diverse topics and approaches in this field is needed.

54 ENVIRONMENTAL SCIENCES↗

Ising-CF: A Pathbreaking Collaborative Filtering Method Through Efficient Ising Machine Learning

Due to Ising models’ strong expressivity and Ising machines’ unique computational power, it is highly desired if Ising-based learning can be used in real-world applications. Unfortunately, the challenges in learning Ising models and gaps between the practical accuracy of Ising machines and the theoretical accuracy of Ising models impede the realization of Ising machines’ potential. Hence, we propose an Ising Machine Learning framework, Ising-CF, for collaborative filtering, a widely-used recommendation method. Specifically, Ising-CF uses Linear Neural Networks with Besag’s pseudo-likelihood and voltage polarization for fast, accurate Ising model learning and an Ising-specific logarithmic quantization for ns-level Ising machine inference with near-theoretical accuracy, 7.3% over SOTA.

Liu, Zhuo↗