Search NASA⌕ Search

SEARCH · Search NASA

Results for “User evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Deep Learning for Fish Identification from Sonar Data (CRADA 481 Final Report)

In eastern regions of the United States, the American eel is a species of management and regulatory concern because of significant population declines, despite the species’ previous abundance in all tributaries of rivers flowing into the Atlantic Ocean. The American eel is also a candidate for listing under the U.S. Endangered Species Act. While hydropower construction and operation are only one of several factors contributing to this population decline, such a listing could impose additional regulatory challenges for a large number of hydropower projects. In this CRADA project, we improved technologies for identifying migrating eels with the goal of reducing the cost and time required for future American eel hydropower impact assessment and mitigation studies, while maintaining accuracy. We built on results from a previous FOA project (FOA# DE-FOA-0001662), led by the Electric Power Research Institute (EPRI), which developed a highly accurate, deep-learning method for identifying migrating eels from imaging sonar data. The current study aimed to further optimize this deep-learning model, originally designed for image classification, and to develop an object detection software capable of identifying fish from sonar videos in real time, enabling the detection of events like fish migrations and specific species, such as the American eel, at hydropower dams. The data conversion algorithms were packaged as software with a graphical user interface, and the software is evaluated by external collaborators. We focused on the American eel in this project and explored the transferability of the developed deep learning models to the sea lamprey, given the similar body shape and swimming behavior between the two species.

13 HYDRO ENERGY↗

Ultrasonic Transducer Irradiation Test Results

Ultrasonic technologies offer the potential for high accuracy and resolution in-pile measurement of a range of parameters, including geometry changes, temperature, crack initiation and growth, gas pressure and composition, and microstructural changes. Many Department of Energy-Office of Nuclear Energy (DOE-NE) programs are exploring the use of ultrasonic technologies to provide enhanced sensors for in-pile instrumentation during irradiation testing. For example, the ability of small diameter ultrasonic thermometers (UTs) to provide a temperature profile in candidate metallic and oxide fuel would provide much needed data for validating new fuel performance models. These efforts are limited by the lack of identified ultrasonic transducer materials capable of long term performance under irradiation test conditions. To address this need, the Pennsylvania State University (PSU) was awarded an Advanced Test Reactor National Scientific User Facility (ATR NSUF) project to evaluate the performance of promising magnetostrictive and piezoelectric transducers in the Massachusetts Institute of Technology Research Reactor (MITR) up to a fast fluence of at least 1021 n/cm2 . A multi-National Laboratory collaboration funded by the Nuclear Energy Enabling Technologies Advanced Sensors and Instrumentation (NEET ASI) program also provided initial support for this effort. This irradiation, which started in February 2014, is an instrumented lead test and real-time transducer performance data are collected along with temperature and neutron and gamma flux data. The irradiation is ongoing and will continue to approximately mid-2015. To date, very encouraging results have been attained as several transducers continue to operate under irradiation.

Daw, Joshua↗

Summary of Expansions and Updates in R&D GREET® 2025

The research and development (R&D) version of Greenhouse gases, Regulated Emissions, and Energy use in Technologies (GREET®) model, or R&D GREET, is developed by Argonne National Laboratory (Argonne) with the support of the U.S. Department of Energy (DOE) and other federal agencies. R&D GREET is a life cycle analysis (LCA) model, structured to systematically examine the energy and environmental effects of a wide variety of transportation fuels and vehicle technologies in all transportation sub-sectors (i.e., road, air, marine, and rail) and other end-use sectors, and energy technology systems. Argonne has expanded and updated the model in many areas in R&D GREET 2025. This report provides a summary of the expansions and updates. R&D GREET is designed as an attributional LCA model, but specific consequential effects for certain pathways are included by default when they are scientifically important and/or highly policy relevant. For example, two major consequential elements – induced land use change (ILUC) for biofuels and avoided emissions for certain RNG-based pathways – are implemented by default in R&D GREET because they are highly relevant to our user base and crucial for a comprehensive evaluation of the environmental effects of these technologies. In a future version of R&D GREET, these consequential elements for biofuels and RNG could be more clearly distinguished from core attributional results. We will consider adding a highly visible toggle that would allow users to turn off or adjust these consequential impacts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Meta-analysis of North American Arctic and boreal aboveground biomass datasets: assessing accuracy, dynamics, and similarities

The North American arctic and boreal regions (ABRs) are rapidly warming and experiencing intensifying disturbances. Accurately quantifying aboveground biomass (AGB) is critical for understanding the impacts of these changes on the carbon cycle and for designing climate change mitigation strategies. Several AGB maps have been developed for the North American ABRs, including recent contributions from National Aeronautics and Space Administration’s Arctic-Boreal Vulnerability Experiment (ABoVE) campaign. However, these maps differ widely in training data, methodology, and resulting AGB density estimates. Presently, a comprehensive comparative evaluation is lacking, making it difficult for users to select datasets suited to their research or management needs. Here, in this study, we conducted a comparative analysis of nine AGB density datasets across North American ABRs, specifically for Alaska and Canada. We (1) summarized AGB by ecoregion and Canadian provinces, (2) evaluated their accuracy against field-based measurements, (3) analyzed spatial and temporal similarities among datasets, and (4) assessed their ability to capture disturbance (fire and harvest) impacts on AGB. We found substantial variation in regional and local AGB estimates across datasets, with overall accuracy ranging from R 2 = 0.25–0.62 and Bias% from −47.8% to 69.9% when validated against field plots. Despite these differences, most datasets have comparatively consistent spatial patterns in AGB (r > 0.8 for most cases). In contrast, agreement on the temporal patterns of AGB change is generally low. We found datasets with spatial resolutions ⩽300 m are capable of capturing disturbance impacts on AGB dynamics, though sensitivity varies across products. Our findings and dataset summary provide guidance for selecting appropriate AGB datasets for different applications within our study area. Our analysis also highlights the need to decrease map bias and increase capability to detect temporal change to decrease uncertainty of AGB datasets potentially by using training data which is representative of major plant functional types within the mapped area.

ABoVE↗

Introduction to MDSplus using Docker

With increased use of MDSplus comes an influx of new users. With them comes a need for more and better ways to learn the suite of tools that is MDSplus. Therefore, the MDSplus team continually evaluates new technologies to improve our software and user experience. To this end, we investigated Docker to determine if and how it could help new users understand MDSplus, make MDSplus easier to install, and allow us to easily test old/new versions. To achieve this, a set of Docker images and instructions have been developed. This paper will provide an overview of MDSplus, and detail the methods to create and use the Docker images. Additionally, we will explore the limitations of such an approach, and the recommended applications. The project where these Docker Images were built, along with the Demo is here: https://github.com/WhoBrokeTheBuild/DockerizedMDSplus https://hub.docker.com/r/whobrokethebuild/mdsplus The now official Docker Images are available here: https://github.com/MDSplus/Docker https://hub.docker.com/r/mdsplus/mdsplus

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Electricity Subsector Transmission Resilience Maturity Model (TRMM) User Guide

The electric transmission sector is facing a range of threats to its functionality that are either new, more severe than experienced in earlier years, or more well understood. Such threats include more frequent and more severe extreme weather events, wildfires, droughts, and human-caused physical and cyberattacks. They also include geological, electromagnetic, and biological events. The novelty or increasing severity of these threats creates a significant need for transmission owners to implement programs to prevent, prepare for, respond to, and recover from such incidents. The national and economic security of the United States depends on the reliable functioning of the Nation’s critical infrastructure in the face of such threats, and the transmission networks are essential components of that infrastructure. The Electricity Subsector Transmission Resilience Maturity Model (TRMM) is a tool that a transmission organization can use to objectively evaluate and benchmark its currently established transmission resilience strategies, programs, policies, and investments, in order to target and prioritize enhancements where needed. The TRMM was developed to address the unique characteristics of the transmission system. The model can enable users to: • evaluate and benchmark their organization’s resilience capabilities, effectively and consistently • prioritize actions and investments to improve the resilience of their systems • share transmission-related knowledge, best practices, and relevant references within their organization and with business partners as a means to improve resilience capabilities • contribute to increasing the overall resilience of the Nation’s transmission systems. The TRMM provides descriptive rather than prescriptive industry-focused guidance. The model content is presented at a high level of abstraction so that it can be interpreted by transmission organizations of various types, structures, and sizes. The model is designed to an be easy-to-use, self-assessment tool.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Trusted Simulation: Considering Model Quality in the Context of User Trust

A high‐quality simulation model should help its users to easily and appropriately calibrate their trust in the model. Traditional evaluation metrics such as validation and robustness are necessary but insufficient for this task. Trust calibration depends on factors like the model's transparency, applicability to intended use, usability, reputation, and consideration of potential bias. This article proposes a framework for designing and evaluating system dynamics models by considering factors that contribute to the proper calibration of user trust. This framework takes inspiration from trusted artificial intelligence, broadening our traditional concept of model quality and explicitly focusing on what users need to consider a model trustworthy and to understand the model's relevance to its intended purpose. The trusted simulation framework can improve our integration of model quality activities throughout the modeling process, leading to more impactful and better‐targeted model design, development, and evaluation.

Naugle, Asmeret Bier [Sandia National Laboratories↗

Environmental and economic optima of solar home systems design: A combined LCA and LCC approach

Here, we compare the economic and environmental optimal design of Solar Home Systems (SHSs) and explore the role of economic incentives (such as tariffs and technology costs) in approximating the two optima. To achieve that, we present a methodology for the environmental and economic evaluation of grid-connected SHSs: user-scale electric systems involving a photovoltaic (PV) power system and a battery energy storage system. The proposed methodology is based on a mixed integer linear programming (MILP) optimization, life cycle assessment and life cycle costing. This methodological framework is applied to a case study involving a typical SHS installation in Italy. The results of the environmental optimal design brought to the evaluation of a 3.25 kW PV assisted by 8.66 kWh of nickel cobalt manganese batteries, whereas the costs of the SHS are minimized by a small PV system (less than 1 kW). Results underline that the environmental optimal configurations rely on battery technologies, which entails a significant cost compared to the grid connection. In contrast, the economic optimal design solutions is less impactful than the grid mix both from an environmental and economic points of view. Thanks to a reduction of batteries and PV costs, the environmental impact of the economic optimal design is expected to decrease in the future.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Enabling power measurement and control on Astra: The first petascale Arm supercomputer

Astra, deployed in 2018, was the first petascale supercomputer to utilize processors based on the ARM instruction set. The system was also the first under Sandia's Vanguard program which seeks to provide an evaluation vehicle for novel technologies that with refinement could be utilized in demanding, large-scale HPC environments. In addition to ARM, several other important first-of-a-kind developments were used in the machine, including new approaches to cooling the datacenter and machine. Here we document our experiences building a power measurement and control infrastructure for Astra. While this is often beyond the control of users today, the accurate measurement, cataloging, and evaluation of power, as our experiences show, is critical to the successful deployment of a large-scale platform. While such systems exist in part for other architectures, Astra required new development to support the novel Marvell ThunderX2 processor used in compute nodes. In addition to documenting the measurement of power during system bring up and for subsequent on-going routine use, we present results associated with controlling the power usage of the processor, an area which is becoming of progressively greater interest as data centers and supercomputing sites look to improve compute/energy efficiency and find additional sources for full system optimization.

97 MATHEMATICS AND COMPUTING↗

Small field campaign: aerosol – ice formation closure pilot study. Final Report

Prediction of atmospheric ice formation from aerosol particles by heterogeneous nucleation represents one of the grand challenges in atmospheric science. Our insufficient predictive understanding of primary ice formation is the reason that climate models typically do not include heterogeneous ice nucleation with subsequent effects on climate uncertainty. Mixed-phase clouds, where supercooled water droplets and ice crystals coexist play globally an important role regulating climate. This is especially the case for the Arctic region that experiences the greatest warming due to climate change compared to other regions in the world. Immersion freezing initiated by ice-nucleating particles (INPs) in supercooled water droplets is recognized as the dominant primary ice formation pathway in mixed-phase cloud regimes. For this reason, it is crucial to evaluate our capability to predict immersion freezing for a given ambient aerosol population. The goal of this project is conducting a field-based pilot study at the U.S. DOE Atmospheric Radiation Measurement (ARM) user facility at Southern Great Plains (SGP) to evaluate our capability to predict the number concentration of aerosol particles that serve as INPs in the immersion freezing mode. Successful prediction of INP number concentrations is also termed “closure”. This field-observational approach represents a first-of-its kind attempt of an aerosol–ice formation closure study (AEROICESTUDY). Very few closure studies related to INPs have been conducted, and to our knowledge, none using robust size-resolved ambient aerosol composition measurements as a starting point. Achievement of aerosol–ice formation closure relies on our ability to characterize the ambient aerosol population with respect to particles size and composition and to determine INP number concentrations for specified freezing temperatures. This requires numerous online and offline instrumentation resulting in this pilot field campaign being a multi-institutional and community-collaborative effort. We chose the ARM SGP megasite for this first aerosol-ice formation closure pilot study due to its significant measurement capabilities available to obtain detailed physical characterization of the local aerosol population including size distribution, mass loading, and chemical composition of non-refractory aerosol particles. The overall objective of this project is to identify ice nucleation parameterizations that produce the most robust predictions of INP numbers and thus are best suited to be included in cloud and climate models. This objective includes the following goals for this field and laboratory-based project: i) What are the crucial aerosol physicochemical property measurements needed to accurately guide ice nucleation representations in models and long-term INP measurements? ii) What level of parameter details needs to be known to achieve aerosol–ice formation closure? iii) What are the leading causes for climate model bias in INP predictions? We found that the advances in our understanding of immersion freezing garnered over the last 20 years allowed us to yield partial and full closures of atmospheric immersion freezing from ambient aerosol particles. When the aerosol population is physicochemically complex and parameterizations for representative INP types are not yet available, we still struggle to accurately predict INP number concentrations. This project clearly demonstrates that with more laboratory and field measurements that are accompanied by particle composition analysis, the necessary datasets to achieve aerosol–ice formation closure for various locations will emerge, thus providing a robust foundation for guiding the representation of INPs in cloud and climate models.

54 ENVIRONMENTAL SCIENCES↗

An Integrated Framework for Risk Assessment of Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants: Methodology Refinement and Exploration

This report documents activities performed by Idaho National Laboratory (INL) during Fiscal Year (FY) 2023 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) risk assessment project. In FY 2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a technical basis to support effective, and secure DI&C technologies for digital upgrades/designs. A risk assessment-informed framework was proposed for this strategy, which aims to (1) provide a best-estimate, risk informed capability to quantitatively estimate the safety margin obtained from plant modernization, especially for safety-related DI&C systems, (2) support and supplement existing risk informed DI&C design guides by providing quantitative risk information and evidence, (3) offer a capability of design architecture evaluation of various DI&C systems, (4) assure the long-term safety and reliability of safety-related DI&C systems, and (5) reduce uncertainty in costs and support integration of DI&C systems in the plant. To achieve these technical goals, the LWRS-developed framework provides a means to address relevant technical issues by: (1) defining a risk informed analysis process for DI&C upgrade that integrates hazard analysis, reliability analysis, and consequence analysis, (2) applying risk informed tools to address common cause failures (CCFs) and quantify corresponding failure probabilities for DI&C technologies, particularly software CCFs, (3) evaluating the impact of digital failures at the component level, system level, and plant level, and (4) providing insights and suggestions on designs to manage the risks, thus to support the development and deployment of advanced DI&C technologies in nuclear power plants (NPPs). Adding diversity within a system or components is the primary means to eliminate and mitigate CCFs, but diversity also increases system complexity and may not address all sources of systematic failures. Optimization of diversity and redundancy applications for the safety-critical DI&C systems remains a challenge. To deal with the technical issues in addressing potential software CCFs in safety-related DI&C systems of NPPs and supporting relevant design optimization, the proposed framework provides: (a) A best-estimate, risk informed capability to address new technical digital issues quantitatively, focusing on software CCFs in safety-related DI&C systems of NPPs; (b) A common and a modularized platform for DI&C designers, software developers, cybersecurity analysts, and plant engineers to predict and prevent risk in the early design stage of DI&C systems; (c) Technical bases and risk informed insights to assist users address the risk informed alternatives for evaluation of CCFs in safety-related DI&C systems of NPPs; and (d) A risk informed tool that offers a capability of design architecture evaluation of various DI&C systems to support system design decisions in diversity and redundancy applications. The research and development efforts of this project in FY 2023 are focused on refining current methods on software CCF modeling and estimation and exploring additional innovative approaches to risk assessment of DI&C systems to enable a more comprehensive and complete assessment of various safety-related DI&C design architectures. The primary audience of this report are DI&C designers, engineers, and probabilistic risk assessment (PRA) practitioners. This includes stakeholders, such as the nuclear utilities and regulators who consider the deployment and upgrade of DI&C systems, DI&C software developers and reviewers, and cybersecurity specialists. It should be noted that all the analyses are performed for the demonstration of the methodology, not for the evaluation of an actual digital control system. Results are obtained based on limited design information and testing data.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

AIMD‐Based Protocols for Modeling Exciplex Fluorescence Spectra and Inter‐System Crossing in Photocatalytic Chromophores

ABSTRACT This study introduces a computational protocol for modeling the emission spectra of exciplexes using excited‐state ab initio molecular dynamics (AIMD) simulations. The protocol is applied to a model exciplex formed by oligo‐p‐phenylenes (OPPs) and triethylamine (TEA), which is of interest in the context of photocatalytic reduction of . AIMD facilitates efficient sampling of the conformational space of OPP3 and OPP4 exciplexes with TEA, offering a dynamic alternative to previously employed static methods. The AIMD‐based protocol successfully reproduces experimental emission spectra for OPP‐TEA exciplexes, agreeing with previous computational and experimental findings. The results show that AIMD simulations provide an efficient means of sampling the conformational space of these exciplexes, requiring less user input and, in some instances, fewer computational resources than multiple excited‐state optimizations initiated from user‐specified initial structures. The study also evaluates the yield of intersystem crossing (ISC) using AIMD and Landau‐Zener probability. The results suggest that ISC is a minor decay channel for OPP3 and OPP4. This work provides new insights into the structural flexibility and emission characteristics of OPP‐TEA photoredox catalyst systems, potentially contributing to improved design strategies for organic chromophores in reduction applications.

Giudetti, Goran [Department of Chemistry Universit↗

Data Placement Optimization for ATLAS in a Multi-Tiered Storage System within a Data Center

Scientific experiments and computations, especially in High Energy Physics, are generating and accumulating data at an unprecedented rate. Effectively managing this vast volume of data while ensuring efficient data analysis poses a significant challenge for data centers, which must integrate various storage technologies. This paper proposes addressing this challenge by designing and developing a precise data popularity prediction model utilizing state-of-theart AI/ML techniques. This model is crafted from the analysis of ATLAS data and access patterns. It enables us to migrate infrequently accessed data to more economical storage media, such as tape drives, while storing frequently accessed data on faster yet costlier storage media like HDD or SSD. This strategic approach ensures data is placed optimally into the appropriate storage classes, thereby maximizing storage capacity while minimizing data access latency for end-users. Furthermore, the paper includes a performance evaluation of the prediction model using various key metrics such as F1 score, accuracy, precision and recall. Finally, we present a prototype use case, leveraging real-world file access data to assess the model’s impact on performance.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Assessment of Electric Grid Transmission System Simulator for Human Factors Research

Over the past decades, various technologies have been developed for electric grid operations to support clean energy, meet rising electricity demands, and address infrastructure concerns. However, the human factors aspect is often overlooked during rapid integration. Questions persist about how these technologies impact human performance. Simulators play a critical role in supporting investigation of human factors design concepts and conducting comprehensive usability testing to evaluate human performance and assess human reliability. This paper aims to address human factors research simulator requirements and conduct a comparative study of six different simulators. A detailed evaluation reveals that the evaluated simulators lack the ability to customize user interfaces. Additionally, their user interface designs do not fulfill the basic human factors design principles, potentially leading to increased response variability and reduced statistical power when conducting controlled experimental research. In the future, it is essential to develop scripting tools to integrate customizable user interfaces and simulation models, ensuring meeting research requirements.

Li, Ruixuan↗

Carbon Storage Planning Inquiry Tool (CS PlanIT)

The CS PlanIT provides stakeholders with easy access to geographically explore, query, and evaluate multiple data layers for a user-defined area of interest, with the goal to accelerate carbon storage resource, feasibility assessments, and planning efforts. The data within CS PlanIT are arranged and categorized to assess each stage of the Carbon Capture and Storage supply chain, from CO2 (Carbon Dioxide) emission sources, critical energy infrastructure (including transport), to CO2 geologic storage and sink locations. Furthermore, stakeholders can gain insights into community and environmental impacts, as CS PlanIT leverages Environmental Justice and Social Justice (EJSJ) and natural hazard datasets. Additionally, documentation in the form of an interactive ArcGIS story map and data catalog are included within the EDX publication to provide user’s information to better understand and explain CS PlanIT’s layout, functions, and associated data sets.

Justman, Devin M.↗

Technical descriptions of the experimental dynamical downscaling simulations over North America by the CAM–MPAS variable-resolution model

Abstract. Comprehensive assessment of climate datasets is important for communicating model projections and associated uncertainties to stakeholders. Uncertainties can arise not only from assumptions and biases within the model but also from external factors such as computational constraint and data processing. To understand sources of uncertainties in global variable-resolution (VR) dynamical downscaling, we produced a regional climate dataset using the Model for Prediction Across Scales (MPAS; dynamical core version 4.0) coupled to the Community Atmosphere Model (CAM; version 5.4), which we refer to as CAM–MPAS hereafter. This document provides technical details of the model configuration, simulations, computational requirements, post-processing, and data archive of the experimental CAM–MPAS downscaling data. The CAM–MPAS model is configured with VR meshes featuring higher resolutions over North America as well as quasi-uniform-resolution meshes across the globe. The dataset includes multiple uniform- (240 and 120 km) and variable-resolution (50–200, 25–100, and 12–46 km) simulations for both the present-day (1990–2010) and future (2080–2100) periods, closely following the protocol of the North American Coordinated Regional Climate Downscaling Experiment. A deviation from the protocol is the pseudo-warming experiment for the future period, using the ocean boundary conditions produced by adding the sea surface temperature and sea-ice changes from the low-resolution version of the Max Planck Institute Earth System Model (MPI-ESM-LR) in the Coupled Model Intercomparison Project Phase 5 to the present-day ocean state from a reanalysis product. Some unique aspects of global VR models are evaluated to provide background knowledge to data users and to explore good practices for modelers who use VR models for regional downscaling. In the coarse-resolution domain, strong resolution sensitivity of the hydrological cycles exists over the tropics but does not appear to affect the midlatitude circulations in the Northern Hemisphere, including the downscaling target of North America. The pseudo-warming experiment leads to similar responses of large-scale circulations to the imposed radiative and boundary forcings in the CAM–MPAS and MPI-ESM-LR models, but their climatological states in the historical period differ over various regions, including North America. Such differences are carried to the future period, suggesting the importance of the base state climatology. Within the refined domain, precipitation statistics improve with higher resolutions, and such statistical inference is verified to be negligibly influenced by horizontal remapping during post-processing. Limited (≈50 % slower) throughput of the current code is found on a recent many-core/wide-vector high-performance computing system, which limits the lengths of the 12–46 km simulations and indirectly affects sampling uncertainty. Our experience shows that global and technical aspects of the VR downscaling framework require further investigations to reduce uncertainties for regional climate projection.

58 GEOSCIENCES↗

Towards a RAG-based summarization for the Electron Ion Collider

Abstract The complexity and sheer volume of information — encompassing documents, papers, data, and other resources — from large-scale experiments demand significant time and effort to navigate, making the task of accessing and utilizing these varied forms of information daunting, particularly for new collaborators and early-career scientists.To tackle this issue, a Retrieval Augmented Generation (RAG)-based Summarization AI for EIC (RAGS4EIC) is under development. This AI-Agent not only condenses information but also effectively references relevant responses, offering substantial advantages for collaborators. Our project involves a two-step approach: first, querying a comprehensive vector database containing all pertinent experiment information; second, utilizing a Large Language Model (LLM) to generate concise summaries enriched with citations based on user queries and retrieved data. We describe the evaluation methods that use RAG assessments (RAGAs) scoring mechanisms to assess the effectiveness of responses. Furthermore, we describe the concept of prompt template based instruction-tuning which provides flexibility and accuracy in summarization. Importantly, the implementation relies on LangChain [1], which serves as the foundation of our entire workflow. This integration ensures efficiency and scalability, facilitating smooth deployment and accessibility for various user groups within the Electron Ion Collider (EIC) community. This innovative AI-driven framework not only simplifies the understanding of vast datasets but also encourages collaborative participation, thereby empowering researchers. As a demonstration, a web application has been developed to explain each stage of the RAG Agent development in detail. The application can be accessed athttps://rags4eic-ai4eic.streamlit.app.[A tagged version of the source code can be found inhttps://github.com/ai4eic/EIC-RAG-Project/releases/tag/AI4EIC2023_PROCEEDING.]

Instruments & Instrumentation↗