Search NASA⌕ Search

SEARCH · Search NASA

Results for “subject matter experts”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

ORCHID: Orchestrated Retrieval-Augmented Classification of High-Risk Property with Intelligent Decision-Making

High-Risk Property (HRP) classification is critical at U.S. Department of Energy (DOE) sites, where inventories include sensitive and often dual-use equipment. Compliance must track evolving rules designated by various export control policies to make transparent and auditable decisions. Traditional expert-only workflows are time-consuming, backlog-prone, and struggle to keep pace with shifting regulatory boundaries. We propose ORCHID, a modular agentic framework for HRP classification that pairs retrieval-augmented generation (RAG) with human oversight to produce policy based outputs that can be audited. Small cooperating agents—retrieval, description refiner, classifier, validator, and feedback logger—coordinate via agent-to-agent messaging and invoke tools through the Model Context Protocol (MCP) for model-agnostic on-premise operation. The interface follows an "Item to Evidence to Decision" loop with step-by-step reasoning, on-policy citations, and append-only audit bundles (run-cards, prompts, evidence). In preliminary tests on real HRP cases, ORCHID improves accuracy and traceability over a non-agentic baseline while deferring uncertain items to Subject Matter Experts (SMEs). The demonstration shows single item submission, grounded citations, SME feedback capture, and exportable audit artifacts—illustrating a practical path to trustworthy LLM assistance in sensitive DOE compliance workflows.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗

Ocular Coherence Tomography in the Evaluation of Anterior Eye Injuries in Space Flight

While Ocular Coherence Tomography (OCT) is not a first-line modality to evaluate anterior eye structures terrestrially, it is a resource already available on the International Space Station (ISS) that can be used in medical contingencies that involve the anterior eye. With remote guidance and subject matter expert (SME) support from the ground, a minimally trained crewmember can now use OCT to evaluate anterior eye pathologies on orbit. OCT utilizes low-coherence interferometry to produce detailed cross-sectional and 3D images of the eye in real time. Terrestrially, it has been used to evaluate macular pathologies and glaucoma. Since 2013, OCT has been used onboard the ISS as one part of a suite of hardware to evaluate the Visual Impairment/Intracranial Pressure risk faced by astronauts, specifically assessing changes in the retina and choroid during space flight. The Anterior Segment Module (ASM), an add-on lens, was also flown for research studies, providing an opportunity to evaluate the anterior eye in real time if clinically indicated. Anterior eye pathologies that could be evaluated using OCT were identified. These included corneal abrasions and ulcers, scleritis, and acute angle closure glaucoma. A remote guider script was written to provide ground specialists with step-by-step instructions to guide ISS crewmembers, who do not get trained on the ASM, to evaluate the anterior eye. The instructions were tested on novice subjects and/or operators, whose feedback was incorporated iteratively. The final remote guider script was reviewed by SME optometrists and NASA flight surgeons. The novel application of OCT technology to space flight allows for the acquisition of objective data to diagnose anterior eye pathologies when other modalities are not available. This demonstrates the versatility of OCT and highlights the advantages of using existing hardware and remote guidance skills to expand clinical capabilities in space flight.

Fer, Dan M.↗

PDF Entity Annotation Tool (PEAT)

While different text mining approaches – including the use of Artificial Intelligence (AI) and other machine based methods - continue to expand at a rapid pace, the tools used by researchers to create the labeled datasets required for training, modeling, and evaluation remain rudimentary. Labeled datasets contain the target attributes the machine is going to learn; for example, training an algorithm to delineate between images of a car or truck would generally require a set of images with a quantitative description of the underlying features of each vehicle type. Development of labeled textual data that can be used to build natural language machine learning models for scientific literature is not currently integrated into existing manual workflows used by domain experts. Published literature is rich with important information, such as different types of embedded text, plots, and tables that can all be used as inputs to train ML/natural language processing (NLP) models, when extracted and prepared in machine readable formats. Currently, both normalized data extraction of use to domain experts and extraction to support development of ML/NLP models are labor intensive and cumbersome manual processes. Automatic extraction of data and information from formats such as PDFs that are optimized for layout and human readability, not machine readability. The PDF (Portable Document Format) Entity Annotation Tool (PEAT) was developed with the goal of allowing users to annotate publications within their current print format, while also allowing those annotations to be captured in a machine-readable format. One of the main issues with traditional annotation tools is that they require transforming the PDF into plain text to facilitate the annotation process. While doing so lessens the technical challenges of annotating data, the user loses all structure and provenance that was inherent in the underlying PDF. Also, textual data extraction from PDFs can be an error prone process. Challenges include identifying sequential blocks of text and a multitude of document formats (multiple columns, font encodings, etc.). As a result of these challenges, using existing tools for development of NLP/ML models directly from PDFs is difficult because the generated outputs are not interoperable. We created a system that allows annotations to be completed on the original PDF document structure, with no plain text extraction. The result is an application that allows for easier and more accurate annotations. In addition, by including a feature that grants the user the ability to easily create a schema, we have developed a system that can be used to annotate text for different domain-centric schemas of relevance to subject matter experts. Different knowledge domains require distinct schemas and annotation tags to support machine learning.

97 MATHEMATICS AND COMPUTING↗

Exploring the Science Trade Space with the JPL Innovation Foundry A-Team

The JPL Innovation Foundry has established a new approach for exploring, developing, and evaluating early concepts with a group called the Architecture Team (A-Team). The A-Team combines innovative collaborative methods and facilitated sessions with subject matter experts and analysis tools to help mature mission concepts. Science, implementation, and programmatic elements are all considered during an ATeam study. In these studies, Concept Maturity Levels (CML) are used to group methods. These levels include idea generation and capture (CML 1), initial feasibility assessment (CML 2), and trade space exploration (CML 3). Methods used for exploring the science objectives, feasibility, and scope will be described including use of a new technique for understanding the most compelling science, called a Science Return Diagram (SRD). In the process of developing the SRD, gradients in the science trade space are uncovered along with their implications for implementation and mission architecture. Special attention is paid towards developing complete investigations, establishing a series of logical claims that lead to the natural selection of a measurement approach. Over 20 science-focused A-Team studies have used these techniques to help science teams refine their mission objectives, make implementation decisions and reveal the mission concept’s most compelling science. This paper will describe the A-Team process for exploring the mission concept's science trade space and the Science Return Diagram technique.In June of 2011 a new collaborative engineering approach forearly concept formulation began in the JPL InnovationFoundry [1], six months later becoming the “A-Team” [2].Responding to a need for exploring mission architecturelevel trades [3], the A-Team precedes Team X [4,5] in asequence of concurrent engineering teams at JPL that can beused to mature a concept from a “cocktail napkin” level ideato a complete mission point design. The A-Team efficientlyexplores the science, implementation, and programmatictrade space in early concept formulation. Small, facilitatedgroups of experts generate innovative ideas, quantitativelyassess feasibility, and discover key sensitivities in the tradespace through collaborative analysis and use of advancedmethods and tools. The A-Team process builds off theexperience within JPL and other recent approaches to earlyconcept formulation [6] including best practices of the JPLInnovation Foundry, Project Systems Engineering &Formulation Section, Team Eureka and the Rapid MissionArchitecture Team[7].The A-Team is a focal point for innovative formulationapproaches and people within JPL. It relies on a largebackground of study resources, creative thinkers and “greybeard” scrutinizers, advanced tools, and subject matterexperts with both breadth and depth in experience andexpertise that are all available at JPL. The A-Team isdesigned to be a rapid and efficient process takingapproximately 6 weeks (the entire process can be as short asjust a few days or as long as up to three months) and costingthe equivalent of a work-month of a full-time employee orless. Studies begin with detailed planning and client reviewfollowed by study sessions, analysis work, and reporting.The staffing on each study is customized to the study goalsand objectives, and it is addressed early in the A-Teamprocess. Sessions are generally half-day or whole-day eventsand conducted over a series of days with focused agendas thatare moderated by a trained facilitator. Preliminary results andknowledge capture are available within hours of each session,and a final report is generally available two weeks later.One of the biggest challenges facing early conceptdevelopment is understanding the gradient in science returnversus various available mission scenarios and payload options. Often times, major areas of scientific inquiry havealready been prioritized by science groups, including throughthe National Research Council’s Decadal Studies inAstronomy, Planetary, and Earth Science. Yet science teamscontinue to struggle, especially in competitive missionsolicitations, to capture the right amount of scope that’sachievable within the cost constraints of the opportunity.Often the desire to completely and comprehensively study ascience area in just one mission (after all, true missionopportunities are rare) drives teams to take on too much,providing requirements that are unachievable within theresources of the opportunity without inducing unacceptableimplementation risk. Alternatively, science teams can seekto reduce risk by using an established instrument, but havenot thought through the traceability and key aspects of thescience question to justify its use. Both scenarios lead to badassumptions at the beginning of the concept development thatcan then ripple through implementation option choices,potentially preventing what would have been a good scienceinvestigation from being selected.The purpose of this paper is first to provide some additionalbackground and summary of the A-Team process, tools,people, and facilities. We then focus on the A-Teammethodology for overcoming the barriers of defining thescience scope well at the early concept development stage.This includes understanding the science story andtraceability, and then examining the gradient in science returnversus key characteristics of observables, developing theright payload and mission requirement specification throughexamining the science and implementation trade space.

Ziemer, John K.↗

Assessment of Potential Dose and Environmental Impacts from Proposed Testing at the INL Radiological Response Training Range

This assessment uses screening-level models to calculate potential environmental impacts from proposed tests at the Idaho National Laboratory (INL) Radiological Response Training Range (RRTR) site. Proposed tests could be conducted using 11 different radioactive material types that include K2O, LaBr3, KBr, Cu, Zr, F, Ga, Ga2O3, NaNO2, Ga-68, and Tc-99m. The tests could potentially release radioactive material to the atmosphere and radionuclides and other contaminants to the soil, which could leach into the unsaturated zone and migrate to the aquifer. Atmospheric transport of radionuclides to potential human receptors and time-integrated air concentrations were calculated with a Gaussian plume model and three years of hourly meteorological data. Potential surface-soil impacts were calculated with the computer program mixing-cell model (MCM). Groundwater impacts were calculated with the computer programs MCM and GWSCREEN. Radiological doses from potential atmospheric releases were calculated for public receptors off the INL Site and for workers at nearby INL facilities. Results were compared to regulatory dose limits. Maximum potential groundwater concentrations were estimated in the aquifer below the NSTR site and compared to drinking water standards or risk-based screening levels for resident tap water. Soil concentrations were calculated and compared to risk-based screening levels for workers and potential future residents. All impacts were estimated assuming 12 tests are conducted annually using all 11 material types for a period of 15 years. This document provides the resources to enable a subject matter expert in the field of environmental assessments to replicate the modeling and calculations. The methodology and parameters are presented in the text. All electronic files, including computer-code input, output, executable files, batch files, scripts, and spreadsheet files are contained in a zip file that can be accessed by selecting “Additional Information” (select Native File) in the INL Electronic Document Management System (EDMS). It is highly unlikely the test scenarios evaluated in this ECAR will adversely impact human health based on comparisons of calculated dose and concentration against regulatory standards and risk-based screening levels. Conservative estimates of dose to workers and the public from atmospheric transport of possible radionuclide releases are far below federal radiation protection standards. Conservative estimates of potential contaminant concentrations in groundwater are less than federal drinking water standards or screening levels. Predicted radionuclide concentrations in surface soils are below risk-based screening levels, except for Ge-68 (material Ga-68) for the worker. The Ge-68 soil concentration can be made less than the worker PRG, if the number of annual tests using Ga-68 is reduced from 12 to 6. However, the sum of ratios still exceeds one because of the high K-40 ratio. If the EF of the worker (number of days the worker is in the contaminated testing area) is reduced from 225 days/yr (default value for full time worker) to 112 days/yr, the Ge-68 ratio is less than one and the sum of ratios is less than one. Actual radiation doses and groundwater and surface-soil concentrations are likely to be much less than those calculated because of the conservative assumptions and parameters employed in the modeling. For example, atmospheric-transport calculations assume the entire inventory of each material type is readily released to the atmosphere and no plume deposition, depletion, or radioactive decay occurs during transport. The calculations also assume the same meteorological conditions (e.g., wind velocity, wind direction, stability class) that produce the maximum 95th percentile concentration (i.e., concentration representing the 95th percentile of a distribution of concentrations derived from 3 years of hourly meteorological data) at each receptor location are the same for all 12 tests during the year, and each receptor is assumed to be present during all 12 tests. The surface-soil assessment assumes the entire inventory of each test is deposited in the top 5 cm of soil. No atmospheric dispersal is assumed, and the radionuclides are subject only to leaching and radioactive decay. The groundwater-pathway modeling is conservative in that it is one-dimensional in the unsaturated zone (no lateral spreading/dilution) and assumes the entire inventory of contaminants infiltrates into the ground at the same location for every test. This is especially conservative for particulate radionuclides because they would have to dissolve or corrode first and some would be dispersed into the atmosphere. The groundwater receptor is also assumed to consume water directly from a hypothetical well positioned in the location of maximum concentration. In addition, conservative degradation rates were used, and volatilization was not considered for the nonradioactive chemical

54 ENVIRONMENTAL SCIENCES↗

Assessment of Potential Dose and Environmental Impacts from Proposed Testing at the INL National Security Test Range

This assessment uses screening-level models to calculate potential environmental impacts from proposed tests at two locations at the Idaho National Laboratory (INL) National Security Test Range (NSTR) site. Proposed tests could be conducted using 11 different radioactive material types that include K 2 O, LaBr 3 , KBr, Cu, Zr, F, Ga, Ga 2 O 3 , NaNO 2 , Ga-68, and Tc-99m. The tests could potentially release radioactive material to the atmosphere and radionuclides and other contaminants to the soil, which could leach into the unsaturated zone and migrate to the aquifer. Atmospheric transport of radionuclides to potential human receptors and time-integrated air concentrations were calculated with a Gaussian plume model and three years of hourly meteorological data. Potential surface-soil impacts were calculated with the computer program mixing-cell model (MCM). Groundwater impacts were calculated with the computer programs MCM and GWSCREEN. Radiological doses from potential atmospheric releases were calculated for public receptors off the INL Site and for workers at nearby INL facilities. Results were compared to regulatory dose limits. Maximum potential groundwater concentrations were estimated in the aquifer below the NSTR site and compared to drinking water standards or risk-based screening levels for resident tap water. Soil concentrations were calculated and compared to risk-based screening levels for workers and potential future residents. All impacts were estimated based on the assumption that 12 tests are conducted annually using all 11 material types for 15 years. This document provides the resources to enable a subject matter expert in the field of environmental assessments to replicate the modeling and calculations. The methodology and parameters are presented in the text. All electronic files, including computer-code input, output, executable files, batch files, scripts, and spreadsheet files, are contained in a zip file that can be accessed by selecting “Additional Information” (select Native File) in the INL Electronic Document Management System (EDMS). It is highly unlikely the test scenarios evaluated in this ECAR will adversely impact human health based on comparisons of calculated dose and concentration against regulatory standards and risk-based screening levels. Conservative estimates of dose to workers and the public from atmospheric transport of possible radionuclide releases are far below federal radiation protection standards. Conservative estimates of potential contaminant concentrations in groundwater are less than federal drinking water standards or screening levels. Predicted radionuclide concentrations in surface soils are below risk-based screening levels, except for Ge-68 (material Ga-68) for the worker. The Ge-68 soil concentration can be made less than the worker PRG, if the number of annual tests using Ga-68 is reduced from 12 to 6. However, the sum of ratios still exceeds one because of the high K-40 ratio. If the EF of the worker (number of days the worker is in the contaminated testing area) is reduced from 225 days/yr (default value for full time worker) to 112 days/yr, the Ge-68 ratio is less than one and the sum of ratios is less than one. Actual radiation doses and groundwater and surface-soil concentrations are likely to be much less than those calculated because of the conservative assumptions and parameters employed in the modeling. For example, atmospheric-transport calculations assume the entire inventory of each material type is readily released to the atmosphere and no plume deposition, depletion, or radioactive decay occurs during transport. The calculations also assume the same meteorological conditions (e.g., wind velocity, wind direction, stability class) that produce the maximum 95th percentile concentration (i.e., concentration representing the 95th percentile of a distribution of concentrations derived from 3 years of hourly meteorological data) at each receptor location are the same for all 12 tests during the year, and each receptor is assumed to be present during all 12 tests. The surface-soil assessment assumes the entire inventory of each test is deposited in the top 5 cm of soil. No atmospheric dispersal is assumed, and the radionuclides are subject only to leaching and radioactive decay. The groundwater-pathway modeling is conservative in that it is one-dimensional in the unsaturated zone (no lateral spreading/dilution) and assumes the entire inventory of contaminants infiltrates into the ground at the same location for every test. This is especially conservative for particulate radionuclides because they would have to dissolve or corrode first and some would be dispersed into the atmosphere. The groundwater receptor is also assumed to consume water directly from a hypothetical well positioned in the location of maximum concentration. In addition, conservative degradation rates were used, and volatilization was not considered for the nonradradioactive chemicals modeled. And finally, the calculations assume all 12 tests will be performed at the same place at both locations, and all 11 radioactive material types will be used for each test. This is conservative because it is anticipated that no more than two material types will be used per test.

99 GENERAL AND MISCELLANEOUS↗

State-of-the-Art: Small Spacecraft Technology

When the first edition of NASA’s Small Spacecraft Technology State-of-the-art report was published in 2013, 247 CubeSats and 105 other non-CubeSat small spacecraft under 50 kilograms (kg) had been launched worldwide, representing less than 2% of launched mass into orbit over multiple years. In 2013 alone, around 60% of the total spacecraft launched had a mass under 600 kg, and of those under 600 kg, 83% were under 200 kg and 37% were nanosatellites (1). Of the total 1,849 spacecraft launched in 2021, 94% were small spacecraft with an overall mass under 600 kg, and of those under 600 kg, 40% were under 200 kg, and 11% were nanosatellites (1). Since 2013, the fight heritage for small spacecraft has increased by over 30% and has become the primary source to space access for commercial, government, private, and academic institutions. The total number of spacecraft launched in the past 10 years is 5,681 and 45% of those had a mass. As with all previous editions of this report, the 2022 edition captures and distills a wealth of new information available on small spacecraft systems from NASA and other publicly available sources. This report is limited to publicly available information and cannot reflect major advances in development that are not publicly disclosed. We encourage any opportunity to publish mission outcomes and technology development milestones (e.g., via conference papers, press releases, company website) so they can be reflected in this report. Overall, this report is a survey of small spacecraft technologies sourced from open literature; it does not endeavor to be an original source, and only considers literature in the public domain to identify and classify devices. Commonly used sources for data include manufacturer datasheets, press releases, conference papers, journal papers, public filings with government agencies, news articles, presentations, the compendium of databases accessed via NASA’s Small Spacecraft Systems Virtual Institute (S3VI) Information Search, and engagement with companies. Data not appropriate for public dissemination, such as proprietary, export controlled, or otherwise restricted data, are not considered. As a result, this report includes many dedicated hours of desk research performed by subject matter experts reviewing resources noted above. Content in this 2022 edition is based on data available by October 2022. This report should not be considered as a comprehensive overview of all the technologies but a great reference for the current state-of-the-art SmallSat technologies. The organizational approach for each chapter is relatively consistent with previous editions and includes an introduction of the technology, current development status of the technology’s procurable systems, and summary tables of technologies surveyed. The content in each chapter is uniquely organized to present a mini-stand-alone report on spacecraft subsystems. As in previous years, chapters include information from previous editions but are updated with new and maturating technologies and reference missions. Tables in each section provide a convenient summary of the technologies discussed, with explanations and references in the body text. The authors have attempted to isolate trends in the small spacecraft industry to point out which technologies have been adopted after successful demonstration missions. Lastly, the authors tried to use the terms “SmallSat,” “microsatellite,” “nanosatellite,” and “CubeSat” in a consistent manner, even as these terms are often used interchangeably in the space industry. Every subsystem chapter contains updated information to reflect the growth in the small spacecraft market. Significant changes are included in several chapters. The “Complete Spacecraft Platforms” chapter now includes information on the two main market options, hosted payload services and dedicated buses. The “Power” chapter provides information on the development of solid-state batteries with significantly higher energy than the current state-of-theart lithium-ion batteries. A large effort was made to update the “Communications” chapter to appropriately capture the recent technology maturation of optical communications for SmallSats. The “Ground Data Systems and Mission Operations” chapter was updated to reflect the recent establishment of the Near Space Network and influx of SmallSat Optical Ground Stations. The “Guidance, Navigation and Control” chapter was updated to include Lidar sensor technology. The “Deorbit Systems” chapter includes a discussion of recently proposed changes by the Federal Communications Commission (FCC) to limit a spacecraft’s lifetime to no longer than 5 years after end-of-mission. The “Identification and Tracking” Chapter includes updated information on the progress of SmallSat tracking. Finally, this report now encompasses technology funded by NASA’s Small Spacecraft Technology (SST) program’s SmallSat Technology Partnerships (STP) initiative which is described further in this Introduction. The reader can find the included SST technology in the “On the Horizon” section of the “Thermal Systems”, “Communications”, and “Guidance, Navigation, and Control” chapters. A central element of this report is to list state-of-the-art technologies by NASA standard Technology Readiness Level (TRL) as defined by the 2020 NASA Engineering Handbook, found in NASA NPR 7123.1C NASA Systems Engineering Processes and Requirements. The authors have endeavored to independently verify the TRL value of each technology by reviewing and citing published test results or publicly available data to the best of their ability. Where test results and data disagree with vendors’ own advertised TRL, the authors have attempted to engage the vendors to discuss the discrepancy. Readers are strongly encouraged to follow the references cited in the literature describing the full performance range and capabilities of each technology. Readers of this report should reach out to individual companies to further clarify information. It is important to note that this report takes a broad system-level view. To attain a high TRL, the subsystem must be in a flight-ready configuration with all supporting infrastructure—such as mounting points, power conversion, and control algorithms—in an integrated unit. An accurate TRL assessment requires a high degree of technical knowledge on a subject device, and an in-depth understanding of the mission (including interfaces and environment) on which the device was flown. There is variability in TRL values depending on design factors for a specific technology. For example, differences in TRL assessment based on the operating environment may result from the thermal environment, mechanical loads, mission duration, or radiation exposure. If a technology has flown on a mission without success, or without providing valid confirmation to the operator, such claimed “flight heritage” was discounted. The authors believe TRLs are most accurately determined when assessed within the context of a program’s unique requirements. While the overall capability of small spacecraft has matured since the 2021 edition of this report, technologies are still being developed to make deep space SmallSat missions more routine and more cost effective. Future editions of this report may include content dedicated to the rapidly growing fields of assembly, integration, and testing services, and mission modeling and simulation–all of which are now extensively represented at small spacecraft conferences. Many of these subsystems and services are still in their infancy, but as they evolve and reliable conventions and standards emerge, the next iteration of this report may also evolve to include additional chapters.

Bruce Yost↗

Dynamic instructions for Lock-out Tag-out

Lock-out tag-out (LOTO) instructions protect personnel from un-expected re-energization or start-up of equipment that is under maintenance. Even though there is rigorous training associated with LOTO activities, inci-dents still occur. Idaho National Laboratory is researching and developing dynamic LOTO instructions, which supports automatic place keeping, per-sonnel working on multiple instructions, and multiple work groups complet-ing the same instructions. Researchers identified user needs through subject matter expert interviews, observations, and classroom training. Failing to identify potential hazards during LOTO can cause injury or death to person-nel. Dynamic instructions can provide planning, incorporate supplemental documentation into the instruction, and improve instruction compliance. Combining these functions may lead to clearer, more applicable instructions which addresses the reason for compliance issues with current paper-based procedures.

99 GENERAL AND MISCELLANEOUS↗

Adoption of image-driven machine learning for microstructure characterization and materials design: A Perspective

Microstructure characterization enables the development of structure-processing-property relationships critical to several research areas within the broad field of materials science, from alloy design to the assessment of corrosion resistance, and failure analysis. Conventional approaches to material characterization have relied on either qualitative inference by the human ex-pert or software applications that can extract high-level features from images, such as boundary segmentation, average grain diameter, etc. Such approaches rely heavily on subject matter expert user intervention and knowledge of what phases or more generally, what microstructural features, are of interest. The recent surge in the adoption of machine learning techniques to address problems in materials engineering has brought with it an increased interest and application of Image Driven Machine Learning (IDML) approaches. In this work, we review the applications of IDML to the field of materials characterization. A canonical hierarchy of stages is defined, which when put sequentially together completes an IDML study: problem definition, dataset building, model selection and training, model evaluation, and integration with existing instrumentation or simulation workflow. The studies reviewed in this work are analyzed from the perspective of each of these stages. Such a review permits agranular assessment of the field, for example the impact of IDML on materials characterization at the nanoscale, the size of a typical dataset required to train a semantic segmentation model on electron microscopy images, ubiquitousness of transfer learning in the domain, etc. Finally, we discuss the importance of interpretability and explainability in the field of IDML for materials characterization, and provide an overview of two emerging techniques in the field: semantic segmentation and generative adversarial networks.

Baskaran, Arun↗

Multilabel proportion prediction and out-of-distribution detection on gamma spectra of short-lived fission products

In the machine learning problem of multilabel classification, the objective is to determine for each test instance which classes the instance belongs to. In this work, we consider an extension of multilabel classification, called multilabel proportion prediction, in the context of radioisotope identification (RIID) using gamma spectra data. We aim to not only predict radioisotope proportions, but also identify out-of-distribution (OOD) spectra. We achieve this goal by viewing gamma spectra as discrete probability distributions, and based on this perspective, we develop a custom semi-supervised loss function that combines a traditional supervised loss with an unsupervised reconstruction error function. Our approach was motivated by its application to the analysis of short-lived fission products from spent nuclear fuel. In particular, we demonstrate that a neural network model trained with our loss function can successfully predict the relative proportions of 37 radioisotopes simultaneously. The model trained with synthetic data was then applied to measurements taken by Pacific Northwest National Laboratory (PNNL) to conduct analysis typically done by subject-matter experts. Here, we also extend our approach to successfully identify when measurements are OOD, and thus should not be trusted, whether due to the presence of a novel source or novel proportions.

Anomaly detection↗

Enabling machine learning-ready HPC ensembles with Merlin

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows, heterogeneous machine architectures, parallel file systems, and batch scheduling, care must be taken to facilitate this analysis in a high performance computing (HPC) environment. Here, we present Merlin, a workflow framework to enable large ML-friendly ensembles of scientific HPC simulations. By augmenting traditional HPC with distributed compute technologies, Merlin aims to lower the barrier for scientific subject matter experts to incorporate ML into their analysis. As a producer–consumer workflow model, Merlin enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features of Merlin are a flexible HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for $\mathscr{O}$(N) task execution and $\mathscr{O}$(N ln N) task queuing to ensembles of millions of tasks. In addition to Merlin’s design, we test the algorithm’s performance in an HPC center and demonstrate the ability to enqueue 40 million simulations in 100 s, with a 30 millisecond per-task overhead that is independent of ensemble size. Finally, we describe some example applications that Merlin has enabled on leadership-class HPC resources, such as the ML-augmented optimization of nuclear fusion experiments and the calibration of infectious disease models to study the progression of and possible mitigation strategies for COVID-19.

97 MATHEMATICS AND COMPUTING↗

Universal Nuclear Accident Dosimeter

The Lawrence Livermore National Laboratory (LLNL) Universal Nuclear Accident Dosimetry (UNAD) project is a four-year initiative aimed at advancing nuclear accident dosimetry methods. This article presents an overview of the research, key findings, and the progress made throughout the project. The primary goals included a background into the history of nuclear accident dosimetry, consolidating current dosimetry techniques within the NNSA/DOE complex, fostering collaboration among subject matter experts, and exploring novel technologies for potential implementation. The technical focus centered on investigating new and novel technologies, instrumentation methods, and analysis methods to develop recommendations for a potential nuclear accident dosimeter (NAD) to be universally deployed through the DOE complex. A multilaboratory and multinational Usergroup was established, conducting periodic meetings to facilitate knowledge exchange. The UNAD team has participated in two international nuclear accident dosimetry intercomparison exercises and one characterization exercise, where the existing LLNL NAD and a prototype alanine electron paramagnetic dosimeter NAD were deployed. Ongoing improvements are being made to the prototype NAD based on results from the exercises, laboratory studies, and collaboration with other laboratories. A machine learning algorithm to optimize the geometry and conversion factors of the current LLNL NAD is being implemented, and the resulting design will be tested in the next exercise. In conclusion, key lessons learned and future directions for the project are discussed.

Electron paramagnetic resonance spectroscopy↗

Informing Plant Asset Reliability and Availability Through AI-Driven Analysis of Operator Logs

The availability and reliability of nuclear power plant (NPP) structures, systems, and components (SSCs) are critical parameters for NPP safety. Tracking these parameters is necessary but costly and labor-intensive, requiring the collection and evaluation of SSC event data such as shutdowns, startups, and failures. To show how these events are needed for the parameters an example is given: one measure of reliability is based on the number of equipment failure events and the number of run hours (i.e., the time from a startup event to a shutdown event). Here, this work investigates using artificial intelligence (AI) to mine NPP operator log entry texts for SSC event data. Four AI approaches were explored for identifying these events, including natural language processing (NLP) methods, generative AI, generative AI combined with NLP, and topic modeling. A key challenge addressed with all four approaches is the brevity of operator log entries. Among these four a neural network–based NLP method was shown to be the most promising for this application, achieving F1 scores of 86.0% for shutdowns, 92.2% for startups, and 80.4% for failures on a subject-matter-expert-curated dataset from NPP operator logs, compared to a baseline of 66.6% for a random classifier. This shows that NLP methods can perform better than generative AI. Additionally, the NLP methods combined with generative AI were shown to perform better than generative AI alone. Generative AI was most successful at providing the background information for the NLP methods to use. This work demonstrates the potential to use AI to automate parameter collection from NPP operator log entries and other records.

97 - MATHEMATICS AND COMPUTING↗

Impacts of Modern IT on LCLS-II Experiment Control Systems

Modern information technology (IT) is a broad term with vague and somewhat arbitrary boundaries which can depend on any given novice or subject matter expert’s notional understanding. For the purposes of this article, IT can be understood as standards in communication, computational power, and storage. Additionally, impacts of modern IT extend beyond its products of hardware and software to include associated work practices and engineering processes.

97 MATHEMATICS AND COMPUTING↗

Research challenges and directions in HVAC fault prevalence

This study provides a review of the current state of knowledge, gaps, and potential value in research on the prevalence of faults in commercial buildings. Two separate efforts were made in this study: (1) we performed a literature review to determine the extent of currently available fault prevalence data for heating, ventilation, and air-conditioning (HVAC) systems, and (2) we conducted dozens of interviews with subject matter experts and stakeholders to determine the HVAC fault data that would be of greatest value. Through the literature review and interviews, we discovered unmet needs for empirical data on the prevalence of faults at the desired level of granularity, consistency, and scale; this lack of data leads us to recommend future work studying commercial buildings’ HVAC fault prevalence, with robust fault taxonomy and a variety of meaningful fault prevalence metrics.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A biology-informed similarity metric for simulated patches of human cell membrane

Complex scientific inquiries rely increasingly upon large and autonomous multiscale simulation campaigns, which fundamentally require similarity metrics to quantify ‘sufficient’ changes among data and/or configurations. However, subject matter experts are often unable to articulate similarity precisely or in terms of well-formulated definitions, especially when new hypotheses are to be explored, making it challenging to design a meaningful metric. Furthermore, the key to practical usefulness of such metrics to enable autonomous simulations lies in in situ inference, which requires generalization to possibly substantial distributional shifts in unseen, future data. Here, we address these challenges in a cancer biology application and develop a meaningful similarity metric for ‘patches’—regions of simulated human cell membrane that express interactions between certain proteins of interest and relevant lipids. In the absence of well-defined conditions for similarity, we leverage several biology-informed notions about data and the underlying simulations to impose inductive biases on our metric learning framework, resulting in a suitable similarity metric that also generalizes well to significant distributional shifts encountered during the deployment. We combine these intuitions to organize the learned embedding space in a multiscale manner, which makes the metric robust to incomplete and even contradictory intuitions. Our approach delivers a metric that not only performs well on the conditions used for its development and other relevant criteria, but also learns key spatiotemporal relationships without ever being exposed to any such information during training.

97 MATHEMATICS AND COMPUTING↗

Efficient Contingency Analysis in Power Systems via Network Trigger Nodes

Modeling failure dynamics within a power system is a complex and challenging process due to multiple inter-dependencies and convoluted inter-domain relationships. Subject matter experts (SMEs) are interested in understanding these failure dynamics for reducing the impact from future disasters (i.e., losses or failures of power system components, such as transmission lines). Contingency analysis (CA) tools enable such ’what-if’ scenario analyses to evaluate the impacts on the power system. Analyzing all possible contingencies among N system components can be computationally expensive. An important step for performing CA is identifying a set of k ‘trigger’ components, which when failed initially can significantly impact the overall system by causing multiple failures. Currently SMEs focus on identifying these trigger components by running expensive simulations on all possible subsets, which quickly becomes infeasible. Hence finding a relevant set of trigger components (contingencies) rapidly to enable efficient and useful CA is crucial.In a collaboration between computer scientists and power system experts, we propose an efficient method for performing CA by exploiting network inter-dependencies in power system components. First, we construct a network with multiple electric grid infrastructure components and dependencies as connections among them. We reformulate the problem of finding a set of trigger components as a problem of identifying critical nodes in the network, which can cascade power failures through connected nodes and cause significant damage to the network. To guide the practical CA tools, we develop a network-based model with a probabilistic edge-weights setup using intricate domain rules. Then we conduct an empirical study on real power system data in the US for both regional and national levels. Firstly, we use power system datasets for the US to create a national-scale domain-driven model. Secondly, we demonstrate that network-based model outperforms the outputs from a real CA tool and show on average 25 × improved selection of contingencies, thereby showcasing practical benefits to the power experts.

Tabassum, Anika↗

Cyber Attack Sequences Generation for Electric Power Grid

Security assessment of cyber-physical energy systems (CPESs) such as the electric power grid is a critical operation to maintain availability, reliability, and quality of service in the presence of persistent threats from malicious cyber actors. Existing security assessment approaches such as penetration testing and red teaming rely on subject matter expert experience and forensic cyber analysis of historical events to perform realistic, threat-informed assessments of CPES defense. CPESs have a large attack surface because of the heterogeneity and complexity of underlying topology, devices, measurements, and vulnerabilities. The aforementioned approaches lead to partial coverage of the attack surface with a large set of unknown but possible exploits. There is a need to automate the CPES attack surface discovery and contextualize it for relevant, highly probable, real-world attack scenarios. We propose a methodology and framework to facilitate the discovery of the CPES attack surface. We present a multilayer attack graph with ranked attack sequences to describe CPES failure scenarios. We present a work-in-progress framework that lists key components to automate the attack modeling and sequence generation. We demonstrate the published National Electric Sector Cybersecurity Organization Resource CPES failure scenario to highlight the trustworthiness of generated attack sequences.

Dutta, Ashutosh↗