Search NASA⌕ Search

SEARCH · Search NASA

Results for “AI tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Predicting Team Functioning in Long Term Space Missions Using Acoustic and Linguistic Measures

Maintaining optimal team functioning is critical for long-duration space exploration missions, yet traditional monitoring methods, such as self-reports and wearable sensors, often impose operational burdens or suffer from bias. This paper investigates a non-intrusive speech-based artificial intelligence (AI) framework to predict degradations in team functioning using data from the Human Exploration Research Analog (HERA) of the U.S. National Aeronautics and Space Administration (NASA). Using acoustic features, linguistic descriptors, and semantic embeddings, we evaluate static non-linear and temporal machine learning models to predict both objective (task accuracy) and subjective (self-reported efficacy and cohesion) team functioning outcomes. Results indicate that temporal models outperform static approaches, with prediction of objective task accuracy in Team Interaction Battery (TIB) improving from near chance to 71%. Self-reported outcomes, including team efficacy and cohesion, are predicted more reliably than task performance, achieving balanced accuracies of up to 85.56% and 78.12%, respectively, and are found to be most strongly associated with acoustic features. In a second interdependent task, the MMSEV–EVA, accuracies of up to 78% are achieved using temporal models with acoustic features. Furthermore, incorporating just 1–2 days of team-specific historical data systematically improved performance, and acoustic markers from informal pre-task interactions provided modest predictive gains. Finally, while automated preprocessing yielded viable accuracy, humancorrected data provided moderate performance gains, though transcription error rates did not significantly correlate with model performance. These findings highlight the potential of speech as a passive, high-fidelity monitoring tool for autonomous habitats.

Temporal modeling↗

Molecular property prediction for very large databases with natural language processing: a case study in ionic liquid design

The prospect of using artificial intelligence (AI) to accurately screen very large databases of compounds for multiple properties has yet to be realized. Here, we explore this possibility using ionic liquids (ILs) which offer unique physicochemical properties and excellent tunability, making them highly versatile solvents for various research applications. Screening millions of potential ILs for the best perfomance for use in specific tasks with experimental methods alone however, is impractical. Further, traditional’ physics-based computational chemistry is hindered by high computational cost. To address this challenge, we leverage a natural language processing (NLP)-based molecular embedding technique with advanced machine learning (ML) models to predict seven key IL properties: viscosity, density, ionic conductivity, surface tension, melting temperature, toxicity, and water solubility. Comprehensive datasets for these properties are obtained, then NLP featurization with Mol2vec is compared with other featurization techniques such as 2D Morgan fingerprints, and 3D quantum chemistry-derived sigma profiles. NLP-based featurization exhibited the best predictive performance, achieving the highest R 2 and lowest RMSE values for all the studied IL properties. Further, we present case studies of how ILs might be screened using combined property criteria for practical cases – lignocellulosic biomass processing, CO 2 capture, and optimal electrolytes for batteries – screening a novel database of ∼10.6 million generated feasible ILs. The results introduce NLP as a powerful tool for engineering many designer solvents with desirable properties for task specific applications.

Mohan, Mood [Oak Ridge National Laboratory (ORNL),↗

Understanding the Physics Representation of Deep Learning Models in Environmental Applications

Deep learning (DL) models have been popular in earth and environmental modeling and analysis, which exhibit huge potential in capturing and reconstructing the non-linearity of relevant environmental processes. They are extensively used as analytical tools or emulators for multiple domains (atmosphere, land surface, ocean, and biogeochemistry). Despite their success, their internal working mechanism remains largely unknown. Such a lack of knowledge hinders the identification of physically consistent models that are fully adaptive to non-stationary climate, as well as the development of physics-informed machine learning such as physics-informed neural network (PINN). To establish preliminary knowledge and framework of such physics representation evaluation, this project focuses on an improved understanding of DL models in the environmental applications. DL models are increasingly applied to environmental modeling and prediction. However, they have been evaluated mostly from a performance perspective, and there is a gap in understanding how they represent the known physics internally. Such knowledge is especially critical when applying DL models under climate change conditions, where new inputs are likely outside the ranges of the training datasets. In this project, we reveal how the known physical processes are represented within DL models from both statistical and mechanistic perspectives. Leveraging the traditional model evaluations that focus more on the accuracies of predictions, we establish a framework that examines both the accuracy and physics representation of DL models. This analysis framework can identify DL models that make the correct predictions based on correct physics, thus enhancing the existing explainable artificial intelligence (explainable-AI) portfolio. It lays a foundation for developing novel metrics to evaluate the emerging DL models in environmental applications. This knowledge also informs the development of physics-informed DL models by revealing the direct connections between the known physical processes and specific model components or structures.

54 ENVIRONMENTAL SCIENCES↗

NSTX-U National Research Program: White Paper in Response to Call from FESAC Sub-Committee

Both scientific and technical innovation is needed for the realization of an attractive engineering solution for a timely and cost-effective Pilot Plant, the design and construction of which is the overarching recommendation of the FESAC Long Range Plan, and the 2021 NASEM Pilot Plant reports, which underpin the Bold Decadal Vision. The two most significant plasma physics gaps to close for a Compact Pilot Plant (CPP) are core confinement improvement and heat flux mitigation, neither of which have been closed in an integrated fashion for any planned fusion power production device. High core confinement and stability are essential for producing majority self-driven plasmas in CPPs with reduced size and auxiliary heating power requirements, with an improvement in confinement being the major driver for cost reduction of a CPP. The National Spherical Tokamak Experiment - Upgrade (NSTX-U) is a unique low aspect ratio research facility that will address the fundamental challenge of developing the science and technology basis for a CPP design that integrates high core and edge confinement with the ability to mitigate very high incident heat fluxes. NSTX-U capabilities will enable the high performance, already achieved on NSTX, to extend into physics regimes much closer to those anticipated in Spherical Tokamak (ST)-based CPPs. These confinement and stability properties will be assessed by a full complement of diagnostics and analysis tools, which will also aid in the development of the underlying theory and predictive models needed for further optimization. Both conventional and transformative heat flux mitigation methods, such as liquid lithium plasma-facing components, will be developed and tested in-situ in NSTX-U at incident heat fluxes of ~100 MW/m 2 , and will inform plans and reduce risk for a subsequent major upgrade to the device to fully heated, high-Z wall and full liquid lithium divertor capability, a technology that potentially could then be implemented on any magnetic confinement device at any aspect ratio. NSTX-U research is fully complementary to programs performed on other STs, nationally and internationally. Furthermore, NSTX-U research has a direct connection to the private sector by informing design choices for future power production facilities being developed by these companies. The NSTX-U program will operate as a national User Facility, with collaborating researchers, engineers, and graduate students from 19 outside institutions, and open to participation and experiments led by researchers from both public and private entities. The research program will advance workforce development through training of young scientists, engineers, and technicians, and it will also serve for further diagnostic innovation, especially for high heat flux and high-Z wall environments, and implementation of advanced artificial intelligence (AI) for plasma and heat flux control.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Reconfigurable Neural Network ASIC for Detector Front-End Data Compression at the HL-LHC

Despite advances in the programmable logic capabilities of modern trigger systems, a significant bottleneck remains in the amount of data to be transported from the detector to off-detector logic where trigger decisions are made. We demonstrate that a neural network (NN) autoencoder model can be implemented in a radiation-tolerant application-specific integrated circuit (ASIC) to perform lossy data compression alleviating the data transmission problem while preserving critical information of the detector energy profile. For our application, we consider the high-granularity calorimeter from the Compact Muon Solenoid (CMS) experiment at the CERN Large Hadron Collider. The advantage of the machine learning approach is in the flexibility and configurability of the algorithm. By changing the NN weights, a unique data compression algorithm can be deployed for each sensor in different detector regions and changing detector or collider conditions. To meet area, performance, and power constraints, we perform quantization-aware training to create an optimized NN hardware implementation. The design is achieved through the use of high-level synthesis tools and the hls4ml framework and was processed through synthesis and physical layout flows based on a low-power (LP)-CMOS 65-nm technology node. The flow anticipates 200 Mrad of ionizing radiation to select gates and reports a total area of 3.6 mm 2 and consumes 95 mW of power. The simulated energy consumption per inference is 2.4 nJ. Furthermore, this is the first radiation-tolerant on-detector ASIC implementation of an NN that has been designed for particle physics applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of ‹ instrument, verb, target › combination delivers more comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. Here, the challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and the assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. Here, a total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms from the competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.

60 APPLIED LIFE SCIENCES↗

A workflow for segmenting soil and plant X-ray computed tomography images with deep learning in Google’s Colaboratory

X-ray micro-computed tomography (X-ray μCT) has enabled the characterization of the properties and processes that take place in plants and soils at the micron scale. Despite the widespread use of this advanced technique, major limitations in both hardware and software limit the speed and accuracy of image processing and data analysis. Recent advances in machine learning, specifically the application of convolutional neural networks to image analysis, have enabled rapid and accurate segmentation of image data. Yet, challenges remain in applying convolutional neural networks to the analysis of environmentally and agriculturally relevant images. Specifically, there is a disconnect between the computer scientists and engineers, who build these AI/ML tools, and the potential end users in agricultural research, who may be unsure of how to apply these tools in their work. Additionally, the computing resources required for training and applying deep learning models are unique, more common to computer gaming systems or graphics design work, than to traditional computational systems. To navigate these challenges, we developed a modular workflow for applying convolutional neural networks to X-ray μCT images, using low-cost resources in Google’s Colaboratory web application. Here we present the results of the workflow, illustrating how parameters can be optimized to achieve best results using example scans from walnut leaves, almond flower buds, and a soil aggregate. We expect that this framework will accelerate the adoption and use of emerging deep learning techniques within the plant and soil sciences.

59 BASIC BIOLOGICAL SCIENCES↗

Stochastic machine learning via sigma profiles to build a digital chemical space

This work establishes a different paradigm on digital molecular spaces and their efficient navigation by exploiting sigma profiles. To do so, the remarkable capability of Gaussian processes (GPs), a type of stochastic machine learning model, to correlate and predict physicochemical properties from sigma profiles is demonstrated, outperforming state-of-the-art neural networks previously published. The amount of chemical information encoded in sigma profiles eases the learning burden of machine learning models, permitting the training of GPs on small datasets which, due to their negligible computational cost and ease of implementation, are ideal models to be combined with optimization tools such as gradient search or Bayesian optimization (BO). Gradient search is used to efficiently navigate the sigma profile digital space, quickly converging to local extrema of target physicochemical properties. While this requires the availability of pretrained GP models on existing datasets, such limitations are eliminated with the implementation of BO, which can find global extrema with a limited number of iterations. A remarkable example of this is that of BO toward boiling temperature optimization. Holding no knowledge of chemistry except for the sigma profile and boiling temperature of carbon monoxide (the worst possible initial guess), BO finds the global maximum of the available boiling temperature dataset (over 1,000 molecules encompassing more than 40 families of organic and inorganic compounds) in just 15 iterations (i.e., 15 property measurements), cementing sigma profiles as a powerful digital chemical space for molecular optimization and discovery, particularly when little to no experimental data is initially available.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The 1991 AVIRIS/POLDER experiment in Camargue, France

Airborne campaigns during the eighties provided high spectral resolution data, collected with imaging instruments such as AIS, AVIRIS, FLI, CAESI, and ISM, in order to investigate the relationship with canopy biophysical characteristics. The statistical approaches used to analyze these data do not allow investigation of the causality and the applicability of the observed correlations. Further, statistical studies demonstrated the high degree of redundancy of the spectral information amongst many others. And for retrieving vegetation biophysical characteristics, few results demonstrate the real information gain attributable to the high spectral resolution capability as compared to the use of a few wide wavelength bands. With several new imaging spectrophotometers scheduled for launch during the next 10 years (MERIS, MODIS, HIRIS), progress in the description and understanding of the mechanisms that drive the spectral variation of canopy reflectance is required. Most of these new sensor systems will also have the capability to observe the target under differing view directions. The problem of the combination and the use of the synergy between both the spectral and the directional sources of canopy reflectance variations has to be addressed. Apart from the atmospheric effects, the spectral variation of the light reflected by canopies originates from the leaves, the soil or the other vegetation elements such as branches and fruits. At leaf level, both diffuse reflectance and transmittance may be simulated by simple models, although no accurate information exists on the absorption features of the biochemicals (except water) in the 900-2500nm wavelength range. Many models mimic the directional variability of canopy reflectance at a given wavelength. Combining a leaf spectral model with a canopy directional model provides a powerful tool to analyze this problem. Some of us have initiated such a study, but our approach and theory remain to be tested using canopy data with their complexity, associated experimental error, and atmospheric effects. The main objective of the 1990 POLDER/AVIRIS experiment in Camargue was to provide a consistent data set over various canopies in order to test the applicability of the theory. The experiment, part of the 1991 MAC Europe experiment, involved simultaneous data collection using two sensors: AVIRIS and POLDER which measures the bidirectional and polarization properties of the targets at 670 and 880nm wavebands.

Baret, F.↗

Exploring the Use of Novel Spatial Accelerators in Scientific Applications

Driven by the need to find alternative accelerators which can viably replace GPUs in next-generation Supercomputing systems, this paper proposes a methodology to enable agile application/hardware co-design. The application-first methodology provides the ability to come up with design of accelerators while working with real-world workloads, available accelerators, and system software. The iterative design process targets a set of kernels in a workload for performance estimates that can prune the design space for later phases of detailed architectural evaluations. To this effect, in this paper, a novel data-parallel device model is introduced that simulates the latency of performance-sensitive operations in an accelerator including data transfers and kernel computation using multi-core CPUs. The use of off-the-shelf simulators, such as pre-RTL simulator Aladdin or multiple tools available for exploring the design of deep neural network accelerators (e.g., Timeloop) is demonstrated for evaluation of various accelerator designs using applications with realistic inputs. Examples of multiple device configurations that are instantiable in a system are explored to evaluate the performance benefit of deploying novel accelerators. The proposed device is integrated with a programming model and system software to potentially explore the impacts of high-level programming languages/compilers and low-level effects such as task scheduling on multiple accelerators. We analyze our methodology for a set of applications that represent high-performance computing (HPC) and graph analytics. The applications include a computational chemistry kernel realized using tensor contractions, triangle counting, GraphSAGE and Breadth-first Search. These applications include kernels such as dense matrix-dense matrix multiplication, sparse matrix-spare matrix multiplication, and sparse matrix-dense vector multiplication. Our results indicate potential performance benefits and insights for system design by including accelerators that realize these kernels along-side general purpose accelerators.

AI, codesign, Accelerated Computing, Modeling and ↗

Performance Comparison of Object Detection Networks for Shrapnel Identification in Ultrasound Images

Ultrasound imaging is a critical tool for triaging and diagnosing subjects but only if images can be properly interpreted. Unfortunately, in remote or military medicine situations, the expertise to interpret images can be lacking. Machine-learning image interpretation models that are explainable to the end user and deployable in real time with ultrasound equipment have the potential to solve this problem. We have previously shown how a YOLOv3 (You Only Look Once) object detection algorithm can be used for tracking shrapnel, artery, vein, and nerve fiber bundle features in a tissue phantom. However, real-time implementation of an object detection model requires optimizing model inference time. Here, we compare the performance of five different object detection deep-learning models with varying architectures and trainable parameters to determine which model is most suitable for this shrapnel-tracking ultrasound image application. We used a dataset of more than 16,000 ultrasound images from gelatin tissue phantoms containing artery, vein, nerve fiber, and shrapnel features for training and evaluating each model. Every object detection model surpassed 0.85 mean average precision except for the detection transformer model. Overall, the YOLOv7tiny model had the higher mean average precision and quickest inference time, making it the obvious model choice for this ultrasound imaging application. Other object detection models were overfitting the data as was determined by lower testing performance compared with higher training performance. In summary, the YOLOv7tiny object detection model had the best mean average precision and inference time and was selected as optimal for this application. Next steps will implement this object detection algorithm for real-time applications, an important next step in translating AI models for emergency and military medicine.

60 APPLIED LIFE SCIENCES↗

EcoBOT: an AI/ML enabled automated phenotyping capability for model plants

Introduction: Advances in automation and AI/ML offer new opportunities for plant science, including design, modeling, and analysis. This study aimed to develop an automated platform for researching small model plants under axenic conditions and integrate it with AI/ML tools. Methods: The EcoBOT platform was developed, which consists of sterile containers (EcoFABs) for growing plants and imaging for monitoring plant growth and health. Brachypodium distachyon was grown on the EcoBOT, and its response to nutrient limitation and copper stress was evaluated. Results: The results showed that Brachypodium distachyon grown in the EcoBOT maintained sterility and responded to nutrient limitation and copper stress. Analysis of over 6,500 root and shoot images revealed varying sensitivity and response rates to copper. Bayesian Optimization was used to improve model accuracies relating copper concentrations to plant biomass via sequential experiments, resulting in a >30% improvement. Discussion: The findings of this study demonstrate the potential of the EcoBOT platform for researching plant responses to environmental factors. Future experiments could focus on relating other chemical stresses and microbial interactions to create generalized models of plant responses.

AI image analysis↗

Observable optimization for precision theory: machine learning energy correlators

The practice of collider physics typically involves the marginalization of multi-dimensional collider data to uni-dimensional observables relevant for some physics task. In many cases, such as classification or anomaly detection, the observable can be arbitrarily complicated, such as the output of a neural network. However, for precision measurements, the observable must correspond to something computable systematically beyond the level of current simulation tools. In this work, we demonstrate that precision-theory-compatible observable space exploration can be systematized by using neural simulation-based inference techniques from machine learning. We illustrate this approach by exploring the space of marginalizations of the energy 3-point correlator to optimize sensitivity to the top quark mass. We first learn the energy-weighted probability density from simulation, then search in the space of marginalizations for an optimal triangle shape. Although simulations and machine learning are used in the process of observable optimization, the output is an observable definition which can be then computed to high precision and compared directly to data without any memory of the computations which produced it. We find that the optimal marginalization is isosceles triangles on the sphere with a side ratio approximately $1 : 1 : \sqrt{2}$ (i.e. right triangles) within the set of marginalizations we consider.

Jets and Jet Substructure↗

Considerations for Introducing Artificial Intelligence into Nuclear Power Plants

Advanced computational tools and techniques such as artificial intelligence and machine learning (AI/ML) can transform the nuclear power industry. This is necessary given that the economic viability of the existing fleet is in jeopardy and its labor-centric approach to operations and maintenance. Currently, AI/ML research is being undertaken for reactor system design and analysis including fault and accident prognosis, nuclear risk analysis such as plant safety and security evaluation, and plant operations and maintenance including predictive maintenance. Applications include both existing and advanced reactor technologies with the aim of improving operational and business efficiencies. Most every aspect of the organization can benefit, from instrumentation and control, to work planning, to human-machine interactions and business management. AI/ML in nuclear can simplify complex problems and produce more effective decision-making. Nonetheless, careful consideration must be given to the implementation of an AI/ML initiative. The aims of this research are to 1) review barriers to AI/ML adoption within the nuclear power industry, and 2) suggest potential solutions. These barriers are organized along five distinct categories (Figure 1) that are interconnected. The first are historical barriers that track the industry’s development over the decades including worldwide nuclear events that shaped public perceptions. The resulting federal scrutiny and intense safety culture that emerged are discussed. Technical barriers to AI/ML adoption are considerable, and include data privacy concerns, data governance, and the current lack of AI/ML expert knowledge at the plants. The main business case barrier remains cost, but an absence of an industry-wide vision and wide-scale adoption also produces reluctance. Stakeholder readiness is reviewed with special attention given to regulatory readiness. The 5-year strategic plan for AI readiness recently published by the U.S. Nuclear Regulatory Commission is highlighted. Last, adoption barriers at the user level are addressed including the importance of user experience and explainable AI. The AI adoption barriers described here are inter-related and ideally should be addressed in a holistic fashion.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Parasitic Effects in Impedance Spectrum of PEM Water Electrolysis Cells: Case Study of High-Frequency Inductive Effects

Electrochemical impedance spectroscopy (EIS) is a powerful tool to characterize and distinguish electrochemical, electrical, and diffusive processes in an electrolysis cell. The EIS response with small impedance (mΩ) depends on components and materials of the cell, but often also on the electrical setup, cables, and connectors, leading to incorrect conclusions about the performance of the electrolysis cells. These parasitic effects are assessed via a short-circuit measurement and confirmed to be external from the membrane electrode assembly (MEA). In the setup, the inductive characteristic is described by a modified inductive reactance and must be included in the equivalent circuit model (ECM) which is fitting the cell EIS spectra in operation (in situ). If points of the spectra showing inductive characteristic (below x-axis in Nyquist plot) are excluded from the ECM evaluation, an artificially increased ohmic resistance at high frequencies is obtained. In addition, considerations on other components of the ECM can be misleading and significantly incorrect. The only way to avoid that inductive behavior caused by the external setup is incorrectly assigned to the ECM describing properties of the MEA is to include the inductive effects in the ECM analysis of in situ EIS measurements.

30 DIRECT ENERGY CONVERSION↗

A standards perspective on genomic data reusability and reproducibility

Genomic and metagenomic sequence data provides an unprecedented ability to re-examine findings, offering a transformative potential for advancing research, developing computational tools, enhancing clinical applications, and fostering scientific collaboration. However, effective and ethical reuse of genomics data is hampered by numerous technical and social challenges. The International Microbiome and Multi’Omics Standards Alliance (IMMSA, https://www.microbialstandards.org/) and the Genomic Standards Consortium (GSC, https://gensc.org) hosted a 5-part seminar series “A Year of Data Reuse” in 2024 to explore challenges and opportunities of data reuse and reproducibility across disparate domains of the genomic sciences. Addressing these challenges will require a multifaceted approach, including common metadata reporting, clear communication, standardized protocols, improved data management infrastructure, ethical guidelines, and collaborative policies that prioritize transparency and accessibility. We offer strategies to enable responsible and technically feasible data reuse, recognition of data reproducibility challenges, and emphasizing the importance of cross-disciplinary efforts in the pursuit of open science and data-driven innovation.

59 BASIC BIOLOGICAL SCIENCES↗

PRIMED for the Future: Purposing Raw Intake for Machine Learning-Enabled Detection (Final Report)

The COVID-19 pandemic demonstrated how a novel, elusive, and diffuse biological threat can engender uncertainty and misinformation, and it underscored the need for flexible analytical modalities agnostic to the identity of biological material. Yet even before the pandemic, recognition of the limitations of the current, list-based approach, which focuses on known pathogens and biotoxins, and of the importance of agent-agnostic biodetection was growing within the biosecurity community. In a 2018 report on “Biodefense in the Age of Synthetic Biology,” for example, the National Academy of Sciences stated that “an overreliance on the Select Agent List is a systematic weakness affecting many aspects of the United States’ current biodefense mitigation capability”. More recently, a group of biodefense researchers proposed the identification and adoption of “bioagent-agnostic signatures (BASs)” as a way of detecting and characterizing not only existing agents but also novel ones, an approach they believe will “enable a more flexible and resilient biodefense posture”. Indeed, the future of biodetection requires us to begin developing novel analytics that can identify anomalies and/or characteristics that indicate a potential threat, whether known or unknown, without looking for a specific signature that has been identified previously. To assess potential threats more rapidly, it is critical to develop agnostic artificial intelligence (AI)/machine learning (ML) systems that can be employed for real-time assessment of the nature and source of a perturbation. Such systems should be multi scale and multi-dimensional, integrating sensor data from a range of biological, chemical, and physical application spaces. Emerging deep learning (DL) models demonstrate exceptional promise for identification of discriminatory features within multi-dimensional datasets. DL models have the capacity to recognize and encode highly complex patterns in a wide range of input data modalities, including images, text, and biological/chemical/physical spectra. As such, they can execute a wide range of assessments and determinations that have traditionally required a human operator. The promise of advances in DL is apparent in the realm of human health and medicine. DL models have been validated for evaluating a variety of clinical threats to human health in a range of contexts, including infection and cancer, and they demonstrated improved performance in predicting stroke relative to human neurologists in some categories of data. Continuously evolving advances in AI/ML are expected to support more efficient evaluation of raw sequence, spectroscopy, and spectrometry data. For instance, recent advances and deployment of large language models (LLM) such as Generative Pre training Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) have already motivated application of these models for biological function prediction. As frameworks such as LLMs become larger and more complex in their representations, their capacity to serve as pre-trained models that can be fine-tuned for biological/biodetection purposes will similarly be amplified. While existing and emerging AI/ML have found broad applicability and use cases in the clinical sciences, development for environmental evaluation and biodetection has been limited. Functionalizing such capabilities for this purpose requires an understanding of the existing technical landscape and how the respective tools and algorithms are currently being employed. This landscape awareness then allows an assessment of the current practical capabilities of existing models and the anticipated requirements and development efforts that will be needed to adapt available algorithms for biodetection applications relevant to DHS. Leveraging expertise in biodetection, ML, and operational biodetection, the effort described in this report is comprised of a systematic landscape assessment (Subtask 2.1), comparative evaluation (Subtask 2.2), and formulation of a value proposition (Subtask 2.3) for the prospect of ML-enabled, agnostic biodetection from raw, or minimally-processed, datasets.

59 BASIC BIOLOGICAL SCIENCES↗

Velocity Extraction Using Complete Time-Domain Waveform Data and Audio Machine Learning

We developed a new machine learning-based tool for extracting information from interferometry measurements: MIDWAZE (Modular Interferometry Direct Waveform AnalyZEr). This paper showcases MIDWAZE’s ability to extract an object’s velocity information from Photonic Doppler Velocimetry (PDV) data at near-human accuracy with little to no human intervention. MIDWAZE can extract velocities roughly 350 times as fast as a human analyst "rushing" to complete their extractions, with similar extraction accuracy. MIDWAZE’s most outstanding feature is that it operates directly in waveform/temporal space, freeing analysis from certain limitations imposed by traditional spectrogram-based approaches and opening the way to "phase aware" PDV analysis. MIDWAZE also has limited ability to discriminate between different solid objects, which we develop as a first step towards automated discrimination of different kinds of objects such as ejecta clouds.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗