Search NASASearch

SEARCH · Search NASA

Results for “Data frames”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

BOSC 2025, the 26th Bioinformatics Open Source Conference

The 26th annual Bioinformatics Open Source Conference (BOSC 2025, open-bio.org/events/bosc-2025) brought its community-driven focus on open-source bioinformatics and open science to the 2025 conference on Intelligent Systems for Molecular Biology and the European Conference on Computational Biology (ISMB/ECCB 2025). Since its launch in 2000, BOSC has been the premier annual meeting covering open-source bioinformatics and open science. Framed by two keynote addresses and a thought-provoking panel discussion, the two-day conference included sessions dedicated to open data, analytic tools and pipelines, workflow platforms, knowledge representation, and the application of AI/ML. The first keynote talk was delivered by Christine Orengo: “Working together to develop, promote and protect our data resources: Lessons learnt developing CATH and TED.” A joint session with the Bio-Ontologies and Knowledge Representation (BOKR) track the second day of BOSC started with a keynote talk by Chris Mungall entitled “Open Knowledge Bases in the Age of Generative AI”. A closing panel on Data Sustainability, moderated by Mónica Muñoz Torres, featured panelists Scott Edmunds, Varsha Khodiyar, Tony Burdett, Nicky Mulder, and Chris Mungall. This year, the CollaborationFest collaborative work event that typically precedes or follows ISMB was incorporated as part of the main conference and organized by BOSC with help from the Function and 3D-SIG tracks.

bioinformatics

GridCoPilot for Thermal Events: An LLM-Based Platform for Power Grid Reliability Analysis

Large Language Models show promise for translating natural language into database queries, but deploying such systems in safety-critical domains requires high reliability. We present an application of GridCoPilot to thermal event analysis (heatwaves and coldwaves) that affect power grid reliability. Our approach uses a LangChain SQL Agent to translate natural language queries into auditable SQL statements, with deterministic visualization routines that parse the structured query results. We introduce structural framing as a design principle, we integrate a NERC-region-level event library with county-level meteorology and decompose the combined data into three relational tables (event metadata, county-level event details, and a county-to-NERC subregion mapping), using prompt-guided joins to direct the model toward correct multi-table queries. For two core analytical patterns (identifying worst events by region and by region-year), the system achieved 100% SQL accuracy across all 16 NERC subregions and both event types (64 queries total). These results validate the approach for target use cases, though performance on diverse natural language formulations requires further investigation. We discuss design trade-offs, failure modes including JSON output truncation, and pathways for extending this approach to other hazard domains.

24 POWER TRANSMISSION AND DISTRIBUTION

Unrolled Video Super-Resolution Network with Autoregressive Prior for the Case of Known Motion

Real-time detection and classification of distant objects is necessary for many national security applications. However, when objects are far from the sensor, they occupy only a small number of pixels in the captured video, limiting the amount of visual detail available for recognition. State-of-the-art classification methods typically rely on high-resolution (HR) video streams to capture characteristic object features, but obtaining such detail is challenging for distant objects that occupy only a few pixels. This motivates the development of video super-resolution (VSR) methods that enhance object classification by recovering fine details from low-pixel representations. Current VSR methods rely either on model-based optimization, which is interpretable but computationally expensive, or on learning-based approaches, which are efficient and high-performing but often lack flexibility and interpretability. In this report, we propose an end-to-end trainable unrolled VSR network, UVSRNet, which super-resolves each frame in a video by exploiting sub-pixel motion between neighboring low-resolution (LR) frames as well as incorporating high-frequency detail from previously super-resolved frames. In particular, by unrolling a plug-and-play (PnP) half-quadratic splitting (HQS) algorithm, we leverage a model-based data-fitting module alongside a learning-based autoregressive prior module. This combination yields a method that maintains the flexibility and interpretability of model-based methods while achieving the performance advantages of learning-based methods.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF

Rasterization with Data-Parallel Primitives

Parallel rasterization can suffer from race conditions during fragment generation, which is traditionally addressed by using specialized hardware accessible via vendor graphics APIs. Unfortunately, graphics APIs are increasingly problematic on high-performance computers, either because they are not provided or because of concerns about dependencies with in situ visualization. In response, we present a hardware-agnostic rasterization algorithm that handles race conditions using only data-parallel primitives (DPPs), enabling efficient rendering on HPC systems without graphics API dependencies and aligning with recent efforts to deliver visualization software with DPPs. Our evaluation consists of three phases: (1) evaluating portability across different CPU and GPU architectures, (2) evaluating competitiveness with a community standard, and (3) evaluating performance across varying workloads and available parallelism. The supporting experiments run on both AMD and NVIDIA GPUs, considering data sets as large as 460 million triangles and 160 million pixels. While performance generally falls short of graphics API baselines, it achieves interactive frame rates on most workloads. As a result, we conclude our approach is a viable solution for rasterization on high-performance computers since our approach is portably performant across different architectures without the need for specialized vendor support.

Buckley, Makani [University of Oregon] (ORCID:0009

A multifrequency study of sub-parsec jets with the Event Horizon Telescope

Context. The 2017 observing campaign of the Event Horizon Telescope (EHT) delivered the first very long baseline interferometry (VLBI) images at the observing frequency of 230 GHz, leading to a number of unique studies on black holes and relativistic jets from active galactic nuclei (AGN). In total, eighteen sources were observed, including the main science targets, Sgr A* and M 87, and various calibrators. Sixteen sources were AGN.Aims. We investigated the morphology of the sixteen AGN in the EHT 2017 data set, focusing on the properties of the VLBI cores: size, flux density, and brightness temperature. We studied their dependence on the observing frequency in order to compare it with the Blandford-Königl (BK) jet model. In particular, we aimed to study the signatures of jet acceleration and magnetic energy conversion.Methods. We modeled the source structure of seven AGN in the EHT 2017 data set using linearly polarized circular Gaussian components (1749+096, 1055+018, BL Lac, J0132–1654, J0006–0623, CTA 102, and 3C 454.3) and collected results for the other nine AGN from dedicated EHT publications, complemented by lower frequency data in the 2–86 GHz range. Combining these data into a multifrequency EHT+ data set, we studied the dependences of the VLBI core component flux density, size, and brightness temperature on the frequency measured in the AGN host frame (and hence on the distance from the central black hole), characterizing them with power law fits. We compared the observations with the BK jet model and estimated the magnetic field strength dependence on the distance from the central black hole.Results. Our observations spanning event horizon to parsec scales indicate a deviation from the standard BK model, particularly in the decrease of the brightness temperature with the observing frequency. Only some of the discrepancies may be alleviated by tweaking the model parameters or the jet collimation profile. Either bulk acceleration of the jet material, energy transfer from the magnetic field to the particles, or both are required to explain the observations. For our sample, we estimate a general radial dependence of the Doppler factor δ ∝ r≤0.5. This interpretation is consistent with a magnetically accelerated sub-parsec jet. We also estimate a steep decrease of the magnetic field strength with radius B ∝ r−3, hinting at jet acceleration or efficient magnetic energy dissipation.Key words: techniques: interferometric / galaxies: active / galaxies: jets / galaxies: nuclei / quasars: general / quasars: supermassive black holes⋆⋆ Deceased.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

Bim-to-fea Conversion Program

The purpose of this program is to enable interoperability between BIM-based architectural design software (i.e., Revit, ArchiCAD, AVEVA E3D) to structural analysis software (i.e., SAP2000). The program takes in BIM building model data via the IFC file format, automatically transforms the architectural coordination entities (structural beams, columns, slabs, walls) to structural analysis entities (i.e., finite element space frames and shells), automatically adjusts the connectivity of the structural analysis entities, and finally exports the structural analysis entities as a structural analysis model contained within a new IFC file. For example, a 3D building in Revit can be exported to an IFC file, run through this BIM-to-FEA program, then the exported IFC can be inputted into SAP2000.

Crowder, Nicholas [Idaho National Laboratory (INL)

Electronic structure prediction of medium and high entropy alloys across composition space

We propose machine learning (ML) models to predict the electron density — the fundamental unknown of a material’s ground state — across the composition space of concentrated alloys. From this, other physical properties can be inferred, enabling accelerated exploration. A significant challenge is that the number of descriptors and sampled compositions required for accurate prediction grows rapidly with species. To address this, we employ Bayesian Active Learning (AL), which minimizes training data requirements by leveraging uncertainty quantification capabilities of Bayesian Neural Networks. Compared to the strategic tessellation of the composition space, Bayesian-AL reduces the number of training data points by a factor of 2.5 for ternary (SiGeSn) and 1.7 for quaternary (CrFeCoNi) systems. We also introduce easy-to-optimize, body-attached-frame descriptors, which respect physical symmetries while keeping descriptor-vector size nearly constant as alloy complexity increases. Our ML models demonstrate high accuracy and generalizability in predicting both electron density and energy across composition space.

materials science

Machine learning-driven descriptions of protein dynamics at solid-liquid interfaces

This chapter has described how ML has enabled quantitative analysis of HS-AFM data to discover the physical phenomena governing protein dynamics and ordering at solid-liquid interfaces. The research detailed in this chapter modeled the rotation models of protein nanorods, the discovery of which would otherwise not be possible. By tracking the trajectories of individual protein rods from frame to frame, it was possible to model Brownian type motion and behaviors and Levy-flight dynamics that had not previously been shown. We also described the application of the Python package AtomAI, which has been developed specifically to analyze and extract physical phenomena, providing exemplar code for training an ensemble of deep neural networks to produce the semantic segmentation of AFM data and functions for encoding and decoding local environments. We last described a combinatorial approach to analyze very noisy data with a densely covered substrate where the emergence of order for the protein liquid crystals could be elucidated. By combining the methods from Case 1 and 2, it was possible to obtain the center of mass and angle for each rod in the images and track the assembly of the rods over time into a 2D liquid crystal array on the surface of mica.

protein dynamics, solid-liquid interfaces, atomic

Breakthrough Conductivity Enhancement in Deep Eutectic Solvents via Grotthuss–Type Proton Transport

There is an increasing demand for the development of ion-conducting electrolytes for energy storage systems. Much attention is directed toward deep eutectic solvents as potential candidates. In the search for highly conductive systems, the possibility of designing deep eutectic solvents with Grotthuss-type proton transport is widely overlooked. Herein, ethaline, a mixture of choline chloride and ethylene glycol is used in a 1:2 molar ratio, to induce a significant conductivity increase with the addition of water and sulfuric acid (H 2 SO 4 ). The achieved breakthrough conductivity is analyzed experimentally and simulated with ab initio molecular dynamics (AIMD). At sufficient water content, an H-bonding network is formed that leads to a significant breakthrough conductivity based on H 2 SO 4 -derived proton transfer following the long-established Grotthuss proton transport mechanism. This result is substantiated by the positive deviation from the ideal KCl line in the Walden plot. Specifically, the data series positioned above the reference line indicates a Grotthuss mechanism in action. The AIMD simulations demonstrate proton transfer between water and ethylene glycol, supported by simulation frames captured at various times.

36 MATERIALS SCIENCE

Regularization via f -Divergence: An Application to Multi-Oxide Spectroscopic Analysis

In this paper, we explore the application of convolutional neural networks (CNNs) for predicting the chemical composition of complex geologic samples in a simulated Martian atmospheric environment. Specifically, we aim to characterize oxide weight percentages (wt.%) of rock samples analyzed by remote Laser-Induced Breakdown Spectroscopy (LIBS), framing the problem as a multi-target regression task . Neural networks trained on LIBS spectra are prone to overfitting due to high spectral complexity, limited labeled data, and measurement noise. While regularization is critical for improving generalization, common methods (e.g., ℓ 2 regularization) impose constraints not directly tied to data distribution properties. We propose a novel regularization method based on a specific ƒ-divergence induced by a graph-based estimator, designed to constrain the distributional discrepancy between predictions and targets. This regularizer serves a dual purpose: (a) mitigating overfitting by enforcing a constraint on the distributional difference between predictions and noisy targets, and (b) acting as an auxiliary loss that penalizes large divergences. To enable backpropagation, we develop a differentiable approximation of this particular ƒ-divergence, making the method feasible for neural networks. Experiments on ChemCam and SuperCam LIBS calibration spectra show that mathematical equation-divergence regularization outperforms or matches standard regularization methods (ℓ 1 , ℓ 2 , dropout) and the classical baseline, partial least squares (PLS). Combining ƒ-divergence regularization with standard regularization yields further performance gains, indicating that distributional regularization is useful in this context giving a promising direction for robust model training in planetary science applications. Source code is publicly available at Klein and Li (2025), https://doi.org/10.11578/dc.20250530.7.

58 GEOSCIENCES

Dark Matter Velocity Distributions for Direct Detection: Astrophysical Uncertainties Are Smaller Than They Appear

The sensitivity of direct detection experiments depends on the phase-space distribution of dark matter near the Sun, which can be modeled theoretically using cosmological hydrodynamical simulations of Milky Way–like galaxies. However, capturing the halo-to-halo variation in the local dark matter speeds—a necessary step for quantifying the astrophysical uncertainties that feed into experimental results—requires a sufficiently large sample of simulated galaxies, which has been a challenge. In this Letter, we quantify this variation with nearly 100 Milky Way–like galaxies from the tng50 simulation, the largest sample to date at this resolution. Moreover, we introduce a novel phase-space scaling procedure that endows every system with a reference frame that accurately reproduces the local standard-of-rest speed of our Galaxy, providing a principled way of extrapolating the simulation results to real-world data. The ensemble of predicted speed distributions is well characterized by the standard halo model, a Maxwell-Boltzmann distribution truncated at the escape speed, though the individual distributions can deviate from it, especially at high speeds. The dark matter–nucleon cross section limits placed by these speed distributions vary by ∼ 60% about the median. This places the 1⁢𝜎 astrophysical uncertainty at or below the level of the systematic uncertainty of current ton-scale detectors, even down to the energy threshold. The predicted uncertainty remains unchanged when subselecting on those TNG 50 galaxies with merger histories similar to the Milky Way. Tabulated speed distributions, as well as Maxwell-Boltzmann fits, are provided for use in computing direct detection bounds or projecting sensitivities.

Milky Way

Statistically elucidated responses from low-signal contrast mechanisms in ultrafast electron microscopy

The emergence of ultrafast electron microscopy (UEM) has enabled the discovery of strongly correlated dynamic mechanisms, including electron–phonon coupling, structural phase transitions, thermal transport, and electromagnetic deflection. Most UEM systems operate stroboscopically, meaning that the technique is susceptible to artifacts, mistakes, and misinterpretation of the data due to extensive experimental effort. In contrast to the ultrafast designation, data acquisition is extraordinarily slow because the electron beam has significantly reduced signal compared to traditional transmission electron microscopy due to pulsing the electron beam. Consequently, the sample may drift, tilt, or undergo irreversible structural changes that are independent of the time-resolved dynamics throughout the experimental time frame. Furthermore, these datasets require significant user interpretation that can be problematic when proper controls are not implemented thoroughly. Here, we demonstrate a new algorithm designed to separate ultrafast structural dynamics from long-term artifacts using a LiNbO 3 sample experiencing electrically driven surface acoustic wave propagation. Additionally, we provide examples of the impact of user bias when analyzing the data and provide a methodology, which enables the extraction of time-resolved responses when the image signal is extraordinarily low. Overall, the goal of this publication is to provide methods that validate the experimental results and reduce researcher biases during UEM data interpretation.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND

Super-Resolved Single-Molecule Tracking Studies of Rhodamine B Accumulation on Fresh and Aged Polyethylene Terephthalate

It is well-known that toxic organic micropollutants (OMs) accumulate on the surfaces of microplastics. However, much remains to be learned about the exact molecular level mechanisms of OM accumulation and how these evolve as the plastics age. In this work, super-resolved single-molecule tracking (SMT) is used for the first time to investigate the accumulation of Rhodamine B (RhB) dye on fresh and artificially aged polyethylene terephthalate (PET) surfaces. PET thin films serve as models for microplastics, while RhB serves as a proxy for the OMs they accumulate. Artificial aging of the films is accomplished by exposing them in a UV-ozone chamber. Water contact angle, spectroscopic ellipsometry, and carbonyl index measurements reveal a gradual decrease in film hydrophobicity, thickness, and carbonyl content with age. Atomic force microscopy (AFM) data reveal an increase in surface roughness and confirm that the films remain largely intact and continuous across the aging times explored. In SMT experiments, wide-field fluorescence videos acquired from the water/PET interface under 7.5 pM RhB reveal both mobile and immobile dye molecules. Measurements of the frame-to-frame displacements of the dye show that diffusion occurs by a desorption-mediated mechanism and that the diffusion rate varies with PET film age. The surface density of mobile dye molecules decreases with increasing PET age, while the population of immobile molecules becomes relatively larger, suggesting an age-dependent transformation of the mechanism(s) by which the dye is accumulated. SMT data reveal that both mobile and immobile molecules repeatedly adsorb over the same surface sites, consistent with the emergence of nanoscale PET surface heterogeneity also revealed by AFM. Estimates of the adsorption coefficients are obtained using a nearest-neighbor analysis, giving values from 9.9 × 10 5 to 2.1 × 10 6 M –1 for immobile molecules and from 1.8 × 10 5 to 2.5 × 10 5 M –1 for mobile molecules on fresh and 5 min aged PET, respectively. Here, anomalous age-dependent variations in the velocity of molecular motion on the PET surface and in the population of immobile molecules are shown to correlate with changes in the strength of RhB adsorption.

Adsorption

TEAMER: Pitching Foil Crossflow Turbine Efficiency Data

This dataset documents the efficiency testing of a pitching foil crossflow turbine, conducted at the University of New Hampshire's (UNH) Chase Ocean Engineering Laboratory tow tank facility. The tests explored various pitch phases and amplitudes, ranging from 0 to 18 degrees, across different flow speeds and turbine RPMs. Specifically, testing was performed at pitch amplitudes of 0,3,6,9,12,15 and 18 degrees. The results indicate that turbine efficiency improves with increased pitch amplitude, reaching optimal performance at 12 degrees. Modifications were made to the test frame by UNH to enhance the stiffness of the support structure. The testing specifically mapped the efficiency of a single quadrant of the Ocean Renewable Power Company (ORPC) Autonomous Turbine Generator Unit (ATGU), covering the full range of allowable pitching amplitudes and phases. The dataset provides both raw and processed data, including drag and torque measurements, and contains Python scripts used for data processing and visualization. This research was supported by funding from TEAMER RFTS 1 (Request for Technical Support).

16 TIDAL AND WAVE POWER

Utilization of Unmanned Aircraft Systems for Environmental Purposes at the Savannah River Site – 26578

Born in the 1950s, the Savannah River Plant was constructed as a plutonium and tritium production plant. As the Cold War era came and went, a change of direction was signaled when the name of the facility changed from Savannah River Plant to Savannah River Site (1989) – the main mission at Savannah River shifted from “production” to “cleanup.” The Department of Energy is responsible for managing the 310 square miles of land that is the Savannah River Site and the cleanup/remediation activities that occur. The Savannah River National Laboratory utilizes unmanned aircraft systems to assist with some of those environmental monitoring and remediation activities. One function of unmanned aircraft systems at the Savannah River National Laboratory is conducting aerial photography and videography. Various infrastructure evaluations have been performed with unmanned aircraft – facility rooftop inspections, water tower lock verifications, earthen dam surveys, etc. An unmanned aircraft system has been used for progress footage of remediation projects – Dunbarton Bay remediation, Saltstone Disposal Unit construction, etc. Thermal cameras on an unmanned aircraft system are used to help identify cracks/leaks in structures from vantage points not readily accessible by personnel. Virtual tours of different waste units are conducted with unmanned aircraft systems for Site groups and federal/state regulators to save costs and travel time. Additionally, advanced remote sensing technologies are used on unmanned aircraft systems at the Savannah River Site. Light Detection and Ranging uses laser pulses to measure distances to the Earth's surface or other targets to create highly detailed topographic maps that accurately portray terrain (e.g., elevation changes, slopes, and contours). Data collection with a Light Detection and Ranging unit mounted on an unmanned aircraft system is quick and efficient – large-area surveys are conducted in shorter time frames. Because Light Detection and Ranging can penetrate through foliage and vegetation to ground level, it is being used in conjunction with a watershed model to study the General Separations Area of the Site to determine stormwater flow volume and direction, monitor stream stability, and forecast river flow behavior. A hyperspectral camera captures a wide spectrum of electromagnetic wavelengths across numerous narrow bands, beyond what the human eye can see. It provides detailed spectral information about the objects or surfaces in an image, which can be used to identify and analyze materials based on their spectral signatures. A hyperspectral camera mounted on an unmanned aircraft system has been used at the Savannah River Site for non-destructive evaluation of concrete and concrete structures. Unmanned aircraft systems at the Savannah River Site are also used for the application of herbicide on identified rooftops. P-Reactor and R-Reactor are entombed nuclear reactors at the Savannah River Site. Unwanted vegetation is often present on these rooftops – over time roots can penetrate seams, cracks, and joints of the general roof and concrete caps, leading to water ingress and deterioration of the structural components. For time and cost efficiencies as well as in the interest of personnel safety, an unmanned aircraft is used to dispense herbicide on rooftop areas where vegetation is noticed to help alleviate the issues/hazards.

Lorier, Troy [Savannah River National Laboratory (

Search for Higgs boson decays into a Z boson and a light hadronically decaying resonance in pp collisions at s =13 TeV with the ATLAS detector

A search for decays of the Higgs boson into a Z boson and a light resonance, with a mass of 0.5–3.5 GeV, is performed using the full 140 fb−1 dataset of 13 TeV proton–proton collisions recorded by the ATLAS detector during LHC Run 2. Leptonic decays of the Z boson and hadronic decays of the light resonance are considered. The resonance can be interpreted as a J / ψ or η c meson, an axion-like particle, or a light pseudoscalar predicted in two-Higgs-doublet models. Due to its low mass, this resonance is produced with a high Lorentz boost in the laboratory frame and therefore reconstructed as a single small-radius jet of hadrons. A neural network is used to correct the Monte Carlo simulation of the total expected background using data from sideband regions. Two additional neural networks are used to distinguish signal from background, enhancing the purity of the signal region. A binned profile-likelihood fit is performed on the final-state invariant mass distribution. No significant excess of events relative to the expected background is observed, and upper limits at 95% confidence level are set on the Higgs boson's branching fraction to a Z boson and a light resonance. The exclusion limit is ∼10% for the lower masses, and increases for higher masses. Upper limits on the effective coupling C Z H eff / Λ of an axion-like particle to a Higgs boson and Z boson are also set at 95% confidence level, and range from 0.9 to 2 TeV−1.

Aad, G

Union through UNITY: Cosmology with 2000 SNe Using a Unified Bayesian Framework

Type Ia supernovae (SNe Ia) were instrumental in establishing the acceleration of the Universe’s expansion. By virtue of their combination of distance reach, precision, and prevalence, they continue to provide key cosmological constraints, complementing other cosmological probes. Individual SN surveys cover only over about a factor of 2 in redshift, so compilations of multiple SN data sets are strongly beneficial. We assemble an up-to-date “Union” compilation of 2087 cosmologically useful SNe Ia from 24 data sets (“Union3”). We take care to put all SNe on the same distance scale and update the light-curve fitting with SALT3 to use the full rest-frame optical. Over the next few years, the number of cosmologically useful SNe Ia will increase by more than a factor of 10, and keeping systematic uncertainties subdominant will be more challenging than ever. We discuss the importance of treating outliers, selection effects, light-curve shape/color populations/standardization relations, unexplained dispersion, and heterogeneous observations simultaneously. We present an updated Bayesian framework, called UNITY1.5 (Unified Nonlinear Inference for Type-Ia cosmologY), that incorporates significant improvements in our ability to model selection effects, standardization, and systematic uncertainties compared to earlier analyses. As an analysis byproduct, we also recover the posterior of the SN-only peculiar-velocity field, although we do not interpret it in this work. We compute updated cosmological constraints with Union3 and UNITY1.5, finding weak 1.7σ–2.6σ tension with flat cold dark matter and possible evidence for thawing dark energy (w0 > − 1, wa < 0). We release our SN distances, light-curve fits, and UNITY1.5 framework to the community.

Rubin, David

Edge AI-Enhanced Traffic Monitoring and Anomaly Detection Using Multimodal Large Language Models

This paper addresses the challenge of traffic monitoring and incident detection in remote areas, utilizing multimodal large language models (LLMs) deployed on edge AI devices. The key novelty of the LLM is to convert real-time video streams into descriptive texts, enabling low-bandwidth transmissions and reliable detection of anomalies and incidents in environments of intermittent connectivity. The model is developed based on fine-tuning open-source LLMs and extending it with multi-modal capabilities to analyze video frames. Our work also involves deploying this model on edge devices such as Nvidia IGX Orin and is planned to be tested in realistic environments in future work. The methodology includes data set curation, iterative model fine-tuning and compression, and hardware-based optimization. This approach aims to enhance traffic safety and response speed in remote areas, marking a significant advancement in the application of AI for traffic monitoring and safety management.

Peruski, Ryan [University of Tennessee, Knoxville