Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Vehicle Automation Benefits and Challenges for Passenger Transport System Beyond Automated Driving

The National Renewable Energy Laboratory has been researching the implementation of fully automated passenger transport systems to be operated within dense urban settings, referred to as Automated Mobility Districts, based on roadway vehicle automation as opposed to track or train-based automation. This research, now in its third phase, is presently addressing the full spectrum of benefits and challenges of full automation of passenger transport systems with respect to fleet electrification and the associated multimodal, large fleet operational management, benefits beyond simply automating the driving tasks. The focal points summarized in the paper and presentation address the benefit-analysis of fleet automation to address added complexities imposed on the multi-fleet operational management when there is a simultaneous implementation of an on-demand service mode that connects with and optimizes the effectiveness of legacy transit systems and new sub-regional autonomous vehicle fleets, with specific emphasis on enhanced ability to better meet peak ridership demand. The research also begins to address challenges in operations arising from lack of personnel present to handle unexpected customer and system needs. Combined, this research articulates vehicle automation benefits and challenges beyond simply automating the driving tasks, addressing additional operational benefits automation provides to address the added complexities imposed by electrification and on-demand modes of operation.

33 ADVANCED PROPULSION SYSTEMS↗

Pan-cancer evaluation of clinical value of mitotic network activity index (MNAI) and its predictive value for immunotherapy

Increased mitotic activity is associated with the genesis and aggressiveness of many cancers. To assess the clinical value of mitotic activity as prognostic biomarker, we performed a pan-cancer study on the mitotic network activity index (MNAI) constructed based on 54-gene mitotic apparatus network. Our pan-cancer assessment on TCGA (33 tumor types, 10,061 patients) and validation on other publicly available cohorts (23 tumor types, 9,209 patients) confirmed the significant association of MNAI with overall survival, progression-free survival, and other prognostic endpoints in multiple cancer types, including lower-grade gliomas (LGG), breast invasive carcinoma (BRCA), as well as many others. We also showed significant association between MNAI and genetic instability, which provides a biological explanation of its prognostic impact at pan-cancer landscape. Our association analysis revealed that patients with high MNAI benefitted more from anti-PD-1 and Anti-CTLA-4 treatment. In addition, we demonstrated that multimodal integration of MNAI and the AI-empowered Cellular Morphometric Subtypes (CMS) significantly improved the predictive power of prognosis compared to using MNAI and CMS alone. Our results suggest that MNAI can be used as a potential prognostic biomarker for different tumor types toward different clinical endpoints, and multimodal integration of MNAI and CMS exceeds individual biomarker for precision prognosis.

60 APPLIED LIFE SCIENCES↗

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗

A Relaxed PV Bus Model in Linear Power Flow

The emerging multimodal active energy resource units make it necessary to introduce constant voltage amplitude buses (PV bus) in the operation of modern distribution systems. To enable the analysis of PV bus using linear power flow models, this letter proposes a relaxed PV bus model for solving power flow related problems using an indirect modeling approach. The developed PV bus model can be applied to linear power flow models in both rectangular and polar coordinates. Besides, the approximation error of the relaxed PV bus model can also be controlled and quantified. Lastly, the proposed relaxed PV bus model is validated using different test systems. According to the numerical studies, the maximum error on the PV bus approximation in all case studies is only 0.61%, and the maximum error of the supporting power at the PV buses is 6.5%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗

Imaging and spatially resolved mass spectrometry applications in nephrology

The application of spatially resolved mass spectrometry (MS) and MS imaging approaches for studying biomolecular processes in the kidney is rapidly growing. These powerful methods, which enable label-free and multiplexed detection of many molecular classes across omics domains (including metabolites, drugs, proteins and protein post-translational modifications), are beginning to reveal new molecular insights related to kidney health and disease. Further, the complexity of the kidney often necessitates multiple scales of analysis for interrogating biofluids, whole organs, functional tissue units, single cells and subcellular compartments. Various MS methods can generate omics data across these spatial domains and facilitate both basic science and pathological assessment of the kidney. Optimal processes related to sample preparation and handling for different MS applications are rapidly evolving. Emerging technology and methods, improvement of spatial resolution, broader molecular characterization, multimodal and multiomics approaches and the use of machine learning and artificial intelligence approaches promise to make these applications even more valuable in the field of nephology. Overall, spatially resolved MS and MS imaging methods have the potential to fill much of the omics gap in systems biology analysis of the kidney and provide functional outputs that cannot be obtained using genomics and transcriptomic methods.

60 APPLIED LIFE SCIENCES↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

A Holistic Approach for Elucidating Local Structure, Dynamics, and Speciation in Molten Salts with High Structural Disorder

To examine ion solvation, exchange, and speciation for minority components in molten salts (MS) typically found as corrosion products, we propose a multimodal approach combining extended X-ray absorption fine structure (EXAFS) spectroscopy, optical spectroscopy, ab initio molecular dynamics (AIMD) simulations, and rate theory of ion exchange. Going beyond conventional EXAFS analysis, our method can accurately quantify populations of different coordination states of ions with highly disordered coordination environments via linear combination fitting of the EXAFS spectra of these coordination states computed from AIMD to the experimental EXAFS spectrum. In a case study of dilute Ni(II) dissolved in the ZnCl 2 +KCl melts, our method reveals heterogeneous distributions of coordination states of Ni(II) that are sensitive to variations in temperature and melt composition. These results are fully explained by the difference in the chloride exchange dynamics at varied temperatures and melt compositions. Finally, this insight will enable a better understanding and control of ion solubility and transport in MS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Unlocking Insights from Logbooks Using AI

Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL, and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, enable macro-analysis for root cause analysis, and facilitate problem-solving automation.

43 PARTICLE ACCELERATORS↗

Connecting Femtosecond Transient Absorption Microscopy with Spatially Coregistered Time Averaged Optical Imaging Modalities

Multimodal all-optical imaging involving coregistered femtosecond transient absorption microscopy (TAM), time-integrated photoluminescence (PL), and steady-state modalities such as confocal reflectance and transmission offers an appealing approach to gain a comprehensive understanding of complex electronic excited-state phenomena in spatially heterogeneous systems. A unique combination of these modalities allows us to unravel not only the competing electronic excited-state dynamical processes but also the underlying morphological information with simultaneous high temporal and spatial resolution. However, correlating the various images obtained from time-resolved and time-independent modalities is generally nontrivial and particularly challenging when the electronic dynamics under study evolve in both time and space. Here, we demonstrate a new approach for rationally correlating time-resolved microscopy with coregistered time-integrated or steady-state modalities. Specifically, our approach involves an extended global lifetime analysis of the time-resolved microscopic data set to separate distinct dynamical processes taking place on commensurate time scales, and the resulting decay-associated amplitude maps (DAAMs) were applied to explore correlations with the images acquired using time-independent modalities. The feasibility of our approach was validated through analyzing a multimodal data set acquired from a thin film of chloride-containing mixed lead halide perovskites (CH 3 NH 3 PbI 3–x Cl x ) using femtosecond transient absorption, time-integrated PL, and confocal reflectance microscopies. Analysis of the results obtained enable us to gain new insight into the complex ultrafast relaxation dynamics in this highly heterogeneous system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Unlocking Insights from Logbooks Using AI

Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, to enable macro-analysis for root cause analysis, and to facilitate problem-solving automation.

43 PARTICLE ACCELERATORS↗

Convergent Manufacturing of Large-Scale Components for Nuclear Applications, via Additive Manufacturing and Powder Metallurgy Hot Isostatic Pressing

Powder metallurgy (PM)–hot isostatic pressing (PM-HIP) has long been recognized as a powerful route for producing fully dense, near net shape metallic components. By consolidating powders under high temperature and pressure, HIP provides isotropic properties, uniform microstructures, and scalability to complex geometries that are vital for sectors such as aerospace, energy, and nuclear power. Yet despite these advantages, the technology has remained constrained by costly trial and error canister fabrication, limitations of conventional forging, and incomplete knowledge about how the canister design influences final part properties. Additive manufacturing (AM), by contrast, thrives on design freedom and geometric flexibility but struggles with speed, scalability, and cost when applied to very large structures. The research presented in this report investigated how a convergent manufacturing approach, combining AM with PM-HIP, can merge the strengths of both technologies, leveraging AM’s flexibility for canister design and HIP’s consolidation capability to deliver reliable, large, and complex parts. The work progressed through three case studies that built on one another in scale and complexity. Small cylindrical canisters fabricated by conventional methods, laser powder bed fusion, and directed energy deposition were filled with stainless steel powders and subjected to HIP. The resulting parts demonstrated near-full density and mechanical properties on par with wrought stainless steel, showing for the first time that AM canisters can be a direct substitute for conventional ones without sacrificing quality. The next step involved a medium-scale, noncentrosymmetric T-valve, which is an enclosed, multibranch geometry that tested the limits of AM + PM-HIP integration. The T-valve achieved predictable shrinkage and uniform densification, confirming feasibility for enclosed designs. However, this study also revealed oxide inclusions and interfacial challenges at the AM + HIP boundary, underscoring the critical importance of controlling interface chemistry and employing robust, in situ strategies, such as melt pool monitoring and thermal monitoring, coupled with nondestructive evaluation techniques such as x-ray computed tomography. Finally, the effort culminated in fabricating a large-scale impeller weighing nearly 2000 lb and spanning 5 ft in diameter. Produced via multirobot wire arc AM and hot isostatic pressed to near-full density, the impeller validated industrial-scale feasibility. Predictive models closely matched experimental shrinkage, tensile properties were spatially uniform across the component, and the AM + PM-HIP interface proved mechanically sound despite the presence of oxide-decorated prior particle boundaries. This large-scale demonstration is a major milestone, showing that hybrid AM + PM‑HIP can reliably deliver components at reactor-relevant scales. Collectively, these studies charted a logical pathway: small-scale work built scientific confidence, medium-scale work highlighted opportunities and challenges, and large-scale work proved industrial impact. The overarching conclusion of this report is that AM + PM-HIP should not be seen as a replacement for forging but as a complementary pathway that provides the US with flexibility, resilience, and new options for manufacturing nuclear-grade components. Looking ahead, several directions emerge as critical to sustaining progress. Predictive modeling must become faster, more accessible, and more accurate, with digital twins and machine learning reducing reliance on trial and error. Powders and alloys must be optimized for HIP, with improved cleanliness, reduced oxides, and tailored chemistries that enhance creep, fatigue, and irradiation resistance. Interfaces between AM and HIP regions must be better engineered through coatings, machining strategies, and surface treatments to mitigate oxide formation and ensure reliable bonding to explore opportunities for HIP of targeted compositional parts, as well as multimaterial HIP cladding applications. Monitoring and nondestructive evaluation need to expand, incorporating multimodal sensors, x-ray computed tomography, and real-time data integration through platforms such as Pelican. At the same time, the pathway to industrial adoption requires techno-economic analysis, machinability studies, and qualification frameworks aligned with industry and regulatory standards. Finally, workforce and academic engagement must be strengthened. Programs that train technicians and engineers for US Navy and US Department of Energy manufacturing challenges should be paired with academic partnerships to support fundamental research, with open sharing of non-export-controlled data to accelerate innovation and build the next generation of experts. In conclusion, this report demonstrates that hybrid AM + PM-HIP is scientifically viable and strategically important. By combining the design agility of AM with the consolidation strength of HIP and embedding modeling, monitoring, and workforce development, this approach provided a transformative new capability for US manufacturing. The path forward is clear: hybrid AM + PM-HIP is not just a promising research direction but is also potentially an industrially relevant pathway that can reshape how nuclear-grade components are designed, qualified, and deployed.

36 MATERIALS SCIENCE↗

Impact of Biofuel Blending on Hydrocarbon Speciation and Particulate Matter from a Medium-Duty Multimode Combustion Strategy

The U.S. Department of Energy’s Co-Optima initiative simultaneous focused on diversifying fuel sources, improving efficiency, and reducing emissions through using novel combustion strategies and sustainable fuel blends. For medium-duty/heavy-duty diesel engines, research in this area has led to the development of a multimode strategy that uses premixed charge compression ignition (PCCI) at low loads and conventional diesel combustion (CDC) at mid–high loads. The aim of this study was to understand how emissions were impacted when using PCCI instead of CDC at low loads and switching to an oxygenated biofuel blend. It provides a detailed speciation of the hydrocarbon (HC) and particulate matter (PM) emissions from a multimode medium-duty engine operating at low loads in PCCI and CDC modes and high loads in CDC. The effect of the oxygenated biofuel blend on emissions was studied at all three mode–load conditions using #2 ULSD and a bio-derived fuel (25% hexyl hexanoate (HHN)) blended in #2 ULSD. The PCCI mode effectively decreased NOx, total HC, and PM/PN emissions, with a substantial decrease in larger particles (≥50 nm). A PM/PN reduction was observed at high loads with the 25% HHN fuel. While the total HC emissions were not impacted by fuel type, the detailed HC analysis exposed changes in the HC’s composition.

09 BIOMASS FUELS↗

Highly cascaded first-order fiber Bragg gratings in highly multimode optical fibers for distributed temperature sensing under harsh environment conditions

This study presents a pioneering technique for fabricating highly cascaded first-order fiber Bragg gratings (FBGs) using a femtosecond laser-assisted point-by-point inscription method in highly multimode optical fibers, specifically Sapphire crystalline fiber, and pure silica coreless fiber. Notably, it marks the first successful demonstration of a distributed array comprising 10 FBGs within highly multimode fibers. This achievement is facilitated by a high-power laser technique that yields larger reflectors characterized by a Gaussian intensity profile. These first-order FBGs offer various advantages, including enhanced reflectivity, reduced fabrication time, and simplified spectral characteristics, enhancing their accessibility for interpretation when contrasted with higher-order FBGs. In addition to that it encompasses a comprehensive analysis of the robustness and efficacy of these FBGs, with particular emphasis on their ability to endure extreme temperatures. These FBGs demonstrate an advantageous capability for localized multi-point temperature monitoring, reaching temperatures up to 1500°C with sapphire crystalline fiber and 1100°C with pure silica coreless fiber. This resilience makes them suitable for deployment in harsh environmental conditions. This innovative approach substantially broadens the potential applications of highly multimode optical fibers, particularly in the arena of sensing and communication, where challenges related to thermal gradients and harsh environments prevail. Furthermore, these groundbreaking first-order FBGs signify a substantial advancement in the realm of distributed temperature sensing, offering supreme capabilities for temperature monitoring and signal stability. As such, our work holds the promise of a substantial impact on industries and applications that demand unwavering reliability under extreme conditions.

47 OTHER INSTRUMENTATION↗

Hybrid Quantum–Classical Graph Transformers for Efficient Sentiment Analysis

Quantum Machine Learning (QML) offers a promising paradigm that leverages quantum computing principles to develop efficient and expressive models for learning from complex and structured data. Recent advances in natural language processing (NLP) and artificial intelligence (AI) have demonstrated capabilities in understanding, generating, and reasoning over linguistic and multimodal information. In this work, we present the Quantum Graph Transformer (QGT), a hybrid quantum–classical architecture that extends graph transformer capabilities through quantum self-attention. The QGT models variable-length sentences as token graphs, where both the embedding encoding and the self-attention mechanisms are implemented using parameterized quantum circuits (PQCs), enabling efficient contextual learning with significantly fewer trainable parameters. We train QGT using both fully connected and 𝑘 -nearest-neighbor graph structures and evaluate it on five benchmark sentiment-classification datasets. Experimental results show that QGT consistently achieves higher or comparable accuracy to existing quantum NLP models and outperforms a Classical Graph Transformer (CGT) baseline with identical architecture, achieving 29.4 × fewer parameters while requiring 3–5 × fewer samples to reach comparable performance. These findings highlight the potential of graph-based quantum models as scalable and data-efficient architectures for natural language understanding.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Informed unsupervised machine learning analysis of dislocation microstructure from high-resolution differential aperture X-ray structural microscopy data

This study leverages high-resolution differential-aperture X-ray structural microscopy (DAXM) to probe the local dislocation structure in deformed 304L-stainless steel at small strain, by measuring the lattice rotation and deviatoric elastic strain with a sub-micron resolution. For a single grain in a polycrystalline specimen, the measured lattice rotation field over the measured volume exhibited a multimodal distribution while the deviatoric elastic strain showed a single-mode distribution. An unsupervised Cauchy mixture machine learning model was developed to resolve the multimodal distribution of the lattice rotation. By mapping the lattice rotation data associated with each Cauchy peak in the model back onto the measured volume, we identify contiguous regions of the crystal rotated near the average values corresponding to the peaks of the overall rotation distribution. These regions represent the grain subdivision in the microstructure. Finally, the dislocation density tensor was also computed and its norm was laid over the rotation field to detect the subgrain boundaries. This step provided a validation of the Cauchy mixture model for the analysis of the lattice rotation distribution. The current study highlights the integration of advanced X-ray microscopy techniques with data-driven analysis methods to uncover detailed microstructure scales in deformed crystals.

Machine learning; Lattice rotation; High-energy X-↗

In situ , in vivo , and in operando imaging and spectroscopy of liquids using microfluidics in vacuum

This review offers a succinct overview of the development of a vacuum-compatible microfluidic reactor system for analysis at the liquid vacuum interface (SALVI), and its diverse applications in in situ, in vivo, and in operando imaging of liquid surfaces as well as the air-liquid (a-l), liquid-liquid (l-l), and solid-liquid (s-l) interfaces in the past decade. SALVI is one of the first microfluidics-based reactors that has enabled direct analysis of volatile liquids in vacuum surface tools such as scanning electron microscopy (SEM) and time-of-flight secondary ion mass spectrometry (ToF-SIMS). Its integration into ambient and vacuum spectroscopy and microscopy is illustrated. Several applications are highlighted including (1) imaging nanoparticles in liquid using in situ SEM; (2) mapping the evolving l-l interface using in situ x-ray absorption spectroscopy and ToF-SIMS; (3) following complex a-l interfacial oxidation reaction products using in situ ToF-SIMS; (4) capturing biological interfaces of cells and microbes via in vivo multimodal and correlative imaging; and (5) monitoring the dynamic solid electrode and liquid electrolyte interface using in operando molecular imaging. Finally, outlook and recommendations are presented. Besides showing the holistic information volume obtained by real-time multiplexed imaging, this review intends to convey the importance of tool development in revolutionizing surface and interface analysis using vacuum platforms previously limited to solid surfaces. Microfluidics is manifested to be not limited to ambient conditions in many examples in this review. Moreover, fundamental interfacial phenomena underpinning mass and charge transfer can now be pursued in real time via innovated chemical imaging and spectroscopy.

42 ENGINEERING↗