Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Quantification of Cross-coupling and Motion Feedthrough for Multiaxis Controllers Used in an Air Combat Flying Task

A real-time piloted simulation of an air-to-air combat flying task using a wings-level-turn aircraft and various novel controllers was conducted. One objective is to quantify how the pilot interacts with the controllers and control modes, including: (1) controller versus aircraft response; (2) proprioceptive cross-coupling among axes of the controllers; and (3) biodynamic cross-coupling between the aircraft motions and the controllers. In order to aid in identifying the items listed above, both the target aircraft and the large amplitude multimode aerospace research simulator (LAMARS) motion system were distributed with quasi-random sums-of-sinusoids. Since the disturbances were separated in frequency, spectral analysis techniques were used to identify the three items listed. The results of the spectral analysis of controller motions from the two-axis side stick, a twist grip mounted on the side stick, a thumb button mounted on the side stick, and conventional rudder pedals are presented. Conclusions and recommendations for further research are also presented.

Jewell, W. E.↗

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗

A Relaxed PV Bus Model in Linear Power Flow

The emerging multimodal active energy resource units make it necessary to introduce constant voltage amplitude buses (PV bus) in the operation of modern distribution systems. To enable the analysis of PV bus using linear power flow models, this letter proposes a relaxed PV bus model for solving power flow related problems using an indirect modeling approach. The developed PV bus model can be applied to linear power flow models in both rectangular and polar coordinates. Besides, the approximation error of the relaxed PV bus model can also be controlled and quantified. Lastly, the proposed relaxed PV bus model is validated using different test systems. According to the numerical studies, the maximum error on the PV bus approximation in all case studies is only 0.61%, and the maximum error of the supporting power at the PV buses is 6.5%.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Phylogenomic discovery and engineering of nitrogen fixation into the bioenergy woody crop poplar

Biological nitrogen fixation (BNF) is a key process enabling plants in specific lineages to convert atmospheric dinitrogen (N₂) into bioavailable ammonia through symbioses with diazotrophic microbes. Expanding this capability beyond native nitrogen-fixing clades into non-nodulating crops would reduce synthetic fertilizer use, lowering energy inputs and environmental impacts in agriculture. Supported by DOE Funding Award DE-SC0018247, the NitFix project advanced foundational knowledge required to engineer root-nodule symbioses in new host species. The team generated the most comprehensive phylogenomic analysis to date of all known nodulating lineages, resolving the evolutionary history of nitrogen-fixing symbiosis and identifying core gene suites retained across nodulating taxa. Through multimodal genomics, transcriptomics, and functional analyses in Medicago truncatula and related species, the project mapped regulatory networks underlying nodule organogenesis, bacterial infection, and nitrogen-fixation efficiency. Key discoveries include the identification of conserved signaling modules for rhizobial recognition, transcription factors controlling nodule differentiation, and metabolic pathways integrating fixed nitrogen into plant growth. The project also developed enabling tools—including optimized transformation pipelines, gene-editing workflows, and imaging-based phenotyping—to accelerate engineering efforts in emerging models. Together, these results refine the mechanistic framework of symbiotic nitrogen fixation and highlight transferable components essential for rewiring these traits into non-nodulating crops.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian Symbolic Regression: Addressing Challenges in Estimating Fractional Bayes Factors and Application to Fatigue Crack Growth Modeling

This research pioneers advancements in computational mechanics by integrating Bayesian-based uncertainty quantification into symbolic regression, specifically focusing on the critical task of accurately estimating the fractional Bayes factor for selecting arbitrary equations. In our exploration, we rigorously study two prominent methods—sequential Monte Carlo and the Laplace approximation—employed for computing the fractional Bayes factor. Our findings underscore the limitations of the Laplace approximation, revealing its diminished accuracy in nonlinear and multimodal scenarios. Specifically, the Laplace approximation is shown to underpredict fractional Bayes factor on a wide set of equations associated with a symbolic regression benchmark. This comparative analysis sheds light on the nuanced performance of these techniques, guiding researchers toward more informed choices in uncertainty quantification within symbolic regression. Furthermore, we showcase the practical utility of these enhanced symbolic regression tools through their application to a real-world problem in fatigue crack growth modeling, emphasizing their efficacy in capturing the complexities of mechanical systems.

Geoffrey Bomarito↗

Imaging and spatially resolved mass spectrometry applications in nephrology

The application of spatially resolved mass spectrometry (MS) and MS imaging approaches for studying biomolecular processes in the kidney is rapidly growing. These powerful methods, which enable label-free and multiplexed detection of many molecular classes across omics domains (including metabolites, drugs, proteins and protein post-translational modifications), are beginning to reveal new molecular insights related to kidney health and disease. Further, the complexity of the kidney often necessitates multiple scales of analysis for interrogating biofluids, whole organs, functional tissue units, single cells and subcellular compartments. Various MS methods can generate omics data across these spatial domains and facilitate both basic science and pathological assessment of the kidney. Optimal processes related to sample preparation and handling for different MS applications are rapidly evolving. Emerging technology and methods, improvement of spatial resolution, broader molecular characterization, multimodal and multiomics approaches and the use of machine learning and artificial intelligence approaches promise to make these applications even more valuable in the field of nephology. Overall, spatially resolved MS and MS imaging methods have the potential to fill much of the omics gap in systems biology analysis of the kidney and provide functional outputs that cannot be obtained using genomics and transcriptomic methods.

60 APPLIED LIFE SCIENCES↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

A Holistic Approach for Elucidating Local Structure, Dynamics, and Speciation in Molten Salts with High Structural Disorder

To examine ion solvation, exchange, and speciation for minority components in molten salts (MS) typically found as corrosion products, we propose a multimodal approach combining extended X-ray absorption fine structure (EXAFS) spectroscopy, optical spectroscopy, ab initio molecular dynamics (AIMD) simulations, and rate theory of ion exchange. Going beyond conventional EXAFS analysis, our method can accurately quantify populations of different coordination states of ions with highly disordered coordination environments via linear combination fitting of the EXAFS spectra of these coordination states computed from AIMD to the experimental EXAFS spectrum. In a case study of dilute Ni(II) dissolved in the ZnCl 2 +KCl melts, our method reveals heterogeneous distributions of coordination states of Ni(II) that are sensitive to variations in temperature and melt composition. These results are fully explained by the difference in the chloride exchange dynamics at varied temperatures and melt compositions. Finally, this insight will enable a better understanding and control of ion solubility and transport in MS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Unlocking Insights from Logbooks Using AI

Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL, and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, enable macro-analysis for root cause analysis, and facilitate problem-solving automation.

43 PARTICLE ACCELERATORS↗

Connecting Femtosecond Transient Absorption Microscopy with Spatially Coregistered Time Averaged Optical Imaging Modalities

Multimodal all-optical imaging involving coregistered femtosecond transient absorption microscopy (TAM), time-integrated photoluminescence (PL), and steady-state modalities such as confocal reflectance and transmission offers an appealing approach to gain a comprehensive understanding of complex electronic excited-state phenomena in spatially heterogeneous systems. A unique combination of these modalities allows us to unravel not only the competing electronic excited-state dynamical processes but also the underlying morphological information with simultaneous high temporal and spatial resolution. However, correlating the various images obtained from time-resolved and time-independent modalities is generally nontrivial and particularly challenging when the electronic dynamics under study evolve in both time and space. Here, we demonstrate a new approach for rationally correlating time-resolved microscopy with coregistered time-integrated or steady-state modalities. Specifically, our approach involves an extended global lifetime analysis of the time-resolved microscopic data set to separate distinct dynamical processes taking place on commensurate time scales, and the resulting decay-associated amplitude maps (DAAMs) were applied to explore correlations with the images acquired using time-independent modalities. The feasibility of our approach was validated through analyzing a multimodal data set acquired from a thin film of chloride-containing mixed lead halide perovskites (CH 3 NH 3 PbI 3–x Cl x ) using femtosecond transient absorption, time-integrated PL, and confocal reflectance microscopies. Analysis of the results obtained enable us to gain new insight into the complex ultrafast relaxation dynamics in this highly heterogeneous system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Towards Unlocking Insights from Logbooks Using AI

Electronic logbooks contain valuable information about activities and events concerning their associated particle accelerator facilities. However, the highly technical nature of logbook entries can hinder their usability and automation. As natural language processing (NLP) continues advancing, it offers opportunities to address various challenges that logbooks present. This work explores jointly testing a tailored Retrieval Augmented Generation (RAG) model for enhancing the usability of particle accelerator logbooks at institutes like DESY, BESSY, Fermilab, BNL, SLAC, LBNL and CERN. The RAG model uses a corpus built on logbook contributions and aims to unlock insights from these logbooks by leveraging retrieval over facility datasets, including discussion about potential multimodal sources. Our goals are to increase the FAIR-ness (findability, accessibility, interoperability, and reusability) of logbooks by exploiting their information content to streamline everyday use, to enable macro-analysis for root cause analysis, and to facilitate problem-solving automation.

43 PARTICLE ACCELERATORS↗

Convergent Manufacturing of Large-Scale Components for Nuclear Applications, via Additive Manufacturing and Powder Metallurgy Hot Isostatic Pressing

Powder metallurgy (PM)–hot isostatic pressing (PM-HIP) has long been recognized as a powerful route for producing fully dense, near net shape metallic components. By consolidating powders under high temperature and pressure, HIP provides isotropic properties, uniform microstructures, and scalability to complex geometries that are vital for sectors such as aerospace, energy, and nuclear power. Yet despite these advantages, the technology has remained constrained by costly trial and error canister fabrication, limitations of conventional forging, and incomplete knowledge about how the canister design influences final part properties. Additive manufacturing (AM), by contrast, thrives on design freedom and geometric flexibility but struggles with speed, scalability, and cost when applied to very large structures. The research presented in this report investigated how a convergent manufacturing approach, combining AM with PM-HIP, can merge the strengths of both technologies, leveraging AM’s flexibility for canister design and HIP’s consolidation capability to deliver reliable, large, and complex parts. The work progressed through three case studies that built on one another in scale and complexity. Small cylindrical canisters fabricated by conventional methods, laser powder bed fusion, and directed energy deposition were filled with stainless steel powders and subjected to HIP. The resulting parts demonstrated near-full density and mechanical properties on par with wrought stainless steel, showing for the first time that AM canisters can be a direct substitute for conventional ones without sacrificing quality. The next step involved a medium-scale, noncentrosymmetric T-valve, which is an enclosed, multibranch geometry that tested the limits of AM + PM-HIP integration. The T-valve achieved predictable shrinkage and uniform densification, confirming feasibility for enclosed designs. However, this study also revealed oxide inclusions and interfacial challenges at the AM + HIP boundary, underscoring the critical importance of controlling interface chemistry and employing robust, in situ strategies, such as melt pool monitoring and thermal monitoring, coupled with nondestructive evaluation techniques such as x-ray computed tomography. Finally, the effort culminated in fabricating a large-scale impeller weighing nearly 2000 lb and spanning 5 ft in diameter. Produced via multirobot wire arc AM and hot isostatic pressed to near-full density, the impeller validated industrial-scale feasibility. Predictive models closely matched experimental shrinkage, tensile properties were spatially uniform across the component, and the AM + PM-HIP interface proved mechanically sound despite the presence of oxide-decorated prior particle boundaries. This large-scale demonstration is a major milestone, showing that hybrid AM + PM‑HIP can reliably deliver components at reactor-relevant scales. Collectively, these studies charted a logical pathway: small-scale work built scientific confidence, medium-scale work highlighted opportunities and challenges, and large-scale work proved industrial impact. The overarching conclusion of this report is that AM + PM-HIP should not be seen as a replacement for forging but as a complementary pathway that provides the US with flexibility, resilience, and new options for manufacturing nuclear-grade components. Looking ahead, several directions emerge as critical to sustaining progress. Predictive modeling must become faster, more accessible, and more accurate, with digital twins and machine learning reducing reliance on trial and error. Powders and alloys must be optimized for HIP, with improved cleanliness, reduced oxides, and tailored chemistries that enhance creep, fatigue, and irradiation resistance. Interfaces between AM and HIP regions must be better engineered through coatings, machining strategies, and surface treatments to mitigate oxide formation and ensure reliable bonding to explore opportunities for HIP of targeted compositional parts, as well as multimaterial HIP cladding applications. Monitoring and nondestructive evaluation need to expand, incorporating multimodal sensors, x-ray computed tomography, and real-time data integration through platforms such as Pelican. At the same time, the pathway to industrial adoption requires techno-economic analysis, machinability studies, and qualification frameworks aligned with industry and regulatory standards. Finally, workforce and academic engagement must be strengthened. Programs that train technicians and engineers for US Navy and US Department of Energy manufacturing challenges should be paired with academic partnerships to support fundamental research, with open sharing of non-export-controlled data to accelerate innovation and build the next generation of experts. In conclusion, this report demonstrates that hybrid AM + PM-HIP is scientifically viable and strategically important. By combining the design agility of AM with the consolidation strength of HIP and embedding modeling, monitoring, and workforce development, this approach provided a transformative new capability for US manufacturing. The path forward is clear: hybrid AM + PM-HIP is not just a promising research direction but is also potentially an industrially relevant pathway that can reshape how nuclear-grade components are designed, qualified, and deployed.

36 MATERIALS SCIENCE↗

A 20-dB quasi-integrated horn antenna

A multimode quasi-integrated dipole-fed horn antenna is presented with a performance comparable to that of waveguide-fed corrugated horn antennas. The antenna has been designed using fullwave analysis and has been fabricated and tested at 91 GHz. The horn has a gain of 20 dB with very symmetric patterns, a Gaussian coupling efficiency of 97 percent, and a cross-polarization level of -22.7 dB. The antenna provides a significant improvement in integrated antenna designs and is suitable for millimeter-wave communication and radar systems and as a Gaussian-beam launcher in quasi-optical receiver systems.

Eleftheriades, George V.↗

Impact of Biofuel Blending on Hydrocarbon Speciation and Particulate Matter from a Medium-Duty Multimode Combustion Strategy

The U.S. Department of Energy’s Co-Optima initiative simultaneous focused on diversifying fuel sources, improving efficiency, and reducing emissions through using novel combustion strategies and sustainable fuel blends. For medium-duty/heavy-duty diesel engines, research in this area has led to the development of a multimode strategy that uses premixed charge compression ignition (PCCI) at low loads and conventional diesel combustion (CDC) at mid–high loads. The aim of this study was to understand how emissions were impacted when using PCCI instead of CDC at low loads and switching to an oxygenated biofuel blend. It provides a detailed speciation of the hydrocarbon (HC) and particulate matter (PM) emissions from a multimode medium-duty engine operating at low loads in PCCI and CDC modes and high loads in CDC. The effect of the oxygenated biofuel blend on emissions was studied at all three mode–load conditions using #2 ULSD and a bio-derived fuel (25% hexyl hexanoate (HHN)) blended in #2 ULSD. The PCCI mode effectively decreased NOx, total HC, and PM/PN emissions, with a substantial decrease in larger particles (≥50 nm). A PM/PN reduction was observed at high loads with the 25% HHN fuel. While the total HC emissions were not impacted by fuel type, the detailed HC analysis exposed changes in the HC’s composition.

09 BIOMASS FUELS↗

Highly cascaded first-order fiber Bragg gratings in highly multimode optical fibers for distributed temperature sensing under harsh environment conditions

This study presents a pioneering technique for fabricating highly cascaded first-order fiber Bragg gratings (FBGs) using a femtosecond laser-assisted point-by-point inscription method in highly multimode optical fibers, specifically Sapphire crystalline fiber, and pure silica coreless fiber. Notably, it marks the first successful demonstration of a distributed array comprising 10 FBGs within highly multimode fibers. This achievement is facilitated by a high-power laser technique that yields larger reflectors characterized by a Gaussian intensity profile. These first-order FBGs offer various advantages, including enhanced reflectivity, reduced fabrication time, and simplified spectral characteristics, enhancing their accessibility for interpretation when contrasted with higher-order FBGs. In addition to that it encompasses a comprehensive analysis of the robustness and efficacy of these FBGs, with particular emphasis on their ability to endure extreme temperatures. These FBGs demonstrate an advantageous capability for localized multi-point temperature monitoring, reaching temperatures up to 1500°C with sapphire crystalline fiber and 1100°C with pure silica coreless fiber. This resilience makes them suitable for deployment in harsh environmental conditions. This innovative approach substantially broadens the potential applications of highly multimode optical fibers, particularly in the arena of sensing and communication, where challenges related to thermal gradients and harsh environments prevail. Furthermore, these groundbreaking first-order FBGs signify a substantial advancement in the realm of distributed temperature sensing, offering supreme capabilities for temperature monitoring and signal stability. As such, our work holds the promise of a substantial impact on industries and applications that demand unwavering reliability under extreme conditions.

47 OTHER INSTRUMENTATION↗

Harnessing Collaborative Learning Automata to Guide Multi-objective Optimization based Inverse Analysis for Structural Damage Identification

Structural damage identification based on physical models is often transformed into an optimization problem that minimizes the difference between measurement information of structure being monitored and the model prediction in the parametric space. However, the objective function in this context often exhibits multimodality, involving high-dimensional variables due to the reliance on finite element models for damage identification. These features pose challenges to optimization algorithms, where entrapment in local solutions can lead to false positives and false negatives in damage identification. In this research, we propose a reinforcement learning based multi-swarm optimizer to tackle such challenges in pursuit of a small yet diverse solution set that can capture the true damage scenario as one of the solutions. The proposed method leverages the flexibility of the particle swarm optimizer and incorporates novel strategies of metaheuristics to realize targeted improvement. To enable the particle swarm to adaptively select the appropriate search strategy based on the current environment, we adopt the learning automata technique, which sidesteps the need for reward strategy selection that is usually ad hoc at each step of the search. The integration harnesses the automatic learning and self-adaptation capabilities of learning automata, enabling the particles to navigate based on environmental signals. This leads to accumulated probabilities tied to advantageous movements, fostering an adaptive exploration of particles in the search space. The proposed approach is first validated through implementing into benchmark test cases with comparisons. It is then applied to structural damage identification with piezoelectric admittance experimental signals. `The results highlight the capability of the algorithm to identify a small solution set with high accuracy to match the actual damage scenario.

Yang Zhang↗

Single-mode Fiber and Few-Mode Fiber Photonic Lanterns Performance Evaluated for Use in a Scalable Real-Time Photon Counting Ground Receiver

Photonic lanterns provide an efficient way of coupling light from a single large-core fiber to multiple small-core fibers. This capability is of interest for space to ground communication applications. In these applications, the optical ground receivers require high-efficiency coupling from an atmospherically distorted focus spot to multiple fiber coupled single pixel super-conducting nanowire detectors. This paper will explore the use of photonic lanterns in a real-time ground receiver that is scalable and constructed with commercial parts. The number of small-core fibers that make a photonic lantern determines the number of spatial modes that they couple. For instance, lanterns made with n number of single-mode fibers can couple n number of spatial modes. Although the laser transmitted from a spacecraft originates as a Gaussian shape, the atmosphere distorts the beam profile by scattering energy into higher-order spatial modes. Therefore, if a ground receiver is sized for a target data rate with n number of detectors, the corresponding lantern made with single-mode fibers will couple n number of spatial modes. The energy of the transmitted beam scattered into spatial modes higher than n will be lost. This paper shows this loss may be reduced by making lanterns with few-mode fibers instead of single-mode fibers, increasing the number of spatial modes that can be coupled and therefore increasing the coupling efficiency to single pixel, single photon detectors. The free space to fiber coupling efficiency of these two types of photonic lanterns are compared over a range of the free-space coupling numerical apertures and mode field diameters. Results indicate the few mode fiber lantern has higher coupling efficiency for telescopes with longer focal lengths under higher turbulent conditions. Also presented is analysis of the jitter added to the system by the lanterns, showing the few-mode fiber photonic lantern adds more jitter than the single-mode fiber lantern, but less than a multimode fiber.

photon counting↗