SEARCH · Search NASA

Results for “Multimodal analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

NASA NTRS1991

Visually guided control of movement in the context of multimodal stimulation

Flight simulation has been almost exclusively concerned with simulating the motions of the aircraft. Physically distinct subsystems are often combined to simulate the varieties of aircraft motion. Visual display systems simulate the motion of the aircraft relative to remote objects and surfaces (e.g., other aircraft and the terrain). 'Motion platform' simulators recreate aircraft motion relative to the gravitoinertial vector (i.e., correlated rotation and tilt as opposed to the 'coordinated turn' in flight). 'Control loaders' attempt to simulate the resistance of the aerodynamic medium to aircraft motion. However, there are few operational systems that attempt to simulate the motion of the pilot relative to the aircraft and the gravitoinertial vector. The design and use of all simulators is limited by poor understanding of postural control in the aircraft and its effect on the perception and control of flight. Analysis of the perception and control of flight (real or simulated) must consider that: (1) the pilot is not rigidly attached to the aircraft; and (2) the pilot actively monitors and adjusts body orientation and configuration in the aircraft. It is argued that this more complete approach to flight simulation requires that multimodal perception be considered as the rule rather than the exception. Moreover, the necessity of multimodal perception is revealed by emphasizing the complementarity rather than the redundancy among perceptual systems. Finally, an outline is presented for an experiment to be conducted at NASA ARC. The experiment explicitly considers possible consequences of coordination between postural and vehicular control.

Riccio, Gary E.↗

NASA NTRS1981

An improved model for the combustion of AP composite propellants

This paper presents several improvements to the BDP model of steady-state burning of AP composite solid propellants. The Price-Boggs-Derr model of AP monopropellant burning is incorporated to represent the AP. A separate energy equation is written for the binder to permit a different surface temperature from the AP; this includes an analysis of the sharing of primary diffusion flame energy, and correction of a BDP model inconsistency in treating the binder regression rate. A method for assembling component contributions to calculate the burning rates of multimodal propellants is also presented. Results are shown in the form of representative burning rate curves, comparisons with data, and calculated internal details of interest. Ideas for future work are discussed in an Appendix.

Cohen, N. S.↗

DOE OSTI2026

Hybrid Quantum–Classical Graph Transformers for Efficient Sentiment Analysis

Quantum Machine Learning (QML) offers a promising paradigm that leverages quantum computing principles to develop efficient and expressive models for learning from complex and structured data. Recent advances in natural language processing (NLP) and artificial intelligence (AI) have demonstrated capabilities in understanding, generating, and reasoning over linguistic and multimodal information. In this work, we present the Quantum Graph Transformer (QGT), a hybrid quantum–classical architecture that extends graph transformer capabilities through quantum self-attention. The QGT models variable-length sentences as token graphs, where both the embedding encoding and the self-attention mechanisms are implemented using parameterized quantum circuits (PQCs), enabling efficient contextual learning with significantly fewer trainable parameters. We train QGT using both fully connected and 𝑘 -nearest-neighbor graph structures and evaluate it on five benchmark sentiment-classification datasets. Experimental results show that QGT consistently achieves higher or comparable accuracy to existing quantum NLP models and outperforms a Classical Graph Transformer (CGT) baseline with identical architecture, achieving 29.4 × fewer parameters while requiring 3–5 × fewer samples to reach comparable performance. These findings highlight the potential of graph-based quantum models as scalable and data-efficient architectures for natural language understanding.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2025

Informed unsupervised machine learning analysis of dislocation microstructure from high-resolution differential aperture X-ray structural microscopy data

This study leverages high-resolution differential-aperture X-ray structural microscopy (DAXM) to probe the local dislocation structure in deformed 304L-stainless steel at small strain, by measuring the lattice rotation and deviatoric elastic strain with a sub-micron resolution. For a single grain in a polycrystalline specimen, the measured lattice rotation field over the measured volume exhibited a multimodal distribution while the deviatoric elastic strain showed a single-mode distribution. An unsupervised Cauchy mixture machine learning model was developed to resolve the multimodal distribution of the lattice rotation. By mapping the lattice rotation data associated with each Cauchy peak in the model back onto the measured volume, we identify contiguous regions of the crystal rotated near the average values corresponding to the peaks of the overall rotation distribution. These regions represent the grain subdivision in the microstructure. Finally, the dislocation density tensor was also computed and its norm was laid over the rotation field to detect the subgrain boundaries. This step provided a validation of the Cauchy mixture model for the analysis of the lattice rotation distribution. The current study highlights the integration of advanced X-ray microscopy techniques with data-driven analysis methods to uncover detailed microstructure scales in deformed crystals.

Machine learning; Lattice rotation; High-energy X-↗

DOE OSTI2020

In situ , in vivo , and in operando imaging and spectroscopy of liquids using microfluidics in vacuum

This review offers a succinct overview of the development of a vacuum-compatible microfluidic reactor system for analysis at the liquid vacuum interface (SALVI), and its diverse applications in in situ, in vivo, and in operando imaging of liquid surfaces as well as the air-liquid (a-l), liquid-liquid (l-l), and solid-liquid (s-l) interfaces in the past decade. SALVI is one of the first microfluidics-based reactors that has enabled direct analysis of volatile liquids in vacuum surface tools such as scanning electron microscopy (SEM) and time-of-flight secondary ion mass spectrometry (ToF-SIMS). Its integration into ambient and vacuum spectroscopy and microscopy is illustrated. Several applications are highlighted including (1) imaging nanoparticles in liquid using in situ SEM; (2) mapping the evolving l-l interface using in situ x-ray absorption spectroscopy and ToF-SIMS; (3) following complex a-l interfacial oxidation reaction products using in situ ToF-SIMS; (4) capturing biological interfaces of cells and microbes via in vivo multimodal and correlative imaging; and (5) monitoring the dynamic solid electrode and liquid electrolyte interface using in operando molecular imaging. Finally, outlook and recommendations are presented. Besides showing the holistic information volume obtained by real-time multiplexed imaging, this review intends to convey the importance of tool development in revolutionizing surface and interface analysis using vacuum platforms previously limited to solid surfaces. Microfluidics is manifested to be not limited to ambient conditions in many examples in this review. Moreover, fundamental interfacial phenomena underpinning mass and charge transfer can now be pursued in real time via innovated chemical imaging and spectroscopy.

42 ENGINEERING↗

DOE OSTI2026

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗

DOE OSTI2022

A multimodal approach to revisiting oxidation defects in Cr 2 O 3

The oxidation of chromium in air at 700 °C was investigated with a focus on point defect behavior and transport during oxide layer growth. A comprehensive set of characterization techniques targeted characteristics of chromium oxide microstructure and chemical composition analysis. TEM showed that the oxide was thicker with longer oxidation times and that, for the thicker oxides, voids formed at the metal/oxide interface. PAS revealed that the longer the oxidation time, there was an overall reduction in vacancy-type defects, though chromium monovacancies were not found in either case. EIS found that the longer oxidized material was more electrochemically stable and that, while all oxides displayed p-type character, the thicker oxide had an overall lower charge carrier density. Together, the results suggest anion oxygen interstitials and chromium vacancy cluster complexes drive transport in an oxidizing environment at this temperature, providing invaluable insight into the mechanisms that regulate corrosion.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Cluster defects in gibbsite nanoplates grown at acidic to neutral pH

Gibbsite [α-Al(OH) 3 ] is the solubility limiting phase for aluminum across a wide pH range, and it is a common mineral phase with many industrial applications. The growth mechanism of this layered-structure material, however, remains incompletely understood. Synthesis of gibbsite at low to circumneutral pH yields nanoplates with substantial interlayer disorder. Here we examine defects in this material in detail, and the effects of recrystallization in highly alkaline sodium hydroxide solution at 80 °C. We employed a multimodal approach, including scanning electron microscopy, magic-angle spinning nuclear magnetic resonance (MAS-NMR), Raman and infrared spectroscopies, X-ray diffraction (XRD), and X-ray total scattering pair distribution function (XPDF) analysis to characterize the ageing of the nanoplates over several days. Additionally, XRD and XPDF indicate that gibbsite nanoplates precipitated at circumneutral pH contain dense, truncated sheets imparting a local difference in interlayer distance. These interlayer defects appear well described by flat Al 13 aluminum hydroxide nanoclusters nearly isostructural with gibbsite sheets present under synthesis conditions and trapped as interlayer inclusions during growth. Ageing at elevated temperature in alkaline solutions gradually improves crystallinity, showing a gradual increase in H-bonding between interlayer OH groups. Between 7 to 8 vol% of the initial gibbsite nanoparticles exhibit this defect, with the majority of differences disappearing after 2–4 hours of recrystallization in alkaline solution. The results not only identify the source of disorder in gibbsite formed under acidic/neutral conditions but also point to a possible cluster-mediated growth mechanism evident through inclusion of relict oligomers with gibbsite-like topology trapped in the interlayer spaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS1975

Interactive multi-spectral analysis of more than one Sonrai village in Niger, West Africa

Use of LANDSAT data and an interaction system is considered for identifying and measuring small scale compact human settlements (villages) for demographic and anthropological studies. Because village components are not uniformly distributed within any one village, they apparently are multimodal, spectrally. Therefore, the functions of location and enumeration are kept separate. Measurement of a known village is compared with CCT response.

Reining, P.↗

NASA NTRS1985

Propagation and radiation characteristics of a multimode corrugated waveguide feedhorn

A prototype of the multimode corrugated feedhorn which will be used in the 400 kW CW Ka-band radar system is described. A rough design is done using coupled mode theory and standard corrugated waveguide modes. A more exact analysis using mode matching techniques is then used which takes into account the effect of a finite number of corrugations per wavelength and determines the modes which are reflected from the device. A prototype feedhorn has been constructed and measured. These experimental results are then compared to the theoretical predictions which agree satisfactorily closely.

Hoppe, D.↗

NASA NTRS1996

Numerical Analysis of the Sea State Bias for Satellite Altimetry

Theoretical understanding of the dependence of sea state bias (SSB) on wind wave conditions has been achieved only for the case of a unidirectional wind-driven sea. Recent analysis of Geosat and TOPEX altimeter data showed that additional factors, such as swell, ocean currents, and complex directional properties of realistic wave fields, may influence SSB behavior. Here we investigate effects of two-dimensional multimodal wave spectra using a numerical model of radar reflection from a random, non-Gaussian surface. A recently proposed ocean wave spectrum is employed to describe sea surface statistics. The following findings appear to be of particular interest: (1) Sea swell has an appreciable effect in reducing the SSB coefficient compared with the pure wind sea case but has less effect on the actual SSB owing to the corresponding increase in significant wave height. (2) Hidden multimodal structure (the two-dimensional wavenumber spectrum contains separate peaks, for swell and wind seas, while the frequency spectrum looks unimodal) results in an appreciable change of SSB. (3) For unimodal, purely wind-driven seas, the influence of the angular spectral width is relatively unimportant; that is, a unidirectional sea provides a good qualitative model for SSB if the swell is absent. (4) The pseudo wave age is generally much better fo parametrization the SSB coefficient than the actual wave age (which is ill-defined for a multimodal sea) or wind speed. (5) SSB can be as high as 5% of the significant wave height, which is significantly greater than predicted by present empirical model functions tuned on global data sets. (6) Parameterization of SSB in terms of wind speed is likely to lead to errors due to the dependence on the (in practice, unknown) fetch.

Glazman, R. E.↗

NASA NTRS2010

Single Spatial-Mode Room-Temperature-Operated 3.0 to 3.4 micrometer Diode Lasers

Compact, highly efficient, 3.0 to 3.4 m light emitters are in demand for spectroscopic analysis and identification of chemical substances (including methane and formaldehyde), infrared countermeasures technologies, and development of advanced infrared scene projectors. The need for these light emitters can be currently addressed either by bulky solid-state light emitters with limited power conversion efficiency, or cooled Interband Cascade (IC) semiconductor lasers. Researchers here have developed a breakthrough approach to fabrication of diode mid-IR lasers that have several advantages over IC lasers used for the Mars 2009 mission. This breakthrough is due to a novel design utilizing the strain-engineered quantum-well (QW) active region and quinternary barriers, and due to optimization of device material composition and growth conditions (growth temperatures and rates). However, in their present form, these GaSb-based laser diodes cannot be directly used as a part of sensor systems. The device spectrum is too broad to perform spectroscopic analysis of gas species, and operating currents and voltages are too high. In the current work, the emitters were fabricated as narrow-ridge waveguide index-guided lasers rather than broad stripe-gain guided multimode Fabry-Perot (FP) lasers as was done previously. These narrow-ridge waveguide mid-IR lasers exhibit much lower power consumptions, and can operate in a single spatial mode that is necessary for demonstration of single-mode distributed feedback (DBF) devices for spectroscopic applications. These lasers will enable a new generation of compact, tunable diode laser spectrometers with lower power consumption, reduced complexity, and significantly reduced development costs. These lasers can be used for the detection of HCN, C2H2, methane, and ethane.

Frez, Clifford F.↗

DOE OSTI2020

Multimodal Nanoscale Tomographic Imaging for Battery Electrodes

Accurate representations of the 3D structure within a lithium-ion battery are key to understanding performance limitations. However, obtaining exact reconstructions of electrodes, where the active particles, the carbon black and polymeric binder domain, and the pore space are visualized is challenging. In this work, it is shown that multimodal imaging can be used to overcome this challenge. High-resolution ptychographic X-ray computed tomography are combined with lower resolution but higher contrast transmission X-ray tomographic microscopy to obtain 3D reconstructions of pristine and cycled graphite-silicon composite electrodes. This cross-correlation enables quantitative analysis of the surface of active particles, including the heterogeneity of carbon-black and binder domain and solid-electrolyte interphase coverage. Capturing the active particles as well as the carbon black-binder domain allows using these segmented structures for electrochemical simulations to highlight the influence of the particle embedding on local state of charge heterogeneities.

25 ENERGY STORAGE↗

NASA NTRS1990

Concurrent Image Processing Executive (CIPE). Volume 1: Design overview

The design and implementation of a Concurrent Image Processing Executive (CIPE), which is intended to become the support system software for a prototype high performance science analysis workstation are described. The target machine for this software is a JPL/Caltech Mark 3fp Hypercube hosted by either a MASSCOMP 5600 or a Sun-3, Sun-4 workstation; however, the design will accommodate other concurrent machines of similar architecture, i.e., local memory, multiple-instruction-multiple-data (MIMD) machines. The CIPE system provides both a multimode user interface and an applications programmer interface, and has been designed around four loosely coupled modules: user interface, host-resident executive, hypercube-resident executive, and application functions. The loose coupling between modules allows modification of a particular module without significantly affecting the other modules in the system. In order to enhance hypercube memory utilization and to allow expansion of image processing capabilities, a specialized program management method, incremental loading, was devised. To minimize data transfer between host and hypercube, a data management method which distributes, redistributes, and tracks data set information was implemented. The data management also allows data sharing among application programs. The CIPE software architecture provides a flexible environment for scientific analysis of complex remote sensing image data, such as planetary data and imaging spectrometry, utilizing state-of-the-art concurrent computation capabilities.

Lee, Meemong↗

DOE OSTI2022

LES of HCCI combustion of iso-octane/air in a flat-piston rapid compression machine

Homogeneous Charge Compression Ignition (HCCI) engines promise better efficiency and cleaner emissions than conventional piston engines, but can be challenging to control. Rapid compression machines (RCM) provide a simplified configuration for investigating HCCI combustion behavior, which is necessary for effective control of engine ignition timing and peak pressures. Here, in this study, we assess the utility of large eddy simulations (LES) for predicting HCCI combustion in a 3-D configuration. To this end, LES with finite-rate chemistry employing a 99-species iso-octane/air mechanism of two RCM operating conditions are performed. The RCM configuration under consideration was designed by Strozzi et al. with a flat piston to introduce large amounts of thermal stratification representative of realistic HCCI engine conditions, through the generation of corner vortices. It is shown that the simulation provides reasonable agreement with temperature fluctuations (7% difference), as well as ignition delay in the short ignition case (1 ms difference), while the long ignition case (35 ms difference) highlights more substantial deficiencies that are still within the expected uncertainty from the employed chemical mechanism. Flame propagation modes predicted by LES agree with experimental observations: spontaneous ignition is seen in the short ignition case, while deflagration is more prominent in the long ignition case. Analysis of global and local quantities classify the short ignition case in a mixed ignition regime, and the long ignition case in the mild ignition regime. These results demonstrate the utility of FRC-LES for investigations of multimode combustion regimes of HCCI combustion in a 3-D configuration.

33 ADVANCED PROPULSION SYSTEMS↗

NASA NTRS1981

A comprehensive analysis of the performance characteristics of the Mount Laguna solar photovoltaic installation

This paper represents the first comprehensive survey of the Mount Laguna Photovoltaic Installation. The novel techniques used for performing the field tests have been effective in locating and characterizing defective modules. A comparative analysis on the two types of modules used in the array indicates that they have significantly different failure rates, different distributions in degradational space and very different failure modes. A life cycle model is presented to explain a multimodal distribution observed for one module type. A statistical model is constructed and it is shown to be in good agreement with the field data.

Shumka, A.↗

NASA NTRS2003

NASA Tech Briefs, September 2003

Topics include: Oxygen-Partial-Pressure Sensor for Aircraft Oxygen Mask; Three-Dimensional Venturi Sensor for Measuring Extreme Winds; Swarms of Micron-Sized Sensors; Monitoring Volcanoes by Use of Air-Dropped Sensor Packages; Capacitive Sensors for Measuring Masses of Cryogenic Fluids; UHF Microstrip Antenna Array for Synthetic- Aperture Radar; Multimode Broad-Band Patch Antennas; 164-GHz MMIC HEMT Frequency Doubler; GPS Position and Heading Circuitry for Ships; Software for Managing Parametric Studies; Software Aids Visualization of Computed Unsteady Flow; Software for Testing Electroactive Structural Components; Advanced Software for Analysis of High-Speed Rolling-Element Bearings; Web Program for Development of GUIs for Cluster Computers; XML-Based Generator of C++ Code for Integration With GUIs; Oxide Protective Coats for Ir/Re Rocket Combustion Chambers; Simplified Waterproofing of Aerogels; Improved Thermal-Insulation Systems for Low Temperatures; Device for Automated Cutting and Transfer of Plant Shoots; Extension of Liouville Formalism to Postinstability Dynamics; Advances in Thrust-Based Emergency Control of an Airplane; Ultrasonic/Sonic Mechanisms for Drilling and Coring; Exercise Device Would Exert Selectable Constant Resistance; Improved Apparatus for Measuring Distance Between Axles; Six Classes of Diffraction-Based Optoelectronic Instruments; Modernizing Fortran 77 Legacy Codes; Active State Model for Autonomous Systems; Shields for Enhanced Protection Against High-Speed Debris; Scaling of Two-Phase Flows to Partial-Earth Gravity; Neutral-Axis Springs for Thin-Wall Integral Boom Hinges.

Source record↗

NASA NTRSDate not supplied

Acquisition of and Access to Research Omics Data

Omics data are essential for understanding the myriad and complex effects of space environments on humans. To assure maximum benefit from these kinds of data, the NASA Human Research Program Data Management Plan stipulates that human omics data should be archived within and accessed through the NASA Life Sciences Portal (NLSP). The NLSP has the capability to acquire and provision access to omics (and other kinds of) research results for individual and ad-hoc groups of subjects at the direction of institutional review boards, or other authorizing bodies or individuals, per institutional, program and investigation-specific policies and procedures. However, because some single-subject omics data, like CT scans and other kinds of large, complex biomedical data, could be used to identify heretofore unknown risks to the subject’s health, or, in certain cases, be used to identify a subject, NASA Policy Directive 7170.1 describes various policies regarding the management of and access to “research genetic testing” data, which includes many kinds of omics data. For example, NPD 7170.1 prohibits access to human research genetic data by NASA personnel who make employment decisions for the subjects from whom the data were obtained. To meet the objective of acquiring research omics data for NLSP in compliance with the policies in NPD 7170.1 and other applicable NASA policies, we designed NOMADS (the NLSP Omics Multimodal Acquisition of Data System), a new component that supports the transfer of large research data files, including research genetic testing data, using one of several different transfer mechanisms. The choice of mechanism is made by the submitter of the data, with guiding information from the system, and is likely to often be determined in large part by the nature and source location of the data. For example, for small files where the source data files are not already stored in a cloud storage system, users are likely to prefer to transfer their data to the NLSP via a web browser. Conversely, for large sets of files already organized and stored in a cloud storage system, users may opt for NOMAD’s cloud-to-cloud transfer method. All omics datasets targeted for the NASA Life Sciences Data Archive must pass a variety of quality checks to ensure data integrity and adherence to the standards defined by the LSDA Data Submission Guidelines (DSG) (see https://nlsp.nasa.gov/explore/lsdahome/datasubmit). These include requirements that data are consistent with open standards established by the omics community. Non-compliant data will not be accepted however archivists are available to advise submitters on how to revise data submissions and re-submit until compliance is achieved. Following compliance with the LSDA DSG, omics data next undergo a variety of additional quality checks to ensure the data meet omics community standards. Domain specific Omics data quality control tools and techniques are continually evolving and linked to the advancements in omics assays utilized and thus, the tools and techniques utilized by the LSDA for data quality control and validation will need to be sustained accordingly. All human omics data will be access controlled according to the policies described above, and requiring IRB approval for any additional access grants once the data are acquired (including access for analysis using the NLSP workspace tools).

Omics↗