Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Micro-Spec: An Ultracompact, High-sensitivity Spectrometer for Far-Infrared and Submillimeter Astronomy

High-performance, integrated spectrometers operating in the far-infrared and submillimeter ranges promise to be powerful tools for the exploration of the epochs of reionization and initial galaxy formation. These devices, using high-efficiency superconducting transmission lines, can achieve the performance of a meter-scale grating spectrometer in an instrument implemented on a 4 inch silicon wafer. Such a device, when combined with a cryogenic telescope in space, provides an enabling capability for studies of the early universe. Here, the optical design process for Micro-Spec (micron-Spec) is presented, with particular attention given to its two-dimensional diffractive region, where the light of different wavelengths is focused on the different detectors. The method is based on the stigmatization and minimization of the light path function in this bounded region, which results in an optimized geometrical configuration. A point design with an efficiency of (is) approximately 90% has been developed for initial demonstration and can serve as the basis for future instruments. Design variations on this implementation are also discussed, which can lead to lower efficiencies due to diffractive losses in the multimode region.

cryogenic telescope↗
DOE OSTI2026

Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET

Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.

Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2025

Predicting Trends in VOC Through Rapid, Multimodal Characterization of State-of-the-Art p-i-n Perovskite Devices

Perovskite photovoltaic technologies are approaching commercial deployment, yet single junction and tandem architectures both still have significant room to improve power conversion efficiency and stability. The ability to perform rapid screening of material quality after altering processing conditions is critical to accelerating the optimization and commercialization of perovskite-based technologies. Currently, researchers utilize a wide range of stand-alone metrology tools to isolate sources of power loss throughout a device stack, which can be slow and labor intensive. Here, we demonstrate the use of a multimodal metrology approach to rapidly determine the maximum achievable and predicted open circuit voltages of >100 perovskite devices during fabrication. Acquisition of these different data is facilitated by combining them into a single integrated measurement platform. We show that these data and automated analysis can be used to rapidly understand and ultimately predict quantitative trends in open circuit voltages of state-of-the-art device architectures. The data and automated analysis workflow presented provides a reliable approach to quickly identify absorber and charge transport layer combinations that can lead to improved open circuit voltages.

14 SOLAR ENERGY↗
NASA NTRS2004

Geomorphologic Studies of a Very Long Lava Flow in Tharsis, Mars

CEPS has undertaken an extended study of long lava flows on the terrestrial planets, their location, morphology, and potential modes of emplacement. As part of this ongoing investigation, we have concentrated on a single large flow in Tharsis, with noted similarities to several terrestrial analogs. An impressive series of lava flows emerges from the topographic saddle between Ascraeus and Pavonis Mons. The most prominent of these (hereafter referred to as the 'Saddle Flow') has distinct margins that can be traced for over 480 km in the Viking images, although its exact source cannot be identified. A multimodal approach is utilized in the examination of the Saddle Flow, including image interpretation (VIKING and THEMIS, MOLA topographic analysis and flow profiling, downflow behavior statistical analysis, rheologic modeling, and GIS modeling and integration.

Peitersen, M. N.↗
DOE OSTI2021

The Value of Watching How Materials Grow: A Multimodal Case Study on Halide Perovskites

Material synthesis is one of the most important aspects in humankinds’ endeavor to discover and create new materials for energy applications. One strategy to tailor materials with desired functions in a rational way is by knowing how functions relate to structure, synthetic variables, arrangement of atoms and molecules, and how functions evolve during synthesis. In order to accelerate materials synthesis, discovery, and optimization by 10 times it is the right time now to integrate computational tools, synthesis, and characterization. One particular barrier to realizing this concept is the understanding of when and how phases form in real time during synthesis, which is challenging to asses by existing theoretical frameworks. In addition, transient or metastable phases with positive free energy above the lowest-free energy ground state can be revealed by such real time (in situ) measurements. Metastable materials are ubiquitous in condensed matter and can show superior properties compared to their equilibrium form. This work discusses the value of emerging multimodal in situ characterizations exemplified on hybrid halide perovskites. Finally, the ways in which the implementation of in situ measurements can advance the materials science synthesis field as well as their role to enable close-loop feedback control and autonomous synthesis are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

LA100 Equity Strategies. Chapter 10: Household Transportation Electrification

The LA100 Equity Strategies project integrates community guidance with robust research, modeling, and analysis to identify strategy options that can increase equitable outcomes in Los Angeles' clean energy transition. This chapter focuses on residential electric vehicle (EV) incentive programs and multimodal electrified transportation services as means to increase equity in household transportation electrification. Specifically, NREL modeled EV adoption and affordability under business-as-usual and enhanced low-income incentives scenarios and transportation-related energy burdens under multimodal electric travel scenarios, including shared EVs, e-bikes, and improved transit services. Based on our analysis and community guidance, we identified strategies for 1)?increasing equity in new and used light-duty EV adoption and EV charging infrastructure distribution, focused on household used EV ownership and home charging access and 2) affordable, time-efficient, and equitable multimodal electrified transportation options, specifically considering the non-vehicle-owning population. Research was guided by input from the community engagement process, and associated equity strategies are presented in alignment with that guidance.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Investigating the interconnectedness of active transportation and public transit usage as a primer for Mobility-as-a-Service adoption and deployment

With the advent of Mobility-as-a-Service packages to reduce car usage and (by extension) greenhouse gas emissions, it is crucial that researchers and practitioners consider mutual determinants and outcomes that link the adoption of multiple alternative modes. This study therefore investigates the joint usage of active travel (walking, cycling, bike-sharing) and public transit (bus, rail) modes with respect to personal and situational contexts. Online survey data (n = 826) were collected across six Midwestern U.S. states using Amazon MTurk. Respondents indicated their average weekly usage of eight travel modes across three trip purposes so that multimodality could be assessed. Several psychological constructs were extracted via (a) the stages of change framework, used to indicate willingness to adopt new behavior, and (b) confirmatory factor analysis conducted on Likert scales rooted in theories of community, identity, norms, personality, and well-being. A multiple-indicators multiple-causes structural equation model is then employed to investigate the process of adopting a modality style that incorporates active and transit modes. The model confirms that compatible physical and social contexts, as well as navigational skills and openness to learning, are key primers of multimodalism. However, a path juncture stemming from neighborhood support for mobility innovation illustrates a potential polarity in outcomes between individuals and communities. In addition, the stage of active mobility adoption is linked to identity and norm activation, offering further guidance on what influences readiness for change. The seamless integration of mobility services is critical to matching the convenience and comfort of the private vehicle; understanding potential pathways to sustainable mobility, though, requires analyses and interventions that are driven by well-being outcomes and grounded in rigorous psychological frameworks. Here, the research findings offer practical guidance for identifying intervention opportunities to be linked with MaaS enrollment while demonstrating the need to illuminate how mobility might relate to social cohesion, identity expression, and various sources of satisfaction.

42 ENGINEERING↗
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2021

Optical coupler for heterogeneous integration

In an optical apparatus, an introduced semiconductor device is heterointegrated on a silicon-based platform containing a silicon-based waveguide. A polymeric waveguide is optically coupled to the introduced semiconductor device and overlies at least a portion of the silicon-based waveguide. The polymeric waveguide is conformed as a multimode interference (MMI) coupler between the introduced semiconductor device and the silicon-based waveguide. At least the polymeric waveguide, and in embodiments, also the silicon-based waveguide, is tapered with a shape that effectuates optical coupling to the silicon-based waveguide.

Gehl, Michael↗
DOE OSTI2024

Crosstalk-robust quantum control in multimode bosonic systems

High-coherence superconducting cavities offer a hardware-efficient platform for quantum information processing. To achieve universal operations of these bosonic modes, the requisite nonlinearity is realized by coupling them to a transmon ancilla. However, this configuration is susceptible to crosstalk errors in the dispersive regime, where the ancilla frequency is Stark shifted by the state of each coupled bosonic mode. This leads to a frequency mismatch of the ancilla drive, lowering the gate fidelities. To mitigate such coherent errors, we employ quantum optimal control to engineer ancilla pulses that are robust to the frequency shifts. These optimized pulses are subsequently integrated into a recently developed echoed conditional displacement protocol for executing single- and two-mode operations. Through numerical simulations, we examine two representative scenarios: the preparation of single-mode Fock states in the presence of spectator modes and the generation of two-mode entangled Bell-cat states. Our approach markedly suppresses crosstalk errors, outperforming conventional ancilla control methods by orders of magnitude. These results provide guidance for experimentally achieving high-fidelity multimode operations and pave the way for developing high-performance bosonic quantum information processors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS1991

Reflection Effects in Multimode Fiber Systems Utilizing Laser Transmitters

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

Bates, Harry E.↗
DOE OSTI2026

Accelerating Structure–Property Relationship Discovery with Multimodal Machine Learning and Self-Driving Microscopy

Microscopy combined with local spectroscopy is widely used to correlate nanoscale structure with functional properties in materials, but conventional measurements rely heavily on human-selected sampling locations and predefined targets, limiting data set diversity and the potential for discovery. Here, we present a framework that integrates autonomous microscopy with dual-novelty deep kernel learning (DN-DKL) for adaptive data acquisition and a dual variational autoencoder (VAE) for representation learning. DN-DKL actively guides the microscopy toward structurally and spectroscopically novel regions, enabling efficient collection of large spectral data sets. Dual-VAE embeds local structures and spectroscopic responses into a shared latent manifold that serves as a structure–property relationship map. We applied this framework for the investigation of halide perovskite films by using conductive atomic force microscopy. The results reveal distinct hysteresis behaviors that are linked to specific nanoscale structural motifs, including grain boundary junction points that show hysteresis under different bias conditions and asymmetric grain boundaries that suppress the charge transport. This framework establishes a general strategy that leverages the complementary strengths of self-driving microscopy, machine learning, and human expertise to accelerate scientific discovery in functional materials.

atomic force microscopy↗
NASA NTRS1972

Development of a model of machine hand eye coordination and program specifications for a topological machine vision system

A unified approach to computer vision and manipulation is developed which is called choreographic vision. In the model, objects to be viewed by a projected robot in the Viking missions to Mars are seen as objects to be manipulated within choreographic contexts controlled by a multimoded remote, supervisory control system on Earth. A new theory of context relations is introduced as a basis for choreographic programming languages. A topological vision model is developed for recognizing objects by shape and contour. This model is integrated with a projected vision system consisting of a multiaperture image dissector TV camera and a ranging laser system. System program specifications integrate eye-hand coordination and topological vision functions and an aerospace multiprocessor implementation is described.

Source record↗
NASA NTRS2011

Performance Evaluation of Block Acquisition and Tracking Algorithms Using an Open Source GPS Receiver Platform

Location technologies have many applications in wireless communications, military and space missions, etc. US Global Positioning System (GPS) and other existing and emerging Global Navigation Satellite Systems (GNSS) are expected to provide accurate location information to enable such applications. While GNSS systems perform very well in strong signal conditions, their operation in many urban, indoor, and space applications is not robust or even impossible due to weak signals and strong distortions. The search for less costly, faster and more sensitive receivers is still in progress. As the research community addresses more and more complicated phenomena there exists a demand on flexible multimode reference receivers, associated SDKs, and development platforms which may accelerate and facilitate the research. One of such concepts is the software GPS/GNSS receiver (GPS SDR) which permits a facilitated access to algorithmic libraries and a possibility to integrate more advanced algorithms without hardware and essential software updates. The GNU-SDR and GPS-SDR open source receiver platforms are such popular examples. This paper evaluates the performance of recently proposed block-corelator techniques for acquisition and tracking of GPS signals using open source GPS-SDR platform.

Ramachandran, Ganesh K.↗
NASA NTRS2003

Multimode Broad-Band Patch Antennas

Microstrip patch antennas of a proposed type would be tunable over broad wavelength ranges. These antennas would be attractive for use in a variety of microwave communication systems in which there are requirements for transmission and/or reception at multiple, widely separated frequencies. Prior efforts to construct tunable microstrip patch antennas have involved integration of microstrip circuitry with, variously, ferrite films with magneticfield tuning, solid-state electronic tuning devices, or piezoelectric tuning actuators. Those efforts have been somewhat successful, but have yielded tuning ranges of 20 percent and smaller much smaller than needed in typical practical cases. Like prior microstrip patch antennas (both tunable and non-tunable), the proposed antennas would have instantaneous bandwidths of about 1 percent of their nominal or resonance frequencies. However, these would be tunable over much broader frequency ranges as much as several octaves, depending on specific designs. They could be fabricated relatively simply and inexpensively by use of conventional photolithography, and without need for integration with solid-state electronic or piezoelectric control devices. An antenna as proposed (see figure) would include a microstrip patch radiating element on a thin ferroelectric film on a semiconductor substrate with a ground-plane conductor on the underside of the substrate. The ferroelectric film could be, for example, SrTiO3 with a thickness of the order of 1 or 2 micrometers.

Romanofsky, Robert R.↗
DOE OSTI2021

Airy light-sheet Raman imaging

Light-sheet fluorescence microscopy has greatly improved the speed and overall photostability of optically sectioning cellular and multi-cellular specimens. Similar gains have also been conferred by light-sheet Raman imaging; these schemes, however, rely on diffraction limited Gaussian beams that hinder the uniformity and size of the imaging field-of-view, and, as such, the resulting throughput rates. Here, we demonstrate that a digitally scanned Airy beam increases the Raman imaging throughput rates by more than an order of magnitude than conventional diffraction-limited beams. Overall, this, spectrometer-less, approach enabled 3D imaging of microparticles with high contrast and 1 µm axial resolution at 300 msec integration times per plane and orders of magnitude lower irradiation density than coherent Raman imaging schemes. We detail the apparatus and its performance, as well as its compatibility with fluorescence light-sheet and quantitative-phase imaging towards rapid and low phototoxicity multimodal imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

SULI Report - Development of a Molten Salt Circulation Loop for in-situ Spectroscopy

This project supports the development of real time optical monitoring capabilities for molten salt reactor (MSR) environments by designing, testing, and refining a molten salt circulation loop suitable for combined laser induced breakdown spectroscopy (LIBS) and ultraviolet visible (UV Vis) absorption measurements. Online spectroscopic monitoring is increasingly important for nuclear safeguards, corrosion tracking, and material accountancy, yet MSR process fluids present substantial challenges due to their chemical complexity and hazards such as high temperatures and radiation. To address these needs, this work focuses on Phase I, the development of a room temperature aqueous circulation loop that serves as a surrogate platform for evaluating flow behavior, optical access, and component performance prior to high temperature salt operation. Initial testing identified several practical issues—including leaks, obstructions, and two-phase flow through the absorption cell—that were systematically resolved through hardware replacement, flow path redesign, and venturi pressure optimization. Relocating the flow cell upstream of the primary venturi enabled periods of stable single-phase flow, demonstrating the feasibility of integrating optical diagnostics into a circulation system. The results of Phase I provide essential design insight for Phase II, which will incorporate furnace compatible materials and LiCl KCl eutectic salt. Completion of the molten salt system will deliver a reusable testbed for evaluating multimodal spectroscopic techniques, advancing nondestructive, real time monitoring tools for future MSR and nuclear fuel cycle applications.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗