Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Used Nuclear Fuel Management Using the Next Generation System Analysis Model

The U.S. Department of Energy (DOE) is leading the National effort to manage the back end of the nuclear fuel cycle, encompassing the safe transportation, storage/staging, and/or eventual disposal of used nuclear fuel (UNF) and high-level radioactive waste. The Next Generation System Analysis Model (NGSAM) is DOE’s discrete-event, agent-based simulation tool designed to model the full life cycle of UNF from reactor discharge to final disposal. NGSAM supports the DOE Office of Spent Fuel and High-Level Waste Disposition by enabling a detailed, scenario-based analysis of logistics, infrastructure, and shipping strategies. NGSAM replaces legacy models with a modern, flexible platform built on Repast Simphony and enhanced by the Process Analysis Tool. NGSAM simulates the movement and interaction of individual fuel assemblies with system components such as canisters, casks, railcars, and facilities. The model integrates with the Java Transportation Operations Model to plan and execute transportation scenarios, supporting both constrained and unconstrained resource allocation. Key features include customizable allocation and acceptance algorithms, detailed facility-level operations, and a Quick Edit tool for rapid scenario adjustments. NGSAM supports multimodal transportation modeling (e.g. rail, road, barge) and provides comprehensive cost, schedule, and infrastructure data. NGSAM utilizes data from sources such as DOE’s STANDARDS UNF database and DOE’s Stakeholder Tool for Assessing Radioactive Transportation, while also allowing user-defined inputs for scenario customization. NGSAM enables stakeholders to evaluate complex UNF management strategies, assess system performance under varying assumptions, and inform decision making for future infrastructure investments. Its modular architecture and integration with other Integrated Waste Management System tools make it a critical asset for planning the safe and efficient disposition of the Nation’s growing UNF inventory.

Craig, Brian [Argonne National Laboratory (ANL)]↗
DOE OSTI2023

Mobility Energy Productivity and Equity: E-Bike Impacts for Low-Income Essential Workers in Denver

New mobility technologies such as electrified and shared mobility, combined with polices and incentive programs, are emerging to help address sustainability and equity issues in transportation planning. However, it can be difficult to understand the impacts of novel mobility trends and emerging modes on energy-efficient access. This is owing to a lack of (1) open-source tools enabling rapid data collection, and (2) open-source metrics that consider multimodal, multiactivity access and mobility within the contexts of sustainability and equity. Here, this paper addresses the topic of improving evaluation of transportation modes and incentive programs by integrating an open-source platform for tracking human travel data—the Open Platform for Agile Trip Heuristics (OpenPATH)—with a mobility metric that quantifies the efficiency of a region’s transportation system: Mobility Energy Productivity (MEP). Integration is demonstrated in the context of pilot programs in Colorado, where low-income essential workers were provided with electric bikes (e-bikes). OpenPATH-informed MEP calculations showed that several locations in downtown Denver provided comparable time-, cost-, and energy-efficient access to opportunities using e-bikes compared with driving. Additionally, providing e-bikes to low-income essential workers was found to be meaningful, as they utilized e-bikes the most to commute, despite driving still being their most utilized mode and the mode with highest MEP scores in Denver. We show how data collected from open-source tools coupled with robust metrics such as MEP can help evaluate the impacts of emerging mobility options. This could support developing policies to incentivize novel modes to achieve greater levels of sustainable, equitable, and efficient access.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Simultaneous on-chip generation of violet, blue, cyan, green, yellow, orange, and red light from an octave-spanning infrared frequency comb

An integrated, multi-spectral visible-light source could significantly benefit technologies such as displays, medical imaging, spectroscopy, visible-light communications, and astrophysics. However, despite recent advances in chip-scale visible lasers, simultaneously generating light of all colors in a single chip has been challenging. Existing solutions are either not suitable for full chip-scale integration, or are fundamentally difficult to scale. Here we demonstrate the simultaneous on-chip generation of infrared, red, orange, yellow, green, cyan, blue, and violet light. Leveraging the low loss, low dispersion, and high density of modes of an adiabatic multimode silicon nitride (SiN) microresonator, we use a single infrared pump of moderate power (~130 mW) to produce an octave-spanning infrared frequency comb that is then converted to different portions of the visible spectrum. We measure non-mode-locked combs and soliton steps corresponding to mode-locked states, making our comb generator suitable for applications that demand either low or high coherence. Since the required pump power is compatible with high-power lasers demonstrated in the same SiN platform, our multi-octave light generator can be fully integrated in a chip-scale form factor. We envision that such a light source will be a catalyst for the development and deployment of miniaturized multi-spectral technologies for quantum systems, medical imaging, displays, and spectroscopy.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Data Fusion via Neural Network Entropy Minimization for Target Detection and Multi-Sensor Event Classification

Broadly applicable solutions to multimodal and multisensory fusion problems across domains remain a challenge because effective solutions often require substantive domain knowledge and engineering. The chief questions that arise for data fusion are in when to share information from different data sources, and how to accomplish the integration of information. The solutions explored in this work remain agnostic to input representation and terminal decision fusion approaches by sharing information through the learning objective as a compound objective function. The objective function this work uses assumes a one-to-one learning paradigm within a one-to-many domain which allows the assumption that consistency can be enforced across the one-to-many dimension. The domains and tasks we explore in this work include multi-sensor fusion for seismic event location and multimodal hyperspectral target discrimination. We find that our domain- informed consistency objectives are challenging to implement in stable and successful learning because of intersections between inherent data complexity and practical parameter optimization. While multimodal hyperspectral target discrimination was not enhanced across a range of different experiments by the fusion strategies put forward in this work, seismic event location benefited substantially, but only for label-limited scenarios.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Multimodal framework for the joint analysis of single-cell RNA and T cell receptor sequencing data predicts T cell response to cancer immunotherapy

T cell states are prognostic in different cancer types. Recent technologies enable joint profiling of T cell RNA and T cell receptor (TCR) sequences at single-cell resolution. Here we present the TCR-RNA Integrating Model (TRIM), a multi-modal variational autoencoder framework that integrates RNA-TCR data and predicts T cell clonality and transcriptional states. TRIM learns a shared representation of the data conditioned on patient, tissue source, and treatment timepoint. We applied TRIM to three independent datasets that included T cells collected before and after checkpoint inhibitor treatment, sourced either from blood and tumor biopsies in patients with head and neck squamous cell carcinoma and colorectal cancer, or from tumor and adjacent tissue in a pan-cancer dataset. In all settings, TRIM accurately predicted intra-tumor T cell clonal expansion and transcriptional status based on T cells from blood or normal tissue before treatment, demonstrating its utility in modeling multimodal T cell data and predicting T cell response to treatment and disease progression.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

High power chip-scale laser

The lack of high-power integrated lasers has been limiting silicon photonics. Despite much progress in chip-scale laser integration, power output remains below levels required for key applications due to low energy efficiency at high pumping currents. Here we break this power limitation by coupling a broad-area multimode gain chip to a silicon-nitride ring resonator and single-mode filter. The resulting optical feedback causes the multimode-gain chip to concentrate its power into a single highly coherent mode. Our device produces more than 150 mW of power and 400 kHz linewidth. We achieve these metrics while maintaining a small footprint of 3 mm 2 .

Antman, Yair↗
DOE OSTI2026

Integrated fluorescence light microscopy-guided cryo-focused ion beam-milling for in situ montage cryo-ET

Cryogenic-electron tomography (cryo-ET) permits the in situ visualization of biological macromolecules at the molecular level. Owing to the variable thickness of cells, tissues and organisms, frozen specimens may need to be thinned by cryo-focused ion beam (FIB) milling to produce thin (<500 nm) cryo-lamellae suitable for cryo-ET. Locating regions of interest remains a challenge because untargeted milling can lead to inadvertent ablation and removal of regions of interest. Correlative light and electron microscopy, combined with cryo-FIB milling, can guide the identification of labeled targets in the cellular milieu. Multiple transfers between cryo-imaging instruments, cumbersome correlation algorithms, limited accuracy and low throughput have hindered the routine adoption of cryo-FIB milling within a multimodal correlative workflow for in situ structural biology. Here, in this study, we present a workflow for 3D correlative cryo-fluorescence light microscopy-FIB-ET that streamlines fluorescence light microscopy-guided FIB milling, improving throughput while preserving both structural and contextual information. The complete integration of hardware and software described here minimizes sample contamination from cross-platform exchanges and greatly enhances the efficiency of 3D targeting in cryo-milling. We then describe procedures for implementing montage parallel array cryo-ET (MPACT), which can be easily adapted to any modern life-science transmission electron microscope. MPACT supports high-throughput cryo-ET acquisitions (10 tilt series in 1.5 h) for structure determination and comprehensive contextual understanding of macromolecules within their native surroundings. A complete session from sample preparation to MPACT data processing takes 5−7 d for an individual experienced in both cryo-EM and cryo-FIB milling.

Yang, Jie E. [Univ. of Wisconsin, Madison, WI (Uni↗
DOE OSTI2026

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗
DOE OSTI2025

Predicting Trends in VOC Through Rapid, Multimodal Characterization of State-of-the-Art p-i-n Perovskite Devices

Perovskite photovoltaic technologies are approaching commercial deployment, yet single junction and tandem architectures both still have significant room to improve power conversion efficiency and stability. The ability to perform rapid screening of material quality after altering processing conditions is critical to accelerating the optimization and commercialization of perovskite-based technologies. Currently, researchers utilize a wide range of stand-alone metrology tools to isolate sources of power loss throughout a device stack, which can be slow and labor intensive. Here, we demonstrate the use of a multimodal metrology approach to rapidly determine the maximum achievable and predicted open circuit voltages of >100 perovskite devices during fabrication. Acquisition of these different data is facilitated by combining them into a single integrated measurement platform. We show that these data and automated analysis can be used to rapidly understand and ultimately predict quantitative trends in open circuit voltages of state-of-the-art device architectures. The data and automated analysis workflow presented provides a reliable approach to quickly identify absorber and charge transport layer combinations that can lead to improved open circuit voltages.

14 SOLAR ENERGY↗
DOE OSTI2021

The Value of Watching How Materials Grow: A Multimodal Case Study on Halide Perovskites

Material synthesis is one of the most important aspects in humankinds’ endeavor to discover and create new materials for energy applications. One strategy to tailor materials with desired functions in a rational way is by knowing how functions relate to structure, synthetic variables, arrangement of atoms and molecules, and how functions evolve during synthesis. In order to accelerate materials synthesis, discovery, and optimization by 10 times it is the right time now to integrate computational tools, synthesis, and characterization. One particular barrier to realizing this concept is the understanding of when and how phases form in real time during synthesis, which is challenging to asses by existing theoretical frameworks. In addition, transient or metastable phases with positive free energy above the lowest-free energy ground state can be revealed by such real time (in situ) measurements. Metastable materials are ubiquitous in condensed matter and can show superior properties compared to their equilibrium form. This work discusses the value of emerging multimodal in situ characterizations exemplified on hybrid halide perovskites. Finally, the ways in which the implementation of in situ measurements can advance the materials science synthesis field as well as their role to enable close-loop feedback control and autonomous synthesis are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2023

LA100 Equity Strategies. Chapter 10: Household Transportation Electrification

The LA100 Equity Strategies project integrates community guidance with robust research, modeling, and analysis to identify strategy options that can increase equitable outcomes in Los Angeles' clean energy transition. This chapter focuses on residential electric vehicle (EV) incentive programs and multimodal electrified transportation services as means to increase equity in household transportation electrification. Specifically, NREL modeled EV adoption and affordability under business-as-usual and enhanced low-income incentives scenarios and transportation-related energy burdens under multimodal electric travel scenarios, including shared EVs, e-bikes, and improved transit services. Based on our analysis and community guidance, we identified strategies for 1)?increasing equity in new and used light-duty EV adoption and EV charging infrastructure distribution, focused on household used EV ownership and home charging access and 2) affordable, time-efficient, and equitable multimodal electrified transportation options, specifically considering the non-vehicle-owning population. Research was guided by input from the community engagement process, and associated equity strategies are presented in alignment with that guidance.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Investigating the interconnectedness of active transportation and public transit usage as a primer for Mobility-as-a-Service adoption and deployment

With the advent of Mobility-as-a-Service packages to reduce car usage and (by extension) greenhouse gas emissions, it is crucial that researchers and practitioners consider mutual determinants and outcomes that link the adoption of multiple alternative modes. This study therefore investigates the joint usage of active travel (walking, cycling, bike-sharing) and public transit (bus, rail) modes with respect to personal and situational contexts. Online survey data (n = 826) were collected across six Midwestern U.S. states using Amazon MTurk. Respondents indicated their average weekly usage of eight travel modes across three trip purposes so that multimodality could be assessed. Several psychological constructs were extracted via (a) the stages of change framework, used to indicate willingness to adopt new behavior, and (b) confirmatory factor analysis conducted on Likert scales rooted in theories of community, identity, norms, personality, and well-being. A multiple-indicators multiple-causes structural equation model is then employed to investigate the process of adopting a modality style that incorporates active and transit modes. The model confirms that compatible physical and social contexts, as well as navigational skills and openness to learning, are key primers of multimodalism. However, a path juncture stemming from neighborhood support for mobility innovation illustrates a potential polarity in outcomes between individuals and communities. In addition, the stage of active mobility adoption is linked to identity and norm activation, offering further guidance on what influences readiness for change. The seamless integration of mobility services is critical to matching the convenience and comfort of the private vehicle; understanding potential pathways to sustainable mobility, though, requires analyses and interventions that are driven by well-being outcomes and grounded in rigorous psychological frameworks. Here, the research findings offer practical guidance for identifying intervention opportunities to be linked with MaaS enrollment while demonstrating the need to illuminate how mobility might relate to social cohesion, identity expression, and various sources of satisfaction.

42 ENGINEERING↗
DOE OSTI2023

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗
DOE OSTI2021

Optical coupler for heterogeneous integration

In an optical apparatus, an introduced semiconductor device is heterointegrated on a silicon-based platform containing a silicon-based waveguide. A polymeric waveguide is optically coupled to the introduced semiconductor device and overlies at least a portion of the silicon-based waveguide. The polymeric waveguide is conformed as a multimode interference (MMI) coupler between the introduced semiconductor device and the silicon-based waveguide. At least the polymeric waveguide, and in embodiments, also the silicon-based waveguide, is tapered with a shape that effectuates optical coupling to the silicon-based waveguide.

Gehl, Michael↗
DOE OSTI2024

Crosstalk-robust quantum control in multimode bosonic systems

High-coherence superconducting cavities offer a hardware-efficient platform for quantum information processing. To achieve universal operations of these bosonic modes, the requisite nonlinearity is realized by coupling them to a transmon ancilla. However, this configuration is susceptible to crosstalk errors in the dispersive regime, where the ancilla frequency is Stark shifted by the state of each coupled bosonic mode. This leads to a frequency mismatch of the ancilla drive, lowering the gate fidelities. To mitigate such coherent errors, we employ quantum optimal control to engineer ancilla pulses that are robust to the frequency shifts. These optimized pulses are subsequently integrated into a recently developed echoed conditional displacement protocol for executing single- and two-mode operations. Through numerical simulations, we examine two representative scenarios: the preparation of single-mode Fock states in the presence of spectator modes and the generation of two-mode entangled Bell-cat states. Our approach markedly suppresses crosstalk errors, outperforming conventional ancilla control methods by orders of magnitude. These results provide guidance for experimentally achieving high-fidelity multimode operations and pave the way for developing high-performance bosonic quantum information processors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Accelerating Structure–Property Relationship Discovery with Multimodal Machine Learning and Self-Driving Microscopy

Microscopy combined with local spectroscopy is widely used to correlate nanoscale structure with functional properties in materials, but conventional measurements rely heavily on human-selected sampling locations and predefined targets, limiting data set diversity and the potential for discovery. Here, we present a framework that integrates autonomous microscopy with dual-novelty deep kernel learning (DN-DKL) for adaptive data acquisition and a dual variational autoencoder (VAE) for representation learning. DN-DKL actively guides the microscopy toward structurally and spectroscopically novel regions, enabling efficient collection of large spectral data sets. Dual-VAE embeds local structures and spectroscopic responses into a shared latent manifold that serves as a structure–property relationship map. We applied this framework for the investigation of halide perovskite films by using conductive atomic force microscopy. The results reveal distinct hysteresis behaviors that are linked to specific nanoscale structural motifs, including grain boundary junction points that show hysteresis under different bias conditions and asymmetric grain boundaries that suppress the charge transport. This framework establishes a general strategy that leverages the complementary strengths of self-driving microscopy, machine learning, and human expertise to accelerate scientific discovery in functional materials.

atomic force microscopy↗
DOE OSTI2021

Airy light-sheet Raman imaging

Light-sheet fluorescence microscopy has greatly improved the speed and overall photostability of optically sectioning cellular and multi-cellular specimens. Similar gains have also been conferred by light-sheet Raman imaging; these schemes, however, rely on diffraction limited Gaussian beams that hinder the uniformity and size of the imaging field-of-view, and, as such, the resulting throughput rates. Here, we demonstrate that a digitally scanned Airy beam increases the Raman imaging throughput rates by more than an order of magnitude than conventional diffraction-limited beams. Overall, this, spectrometer-less, approach enabled 3D imaging of microparticles with high contrast and 1 µm axial resolution at 300 msec integration times per plane and orders of magnitude lower irradiation density than coherent Raman imaging schemes. We detail the apparatus and its performance, as well as its compatibility with fluorescence light-sheet and quantitative-phase imaging towards rapid and low phototoxicity multimodal imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

SULI Report - Development of a Molten Salt Circulation Loop for in-situ Spectroscopy

This project supports the development of real time optical monitoring capabilities for molten salt reactor (MSR) environments by designing, testing, and refining a molten salt circulation loop suitable for combined laser induced breakdown spectroscopy (LIBS) and ultraviolet visible (UV Vis) absorption measurements. Online spectroscopic monitoring is increasingly important for nuclear safeguards, corrosion tracking, and material accountancy, yet MSR process fluids present substantial challenges due to their chemical complexity and hazards such as high temperatures and radiation. To address these needs, this work focuses on Phase I, the development of a room temperature aqueous circulation loop that serves as a surrogate platform for evaluating flow behavior, optical access, and component performance prior to high temperature salt operation. Initial testing identified several practical issues—including leaks, obstructions, and two-phase flow through the absorption cell—that were systematically resolved through hardware replacement, flow path redesign, and venturi pressure optimization. Relocating the flow cell upstream of the primary venturi enabled periods of stable single-phase flow, demonstrating the feasibility of integrating optical diagnostics into a circulation system. The results of Phase I provide essential design insight for Phase II, which will incorporate furnace compatible materials and LiCl KCl eutectic salt. Completion of the molten salt system will deliver a reusable testbed for evaluating multimodal spectroscopic techniques, advancing nondestructive, real time monitoring tools for future MSR and nuclear fuel cycle applications.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗