Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

2023 University of Puerto Rico at Mayagüez National Institute for Congestion Reduction Study

# 2023 University of Puerto Rico at Mayagüez National Institute for Congestion Reduction Study The 2023 University of Puerto Rico at Mayagüez National Institute for Congestion Reduction (NCIR) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of policies that could incentivize the use of alternative modes of travel such as transit and micromobility. Such travel modes reduce congestion by reducing the miles traveled by privately owned vehicles in urban and rural areas. The [National Institute for Congestion Reduction](https://nicr.usf.edu/) provides multimodal congestion reduction strategies through real-world deployments that leverage advances in technology, big data science, and innovative transportation options to optimize the efficiency and reliability of the transportation system for all users. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 17 participants. ## Survey Records, Data, and Documentation Study records include 17 participants. The total number of trips was 458 and total non-air-miles traveled was approximately 1,469.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Immersive Analytics in Critical Spatial Domains: From Materials to Energy Systems

Immersive analytics (IA) leverages virtual reality, augmented reality, and mixed reality to transform how users interact with complex datasets across domains such as science, industry, and education. These immersive technologies offer spatial and multimodal environments that foster intuitive exploration, but they also introduce challenges related to cognitive load, interface design, and system performance. Here, this article presents a comprehensive review of visualization techniques, interaction models, and multimodal inputs utilized in IA. Drawing on case studies in scientific visualization, industrial training, and educational communication, we examine both the potential and limitations of current systems. Finally, we propose future research directions, focusing on real‐time collaboration, adaptive user interfaces, and scalable data exploration strategies to advance the field.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study

# 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge Study The 2024 University of Puerto Rico at Mayagüez Civic Innovation Challenge (CIVIC) Study provided insight into the travel patterns and associated energy consumption of participants. Study results helped researchers identify opportunities for the development of shared mobility strategies—such as collaborative ride-sharing programs—that could address the mobility needs of rural communities in Puerto Rico. The Civic Innovation Challenge is a multiagency, federal government research and action competition that funds ready-to-implement, research-based pilot projects that have the potential for scalable, sustainable, and transferable impact on community-identified priorities. ## Data Collection Agency The University of Puerto Rico at Mayagüez conducted the study. ## Survey Methodology The study was conducted in Spanish. Data collection was enabled via the open-source [NREL OpenPATH platform](https://www.nrel.gov/transportation/openpath). The resulting dataset consists of partially automated travel diaries—combining sensed and surveyed data reflecting patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from the 31 participants. ## Survey Records, Data, and Documentation Survey records include 31 participants. The total number of trips was 1,373 and the total non-air-miles traveled was approximately 8,260.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗
DOE OSTI2025

Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

A Representation Fusion Framework for Decoupling Diagnostic Information in Multimodal Learning

Modern medicine increasingly relies on multimodal data, ranging from clinical notes to imaging and genomics, to guide diagnosis and treatment. However, integrating these heterogeneous data sources in a principled and interpretable manner remains a major challenge. We present MODES (Multi-mOdal Disentangled Embedding Space), a representation fusion framework that explicitly separates shared and modality-specific factors of variation, offering a structured latent space for multimodal information that improves both prediction and interpretability. By leveraging pre-trained unimodal foundation models, MODES mitigates the dependency on extensive paired datasets, crucial in data-scarce clinical settings. We introduce a masking strategy that optimizes representation dimensionality by eliminating low-information dimensions, to achieve compact, information-rich representations. Our framework demonstrates superior performance in predicting diagnoses and phenotypes compared to unimodal and conventional fusion models. MODES also enables robust diagnostic inference in missing data scenarios, offering an opportunity toward interpretable and efficient multimodal diagnostics in personalized healthcare.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity—ranging from encoder-only to encoder-decoder and masked autoencoding paradigms—makes it challenging to assess performance trade-offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self-supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next-generation geospatial foundation models capable of robust multimodal reasoning.

Ambrozio Dias, Philipe [ORNL] (ORCID:0000000194277↗
DOE OSTI2025

CareWELL: Multimodal Region Representation Learning with Spatial Contexts for Urban Health

Rapid urbanization affects living environments by intensifying exposure to air pollution, heat, noise, and urban dynamics, which together contribute to uneven health outcomes across neighborhoods. For instance, cardiovascular, respiratory, and mental health conditions are each influenced by distinct exposures such as air pollution, extreme temperatures, or limited access to green space. These heterogeneous patterns require understanding the characteristics of geographic regions in order to explain why urban health risks vary across urban areas. Recent work in self-supervised region representation learning provides a promising way to model such characteristics from multimodal geospatial data. However, existing methods face two major limitations: (i) they often depend on non-public datasets, limiting reproducibility and applicability, and (ii) their generic pretraining objectives overlook health-relevant determinants, including temporal variability in environmental exposures and inequalities in social conditions. To address these gaps, we propose Context-Aware Region rEpresentation with Weather, Environment, and Location Learning (CareWELL). CareWELL leverages large language models to encode seasonal variability in weather, employs contrastive learning to align geo-coordinate and weather representations, and introduces a context-aware objective that integrates socio-demographic factors while preserving spatial correlations. We evaluate CareWELL by predicting six urban health outcomes in Manhattan, New York City, and demonstrate that CareWELL consistently outperforms state-of-the-art baselines as well as a traditional spatial computing method. These results suggest the importance of context-aware pretraining objectives for learning health-relevant region representations.

Namgung, Min [ORNL]↗
DOE OSTI2026

2022 Bull E-Bike Pilot Program Study

In 2022, the City of Durham conducted an e-bike pilot program study to learn more about how electric bikes (e-bikes) could improve the transportation experience in the "Bull City" (a.k.a., Durham, North Carolina). The study used pedal-assist e-bikes, which feature an electric motor and battery to help power the bike. The motor amplifies the power behind each pedal stroke, augmenting the energy you put into the bike. #### Data Collection Agency The City of Durham's Transportation Department conducted the study. #### Survey Methodology Program participants used electric-assist e-bikes for at least 4 weeks between August and November 2022 in exchange for sharing information about their experiences, including tracking their travel via a smartphone app. In addition to the e-bike, participants received maintenance support along with a helmet, bike lock, and other accessories. Data collection was enabled by the [NLR OpenPATH platform](https://www.nlr.gov/transportation/openpath.html). #### Survey Records and Data Survey records include a total of 76 participants. The dataset contains 3 months of partially automated travel diaries, combining sensed and surveyed travel behavior data—patterns of multimodal, end-to-end, individual human mobility—as well as demographic and socioeconomic information from participants. The number of total trips was 6,488, the number of e-bike trips was 2,183, and the number of e-bike miles traveled was 5,450.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

An Agenda for Multimodal Foundation Models for Earth Observation

Archives of remote sensing (RS) data are increasing swiftly as new sensing modalities with enhanced spatiotemporal resolution become operational. While promising new breakthroughs, the sheer volume of RS archives stretches the limits of human analysts and existing AI tools, as most models are: i) limited to single data modalities; ii) task-specific; iii) heavily reliant on labeled data. The emerging Foundation Models (FMs) have the potential to address these limitations. Trained on vast unlabeled datasets through self-supervised learning, FMs enable generic feature extraction that facilitate specialization to a wide variety of downstream tasks. This paper describes a vision towards an FM for multimodal Earth Observation data (FM4EO), discussing key building blocks and open challenges. We put particular emphasis on multimodal reasoning, a topic underexplored in EO. Our ultimate goal is a practical path toward FM4EO with capacity to unlock breakthroughs in few-shot learning scenarios, multimodal geographic knowledge integration, synthesis, and hypothesis generation.

Ambrozio Dias, Philipe↗