Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗

High-performance multimode elastocaloric cooling system

Developing zero–global warming potential refrigerants has emerged as one area that helps address global climate change concerns. Various high-efficiency caloric cooling techniques meet this goal, but scaling them up to technologically meaningful performance remains challenging. We have developed an elastocaloric cooling system with a maximum cooling power of 260 watts and a maximum temperature span of 22.5 kelvin. These values are among the highest reported for any caloric cooling system. Its key feature is the compression of fatigue-resistant elastocaloric nitinol (NiTi) tubes configured in a versatile multimode heat exchange architecture, which allows the harnessing of both high delivered cooling power and large temperature spans. Our system shows that elastocaloric cooling, which only emerged 8 years ago, is a promising direction for commercializing caloric cooling.

Science & Technology - Other Topics↗

CareWELL: Multimodal Region Representation Learning with Spatial Contexts for Urban Health

Rapid urbanization affects living environments by intensifying exposure to air pollution, heat, noise, and urban dynamics, which together contribute to uneven health outcomes across neighborhoods. For instance, cardiovascular, respiratory, and mental health conditions are each influenced by distinct exposures such as air pollution, extreme temperatures, or limited access to green space. These heterogeneous patterns require understanding the characteristics of geographic regions in order to explain why urban health risks vary across urban areas. Recent work in self-supervised region representation learning provides a promising way to model such characteristics from multimodal geospatial data. However, existing methods face two major limitations: (i) they often depend on non-public datasets, limiting reproducibility and applicability, and (ii) their generic pretraining objectives overlook health-relevant determinants, including temporal variability in environmental exposures and inequalities in social conditions. To address these gaps, we propose Context-Aware Region rEpresentation with Weather, Environment, and Location Learning (CareWELL). CareWELL leverages large language models to encode seasonal variability in weather, employs contrastive learning to align geo-coordinate and weather representations, and introduces a context-aware objective that integrates socio-demographic factors while preserving spatial correlations. We evaluate CareWELL by predicting six urban health outcomes in Manhattan, New York City, and demonstrate that CareWELL consistently outperforms state-of-the-art baselines as well as a traditional spatial computing method. These results suggest the importance of context-aware pretraining objectives for learning health-relevant region representations.

Namgung, Min [ORNL]↗

Capturing Travel Mode Adoption in Designing On-Demand Multimodal Transit Systems

This paper studies how to integrate rider mode preferences into the design of on-demand multimodal transit systems (ODMTSs). It is motivated by a common worry in transit agencies that an ODMTS may be poorly designed if the latent demand, that is, new riders adopting the system, is not captured. This paper proposes a bilevel optimization model to address this challenge, in which the leader problem determines the ODMTS design, and the follower problems identify the most cost efficient and convenient route for riders under the chosen design. The leader model contains a choice model for every potential rider that determines whether the rider adopts the ODMTS given her proposed route. To solve the bilevel optimization model, the paper proposes an exact decomposition method that includes Benders optimal cuts and no-good cuts to ensure the consistency of the rider choices in the leader and follower problems. Moreover, to improve computational efficiency, the paper proposes upper and lower bounds on trip durations for the follower problems, valid inequalities that strengthen the no-good cuts, and approaches to reduce the problem size with problem-specific preprocessing techniques. The proposed method is validated using an extensive computational study on a real data set from the Ann Arbor Area Transportation Authority, the transit agency for the broader Ann Arbor and Ypsilanti region in Michigan. The study considers the impact of a number of factors, including the price of on-demand shuttles, the number of hubs, and access to transit systems criteria. The designed ODMTSs feature high adoption rates and significantly shorter trip durations compared with the existing transit system and highlight the benefits of ensuring access for low-income riders. Finally, the computational study demonstrates the efficiency of the decomposition method for the case study and the benefits of computational enhancements that improve the baseline method by several orders of magnitude. Funding: This research was partly supported by National Science Foundation [Leap HI Proposal NSF-1854684] and the Department of Energy [Research Award 7F-30154].

Operations Research & Management Science↗

Multimode description of self-mode locking in a single-section quantum-dot laser

This paper describes a theory for mode locking and frequency comb generation by four-wave mixing in a semiconductor quantum-dot active medium. The derivation uses a multimode semiclassical laser theory that accounts for fast carrier collisions within an inhomogeneous distribution of quantum dots. Numerical simulations are presented to illustrate the role of active medium nonlinearities in mode competition, gain saturation, carrier-induced refractive index and creation of combination tones that lead to locking of beat frequencies among lasing modes in the presence of cavity material dispersion.

Chow, Weng W.↗

Using multimodal X-ray computed tomography to advance 3D petrography: A non-destructive investigation of olivine inside a carbonaceous chondrite

Rocks form in three dimensions through time and studying them provides information from inside dynamic systems we cannot otherwise observe. Yet how we typically access the interior of the rocks themselves to gain that information may limit our understanding and influence how we reconstruct the processes that formed them. Here, we demonstrate combined non-destructive 3D X-ray imaging techniques that produce quantitative densitometric and crystallographic maps of entire individual grains inside a rock. Olivine grains throughout a sample of the carbonaceous chondrite Northwest Africa (NWA) 11346 were each characterized by size, shape, composition, zoning intensity, and crystallographic orientation. The addition of 3D crystallographic mapping to calibrated 3D densitometric analysis—used to calculate chemical composition—demonstrates a fully non-destructive petrographic method and provides unique insight. For instance, in our case, using crystallographic data to delineate individual grains and then measuring the 3D size, shape, and composition of each distinguishes variably reset relict grains from those later crystallized after a melting event. Intersection in a 2D slice could not have led to this interpretation because the integration of three-dimensional size, rounding, composition, location, and crystallographic orientation measured from each grain forms the key patterns. Multimodal laboratory X-ray imaging has strong potential to advance 3D petrography.

36 MATERIALS SCIENCE↗

Multimodal single-Cell/ Particle imaging and engineering for energy conversion in bacteria (Final Technical Report)

Hybrid inorganic-microbial systems have emerged as a potentially transformative approach to combine the light-harvesting capability of inorganic semiconductors and the ability of microbes to orchestrate complex chemical transformations. The objective of this collaborative research is to combine quantum materials synthesis, bacterial synthetic biology, and multimodal single-entity imaging to quantitatively study how hybrid QD-bacteria systems convert light to value chemicals at the single-to-sub cell level, with the ultimate goal of gaining insights to guide the engineering of QDs and bacterial genetics for more efficient bioenergy conversion. The final technical report summarizes our achievements toward this objective.

09 BIOMASS FUELS↗

Addressing Critical Problems in Materials Science Through Multiscale and Multimode Characterization (Project 1); Characterization and Optimization of Novel Triple-Conducting Oxide Materials for Energy Applications (Project 2) (CRADA Final Report)

PROJECT 1: Address critical problems in materials science and simultaneously advance the state-of-the-art in multiscale and multimode characterization using the combined advanced analytical capabilities and expertise of Colorado School of Mines (CSM) and the National Renewable Energy Laboratory (NREL). The primary effort of the Phase I of this CRADA is to establish the International Center for Multiscale Characterization using shared resources at both NREL and CSM. Phase II will focus on capability development and marketing, choosing candidate materials science issues in the areas of structure imaging, chemical composition mapping, and correlating properties and performance of materials for impact in energy-related, environmental and critical materials areas. The CRADA will be modified to include specific topics of concern in materials science to industry member partners. Advanced analytical capabilities and expertise at CSM and NREL will be used to advance materials understanding and performance through characterization of multiscale phenomena including structural imaging, chemical composition mapping, and other techniques correlating properties and performance of materials. PROJECT 2: As part of the International Center for Materials Characterization, work under Modification #1 will be led by Colorado School of Mines (CSM), working in collaboration with NREL staff to mentor and advise CSM postdoctoral researchers on set up of diffusion annealing experiments. The purpose of the modification is to provide for NREL staff to mentor and advise CSM postdoctoral researchers on set up of diffusion annealing experiments, including mentoring and advising the CSM-NREL team on proper Secondary Ion Mass Spectrometry (SIMS) data analysis as needed. SIMS measurements of 10-20 samples will be performed at NREL during the project duration.

08 HYDROGEN↗

Multimodal Ligand Non-Innocence for Reduction Catalysis (Final Technical Report)

The goal of this project was to develop multimodal ligand non-innocence in late transition metal complexes of aminophenolate ligands and to apply this ligand-centered reactivity to small-molecule reduction reactions relevant to energy-conversion chemistry. Specific aims were, 1) Prepare new coordination complexes of aminophenolate ligands and characterize them using a battery of structural, spectroscopic, and computational methods. 2) Benchmark the thermodynamics and kinetics of e - , H + , H • , and H - transfer reactivity to establish the baseline reactivity of new metal complexes containing aminophenolate ligands. 3) Apply new aminophenolate complexes to catalytic reduction reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multimodal Instrument Concepts for Chemical Sciences at Second Target Station

The development of advanced chemical and energy systems is inherently complex, relying heavily on their unique pathways. Because no two catalysts or batteries follow exactly the same kinetic trajectories, conventional sequential measurements often obscure crucial relationships between structure and dynamics through statistical averaging. This report introduces two neutron scattering instrument concepts for the Second Target Station (STS) specifically designed to overcome this barrier: the Extended Q-range Diffractometer (EQD) and the Multimodal Chemical Spectrometer (MCS).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multimodal Few-Shot Segmentation of Electron Micrographs

Scanning transmission electron microscopy (STEM) is one of the most used methods of analyzing the chemistry and composition of materials. By analyzing microstructures, these microscopes can help scientists better understand the molecular underpinnings of microelectronics, batteries, and more. However, STEM data can be difficult to interpret, so recent developments have been made in applications of machine learning to analyze these images. The PNNL-developed pyCHIP Classifier has achieved results in segmenting STEM these images via few-shot learning, a method which requires little data and human input, perfect for quickly analysis. In my internship I (Eli Meyers) investigated a multimodal improvement of this classifier by incorporating energy dispersive x-ray spectroscopy (EDS) data into the classification process for a more accurate segmentation. Furthermore, I encoded the spectral data by training a mass spectrometry encoder on the EDS data to extract a more meaningful representation of the data.

36 MATERIALS SCIENCE↗

Development of Multimodal Few-Shot Analytics for Electron Micrographs

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Attempts at creating a multimodal approach can provide further improvements to current models and help extract more salient features from data. In this vein, raw spectrum data was taken to provide an additional modality to our current pyCHIP classifier. Modifications in segmentation also show potential in improving the accuracy of the pyCHIP classifier. Classifier output was analyzed using network graphs and unsupervised clustering algorithms such as spectral clustering to detect better segmentation methods than the current “chipping” approach. We suggest that the chip selection process can be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗

Utilizing multimodal high-intensity interval training for a firefighter training academy during the COVID-19 pandemic

Firefighters typically undergo a 16–24-week training academy during which they perform a variety of traditional exercise programs such as cardiovascular, resistance, and concurrent training. Because of limited facility access, some fire departments seek alternative exercise programs, such as multimodal high-intensity interval training (MM-HIIT), which essentially combines resistance and interval training. Here, the primary purpose of this study was to assess the effect of MM-HIIT on body composition and physical fitness in firefighter recruits who completed a training academy during the coronavirus (COVID-19) pandemic. A secondary purpose was to compare the effects of MM-HIIT to previous training academies that implemented traditional exercise programs. Healthy and recreationally-trained recruits (n=12) participated in 2-3 days/week of MM-HIIT for 12 weeks and had several components of body composition and physical fitness measured before and after the program. Because of COVID-19-related gym closures, all MM-HIIT sessions were performed outdoors at a fire station with minimal equipment. These data were retroactively compared to a control group (CG) that previously completed training academies with traditional exercise programs. Subjects in the MM-HIIT group significantly improved several components of body composition and fitness, including fat mass, fat-free mass, body fat percentage, aerobic capacity, and muscular endurance (p < 0.005). Moreover, there were no significant differences for any dependent variable when MM-HIIT was compared to the CG (p≥0.005). These results suggest that MM-HIIT may serve as an effective substitute for traditional concurrent training paradigms that are typically used for firefighter academies.

60 APPLIED LIFE SCIENCES↗

Fractal Characterization of Multimodal, Multiscale Images of Shale Rock Fracture Networks

An array of multimodal and multiscale images of fractured shale rock samples and analogs was collected with the aim of improving the numerical representation of fracture networks. 2D and 3D reconstructions of fractures and matrices span from 10 –6 to 100 m. The origin of the fracture networks ranged from natural to thermal maturation to hydraulically induced maturation. Images were segmented to improve fracture identification. Then, the fractal dimension and length distribution of the fracture networks were calculated for each image dataset. The resulting network connectivity and scaling associations are discussed at length on the basis of scale, sample and order of magnitude. Fracture network origin plays an important role in the resulting fracture systems and their scaling. Rock analogs are also evaluated using these descriptive tools and are found to be faithful depictions of maturation-induced fracture networks.

58 GEOSCIENCES↗

Data for reproducing the figures of the paper Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas

This deposit contains the raw data for reproducing research results of the paper Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas. The main contribution of this work is to utilize machine learning techniques to reconstruct and enhance the resolution of a diagnostic measurement from other available diagnostics in a system. The proposed techniques is called Diag2Diag.

diag2diag↗