Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Turbulent transport and mixing in the multimode narrowband Richtmyer-Meshkov instability

The mean momentum and heavy mass fraction, turbulent kinetic energy, and heavy mass fraction variance fields, as well as the budgets of their transport equations are examined several times during the evolution of a narrowband Richtmyer-Meshkov instability initiated by a Mach 1.84 shock traversing a perturbed interface separating gases with a density ratio of 3. The results are computed using the “quarter scale” data from four algorithms presented in the θ-group study of Thornber et al. [“Late-time growth rate, mixing, and anisotropy in the multimode narrowband Richtmyer-Meshkov instability: The θ-group collaboration,” Phys. Fluids 29, 105107 (2017)]. The present study is inspired by a previous similar study of Rayleigh-Taylor instability and mixing using direct numerical simulation data by Schilling and Mueschke [“Analysis of turbulent transport and mixing in transitional Rayleigh-Taylor unstable flow using direct numerical simulation data,” Phys. Fluids 22, 105102 (2010)]. In addition to comparing the predictions of the data from four implicit large-eddy simulation codes, the budgets are used to quantify the relative importance of the terms in the transport equations, and the balance of the terms is employed to infer the numerical dissipation. Furthermore, terms arising from the compressibility of the flow are examined, in particular the pressure-dilatation. The results are useful for validation of large-eddy simulation and Reynolds-averaged modeling of Richtmyer-Meshkov instability.

42 ENGINEERING↗

Unveiling the nanoscale architectures and dynamics of protein assembly with in situ atomic force microscopy

Proteins play a vital role in different biological processes by forming complexes through precise folding with exclusive inter- and intra-molecular interactions. Understanding the structural and regulatory mechanisms underlying protein complex formation provides insights into biophysical processes. Furthermore, the principle of protein assembly gives guidelines for new biomimetic materials with potential applications in medicine, energy, and nanotechnology. Atomic force microscopy (AFM) is a powerful tool for investigating protein assembly and interactions across spatial scales (single molecules to cells) and temporal scales (milliseconds to days). It has significantly contributed to understanding nanoscale architectures, inter- and intra-molecular interactions, and regulatory elements that determine protein structures, assemblies, and functions. This review describes recent advancements in elucidating protein assemblies with in situ AFM. We discuss the structures, diffusions, interactions, and assembly dynamics of proteins captured by conventional and high-speed AFM in near-native environments and recent AFM developments in the multimodal high-resolution imaging, bimodal imaging, live cell imaging, and machine-learning-enhanced data analysis. These approaches show the significance of broadening the horizons of AFM and enable unprecedented explorations of protein assembly for biomaterial design and biomedical research.

36 MATERIALS SCIENCE↗

Computational Design of Alloys for Energy Technologies

Advanced materials that maintain their mechanical performance under elevated temperatures, corrosive environments, and a range of static and evolving stresses are needed to improve the efficiency and reduce the environmental impact of a wide spectrum of energy technologies. For instance, cost-efficient alloys that can withstand high temperatures (e.g., 700 °C) have a critical role in improving the efficiency and economics of power generation to support decarbonization of the energy sector; such is true of both the nuclear and fossil energy sectors. Considering both the threats of the energy crisis, namely soaring costs of greenhouse gas emission-producing energy and climate change, it is essential to increase the pace of material discovery and enable rapid paths for material qualification to advance clean energy technologies. Conventionally, alloy development has followed a slow Edisonian process that uses repeated cycles of making, characterizing, and modifying to arrive at optimum composition and processing conditions to achieve the desired component performance. This optimization is followed by the necessary stepwise materials qualification. Furthermore, the increasing adoption of sound data management and physics-informed machine learning represents the next step in the acceleration of materials design and development. In the integrated computational materials engineering (ICME) approach, computational modeling and simulation data from different length and time scales can be combined with complex microstructural details from multimodal experimental characterization and selective property testing to close the design loop for rapid alloy development.

Computational Design Of Materials↗

Narrow structure in the coherent population trapping resonance in sodium

We present a detailed study of coherent population trapping (CPT) in the Hanle configuration in sodium atoms confined inside a glass cell and irradiated with a broadband multimode dye laser light resonant with the D{sub 1} line. The presence of several modes spaced by tens of MHz is effective in inhibiting hyperfine optical pumping, thus reducing losses and allowing for efficient trapping. A narrow resonance, whose width is of the order of 1 mG, is observed superimposed on the electromagnetically induced transparency (EIT) resonance. Such a structure is more than two orders of magnitude narrower than the broader one, with significantly reduced power broadening. In order to describe this phenomenon, we developed a theoretical model, based on numerical solutions of density matrix equations, which takes into account the peculiarity of CPT induced by broadband multimode laser light. Results are shown to be in very good agreement with the experimental data. In this framework, the small width and the small amount of power broadening exhibited by this narrow spectral structure are related to the time spent by the atoms to re-enter the laser beam volume after collisions that preserve the orientation. This study offers insight into the mechanisms of atoms depolarization caused by collisions with the cell walls and represents a starting point for the development of techniques for the diagnostics of cell-coating parameters and new applications in metrology and magnetometry.

74 ATOMIC AND MOLECULAR PHYSICS↗

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Instruction finetuning is a popular paradigm to align large language models (LLM) with human intent. Despite its popularity, this idea is less explored in improving the LLMs to align existing foundation models with scientific disciplines, concepts and goals. In this work, we present SciTune as a tuning framework to improve the ability of LLMs to follow scientific multimodal instructions. To test our methodology, we use a human-generated scientific instruction tuning dataset and train a large multimodal model LLaMA-SciTune that connects a vision encoder and LLM for science-focused visual and language understanding. LLaMA-SciTune significantly outperforms the state-of-the-art models in the generated figure types and captions in multiple scientific multimodal benchmarks. In comparison to the models that are fine-tuned with machine generated data only, LLaMA-SciTune surpasses human performance on average and in many sub-categories on the ScienceQA benchmark.

• Artificial intelligence (AI) / machine learning ↗

Numerical Analysis of the Sea State Bias for Satellite Altimetry

Theoretical understanding of the dependence of sea state bias (SSB) on wind wave conditions has been achieved only for the case of a unidirectional wind-driven sea. Recent analysis of Geosat and TOPEX altimeter data showed that additional factors, such as swell, ocean currents, and complex directional properties of realistic wave fields, may influence SSB behavior. Here we investigate effects of two-dimensional multimodal wave spectra using a numerical model of radar reflection from a random, non-Gaussian surface. A recently proposed ocean wave spectrum is employed to describe sea surface statistics. The following findings appear to be of particular interest: (1) Sea swell has an appreciable effect in reducing the SSB coefficient compared with the pure wind sea case but has less effect on the actual SSB owing to the corresponding increase in significant wave height. (2) Hidden multimodal structure (the two-dimensional wavenumber spectrum contains separate peaks, for swell and wind seas, while the frequency spectrum looks unimodal) results in an appreciable change of SSB. (3) For unimodal, purely wind-driven seas, the influence of the angular spectral width is relatively unimportant; that is, a unidirectional sea provides a good qualitative model for SSB if the swell is absent. (4) The pseudo wave age is generally much better fo parametrization the SSB coefficient than the actual wave age (which is ill-defined for a multimodal sea) or wind speed. (5) SSB can be as high as 5% of the significant wave height, which is significantly greater than predicted by present empirical model functions tuned on global data sets. (6) Parameterization of SSB in terms of wind speed is likely to lead to errors due to the dependence on the (in practice, unknown) fetch.

Glazman, R. E.↗

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

A Novel Framework for Multi-Path Data Fusion in Earth Observation and New Observing Strategies: Applications to Predicting Forest Canopy Height

Exponential growth of data from Earth Observation (EO) assets has necessitated the development of sophisticated methods for data interpretation and management. NASA’s New Observing Strategy (NOS) approach aims to coordinate operations among complex heterogenous systems of constellations, requiring advanced Artificial Intelligence and Machine Learning (AI/ML) techniques. Despite significant advancements in AI/ML across various domains, the EO and machine learning for satellite (SatML) fields remain fragmented, often relying on adapted techniques rather than domain-specific solutions. We present a novel end-to-end data fusion framework tailored specifically for EO and SatML, addressing this gap by facilitating rapid development of AI/ML applications. This framework, called, Multimodal Earth Observation Workflow for Machine Learning (MEOW-ML), sup- ports the entire AI/ML lifecycle, from dataset manipulation, to model training, evaluation, and logging, and is designed to expedite the development of next-generation NOS deployments and SOTA in EO. We apply our framework to predict canopy height model (CHM) derived from lidar data. We integrate multiple data modalities through a hierarchical, multi-path model architecture, effectively identifying and leveraging the unique strengths of each data source to enhance predictive accuracy. Our experiments demonstrate that the multi-path architecture outperforms traditional single-path models and provides significant advantages in both accuracy and computational efficiency.

Mark Moussa↗

Multimodal Friction Ignition Tester

The multimodal friction ignition tester (MFIT) is a testbed for experiments on the thermal and mechanical effects of friction on material specimens in pressurized, oxygen-rich atmospheres. In simplest terms, a test involves recording sensory data while rubbing two specimens against each other at a controlled normal force, with either a random stroke or a sinusoidal stroke having controlled amplitude and frequency. The term multimodal in the full name of the apparatus refers to a capability for imposing any combination of widely ranging values of the atmospheric pressure, atmospheric oxygen content, stroke length, stroke frequency, and normal force. The MFIT was designed especially for studying the tendency toward heating and combustion of nonmetallic composite materials and the fretting of metals subjected to dynamic (vibrational) friction forces in the presence of liquid oxygen or pressurized gaseous oxygen test conditions approximating conditions expected to be encountered in proposed composite material oxygen tanks aboard aircraft and spacecraft in flight. The MFIT includes a stainless-steel pressure vessel capable of retaining the required test atmosphere. Mounted atop the vessel is a pneumatic cylinder containing a piston for exerting the specified normal force between the two specimens. Through a shaft seal, the piston shaft extends downward into the vessel. One of the specimens is mounted on a block, denoted the pressure block, at the lower end of the piston shaft. This specimen is pressed down against the other specimen, which is mounted in a recess in another block, denoted the slip block, that can be moved horizontally but not vertically. The slip block is driven in reciprocating horizontal motion by an electrodynamic vibration exciter outside the pressure vessel. The armature of the electrodynamic exciter is connected to the slip block via a horizontal shaft that extends into the pressure vessel via a second shaft seal. The reciprocating horizontal motion can be chosen to be random with a flat spectrum over the frequency range of 10 Hz to 1 kHz, or to be sinusoidal at any peak-to-peak amplitude up to 0.8 in. (.2 cm) and fixed or varying frequency up to 1 kHz. The temperatures of the specimen and of the vessel are measured by thermocouples. A digital video camera mounted outside the pressure vessel is aimed into the vessel through a sapphire window, with its focus fixed on the interface between the two specimens. A position transducer monitors the displacement of the pneumatic-cylinder shaft. The pressure in the vessel is also monitored. During a test, the output of the video camera, the temperatures, and the pneumatic-shaft displacement are monitored and recorded. The test is continued for a predetermined amount of time (typically, 10 minutes) or until either (1) the output of the position transducer shows a sudden change indicative of degradation of either or both specimens, (2) ignition or another significant reaction is observed, or (3) pressure in the vessel increases beyond a pre-set level that triggers an automatic shutdown.

Davis, Eddie↗

Multimodal Chemical Imaging for Linking Adhesion with Local Chemistry in Agrochemical Multicomponent Polymeric Coatings

Seed coatings improve germination and offer higher crop yields through a blend of active ingredients (such as insecticides and fungicides), polymers, waxes, fillers, and pigments. To reach their full potential, fundamental formulation challenges bridging structure and function need to be addressed. In some instances, during industrial-volume packing and transportation, coated seeds do not flow well through elevators, conveyers, and applicators, which may reduce yield and add cost. In this work, we illustrate a combinatorial chemical imaging approach to study seed coatings at the microscale to link chemical and physical properties responsible for low seed flowability. The local chemical composition was examined using time-of-flight secondary ion mass spectrometry (ToF-SIMS) and at comparable length scales, the local adhesive properties were examined using atomic force microscopy (AFM) force volume mapping. The link between the chemical and the adhesive properties was established by non-negative matrix factorization (NMF). The correlative multimodal imaging approach developed here utilizing AFM force volume mapping, ToF-SIMS chemical mapping, and data analytics offers a path for linking function with localized chemistry when investigating multicomponent soft material systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The cardiac molecular setting of metabolic syndrome in pigs reveals disease susceptibility and suggests mechanisms that exacerbate COVID-19 outcomes in patients

Abstract Although metabolic syndrome (MetS) is linked to an elevated risk of cardiovascular disease (CVD), the cardiac-specific risk mechanism is unknown. Obesity, hypertension, and diabetes (all MetS components) are the most common form of CVD and represent risk factors for worse COVID-19 outcomes compared to their non MetS peers. Here, we use obese Yorkshire pigs as a highly relevant animal model of human MetS, where pigs develop the hallmarks of human MetS and reproducibly mimics the myocardial pathophysiology in patients. Myocardium-specific mass spectroscopy-derived metabolomics, proteomics, and transcriptomics enabled the identity and quality of proteins and metabolites to be investigated in the myocardium to greater depth. Myocardium-specific deregulation of pro-inflammatory markers, propensity for arterial thrombosis, and platelet aggregation was revealed by computational analysis of differentially enriched pathways between MetS and control animals. While key components of the complement pathway and the immune response to viruses are under expressed, key N6-methyladenosin RNA methylation enzymes are largely overexpressed in MetS. Blood tests do not capture the entirety of metabolic changes that the myocardium undergoes, making this analysis of greater value than blood component analysis alone. Our findings create data associations to further characterize the MetS myocardium and disease vulnerability, emphasize the need for a multimodal therapeutic approach, and suggests a mechanism for observed worse outcomes in MetS patients with COVID-19 comorbidity.

60 APPLIED LIFE SCIENCES↗

X-ray microscopy enables multiscale high-resolution 3D imaging of plant cells, tissues, and organs

Capturing complete internal anatomies of plant organs and tissues within their relevant morphological context remains a key challenge in plant science. While plant growth and development are inherently multiscale, conventional light, fluorescence, and electron microscopy platforms are typically limited to imaging of plant microstructure from small flat samples that lack a direct spatial context to, and represent only a small portion of, the relevant plant macrostructures. We demonstrate technical advances with a lab-based X-ray microscope (XRM) that bridge the imaging gap by providing multiscale high-resolution three-dimensional (3D) volumes of intact plant samples from the cell to the whole plant level. Serial imaging of a single sample is shown to provide sub-micron 3D volumes co-registered with lower magnification scans for explicit contextual reference. High-quality 3D volume data from our enhanced methods facilitate sophisticated and effective computational segmentation. Advances in sample preparation make multimodal correlative imaging workflows possible, where a single resin-embedded plant sample is scanned via XRM to generate a 3D cell-level map, and then used to identify and zoom in on sub-cellular regions of interest for high-resolution scanning electron microscopy. In total, we present the methodologies for use of XRM in the multiscale and multimodal analysis of 3D plant features using numerous economically and scientifically important plant systems.

59 BASIC BIOLOGICAL SCIENCES↗

Structural Dynamic Analysis of Spent Nuclear Fuel

This unlimited distribution milestone report is the deliverable for M2SF-19PN010202014. This report completes the modeling and analysis related to the Equipos Nucleares Sociedad Anónima/U.S. Department of Energy (ENSA/DOE) spent nuclear fuel (SNF) multimodal transportation test (MMTT) campaign performed in 2017. A previous report studied the shock and vibration data generated during the MMTT and determined effective modeling and analysis methodologies and strategies. This report completes the modeling and analysis activity by applying the structural dynamic analysis models and methods to the Atlas railcar system. This analysis demonstrates that the MMTT configuration provided a conservative, bounding shock and vibration environment for SNF in comparison to finite element model results that are configured to represent the Atlas railcar system and all of its SNF package combinations. Additionally, this report establishes a technical basis for recommending that no further analysis is necessary to demonstrate that SNF cladding will remain intact during shock and vibration loading conditions that occur during normal conditions of transportation (NCT). 10 CFR 71.71 defines package tests to demonstrate acceptable package performance under NCT conditions. The focus of this work is to demonstrate that SNF cladding will remain intact within the package while it is subjected to what 10 CFR 71.71 calls: Vibration normally incident to transport. The MMTT recorded negligible shock and vibrations on the SNF cladding during the test campaign, and this analysis supports the conclusion that intact fuel rods carried in any current SNF transportation package will experience similar, negligible, shock and vibration conditions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Robust Importance Sampling for Bayesian Model Calibration with Spatio-Temporal Data

This paper addresses two challenges in Bayesian calibration: 1) computational speed of existing sampling algorithms, and 2) calibration with spatio-temporal responses. The commonly used Markov Chain Monte Carlo (MCMC) approaches require many sequential model evaluations making the computational expense prohibitive. This paper proposes an efficient sampling algorithm: iterative importance sampling with genetic algorithm (IISGA). While iterative importance sampling enables computational efficiency, the genetic algorithm enables robustness by preventing sample degeneration and avoids getting stuck in multimodal search spaces. An inflated likelihood further enables robustness in high-dimensional parameter spaces by enlarging the target distribution. Spatio-temporal data complicate both surrogate modeling, which is necessary for expensive computational models, and the likelihood estimation. In this work, singular value decomposition is investigated for reducing the high-dimensional field data to a lower-dimensional space prior to Bayesian calibration. Then the likelihood is formulated and Bayesian inference is performed in the lower-dimension, latent space. An illustrative example is provided to demonstrate IISGA relative to existing sampling methods, and then IISGA is employed to calibrate a thermal battery model with 26 uncertain calibration parameters and spatio-temporal response data.

97 MATHEMATICS AND COMPUTING↗

Study of wavelength division multiplexing as a means of increasing the number of channels in multimode fiber optic communication links

A number of optical communication lines are now in use at the Kennedy Space Center (KSC) for the transmission of voice, computer data, and video signals. Presently, all of these channels utilize a single carrier wavelength centered near 1300 nm. The theoretical bandwidth of the fiber far exceeds the utilized capacity. Yet, practical considerations limit the usable bandwidth. The fibers have the capability of transmitting a multiplicity of signals simultaneously in each of two separate bands (1300 and 1550 nm). Thus, in principle, the number of transmission channels can be increased without installing new cable if some means of wavelength division multiplexing (WDM) can be utilized. The main goal of these experiments was to demonstrate that a factor of 2 increase in bandwidth utilization can share the same fiber in both a unidirectional configuration and a bidirectional mode of operation. Both signal and multimode fiber are installed at KSC. The great majority is multimode; therefore, this effort concentrated on multimode systems.

Bates, Harry↗

Reflection Effects in Multimode Fiber Systems Utilizing Laser Transmitters

A number of optical communication lines are now in use at NASA-Kennedy for the transmission of voice, computer data, and video signals. Now, all of these channels use a single carrier wavelength centered near 1300 or 1550 nm. Engineering tests in the past have given indications of the growth of systematic and random noise in the RF spectrum of a fiber network as the number of connector pairs is increased. This noise seems to occur when a laser transmitter is used instead of a LED. It has been suggested that the noise is caused by back reflections created at connector fiber interfaces. Experiments were performed to explore the effect of reflection on the transmitting laser under conditions of reflective feedback. This effort included computer integration of some of the instrumentation in the fiber optic lab using the Lab View software recently acquired by the lab group. The main goal was to interface the Anritsu Optical and RF spectrum analyzers to the MacIntosh II computer so that laser spectra and network RF spectra could be simultaneously and rapidly acquired in a form convenient for analysis. Both single and multimode fiber is installed at Kennedy. Since most are multimode, this effort concentrated on multimode systems.

Bates, Harry E.↗

MIDA: A Multimodal Imaging-Based Detailed Anatomical Model of the Human Head and Neck

Computational modeling and simulations are increasingly being used to complement experimental testing for analysis of safety and efficacy of medical devices. Multiple voxel- and surface-based whole- and partial-body models have been proposed in the literature, typically with spatial resolution in the range of 1–2 mm and with 10–50 different tissue types resolved. We have developed a multimodal imaging-based detailed anatomical model of the human head and neck, named “MIDA”. The model was obtained by integrating three different magnetic resonance imaging (MRI) modalities, the parameters of which were tailored to enhance the signals of specific tissues: i) structural T1- and T2-weighted MRIs; a specific heavily T2-weighted MRI slab with high nerve contrast optimized to enhance the structures of the ear and eye; ii) magnetic resonance angiography (MRA) data to image the vasculature, and iii) diffusion tensor imaging (DTI) to obtain information on anisotropy and fiber orientation. The unique multimodal high-resolution approach allowed resolving 153 structures, including several distinct muscles, bones and skull layers, arteries and veins, nerves, as well as salivary glands. The model offers also a detailed characterization of eyes, ears, and deep brain structures. A special automatic atlas-based segmentation procedure was adopted to include a detailed map of the nuclei of the thalamus and midbrain into the head model. The suitability of the model to simulations involving different numerical methods, discretization approaches, as well as DTI-based tensorial electrical conductivity, was examined in a case-study, in which the electric field was generated by transcranial alternating current stimulation. The voxel- and the surface-based versions of the models are freely available to the scientific community.

59 BASIC BIOLOGICAL SCIENCES↗

Multimodal correlative study of Hall transport and magnetic phases in Fe/Gd multilayer systems

The Fe/Gd multilayer system hosts a number of magnetic phases, such as stripe, mixed stripe and skyrmion, skyrmion lattice, and isolated skyrmions for a wide range of temperature and magnetic field. We report different Hall transport signals in a Fe/Gd system through multimodal correlative resonant soft x-ray scattering (RSXS), Hall effect, magneto-optic Kerr effect, and transmission x-ray microscopy measurements. The simultaneous nature of the RSXS and Hall transport measurements allowed us to accurately connect various features in the transport data with the specific magnetic phases. We found that the topological Hall effect (THE) shows peaks with opposite signs, which we attribute to two different mechanisms. Our multimodal correlative study indicates that the sign reversal in THE occurs when the system transforms to and from a skyrmion lattice and low density isolated skyrmion phases. We propose that the skyrmion lattice contributes to the THE through a Berry phase induced emergent magnetic field mechanism in one case, and a skew scattering mechanism corresponding to the isolated low density skyrmion state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗