Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Hollow-core microstructured ‘revolver’ fibre for the UV spectral range

We report the first silica-based hollow-core microstructured fibre for the UV spectral range, with a reflective cladding formed by a single ring of capillaries. The optical loss in the fibre at a wavelength of 250 nm is 3 dB m{sup −1}. We demonstrate distinctions between the propagation of high-order modes and the fundamental mode of the hollow core of a ‘revolver’ fibre with noncontacting cladding capillaries and examine the effect of multimode excitation on the transmission bandwidth of the fibre. Based on experimental data and numerical simulation results, we formulate recommendations how to reduce the level of losses and extend transmission bands in a hollow-core revolver fibre in the UV spectral range. (paper)

42 ENGINEERING↗

PACE OCI Short-Wave Infrared Detection Assembly Optical System Design, Alignment, and Environmental Test

The Ocean Color Instrument (OCI), which will be integrated with the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite, will collect science data that will be used to monitor the health of Earth’s oceans and atmosphere. The Short-Wave Infrared (SWIR) Detection Assembly (SDA), built and characterized by Utah State University Space Dynamics Laboratory (SDL), is a subsystem of OCI consisting of 32 channels covering seven discrete optical bands of interest. A total of 16 SWIR Detection Subassemblies (SDSs) compose the SDA and house the cold optical system. The science data optical input for each SDS is supplied by a 0.22 NA multimode fiber interfacing with a fiber adapter. The diverging light from the fiber is collimated, split by a dichroic beamsplitter to two separate channels, filtered by the science filter, and then reimaged onto the single-element detectors with a final 0.76 NA. Aspheric, diamond-turned powered elements are used throughout the optical design. Fabrication and alignment tolerance analysis/budgets are balanced to ensure the optical system meets throughput requirements. All systems are aligned at ambient temperature using an InSb camera and an in-line illumination microscope system to directly image the active detector area through the science filters. Compensators used during alignment are detector focus and decenter, which are adjusted via photoetched shims in increments of 25 µm. Average focus and centering errors were less than 8 µm among all 32 flight and 10 flight spare detectors. Each SDS spectral response and conversion gain was verified at operational temperature of -65°C in vacuum.

OCI↗

Transition from wall modes to multimodality in liquid gallium magnetoconvection

Coupled laboratory-numerical experiments of Rayleigh-Bénard convection in liquid gallium subject to a vertical magnetic field are presented. The experiments are carried out in two cylindrical containers with diameter-to-height aspect ratio Γ = 1.0 and 2.0 at varying thermal forcing (Rayleigh numbers 10 5 ≲ Ra ≲ 10 8 ) and magnetic field strength (Chandrasekhar numbers 0 ≲ Ch ≲ 3 × 10 5 ). Laboratory measurements and numerical simulations confirm that magnetoconvection in our finite cylindrical tanks onsets via nondrifting wall-attached modes, in good agreement with asymptotic predictions for a semi-infinite domain. With increasing supercriticality, the experimental and numerical thermal measurements and the numerical velocity data reveal transitions between wall mode states with different azimuthal mode numbers and between wall-dominated convection to wall and interior multimodality. These transitions are also reflected in the heat transfer data, which combined with previous studies connect onset to supercritical turbulent behaviors in liquid metal magnetoconvection over a large parameter space. The gross heat transfer behaviors between magnetoconvection and rotating convection in liquid metals are compared and discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Search for spinning black hole binaries in mock LISA data using a genetic algorithm

Coalescing massive black hole binaries are the strongest and probably the most important gravitational wave sources in the LISA band. The spin and orbital precessions bring complexity in the waveform and make the likelihood surface richer in structure as compared to the nonspinning case. We introduce an extended multimodal genetic algorithm which utilizes the properties of the signal and the detector response function to analyze the data from the third round of mock LISA data challenge (MLDC3.2). The performance of this method is comparable, if not better, to already existing algorithms. We have found all five sources present in MLDC3.2 and recovered the coalescence time, chirp mass, mass ratio, and sky location with reasonable accuracy. As for the orbital angular momentum and two spins of the black holes, we have found a large number of widely separated modes in the parameter space with similar maximum likelihood values.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Maven: a multimodal foundation model for supernova science

Abstract A common setting in astronomy is the availability of a small number of high-quality observations, and larger amounts of either lower-quality observations or synthetic data from simplified models. Time-domain astrophysics is a canonical example of this imbalance, with the number of supernovae observed photometrically outpacing the number observed spectroscopically by multiple orders of magnitude. At the same time, no data-driven models exist to understand these photometric and spectroscopic observables in a common context. Contrastive learning objectives, which have grown in popularity for aligning distinct data modalities in a shared embedding space, provide a potential solution to extract information from these modalities. We present Maven, the first foundation model for supernova science. To construct Maven, we first pre-train our model to align photometry and spectroscopy from 0.5 M synthetic supernovae using a contrastive objective. We then fine-tune the model on 4702 observed supernovae from the Zwicky transient facility. Maven reaches state-of-the-art performance on both classification and redshift estimation, despite the embeddings not being explicitly optimized for these tasks. Through ablation studies, we show that pre-training with synthetic data improves overall performance. In the upcoming era of the Vera C. Rubin observatory, Maven will serve as a valuable tool for leveraging large, unlabeled and multimodal time-domain datasets.

Zhang, Gemma (ORCID:0000000280198082)↗

Predictability as a probe of manifest and latent physics: The case of atomic scale structural, chemical, and polarization behaviors in multiferroic Sm-doped BiFeO 3

The predictability of a certain effect or phenomenon is often equated with the knowledge of relevant physical laws, typically understood as a functional or numerically derived relationship between the observations and known states of the system. Correspondingly, observations inconsistent with prior knowledge can be used to derive new knowledge on the nature of the system or indicate the presence of yet unknown mechanisms. In this work, we explore the applicability of Gaussian processes (GP) to establish predictability and uncertainty of local behaviors from multimodal observations, providing an alternative to this classical paradigm. Using atomic resolution scanning transmission electron microscopy (STEM) of multiferroic Sm-doped BiFeO 3 across a broad composition range, we directly visualize the atomic structure and structural, physical, and chemical order parameter fields for the material. GP regression is used to establish the predictability of the local polarization field from different groups of parameters, including the adjacent polarization values and several combinations of physical and chemical descriptors, including lattice parameters, column intensities, etc. We observe that certain elements of microstructure, including charged and uncharged domain walls and interfaces with the substrate, are best predicted with specific combinations of descriptors, and this predictability and associated uncertainties are consistent across the composition series. The associated generative physical mechanisms are discussed. It is also found that certain parameter combinations tend to predict the orthorhombic phase in the cases where rhombohedral phase is observed, suggesting a potential role of clamping and confinement phenomena in phase equilibrium in Sm-BiFeO 3 system close to morphotropic phase boundary. We argue that predictability and uncertainty in observational data offer a new pathway to probe the physics of condensed matter systems from multimodal local observations.

74 ATOMIC AND MOLECULAR PHYSICS↗

Interatomic Potentials Models for Cu-Ni and Cu-Zr Alloys

This study explores a Bayesian calibration framework for the RAMPAGE alloy potential model for Cu-Ni and Cu-Zr systems, respectively. In RAMPAGE potentials, it is proposed that once calibrated potentials for individual elements are available, the inter-species interactions can be described by fitting a Morse potential for pair interactions with three parameters, while densities for the embedding function can be scaled by two parameters from the elemental densities. Global sensitivity analysis tools were employed to understand the impact each parameter has on the MD simulation results. A transitional Markov Chain Monte Carlo algorithm was used to generate samples from the multimodal posterior distribution consistent with the discrepancy between MD simulation results and DFT data. For the Cu-Ni system the posterior predictive tests indicate that the fitted interatomic potential model agrees well with the DFT data, justifying the basic RAMPAGE assumptions. For the Cu-Zr system, where the phase diagram suggests more complicated atomic interactions than in the case of Cu-Ni, the RAMPAGE potential captured only a subset of the DFT data. The resulting posterior distribution for the 5 model parameters exhibited several modes, with each mode corresponding to specific simulation data and a suboptimal agreement with the DFT results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗

Multimodal information Management: Evaluation of Auditory and Haptic Cues for NextGen Communication Displays

Auditory communication displays within the NextGen data link system may use multiple synthetic speech messages replacing traditional ATC and company communications. The design of an interface for selecting amongst multiple incoming messages can impact both performance (time to select, audit and release a message) and preference. Two design factors were evaluated: physical pressure-sensitive switches versus flat panel "virtual switches", and the presence or absence of auditory feedback from switch contact. Performance with stimuli using physical switches was 1.2 s faster than virtual switches (2.0 s vs. 3.2 s); auditory feedback provided a 0.54 s performance advantage (2.33 s vs. 2.87 s). There was no interaction between these variables. Preference data were highly correlated with performance.

Begault, Durand R.↗

Utah FORGE: Well 16B(78)-32 DTS, RFS DSS Strain, and Absolute Strain Circulation Test Fiber Optic Data - August 2024

This dataset contains processed fiber optic measurements collected during the extended cross-well circulation test at the Utah FORGE site in August 2024. The data was acquired from the 16B(78)-32 well using distributed fiber optic sensing (DFOS) technology, including distributed temperature sensing (DTS) on multimode fiber and distributed strain sensing (DSS) measurements on single-mode fiber. The dataset includes Brillouin absolute strain, Rayleigh frequency shift (RFS) DSS strain change, RFS DSS strain change rate, and temperature (DTS) data, all stored in HDF5 format. Time coordinates are provided in UTC, and depth measurements are given in measured depth relative to the rotary kelly bushing (MD RKB) in feet. The spatial sampling on the RFS DSS strain data and the Brillouin Absolute Total Strain data is 20 cm and the spatial sampling on the DTS data is 1m. The dataset is accompanied by a report from Neubrex, which provides further documentation.

15 GEOTHERMAL ENERGY↗

Artificial generation of representative single Li-ion electrode particle architectures from microscopy data

Accurately capturing the architecture of single lithium-ion electrode particles is necessary for understanding their performance limitations and degradation mechanisms through multi-physics modeling. Information is drawn from multimodal microscopy techniques to artificially generate LiNi 0.5 Mn 0.3 Co 0.2 O 2 particles with full sub-particle grain detail. Statistical representations of particle architectures are derived from X-ray nano-computed tomography data supporting an ‘outer shell’ model, and sub-particle grain representations are derived from focused-ion beam electron backscatter diffraction data supporting a ‘grain’ model. A random field model used to characterize and generate the outer shells, and a random tessellation model used to characterize and generate grain architectures, are combined to form a multi-scale model for the generation of virtual electrode particles with full-grain detail. This work demonstrates the possibility of generating representative single electrode particle architectures for modeling and characterization that can guide synthesis approaches of particle architectures with enhanced performance.

36 MATERIALS SCIENCE↗

Used Nuclear Fuel Management Using the Next Generation System Analysis Model

The U.S. Department of Energy (DOE) is leading the National effort to manage the back end of the nuclear fuel cycle, encompassing the safe transportation, storage/staging, and/or eventual disposal of used nuclear fuel (UNF) and high-level radioactive waste. The Next Generation System Analysis Model (NGSAM) is DOE’s discrete-event, agent-based simulation tool designed to model the full life cycle of UNF from reactor discharge to final disposal. NGSAM supports the DOE Office of Spent Fuel and High-Level Waste Disposition by enabling a detailed, scenario-based analysis of logistics, infrastructure, and shipping strategies. NGSAM replaces legacy models with a modern, flexible platform built on Repast Simphony and enhanced by the Process Analysis Tool. NGSAM simulates the movement and interaction of individual fuel assemblies with system components such as canisters, casks, railcars, and facilities. The model integrates with the Java Transportation Operations Model to plan and execute transportation scenarios, supporting both constrained and unconstrained resource allocation. Key features include customizable allocation and acceptance algorithms, detailed facility-level operations, and a Quick Edit tool for rapid scenario adjustments. NGSAM supports multimodal transportation modeling (e.g. rail, road, barge) and provides comprehensive cost, schedule, and infrastructure data. NGSAM utilizes data from sources such as DOE’s STANDARDS UNF database and DOE’s Stakeholder Tool for Assessing Radioactive Transportation, while also allowing user-defined inputs for scenario customization. NGSAM enables stakeholders to evaluate complex UNF management strategies, assess system performance under varying assumptions, and inform decision making for future infrastructure investments. Its modular architecture and integration with other Integrated Waste Management System tools make it a critical asset for planning the safe and efficient disposition of the Nation’s growing UNF inventory.

Craig, Brian [Argonne National Laboratory (ANL)]↗

Development of a dynamic quality assurance testing protocol for multisite clinical trial DCE-CT accreditation

Purpose: Credentialing can have an impact on whether or not a clinical trial produces useful quality data that is comparable between various institutions and scanners. With the recent increase of dynamic contrast enhanced-computed tomography (DCE-CT) usage as a companion biomarker in clinical trials, effective quality assurance, and control methods are required to ensure there is minimal deviation in the results between different scanners and protocols at various institutions. This paper attempts to address this problem by utilizing a dynamic flow imaging phantom to develop and evaluate a DCE-CT quality assurance (QA) protocol.Methods: A previously designed flow phantom, capable of producing predictable and reproducible time concentration curves from contrast injection was fully validated and then utilized to design a DCE-CT QA protocol. The QA protocol involved a set of quantitative metrics including injected and total mass error, as well as goodness of fit comparison to the known truth concentration curves. An additional region of interest (ROI) sensitivity analysis was also developed to provide additional details on intrascanner variability and determine appropriate ROI sizes for quantitative analysis. Both the QA protocol and ROI sensitivity analysis were utilized to test variations in DCE-CT results using different imaging parameters (tube voltage and current) as well as alternate reconstruction methods and imaging techniques. The developed QA protocol and ROI sensitivity analysis was then applied at three institutions that were part of clinical trial involving DCE-CT and results were compared.Results: The inherent specificity of robustness of the phantom was determined through calculation of the total intraday variability and determined to be less than 2.2 ± 1.1% (total calculated output contrast mass error) with a goodness of fit (R{sup 2}) of greater than 0.99 ± 0.0035 (n= 10). The DCE-CT QA protocol was capable of detecting significant deviations from the expected phantom result when scanning at low mAs and low kVp in terms of quantitative metrics (Injected Mass Error 15.4%), goodness of fit (R{sup 2}) of 0.91, and ROI sensitivity (increase in minimum input function ROI radius by 146 ± 86%). These tests also confirmed that the ASIR reconstruction process was beneficial in reducing noise without substantially increasing partial volume effects and that vendor specific modes (e.g., axial shuttle) did not significantly affect the phantom results. The phantom and QA protocol were finally able to quickly (<90 min) and successfully validate the DCE-CT imaging protocol utilized at the three separate institutions of a multicenter clinical trial; thereby enhancing the confidence in the patient data collected.Conclusions: A DCE QA protocol was developed that, in combination with a dynamic multimodality flow phantom, allows the intrascanner variability to be separated from other sources of variability such as the impact of injection protocol and ROI selection. This provides a valuable resource that can be utilized at various clinical trial institutions to test conformance with imaging protocols and accuracy requirements as well as ensure that the scanners are performing as expected for dynamic scans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Far-field radiation of AFT turbofan noise

The far-field radiation from the end of an exhaust duct is studied using both approximate and exact methods. Experimental data of narrow-band tone noise from static tests are compared to a multimodal radiation pattern. It is pointed out that possibly the exhaust noise in the far-field is inherently more difficult to attenuate than an inlet noise using duct suppressors.

Rice, E. J.↗

Bellerophon Environment for Analysis of Materials (BEAM)

Improvements in scientific instrumentation allow imaging at mesoscopic to atomic length scales, many spectroscopic modes, and now--with the rise of multimodal acquisition systems and the associated processing capability--the era of multidimensional, informationally dense data sets has arrived. Technical issues in these combinatorial scientific fields are exacerbated by computational challenges best summarized as a necessity for drastic improvement in the capability to transfer, store, and analyze large volumes of data. The Bellerophon Environment for Analysis of Materials (BEAM) platform provides material scientists the capability to directly leverage the integrated computational and analytical power of High Performance Computing (HPC) to perform scalable data analysis and simulation and manage uploaded data files via an intuitive, cross-platform client user interface. This framework delivers authenticated, "push-button" execution of complex user workflows that deploy data analysis algorithms and computational simulations utilizing compute-and-data cloud infrastructures and HPC environments like Titan at the Oak Ridge Leadershp Computing Facility (OLCF).

Lingerfelt, Eric J↗

Anomalous cluster detection in spatiotemporal meteorological fields

Finding anomalous regions in spatiotemporal climate data is an important problem with a need for greater accuracy. The collective and contextual nature of anomalies (e.g., heat waves) coupled with the real‐valued, seasonal, multimodal, highly correlated, and gridded nature of climate variable observations poses a multitude of challenges. Existing anomaly detection methods have limitations in the specific setting of real‐valued areal spatiotemporal data. In this paper, we develop a method for extreme event detection in meteorological datasets that follows from well known distribution‐based anomaly detection approaches. The method models spatial and temporal correlations explicitly through a piecewise parametric assumption and generalizes the Mahalanobis distance across distributions of different dimensionalities. The result is an effective method to mine contiguous spatiotemporal anomalous regions from meteorological fields which improves upon the current standard approach in climatology. The proposed method has been evaluated on a real global surface temperature dataset and validated using historical records of extreme events.

Ramachandra, Bharathkumar↗

Calibration of time-of-flight cameras for accurate intraoperative surface reconstruction

Purpose: In image-guided surgery (IGS) intraoperative image acquisition of tissue shape, motion, and morphology is one of the main challenges. Recently, time-of-flight (ToF) cameras have emerged as a new means for fast range image acquisition that can be used for multimodal registration of the patient anatomy during surgery. The major drawbacks of ToF cameras are systematic errors in the image acquisition technique that compromise the quality of the measured range images. In this paper, we propose a calibration concept that, for the first time, accounts for all known systematic errors affecting the quality of ToF range images. Laboratory and in vitro experiments assess its performance in the context of IGS.Methods: For calibration the camera-related error sources depending on the sensor, the sensor temperature and the set integration time are corrected first, followed by the scene-specific errors, which are modeled as function of the measured distance, the amplitude and the radial distance to the principal point of the camera. Accounting for the high accuracy demands in IGS, we use a custom-made calibration device to provide reference distance data, the cameras are calibrated too. To evaluate the mitigation of the error, the remaining residual error after ToF depth calibration was compared with that arising from using the manufacturer routines for several state-of-the-art ToF cameras. The accuracy of reconstructed ToF surfaces was investigated after multimodal registration with computed tomography (CT) data of liver models by assessment of the target registration error (TRE) of markers introduced in the livers.Results: For the inspected distance range of up to 2 m, our calibration approach yielded a mean residual error to reference data ranging from 1.5 ± 4.3 mm for the best camera to 7.2 ± 11.0 mm. When compared to the data obtained from the manufacturer routines, the residual error was reduced by at least 78% from worst calibration result to most accurate manufacturer data. After registration of the CT data with the ToF data, the mean TRE ranged from 3.7 ± 2.1 mm for point-based and 5.7 ± 1.9 mm for surface-based registration for the best camera to 6.2 ± 3.4 and 11.1 ± 2.8 mm, respectively. Compared to data provided by the manufacturer, the mean TRE decreased by 8%–60% for point-based and by 18%–74% for surface-based registration.Conclusions: Using the proposed calibration approach improved the measurement accuracy of all investigated ToF cameras. Although evaluated in the context of intraoperative image acquisition, the proposed calibration procedure can easily be applied to other medical applications using ToF cameras, such as patient positioning or respiratory motion tracking in radiotherapy.

62 RADIOLOGY AND NUCLEAR MEDICINE↗