Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

MicroComputed Tomography: Methodology and Applications

Due to the availability of commercial laboratory systems and the emergence of user facilities at synchrotron radiation sources, studies of microcomputed tomography or microCT have increased exponentially. MicroComputed Technology provides a complete introduction to the technology, describing how to use it effectively and understand its results. The first part of the book focuses on methodology, covering experimental methods, data analysis, and visualization approaches. The second part addresses various microCT applications, including porous solids, microstructural evolution, soft tissue studies, multimode studies, and indirect analyses. The author presents a sufficient amount of fundamental material so that those new to the field can develop a relative understanding of how to design their own microCT studies. One of the first full-length references dedicated to microCT, this book provides an accessible introduction to field, supplemented with application examples and color images.

43 PARTICLE ACCELERATORS↗

Local and transient nanoscale strain mapping during in situ deformation

The mobility of defects such as dislocations controls the mechanical properties of metals. This mobility is determined both by the characteristics of the defect and the material, as well as the local stress and strain applied to the defect. Therefore, the knowledge of the stress and strain during deformation at the scale of defects is important for understanding fundamental deformation mechanisms. In this paper, we demonstrate a method of measuring local stresses and strains during continuous in situ deformation with a resolution of a few nanometers using nanodiffraction strain mapping. Finally, our results demonstrate how large multidimensional data sets captured with high speed electron detectors can be analyzed in multiple ways after an in situ TEM experiment, opening the door for true multimodal analysis from a single electron scattering experiment.

36 MATERIALS SCIENCE↗

Possibility of an integrated transmission electron microscope: enabling complex in-situ experiments

Abstract Multimodal in-situ experiments are the wave of the future, as this approach will permit multispectral data collection and analysis during real-time nanoscale observation. In contrast, the evolution of technique development in the electron microscopy field has generally trended toward specialization and subsequent bifurcation into more and more niche instruments, creating a challenge for reintegration and backward compatibility for in-situ experiments on state-of-the-art microscopes. We do not believe this to be a requirement in the field; therefore, we propose an adaptive instrument that is designed to allow nearly simultaneous collection of data from aberration-corrected transmission electron microscopy (TEM), probe-corrected scanning transmission electron microscopy, ultrafast TEM, and dynamic TEM with a flexible in-situ testing chamber, where the entire instrument can be modified as future technologies are developed. The value would be to obtain a holistic understanding of the underlying physics and chemistry of the process-structure–property relationships in materials exposed to controlled extreme environments. Such a tool would permit the ability to explore, in-situ, the active reaction mechanisms in a controlled manner emulating those of real-world applications with nanometer and nanosecond resolution. If such a powerful tool is developed, it has the potential to revolutionize our materials understanding of nanoscale mechanisms and transients. Graphical Abstract

36 MATERIALS SCIENCE↗

A Phase II Study of Preradiotherapy Chemotherapy Followed by Hyperfractionated Radiotherapy for Newly Diagnosed High-Risk Medulloblastoma/Primitive Neuroectodermal Tumor: A Report From the Children's Oncology Group (CCG 9931)

Purpose: To verify feasibility and monitor progression-free survival and overall survival in children with high-risk medulloblastoma and noncerebellar primitive neuroectodermal tumors (PNETs) treated in a Phase II study with preradiotherapy chemotherapy (CHT) followed by high-dose, hyperfractionated craniospinal radiotherapy (CSRT). Methods and Materials: Eligibility criteria included age >3 years at diagnosis, medulloblastoma with either high M stage and/or >1.5 cm{sup 2} postoperative residual disease, and all patients with noncerebellar PNET. Treatment was initiated with five alternating monthly cycles of CHT (A [cisplatin, cyclophosphamide, etoposide, and vincristine], B [carboplatin and etoposide], A, B, and A) followed by hyperfractionated CSRT (40 Gy) with a boost to the primary tumor (72 Gy) given in twice-daily 1-Gy fractions. Results: The valid study group consisted of 124 patients whose median age at diagnosis was 7.8 years. Eighty-four patients (68%) completed the entire protocol according to study guidelines (within 9 months), and the median time to complete CSRT was 1.6 months. Major reasons for failure to complete CHT included progressive disease (17%) and toxic death (2.4%). The 5-year progression-free survival and overall survival rates were 43% {+-} 5% and 52% {+-} 5%, respectively. No significant differences were detected in subset analysis related to response to CHT, site of primary tumor, postoperative residual disease, or M stage. Conclusions: The feasibility of this intensive multimodality protocol was confirmed, and response to pre-RT CHT did not impact on survival. Survival data from this protocol can not be compared with data from other studies, given the protocol design.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

The Zwicky Transient Facility Bright Transient Survey. III. BTSbot: Automated Identification and Follow-up of Bright Transients with Deep Learning

Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.

Rehemtulla, Nabeel (ORCID:0000000256832389)↗

SIR-C, the next generation spaceborne SAR

SIR-C represents a significant advance in spaceborne SAR system capabilities. The design approach is responsive to the requirements identified by the Science Steering Committee. This multimode feature of the sensor will provide science investigators with new dimensions in acquiring and interpreting scientific data. The flexibility of the SIR-C design will provide a core instrument which will meet the needs of SAR data users into the 1990's and serve as a foundation for ultimate incorporation into the EOS platform.

Caro, E. R.↗

Dynamic Anomaly Response and Integrated Analysis (DARIA): A Fault Investigation Toolset Supporting Earth-Independent Operations in Future Crewed Mars Missions

NASA's Moon to Mars Objectives outline a strategic vision for human spaceflight culminating in crewed missions to Mars. A critical component of this objective is the development of systems that are capable of being Earth-Independent Operated (EIO). A key aspect of EIO is the ability to rapidly detect, diagnose, and respond to anomalies in crew-supporting habitat and connected systems. To address this, the Dynamic Anomaly Response and Integrated Analysis (DARIA) architecture has been developed. DARIA incorporates a network of compact, wireless sensing devices called the System for Telemetry Amalgamation of Multimodal PrognosticS (STAMPS) for increased state awareness of EIO habitats. Able to perform on-the-fly data acquisition, STAMPS are connected to integrated anomaly data dashboards for crew visualization. DARIA is designed to seamlessly integrate into various off-world environments, including the International Space Station, Lunar Gateway, Artemis Base Camp, and future Mars habitats. By leveraging Commercial Off-The-Shelf (COTS) hardware, the NASA Internet of Things (NASA IoT) framework, and EIO fault detection methods, DARIA provides a cost-effective and adaptable solution for anomaly detection and response in EIO habitats.

Diagnostics↗

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗

Computed Tomography Scans of Naturally Mineralized Fractures in Upper Wolfcamp Shale

Computed tomography scans of fractures in small samples of Wolfcamp Shale from the Permian Basin and a depth of approximately 10,400 feet that have been cemented through natural processes. These samples were CT scanned at NETL. The data sets compliment the manuscript by Hajirezaie et al entitled "Mineral characterization of a sealed fracture: A multiscale multimodal imaging study of a syntaxial vein"

Computed Tomography↗

Review of composite propellant burn rate modeling

Steady-state combustion modeling of composite solid propellants is discussed with emphasis on the Beckstead-Derr-Price (BDP) model. The BDP model and some revisions are considered with respect to the analysis of monomodal ammonium perchlorate/inert binder propellants: topics examined include continuity relations, surface area relations, characteristic surface dimension, flame heights, and energy balance. Application of the BDP model to more complicated propellants containing multiple active ingredients is described. These propellants include multimodal, mixed oxidizer, active binder, aluminized, catalyzed, and nitramine propellants. Example cases of modeling (with comparison to experimental data) are presented, and strengths and weaknesses of current modeling approaches are evaluated.

Cohen, N. S.↗

An improved model for the combustion of AP composite propellants

This paper presents several improvements to the BDP model of steady-state burning of AP composite solid propellants. The Price-Boggs-Derr model of AP monopropellant burning is incorporated to represent the AP. A separate energy equation is written for the binder to permit a different surface temperature from the AP; this includes an analysis of the sharing of primary diffusion flame energy, and correction of a BDP model inconsistency in treating the binder regression rate. A method for assembling component contributions to calculate the burning rates of multimodal propellants is also presented. Results are shown in the form of representative burning rate curves, comparisons with data, and calculated internal details of interest. Ideas for future work are discussed in an Appendix.

Cohen, N. S.↗

Investigation of Liner Axial Displacement in a Complex Acoustic Environment

This paper investigates the effects of axial liner displacement on modal attenuation and scattering. Tests are conducted with a uniform liner mounted in the NASA Langley Curved Duct Test Rig, with a multimode source at flow conditions of Mach 0.0 and 0.3. The impedance of the liner is educed from data acquired in the NASA Langley Grazing Flow Impedance Tube. This impedance is then used as input to the CDUCT-LaRC propagation code to enable comparisons of predicted and measured modal content upstream and downstream of the liner as the axial displacement is varied. Results show that the liner position has a clear effect on the sound field as the number of modes is increased from two to six. The comparison of measured and predicted modal content is very good when only a few modes are present. For frequencies in which more modes are present, this comparison is less favorable very near resonance, but improves for frequencies away from resonance.

Brown, M. C.↗

Venus Radar Mapper (VRM) - Multimode radar system design

The paper describes the radar design of the Venus Radar Mapper (VRM), which is intended to acquire global radar imaging and altimetry data of the Venus surface. The radar design requirements are satisfied through the use of an existing Voyager antenna for the SAR function and newly developed sensor and altimeter antenna subsystems. The sensor utilizes a block adaptive quantizer to maximize science data return with minimum transmission of radar data back to earth.

Johnson, William T. K.↗

Multimodal hyperspectral optical microscopy

We describe a unique and convenient approach to multimodal hyperspectral optical microscopy, herein achieved by coupling a portable and transferable hyperspectral imager to various optical microscopes. The experimental and data analysis schemes involved in recording spectrally and spatially resolved fluorescence, dark field, and optical absorption micrographs are illustrated through prototypical measurements targeting selected model systems. Namely, hyperspectral fluorescence micrographs of isolated fluorescent beads are employed to ensure spectral calibration of our detector and to gauge the attainable spatial resolution of our measurements; the recorded images are diffraction-limited. Moreover, spatially over-sampled absorption spectroscopy of a single lipid (18:1 Liss Rhod PE) layer reveals that optical densities on the order of 10-3 may be resolved by spatially averaging the recorded optical signatures. We also briefly illustrate two applications of our setup in the general areas of plasmonics and cell biology. Most notably, we deploy hyperspectral optical absorption microscopy to identify and image algal pigments within a single live Tisochrysis lutea cell. Overall, this work paves the way for multimodal multidimensional spectral imaging measurements spanning the realms of several scientific disciples.

47 OTHER INSTRUMENTATION↗

Materials for multifunctional balloon catheters with capabilities in cardiac electrophysiological mapping and ablation therapy

Developing advanced surgical tools for minimally invasive procedures represents an activity of central importance to improving human health. A key challenge is in establishing biocompatible interfaces between the classes of semiconductor device and sensor technologies that might be most useful in this context and the soft, curvilinear surfaces of the body. Furthermore, this paper describes a solution based on materials that integrate directly with the thin elastic membranes of otherwise conventional balloon catheters, to provide diverse, multimodal functionality suitable for clinical use. As examples, we present sensors for measuring temperature, flow, tactile, optical and electrophysiological data, together with radiofrequency electrodes for controlled, local ablation of tissue. Use of such ‘instrumented’ balloon catheters in live animal models illustrates their operation, as well as their specific utility in cardiac ablation therapy. The same concepts can be applied to other substrates of interest, such as surgical gloves.

36 MATERIALS SCIENCE↗

Advancing Industry 4.0: Multimodal Sensor Fusion for AI-Based Fault Detection in 3D Printing

Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle clogging, filament runout, and layer misalignment, which compromise print quality and reliability. Traditional inspection methods are costly, time-intensive, and often limited to post-process analysis, making them unsuitable for real-time intervention. In this current study, the authors developed a novel, low-cost, and portable faultdetection system that leverages multimodal sensor fusion and artificial intelligence for real-time monitoring in FDM-based 3D printing. The system integrates acoustic, vibration, and thermal sensing into a non-intrusive architecture, capturing complementary data streams that reflect both mechanical and process-related anomalies. Acoustic and thermal sensors operate in a fully contactless manner, while the vibration sensor requires minimal attachment such that it will not interfere with printer hardware, thereby preserving portability and ease of deployment. The multimodal signals are processed into spectrograms and time-frequency features, which are classified using convolutional neural networks for intelligent fault detection. The proposed system advances Industry 4.0 objectives by offering an affordable, scalable, and practical monitoring solution that improves faultdetection accuracy, reduces waste, and supports sustainable, adaptive manufacturing.

42 ENGINEERING↗

Ab initio modeling of molecular IR spectra of astrophysical interest: application to CH 4

Aims. We describe an ab initio-based numerical method of obtaining infrared spectroscopic data (line list) of polyatomic molecules that allows calculation of complete sets of lines for temperatures up to several thousand Kelvin.While the main focus is on completeness and consistency, not spectroscopic accuracy, the approach is in principle “exact” for line positions and, although not exact for line strengths, of sufficient accuracy to be of value, especially in wavelength regions where there are gaps in reliable experimental data. Methods. Global potential energy and dipole moment hypersurfaces are fitted to the results of ab initio electronic structure calculations. The MULTIMODE software is then used to obtain rovibrational energy levels and dipole transition matrix elements. This information is used to calculate a complete set of Einstein coefficients of spontaneous emission Ai j. Results. The method is applied to obtain a spectroscopic database for methane containing over 1.4 million lines up to an upper state energy of 6200 cm -1 (~9000 K). The emission spectrum of CH4 at 1000 K is calculated with the complete set of Einstein coefficients and compared with the one obtained from the HITRAN database. Gaps in the database are realistically filled in by the calculated spectrum. Conclusions. Consistent and complete databases are important for astrophysical applications. Databases obtained by the method described here fulfill this requirement and are sufficiently accurate for astrophysical applications such as model atmosphere calculations and the corresponding synthetic spectra.

74 ATOMIC AND MOLECULAR PHYSICS↗

Machine Learning for Joint Quality Control

The use of lightweight material combinations has been highly demanded in manufacturing automotive structures. However, making robust dissimilar material joints of such lightweight materials is still challenging. A significant barrier to achieving high-quality and repeatable joint performance is a deficient understanding of the relationship between the welding process, joint attributes, and joint performance. In this context, welding factors refer to material, equipment, environment, and process parameters, while joint features comprise specific microstructural attributes of the weld such as nugget size, heat affected zone (HAZ) topology, intermetallic layer thickness, and sheet thickness reduction. Joint performance is quantified in terms of strength (e.g., tensile shear, coach peel, cross-tension), weld size, and hardness, among other factors. While there have been many attempts to establish this process-structure-property relationship by developing a model derived from the associated physics and first principles, the complexity of the joining processes compounded by the complex interactions with different materials in an automotive assembly line environment, has hindered the usefulness of such attempts. The complexity is further exacerbated using different stacking materials, especially comprising dissimilar material combinations. In practice, the common approach has been the laborious process of creating welds, characterizing them, and then physically testing them through experimentation. With the emergence of artificial intelligence (AI) methods, an alternative pathway to eliciting the desired process-structure-property relationship at an accelerated pace is to use a data-driven approach by employing machine-learning (ML) techniques. This approach is benefitted by the availability of large streams of data, generated through years of research and testing by original equipment manufacturers, in the form of material, process, environmental, equipment, microstructural, and bulk-scale performance information from multimodal, multiscale sensors making measurements from laboratory-scale to production-scale processes. During Phase I efforts, which ended in fiscal year (FY) 2021, the Oak Ridge National Laboratory and Pacific Northwest National Laboratory (ORNL/PNNL) team demonstrated the effectiveness of different ML/AI frameworks in modeling complex relationships between resistance spot welding (RSW) process parameters, weld attributes, and joint properties using a subset of data from General Motors (GM). In FY 2022, the project team further refined and expanded their respective ML models to analyze additional welds with new weld stack-ups and materials to enhance the ML model predictive capability. ORNL extended its unified deep neural networks (DNN) ML training and prediction framework with new data streams of process parameters, and PNNL extended its model describing RSW process parameters’ associations with weld attributes. In FY 2023, the project team completed the development of the AI/ML architecture for analyzing aluminum/steel joints manufactured by GM via RSW and transitioned into the inline welding quality monitoring task for steel/steel RSW joints provided by GM.

36 MATERIALS SCIENCE↗