Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Deciphering electrocatalysts with multimodal operando approaches

Here, the electrocatalytic processes of a copper catalyst during nitrate electroreduction are unveiled by correlated operando microscopy and spectroscopy. Catalysts are vital to the modern chemical industry, yet their development has largely relied on trial-and-error approaches. Optimizing catalysts requires a fundamental understanding of their structure–chemical property behaviour under operational conditions. However, operando characterization remains challenging, especially for reactions occurring in the complex and dynamic liquid environments of electrochemical systems. Over the past decade, the rapid development of in situ and operando environmental transmission electron microscopy (ETEM) and microelectromechanical system (MEMS)-based closed-cell holders, enabling environmental studies within the vacuum environment of transmission electron microscopy (TEM), has substantively advanced understanding of heterogeneous catalysis, notably for gas-phase reactions. In situ ETEM enables the direct observation of the catalyst evolution in terms of structure, morphology and chemical state at the nano-to-atomic scale, providing insights into their correlation with catalytic performance.

36 MATERIALS SCIENCE↗

Scalable in situ non-destructive evaluation of additively manufactured components using process monitoring, sensor fusion, and machine learning

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. However, the current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques, which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. In this work, an in situ NDE (INDE) system was engineered to detect subsurface flaws detected in X-Ray Computed Tomography (XCT) directly from process monitoring data. A multilayer, multimodal data input allowed the INDE system to detect numerous subsurface flaws in the size range of 200–1000µm using a novel human-in-the-loop annotation procedure. Furthermore, a framework was established for generating probability-of-detection (POD) and probability-of-false-alarm (PFA) curves compliant with NDE standards by systematically comparing instances of detected subsurface flaws to post-build XCT data. Here, we also introduce for the first time in the AM in situ sensing literature the a 90/95 – the flaw size corresponding to a 90% detection rate on the lower 95% confidence interval of the POD curve. The INDE system successfully demonstrated POD capabilities commensurate with traditional NDE methods. Traditional ML performance metrics were also shown to be inadequate for assessing the ability of the INDE system’s flaw detection performance. It is the hope of the authors that future studies will adopt the POD and PFA approach outlined here to provide better insight into the utility of process monitoring for AM.

36 MATERIALS SCIENCE↗

Facile fabrication of 2D material multilayers and vdW heterostructures with multimodal microscopy and AFM characterization

Reliable transfer processes that enable manipulation of two-dimensional (2D) materials, e.g., transition metal dichalcogenides (TMDCs) and MXenes, from one substrate to another has been a necessity for successful device fabrication. Here, with both mechanical exfoliation and chemical vapor deposition (CVD) widely used, a versatile, clean, deterministic, and yet simple transfer technique is highly needed. To address such need, we developed a transfer method that takes advantage of wettability contrast between interfaces without the use of sacrificial layers or chemical processes. More importantly, a setup was developed to carry out this transfer method with high sample selectivity and fine control of the position and orientation of transferred TMDC crystals, a feature required for fabrication of the devices based on vertical 2D heterostructures. Using both exfoliated and CVD grown materials and subsequent atomic force microscopy (AFM), photoluminescence (PL), confocal Raman and tip enhanced Raman spectroscopy (TERS) characterization, we ascertained the quality of interfaces resulting from the transfer process while preserving excellent 2D material integrity. PL and TERS maps revealed nanometer-scale heterogeneities in the interfaces of fabricated heterostructures, which should enable further perfection of the transfer technique. TERS/TEPL information were employed to identify areas suitable for nanodevice fabrication, making the reported transfer and characterization methods ideal for making high quality assembly of 2D heterostructure more accessible, which should facilitate exploration of vertical 2D heterostructures for applications in electronics, batteries, solar cells, and twistronics.

2D material transfer↗

Multimodal and multiscale strengthening mechanisms in Al-Ni-Zr-Ti-Mn alloy processed by laser powder bed fusion additive manufacturing

The unique thermokinetics of laser-powder bed fusion additive manufacturing (L-PBFAM) has been exploited for development of a novel high-strength Al-Ni-Ti-Zr-Mn alloy. The addition of 0.5 wt% Mn leads to extraordinary improvement in ultimate tensile strength (502 MPa) and work hardening due to the activation of two Mn-induced strengthening mechanisms. First, by a bimodal particle strengthening effect due to Al 31 Mn 6 Ni 12 nano-quasi-crystal particles rejected in inter-dendritic spaces and fibrous Al 3 Ni eutectic dendritic channels, which predominately contributes to the strength improvement, and second by solid solution strengthening from remaining Mn entrapped in Al. These mechanisms supplement the particle strengthening effect imparted by coherent and incoherent Al 3 (Ti,Zr) co-precipitates present at melt pool boundaries, dislocation strengthening due to solidification induced strain, and Hall-Petch and backstress strengthening effect due to heterogenous grain size distribution occurring at various length scales. In conclusion, the solidification dynamics and hierarchical heat distribution that are associated with L-PBFAM resulted in complex spatial variations in these strengthening phenomena and were investigated via a high-throughput multiscale structure–property correlation that involved thermokinetic simulation, X-ray diffraction, high-resolution nanoindentation mapping, and site-specific transmission electron microscopy of the alloy.

36 MATERIALS SCIENCE↗

Advanced Facility Design and AI/ML Enabled Safeguards to Establish Secure, Economical Recycling of Fast Reactor Fuels (Final Scientific/Technical Report)

The project, "Advanced Facility Design and AI/ML Enabled Safeguards to Establish Secure, Economical Recycling of Fast Reactor Fuels," represents a significant advancement in nuclear fuel recycling technology. It integrates cutting-edge multimodal sensor fusion, machine learning (ML), and digital twin (DT) technologies to address challenges in material safeguarding, process optimization, and regulatory compliance for pyroprocessing facilities. This research has significantly enhanced the understanding of pyrochemical fuel recycling processes by developing innovative tools and methodologies. The Multimodal Safeguards Monitoring Unit (MSMU) combines electroanalytical techniques, Raman spectroscopy, and differential thermal analysis (DTA) to enable high-fidelity, near-real-time material accountancy measurements. Machine learning techniques, such as Long Short-Term Memory (LSTM) autoencoders, are utilized to detect anomalies in material balances and sensor data, improving the reliability of safeguards monitoring. Additionally, digital twin technology has been established to provide real-time system-level monitoring and diagnostics, integrating physics-based models with sensor data to optimize process safety and efficiency.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Thermodynamic processes induced by coherent radiation

It is shown by quantum statistics that under certain stated conditions the entropy of coherent radiation is zero and it is still negligible for multimode laser operation. This makes possible gas kinetic processes which, to a small extent, have already been observed or even utilized, but which can be greatly enhanced by an optimized choice of molecular structures and radiation conditions. Radiative cooling of gases is discussed in detail. The conditions for maximum heat withdrawal are derived, and it is proposed that the processes of cooling and relaxation heating can be sufficiently separated in time to achieve certain effects and thermodynamic cycles. One of these is the complete conversion, possible in principle, of coherent radiation into work. This concept is based on a heat pump process followed by heat-to-work conversion, the heat rejected being just equal to that withdrawn by radiation. The conditions for complete conversion turn out to be the same as for maximum heat withdrawal. The feasibility of these processes depends on the degree to which practical conditions can be met, and on the validity of certain assumptions which have to await experimental verification.

Garbuny, M.↗

Machine Learning for Joint Quality Control

The use of lightweight material combinations has been highly demanded in manufacturing automotive structures. However, making robust dissimilar material joints of such lightweight materials is still challenging. A significant barrier to achieving high-quality and repeatable joint performance is a deficient understanding of the relationship between the welding process, joint attributes, and joint performance. In this context, welding factors refer to material, equipment, environment, and process parameters, while joint features comprise specific microstructural attributes of the weld such as nugget size, heat affected zone (HAZ) topology, intermetallic layer thickness, and sheet thickness reduction. Joint performance is quantified in terms of strength (e.g., tensile shear, coach peel, cross-tension), weld size, and hardness, among other factors. While there have been many attempts to establish this process-structure-property relationship by developing a model derived from the associated physics and first principles, the complexity of the joining processes compounded by the complex interactions with different materials in an automotive assembly line environment, has hindered the usefulness of such attempts. The complexity is further exacerbated using different stacking materials, especially comprising dissimilar material combinations. In practice, the common approach has been the laborious process of creating welds, characterizing them, and then physically testing them through experimentation. With the emergence of artificial intelligence (AI) methods, an alternative pathway to eliciting the desired process-structure-property relationship at an accelerated pace is to use a data-driven approach by employing machine-learning (ML) techniques. This approach is benefitted by the availability of large streams of data, generated through years of research and testing by original equipment manufacturers, in the form of material, process, environmental, equipment, microstructural, and bulk-scale performance information from multimodal, multiscale sensors making measurements from laboratory-scale to production-scale processes. During Phase I efforts, which ended in fiscal year (FY) 2021, the Oak Ridge National Laboratory and Pacific Northwest National Laboratory (ORNL/PNNL) team demonstrated the effectiveness of different ML/AI frameworks in modeling complex relationships between resistance spot welding (RSW) process parameters, weld attributes, and joint properties using a subset of data from General Motors (GM). In FY 2022, the project team further refined and expanded their respective ML models to analyze additional welds with new weld stack-ups and materials to enhance the ML model predictive capability. ORNL extended its unified deep neural networks (DNN) ML training and prediction framework with new data streams of process parameters, and PNNL extended its model describing RSW process parameters’ associations with weld attributes. In FY 2023, the project team completed the development of the AI/ML architecture for analyzing aluminum/steel joints manufactured by GM via RSW and transitioned into the inline welding quality monitoring task for steel/steel RSW joints provided by GM.

36 MATERIALS SCIENCE↗

Multimodal analysis for human ex vivo studies shows extensive molecular changes from delays in blood processing

Multi-omic profiling of human peripheral blood is increasingly utilized to identify biomarkers and pathophysiologic mechanisms of disease. The importance of these platforms in clinical and translational studies led us to investigate the impact of delayed blood processing on the numbers and state of peripheral blood mononuclear cells (PBMC) and on the plasma proteome. Similar to previous studies, we show minimal effects of delayed processing on the numbers and general phenotype of PBMCs up to 18 hours. In contrast, profound changes in the single-cell transcriptome and composition of the plasma proteome become evident as early as 4 hours after blood draw. These reflect patterns of cellular activation across diverse cell types that lead to progressive distancing of the gene expression state and plasma proteome from native in situ biology. Differences accumulating during an overnight rest (18 hours) would confound relevant biologic variance related to many underlying disease states.

59 BASIC BIOLOGICAL SCIENCES↗

Real time quantitative imaging for semiconductor crystal growth, control and characterization

A quantitative real time image processing system has been developed which can be software-reconfigured for semiconductor processing and characterization tasks. In thermal imager mode, 2D temperature distributions of semiconductor melt surfaces (900-1600 C) can be obtained with temperature and spatial resolutions better than 0.5 C and 0.5 mm, respectively, as demonstrated by analysis of melt surface thermal distributions. Temporal and spatial image processing techniques and multitasking computational capabilities convert such thermal imaging into a multimode sensor for crystal growth control. A second configuration of the image processing engine in conjunction with bright and dark field transmission optics is used to nonintrusively determine the microdistribution of free charge carriers and submicron sized crystalline defects in semiconductors. The IR absorption characteristics of wafers are determined with 10-micron spatial resolution and, after calibration, are converted into charge carrier density.

Wargo, Michael J.↗

Effects of Type and Strength of Force Feedback on Movement Time in a Target Selection Task

Future cockpits will likely include new onboard technologies, such as cockpit displays of traffic information, to help support future flight deck roles and responsibilities. These new technologies may benefit from multimodal feedback to aid pilot information processing. The current study investigated the effects of multiple levels of force feedback on operator performance in an aviation task. Participants were presented with two different types of force feedback (gravitational and spring force feedback) for a discrete targeting task, with multiple levels of gain examined for each force feedback type. Approach time and time in target were recorded. Results suggested that the two highest levels of gravitational force significantly reduced approach times relative to the lowest level of gravitational force. Spring force level only affected time in target. Implications of these findings for the design of future cockpit displays will be discussed.

CDTI↗

On the Development of Order and Interfaces during the Growth of Ultrathin La 2 CuO 4 Films by Molecular Beam Epitaxy

While the atomic structure of interfaces in complex oxide heterostructures created by epitaxial growth has been investigated extensively, few studies have been conducted on how interfaces form and restructure at the initial stage of film growth. The dynamic aspects of the growth behavior can strongly influence the final interfacial atomic structure, which may lead to the emergence of interface-specific properties, such as the rise of interfacial superconductivity between certain Ruddlesden-Popper oxide materials. In this report, the structural development of La2CuO 4 thin films grown by molecular beam epitaxy on a LaSrAlO 4 substrate is investigated by X-ray diffraction measurements with rapid scans over a volume of reciprocal space. This method provides far more detailed information on interface formation than traditional fixed-point measurements. The results show that the atomic structure of the interface becomes fully established after just a single unit cell of growth. Interestingly, restructuring continues to occur within the topmost half to one unit cell of the film during the deposition process. However, diffraction intensity oscillations from both reflection high-energy electron and X-ray measurements stabilize only after the growth of two unit cells, indicating that the growth front morphology continues to evolve until the start of the third unit cell. This multimodal investigation provides insights into the atomic processes taking place during layered oxide interface formation, including the dynamical rearrangement of LaO and CuO 2 layers. Such information is not only relevant to the engineering and optimization of functional layer structures but can also be critical for ultrathin films.

36 MATERIALS SCIENCE↗

Reaction engineering: a lost (and found) art for a decarbonized future [Slides]

The heart (or, perhaps more appropriately, the stomach) of any chemical manufacturing process is the reactor, where chemical and physical transformations occur under precisely controlled conditions. For traditional industrial processes, the design, optimization and operation of chemical reactors are extremely well developed, drawing upon the principles of chemistry, physics, calculus and economics. However, new-age process concepts proposing to use "exotic" reactors and/or sustainable inputs (e.g., renewable carbon resources, electrons, photons, plasma) face a dearth of well documented reaction engineering principles & design practices that eclipses their rapid adoption. This presentation features two vignettes of (the return of) reaction engineering in sustainable process science, first in the valorization of lignin from biomass, and second in understanding multimodal catalyst deactivation in industrial-scale reactors within the Catofin process for propane dehydrogenation. Overall, this seminar seeks to educate student researchers on practical means of advancing laboratory reactor technologies towards commercial practice.

09 BIOMASS FUELS↗

A Workflow for Accelerating Multimodal Data Collection for Electrodeposited Films

Abstract Future machine learning strategies for materials process optimization will likely replace human capital-intensive artisan research with autonomous and/or accelerated approaches. Such automation enables accelerated multimodal characterization that simultaneously minimizes human errors, lowers costs, enhances statistical sampling, and allows scientists to allocate their time to critical thinking instead of repetitive manual tasks. Previous acceleration efforts to synthesize and evaluate materials have often employed elaborate robotic self-driving laboratories or used specialized strategies that are difficult to generalize. Herein we describe an implemented workflow for accelerating the multimodal characterization of a combinatorial set of 915 electroplated Ni and Ni–Fe thin films resulting in a data cube with over 160,000 individual data files. Our acceleration strategies do not require manufacturing-scale resources and are thus amenable to typical materials research facilities in academic, government, or commercial laboratories. The workflow demonstrated the acceleration of six characterization modalities: optical microscopy, laser profilometry, X-ray diffraction, X-ray fluorescence, nanoindentation, and tribological (friction and wear) testing, each with speedup factors ranging from 13–46x. In addition, automated data upload to a repository using FAIR data principles was accelerated by 64x.

36 MATERIALS SCIENCE↗

Multimodal Defect Imaging of Pure Tungsten Components Fabricated via Electron Beam Powder Bed Fusion

The utilization of additive manufacturing (AM) techniques for refractory materials in high-temperature environments has significantly expanded because of the ability to fabricate geometrically complex components. Electron beam powder bed fusion (EB-PBF), which provides lower residual stress, a cleaner vacuum environment, and better efficiency for high melting point, is one of the best-suited AM methods to produce advanced refractory components. However, the property variation attributed to the heterogeneous microstructure and process-induced defects has hindered the widespread adoption of EB-PBF-produced material like tungsten. While numerous in-situ monitoring and defect detection methods have been demonstrated for EB-PBF, a workflow that compares and evaluates process-induced abnormalities from different imaging perspectives is still limited. This study examines a feature-embedded tungsten component manufactured via the EB-PBF process to demonstrate the defect detection capabilities of a multimodal defect imaging workflow. The predefined and process-induced defects are evaluated by harnessing various imaging techniques, including in-situ electron imaging, layerwise near-infrared (NIR) imaging, post-build high-energy x-ray computed tomography (CT), and conventional destructive metallography. The results highlight the strengths and limitations of distinctive defect imaging techniques concerning specific defect types, sizes, and conditions. It was found that electron imaging can provide more abnormal detection capabilities while maintaining a higher measuring accuracy, against the conventional metallography in this case study, compared with NIR and CT imaging techniques.

36 MATERIALS SCIENCE↗

Single-molecule imaging of lignocellulose deconstruction by SCATTIRSTORM microscopy

The goal of this project is to build a multimodal optical microscope to measure the binding, processive degradation, and pausing behaviors of cellulases as they interact with and degrade both synthetic and naturally occurring lignocellulosic walls. To achieve this, we will use high spatio-temporal single-molecule imaging to track cellulases, while visualizing specific molecular components of cellulose, lignin and hemicellulose, that make up their lignocellulose substrate. The microscope will combine Interferometric Scattering (iSCAT), which provides unprecedented spatiotemporal resolution; Total Internal Reflection Fluorescence (TIRF), which provides single-molecule resolution of multiple fluorophore-labeled molecules; and Stochastic Reconstruction (STORM), which allows for three-dimensional super-resolution imaging of intact plant cell walls during degradation. Initial studies will investigate cellulase dynamics on in vitro-assembled cell wall analogs, and later work will progress to using native plant cell walls.

09 BIOMASS FUELS↗

Magellan imaging radar mission to Venus

The Magellan imaging-radar mapping mission has collected and processed data from the spacecraft in an elliptical orbit around Venus. A brief description is given of the mission and the spacecraft, followed by a more detailed description of the radar system design, which used earth-orbiting SAR experience and several innovations in its design to operate from an orbit around another planet. The radar sensor, ground processing, and data products are described. This multimode radar is the only science instrument on the mission and has the objective of mapping at least 70 percent of the planet surface. It has three modes: SAR, altimetry, and passive radiometry. The radar system has produced maps of almost all of the Venusian surface with a resolution better than 600-m equivalent optical line pair, and the best resolution obtained is equivalent to less than 300 m. Some of the early radar images are shown.

Johnson, William T. K.↗

Prediction of Cognitive States During Flight Simulation Using Multimodal Psychophysiological Sensing

The Commercial Aviation Safety Team found the majority of recent international commercial aviation accidents attributable to loss of control inflight involved flight crew loss of airplane state awareness (ASA), and distraction was involved in all of them. Research on attention-related human performance limiting states (AHPLS) such as channelized attention, diverted attention, startle/surprise, and confirmation bias, has been recommended in a Safety Enhancement (SE) entitled "Training for Attention Management." To accomplish the detection of such cognitive and psychophysiological states, a broad suite of sensors was implemented to simultaneously measure their physiological markers during a high fidelity flight simulation human subject study. Twenty-four pilot participants were asked to wear the sensors while they performed benchmark tasks and motion-based flight scenarios designed to induce AHPLS. Pattern classification was employed to predict the occurrence of AHPLS during flight simulation also designed to induce those states. Classifier training data were collected during performance of the benchmark tasks. Multimodal classification was performed, using pre-processed electroencephalography, galvanic skin response, electrocardiogram, and respiration signals as input features. A combination of one, some or all modalities were used. Extreme gradient boosting, random forest and two support vector machine classifiers were implemented. The best accuracy for each modality-classifier combination is reported. Results using a select set of features and using the full set of available features are presented. Further, results are presented for training one classifier with the combined features and for training multiple classifiers with features from each modality separately. Using the select set of features and combined training, multistate prediction accuracy averaged 0.64 +/- 0.14 across thirteen participants and was significantly higher than that for the separate training case. These results support the goal of demonstrating simultaneous real-time classification of multiple states using multiple sensing modalities in high fidelity flight simulators. This detection is intended to support and inform training methods under development to mitigate the loss of ASA and thus reduce accidents and incidents.

Harrivel, Angela R.↗

Multimode Acoustic Research

There is a need for high temperature containerless processing facilities that can efficiently position and manipulate molten samples in the reduced gravity environment of space. The goal of the research is to develop sophisticated high temperature manipulation capabilities such as selection of arbitrary axes rotation and rapid sample cooling. This program will investigate new classes of acoustic levitation in rectangular, cylindrical and spherical geometries. The program tasks include calculating theoretical expressions of the acoustic forces in these geometries for the excitation of up to three acoustic modes (multimodes). These calculations are used to: (1) determine those acoustic modes that produce stable levitation, (2) isolate the levitation and rotation capabilities to produce more than one axis of rotation, and (3) develop methods to translate samples down long tube cylindrical chambers. Experimental levitators will then be constructed to verify the stable levitation and rotation predictions of the models.

Barmatz, M.↗