Nonnegative matrix factorization-based blind source separation for full-field and high-resolution modal identification from video
Not Available
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not Available
Explore the source record for details and available documents.
Explore the source record for details and available documents.
To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.
Accurate estimation of offshore wind turbine (OWT) modal parameters has a prominent effect on the design loads, lifetime prediction, and dynamic response of the system. Modal parameters can vary during the operation of OWTs. This paper studies the variation and sensitivity analysis of an OWT’s modal parameters with respect to operational and environmental conditions. Three finite element models of a jacket-supported OWT at the Block Island Wind Farm are created within the OpenSees, SAP2000, and OpenFAST platforms and validated using experimental measurements. The OpenFAST model is used to simulate the modal parameters of the turbine under various wind speed, rotor speed, power, yaw angle, mean sea level, blade pitch angle, and soil spring values. The model-predicted modal parameters of the first fore–aft (FA) and side–side (SS) modes are compared to those identified from experimental measurements. Results from the simulations show that the first FA natural frequency and damping ratio mostly depend on the rotor speed and wind speed, respectively, while yaw angle and mean sea level do not have a visible effect. It is observed that there is about 8% stiffening in the first FA frequency and an aerodynamic damping of 7.5% during the operation of the OWT.
Here, we present modal-based methods for model calibration in structural dynamics, and address several key challenges in the solution of gradient-based optimization problems with eigenvalues and eigenvectors, including the solution of singular Helmholtz problems encountered in sensitivity calculations, non-differentiable objective functions caused by mode swapping during optimization, and cases with repeated eigenvalues. Unlike previous literature that relied on direct solution of the eigenvector adjoint equations, we present a parallel iterative domain decomposition strategy (Adjoint Computation via Modal Superposition with Truncation Augmentation) for the solution of the singular Helmholtz problems. For problems with repeated eigenvalues we present a novel Mode Separation via Projection algorithm, and in order to address mode swapping between inverse iterations we present a novel Injective mode ordering metric. We present the implementation of these methods in a massively parallel finite element framework with the ability to use measured modal data to extract unknown structural model parameters from large complex problems. A series of increasingly complex numerical examples are presented that demonstrate the implementation and performance of the methods in a massively parallel finite element framework [7], [5], using gradient-based optimization techniques in the Rapid Optimization Library (ROL) [21].
The electric power grid is undergoing a tremendous transformation due to the increasing penetration of renewable energy resources beginning with wind and more recently with the distributed energy resources (DERs) such as solar and battery storage. DERs have dramatically changed the role of the distribution systems in the overall power grid, and they are expected to contribute a significant portion of power generation in the future. If current trends for DERs continue, system operation and control will need to change dramatically for improved grid reliability and resiliency. As renewable resources increase in penetration, new and challenging operational, planning, and design problems are expected to emerge. Some of the key challenges that arise in the planning and operation of the future grid are: 1) Quantifying the impact of high DER penetration in distribution systems on bulk grid behavior over multiple time scales. 2) Identifying whether a particular DER configuration/settings have a large impact on the overall grid behavior. These challenges can be addressed in an offline manner using detailed T&D grid models and they can also be addressed in an online manner using sensor measurements. In particular, the advancement and planned growth in sensor technology in power grid over various voltage levels provide us with a unique opportunity to tackle these challenges from a data analytic perspective without needing detailed T&D grid models. A few questions that naturally arise when addressing the challenges from DERs using sensor data are: 1) How can we use limited sensor measurements to monitor & control voltage stability and small signal stability of the bulk system? 2) How can we ensure that the developed data analytic methods are robust to data availability and quality issues? 3) How can we compute the developed analytics in a scalable manner using streaming measurements? In this project, we addressed the aforementioned challenges arising from DERs and answered the questions raised above on how to effectively use the sensor measurements to enhance the reliability and performance of the electric grid. Thus, the overarching goal of this project is to develop effective reduced/representative system models from data that make the computational complexity sufficiently manageable so as to be useful to simulate, analyze, and even control complex non-linear power systems dynamics with large penetrations of DERs. In order to achieve the objective, the project team established a four-fold technical approach 1) Formulated a combined transmission-distribution co-simulation framework for data generation and validation, 2) Derived reduced/representative models of power systems based on data-driven methods for efficient computation and appropriate representation of system behavior, 3) Developed data driven characterization of power system behavior based on transfer operator theory, machine learning and optimization for model estimation, 4) Incorporated a scalable data management and processing architecture using distributed Kafka streaming applications that coordinate input data streams to the developed data analytics. The key accomplishments of the project are: 1) Development of a scalable multi-timescale T&D co-simulation framework (both for steady state and for dynamic co-simulation) using commercial solvers (PSSE and GridLAB-D). The steady-state T&D co-simulation interface is shared with our industry partner (PJM). 2) A structured reduced order dynamic model of distribution systems that can represent partial motor stalling along with a systematic procedure to derive the model parameters. 3) A PMU based online method to monitor, localize and mitigate fault-induced delayed voltage recovery using DER reactive support and load control in distribution systems. 4) Development of linear operator based robust methodologies for dynamic state estimation, uncertainty quantification, system identification and trajectory prediction for power system dynamics. 5) An adaptive damping control for utilizing wind energy resources to provide oscillation damping and system stability. 6) Implementation of Kafka-based framework for efficient processing of streaming data using Linux-based local virtual environment.
Vertically pointing millimeter-wavelength radars provide a wealth of information about cloud and precipitation particle properties. Doppler spectral data can inform on how particles of varying vertical velocities contribute to the total backscattered power observed. It is more computationally cost effective to process moment data instead of spectra data, but doing so leaves valuable information on the cutting room floor. To confidently identify a multi-modal spectra event, in which two or more modes are present within a layer, Doppler spectral data are essential. This means long-term identification of layers featuring multi-modal spectra can be cost prohibitive. To address this, we explore three multi-modal spectra cases from winter precipitation events to determine characteristic signatures of these layers in the moment data averaged over short time periods (∼ 145 s) and explore how these layers differ from the rest of the vertical profiles. We find that the mean spectrum width and the standard deviation of mean Doppler velocity can be used to determine whether or not a layer is multi-modal. In particular, multi-modal layers in mixed-phase and ice clouds feature larger mean spectrum width (exceeding 0.17 m s −1 ) and smaller standard deviation of the mean Doppler velocity (below 0.1 m s −1 ). In Part 1 of this study, the identification criteria and methods are described. In Part 2 (Wugofski and Kumjian, 2025), we perform a verification of the method for three years of vertically pointing radar data, and explore the meteorological conditions associated with identified multi-modal spectral events.
The use of SEM-DIC, AFM, ECCI, and HR-EBSD to characterize slip-system activity was assessed on the same material volume of Ti-7Al. This study presents a robust comparison of the various methods for the first time, including an assessment of their advantages and disadvantages, and how they can be used effectively in a complementary fashion. The analysis of the different approaches was carried out in a blind, round-robin manner at three different universities. A Ti-7Al specimen was deformed in uniaxial tension to approximately 3% axial strain, and the active slip systems were independently identified using (i) trace analysis; (ii) in-SEM digital image correlation, (iii) observations of residual dislocations from ECCI, and (iv) long-range rotation gradients through HR-EBSD, with consistent trace identification in all cases. Displacement data from AFM was used to augment SEM-DIC displacement data by providing complementary out-of-plane displacement information. Furthermore, short-range dislocation gradients (measured by DIC) provided insight into the residual geometrically necessary dislocation (GND) content, and was consistent with the GND content extracted from EBSD data and ECCI images, confirming the presence of residual GNDs on the dominant slip systems resulting in visible slip bands. Furthermore, these approaches can be used in tandem to provide multi-modal information on slip band identification, strain and orientation gradients, out-of-plane displacements, and the presence of GNDs and SSDs, all of which can be used to inform and validate the development of dislocation-based crystal plasticity and strain gradient models.
A J-resolved spectroscopy that depends on homonuclear scalar coupling in the strong-coupling regime and heteronuclear coupling in the weak regime expands complex peak patterns to a second axis. Hyperpolarization by Signal Amplification by Reversible Exchange (SABRE) enables the spectroscopy at a low magnetic field of 0.82 mT. Overlapping peaks of molecules such as 3-fluoropyridine and 3,5-difluoropyridine are resolved. Density matrix simulations of the 1 H and 19 F spins indicate a strong dependence on the signs and values of the J-coupling constants, including the homonuclear couplings that are not directly observable. The best matching peak positions and intensities predict coupling constants, including couplings between chemically equivalent nuclear spins, ranging in magnitude from 0.4 to 9.0 Hz for the two molecules. Simulations of other spin systems show unique patterns for molecules containing 1 H and 19 F or 13 C. The dependence of the J-resolved peak patterns on all coupling constants in a spin system presents a new modality for portable and inexpensive identification of molecules.
Prebiotics are defined as non-digestible dietary components that promote the growth of beneficial gut microorganisms. In many cases, however, this capability is not systematically evaluated. Here, we develop a methodology for determining prebiotic-responsive bacteria using the popular dietary supplement inulin. We first identify microbes with a capacity to bind inulin using mesoporous silica nanoparticles functionalized with inulin. 16S rRNA gene amplicon sequencing of sorted cells revealed that the ability to bind inulin was widespread in the microbiota. We further evaluate which taxa are metabolically stimulated by inulin and find that diverse taxa from the phyla Firmicutes and Actinobacteria respond to inulin, and several isolates of these taxa can degrade inulin. Incubation with another prebiotic, xylooligosaccharides (XOS), in contrast, shows a more robust bifidogenic effect. Interestingly, the Coriobacteriia Eggerthella lenta and Gordonibacter urolithinfaciens are indirectly stimulated by the inulin degradation process, expanding our knowledge of inulin-responsive bacteria.
Explore the source record for details and available documents.
Vehicle re-identification (re-ID) across disparate sensing modalities remains a fundamental challenge for transportation research. In this work, we introduce a deep multi-view vehicle re-ID framework that leverages Siamese networks to compare pairs of vehicle images and produce matching scores, enabling robust association across drastically different viewpoints such as those from UAVs, surveillance cameras, and ground sensors. The model exploits convolutional neural networks to learn features that remain discriminative under changes in angle, distance, and illumination, supporting more generalizable re-ID performance. As part of this effort, we also developed an automated pipeline to synchronize roadside and UAV video streams, producing a multi-perspective dataset that complements preexisting real collections and a synthetic dataset generated in this study. Together, these contributions advance the capability to re-identify vehicles across wide viewing baselines; establish a foundation for scalable, reproducible research in vehicle re-ID; and open pathways for future applications, such as inferring routine behaviors, movement patterns, and daily habits of the individual associated with the vehicle.
Blue Horizontal Branch stars (BHBs) are ideal tracers to probe the global structure of the milky Way (MW), and the increased size of the BHB star sample could be helpful to accurately calculate the MW's enclosed mass and kinematics. Large survey telescopes have produced an increasing number of astronomical images and spectra. However, traditional methods of identifying BHBs are limited in dealing with the large scale of astronomical data. A fast and efficient way of identifying BHBs can provide a more significant sample for further analysis and research. Therefore, in order to fully use the various data observed and further improve the identification accuracy of BHBs, we have innovatively proposed and implemented a Bi-level attention mechanism-based Transformer multimodal fusion model, called Bi-level Attention in the Transformer with Multimodality (BATMM). The model consists of a spectrum encoder, an image encoder, and a Transformer multimodal fusion module. The Transformer enables the effective fusion of data from two modalities, namely image and spectrum, by using the proposed Bi-level attention mechanism, including cross-attention and self-attention. As a result, the information from the different modalities complements each other, thus improving the accuracy of the identification of BHBs. The experimental results show that the F1 score of the proposed BATMM is 94.78%, which is 21.77% and 2.76% higher than the image and spectral unimodality, respectively. It is therefore demonstrated that higher identification accuracy of BHBs can be achieved by means of using data from multiple modalities and employing an efficient data fusion strategy.
We report in-situ process monitoring as an aid to part qualification for laser powder-bed fusion (L-PBF) technology is a topic of increasing interest to the additive manufacturing community. In this work, airborne acoustic and inline pyrometry measurements were recorded simultaneously with the laser position. X-ray radiography imaging was used to spatio-temporally register keyhole pore locations to the pyrometry and acoustic signals, enabling binary labeling of data partitions based on pore formation. These labeled partitions were subsequently featurized using a highly comparative time-series analysis toolbox. Acoustic data was found to be much more effective than the pyrometry data for keyhole pore identification. However, when the information contained in both sensing modalities was combined in a sensor fusion strategy, the error rates of the top performing models were significantly reduced.
Deep learning (DL) is one of the fastest-growing topics in materials data science, with rapidly emerging applications spanning atomistic, image-based, spectral, and textual data modalities. DL allows analysis of unstructured data and automated identification of features. The recent development of large materials databases has fueled the application of DL methods in atomistic prediction in particular. In contrast, advances in image and spectral data have largely leveraged synthetic data enabled by high-quality forward models as well as by generative unsupervised DL methods. In this article, we present a high-level overview of deep learning methods followed by a detailed discussion of recent developments of deep learning in atomistic simulation, materials imaging, spectral analysis, and natural language processing. For each modality we discuss applications involving both theoretical and experimental data, typical modeling approaches with their strengths and limitations, and relevant publicly available software and datasets. We conclude the review with a discussion of recent cross-cutting work related to uncertainty quantification in this field and a brief perspective on limitations, challenges, and potential growth areas for DL methods in materials science.
Cryogenic correlative light and electron microscopy (cryo-CLEM) seeks to leverage orthogonal information present in two powerful imaging modalities. While recent advances in cryogenic electron microscopy (cryo-EM) allow for the visualization and identification of structures within cells at the nanometer scale, information regarding the cellular environment, such as pH, membrane potential, ionic strength, etc., which influences the observed structures remains absent. Fluorescence microscopy can potentially be used to reveal this information when specific labels, known as fluorescent biosensors, are used, but there has been minimal use of such biosensors in cryo-CLEM to date. Here we demonstrate the applicability of one such biosensor, the fluorescent protein roGFP2, for cryo-CLEM experiments. At room temperature, the ratio of roGFP2 emission brightness when excited at 425 nm or 488 nm is known to report on the local redox potential. When samples containing roGFP2 are rapidly cooled to 77 K in a manner compatible with cryo-EM, the ratio of excitation peaks remains a faithful indicator of the redox potential at the time of freezing. Using purified protein in different oxidizing/reducing environments, we generate a calibration curve which can be used to analyze in situ measurements. As a proof-of-principle demonstration, we investigate the oxidation/reduction state within vitrified Caulobacter crescentus cells. The polar organizing protein Z (PopZ) localizes to the polar regions of C. crescentus where it is known to form a distinct microdomain. Finally, by expressing an inducible roGFP2-PopZ fusion we visualize individual microdomains in the context of their redox environment.
Abstract Machine learning (ML) models often fail with data that deviates from their training distribution. This is a significant concern for ML-enabled devices as data drift may lead to unexpected performance. This work introduces a new framework for out of distribution (OOD) detection and data drift monitoring that combines ML and geometric methods with statistical process control (SPC). We investigated different design choices, including methods for extracting feature representations and drift quantification for OOD detection in individual images and as an approach for input data monitoring. We evaluated the framework for both identifying OOD images and demonstrating the ability to detect shifts in data streams over time. We demonstrated a proof-of-concept via the following tasks: 1) differentiating axial vs. non-axial CT images, 2) differentiating CXR vs. other radiographic imaging modalities, and 3) differentiating adult CXR vs. pediatric CXR. For the identification of individual OOD images, our framework achieved high sensitivity in detecting OOD inputs: 0.980 in CT, 0.984 in CXR, and 0.854 in pediatric CXR. Our framework is also adept at monitoring data streams and identifying the time a drift occurred. In our simulations tracking drift over time, it effectively detected a shift from CXR to non-CXR instantly, a transition from axial to non-axial CT within few days, and a drift from adult to pediatric CXRs within a day—all while maintaining a low false positive rate. Through additional experiments, we demonstrate the framework is modality-agnostic and independent from the underlying model structure, making it highly customizable for specific applications and broadly applicable across different imaging modalities and deployed ML models.