Rapid Constrained Object Motion Estimation based on Centroid Localization of Semantically Labeled Objects
Explore the source record for details and available documents.
Young, Carol Christine↗
SEARCH · Search NASA
Results for “motion estimation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Rapid Constrained Object Motion Estimation based on Centroid Localization of Semantically Labeled Objects
Explore the source record for details and available documents.
Young, Carol Christine↗
ReLU, Sparseness, and the Encoding of Optic Flow in Neural Networks
Accurate self-motion estimation is critical for various navigational tasks in mobile robotics. Optic flow provides a means to estimate self-motion using a camera sensor and is particularly valuable in GPS- and radio-denied environments. The present study investigates the influence of different activation functions—ReLU, leaky ReLU, GELU, and Mish—on the accuracy, robustness, and encoding properties of convolutional neural networks (CNNs) and multi-layer perceptrons (MLPs) trained to estimate self-motion from optic flow. Our results demonstrate that networks with ReLU and leaky ReLU activation functions not only achieved superior accuracy in self-motion estimation from novel optic flow patterns but also exhibited greater robustness under challenging conditions. The advantages offered by ReLU and leaky ReLU may stem from their ability to induce sparser representations than GELU and Mish do. Our work characterizes the encoding of optic flow in neural networks and highlights how the sparseness induced by ReLU may enhance robust and accurate self-motion estimation from optic flow.
97 MATHEMATICS AND COMPUTING↗
Autoencoding is All You Need (for MSTd)
We explore various neural network task and architectural constraints to find the minimal set that produces network activity similar to that found in primate MSTd. MSTd is a brain region in the dorsal visual pathway associated with self motion estimation from visual motion (i.e. optic flow).
Layton, Oliver W [Colby College]↗
Graph-learning approach to combine multiresolution seismic velocity models
SUMMARY The resolution of velocity models obtained by tomography varies due to multiple factors and variables, such as the inversion approach, ray coverage, data quality, etc. Combining velocity models with different resolutions can enable more accurate ground motion simulations. Toward this goal, we present a novel methodology to fuse multiresolution seismic velocity maps with probabilistic graphical models (PGMs). The PGMs provide segmentation results, corresponding to various velocity intervals, in seismic velocity models with different resolutions. Further, by considering physical information (such as ray path density), we introduce physics-informed probabilistic graphical models (PIPGMs). These models provide data-driven relations between subdomains with low (LR) and high (HR) resolutions. Transferring (segmented) distribution information from the HR regions enhances the details in the LR regions by solving a maximum likelihood problem with prior knowledge from HR models. When updating areas bordering HR and LR regions, a patch-scanning policy is adopted to consider local patterns and avoid sharp boundaries. To evaluate the efficacy of the proposed PGM fusion method, we tested the fusion approach on both a synthetic checkerboard model and a fault zone structure imaged from the 2019 Ridgecrest, CA, earthquake sequence. The Ridgecrest fault zone image consists of a shallow (top 1 km) high-resolution shear-wave velocity model obtained from ambient noise tomography, which is embedded into the coarser Statewide California Earthquake Center Community Velocity Model version S4.26-M01. The model efficacy is underscored by the deviation between observed and calculated traveltimes along the boundaries between HR and LR regions, 38 per cent less than obtained by conventional Gaussian interpolation. The proposed PGM fusion method can merge any gridded multiresolution velocity model, a valuable tool for computational seismology and ground motion estimation.
Geochemistry & Geophysics↗
Adapt: A Weather Radar Data Analysis and Nowcasting Platform for Informed Adaptive Scanning
SF-26-021 Adapt is a data processing platform for real-time data analysis, short term prediction of targets convective cells and tracking for archived data. It provides tools for downloading, processing, segmenting, projecting, analyzing, and visualizing storm cell data from weather radar. The pipeline includes cell detection, motion estimation using optical flow, cell property extraction, and persistence to NetCDF and SQLite/Parquet for guiding adaptive scanning.
Raut, Bhupendra Ashokrao [Argonne National Laborat↗
Performance evaluation of the USGS velocity model for the San Francisco Bay Area
In this study, we evaluated the performance of the United States Geological Survey velocity model developed for the San Francisco Bay Area (SFBA), version 21.1. The evaluation was performed through high-resolution three-dimensional physics-based ground motion simulations of seven small-magnitude earthquakes (ranging from magnitude 3.8 to 4.4) that occurred on the eastern side of the San Francisco Bay. The simulations were performed in the frequency range from 0 to 5 Hz with a minimum shear-wave velocity of 250 m/s, which allowed the capture of wave propagation effects of the near-surface soft materials that characterize local basins. Based on the direct comparison of Fourier amplitude spectra between recorded and simulated ground motions for more than 250 stations, we found that the velocity model generally performs well in the frequency range of 0.2–5 Hz. The median value of the Fourier amplitude residuals was found to be near zero for all seven earthquakes. The slight over-prediction of 0.2 log-natural units at frequencies above 3 Hz in our simulations was attributed to the potentially inaccurate representation of the source radiation pattern by a double-couple point source model, and simple representation of shallow small-scale underground structural complexity in the velocity model. Maps of spectral amplitude differences between the simulated and recorded data were used to identify areas responsible for systematic ground motion over-predictions or under-predictions. For example, while some sub-domains over soft sediments show over-prediction patterns, the block east of the Hayward fault is prone to exhibit patterns of under-prediction. These maps can be used to guide future refinements of the SFBA velocity model. Since our simulation methodology allows for the decoupling of the source and wave propagation effects, the ground motion data generated by our simulations can also be used to quantify the epistemic uncertainty due to the velocity model, in empirically based ground motion estimates for the SFBA.
58 GEOSCIENCES↗
Mode-multiplexed photonic integrated vector dot-product core from inverse design
Photonic computing has the potential to harness the full degrees of freedom (DOFs) of the light field, including the wavelength, spatial mode, spatial location, phase quadrature, and polarization, to achieve a higher level of computing parallelism and scalability than digital electronic processors. While multiplexing using the wavelength and other DOFs can be readily integrated on silicon photonics platforms with compact footprints, conventional mode-division multiplexed (MDM) photonic designs occupy areas exceeding tens to hundreds of microns for a few spatial modes, significantly limiting their scalability. Here, we utilize inverse design to demonstrate an ultracompact photonic computing core that calculates vector dot products based on MDM coherent mixing. Our dot-product core integrates the functionalities of two-mode multiplexers and one multimode coherent mixer within a nominal footprint of 5 μm x 3 μm . We have experimentally demonstrated computing examples on the fabricated dot-product core, including complex number multiplication and motion estimation using optical flow. The compact dot-product core design enables large-scale on-chip integration in a parallel photonic computing primitive cluster for high-throughput scientific computing and computer vision tasks.
97 MATHEMATICS AND COMPUTING↗
Transformational Regional-Scale Earthquake Simulations with the DOE EarthQuake SIMulation Exascale Framework
Earthquakes present worldwide risk to economic and human safety. The 2023 earthquakes in Turkiye provided a reminder of the potential for catastrophic consequences with 50,700 deaths and 15.7 million people affected. The ability to predict ground motions and infrastructure damage for earthquakes continues to be a challenging problem for scientists and engineers. Until now, estimates of ground motions have been performed empirically by looking at sparse data from past earthquakes. This approach can provide statistical information on intensity amplitudes but cannot inform site-specific ground motions essential to developing the most effective resilience. Interest has grown in large-scale computational models to simulate earthquakes at regional scale. The U.S. Department of Energy EarthQuake SIMulation (EQSIM) framework was developed for regional-scale earthquake simulations at unprecedented fidelity, taking advantage of emerging GPU-accelerated systems. This article describes the EQSIM workflow and demonstrates regional-scale simulations with the new computational capability available to scientists in their quest to mitigate future disasters.
58 GEOSCIENCES↗
Simulation of Physics-Based 0-10Hz Strong Motion Using High Performance Computing Supporting Refinements to Regional Ground Motion Models for the Central Eastern US
In collaboration with the U.S. Nuclear Regulatory Commission (NRC) the LLNL has developed a computationally efficient simulation platform designed to perform physics-based ground motion simulations for crustal earthquakes in the Stable Continental Regions of Central and Eastern US (CEUS), using high-performance computing. The main objective of the earthquake simulations was to use synthetic ground motion to provide constrains to refinements of existing ergodic Ground Motion Models (GMMs), for large magnitude earthquakes and near-fault distances, for which these models are less reliable. Physics-based broadband (0-10Hz) ground motion simulations were used to estimate the near-fault ground motion amplitudes and within event and between-event variabilities associated with fault rupture characteristics. In our simulations we used a 3D regional velocity model that was based on Saikia’s 1D velocity model (1994). In simulations performed during the first stage of this project the Saikia’s velocity model demonstrated better performance in modelling high frequency regional wave propagation for the CEUS region recorded during the Mw5.0 November 7, 2016, Cushing Oklahoma (Taylor et al., 2017), and Mw5.8 September 3, 2016, Pawnee Oklahoma earthquakes. The proposed regional 3D model includes random perturbations to the 1D background model using the stochastic scheme of Pitarka and Mellors (2021). In addition, validation analysis of the rupture generator and regional wave propagation models, using comparisons with different GMMs for Mw6.5 and Mw7.0 scenario earthquakes in the CEUS region resulted in a very good match between the simulated and empirical ground motion models. For the purposes of seismic hazard assessment at the existing and planned nuclear power plants, NRC is interested in studies aimed at improving the current ground motion models (GMM) for both Stable Continental Regions (SCR) in the Central and Eastern US and Active Crustal Regions (ACR) in the Western US. Due to lack of recorded data, these improvements require synthetic data for short fault distances and large magnitude earthquakes for which the existing recorded data is not enough to uniquely constrain the GMMs. The need for simulations and strong motion data is especially critical for the CEUS region where we do not have recorded data from potentially large damaging earthquakes with moment magnitudes 6.0 and higher. In this the project, we focused on 10Hz simulations of Mw7.0 scenario earthquakes with strike slip and thrust faulting mechanisms. We used more than 50 Mw7.0 earthquake rupture scenarios to investigate the ground motion uncertainty due to unknown earthquake rupture parameters, in particular, the slip distribution, rupture velocity, and faulting mechanism, and their implication on ground motion amplification due to forward rupture directivity effects.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Reducing Frequency Bias of Fourier Neural Operators in 3D Seismic Wavefield Simulations Through Multistage Training
The recent development of neural operator (NeurOp) learning for solutions to the elastic wave equation shows promising results and provides the basis for fast large-scale simulations for different seismological applications. In this article, we use the Fourier neural operator (FNO) model to directly solve the 3D Helmholtz wave equation for fast seismic ground-motion simulations on different frequencies and show the frequency bias of the FNO model, that is, it learns the lower frequencies better comparing to the higher frequencies. To reduce the frequency bias, we adopt the multistage FNO training, that is, after training a stage 1 FNO model for estimating the ground motion, we use a second FNO model as the stage 2 to learn from the residual, which greatly reduced the errors on the higher frequencies. By adopting this multistage training, the FNO models show reduced biases on higher frequencies, which enhanced the overall results of the ground-motion simulations. Thus the multistage training FNO improves the accuracy and realism of the ground-motion simulations.
earthquakes↗
Using Fiducial Markers for Pose Estimation of an OSWEC in a Wave Tank: Preprint
In this study, we consider a novel method of sensing the motion of a wave energy converter during testing in a wave flume under the influence of incoming waves. The wave energy converter considered in our research is an oscillating surge wave energy converter, which is a hinged paddle that responds to incoming waves. Motion sensing is normally done with inertial sensors, which can hinder the motion due to suspended cables that carry power and transmit signals. Our proposed method is contactless and can be implemented economically. A camera is used to record different marker patterns affixed to the moving paddle and the motion deduced by pose estimation algorithms. Fiducial markers are commonly used for robot localization and in augmented reality. There are many types of fiducial markers, including ArUco-type markers which are accurate, fast and robust. The system consists of markers attached to the paddle element and recorded using a machine vision camera. A pose estimation algorithm is then applied to the detected markers to estimate the tilt of the paddle. In this work, we examine the challenges of image acquisition and calibration for underwater targets, compare the motion obtained by this new system with a calibrated tilt sensor and identify areas where the new system may be superior.
computer vision↗
A Physics-Based Digital Twin for Wave Elevation and Seabed Moment Estimation of Offshore Monopiles: Preprint
In this work, we present a proof of concept of a physics-based digital twin for a monopile structure (with overhead inertia) subjected to wave loading. The digital twin is formulated using reduced-order models derived from first principles and combined with a Kalman filter for state estimation. The proposed framework estimates the monopile top motion, the wave elevation, and the section forces and moments along the pile using primarily acceleration measurements at the monopile top. Key innovations include the use of a hydrodynamic shape function to represent distributed wave loading in a compact and computationally efficient manner, and the introduction of a shaping filter to augment the state-space with wave kinematics. Synthetic measurement data are generated using OpenFAST and used as a reference to assess the performance of the digital twin. Results demonstrate that the wave elevation can be accurately reconstructed without direct sea-state measurements as long as the wave regime is inertia-dominated. Under the ideal tested conditions, the total hydrodynamic force and sea-bed bending moment are estimated with relative errors on the order of 1% and correlation coefficients exceeding 96%. Future work will evaluate the estimator's performance under operational uncertainties and more complex loading conditions.
17 WIND ENERGY↗
Productivity and cost of energy chipping with non-integrated harvesting systems in the Coastal Plain of the US south
Research from the 1980s–2010s suggested that integrated harvesting systems that harvest conventional products (e.g., sawtimber, pulpwood) and energy chips simultaneously were the most effective solution to produce energy chips in the US South. Alternatives, such as biomass-only systems, have important advantages in forest stands with low volumes of merchantable timber. The goal of this study was to estimate the productivity and cost of producing energy chips using non-integrated systems. Innovative chipping contractors using non-integrated systems were identified through contacts with procurement foresters responsible for purchasing energy chips. Elemental time-and-motion studies were conducted to estimate harvesting productivity on five operations, including one clearcut harvest and four first thinnings in overstocked stands. The hourly cost of equipment was estimated using the machine rate method. Cost per tonne was estimated by combining hourly productivity and hourly costs in a modified version of the Auburn Harvesting Analyzer. System productivity averaged 37 tonnes per scheduled machine hour (smh) and cut-and-haul costs averaged $33.86 t −1 (USD), which was comparable to previous estimates from integrated systems. In conclusion, this study suggests there are viable alternatives to integrated harvesting systems to produce energy chips, especially in stands with low volumes of merchantable timber.
09 BIOMASS FUELS↗
Collaborative Research: Properties and Dynamics of the Shallow Crust (Final Report)
Ground motions recorded at one location are often extrapolated to nearby regions within a given radius. Here, we explore the appropriateness of spatial extrapolation using data from seven small aperture seismic network deployments in southern California. Six of these deployments are linear arrays of 4-13 stations, and one is a 2D array of 13 stations at Pinyon Flats Observatory. The spatial footprint array diameters are 3 km or less, and each array was operational for a year or more. From our base catalog (M2.5+ earthquakes; 4038 events; September 2010 - June 2023), automated methods remove temporally overprinted waveforms from nearby events (< 5 km) in quick succession (< 5 min) and data with nonviable waveforms. These 200 samples per second data are filtered at 0.5-25 Hz and must have signal-tonoise ratios (SNRs) of 2.5+. Peak ground acceleration (PGA) and peak ground velocity (PGV) are derived individually from the maximum absolute values of each of the 3-component waveforms (vertical, northsouth, and east-west). Five of the seven arrays traverse the San Jacinto fault, and two do not. Ground motion observations are compared with theoretical estimates from Abrahamson et al., 2014. On average, arrays deployed within and across fault zones consistently record ground motions above theoretical expectations, whereas off-fault arrays record ground motions at or slightly below theoretical expectations. We attribute these differences to site conditions because these trends prevail for the full data suites. For each network and each individual channel, the coefficient of variation indicates that the standard deviations are ~30±6% of the mean. Exploring relative ground motion contributions from all three channels (ternary plots), as expected, most data show that vertical ground motions are attenuated compared to horizontal ones. However, this is not always the case for RA array data, where vertical motions can be ~2-3 times larger than horizontal motions for select events near Cahuilla, CA. These anomalously high vertical motions are focal mechanism-related. These results suggest that ternary plots created using only a small amount of data can be used as a data quality metric and a tool to find anomalous features in three-component data.
58 GEOSCIENCES↗
Accuracy optimized neural networks do not effectively model optic flow tuning in brain area MSTd
Accuracy-optimized convolutional neural networks (CNNs) have emerged as highly effective models at predicting neural responses in brain areas along the primate ventral stream, but it is largely unknown whether they effectively model neurons in the complementary primate dorsal stream. We explored how well CNNs model the optic flow tuning properties of neurons in dorsal area MSTd and we compared our results with the Non-Negative Matrix Factorization (NNMF) model, which successfully models many tuning properties of MSTd neurons. To better understand the role of computational properties in the NNMF model that give rise to optic flow tuning that resembles that of MSTd neurons, we created additional CNN model variants that implement key NNMF constraints – non-negative weights and sparse coding of optic flow. While the CNNs and NNMF models both accurately estimate the observer's self-motion from purely translational or rotational optic flow, NNMF and the CNNs with nonnegative weights yield substantially less accurate estimates than the other CNNs when tested on more complex optic flow that combines observer translation and rotation. Despite its poor accuracy, NNMF gives rise to tuning properties that align more closely with those observed in primate MSTd than any of the accuracy-optimized CNNs. This work offers a step toward a deeper understanding of the computational properties and constraints that describe the optic flow tuning of primate area MSTd.
60 APPLIED LIFE SCIENCES↗
Deep-learning optical flow for measuring velocity fields from experimental data
Deep learning-based optical flow (DLOF) extracts features in video frames with deep convolutional neural networks to estimate the inter-frame motions of objects. DLOF computes velocity fields more accurately than PIV for densely labeled systems.
97 MATHEMATICS AND COMPUTING↗
XRISM spectroscopy on orbital modulation of Fe Ly α lines in Cygnus X-3
To understand physical processes such as mass transfer and binary evolution in X-ray binaries, the orbital parameters of the system are fundamental and crucial information. Cygnus X-3 is a high-mass X-ray binary composed of a compact object of unknown nature and a Wolf–Rayet star, which is of great interest in the context of wind-fed mass accretion and binary evolution. Here we present XRISM/Resolve high-resolution spectroscopy, focusing on the Fe Ly$\alpha$ lines when the source was in its hypersoft state. We perform an orbital phase-resolved spectral analysis of the lines to study the orbital modulation of the emission and absorption lines. It is found that the emission lines reflect the orbital motion of the compact object whose estimated velocity amplitude is $430^{+150}_{-140}$ km s$^{-1}$, while the absorption lines show a variation that can be interpreted as originating from the stellar wind. We discuss possible mass ranges for the binary components using the mass function with the estimated value of the velocity amplitude in this work, combined with the relation between the mass-loss rate and the orbital period derivative and the empirical mass and mass-loss rate relation for Galactic Wolf–Rayet stars. They are constrained to be (1.3–5.1) and (9.3–12) M$_\odot$, respectively, for the assumed inclination angle of $i =25^\circ$, and become more relaxed, (1.3–24) and (9.3–16) M$_\odot$, for $i = 35^\circ$. Thus, it remains unclear whether the system harbors a black hole or a neutron star.
X-rays: binaries↗