Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗

Imagery Integration Team

The Human Exploration Science Office (KX) provides leadership for NASA's Imagery Integration (Integration 2) Team, an affiliation of experts in the use of engineering-class imagery intended to monitor the performance of launch vehicles and crewed spacecraft in flight. Typical engineering imagery assessments include studying and characterizing the liftoff and ascent debris environments; launch vehicle and propulsion element performance; in-flight activities; and entry, landing, and recovery operations. Integration 2 support has been provided not only for U.S. Government spaceflight (e.g., Space Shuttle, Ares I-X) but also for commercial launch providers, such as Space Exploration Technologies Corporation (SpaceX) and Orbital Sciences Corporation, servicing the International Space Station. The NASA Integration 2 Team is composed of imagery integration specialists from JSC, the Marshall Space Flight Center (MSFC), and the Kennedy Space Center (KSC), who have access to a vast pool of experience and capabilities related to program integration, deployment and management of imagery assets, imagery data management, and photogrammetric analysis. The Integration 2 team is currently providing integration services to commercial demonstration flights, Exploration Flight Test-1 (EFT-1), and the Space Launch System (SLS)-based Exploration Missions (EM)-1 and EM-2. EM-2 will be the first attempt to fly a piloted mission with the Orion spacecraft. The Integration 2 Team provides the customer (both commercial and Government) with access to a wide array of imagery options - ground-based, airborne, seaborne, or vehicle-based - that are available through the Government and commercial vendors. The team guides the customer in assembling the appropriate complement of imagery acquisition assets at the customer's facilities, minimizing costs associated with market research and the risk of purchasing inadequate assets. The NASA Integration 2 capability simplifies the process of securing one-of-a-kind imagery assets and skill sets, such as ground-based fixed and tracking cameras, crew-in the-loop imaging applications, and the integration of custom or commercial-off-the-shelf sensors onboard spacecraft. For spaceflight applications, the Integration 2 Team leverages modeling, analytical, and scientific resources along with decades of experience and lessons learned to assist the customer in optimizing engineering imagery acquisition and management schemes for any phase of flight - launch, ascent, on-orbit, descent, and landing. The Integration 2 Team guides the customer in using NASA's world-class imagery analysis teams, which specialize in overcoming inherent challenges associated with spaceflight imagery sets. Precision motion tracking, two-dimensional (2D) and three-dimensional (3D) photogrammetry, image stabilization, 3D modeling of imagery data, lighting assessment, and vehicle fiducial marking assessments are available. During a mission or test, the Integration 2 Team provides oversight of imagery operations to verify fulfillment of imagery requirements. The team oversees the collection, screening, and analysis of imagery to build a set of imagery findings. It integrates and corroborates the imagery findings with other mission data sets, generating executive summaries to support time-critical mission decisions.

Calhoun, Tracy↗

Additive Manufacturing of Oxide Dispersion Strengthened Multi Principle Element Alloys for Future Aerospace Applications

Oxide Dispersion Strengthened (ODS) materials have long been of interest for their high temperature applications, and additive manufacturing enables their manufacturing viability. The ODS multi-principle element alloy NiCoCr was prepared using powder metallurgy techniques, additively manufactured, and evaluated for its processingmicrostructure-property relationships. The high temperature foundations of nickel-base superalloys and ODS materials were combined with the manufacturing advantages of 3D printing and the chemical simplicity of NiCoCr to inspire this work, which was divided into powder and printed material assessments. The project was achieved through multiple iterative project loops to assess the processing parameters’ impact on the microstructure and mechanical properties of the feedstock powder and printed material. The powder investigations (Chapter 3) focused on understanding the oxide coating that formed on the metal powder following acoustic mixing. Time of Flight Secondary Ion Mass Spectrometry was used to semi-quantitatively assess the amount of yttrium on the surface of the mixed powders, and indicated that a combination of higher mixing condition energy and moderate mixing time resulted in the most oxide coating on the NiCoCr powder. The results were supported by a qualitative assessment of scanning electron images of coated powder particles. Following mixing, the ODS NiCoCr was consolidated by Laser Powder Bed Fusion. The evaluations of the printed material (Chapter 4) frst considered screening experiments including Archimedes’ density, porosity, and grain size and number metrics from electron backscatter diffraction data. After the ideal additive manufacturing parameters were identifed, both the oxide homogeneity and yield strength were discussed for the idealized printed material. Overall, the project suggests that the combined use of qualitative or semi-quantitative powder surface analysis with Archimedes’ density analyses can be a valid high-throughput technique which can lead to process optimization of Laser Powder Bed Fusion additively manufactured ODS material.

Laura G Wilson↗

Image Analysis via Soft Computing: Prototype Applications at NASA KSC and Product Commercialization

This slide presentation reviews the use of "soft computing" which differs from "hard computing" in that it is more tolerant of imprecision, partial truth, uncertainty, and approximation and its use in image analysis. Soft computing provides flexible information processing to handle real life ambiguous situations and achieve tractability, robustness low solution cost, and a closer resemblance to human decision making. Several systems are or have been developed: Fuzzy Reasoning Edge Detection (FRED), Fuzzy Reasoning Adaptive Thresholding (FRAT), Image enhancement techniques, and visual/pattern recognition. These systems are compared with examples that show the effectiveness of each. NASA applications that are reviewed are: Real-Time (RT) Anomaly Detection, Real-Time (RT) Moving Debris Detection and the Columbia Investigation. The RT anomaly detection reviewed the case of a damaged cable for the emergency egress system. The use of these techniques is further illustrated in the Columbia investigation with the location and detection of Foam debris. There are several applications in commercial usage: image enhancement, human screening and privacy protection, visual inspection, 3D heart visualization, tumor detections and x ray image enhancement.

Dominguez, Jesus A.↗

NASA Tech Briefs, August 2005

Topics include: Hidden Identification on Parts: Magnetic Machine-Readable Matrix Symbols; System for Processing Coded OFDM Under Doppler and Fading; Multipurpose Hyperspectral Imaging System; Magnetic-Flux-Compensated Voltage Divider; High-Performance Satellite/Terrestrial-Network Gateway; Internet-Based System for Voice Communication With the ISS; Stripline/Microstrip Transition in Multilayer Circuit Board; Dual-Band Feed for a Microwave Reflector Antenna; Quadratic Programming for Allocating Control Effort; Range Process Simulation Tool; Simulator of Space Communication Networks; Computing Q-D Relationships for Storage of Rocket Fuels; Contour Error Map Algorithm; Portfolio Analysis Tool; Glass Frit Filters for Collecting Metal Oxide Nanoparticles; Anhydrous Proton-Conducting Membranes for Fuel Cells; Portable Electron-Beam Free-Form Fabrication System; Miniature Laboratory for Detecting Sparse Biomolecules; Multicompartment Liquid-Cooling/Warming Protective Garments; Laser Metrology for an Optical-Path-Length Modulator; PCM Passive Cooling System Containing Active Subsystems; Automated Electrostatics Environmental Chamber; Estimating Aeroheating of a 3D Body Using a 2D Flow Solver; Artificial Immune System for Recognizing Patterns; Computing the Thermodynamic State of a Cryogenic Fluid; Safety and Mission Assurance Performance Metric; Magnetic Control of Concentration Gradient in Microgravity; Avionics for a Small Robotic Inspection Spacecraft; and Simulation of Dynamics of a Flexible Miniature Airplane.

Source record↗

Design of a Lunar Plume-Surface Interaction Measurement System

Plume-surface interactions between a rocket plume and the lunar surface will be studied in-situ during two of NASA’s upcoming Commercial Lunar Payload Services Program missions. The payload, Stereo Cameras for Lunar Plume-Surface Studies (SCALPSS), will employ a multiple-camera photogrammetry system to obtain stereo images of the lunar regolith before, during, and after significant erosion and subsequent crater formation. The evaluation of measurement system capabilities and design process of the payload is informed by computational fluid dynamics predictions, accuracy modeling based on experimental data, camera simulation, and lander design, all of which are combined in the Virtual Diagnostic Interface. The second SCALPSS mission, traveling to the moon on Firefly Aerospace’s Blue Ghost lander in early 2023, aims to build on the design and complexity of the first payload, which is launching in early 2022 on Intuitive Machines’ Nova-C lander. The Blue Ghost SCALPSS mission will include two additional cameras and a total of three different lens focal lengths which will target specific points in the vehicle’s descent to obtain quantitative and accurate 3D reconstruction of the lunar surface both prior to and after crater formation.

photogrammetry↗

Clear-Sky Remote Sensing in the Vicinity of Clouds: What Can Be Learned About Aerosol Changes?

Studies on aerosol direct and indirect effects require a precise separation of cloud-free and cloudy air. However, separation between cloud-free and cloudy areas from remotely-sensed measurements is ambiguous. The transition zone in the regions around clouds often stretches out tens of km, which are neither precisely clear nor precisely cloudy. We study the transition zone between cloud-free and cloudy air using MODerate-resolution Imaging Spectroradiometer (MODIS) and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) measurements. Both instruments show enhanced clear-sky reflectance (MODIS) and clear-sky backscatterer (CALIPSO) near clouds. Analyzing a large dataset of MODIS observations we examine the effect of three-dimensional (3D) radiative interactions between clouds and cloud-free areas, also known as a cloud adjacency effect. Comparing with CALIPSO clear-sky backscatterer measurements, we show that the cloud adjacency effect may be responsible for a large portion of the enhanced clear sky reflectance observed by MODIS. While aerosol particles are responsible for a large part of the near-cloud enhancements in CALIPSO observations, misidentified or undetected cloud particles are also likely to contribute. As a result, both the nature of these particles (cloud vs. aerosol) and the processes creating them need to be clarified using a quantitative assessment of remote sensing limitations in particle detection and identification. "The width and ubiquity of the transition zone near clouds imply that studies of-aerosol-cloud -interactions and aerosol direct radiative effects need to account for aerosol changes near clouds. Not accounted, these changes can cause systematic biases toward smaller aerosol radiative forcing. On the other hand, including aerosol products near clouds despite their uncertainties may overestimate aerosol radiative forcing. Therefore, there is an urgent need for developing methods that can assess and account for remote sensing challenges and thus allow for including the transition zone into the study. We describe a simple model that estimates the cloud-induced enhanced reflectances of cloud-free areas in the vicinity of clouds. The model assumes that the enhancement is due entirely to Rayleigh scattering and is therefore bigger at shorter wavelengths, thus creating a so-called apparent "bluing" of aerosols in remote sensing retrievals.

Marshak, Alexander↗

Clear-Sky Remote Sensing in the Vicinity of Clouds: What We Learned from MODIS and CALIPSO

Studies on aerosol direct and indirect effects require a precise separation of cloud-free and cloudy air. However, separation between cloud-free and cloudy areas from remotely-sensed measurements is ambiguous. The transition zone in the regions around clouds often stretches out tens of km, which are neither precisely clear nor precisely cloudy. We study the transition zone between cloud-free and cloudy air using MODerate-resolution Imaging Spectroradiometer (MODIS) and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) measurements. Both instruments show enhanced clear-sky reflectance (MODIS) and clear-sky backscatterer (CALIPSO) near clouds, Analyzing a large dataset of MODIS observations we examine the effect of three-dimensional (3D) radiative interactions between clouds and cloud-free areas, also known as a cloud adjacency effect. Comparing with CALIPSO clear-sky backscatterer measurements, we show that the cloud adjacency effect may be responsible for a large portion of the enhanced clear sky reflectance observed by MODIS. While aerosol particles are responsible for a large part of the near-cloud enhancements in CALIPSO observations, misidentified or undetected cloud particles are also likely to contribute. As a result, both the nature of these particles (cloud vs. aerosol) and the processes creating them need to be clarified using a quantitative assessment of remote sensing limitations in particle detection and identification. The width and ubiquity of the transition zone near clouds imply that studies of aerosol-cloud interactions and aerosol direct radiative effects need to account for aerosol changes near clouds. Not accounted, these changes can cause systematic biases toward smaller aerosol radiative forcing. On the other hand, including aerosol products near clouds despite their uncertainties may overestimate aerosol radiative forcing. Therefore, there is an urgent need for developing methods that can assess and account for remote sensing challenges and thus allow for including the transition zone into the study. We describe a simple model that estimates the cloud-induced enhanced reflectances of cloud-free areas in the vicinity of clouds. The model assumes that the enhancement is due entirely to Rayleigh scattering and is therefore bigger at shorter wavelengths, thus creating a so-called apparent "bluing" of aerosols in remote sensing retrievals.

Marshak, Alexander↗

Cluster Analysis of IRIS Spectroscopic Line Profiles and SDO/AIA EUV Emission in Observations and RMHD Simulations of the Solar Atmosphere

Spatially-resolved observations from the IRIS and SDO/AIA satellites, especially when coupled with realistic 3D RMHD simulations, are a powerful tool for analysis of processes in the solar chromosphere, transition region, and corona. However, the complexity of the data makes understanding the observations and modeling results difficult. In this work, we apply unsupervised clustering algorithms for analysis of observational and synthetic chromospheric Mg II h&k 2796Å&2803Å and transition region C II 1334Å&1335Å line profiles observed by IRIS, and extreme ultraviolet (EUV) emission observed by SDO/AIA, for various types of problems. The synthetic line profiles are computed for simulations of the quiescent solar atmosphere (using the StellarBox and RH1.5 codes). The K-Means clustering algorithm is applied, and the selection of an optimal number of clusters is supported by the average silhouette width technique. We discuss applications of the line profile clustering method to 1) visualization of computational and observational spectroscopic imaging data; 2) understanding of evolutionary trends and behavior patterns of quiet Sun emission and during solar flares; and 3) recognition of heating events and shock waves.

Sadykov, Viacheslav↗

Analysis of TRMM-LIS Lightning and Related Microphysics Using a Cell-Scale Database

Previous studies of tropical lightning activity using Tropical Rainfall Measurement Mission (TRMM) Lightning Imaging Sensor (LIS) data performed analyses of lightning behavior over mesoscale "feature" scales or over uniform grids. In order to study lightning and the governing ice microphysics intrinsic to thunderstorms at a more process-specific scale (i.e., the scale over which electrification processes and lightning occur in a "unit" thunderstorm), a new convective cell-scale database was developed by analyzing and refining the University of Utah's Precipitation Features database and retaining precipitation data parameters computed from the TRMM precipitation radar (PR), microwave imager (TMI) and LIS instruments. The resulting data base was to conduct a limited four-year study of tropical continental convection occurring over the Amazon Basin, Congo, Maritime Continent and the western Pacific Ocean. The analysis reveals expected strong correlations between lightning flash counts per cell and ice proxies, such as ice water path, minimum and average 85GHz brightness temperatures, and 18dBz echo top heights above the freezing level in all regimes, as well as regime-specific relationships between lighting flash counts and PR-derived surface rainfall rates. Additionally, radar CFADs were used to partition the 3D structure of cells in each regime at different flash counts. The resulting cell-scale analyses are compared to previous mesoscale feature and gridded studies wherever possible.

Leroy, Anita↗

Bayesian Vision for Shape Recovery

We present a new Bayesian vision technique that aims at recovering a shape from two or more noisy observations taken under similar lighting conditions. The shape is parametrized by a piecewise linear height field, textured by a piecewise linear irradiance field, and we assume Gaussian Markovian priors for both shape vertices and irradiance variables. The observation process. also known as rendering, is modeled by a non-affine projection (e.g. perspective projection) followed by a convolution with a piecewise linear point spread function. and contamination by additive Gaussian noise. We assume that the observation parameters are calibrated beforehand. The major novelty of the proposed method consists of marginalizing out the irradiances considered as nuisance parameters, which is achieved by Laplace approximations. This reduces the inference to minimizing an energy that only depends on the shape vertices, and therefore allows an efficient Iterated Conditional Mode (ICM) optimization scheme to be implemented. A Gaussian approximation of the posterior shape density is computed, thus providing estimates both the geometry and its uncertainty. We illustrate the effectiveness of the new method by shape reconstruction results in a 2D case. A 3D version is currently under development and aims at recovering a surface from multiple images, reconstructing the topography by marginalizing out both albedo and shading.

Jalobeanu, Andre↗

NASA Tech Briefs, March 2010

Topics covered include: Software Tool Integrating Data Flow Diagrams and Petri Nets; Adaptive Nulling for Interferometric Detection of Planets; Reducing the Volume of NASA Earth-Science Data; Reception of Multiple Telemetry Signals via One Dish Antenna; Space-Qualified Traveling-Wave Tube; Smart Power Supply for Battery-Powered Systems; Parallel Processing of Broad-Band PPM Signals; Inexpensive Implementation of Many Strain Gauges; Constant-Differential-Pressure Two-Fluid Accumulator; Inflatable Tubular Structures Rigidized with Foams; Power Generator with Thermo-Differential Modules; Mechanical Extraction of Power From Ocean Currents and Tides; Nitrous Oxide/Paraffin Hybrid Rocket Engines; Optimized Li-Ion Electrolytes Containing Fluorinated Ester Co-Solvents; Probabilistic Multi-Factor Interaction Model for Complex Material Behavior; Foldable Instrumented Bits for Ultrasonic/Sonic Penetrators; Compact Rare Earth Emitter Hollow Cathode; High-Precision Shape Control of In-Space Deployable Large Membrane/Thin-Shell Reflectors; Rapid Active Sampling Package; Miniature Lightweight Ion Pump; Cryogenic Transport of High-Pressure-System Recharge Gas; Water-Vapor Raman Lidar System Reaches Higher Altitude; Compact Ku-Band T/R Module for High-Resolution Radar Imaging of Cold Land Processes; Wide-Field-of-View, High-Resolution, Stereoscopic Imager; Electrical Capacitance Volume Tomography with High-Contrast Dielectrics; Wavefront Control and Image Restoration with Less Computing; Polarization Imaging Apparatus; Stereoscopic Machine-Vision System Using Projected Circles; Metal Vapor Arcing Risk Assessment Tool; Performance Bounds on Two Concatenated, Interleaved Codes; Parameterizing Coefficients of a POD-Based Dynamical System; Confidence-Based Feature Acquisition; Algorithm for Lossless Compression of Calibrated Hyperspectral Imagery; Universal Decoder for PPM of any Order; Algorithm for Stabilizing a POD-Based Dynamical System; Mission Reliability Estimation for Repairable Robot Teams; Processing AIRS Scientific Data Through Level 3; Web-Based Requesting and Scheduling Use of Facilities; AutoGen Version 5.0; Time-Tag Generation Script; PPM Receiver Implemented in Software; Tropospheric Emission Spectrometer Product File Readers; Reporting Differences Between Spacecraft Sequence Files; Coordinating "Execute" Data for ISS and Space Shuttle; Database for Safety-Oriented Tracking of Chemicals; Apparatus for Cold, Pressurized Biogeochemical Experiments; Growing B Lymphocytes in a Three-Dimensional Culture System; Tissue-like 3D Assemblies of Human Broncho-Epithelial Cells; Isolation of Resistance-Bearing Microorganisms; Oscillating Cell Culture Bioreactor; and Liquid Cooling/Warming Garment.

Source record↗

Situational Awareness from a Low-Cost Camera System

A method gathers scene information from a low-cost camera system. Existing surveillance systems using sufficient cameras for continuous coverage of a large field necessarily generate enormous amounts of raw data. Digitizing and channeling that data to a central computer and processing it in real time is difficult when using low-cost, commercially available components. A newly developed system is located on a combined power and data wire to form a string-of-lights camera system. Each camera is accessible through this network interface using standard TCP/IP networking protocols. The cameras more closely resemble cell-phone cameras than traditional security camera systems. Processing capabilities are built directly onto the camera backplane, which helps maintain a low cost. The low power requirements of each camera allow the creation of a single imaging system comprising over 100 cameras. Each camera has built-in processing capabilities to detect events and cooperatively share this information with neighboring cameras. The location of the event is reported to the host computer in Cartesian coordinates computed from data correlation across multiple cameras. In this way, events in the field of view can present low-bandwidth information to the host rather than high-bandwidth bitmap data constantly being generated by the cameras. This approach offers greater flexibility than conventional systems, without compromising performance through using many small, low-cost cameras with overlapping fields of view. This means significant increased viewing without ignoring surveillance areas, which can occur when pan, tilt, and zoom cameras look away. Additionally, due to the sharing of a single cable for power and data, the installation costs are lower. The technology is targeted toward 3D scene extraction and automatic target tracking for military and commercial applications. Security systems and environmental/ vehicular monitoring systems are also potential applications.

Freudinger, Lawrence C.↗

Three-dimensional echocardiographic planimetry of maximal regurgitant orifice area in myxomatous mitral regurgitation: intraoperative comparison with proximal flow convergence

OBJECTIVES: We sought to validate direct planimetry of mitral regurgitant orifice area from three-dimensional echocardiographic reconstructions. BACKGROUND: Regurgitant orifice area (ROA) is an important measure of the severity of mitral regurgitation (MR) that up to now has been calculated from hemodynamic data rather than measured directly. We hypothesized that improved spatial resolution of the mitral valve (MV) with three-dimensional (3D) echo might allow accurate planimetry of ROA. METHODS: We reconstructed the MV using 3D echo with 3 degrees rotational acquisitions (TomTec) using a transesophageal (TEE) multiplane probe in 15 patients undergoing MV repair (age 59 +/- 11 years). One observer reconstructed the prolapsing mitral leaflet in a left atrial plane parallel to the ROA and planimetered the two-dimensional (2D) projection of the maximal ROA. A second observer, blinded to the results of the first, calculated maximal ROA using the proximal convergence method defined as maximal flow rate (2pi(r2)va, where r is the radius of a color alias contour with velocity va) divided by regurgitant peak velocity (obtained by continuous wave [CW] Doppler) and corrected as necessary for proximal flow constraint. RESULTS: Maximal ROA was 0.79 +/- 0.39 (mean +/- SD) cm2 by 3D and 0.86 +/- 0.42 cm2 by proximal convergence (p = NS). Maximal ROA by 3D echo (y) was highly correlated with the corresponding flow measurement (x) (y = 0.87x + 0.03, r = 0.95, p < 0.001) with close agreement seen (AROA (y - x) = 0.07 +/- 0.12 cm2). CONCLUSIONS: 3D echo imaging of the MV allows direct visualization and planimetry of the ROA in patients with severe MR with good agreement to flow-based proximal convergence measurements.

NASA Discipline Cardiopulmonary↗

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Observations of atmospheric 3D winds are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we compare state-of-the-art convolutional neural networks for optical flow in a physics-guided deep learning framework for predicting AMVs. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

Geostationary↗

Electrodynamic Dust Shield (EDS) Preparation for MISSE-11 Launch

The dusty surfaces of the Moon, Mars, and various asteroids present a significant challenge to NASA’s manned and unmanned space exploration efforts. The fine, electrostatically charged dust is difficult to remove and has resulted in vision obscuration, false instrument readings, contamination, elevated temperatures, performance reduction, and equipment failure. To alleviate these problems, NASA KSC’s Electrostatics and Surface Physics Laboratory (ESPL) is developing active dust mitigation systems for solar system exploration and in situ resource utilization (ISRU). Part of KSC’s Swamp Works system, the lab emphasizes fast-paced, hands-on, cost-effective, and collaborative innovation. The Electrodynamic Dust Shield (EDS) is an ESPL technology being developed to prevent dust accumulation on space components. It consists of a dielectric substrate embedded with parallel electrodes which, when applied with high voltage out-of-phase waveforms, produce a traveling electric field wave that scatters dust particles from its surface via dielectrophoretic and electrostatic forces. The EDS is currently fully functional and has been tested for scalability and endurance in reduced gravity/pressure flight. Next, it will be part of the May 2019 Materials International Space Station Experiment-11 (MISSE-11) payload, which will test small shield samples for performance durability with exposure to the harsh space environment. The summer objective was to test EDS functionality before active and passive dust shield samples launch on MISSE-11, in order to screen for good flight/control samples as well as to compare pre-flight and post-flight clearing efficiencies. I imaged glass and Kapton shields of 2-phase and 3-phase electrode configurations with the Keyence VHX-5000 digital microscope to check for damage before and after all testing for a qualitative pre-flight baseline; helped with vacuum testing of high-voltage shield breakdown; assembled shields and wires using Electrobond 004 silver epoxy; and helped with vacuum and cryogenic dust clearance testing of assembled EDS systems. I learned CAD (computer-aided design) and 3D printing skills to create parts for a shaker table/motor assembly, which will allow for repeatable experiments by evening out EDS dust distribution in a consistent manner prior to dust scattering testing. I will also be improving the interfacing with Alpha Space’s prototype Data Communications Unit (DCU), a payload component to control power to the EDS and store data, by mapping the DCU structure upon power-up and writing shell scripts to improve various processes. Finally, I also CADed and 3D-printed plastic supports for three different geometries of the Electrostatic Precipitator (ESP), a project that aims to use high voltage electrodes to charge and filter out dust from the Martian atmosphere drawn for ISRU devices. This work on dust mitigation technologies will help to support future robotic and human space exploration missions, including NASA’s Journey to Mars; the EDS has especially significant applications to spacecraft solar panels, thermal radiators, viewports, and astronaut visors. This opportunity has also allowed me to become more familiar with various lab equipment and hardware testing, develop key modeling skills in SolidWorks, explore past and present components critical to America’s space program, work with inspiring peers and mentors, and ascertain my dream of working permanently for NASA.

space↗

NASA NeMO-Net

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low- resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

NASA↗