Search NASA⌕ Search

SEARCH · Search NASA

Results for “video processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Some Aeronautical Communications Experiments

Classically there has existed an asymmetry between the computing and communicating sides of aerospace systems. Over the past few decades, this asymmetry has shifted to favoring communication link technologies, meaning that advancements in available central processing units (CPUs), storage devices, and internal data buses have stagnated. Indeed, the increased emphasis placed on refining subsystem performance such as with antenna bandwidth in phased arrays, amplifier power efficiency, software defined radio (SDR) flexibility and encoding for data compression and error correction has given rise to successful debuts of multi-gigabit-per-second data return from long space-link distances. These accomplishments are easily quantifiable through link budgets and illustrate what is possible, but also reveal the deficiencies in overall communications capabilities. In particular, the ever-accelerating presence of aerospace vehicles gives rise to newer and larger classes of challenges to address the needs of 21st century systems. Furthermore remote sensing and imaging capabilities have far outpaced our ability to transmit their products to the ground, so we are increasingly dependent on pre-processing and downselection to contend with the communications bottleneck. No longer may we depend upon the constrained logistics in delivering end-to-end data delivery through manual reconfigurations, static event scheduling and execution on a per-vehicle basis, for these methods do not scale and therefore must give way to dynamic, networked approaches with an overall systems view in mind. Emerging mission requirements exhibit a trend toward multiple smaller-scale vehicles working together to perform dissimilar observations. Such operations necessitate sensor fusion across a constellation, and where data processing may be distributed throughout a fairly disconnected network whose topology changes over time in non-deterministic manners. Individual communications link performance is still very relevant to deploying an effective communications system, but now must be embedded within a greater architecture of capability to optimally utilize the bandwidth available from each link to generate an ultimate end-to-end quality of service. The deleterious effects of timing uncertainty across the arrangement presents a challenge to measurement synchronization and delivery, so a successful deployed system needs to be tolerant to the delays inherent in time-of-light between elements and digital processing latencies existing at each node. In this presentation we share the flight test results from a high performance Gbps laser communications terminal evaluated with a suite of store and forward capabilities called High-rate Delay Tolerant Networking (HDTN). The communications payload is operated over Lake Erie across a range of configurations including several convergence layers, and is evaluated to determine recovery time after link disruptions, information loss, efficiency and speed. The effectiveness of utilizing a flying laboratory to increase the Technology Readiness Level (TRL) of an integrated system in relevant environments is discussed, as well as the value of conducting aeronautics experiments to retire risk for technology infusion into space missions. Upcoming flight campaigns will be presented, including opportunities to demonstrate secure command and control, data intensive hyperspectral imaging, quantum link characterization, 4k High Definition (HD) video streaming and internetworked space-ground-aero relay operations. These experiments will pave the way for future missions which will depend upon interoperability across disparate government and privately owned networks, involve contention with uncertain and dynamic timing, and require agility to autonomously configure optimal parameters across networks of ever-increasing size and complexity to ensure data delivery. https://www1.grc.nasa.gov/space/scan/acs/tech-studies/dtn/

Daniel Raible↗

The Effect of Penetration Depth on Thermal Contrast of NDT by Thermography

Nondestructive evaluation by Thermography (TNDE) is generally classified into two categories, the passive approach and the active approach. The passive approach is usually performed by measuring the natural temperature difference between the ambient and the material or structure to be tested. The active approach, on the other hand, requires the application of an external energy source to stimulate the material for inspection. A laser, a heater, a hot air blower, a high power thermal pulse, mechanical, or electromagnetic energy may provide the energy sources. For the external heating method to inspect materials for defects and imperfection at ambient temperature, a very short burst of heat can be introduced to one of the surfaces or slow heating of the side opposite to the side being observed. Due to the interruption of the heat flow through the defects, the thermal images will reveal the defective area by contrasting against the surrounding good materials. This technique is called transient Thermography, pulse video Thermography, or thermal wave imaging. As an empirical rule, the radius of the smallest defect should be at least one to two times larger than its depth under the surface. Thermography is being used to inspect void, debond, impact damage, and porosity in composite materials. It has been shown that most of the defects and imperfection can be detected. However, the current method of inspection using thermographic technique is more of an art than a practical scientific and engineering approach. The success rate of determining the defect location and defect type is largely depend on the experience of the person who operates thermography system and performs the inspection. The operator has to try different type of heat source, different duration of its application time, as well as experimenting with the thermal image acquisition time and interval during the inspection process. Further-more, the complexity of the lay-up and structure of composites makes it more difficult to determine the optimal operating condition for revealing the defects. In order to develop an optimal thermography inspection procedure, we must understand the thermal behavior inside the material subjected to transient heat in order to interpret the thermal images correctly. Fabrication of finite element models of characteristic defects in composite materials subjected to transient heat will enable the development of appropriate procedure for thermography inspection. Design of phantom defects could be modeled and behavior characterized prior to physically building these test parts. Since production of phantom test parts can be very time consuming and laborious, it is important to design good representative defects.

Chu, Tsuchin Philip↗

Modifying a Commercial Centrifuge to Reduce Electromagnetic Interference and Evaluating Functionality of Ultrasound Equipment

The Project Management and Engineering Branch (SF4) supports the Human Health and Performance Directorate (HH&P) and is responsible for developing and supporting human systems hardware for the International Space Station (ISS). When a principal investigator's (PI) medical research project on the ISS is accepted, SF4 develops the necessary hardware and software to transport to the ISS. The two projects I primarily worked on were the centrifuge and ultrasound projects. Centrifuge: One concern with spacecraft such as the ISS is electromagnetic interference (EMI) from onboard equipment, typically from radio waves (frequencies of ~3 kHz to ~300 GHz), which can negatively affect nearby circuitry. Standard commercial centrifuges produce EMI above safety limits, so my task was to help reduce EMI production from this equipment. Two centrifuges were tested: one unmodified as a control and one modified. To reduce EMI below safety limits, one centrifuge was modified to become a Faraday shield, in which significant electrical contact was made between all regions of the centrifuge housing. This included removing non-conductive paint, applying conductive fabric to the lid and foam sealer, adding a 10,000 μF decoupling capacitor across the power supply, and adding copper adhesive-mount gaskets to the housing interior. EMI testing of both centrifuges was performed in the EMI/EMC Control Test and Measurement Facility. EMI for both centrifuges was below safety limits for frequencies between 10 MHz and 15 GHz (pass); however, between 14 kHz and 10 MHz, EMI for the unmodified centrifuge exceeded safety limits (fail) as expected. Alternatively, for the modified centrifuge with the Faraday shield, EMI was below the safely limit of 55 dBμV/m for electromagnetic frequencies between 14 kHz and 10 MHz. This result indicates our modifications were successful. The successful EMI test allowed us to communicate with the vendor what modifications they needed to make to their commercial unit to meet our specifications and to understand what needs to be done in lab to the new centrifuge. Our modifications will provide a standard for readying centrifuges for future missions. Once the new modified centrifuge arrives by the vendor, it will need to undergo EMI testing again for validation. The centrifuge is also in the process of compatibility testing with a custom stowage drawer, which is an ongoing project in SF4. Both of these items will be payloads on future missions to the ISS for various research purposes. Ultrasound: ISS currently has an onboard ultrasound (Ultrasound 2 system) for research and medical purposes. Every piece of medical flight hardware has an equivalent ground-unit so instrumentation can be routinely evaluated and transported to the ISS if necessary. The ground-unit ultrasound equipment must be evaluated every six months using a task performance sheet (TPS). A TPS is a document, written by the appropriate scientists and engineers, which describes how to run equipment and is written in such a way that astronauts with unspecialized training can follow the tasks. I was responsible for performing six TPSs on a combination of three ultrasounds and two video power converters (VPCs). Performing a TPS involves checking out and computationally documenting each piece of equipment removed from storage locations, setting up hardware and software, performing tasks to verify functionality, returning equipment, and logging items back into the computerized system. My work revealed all ground-unit ultrasounds were functioning properly. Because of proper function, a discrepancy report (DR) did not have to be opened. The TPS was then passed along to the Quality Engineering (QE) for review and ultimately given to Quality Assurance (QA). Other projects: In addition to my main projects, I participated in other tasks including troubleshooting an EEG headband, volunteering for an ultrasound training research study, and conformal coating printed circuit boards. My internship at SF4 has helped me understand how space systems hardware development for the ISS fits into NASA's mission and vision.

Greening, Gage J.↗

The Origin of Chondrites: Metal-Silicate Separation Experiments Under Microgravity Conditions, Experiment 2

Chondrites are categorized into different groups by several properties, including the metal-to-silicate ratio. Various processes have been suggested to produce distinct metal/silicate ratios, some based on sorting in the early solar nebular and others occurring after accretion on the parent body. Huang et al. suggested that a weak gravitational field accompanied by degassing, could result in metal/silicate separation on parent bodies. We suggest that asteroids were volatile-rich, at least early in their histories. Spectroscopic evidence from asteroid surfaces indicates that one-third of all asteroids maybe rich in clays and hydrated minerals, similar to carbonaceous chondrites. Internal and/or external heating could have caused volatiles to evaporate and pass through a surface dust layer. Spacecraft images of asteroids show they have a thick regoliths. Housen, and Asphaug and Nolan proposed that even a 10 km diameter asteroid could potentially have a significant regolith. Grain size and grain density sorting could occur in the unconsolidated layer by the process known as fluidization. This process occurs when an upward stream of gas is passed through a bed of particles which are lifted against a gravitational force. Fluidization is commonly used commercially to sort particulates. This type of behavior is based upon the bed, as a whole, and differs from aerodynamic sorting. Two sets of reduced gravity experiments were conducted during parabolic flights aboard NASA's KC-135 aircraft. The first experiment employed 310 tubes of 2.5 cm diameter, containing mixtures of sand and metal grains. A gas source was used to fluidize the mixture at reduced gravity conditions and mixtures were analyzed after the flight. However, this experiment did not allow a description of the fluidization as a function of gravity. A second experiment was conducted on the KC-135 aircraft in the summer of 2001, consisting of two Plexiglas cylinders containing a metal/silicate mixture, and video cameras to record the experiment on tape. Here we summarize this experiment and discusses the implications for metalsilicate separation on asteroid bodies.

Moore, S. R.↗

Dynamic Mode Decomposition of Unsteady Pressure-Sensitive Paint Measurements for the NASA Unitary Plan Wind Tunnel Tests

This paper describes the Dynamic Mode Decomposition (DMD) of the pressures on the scale model of the Space Launch System (SLS) Block 1 cargo vehicle with the Unsteady Pressure-Sensitive Paint (uPSP) measurements, which were collected in the Ascent Transient Aerodynamics Tests with the Unitary Plan Wind Tunnel 11-by-11-foot Transonic Wind Tunnel in September 2019 at NASA Ames Research Center. The work described in this paper is a part of NASA’s development of a new state-of-the-art uPSP capability in production wind tunnels. The conventional DMD algorithm is based on the Singular Value Decomposition (SVD) of the data matrix. For the matrix of the uPSP measurements of the SLS ATAT, the number of rows is equal to the number of nodes in the grid of the scale model, and the number of columns is equal to the number of frames in the videos taken with 4 Phantom high-speed cameras. In this paper, it is verified that, for the time series with zero mean value, the DMD is equivalent to the decomposition with the Discrete Fourier Transform (DFT). Considering the uPSP is mainly used in the assessment of the unsteady, aerodynamic phenomena, the DMD of the uPSP measurements can be implemented in two steps: (1) subtract the mean value from the uPSP measurement on each of the grid nodes; (2) apply the Fast Fourier Transform (FFT) on the resulting zero-mean time series. The DMD of the uPSP measurements with FFT has two advantages: (1) the computational complexity of FFT is O(N*logN), where N is the length of the time series; (2) compared to the SVD-based DMD algorithm, the DMD with FFT can be easily implemented in parallel processing. A sample matrix of uPSP measurements, at the size of 341 grid nodes and 128 frames, is generated. Figures 1 and 2 show the eigenvalues and the ratios of the eigenvectors, respectively, of the sample matrix, without and with the mean value removed on each of the grid nodes, computed with the SVD-based DMD and the FFT. The figures demonstrate the equivalence of the SVD-based DMD and the decomposition with DFT/FFT for the time series with zero mean value. The results of DMD of the uPSP measurements of the SLS ATAT in September 2019 are presented in the paper. The DMD modes at different frequencies are shown, the aerodynamic phenomena (e.g. shockwave and vortex shedding) are demonstrated and the correlation of the DMD modes with the test configuration parameter (e.g., the Mach Number) is discussed. Figure 3 shows a software tool to visualize the DMD modes. The code to implement the algorithm described in this paper was written in C, with libraries of FFTW for FFT and MPI/OpenMP for parallel processing, and executed on the NASA Pleiades supercomputer. Funding for this research was provided by the NASA Aerosciences Evaluation and Test Capabilities Project.

Pressure-Sensitive Paint↗

The Effects of Gravity on Wrinkled Laminar Flames

The effects of gravity are significant to the dynamics of idealized unconfined open premixed flames. Moderate to low turbulence Reynolds number flames, i.e., wrinkled laminar flames, of various unconfined geometries have been used extensively for investigating fundamental processes of turbulent flame propagation and to validate theoretical models. Without the wall constraints, the flames are free to expand and interact with surrounding ambient air. The flow field in which the flame exists is determined by a coupling of burner geometry, flame orientation and the gravity field. These complex interactions raise serious questions regarding the validity of comparing the experimental data of open flames with current theoretical and numerical models that do not include the effects of gravity nor effects of the larger aerodynamic flowfield. Therefore, studies of wrinkled laminar flame in microgravity are needed for a better understanding of the role of gravity on flame characteristics such as the orientation, mean aerodynamics stretch, flame wrinkle size and burning rate. Our approach to characterize and quantify turbulent flame structures under microgravity is to exploit qualitative and quantitative flow visualization techniques coupled with video recording and computer controlled image analysis technologies. The experiments will be carried out in the 2.2 second drop tower at the NASA Lewis Research Center. The longest time scales of typical wrinkled laminar flames in the geometries considered here are in the order of 10 msec. Hence, the duration of the drop is sufficient to obtain the amount of statistical data necessary for characterize turbulent flame structures.

Kostiuk, Larry W.↗

Exploring Space on the Computer

For the past year Dennis Stocker has been in the process of developing pencil and paper games, which are fun, challenging, and educational for middle school and high school students. The latest version of these pencil and paper games is Spaceship Commander. The objective of the game is to earn points by plotting the flight path of a spaceship so astronauts can perform microgravity experiments, and make short-range measurements of other planets. During my ten weeks here at the GRC my goal is to create a computer based version of Spaceship commander. During the development of this game the primary focus has been on making it as educational and fun for the student as possible. The main educational objective of this game is to give students an understanding of forces and motion, including gravity. This is done by incorporating Newton's laws into the game. For example a spacecraft in the video game experiences a gravitational force applied to it by planets. The software I am using to create this game is a freeware application called Game Maker. Game Maker allows novice computer programmers like me to create arcade style games using a visual drag and drop interface. By using functions provided by Game Maker and a few I have written myself, I have been able to create a few simple computer games. Currently the computer game allows the student to navigate a space ship around planets, and asteroids by using the arrow keys on the numeric keypad. Each time an arrow key is pressed by the student the corresponding acceleration of the space ship is seen on the screen. Points are earned by navigating the space ship close enough to planets to gather scientific data. However the game encourages the student to plan his or her course carefully, because if the student gets too close to a planet they may not be able to escape the planet s gravity, and crash into the planet. The next step in the game development is to include a launch sequence which allows the student to launch from their home planet at a speed and direction determined by the student. Additional information is included in the original extended abstract.

Bozym, Patrick↗

NASA Tech Briefs, January 2007

Topics covered include: Flexible Skins Containing Integrated Sensors and Circuitry; Artificial Hair Cells for Sensing Flows; Video Guidance Sensor and Time-of-Flight Rangefinder; Optical Beam-Shear Sensors; Multiple-Agent Air/Ground Autonomous Exploration Systems; A 640 512-Pixel Portable Long-Wavelength Infrared Camera; An Array of Optical Receivers for Deep-Space Communications; Microstrip Antenna Arrays on Multilayer LCP Substrates; Applications for Subvocal Speech; Multiloop Rapid-Rise/Rapid Fall High-Voltage Power Supply; The PICWidget; Fusing Symbolic and Numerical Diagnostic Computations; Probabilistic Reasoning for Robustness in Automated Planning; Short-Term Forecasting of Radiation Belt and Ring Current; JMS Proxy and C/C++ Client SDK; XML Flight/Ground Data Dictionary Management; Cross-Compiler for Modeling Space-Flight Systems; Composite Elastic Skins for Shape-Changing Structures; Glass/Ceramic Composites for Sealing Solid Oxide Fuel Cells; Aligning Optical Fibers by Means of Actuated MEMS Wedges; Manufacturing Large Membrane Mirrors at Low Cost; Double-Vacuum-Bag Process for Making Resin- Matrix Composites; Surface Bacterial-Spore Assay Using Tb3+/DPA Luminescence; Simplified Microarray Technique for Identifying mRNA in Rare Samples; High-Resolution, Wide-Field-of-View Scanning Telescope; Multispectral Imager With Improved Filter Wheel and Optics; Integral Radiator and Storage Tank; Compensation for Phase Anisotropy of a Metal Reflector; Optical Characterization of Molecular Contaminant Films; Integrated Hardware and Software for No-Loss Computing; Decision-Tree Formulation With Order-1 Lateral Execution; GIS Methodology for Planning Planetary-Rover Operations; Optimal Calibration of the Spitzer Space Telescope; Automated Detection of Events of Scientific Interest; Representation-Independent Iteration of Sparse Data Arrays; Mission Operations of the Mars Exploration Rovers; and More About Software for No-Loss Computing.

Source record↗

On-orbit performance of the 12 GHz, 200 watt transmitter experiment package for CTS

Performance characteristics from on-orbit tests of the Transmitter Experiment Package (TEP) for the Communications Technology Satellite (CTS) are presented. The TEP consists of a Power Processing System (PPS), an Output Stage Tube (OST), and a Variable Conductance Heat Pipe System (VCHPS), all of which are described. The OST is a coupled-cavity traveling-wave tube with a multistage depressed collector and a stepped velocity-tapered slow-wave structure for efficiency enhancement. It has an RF output power of 240 W and an overall efficiency of 51.5% at a center band frequency of 12.080 GHz. The PPS provides the required operating voltages, regulation, control, and protection for the OST. It has a measured dc-dc conversion efficiency of 86.5% to 88.5%. The VCHPS consists of a fin radiator and three dual-artery stainless steel heat pipes using methanol and a mixture of inert gases. Test results presented include efficiencies, RF output power, frequency response, and performance with single and multiple (two) carriers frequency-modulated by video signals.

Alexovich, R. E.↗

Applicability of Micro X-Ray Fluorescence Spectroscopy to Astromaterials Curation and Research

Introduction: The Astromaterials Acquisition and Curation Office at NASA’s Johnson Space Center (JSC) curates NASA’s astromaterial sample collections which includes: Apollo samples, Luna samples, Ant-arctic meteorites, cosmic dust particles, microparticle impacts into space-flown materials, Genesis solar wind atoms, Stardust comet Wild-2 particles, Stardust inter-stellar particles, Hayabusa asteroid Itokawa particles, Hayabusa 2 asteroid Ryugu particles, and future OSIRIS-Rex asteroid Bennu particles (landing in Sep-tember, 2023) [1–3]. To enhance JSC’s advanced cu-ration capabilities, we have recently installed a high-performance micro-X-ray fluorescence (µXRF) spec-trometer to assist in sample characterization through rapid, non-destructive, in-situ elemental analyses that do not require the sample preparation protocols (i.e., polishing and carbon-coating) commonly needed for electron beam analyses. With this new instrument, we are capable of detecting all elements down to carbon in a variable-pressure or He-purged chamber for anal-ysis of a wide range of sample types. Here we describe the instrumental set-up, capabilities, and applicability of µXRF analysis to astromaterials curation and re-search. Instrumentation and Methodology: The X-ray fluorescence and computed tomography lab (X-FaCT) lab at JSC is now equipped with a Bruker M4 Tornado Plus µXRF (Fig. 1). This system is an energy-dispersive x-ray spectrometer equipped with two 60 mm2 silicon drift detectors (SDD) that are able to be used simulta-neously for output count rates ~500,000 cps. New light element windows allow detecting and analyzing the entire elemental range from carbon to americium. Two x-ray tubes (micro-focus Rh with polycapillary lenses and W with collimators of 0.5, 1.0, 2.0, and 4.5 mm) with max excitation parameters of 50 kV, 30 W and 50 kV, 40 W, respectively, allow for more flexibility of the analysis of high energy lines. The motorized X-Y-Z stage has a mapping range of 190 x 160 mm and can support samples up to 7 kg (~15.5 lbs) and a height of 120 mm [4]. Analytical modes include elemental analysis (down to ~20 µm spot size) via point, line, or area of bulk materials (rock surfaces, thin sections, thick sections, etc.) as well as coating analysis (determination of thickness and composition) of samples. This system has a variable vacuum chamber (1 mbar to 1 atm) that is also equipped with a He-purge system which accommodates vacuum sensitive samples while still allowing detection of light elements at atmospheric pressure. Utility and Applicability of µXRF in Astro-materials research and exploration science (ARES): Elemental analysis using µXRF is commonly em-ployed for both terrestrial and planetary geological science disciplines [5]. It is especially useful for analy-sis of astromaterials given the limited sample prepara-tion required, which is not feasible for certain materi-als. Here we show select applications of µXRF anal-yses of astromaterials that can, have, and will be done at JSC’s X-FaCT lab. Point analysis: In-situ spot analyses (~20 µm spot size) on a cut slab of Martian meteorite NWA 10922 allowed for the discovery, qualitative elemental analy-sis and determination of different feldspar minerals [6]. These point analyses served as an effective prelim-inary step for subsequent quantitative analyses. Ana-lytical standards can be employed for more accurate quantification of µXRF spot analyses. Area analysis: This analytical mode measures all detectable elements (from C to Am) at each pixel (>5 µm pixel size) in a user-defined area. The results are shown as elemental maps which can be extracted as 16-bit TIFF’s for further data processing. In Fig. 2. we show elemental distribution maps of the high-Ti basalt 73001,531 that have been processed using ImageJ software. From these maps you can accurately and quickly (this map took ~50 mins.) identify mineral components, such as pyroxene, plagioclase, oxides, and phosphates, compositional zoning, and mineral textures. Detection of high-Z phases: µXRF techniques are es-pecially effective at analyzing trace minerals with high-atomic-number (high-Z) elements because the high-energy characteristic X-rays used (relative to SEM EDS) allow for mapping of K lines in elements up to La (typically SEM maps use L X-ray lines for elements >Zn, and these can often have interferences). Thus, µXRF is especially suited for identifying minerals like zircon, baddeleyite, REE-rich phosphates, Fe-rich met-als, oxides, sulfides, and phosphides [4]. In Fig. 3 we show elemental distribution maps for 73001,530 where we are able to correlate the original video image with, Zr, Si, Y and Hf elemental maps together identi-fying the location of a zircon. In this location you would expect lower Si compared to surrounding mate-rial, as well as higher Zr, Y, and Hf content compared to surrounding material, all of which is confirmed by our XRF ele-mental distribution maps (Figure 2.) Conclusions: The new M4 Tornado Plus µXRF within the Astromaterials Acquisition and Curation office at NASA JSC allows for rapid and non-destructive elemental analysis of astromaterials with limited or no sample preparation. µXRF analyses pro-vide crucial compositional knowledge for the prelimi-nary examination and curation of astromaterials. This instrument enhances the advanced curation capabili-ties in the X-FaCT laboratory at JSC by allowing pro-ductive, cohesive, and non-destructive multi-modal x-ray analyses on astromaterial samples, which is neces-sary for the comprehensive curation and study of our current and future astromaterial collections. Addition-ally, µXRF can provide complimentary information to researchers for studies on astromaterials. References: [1] Allen, C. et al., (2011). Chemie De Erde Geochemistry, 71, 1-20. [2] McCubbin, F. M. et al., (2016) 47th LPSC, abstract #2668 [3] Zeigler, R. A. et al., (2017) 48th LPSC, abstract #2772 [4] Bruker User Manual [5] Young et al., (2016) Appl. Geochemistry, 72, 77-87 [6] Mor-ris, R. V. et al., (2023) 54th LPSC.

E W O'Neal↗

Instrumentation and robotic image processing using top-down model control

A top-down image processing scheme is described. A three-dimensional model of a robotic working environment, with robot manipulators, workpieces, cameras, and on-the-scene visual enhancements is employed to control and direct the image processing, so that rapid, robust algorithms act in an efficient manner to continually update the model. Only the model parameters are communicated, so that savings in bandwidth are achieved. This image compression by modeling is especially important for control of space telerobotics. The background for this scheme lies in an hypothesis of human vision put forward by the senior author and colleagues almost 20 years ago - the Scanpath Theory. Evidence was obtained that repetitive sequences of saccadic eye movements, the scanpath, acted as the checking phase of visual pattern recognition. Further evidence was obtained that the scanpaths were apparently generated by a cognitive model and not directly by the visual image. This top-down theory of human vision was generalized in some sense to the frame in artificial intelligence. Another source of the concept arose from bioengineering instrumentation for measuring the pupil and eye movements with infrared video cameras and special-purpose hardware.

Stark, Lawrence↗

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

The recent development of deep learning has been mostly focusing on Euclidean data, such as images, videos, audios, etc. However, most real-world information and relation are often expressed as graphs. To efficiently learn from graph data, graph convolutional networks (GCNs) emerge as a promising approach, showing advantages in several practical applications such as social network analysis, knowledge discovery, 3D modeling, motion capturing, etc. Real-world graphs are usually extremely large and imbalanced, posting significant performance demand and design challenges on the hardware dedicated for GCN inference. In this paper, we propose an architecture design called UW-GCN to accelerate graph convolutional network inference. To tackle the major performance bottleneck from workload imbalance, we propose dynamic neighborhood stealing and remote chunk shuffling techniques, relying on hardware flexibility to achieve hardware auto-tuning under negligible area or delay overhead. Specifically, UW-GCN is able to smartly profile the sparse graph pattern while continuously adjusting the workload distribution via routing reconfiguration among parallel processing elements (PEs). The ideal configuration is then reused in the remaining iterations. To the best of our knowledge, this is the first accelerator design particularly for GCN and the first work relying on hardware auto-tuning, which is normally based on software, to achieve near-optimal workload balance in processing sparse structures.

Geng, Tong↗

Integration of historical map and aerial imagery to characterize long-term land-use change and landscape dynamics: An object-based analysis via Random Forests

Tracking Earth’s past helps us to move from hindsight to foresight in seeking landscape sustainability, a pursuit aided by modern mapping capabilities but hindered by a dearth of historical landscape information. To fill the data gap and exemplify the use of old map for land-use change sciences, we combined a paper-based US civil war map and aerial photos to derive land-use history and landscape dynamics at fine scales for a region near Chancellorsville, VA, USA, from 1867 to 2014. We also tested how advanced algorithms—object-based analysis and random forests (RF)—could aid in data processing. Automatic classification of the 1867 map proved difficult, but its manual digitization could benefit from object-based image segmentation. Classifying digital aerial images was more accurate via the object-based than pixel-based method, but only if the images were segmented appropriately. In the object-based classification, spectral-based features were much more important than shape/geometry features, as ranked by RF. During the 147 years, 32% of the region changed in land type. Settlement and roads increased in extent by 1850% and 691%, respectively, and woodland decreased by 19%. These changes fragmented the landscape, altered the hydrological regime, and affected river morphology. The utility of old maps exemplified here provides an impetus for exploring and leveraging extant old maps or historical records to support land-use and global change research. Our study also connotes the importance of geotagging current data, such as photos and videos, that may serve as a baseline to document future landscape change.

Historical map, object-based, Random Forests, old ↗

Variability in Ocean Color Associated with Phytoplankton and Terrigenous Matter: Time Series Measurements and Algorithm Development at the FRONT Site on the New England Continental Shelf

Fronts in the coastal ocean describe areas of strong horizontal gradients in both physical and biological properties associated with tidal mixing and freshwater estuarine output (e.g. Simpson, 1981 and O Donnell, 1993). Related gradients in optically important constituents mean that fronts can be observed from space as changes in ocean color as well as sea surface temperature (e.g., Dupouy et al., 1986). This research program is designed to determine which processes and optically important constituents must be considered to explain ocean color variations associated with coastal fronts on the New England continental shelf, in particular the National Ocean Partnership Program (NOPP) Front Resolving Observational Network with Telemetry (FRONT) site. This site is located at the mouth of Long Island sound and was selected after the analysis of 12 years of AVHRR data showed the region to be an area of strong frontal activity (Ullman and Cornillon, 1999). FRONT consists of a network of modem nodes that link bottom mounted Acoustic Doppler Current Profilers (ADCPs) and profiling arrays. At the center of the network is the Autonomous Vertically Profiling Plankton Observatory (AVPPO) (Thwaites et al. 1998). The AVPPO consists of buoyant sampling vehicle and a trawl-resistant bottom-mounted enclosure, which holds a winch, the vehicle (when not sampling), batteries, and controller. Three sampling systems are present on the vehicle, a video plankton recorder, a CTD with accessory sensors, and a suite of bio-optical sensors including Satlantic OCI-200 and OCR-200 spectral radiometers and a WetLabs ac-9 dual path absorption and attenuation meter. At preprogrammed times the vehicle is released, floats to the surface, and is then winched back into the enclosure with power and data connection maintained through the winch cable. Communication to shore is possible through a bottom cable and nearby surface telemetry buoy, equipped with a mobile modem, giving the capability for near-real time data transmission and interactive sampling control.

Morrison, John R.↗

Orion MPCV GN and C End-to-End Phasing Tests

End-to-end integration tests are critical risk reduction efforts for any complex vehicle. Phasing tests are an end-to-end integrated test that validates system directional phasing (polarity) from sensor measurement through software algorithms to end effector response. Phasing tests are typically performed on a fully integrated and assembled flight vehicle where sensors are stimulated by moving the vehicle and the effectors are observed for proper polarity. Orion Multi-Purpose Crew Vehicle (MPCV) Pad Abort 1 (PA-1) Phasing Test was conducted from inertial measurement to Launch Abort System (LAS). Orion Exploration Flight Test 1 (EFT-1) has two end-to-end phasing tests planned. The first test from inertial measurement to Crew Module (CM) reaction control system thrusters uses navigation and flight control system software algorithms to process commands. The second test from inertial measurement to CM S-Band Phased Array Antenna (PAA) uses navigation and communication system software algorithms to process commands. Future Orion flights include Ascent Abort Flight Test 2 (AA-2) and Exploration Mission 1 (EM-1). These flights will include additional or updated sensors, software algorithms and effectors. This paper will explore the implementation of end-to-end phasing tests on a flight vehicle which has many constraints, trade-offs and compromises. Orion PA-1 Phasing Test was conducted at White Sands Missile Range (WSMR) from March 4-6, 2010. This test decreased the risk of mission failure by demonstrating proper flight control system polarity. Demonstration was achieved by stimulating the primary navigation sensor, processing sensor data to commands and viewing propulsion response. PA-1 primary navigation sensor was a Space Integrated Inertial Navigation System (INS) and Global Positioning System (GPS) (SIGI) which has onboard processing, INS (3 accelerometers and 3 rate gyros) and no GPS receiver. SIGI data was processed by GN&C software into thrust magnitude and direction commands. The processing changes through three phases of powered flight: pitchover, downrange and reorientation. The primary inputs to GN&C are attitude position, attitude rates, angle of attack (AOA) and angle of sideslip (AOS). Pitch and yaw attitude and attitude rate responses were verified by using a flight spare SIGI mounted to a 2-axis rate table. AOA and AOS responses were verified by using a data recorded from SIGI movements on a robotic arm located at NASA Johnson Space Center. The data was consolidated and used in an open-loop data input to the SIGI. Propulsion was the Launch Abort System (LAS) Attitude Control Motor (ACM) which consisted of a solid motor with 8 nozzles. Each nozzle has active thrust control by varying throat area with a pintle. LAS ACM pintles are observable through optically transparent nozzle covers. SIGI movements on robot arm, SIGI rate table movements and LAS ACM pintle responses were video recorded as test artifacts for analysis and evaluation. The PA-1 Phasing Test design was determined based on test performance requirements, operational restrictions and EGSE capabilities. This development progressed during different stages. For convenience these development stages are initial, working group, tiger team, Engineering Review Team (ERT) and final.

Neumann, Brian C.↗

Deep Learning for Automated Identification of Eels in Sonar Data

Freshwater eels, such as the American eel (Anguilla rostrata) present numerous challenges related to safe downstream fish passage at hydroelectric facilities. One of those challenges is effective monitoring of their abundance, movements, and behavior to facilitate design and operation of eel protection and passage facilities. A previous EPRI study documented the ability of human analysts to reliably identify American eels in data obtained with a 1100/1800 kHz, multibeam sonar. This report describes a project to develop deep learning (a subset of artificial intelligence) tools to automate the time-consuming, subjective process of eel identification in multibeam sonar data. The project exploited new data collected in the laboratory and the existing data from the prior EPRI field study to develop and test deep learning and other data analytic tools, including wavelet filtering, differencing for static object removal, and convolutional neural network analysis. The analysis of the laboratory data demonstrated feasibility of the approach, revealed object characteristics observed with the sonar that distinguish eels from similarly sized and shaped acoustic targets, and provided additional data for algorithm selection and training. Deep learning algorithms trained and tested on the laboratory data alone achieved accuracy rates of greater than 98% when classifying acoustic images of eels and similar-sized neutrally buoyant sticks. The algorithm trained and tested on the pre-existing field data alone, and yielded classification accuracy of 9.3% false positives and 13.3% false negatives when distinguishing between eels and sticks/PVC pipes based on video clips (i.e., multiple, consecutive images). This performance is comparable to the classification accuracy achieved by human analysts in the prior study. The deep learning algorithm trained on a combination of video clips obtained in the laboratory and the field and tested on video clips from the field, was able to distinguish eels from sticks and PVC pipes (a river debris analog) of similar size with 100% accuracy. Outreach to the hardware, software, and end-user communities early in the project helped to identify needs and specify the application space. Outreach to those communities at the end of the project communicated project results and opportunities for further development. The project achieved proof of concept for automated identification of eel in multibeam sonar data. Future work should focus on acquisition of additional data for more robust algorithm training and testing; modification of the software tools to accommodate multiple acoustic targets in the acoustic field at a given time; identification of additional object classes; incorporation of motion in the object identification and classification algorithms; operationalizing the software tools, including integration with other existing sonar data analysis tools; and partnering with hardware and software providers for distribution of the software tools with their commercial products.

13 HYDRO ENERGY↗

Positive-Buoyancy Rover for Under Ice Mobility

A buoyant rover has been developed to traverse the underside of ice-covered lakes and seas. The rover operates at the ice/water interface and permits direct observation and measurement of processes affecting freeze- over and thaw events in lake and marine environments. Operating along the 2- D ice-water interface simplifies many aspects of underwater exploration, especially when compared to submersibles, which have difficulty in station-keeping and precision mobility. The buoyant rover consists of an all aluminum body with two aluminum sawtooth wheels. The two independent body segments are sandwiched between four actuators that permit isolation of wheel movement from movement of the central tether spool. For normal operations, the wheels move while the tether spool feeds out line and the cameras on each segment maintain a user-controlled fixed position. Typically one camera targets the ice/water interface and one camera looks down to the lake floor to identify seep sources. Each wheel can be operated independently for precision turning and adjustments. The rover is controlled by a touch- tablet interface and wireless goggles enable real-time viewing of video streamed from the rover cameras. The buoyant rover was successfully deployed and tested during an October 2012 field campaign to investigate methane trapped in ice in lakes along the North Slope of Alaska.

Leichty, John M.↗

Statistical Characteristics of Raindrop Size Distributions and Parameters in Central China during the Meiyu Seasons

The rain parameters measured by the laser OTT Parsivel raindrop disdrometer (Parsivel), the two-dimensional video disdrometer (2DVD) and DZZ5 tipping-bucket rain gauge (RG) during the Integrative Monsoon Frontal Rainfall Experiment (IMFRE) in summer 2018 are compared. The total rain amounts observed by Parsivel, 2DVD, and RG during IMFRE are 178.07 mm, 176.76 mm and 182.5 mm, while their total rainy hours are 113, 113 and 90. The mean Dm (mass-weighted mean diameter) and liquid water content values derived from Parsivel and 2DVD are 0.9 mm and 1.02 mm, and 0.247 g m-3 and 0.223 g m-3, respectively, and Parsivel is more sensitive to small raindrops (< 1 mm) than 2DVD. The raindrop spectra measured by Parsivel and 2DVD have excellent agreement for both convective rain (CR) and stratiform rain (SR) within a range of Dm from 1 to 3.5 mm. The rain samples from six Parsivel sites over the middle reaches of the Yangtze River during the 2016–2018 meiyu seasons have been collected and processed. The frequency occurrences for rain rates (RR) < 5 and > 10 mm h-1 are 83.9% and 7.4%, respectively, but they contribute 30.5% and 52.1 % of the total accumulated rainfall. Comparing the results with those over the lower reaches, the RR and total accumulated rainfall over the middle reaches are greater, especially for heavy rainfall. The rain drop size distributions (DSDs) in this study are wider and have higher number concentration than those from the lower reaches.

Raindrop size distribution, Meiyu front, disdromet↗