Search NASA⌕ Search

SEARCH · Search NASA

Results for “Vision Tests”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
NASA NTRS2003

The Effectiveness of Various Attitude Indicator Display Sizes and Extended Horizon Lines on Attitude Maintenance in a Part-Task Simulation

Spatial disorientation (SD) is a constant contributing factor to the rate of fatal aviation accidents. SD occurs as a result of perceptual errors that can be attributed in part to the inefficient presentation of synthetic orientation cues via the attitude indicator when external visual conditions are poor. Improvements in the design of the attitude indicator may help to eliminate instrumentation as a factor in the onset of SD. The goal of the present study was to explore several display concepts that may contribute to an improved attitude display. Specifically, the effectiveness of various display sizes, some that are used in current and some that are anticipated in future attitude displays that may incorporate Synthetic Vision Systems (SVS) concepts, was assessed. In addition, a concept known as an extended horizon line or Malcolm Horizon (MH) was applied and evaluated. Paired with the MH, the novel concept of a fixed reference line representing the central horizontal plane of the aircraft was also tested. Subjects performance on an attitude control task and secondary math workload task was measured across the various display sizes and conditions. The results, with regard to display size, confirmed the bigger is better concept, yielding better performance with the larger display sizes. A clear and significant improvement in attitude task performance was found with the addition of the extended horizon line. The extended or MH seemed to equalize attitude performance across display sizes, even for a central or foveal display as small as three inches in width.

Comstock, J. Raymond, Jr.↗
NASA NTRS2001

Orientation processing mechanisms revealed by the plaid tilt illusion

The tilt after-effect (TAE) and tilt illusion (TI) have revealed a great deal about the nature of orientation coding of 1-dimensional (1D) lines and gratings. Comparatively little research however has addressed the mechanisms responsible for encoding the orientation of 2-dimensional (2D) plaid stimuli. A multi-stage model of edge detection has recently been proposed [Georgeson, M. A. (1998) Image & Vision Computing, 16(6-7), 389-405] to account for the perceived structure of a plaid stimulus that incorporates extraction of the zero-crossings (ZCs) of the plaid. Data is presented showing that the ZCs of a plaid inducing stimulus can interact with vertical grating test stimulus to induce a standard tilt illusion. However, by considering the second-order structure of a plaid rather than ZCs, it was shown that the perceived orientation of the vertical test grating results from the combination of orientation illusions due to the first- and second-order components of an inducing plaid. The data suggest that the mechanisms encoding the orientation of second-order contours are similar to, and interact directly with, those that encode first-order contours.

Orientation/physiology↗
NASA NTRS2004

NASA's Nuclear Frontier: The Plum Brook Reactor Facility, 1941-2002

In 1953, President Eisenhower delivered a speech called "Atoms for Peace" to the United Nations General Assembly. He described the emergence of the atomic age and the weapons of mass destruction that were piling up in the storehouses of the American and Soviet nations. Although neither side was aiming for global destruction, Eisenhower wanted to "move out of the dark chambers of horrors into the light, to find a way by which the minds of men, the hopes of men, the souls of men everywhere, can move towards peace and happiness and well-being." One way Eisenhower hoped this could happen was by transforming the atom from a weapon of war into a useful tool for civilization. Many people believed that there were unprecedented opportunities for peaceful nuclear applications. These included hopeful visions of atomic-powered cities, cars, airplanes, and rockets. Nuclear power might also serve as an efficient way to generate electricity in space to support life and machines. Eisenhower wanted to provide scientists and engineers with "adequate amounts of fission- able material with which to test and develop their ideas." But, in attempting to devise ways to use atomic power for peaceful purposes, scientists realized how little they knew about the nature and effects of radiation. As a result, the United States began constructing nuclear test reactors to enable scientists to conduct research by producing neutrons.

Bowles, Mark D.↗
NASA NTRSDate not supplied

VSLAM and Coplanar POSIT for Advanced Air Mobility Approach and Landing

Advanced Air Mobility (AAM) aircraft have many challenges for landing accurately and safely in urban, suburban, and rural environments. Localization in large and open rural environments could utilize GPS, but AAM aircraft in urban environments will encounter GPS degradation. Another challenge involves flight operation time, i.e., flying during the day or at night. There are different types of guidelines and landmarks at runways, heliports, and vertiports for daytime and nighttime applications. Tailoring feature detection methods for AAM approach and landing during the day and night pose different issues and challenges. It is easier to detect edges, lines, and other runway markers during the day than at night. Conversely, it is easier to detect landing light configurations and patterns at nighttime than daytime. Consequently, utilizing the same feature detector for daytime and nighttime operations may not be feasible. This paper focuses on vision-based precision approach and landing (PAL) and builds on previous work by comparing ORB SLAM, custom VSLAM, and coplanar pose from orthography and scaling with iterations (POSIT) for daytime and nighttime operations. Implementing high fidelity simulations with computer graphics and extracting video frames from flight test data provide promising results for AAM PAL applications.

Evan Kawamura↗
NASA NTRSDate not supplied

Validation Experiments for Turbulent Separation over an Axisymmetric Body of Revolution

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges to validating numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires data from advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed measurements of the flow field undergoing a smooth, adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states progressing from fully attached, to incipient separation, and finally to small-scale separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configurations of the axisymmetric model host a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation, as well as a slightly larger adverse pressure gradient, inducing a small-scale region of turbulent separation. Experiments include steady pressure measurements and 2-D PIV to provide the preliminary dataset for simulation studies, which examine the effect of variable grid domains and RANS turbulence models. This is done in an effort to understand and evaluate the critical variability between solutions for the present model configurations. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and slight variability in reference parameters. Ongoing work will focus on higher fidelity experimental campaigns to obtain surface flow visualizations and Stereo-Particle Image Velocimetry (SPIV) to deliver higher spatial resolution of the three-dimensional flow field to aid turbulence modelers.

Validation↗
DOE OSTI2024

ThermoPore: Predicting part porosity based on thermal images using deep learning

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R 2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.

Deep learning↗
NASA NTRS1992

An experiment in vision based autonomous grasping within a reduced gravity environment

The National Aeronautics and Space Administration's Reduced Gravity Program (RGP) offers opportunities for experimentation in gravities of less than one-g. The Extravehicular Activity Helper/Retriever (EVAHR) robot project of the Automation and Robotics Division at the Lyndon B. Johnson Space Center in Houston, Texas, is undertaking a task that will culminate in a series of tests in simulated zero-g using this facility. A subset of the final robot hardware consisting of a three-dimensional laser mapper, a Robotics Research 807 arm, a Jameson JH-5 hand, and the appropriate interconnect hardware/software will be used. This equipment will be flown on the RGP's KC-135 aircraft. This aircraft will fly a series of parabolas creating the effect of zero-g. During the periods of zero-g, a number of objects will be released in front of the fixed base robot hardware in both static and dynamic configurations. The system will then inspect the object, determine the objects pose, plan a grasp strategy, and execute the grasp. This must all be accomplished in the approximately 27 seconds of zero-g.

Grimm, K. A.↗
DOE OSTI2025

Computer Vision Pipeline for Image Analysis for Freeze‐Fracture Electron Microscopy: Rosette Cellulose Synthase Complexes Case

In materials science, plant biology, agriculture, and environmental research, the automated analysis of high-magnification, complex microscopy images, such as those generated by freeze-fracture electron microscopy (FF-TEM), remains a critical challenge that limits the scalability of data interpretation. We present a deep learning computer vision pipeline for high-throughput detection and morphological characterization analysis of cellulose synthase complexes (CSCs, or rosettes) in FF-TEM images. The pipeline integrates preprocessing, detection, human-in-the-loop verification, and semantic segmentation to quantify features such as rosette diameter and inter-lobe spacing. The approach was trained and tested on a curated dataset of high-resolution FF-TEM micrographs of Physcomitrium patens, expanded via strategic tiling and augmentation to over 650 images. We compare YOLOv8 and YOLOv9 architectures and demonstrate that YOLOv9 achieves superior performance in both localization accuracy (mAP50-95 = 0.854) and inference speed. The resulting distributions revealed biological variability consistent with prior manual studies, validating the approach for high-throughput applications. Our results show that the pipeline achieves human-expert level accuracy while dramatically reducing analysis time, enabling scalable, reproducible structural characterization of intramembrane protein complexes. The pipeline is broadly applicable to other domains requiring precise interpretation of complex microscopy data and establishes a foundation for future artificial intelligence (AI)-assisted workflows in biological imaging.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

NSTX-U – A national User Facility to close the key fusion gaps

This presentation lays out how the NSTX-U Research Program will help close the science and technology gaps for moving towards a Fusion Pilot Plant (FPP) and how this work is aligned with the Bold Decadal Vision. The science gap focuses on determining whether the good confinement trends in Spherical Tokamaks extends to lower collisionalities that are comparable to those expected in FPPs. The technology gap is one of mitigating the power exhaust in FPPs, and NSTX-U is uniquely positioned to test Liquid Metal components in the highest heat flux environment of any existing tokamak, spherical or otherwise.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1989

Autonomous sensor-based dual-arm satellite grappling

Dual-arm satellite grappling involves the integration of technologies developed in the Sensing and Perception (S&P) Subsystem for object acquisition and tracking, and the Manipulator Control and Mechanization (MCM) Subsystem for dual-arm control. S&P acquires and tracks the position, orientation, velocity, and angular velocity of a slowly spinning satellite, and sends tracking data to the MCM subsystem. MCM grapples the satellite and brings it to rest, controlling the arms so that no excessive forces or torques are exerted on the satellite or arms. A 350-pound satellite mockup which can spin freely on a gimbal for several minutes, closely simulating the dynamics of a real satellite is demonstrated. The satellite mockup is fitted with a panel under which may be mounted various elements such as line replacement modules and electrical connectors that will be used to demonstrate servicing tasks once the satellite is docked. The subsystems are housed in three MicroVAX II microcomputers. The hardware of the S&P Subsystem includes CCD cameras, video digitizers, frame buffers, IMFEX (a custom pipelined video processor), a time-code generator with millisecond precision, and a MicroVAX II computer. Its software is written in Pascal and is based on a locally written vision software library. The hardware of the MCM Subsystem includes PUMA 560 robot arms, Lord force/torque sensors, two MicroVAX II computers, and unimation pneumatic parallel grippers. Its software is written in C, and is based on a robot language called RCCL. The two subsystems are described and test results on the grappling of the satellite mockup with rotational rates of up to 2 rpm are provided.

Wilcox, Brian↗
NASA NTRS2016

Fluid Shifts: Otoacoustical Emission Changes in Response to Posture and Lower Body Negative Pressure

INTRODUCTION: The purpose of the NASA Fluid Shifts Study is to characterize fluid distribution and compartmentalization associated with long-duration spaceflight and to correlate these findings with vision changes and other elements of the visual impairment and intracranial pressure (VIIP) syndrome. VIIP signs and symptoms, as well as postflight lumbar puncture data, suggest that elevated intracranial pressure (ICP) may be associated with spaceflight-induced cephalad fluid shifts, but this hypothesis has not been tested. Due to the invasive nature of direct measures of ICP, a noninvasive technique of monitoring ICP is desired for use during spaceflight. The phase angle and amplitude of otoacoustic emissions (OAEs) have been shown to be sensitive to posture change and ICP (1, 2), therefore use of OAEs is an attractive option. OAEs are low-level sounds produced by the sensory cells of the cochlea in response to auditory stimulation. These sounds travel peripherally from the cochlea, through the oval window, to the ear canal where they can be recorded. OAE transmission is sensitive to changes in the stiffness of the oval window, occurring as a result of changes in cochlear pressure. Increased stiffness of the oval window largely affects the transmission of sound from the cochlea at frequencies between 800 Hz and 1600 Hz. OAEs can be self-recorded in the laboratory or on the ISS using a handheld device. Our primary objectives regarding OAE measures in this experiment were to 1) validate this method during preflight testing of each crewmember (while sitting, supine and in head-down tilt position), and 2) determine if OAE measures (and presumably ICP) are responsive to lower body negative pressure and to spaceflight. METHODS: Distortion-product otoacoustic emissions (DPOAEs) and transient evoked otoacoustic emissions (TEOAEs) were recorded preflight using the Otoport Advance OAE system (Otodynamics Ltd., Hatfield, UK). Data were collected in four conditions (seated, supine, 15 degrees head down tilt (HDT), and 15 degrees HDT with lower body negative pressure (LBNP)) to produce a range of ICP in each subject and test the susceptibility of OAEs to LBNP. LBNP was induced using the Russian Chibis suit to produce the same fit and pressures that would be experienced inflight during Chibis LBNP trials. Similar trials have occurred inflight on the ISS. A comparative analysis of preflight and inflight phase measurements and magnitudes was completed in both broad and narrow band frequency ranges. RESULTS: TEOAE data demonstrated notable phase shifts from 859-1640 Hz when the seated baseline condition is compared to supine, HDT, and HDT plus Chibis conditions. Changes were particularly pronounced at low frequencies and were consistent with the expected ICP changes. Preflight DPOAE magnitude data revealed changes consistent with increased ICP in two conditions at 1414 Hz, where a magnitude change (relative to the seated condition) was seen in the HDT position and in HDT plus Chibis. DISCUSSION: OAEs revealed systematic changes in phase and magnitude throughout all test conditions (including use of Chibis LBNP) that were consistent with ICP changes. Results indicate that OAEs may provide a rapid noninvasive means of monitoring ICP changes. The first two subjects are projected to complete inflight testing on the ISS in early 2016, with the full complement of 10 subjects scheduled to be complete in 2018.

Melgoza, R.↗
NASA NTRS2016

Comparison of Cross Correlation and Optical Flow Methods for Processing Retroreflective and Natural Background BOS Data

Background oriented schlieren images have historically been generated by calculating the observed pixel displacement between an image pair using normalized cross-correlation methods. This work uses optical flow data reduction methods to solve the displacement fields. A well established method used in the computer vision community, optical flow is the apparent brightness motion in an image sequence. The regularization method of Horn and Schunck is used to create schlieren images using two data sets: a supersonic shockjet plume interaction at the NASA Ames Unitary Plan Wind Tunnel, and a transonic flight test of a T-38 using a naturally occurring background performed in conjunction with NASA Ames and Armstrong research centers. Results are presented and contrasted with those using normalized cross-correlation methods. The optical flow images are found to provided significantly more detail at a decreased computational time.

schlieren↗
NASA NTRSDate not supplied

Validation Experiments of Incipient Turbulent Separation over an Axisymmetric Afterbody

Historically, the flow physics involved with most turbulent separated flows have presented fundamental challenges in validation between experimental and numerical approaches. As recognized by the CFD Vision 2030 study commissioned by NASA, validation of Reynolds-averaged Navier-Stokes (RANS) models and other scale-resolving methods for turbulent separated flow requires the support of advanced, high-fidelity experiments designed specifically for CFD implementation. In accordance with this effort, a new test platform, referred to as the NASA Axisymmetric Afterbody, was designed to obtain detailed information of the flow field over a smooth body, undergoing adverse pressure gradient induced separation for a fixed Reynolds number, Re = 180,000. The parametric body offers a range of flow states from fully attached,incipient separation, to fully separated flow based on variable afterbody geometries. In an initial effort to evaluate RANS turbulence model capabilities, the present configuration of the axisymmetric model features a mild adverse pressure gradient over the contoured boattail section, inducing incipient turbulent separation. Experiments include steady pressure measurements to serve as preliminary comparisons to simulation studies, which examine the effect of variable grid domains and RANS turbulence models, in an effort to understand and evaluate the critical variability between solutions for the present configuration. Results indicate potential discrepancies may be due to the effect of the square tunnel test section walls, relatively large blockage ratio, and inconsistent reference parameters. Ongoing work will focus on the experimental campaigns to obtain surface flow visualizations and high-resolution, off-body flow field measurements using Stereoscopic Particle Image Velocimetry (SPIV) and Laser Doppler Velocimetry (LDV) techniques to provide a detailed benchmark dataset to aid turbulence modelers.

axisymmetric afterbody↗
NASA NTRS2015

Evalution of a DE-Identification Process for Ocular Imaging

Medical privacy of NASA astronauts requires an organized and comprehensive approach when data are being made available outside NASA systems. A combination of factors, including the uniquely small patient population, the extensive medical testing done on these individuals, and the relative cultural popularity of the astronauts puts them at a far greater risk to potential exposure of personal information than the general public. Therefore, care must be taken to ensure that the astronauts' identities are concealed. Magnetic Resonance Imaging (MRI) medical data is a recent source of interest to researchers concerned with the development of Visual Impairment due to Intracranial Pressure (VIIP) in the astronaut population. Each vision MRI scan of an astronaut includes 176 separate sagittal images that are saved as an "image series" for clinical use. In addition to the medical information these image sets provide, they also inherently contain a substantial amount of non-medical personally identifiable information (PII) such as-name, date of birth, and date of exam. We have shown that an image set of this type can be rendered, using free software, to give an accurate representation of the patient's face. This currently restricts NASA from dispensing MRI data to researchers in a deidentified format. Automated software programs, such as the Brain Extraction Tool, are available to researchers who wish to de-identify MRI sagittal brain images by "erasing" identifying characteristics such as the nose and jaw on the image sets. However, this software is not useful to NASA for vision research because it removes the portion of the images around the eye orbits, which is the main area of interest to researchers studying the VIIP syndrome. The Lifetime Surveillance of Astronaut Health program has resolved this issue by developing a protocol to de-identify MRI sagittal brain images using Showcase Premier, a DICOM (Digital Imaging and Communications in Medicine) software package. The software allows manual editing of one image from a patient's image set to be automatically applied to the entire image series. This new approach would allow a new level of access to untapped medical imaging data relating to VIIP that can be utilized by researchers while protecting the privacy of the astronauts. In the next step toward finalizing this technique, NASA clinical radiology consultants will test the images to verify removal of all metadata and PII.

LaPelusa, Michael B.↗
NASA NTRS1995

Simulator Investigation of Pilot Aids for Helicopter Terminal Area Operations with One Engine Inoperative

Two recent piloted simulation experiments have investigated advanced display concepts applied to civil transport helicopter terminal area operations. Civil Category A helicopter operations apply to multi-engine helicopters wherein a safe recovery (land or fly out) is required in the event of a single engine failure. The investigation used the NASA Ames Research Center Vertical Motion Simulator, which has a full six degrees of freedom, to simulate the flight task as closely as possible. The goal of these experiments was to use advanced cockpit displays to improve flight safety and enhance the mission performance of Category A terminal area operations in confined areas. The first experiment investigated the use of military display formats to assist civil rotorcraft in performing a Category A takeoff in confined terminal areas. Specifically, it addressed how well a difficult hovering backup path could be followed using conventional instruments in comparison to panel mounted integrated displays. The hovering backup takeoff, which enables pilots to land back to the confined area pad in the event of an engine failure, was chosen since it is a difficult task to perform. Seven NASA and Army test pilots participated in the experiment. Evaluations, based on task performance and pilot workload, showed that an integrated display enabled the pilot to consistently achieve adequate or desired performance with reasonable pilot workload. Use of conventional instruments, however, frequently resulted in unacceptable performance (poor flight path tracking), higher pilot workload, and poor situational awareness. Although OEI landbacks were considered a visual task, the improved performance on the backup portion, in conjunction with increased situational awareness resulting from use of integrated displays, enabled the pilots to handle an engine failure and land back safely. In contrast, use of conventional instruments frequently led to excessive rates of sink at touchdown. A second simulation (in progress - July - August) is being conducted to investigate the use of advanced displays to perform vertical and short takeoffs and landings. One Engine Inoperative trajectories, which were optimized based on safety of flight restrictions, are utilized. Based on comments from the first experiment and further analytic development, appropriate fly out and approach guidance was added. Displays include conventional instruments with raw data, and the following integrated displays: multi-view and side-view hover displays based on the Apache Pilot Night Vision System, and variations of the pathway-in-the-sky displays with a flight-path-vector, a leader and flight director modifications. Panel mounted and head-up displays are being evaluated. Engine modifications have been incorporated to simulate 30 second and 2 minute contingency power ratings. Evaluations are based on task performance and pilot workload. NASA, Army, FAA, and industry test pilots participated. Details concerning the design, conduct, and the results of the experiment will be reported in the proposed paper.

Iseler, Laura↗
NASA NTRS2015

AdvoCATE - User Guide

The basic vision of AdvoCATE is to automate the creation, manipulation, and management of large-scale assurance cases based on a formal theory of argument structures. Its main purposes are for creating and manipulating argument structures for safety assurance cases using the Goal Structuring Notation (GSN), and as a test bed and proof-of-concept for the formal theory of argument structures. AdvoCATE is available for Windows 7, Macintosh OSX, and Linux. Eventually, AdvoCATE will serve as a dashboard for safety related information and provide an infrastructure for safety decisions and management.

Safety Case↗
NASA NTRSDate not supplied

Mineralogy and Spectroscopy of Mount Etna Lava Flows as an Analogue to Venus

Reports of geologically recent volcanism at Venus [1–3] raise the question of whether Venus is actively resurfacing. Observing the venusian surface is difficult due to the planet’s thick, relatively opaque atmosphere, but emission from the surface is detectable via a few atmospheric windows in the near-infrared (NIR) around 1 μm [4]. Spectroscopy of rocks at these wavelengths varies due to its primary composition and the presence of secondary weathering products [2, 5, 6]. If degree of alteration can be tied to the spectroscopic response, then the weathering of the venusian surface can reveal its age and extent of recent volcanism [2, 7]. Mount Etna on Earth is a potential analogue to Venus that can aid our understanding. The composite volcano is currently active and exhibits a progression of dated lava flows with a range of textures (‘a‘¯a versus p¯ahoehoe flows) and degrees of alteration [8]. While not a perfect analogue due to differing weathering environments, Mount Etna represents a natural age progression of altered basaltic rock [8] that can provide a useful comparison to volcanic structures on Venus. Here we will determine if spectroscopy can determine the alteration state of these flows as a proxy for their age. Future missions to Venus such as VERITAS, En- Vision, and DAVINCI will observe the surface in NIR emissivity. Kirchhoff’s Law holds that e = 1−r, where e is the emissivity and r is the reflectance. NIR emissivity can be reliably calculated from reflectance measurements of rocks [9], so laboratory reflectance spectroscopy is useful to rapidly test potential Venus analogue materials.

Gabriel L. Eggers↗
DOE OSTI2024

Computer vision models enable mixed linear modeling to predict arbuscular mycorrhizal fungal colonization using fungal morphology

Abstract The presence of Arbuscular Mycorrhizal Fungi (AMF) in vascular land plant roots is one of the most ancient of symbioses supporting nitrogen and phosphorus exchange for photosynthetically derived carbon. Here we provide a multi-scale modeling approach to predict AMF colonization of a worldwide crop from a Recombinant Inbred Line (RIL) population derived from Sorghum bicolor and S. propinquum . The high-throughput phenotyping methods of fungal structures here rely on a Mask Region-based Convolutional Neural Network (Mask R-CNN) in computer vision for pixel-wise fungal structure segmentations and mixed linear models to explore the relations of AMF colonization, root niche, and fungal structure allocation. Models proposed capture over 95% of the variation in AMF colonization as a function of root niche and relative abundance of fungal structures in each plant. Arbuscule allocation is a significant predictor of AMF colonization among sibling plants. Arbuscules and extraradical hyphae implicated in nutrient exchange predict highest AMF colonization in the top root section. Our work demonstrates that deep learning can be used by the community for the high-throughput phenotyping of AMF in plant roots. Mixed linear modeling provides a framework for testing hypotheses about AMF colonization phenotypes as a function of root niche and fungal structure allocations.

59 BASIC BIOLOGICAL SCIENCES↗