Results for “landmark detection” — Page 3

DOE OSTI2024

Expression of a mammalian RNA demethylase increases flower number and floral stem branching in Arabidopsis thaliana

Abstract RNA methylation plays a central regulatory role in plant biology and is a relatively new target for plant improvement efforts. In nearly all cases, perturbation of the RNA methylation machinery results in deleterious phenotypes. However, a recent landmark paper reported that transcriptome‐wide use of the human RNA demethylase FTO substantially increased the yield of rice and potatoes. Here, we have performed the first independent replication of those results and demonstrated broader transferability of the trait, finding increased flower and fruit count in the model species Arabidopsis thaliana . We also performed RNA‐seq of our FTO‐transgenic plants, which we analyzed in conjunction with previously published datasets to detect several previously unrecognized patterns in the functional and structural classification of the upregulated and downregulated genes. From these, we present mechanistic hypotheses to explain these surprising results with the goal of spurring more widespread interest in this promising new approach to plant engineering.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2022

Lunar Rover Localization Using Craters as Landmarks

Onboard localization capabilities for planetary rovers to date have used relative navigation, by integrating combinations of wheel odometry, visual odometry, and inertial measurements during each drive to track position relative to the start of each drive. At the end of each drive, a “ground-in-the-loop” (GITL) interaction is used to get a position update from human operators in a more global reference frame, such as a map frame defined by orbital reconnaissance imaging of a large region around the rover’s current position. For Mars rovers, this typically has involved downlinking imagery from the rover mast cameras and using interactive visualization tools on Earth to register such images to the orbital reconnaissance images. For safety purposes, rover mission operations typically specify “keep out zones”, which human operators recognize as being unsafe in the orbital images. Autonomous rover drives are limited in distance so that accumulated relative navigation error does not risk the possibility of the rover driving into a keep out zone. The allowable autonomous drive distance in this mode of operation depends on the distribution of keep out zones and the accuracy of relative navigation; in practice, drive limits of a few hundred meters between GITL cycles are to be expected. Several rover mission concepts have recently been studied that require much longer drives between GITL cycles, particularly for the Moon. This includes lunar rover mission concepts that involve (1) driving mostly in sunlight at low latitudes, (2) driving in permanently shadowed regions near the south pole, and (3) a mixture of day and night driving in mid-latitudes. These concepts include total traverse distance requirements of up to 1,800 km in 4 Earth years, with individual drives of several kilometers between stops for downlink. These concepts require greater autonomy to minimize GITL cycles to enable such large range; onboard global localization is a key element of such autonomy. Multiple techniques have been studied in the past for onboard rover global localization, including radio navigation aiding from an orbiter, recognizing horizon landmarks that are known in a regional elevation map, and correlating a local elevation map created onboard the rover with a regional elevation map. These techniques all have drawbacks, including requiring an expensive extra mission element (navigation orbiter), unavailability of sufficient regional elevation map data, or limited accuracy in resulting position estimates (e.g. a few hundred meters with horizon landmarks). For the Moon, the ubiquitous craters offer another possibility, which involves mapping craters from orbit, then recognizing crater landmarks with cameras and/or a lidar onboard the rover. This approach is applicable everywhere on the Moon, does not require high resolution stereo imaging from orbit as some other approaches do, and has potential to enable position knowledge with order of 10 m accuracy at all times. This paper will provide more detail on our technical approach to crater-based lunar rover localization and will present initial results on crater detection using 3-D point cloud data from onboard lidar or stereo cameras and using shading cues in monocular onboard imagery.

Ono, M.↗

NASA NTRS2011

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions.

Blanson, Nina↗

NASA NTRS2012

Automatic Facial Expression Recognition and Operator Functional State

The prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions

Blanson, Nina↗

NASA NTRS2005

Automated Image Registration Using Morphological Region of Interest Feature Extraction

With the recent explosion in the amount of remotely sensed imagery and the corresponding interest in temporal change detection and modeling, image registration has become increasingly important as a necessary first step in the integration of multi-temporal and multi-sensor data for applications such as the analysis of seasonal and annual global climate changes, as well as land use/cover changes. The task of image registration can be divided into two major components: (1) the extraction of control points or features from images; and (2) the search among the extracted features for the matching pairs that represent the same feature in the images to be matched. Manual control feature extraction can be subjective and extremely time consuming, and often results in few usable points. Automated feature extraction is a solution to this problem, where desired target features are invariant, and represent evenly distributed landmarks such as edges, corners and line intersections. In this paper, we develop a novel automated registration approach based on the following steps. First, a mathematical morphology (MM)-based method is used to obtain a scale-orientation morphological profile at each image pixel. Next, a spectral dissimilarity metric such as the spectral information divergence is applied for automated extraction of landmark chips, followed by an initial approximate matching. This initial condition is then refined using a hierarchical robust feature matching (RFM) procedure. Experimental results reveal that the proposed registration technique offers a robust solution in the presence of seasonal changes and other interfering factors. Keywords-Automated image registration, multi-temporal imagery, mathematical morphology, robust feature matching.

Plaza, Antonio↗

NASA NTRS1987

Certainty grids for mobile robots

A numerical representation of uncertain and incomplete sensor knowledge called Certainty Grids has been used successfully in several mobile robot control programs, and has proven itself to be a powerful and efficient unifying solution for sensor fusion, motion planning, landmark identification, and many other central problems. Researchers propose to build a software framework running on processors onboard the new Uranus mobile robot that will maintain a probabilistic, geometric map of the robot's surroundings as it moves. The certainty grid representation will allow this map to be incrementally updated in a uniform way from various sources including sonar, stereo vision, proximity and contact sensors. The approach can correctly model the fuzziness of each reading, while at the same time combining multiple measurements to produce sharper map features, and it can deal correctly with uncertainties in the robot's motion. The map will be used by planning programs to choose clear paths, identify locations (by correlating maps), identify well-known and insufficiently sensed terrain, and perhaps identify objects by shape. The certainty grid representation can be extended in the same dimension and used to detect and track moving objects.

Moravec, H. P.↗

NASA NTRS2024

3D Scanning System to Assess Gravity-Dependent Body Shape Changes

The human body shows unique physiological and morphological changes when exposed to different gravity conditions, including muscle atrophy, fluid shift, spinal elongation, and body posture adjustments. Such changes need to be incorporated for human-system integration in the vehicle habitat, garment, and spacesuit designs, as inaccurate body measurements can result in suboptimal crew protection that can potentially decrease injury tolerance. However, the traditional linear measurements, such as stature, segment lengths or circumferences measured using a caliper or tape measure, often show limited consistency and are unable to capture the nonlinear characteristics of the human body. While 3D body scanning can provide significant advantages over linear measurements, the technologies have not been fully developed or customized for in-flight scanning. For ground laboratory use, several different scanner types are commercially available. However, in-flight scanning requires additional technical considerations, such as minimal scan time, simplified calibration, and sufficient capture volume. This work aims to develop a prototype 3-D body scanning system that is customized for in-flight use to scan crewmembers, with the configuration and performance optimized for detecting known gravity-dependent body shape and posture changes. A hardware system will be custom built using a network of commercial off-the-shelf 3D sensors. The sensor parameters and settings will be optimized to detect the targeted body shape changes, specifically using body manikins of which the shape and size are iteratively permuted to simulate the known changes by fluid shift and spinal elongation. The capture volume will be also matched for a range of body sizes from a 1st percentile female to 99th percentile male. Unintentional body motions or floating in microgravity will be also simulated and incorporated. A data acquisition software will be developed for efficient in-flight operations with minimal overhead and easy-to-use user interface. A simplified calibration procedure will be designed for robust scanning against frequent vibration or unexpected sensor position shifts. The system will be tested in the ground laboratory for accuracy and reliability against a reference scanning system. New anthropometry measurements will be also identified to sensitively capture the gravity dependent body shape changes, in addition to the traditional anthropometry measurements. A novel landmark-based technique will be tested for consistent anthropometry measurements across posture variations. If successfully developed and deployed, the new system is expected to provide previously unavailable body shape and size data from different gravitational environments, including 0-g, 1/6-g, and 1-g. Such data can improve suit fit, habitat design, exercise efficacy quantification and sizing of orthostatic intolerance garments.

K H Kim↗

NASA NTRS2024

3D Scanning System to Assess Gravity-Dependent Body Shape Changes

The human body shows unique physiological and morphological changes when exposed to different gravity conditions, including muscle atrophy, fluid shift, spinal elongation, and body posture adjustments. Such changes need to be incorporated for human-system integration in the vehicle habitat, garment, and spacesuit designs, as inaccurate body measurements can result in suboptimal crew protection that can potentially decrease injury tolerance. However, the traditional linear measurements, such as stature, segment lengths or circumferences measured using a caliper or tape measure, often show limited consistency and are unable to capture the nonlinear characteristics of the human body. While 3D body scanning can provide significant advantages over linear measurements, the technologies have not been fully developed or customized for in-flight scanning. For ground laboratory use, several different scanner types are commercially available. However, in-flight scanning requires additional technical considerations, such as minimal scan time, simplified calibration, and sufficient capture volume. This work aims to develop a prototype 3-D body scanning system that is customized for in-flight use to scan crewmembers, with the configuration and performance optimized for detecting known gravity-dependent body shape and posture changes. A hardware system will be custom built using a network of commercial off-the-shelf 3D sensors. The sensor parameters and settings will be optimized to detect the targeted body shape changes, specifically using body manikins of which the shape and size are iteratively permuted to simulate the known changes by fluid shift and spinal elongation. The capture volume will be also matched for a range of body sizes from a 1st percentile female to 99th percentile male. Unintentional body motions or floating in microgravity will be also simulated and incorporated. A data acquisition software will be developed for efficient in-flight operations with minimal overhead and easy-to-use user interface. A simplified calibration procedure will be designed for robust scanning against frequent vibration or unexpected sensor position shifts. The system will be tested in the ground laboratory for accuracy and reliability against a reference scanning system. New anthropometry measurements will be also identified to sensitively capture the gravity dependent body shape changes, in addition to the traditional anthropometry measurements. A novel landmark-based technique will be tested for consistent anthropometry measurements across posture variations. If successfully developed and deployed, the new system is expected to provide previously unavailable body shape and size data from different gravitational environments, including 0-g, 1/6-g, and 1-g. Such data can improve suit fit, habitat design, exercise efficacy quantification and sizing of orthostatic intolerance garments.

K H Kim↗

DOE OSTI2022

Ultrafast electron diffraction: Visualizing dynamic states of matter

Since the discovery of electron-wave duality, electron scattering instrumentation has developed into a powerful array of techniques for revealing the atomic structure of matter. Beyond detecting local lattice variations in equilibrium structures with the highest possible spatial resolution, recent research efforts have been directed toward the long-sought-after dream of visualizing the dynamic evolution of matter in real time. The atomic behavior at ultrafast timescales carries critical information on phase transition and chemical reaction dynamics, the coupling of electronic and nuclear degrees of freedom in materials and molecules, and the correlation among structure, function, and previously hidden metastable or nonequilibrium states of matter. Ultrafast electron pulses play an essential role in this scientific endeavor, and their generation has been facilitated by rapid technical advances in both ultrafast laser and particle accelerator technologies. Here this review presents a summary of the noteworthy developments in this field in the last few decades. The physics and technology of ultrafast electron beams is presented with an emphasis on the figures of merit most relevant for ultrafast electron diffraction experiments. Recent developments in the generation, manipulation, and characterization of ultrashort electron beams aimed at improving the combined spatiotemporal resolution of these measurements are discussed. The fundamentals of electron scattering from atomic matter and the theoretical frameworks for retrieving dynamic structural information from solid-state and gas-phase samples is described. Essential experimental techniques and several landmark works that have applied these approaches are also highlighted to demonstrate the widening applicability of these methods. Ultrafast electron probes with ever-improving capabilities, combined with other complementary photon-based or spectroscopic approaches, hold tremendous potential for revolutionizing our ability to observe and understand energy and matter at atomic scales.

43 PARTICLE ACCELERATORS↗

NASA NTRSDate not supplied

Adjusting a Full Body Model to Mitigate Inverse Kinematics Artifacts in Opensim

BACKGROUND: In support of Vibration Isolation and Stabilization (VIS) system development for Human Health Countermeasures (HHC) exercise systems in space, such as the European Enhanced Exploration Exercise Device (E4D) [1], dynamic quantities required to model the response of a proposed VIS while considering the effect of VIS motion on the forces between the human and VIS platform were obtained using motion capture data [2]. On occasion, large-amplitude oscillatory spikes were found in the subject’s linear and angular momentum derivatives, affecting analyses that depend on forces and moments derived from motion capture. The purpose of this investigation was to identify causes of these artifacts and techniques for their resolution. METHODS AND RESULTS: To obtain the required human dynamic quantities to drive the VIS simulation, motion capture data was collected containing recorded trajectories of passive retroreflective markers on body landmarks of an exercising subject. Since the full body Rajagopal model [3] was originally used to enhance gait analysis, upper body joints did not require large Ranges of Motion (ROM). We thus modified the Rajagopal model [4, 5] to allow it to be used for upper body intensive exercises like those common to the E4D. OpenSim Inverse Kinematics (IK) [6] was performed using these scaled subject models to generate the joint angles throughout the exercise while minimizing marker error. At times, the arms were observed to ‘snap’ from one configuration to another, causing spike artifacts. Following IK, a custom OpenSim plugin [7] was used to determine the required dynamic quantities including the rates of change of the linear and angular momenta of the human. Since motion capture is recorded at a larger time step than required by the VIS simulation, the human center of mass location was fit with splines and a second derivative taken to obtain the momentum derivative, allowing the VIS simulation to maintain conservation of momentum when appropriate. In a few cases during this stage, artifacts much larger than the expected noise of the second derivatives were introduced. Investigation of cases containing artifacts revealed several modifications that could be made to the OpenSim model to improve IK results. Since OpenSim models use Euler angles and rotation sequences, ‘gimbal lock’ would be encountered in the arms when raised 90 degrees to the side (e.g., T-pose, some hang clean exercise, etc.). This was resolved by reorienting the horizontal axes at the shoulder joint by 45 degrees, placing ‘gimbal lock’ outside common arm ROM, with the arm ROMs adjusted following this change. Elbow and wrist ROMs could also be adjusted to allow realistic motion while at the same time limiting the likelihood of unrealistic orientations. On occasion, the arms flipped backwards when raised above the head. This was prevented by using medial elbow markers in scaling and IK. When medial markers were not available, the acromial joint location in the unscaled model was shifted before model scaling to better align the arm with available markers. Lastly, artifacts which became apparent after taking the second derivatives of spline-fit data were found to occur in cases when the pelvis rotation limit prevented the full range of motion of an exercise. These issues were resolved by unclamping the pelvis rotation limit. Through this investigation, an understanding of conditions leading to IK artifacts was acquired allowing the automation of artifact detection. These artifact detection and mitigation techniques can be applied toward modeling of upper body motions in aerospace and other fields for improved IK results.

C A Bell↗