Search NASA⌕ Search

SEARCH · Search NASA

Results for “camera mobility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Contour Mapping

In the early 1990s, the Ohio State University Center for Mapping, a NASA Center for the Commercial Development of Space (CCDS), developed a system for mobile mapping called the GPSVan. While driving, the users can map an area from the sophisticated mapping van equipped with satellite signal receivers, video cameras and computer systems for collecting and storing mapping data. George J. Igel and Company and the Ohio State University Center for Mapping advanced the technology for use in determining the contours of a construction site. The new system reduces the time required for mapping and staking, and can monitor the amount of soil moved.

Source record↗

Wide-Field-of-View, High-Resolution, Stereoscopic Imager

A device combines video feeds from multiple cameras to provide wide-field-of-view, high-resolution, stereoscopic video to the user. The prototype under development consists of two camera assemblies, one for each eye. One of these assemblies incorporates a mounting structure with multiple cameras attached at offset angles. The video signals from the cameras are fed to a central processing platform where each frame is color processed and mapped into a single contiguous wide-field-of-view image. Because the resolution of most display devices is typically smaller than the processed map, a cropped portion of the video feed is output to the display device. The positioning of the cropped window will likely be controlled through the use of a head tracking device, allowing the user to turn his or her head side-to-side or up and down to view different portions of the captured image. There are multiple options for the display of the stereoscopic image. The use of head mounted displays is one likely implementation. However, the use of 3D projection technologies is another potential technology under consideration, The technology can be adapted in a multitude of ways. The computing platform is scalable, such that the number, resolution, and sensitivity of the cameras can be leveraged to improve image resolution and field of view. Miniaturization efforts can be pursued to shrink the package down for better mobility. Power savings studies can be performed to enable unattended, remote sensing packages. Image compression and transmission technologies can be incorporated to enable an improved telepresence experience.

Prechtl, Eric F.↗

Method and system for providing autonomous control of a platform

The present application provides a system for enabling instrument placement from distances on the order of five meters, for example, and increases accuracy of the instrument placement relative to visually-specified targets. The system provides precision control of a mobile base of a rover and onboard manipulators (e.g., robotic arms) relative to a visually-specified target using one or more sets of cameras. The system automatically compensates for wheel slippage and kinematic inaccuracy ensuring accurate placement (on the order of 2 mm, for example) of the instrument relative to the target. The system provides the ability for autonomous instrument placement by controlling both the base of the rover and the onboard manipulator using a single set of cameras. To extend the distance from which the placement can be completed to nearly five meters, target information may be transferred from navigation cameras (used for long-range) to front hazard cameras (used for positioning the manipulator).

Seelinger, Michael J.↗

GEMINI Case Study

Sandia's GEMINI-Scout Mine Rescue Robot is an unmanned ground vehicle designed to enter potentially hazardous environments to explore, assess, and evaluate dangerous situations first responders may face when conducting a rescue mission. GEMINI is approximately four feet long and two feet tall, which enables the robot to maneuver through small locations on rough terrains caused by earthquakes, fires, or radiological incidents. GEMINI uses track propulsion to climb stairs, travel through gravel and sand pits, pivot in place, and traverse 45-degree climbs with few problems. Furthermore, the vehicle's dual tracked-chassis design allows it to operate in hostile, dark, muddy, high-temperature, and explosive debris-strewn environments, while maintaining efficient ground mobility. The mobility and modularity of the vehicle allow for easy integration of sensors to conduct gas and temperature sensing and offers pan/tilt, zoom color, and thermal camera video streaming capabilities. The vehicle is also able to carry a payload of about 50 pounds of batteries and can handle an additional 200 pounds of payload, whether for additional diagnostics, supplies, or clothing for those trapped in an effected area. GEMINI is remotely operated through a wireless connection and an onboard computer running a customized embedded control application, which directly communicates to all onboard components except for the audio and video systems. When line of sight is not possible, operators use a shockresistant fiber optic cable to ensure continuous functionality of the vehicle. This allows for direct local control of the vehicle, which streams collected data back to the operator for enhanced situational awareness. In addition, the vehicle incorporates safety features such as explosion proof housing to ensure safe electronic operations in hazardous gas or flooded environments; a four-channel video link and two-way audio to ensure located survivors can communicate with operators; and an MSHA-approved multi-gas sensor to monitor air quality.

42 ENGINEERING↗

Materials Processing in Space: Model Experiments aboard the International Space Station

Direct observation of fluid flow, bubble movement and solidification during controlled melting and solidification of succinonitrile were conducted in the glovebox facility of the International Space Station (ISS). The samples were processed in the Pore Formation and Mobility Investigation (PFMI) apparatus in the glovebox facility (GBX) on board the ISS. Experimental processing parameters of temperature gradient and translation speed, as well as camera settings, were remotely monitored and manipulated from the ground Telescience Center (TSC) at the Marshall Space Flight Center. Real time visualization of the controlled directional melt back and resolidification reveals a number of microgravity dependent phenomena otherwise masked by Earth s gravity. These and some initial analysis of the observed events is presented.

Grugel, Richard↗

Evolution of the Mobile Information SysTem (MIST)

The Mobile Information SysTem (MIST) had its origins in the need to determine whether commercial off the shelf (COTS) technologies could improve intervehicular activities (IVA) on International Space Station (ISS) crew maintenance productivity. It began with an exploration of head mounted displays (HMDs), but quickly evolved to include voice recognition, mobile personal computing, and data collection. The unique characteristic of the MIST lies within its mobility, in which a vest is worn that contains a mini-computer and supporting equipment, and a headband with attachments for a HMD, lipstick camera, and microphone. Data is then captured directly by the computer running Morae(TM) or similar software for analysis. To date, the MIST system has been tested in numerous environments such as two parabolic flights on NASA's C-9 microgravity aircraft and several mockup facilities ranging from ISS to the Altair Lunar Sortie Lander. Functional capabilities have included its lightweight and compact design, commonality across systems and environments, and usefulness in remote collaboration. Human Factors evaluations of the system have proven the MIST's ability to be worn for long durations of time (approximately four continuous hours) with no adverse physical deficits, moderate operator compensation, and low workload being reported as measured by Corlett Bishop Discomfort Scale, Cooper-Harper Ratings, and the NASA Total Workload Index (TLX), respectively. Additionally, through development of the system, it has spawned several new applications useful in research. For example, by only employing the lipstick camera, microphone, and a compact digital video recorder (DVR), we created a portable, lightweight data collection device. Video is recorded from the participants point of view (POV) through the use of the camera mounted on the side of the head. Both the video and audio is recorded directly into the DVR located on a belt around the waist. This data is then transferred to another computer for video editing and analysis. Another application has been discovered using simulated flight, in which, a kneeboard is replaced with mini-computer and the HMD to project flight paths and glide slopes for lunar ascent. As technologies evolve, so will the system and its application for research and space system operations.

Litaker, Harry L., Jr.↗

Modular Platforms for Advanced Inspection, Locomotion, and Manipulation - 17150

Robots can provide remote access, manipulation, and inspection capabilities to augment human workers and improve safety in potentially dangerous decommissioning, radioactive waste management, and emergency response operations. However, such activities may require navigating challenging and unstructured environments, such as those with uneven terrain, obstacles, or loose debris. This remains a difficult task, even for modern robots. What's more, a robot's physical design can inhibit it from accessing hard-to-reach areas such as the tight spaces around, underneath, or inside piping and equipment. To address these challenges, we have developed a series of physically robust hardware modules that can be configured into a variety of robot morphologies, specialized to support different operational needs. Each hardware module consists of a number of onboard sensors and a high performance actuator with a series elastic element to sense and control interaction forces for improved locomotion and manipulation. Using this hardware, we have designed several robotic platforms that support the access, manipulation, and inspection requirements of decommissioning and radioactive waste management. To highlight current capabilities and potential opportunities for technological improvement, we present the outcomes from field demonstrations of our modular platforms at the Office of Environmental Management's Science of Safety Portsmouth Gaseous Diffusion Plant Robotics Challenge. Specifically, results include a serpentine robot climbing vertical structures such as pipes, posts, and supports to demonstrate advanced inspection. Additionally, we discuss field trials of a similar modular configuration that yields a highly dexterous manipulator arm and camera system capable of adding manipulation and inspection functionality to existing structures. Results are presented from inspection tasks in which the manipulator is installed on another mobile robotic platform. Finally, we show our hardware modules can be reconfigured into platforms capable of withstanding significant impacts and of alternative means of locomotion, as may be required to cross terrain too challenging for traditional wheeled robots. Results describe the performance of a hexapod robot that uses proprioceptive feedback to locomote in outdoor trials reminiscent of emergency response conditions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Advantages of Brahms for Specifying and Implementing a Multiagent Human-Robotic Exploration System

We have developed a model-based, distributed architecture that integrates diverse components in a system designed for lunar and planetary surface operations: an astronaut's space suit, cameras, all-terrain vehicles, robotic assistant, crew in a local habitat, and mission support team. Software processes ('agents') implemented in the Brahms language, run on multiple, mobile platforms. These mobile agents interpret and transform available data to help people and robotic systems coordinate their actions to make operations more safe and efficient. The Brahms-based mobile agent architecture (MAA) uses a novel combination of agent types so the software agents may understand and facilitate communications between people and between system components. A state-of-the-art spoken dialogue interface is integrated with Brahms models, supporting a speech-driven field observation record and rover command system. An important aspect of the methodology involves first simulating the entire system in Brahms, then configuring the agents into a runtime system Thus, Brahms provides a language, engine, and system builder's toolkit for specifying and implementing multiagent systems.

Clancey, William J.↗

Evaluation of Hands-Free Devices for the Display of Maintenance Procedures

Over the past year, NASA's focus has turned to crewed long duration and exploration missions. On these journeys, crewmembers will be required to execute thousands of procedures to maintain life support systems, check out space suits, conduct science experiments, and perform medical exams. To support the many complex tasks crewmembers undertake in microgravity, NASA is interested in providing crewmembers a hands-free work environment to promote more efficient operations. The overarching objective is to allow crewmembers to use both of their hands for tasks related to their mission, versus holding a paper manual or interacting with a display. The use of advanced, hands-free tools will undoubtedly make the crewmembers task easier, but they can also add to overall task complexity if not properly designed. A leading candidate technology for supporting a hands-free environment is the Head-Mounted Display (HMD). A more recent technology (e-book reader) that could be easily temp-stowed near the work area is also a potential hands-free solution. Previous work at NASA involved the evaluation of several commercially available HMDs for visual quality, comfort, and fit, as well as suitability for use in microgravity. Based on results from this work, three HMDs were selected for further evaluation (along with an e-book reader), using International Space Station (ISS)-like maintenance procedures. Two evaluations were conducted in the Space Station Mockup and Trainer Facility (SSMTF) located at the NASA Johnson Space Center (building 9). The SSMTF is a full scale, medium fidelity replica of the pressurized portions of the ISS. It supports crew training such as ingress and egress, habitability, and emergency procedures. In each of the two evaluations, the participants performed two maintenance procedures. One maintenance procedure involved inspecting air filters in a life support system and replacing them with a clean filter if one were found to be contaminated. The second maintenance procedure focused on working in a confined space; specifically, pulling down a rack to inspect wiring configurations, and rewiring in a different pattern. The maintenance procedures were selected to assess mobility, tool use, and access to multiple document sources during task performance. That is, the participant had to move from rack to rack, use a wrench, a camera, etc., replace components, and refer to diagrams to complete tasks. A constraint was imposed that the ISS-like format of the procedures was to be retained, and not modified or optimized for the electronic device ("plug and play" approach). This was based on future plans to test with real procedures on ISS.

Ronald B Hoffman↗

Autonomous Navigation by a Mobile Robot

ROAMAN is a computer program for autonomous navigation of a mobile robot on a long (as much as hundreds of meters) traversal of terrain. Developed for use aboard a robotic vehicle (rover) exploring the surface of a remote planet, ROAMAN could also be adapted to similar use on terrestrial mobile robots. ROAMAN implements a combination of algorithms for (1) long-range path planning based on images acquired by mast-mounted, wide-baseline stereoscopic cameras, and (2) local path planning based on images acquired by body-mounted, narrow-baseline stereoscopic cameras. The long-range path-planning algorithm autonomously generates a series of waypoints that are passed to the local path-planning algorithm, which plans obstacle-avoiding legs between the waypoints. Both the long- and short-range algorithms use an occupancy-grid representation in computations to detect obstacles and plan paths. Maps that are maintained by the long- and short-range portions of the software are not shared because substantial localization errors can accumulate during any long traverse. ROAMAN is not guaranteed to generate an optimal shortest path, but does maintain the safety of the rover.

Huntsberger, Terrance↗

Mars Sample Recovery Helicopter: Rotorcraft to Retrieve the First Samples from the Martian Surface

The Mars Sample Return Mission (MSR) will carry the next set of Mars helicopters, Sample Recovery Helicopters (SRHs), to the Martian surface. After successfully demonstrating extraterrestrial flight in 2021, Ingenuity has acted as a “scout” for the Perseverance rover while the rover gathers samples of Martian soil. In 2028, the MSR mission will launch a lander and two Ingenuity-sized SRHs to retrieve these samples. These will be the first samples of the Martian surface delivered to Earth. The SRH project will maintain heritage from Ingenuity’s design when possible. However, several key changes must be made, including a ground mobility system, a robotic arm for tube manipulation, and the ability to carry the weight of a science payload (the sample tubes). In addition, the onboard software and cameras will be upgraded, and the rotor radius will be increased. Furthermore, new rotor performance and flight dynamics models and thorough characterization of vehicle limits will be required. The new vehicle design will be described, as well as validation and verification efforts to date.

Rotorcraft↗

Design of a pressurized lunar rover

A pressurized lunar rover is necessary for future long-term habitation of the moon. The rover must be able to safely perform many tasks, ranging from transportation and reconnaissance to exploration and rescue missions. Numerous designs were considered in an effort to maintain a low overall mass and good mobility characteristics. The configuration adopted consists of two cylindrical pressure hulls passively connected by a pressurized flexible passageway. The vehicle has an overall length of 11 meters and a total mass of seven metric tons. The rover is driven by eight independently powered two meter diameter wheels. The dual-cylinder concept allows a combination of articulated frame and double Ackermann steering for executing turns. In an emergency, the individual drive motors allow the option of skid steering as well. Two wheels are connected to either side of each cylinder through a pinned bar which allows constant ground contact. Together, these systems allow the rover to easily meet its mobility requirements. A dynamic isotope power system (DIPS), in conjunction with a closed Brayton cycle, supplied the rover with a continuous supply of 8.5 kW. The occupants are all protected from the DIPS system's radiation by a shield of tantalum. The large amount of heat produced by the DIPS and other rover systems is rejected by thermal radiators. The thermal radiators and solar collectors are located on the top of the rear cylinder. The solar collectors are used to recharge batteries for peak power periods. The rover's shell is made of graphite-epoxy coated with multi-layer insulation (MLI). The graphite-epoxy provides strength while the thermally resistant MLI gives protection from the lunar environment. An elastomer separates the two materials to compensate for the thermal mismatch. The communications system allows for communication with the lunar base with an option for direct communication with earth via a lunar satellite link. The various links are combined into one signal broadcast in the S-band at 2.3 GHz. The rover is fitted with a parabolic reflector disk for S-band transmission, and an omnidirectional antenna for local extravehicular activity (EVA) communication. The rover's guidance, navigation, and control subsystem consists of an inertial guidance system, an orbiting lunar satellite, and an obstacle avoidance system. In addition, the rover is equipped with a number of external fixtures including two telerobotic arms, lights, cameras, EVA storage, manlocks, a docking fixture, solar panels, thermal radiators, and a scientific airlock. In conclusion, this rover meets all of the design requirements and clearly surpasses them in the areas of mobility and maneuverability.

Bhardwaj, Manoj↗

STS-111 Flight Day 3 Highlights

On Flight Day 3 of STS-111, the crew of Endeavour (Kenneth Cockrell, Commander; Paul Lockhart, Pilot; Franklin Chang-Diaz, Mission Specialist; Philippe Perrin, Mission Specialist) and the Expedition 5 crew (Valery Korzun, Commander; Peggy Whitson, Flight Engineer; Sergei Treschev, Flight Engineer), begin their final approach towards the International Space Station (ISS). From cameras aboard the ISS, live video of Endeavour is shown as it approaches the station. The Orbiter is maneuvered slowly to a position for docking, and cameras from multiple angles show this process. As it is maneuvered, there are clear views of its payload bay, which includes the Leonardo MultiPurpose Logistics Module (MPLM) and the Mobile Base System (MBS), both of which will be installed on the ISS during this mission. In the final stages of the docking procedure there is close-up footage of Endeavour meeting the ISS's Pressurized Mating Adapter 2 on the Destiny Laboratory Module. Inside the ISS, the Expedition 4 crew (Yury Onufrienko, Commander; Daniel Bursch, Flight Engineer; Carl Walz, Flight Engineer), which will be replaced by the Expedition 5 crew, prepares for final docking. Crew members are shown transferring equipment from the Endeavour to the ISS, prior to a replay of the mating of the two crafts. In the replay, the hatch is shown being opened and the two newly arrived crews are greeted with excitement by Expedition 4 crewmembers. The video closes with footage of the Quest airlock used for EVA (extravehicular activity) egress, and the Canadarm 2 robotic arm.

Source record↗

Visual and Inertial Datasets for an eVTOL Aircraft Approach and Landing Scenario

A National Aeronautics and Space Administration (NASA) project developing computer vision algorithms for autonomous flight is producing real-world datasets with cameras mounted on aircraft. In related domains, such as autonomous driving, open datasets are key to innovation and advancement in computer vision and autonomous perception for future Advanced Air Mobility (AAM) operations. Few vision datasets, however, are publicly available in the aviation context. This paper introduces preliminary datasets containing several examples of approach and landing scenarios. The platform aircraft include a multirotor small unmanned aerial system (sUAS) and a crewed helicopter as surrogates for future electric vertical take-off and landing (eVTOL) aircraft. The dataset provides video imagery with associated inertial navigation system-global positioning system (INS-GPS) position and attitude estimates and other sensors. Surveyed locations of the visual features of the landing area are included. This dataset is the first to be released in an ongoing effort to collect and share large, diverse datasets relevant to autonomous aviation; community critique that can inform and improve future flight campaigns is welcome.

Nelson Brown↗

HERMIES-3: A step toward autonomous mobility, manipulation, and perception

HERMIES-III is an autonomous robot comprised of a seven degree-of-freedom (DOF) manipulator designed for human scale tasks, a laser range finder, a sonar array, an omni-directional wheel-driven chassis, multiple cameras, and a dual computer system containing a 16-node hypercube expandable to 128 nodes. The current experimental program involves performance of human-scale tasks (e.g., valve manipulation, use of tools), integration of a dexterous manipulator and platform motion in geometrically complex environments, and effective use of multiple cooperating robots (HERMIES-IIB and HERMIES-III). The environment in which the robots operate has been designed to include multiple valves, pipes, meters, obstacles on the floor, valves occluded from view, and multiple paths of differing navigation complexity. The ongoing research program supports the development of autonomous capability for HERMIES-IIB and III to perform complex navigation and manipulation under time constraints, while dealing with imprecise sensory information.

Weisbin, C. R.↗

FPGA Implementation of Stereo Disparity with High Throughput for Mobility Applications

High speed stereo vision can allow unmanned robotic systems to navigate safely in unstructured terrain, but the computational cost can exceed the capacity of typical embedded CPUs. In this paper, we describe an end-to-end stereo computation co-processing system optimized for fast throughput that has been implemented on a single Virtex 4 LX160 FPGA. This system is capable of operating on images from a 1024 x 768 3CCD (true RGB) camera pair at 15 Hz. Data enters the FPGA directly from the cameras via Camera Link and is rectified, pre-filtered and converted into a disparity image all within the FPGA, incurring no CPU load. Once complete, a rectified image and the final disparity image are read out over the PCI bus, for a bandwidth cost of 68 MB/sec. Within the FPGA there are 4 distinct algorithms: Camera Link capture, Bilinear rectification, Bilateral subtraction pre-filtering and the Sum of Absolute Difference (SAD) disparity. Each module will be described in brief along with the data flow and control logic for the system. The system has been successfully fielded upon the Carnegie Mellon University's National Robotics Engineering Center (NREC) Crusher system during extensive field trials in 2007 and 2008 and is being implemented for other surface mobility systems at JPL.

Random access memory↗

Methods for Improving Long-Range Wireless Communication Between Extreme Terrain Vehicles

Axel is an extreme terrain, two-wheeled rover designed to traverse rocky surface and sub-surface landscapes in order to conduct remote science experiments in hard-to-reach locations. The rover's design meets many requirements for a mobile research platform capable of reaching water seeps on Martian cliff sides. Axel was developed by the Mobility and Robotic Systems section at the Caltech Jet Propulsion Laboratory. Unique design criteria associated with extreme terrain mobility led to a unique rover solution, consisting of a central module, which provides long-term energy storage and space for large-scale science payloads, and two detachable Axels that can detach and explore extreme terrain locations that are inaccessible to conventional rovers. The envisioned mission could involve a four-wheeled configuration of Axel called 'DuAxel' that is able to traverse the benign, flattened terrain of a landing site and approach the edge of the targeted crater or cave where it would deploy anchoring legs and detach one of the Axel rovers [1]. A tether provides a secure link between the Axel rover and the central module, acting as an anchor to allow Axel to descend along steep crater walls to collect data from the scientifically relevant sites along the water seeps or crater ledges. After completing its scientific mission Axel would hoist itself up to the central module and dock autonomously (using its on-board stereo cameras), allowing the once-again recombined DuAxel to travel to another location to repeat data collection.

wireless communication↗

Stereo Camera Deployment in Support of TRACER (Field Campaign Report)

An improved understanding of the salient environmental controls on cloud formation, evolution, and eventual dissipation is critical to address ongoing challenges with cloud process and parameterization representations in global climate and Earth system models. One goal for the recent U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Tracking Aerosol Convection Interactions Experiment (TRACER) campaign was to collect a comprehensive data set that enabled such convective cloud process studies and key demonstrations for those controls that influenced cloud life cycle (i.e., aerosols, thermodynamics) in the Houston, Texas region. To help accomplish this, ARM instrumentation during TRACER was tasked with tracking a large number of individual, isolated convective cells – and to follow the evolution of these cells at high spatiotemporal resolution to characterize changes in cloud dynamic and microphysical properties. Since Houston experiences a range of convective clouds, it was known that the standard ARM Mobile Facility (AMF) instruments may not be sufficient to completely document initiating, transient, or dissipating low- or shallow-cloud behaviors that were also expected during this campaign (in terms of sensitivity, resolution, and/or operational availability). As one partial solution, a supplemental stereo camera deployment (this sub-campaign) was requested to augment the ARM AMF instrumentation to better address shallow and shallow-to-deep transitional types of cloud process drivers during TRACER (ARM stereo cameras for clouds [STEREOCAM]; Romps and Öktem 2018). The primary scientific focus was the relationships between cloud properties and the ambient conditions, which points to several key TRACER science questions including: ‘What is the relationship between cloud size or updraft intensity to the environmental wind shear and/or humidity?’ Overall, the ARM TRACER stereo camera deployment demonstrated unique effectiveness in observing a wide range of critical shallow, congestus, and transitioning or time-evolving cloud characteristics. The data sets from these cameras include information on the clouds' horizontal dimensions, elevations, and depths, while also enabling potential products for cloud initiation and dissipation rates, and vertical velocities. Stereo cameras simultaneously inform on cloud life cycle stage and spatial properties such as cloud fractional coverage, which should provide complementary information for ARM users when combined with TRACER cloud radars, lidar, and/or other profiling sensors. Moreover, camera products offer large-eddy simulation (LES),-scale-appropriate cloud coverage, depth, and spatial variability estimates, while opening additional avenues to challenge difficult process questions on cloud updrafts/entrainment and their covariability with environmental controls such as wind shear and humidity.

47 OTHER INSTRUMENTATION↗