Search NASA⌕ Search

SEARCH · Search NASA

Results for “mobile visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Creating a Prototype Web Application for Spacecraft Real-Time Data Visualization on Mobile Devices

Mobile devices (smart phones, tablets) have become commonplace among almost all sectors of the workforce, especially in the technical and scientific communities. These devices provide individuals the ability to be constantly connected to any area of interest they may have, whenever and wherever they are located. The Huntsville Operations Support Center (HOSC) is attempting to take advantage of this constant connectivity to extend the data visualization component of the Payload Operations and Integration Center (POIC) to a person's mobile device. POIC users currently have a rather unique capability to create custom user interfaces in order to view International Space Station (ISS) payload health and status telemetry. These displays are used at various console positions within the POIC. The Software Engineering team has created a Mobile Display capability that will allow authenticated users to view the same displays created for the console positions on the mobile device of their choice. Utilizing modern technologies including ASP.net, JavaScript, and HTML5, we have created a web application that renders the user's displays in any modern desktop or mobile web browser, regardless of the operating system on the device. Additionally, the application is device aware which enables it to render its configuration and selection menus with themes that correspond to the particular device. The Mobile Display application uses a communication mechanism known as signalR to push updates to the web client. This communication mechanism automatically detects the best communication protocol between the client and server and also manages disconnections and reconnections of the client to the server. One benefit of this application is that the user can monitor important telemetry even while away from their console position. If expanded to the scientific community, this application would allow a scientist to view a snapshot of the state of their particular experiment at any time or place. Because the web application renders the displays that can currently be created with the POIC ground system, the user can tailor their displays for a particular device using tools that they are already trained to use.

Lang, Jeremy S.↗

Changes in Exercise Data Management

The suite of exercise hardware aboard the International Space Station (ISS) generates an immense amount of data. The data collected from the treadmill, cycle ergometer, and resistance strength training hardware are basic exercise parameters (time, heart rate, speed, load, etc.). The raw data are post processed in the laboratory and more detailed parameters are calculated from each exercise data file. Updates have recently been made to how this valuable data are stored, adding an additional level of data security, increasing data accessibility, and resulting in overall increased efficiency of medical report delivery. Questions regarding exercise performance or how exercise may influence other variables of crew health frequently arise within the crew health care community. Inquiries over the health of the exercise hardware often need quick analysis and response to ensure the exercise system is operable on a continuous basis. Consolidating all of the exercise system data in a single repository enables a quick response to both the medical and engineering communities. A SQL server database is currently in use, and provides a secure location for all of the exercise data starting at ISS Expedition 1 - current day. The database has been structured to update derived metrics automatically, making analysis and reporting available within minutes of dropping the inflight data it into the database. Commercial tools were evaluated to help aggregate and visualize data from the SQL database. The Tableau software provides manageable interface, which has improved the laboratory's output time of crew reports by 67%. Expansion of the SQL database to be inclusive of additional medical requirement metrics, addition of 'app-like' tools for mobile visualization, and collaborative use (e.g. operational support teams, research groups, and International Partners) of the data system is currently being explored.

Buxton, R. E.↗

Changes in Exercise Data Management

The suite of exercise hardware aboard the International Space Station (ISS) generates an immense amount of data. The data collected, treadmill, cycle ergometer, and resistance strength training hardware, are basic exercise parameters (time, heart rate, speed, load, etc.). The raw data are processed in the laboratory and more detailed parameters are calculated from each exercise data file. Updates recently have been made to how these valuable data are stored, adding an additional level of security, increasing accessibility, and resulting in overall increased efficiency of medical report delivery. Questions regarding exercise performance or how exercise may influence other variables of crew health frequently arise within the crew health care community. Inquiries regarding the health of the exercise hardware often need quick analysis and response to ensure the exercise system is operable on a continuous basis. Consolidating all of the exercise system data in a single repository enables a quick response to both the medical and engineering communities. A SQL server database is currently in use, and provides a secure location for all of the exercise data starting at ISS Expedition 1 to current date. The database has been structured to update derived metrics automatically, making analysis and reporting available within minutes of dropping the in-flight data into the database. Commercial tools were evaluated to help aggregate and visualize data from the SQL database. The Tableau software provides manageable interface, which has improved the laboratory’s output time of crew reports by 67%. Expansion of the SQL database, to be inclusive of additional medical requirement metrics, addition of ‘app-like’ tools for mobile visualization, and collaborative use (e.g., operational support teams, research groups, and International Partners) of the data system, is currently being explored.

Buxton, R. E.↗

Improvement in Visual Target Tracking for a Mobile Robot

In an improvement of the visual-target-tracking software used aboard a mobile robot (rover) of the type used to explore the Martian surface, an affine-matching algorithm has been replaced by a combination of a normalized- cross-correlation (NCC) algorithm and a template-image-magnification algorithm. Although neither NCC nor template-image magnification is new, the use of both of them to increase the degree of reliability with which features can be matched is new. In operation, a template image of a target is obtained from a previous rover position, then the magnification of the template image is based on the estimated change in the target distance from the previous rover position to the current rover position (see figure). For this purpose, the target distance at the previous rover position is determined by stereoscopy, while the target distance at the current rover position is calculated from an estimate of the current pose of the rover. The template image is then magnified by an amount corresponding to the estimated target distance to obtain a best template image to match with the image acquired at the current rover position.

Kim, Won↗

Safe and Precise Landing Integrated Capabilities Evolution (SPLICE) Imagery of Sensors

Collection of imagery of SPLICE hardware and software visualization. Descent Landing Computer ETU Open Frame Chassis (OFC). ETU pictures of the GSFC Hazard Detection Lidar during assembly. Prototype picture of the delivered Psionic Navigation Doppler Lidar, including testing with a three-dimensional mobile target. Visualization of a lunar lander simulation using the Dual Quaternion Guidance, demonstrating pointing of a mounted hazard lidar, and then diverting to a selected safe site.

Guidance Navigation and Control↗

Laser-powered Martian rover

Two rover concepts were considered: an unpressurized skeleton vehicle having available 4.5 kW of electrical power and limited to a range of about 10 km from a temporary Martian base and a much larger surface exploration vehicle (SEV) operating on a maximum 75-kW power level and essentially unrestricted in range or mission. The only baseline reference system was a battery-operated skeleton vehicle with very limited mission capability and range and which would repeatedly return to its temporary base for battery recharging. It was quickly concluded that laser powering would be an uneconomical overkill for this concept. The SEV, on the other hand, is a new rover concept that is especially suited for powering by orbiting solar or electrically pumped lasers. Such vehicles are visualized as mobile habitats with full life-support systems onboard, having unlimited range over the Martian surface, and having extensive mission capability (e.g., core drilling and sampling, construction of shelters for protection from solar flares and dust storms, etc.). Laser power beaming to SEV's was shown to have the following advantages: (1) continuous energy supply by three orbiting lasers at 2000 km (no storage requirements as during Martian night with direct solar powering); (2) long-term supply without replacement; (3) very high power available (MW level possible); and (4) greatly enhanced mission enabling capability beyond anything currently conceived.

Harries, W. L.↗

Measurement of Visual Reaction Times Using Hand-held Mobile Devices

Modern mobile devices provide a convenient platform for collecting research data in the field. But,because the working of these devices is often cloaked behind multiple layers of proprietary system software, it can bedifficult to assess the accuracy of the data they produce, particularly in the case of timing. We have been collecting datain a simple visual reaction time experiment, as part of a fatigue testing protocol known as the Psychomotor Vigilance Test (PVT). In this protocol, subjects run a 5-minute block consisting of a sequence of trials in which a visual stimulus appears after an unpredictable variable delay. The subject is required to tap the screen as soon as possible after the appearance of the stimulus. In order to validate the reaction times reported by our program, we had subjects perform the task while a high-speed video camera recorded both the display screen, and a side view of the finger (observed in a mirror). Simple image-processing methods were applied to determine the frames in which the stimulus appeared and disappeared, and in which the finger made and broke contact with the screen. The results demonstrate a systematic delay between the initial contact by the finger and the detection of the touch by the software, having a value of 80 +- 20 milliseconds.

reaction time↗

Integration for navigation on the UMASS mobile perception lab

Integration of real-time visual procedures for use on the Mobile Perception Lab (MPL) was presented. The MPL is an autonomous vehicle designed for testing visually guided behavior. Two critical areas of focus in the system design were data storage/exchange and process control. The Intermediate Symbolic Representation (ISR3) supported data storage and exchange, and the MPL script monitor provided process control. Resource allocation, inter-process communication, and real-time control are difficult problems which must be solved in order to construct strong autonomous systems.

Draper, Bruce↗

Distributed Visual Sensing and Fusion for Advanced Air Mobility

Surveillance solutions for Advanced and Urban Air Mobility frameworks are a key factor to enable safe operations of highly automated aircraft in the civil airspace. To design solutions suitable for all types of aircraft, non-cooperative sensors can be used, though many challenges arise when the small dimensions of the vehicles and their proximity to the ground during low-altitude missions are considered. A distributed sensing concept can be efficiently applied to address these challenges by exploiting multiple sensors within a surveillance network. This paper proposes a strategy to fuse the information collected by three ground-fixed cameras within a network of multiple distributed sensors and is tested with during experimental flight tests. The solution exploits standalone tracking estimates of each camera within a fusion center that performs triangulation and three-dimensional tracking. This approach is tested in a scenario involving two small UAVs flying at low altitude. The paper deals with the challenges of associating the two objects from independent and unrelated tracks to achieve robust triangulation, which produces meter-level mean errors with respect to GNSS-based ground truth.

Federica Vitiello↗

High-Performance 3D Articulated Robot Display

In the domain of telerobotic operations, the primary challenge facing the operator is to understand the state of the robotic platform. One key aspect of understanding the state is to visualize the physical location and configuration of the platform. As there is a wide variety of mobile robots, the requirements for visualizing their configurations vary diversely across different platforms. There can also be diversity in the mechanical mobility, such as wheeled, tracked, or legged mobility over surfaces. Adaptable 3D articulated robot visualization software can accommodate a wide variety of robotic platforms and environments. The visualization has been used for surface, aerial, space, and water robotic vehicle visualization during field testing. It has been used to enable operations of wheeled and legged surface vehicles, and can be readily adapted to facilitate other mechanical mobility solutions. The 3D visualization can render an articulated 3D model of a robotic platform for any environment. Given the model, the software receives real-time telemetry from the avionics system onboard the vehicle and animates the robot visualization to reflect the telemetered physical state. This is used to track the position and attitude in real time to monitor the progress of the vehicle as it traverses its environment. It is also used to monitor the state of any or all articulated elements of the vehicle, such as arms, legs, or control surfaces. The visualization can also render other sorts of telemetered states visually, such as stress or strains that are measured by the avionics. Such data can be used to color or annotate the virtual vehicle to indicate nominal or off-nominal states during operation. The visualization is also able to render the simulated environment where the vehicle is operating. For surface and aerial vehicles, it can render the terrain under the vehicle as the avionics sends it location information (GPS, odometry, or star tracking), and locate the vehicle over or on the terrain correctly. For long traverses over terrain, the visualization can stream in terrain piecewise in order to maintain the current area of interest for the operator without incurring unreasonable resource constraints on the computing platform. The visualization software is designed to run on laptops that can operate in field-testing environments without Internet access, which is a frequently encountered situation when testing in remote locations that simulate planetary environments such as Mars and other planetary bodies.

Powell, Mark W.↗

Economic impact of stimulated technological activity. Part 3: Case study, knowledge additions and earth links from space crew systems

A case study of knowledge contributions from the crew life support aspect of the manned space program is reported. The new information needed to be learned, the solutions developed, and the relation of new knowledge gained to earthly problems were investigated. Illustrations are given in the following categories: supplying atmosphere for spacecraft; providing carbon dioxide removal and recycling; providing contaminant control and removal; maintaining the body's thermal balance; protecting against the space hazards of decompression, radiation, and meteorites; minimizing fire and blast hazards; providing adequate light and conditions for adequate visual performance; providing mobility and work physiology; and providing adequate habitability.

Source record↗

Biomedical technology transfer. Applications of NASA science and technology

Ongoing projects described address: (1) intracranial pressure monitoring; (2) versatile portable speech prosthesis; (3) cardiovascular magnetic measurements; (4) improved EMG biotelemetry for pediatrics; (5) ultrasonic kidney stone disintegration; (6) pediatric roentgen densitometry; (7) X-ray spatial frequency multiplexing; (8) mechanical impedance determination of bone strength; (9) visual-to-tactile mobility aid for the blind; (10) Purkinje image eyetracker and stabilized photocoalqulator; (11) neurological applications of NASA-SRI eyetracker; (12) ICU synthesized speech alarm; (13) NANOPHOR: microelectrophoresis instrument; (14) WRISTCOM: tactile communication system for the deaf-blind; (15) medical applications of NASA liquid-circulating garments; and (16) hip prosthesis with biotelemetry. Potential transfer projects include a person-portable versatile speech prosthesis, a critical care transport sytem, a clinical information system for cardiology, a programmable biofeedback orthosis for scoliosis a pediatric long-bone reconstruction, and spinal immobilization apparatus.

Harrison, D. C.↗

Human operator performance of remotely controlled tasks: Teleoperator research conducted at NASA's George C. Marshall Space Flight Center. Executive summary

The combination of human and machine capabilities into an integrated engineering system which is complex and interactive interdisciplinary undertaking is discussed. Human controlled remote systems referred to as teleoperators, are reviewed. The human factors requirements for remotely manned systems are identified. The data were developed in three principal teleoperator laboratories and the visual, manipulator and mobility laboratories are described. Three major sections are identified: (1) remote system components, (2) human operator considerations; and (3) teleoperator system simulation and concept verification.

Shields, N., Jr.↗

Assessing Performance of Radar and Visual Sensing Techniques for Ground-To-Air Surveillance in Advanced Air Mobility

The safe integration of Unmanned Aircraft Vehicles (UAV) within the civil airspace is of great interest to NASA’s Advanced Air Mobility project, which envisions high density of operations in and around urban areas that include both UAV and AAM aircraft. To enable safe autonomous operations of both platforms, reliable airspace surveillance strategies must be designed and experimentally validated in relevant scenarios, where multiple small UAV operate flying in low altitude conditions. An example of such a scenario is described in this paper which provides performance assessment of various sensing strategies experimentally tested during flight campaigns with four UAV completing simultaneous missions from vertiports. Such campaigns are performed by the High Density Vertiplex subproject which assesses a prototype of Urban Air Mobility ecosystem. For the purposes of this work, the flights are observed from multiple sensing nodes each with radar and camera sensors. The visual detection and tracking algorithms achieved 96.1% to 99.9% average tracking coverage of the UAV above the horizon, reaching detection ranges larger than 1 kilometer for octocopter. Radar-based tracking shows a lower coverage mainly due to ground clutter removal challenges but provides comparable detection ranges and meter-level range accuracy.

Federica Vitiello↗

Satcom systems and technologies into the 21st century

The role of communications satellites in the domestic U.S. telecommunications market for the next 25 years is examined, the focus being on the new satellite communications systems concepts and their enabling technologies. A simple procedure for the identification of critical satellite technologies in the years 2000-2015 is described. Study results indicate that by the year 2015, satellites will find commercial applications in the distribution of space-gathered data, supercomputer network, scientific visualization to remote areas, mobile services, VSAT, broadband ISDN, and data services.

Kwan, Robert K.↗

Vision based object pose estimation for mobile robots

Mobile robot navigation using visual sensors requires that a robot be able to detect landmarks and obtain pose information from a camera image. This paper presents a vision system for finding man-made markers of known size and calculating the pose of these markers. The algorithm detects and identifies the markers using a weighted pattern matching template. Geometric constraints are then used to calculate the position of the markers relative to the robot. The selection of geometric constraints comes from the typical pose of most man-made signs, such as the sign standing vertical and the dimensions of known size. This system has been tested successfully on a wide range of real images. Marker detection is reliable, even in cluttered environments, and under certain marker orientations, estimation of the orientation has proven accurate to within 2 degrees, and distance estimation to within 0.3 meters.

Wu, Annie↗

The Evolution of Three Dimensional Visualization for Commanding the Mars Rovers

NASA's Jet Propulsion Laboratory has built and operated four rovers on the surface of Mars. Two and three dimensional visualization has been extensively employed to command both the mobility and robotic arm operations of these rovers. Stereo visualization has been an important component in this set of visualization techniques. This paper discusses the progression of the implementation and use of visualization techniques for in-situ operations of these robotic missions. Illustrative examples will be drawn from the results of using these techniques over more than ten years of surface operations on Mars.

stereo visualization↗