Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Real-time Terrain Relative Navigation Test Results from a Relevant Environment for Mars Landing

Terrain Relative Navigation (TRN) is an on-board GN&C function that generates a position estimate of a spacecraft relative to a map of a planetary surface. When coupled with a divert, the position estimate enables access to more challenging landing sites through pin-point landing or large hazard avoidance. The Lander Vision System (LVS) is a smart sensor system that performs terrain relative navigation by matching descent camera imagery to a map of the landing site and then fusing this with inertial measurements to obtain high rate map relative position, velocity and attitude estimates. A prototype of the LVS was recently tested in a helicopter field test over Mars analog terrain at altitudes representative of Mars Entry Descent and Landing conditions. TRN ran in real-time on the LVS during the flights without human intervention or tuning. The system was able to compute estimates accurate to 40m (3 sigma) in 10 seconds on a flight like processing system. This paper describes the Mars operational test space definition, how the field test was designed to cover that operational envelope, the resulting TRN performance across the envelope and an assessment of test space coverage.

Pin-point Landing↗
DOE OSTI2026

Cooling Matters: Benchmarking Large Language Models and Vision-Language Models on Liquid-Cooled Versus Air-Cooled H100 GPU Systems

The unprecedented growth in artificial intelligence (AI) workloads, recently dominated by large language models (LLMs) and vision-language models (VLMs), has intensified power and cooling demands in data centers. This study benchmarks LLMs and VLMs on two HGX nodes, each with 8× NVIDIA H100 graphics processing units (GPUs), using liquid and air cooling. Leveraging GPU Burn, Weights & Biases, and IPMItool, we collect detailed thermal, power, and computation data. Results show that the liquid-cooled systems maintain GPU temperatures between 41-50$^\circ$C, while the air-cooled counterparts fluctuate between 54-72$^\circ$C under load. This thermal stability of liquid-cooled systems yields 17% higher performance (54 TFLOPs/ GPU vs. 46 TFLOPs/GPU), performance-per-watt, reduced energy overhead, and greater system efficiency than the air-cooled counterparts. These findings underscore the energy and sustainability benefits of liquid cooling, offering a compelling path forward for hyperscale data centers seeking to optimize AI infrastructure. https://github.com/iscaas/Cooling-Matters.

Latif, Imran↗
NASA NTRS1981

The enchanted loom

The evolution of intelligence began with the movement of Crossopterygian fish onto land. The eventual appearance of large dinosaurs eliminated all but the smallest of mammalian creatures, with the survivors forced to move only nocturnally, when enhanced olfactory and aural faculties were favored and involved a larger grey matter/body mass ratio than possessed by the dinosaurs. Additionally, the mammals made comparisons between the inputs of various senses, implying the presence of significant memory capacity and an ability to abstract survival information. More complex behavior occurred with the advent of tree dwellers (forward-looking eyes), hands, color vision, and the ability to grip and manipulate objects. An extra pound of brain evolved in the human skull in less than a million years. The neural processes that can lead to an action by a creature with a brain are mimicked by the basic AND and OR gates in computers, which are rapidly approaching the circuit density of the human brain. It is suggested that humans will eventually produce computers of higher intelligence than people possess, and computer spacecraft, alive in an electronic sense, will travel outward to explore the universe.

Jastrow, R.↗
NASA NTRS2001

Use of Soft Computing Technologies for a Qualitative and Reliable Engine Control System for Propulsion Systems

The problem to be addressed in this paper is to explore how the use of Soft Computing Technologies (SCT) could be employed to improve overall vehicle system safety, reliability, and rocket engine performance by development of a qualitative and reliable engine control system (QRECS). Specifically, this will be addressed by enhancing rocket engine control using SCT, innovative data mining tools, and sound software engineering practices used in Marshall's Flight Software Group (FSG). The principle goals for addressing the issue of quality are to improve software management, software development time, software maintenance, processor execution, fault tolerance and mitigation, and nonlinear control in power level transitions. The intent is not to discuss any shortcomings of existing engine control methodologies, but to provide alternative design choices for control, implementation, performance, and sustaining engineering, all relative to addressing the issue of reliability. The approaches outlined in this paper will require knowledge in the fields of rocket engine propulsion (system level), software engineering for embedded flight software systems, and soft computing technologies (i.e., neural networks, fuzzy logic, data mining, and Bayesian belief networks); some of which are briefed in this paper. For this effort, the targeted demonstration rocket engine testbed is the MC-1 engine (formerly FASTRAC) which is simulated with hardware and software in the Marshall Avionics & Software Testbed (MAST) laboratory that currently resides at NASA's Marshall Space Flight Center, building 4476, and is managed by the Avionics Department. A brief plan of action for design, development, implementation, and testing a Phase One effort for QRECS is given, along with expected results. Phase One will focus on development of a Smart Start Engine Module and a Mainstage Engine Module for proper engine start and mainstage engine operations. The overall intent is to demonstrate that by employing soft computing technologies, the quality and reliability of the overall scheme to engine controller development is further improved and vehicle safety is further insured. The final product that this paper proposes is an approach to development of an alternative low cost engine controller that would be capable of performing in unique vision spacecraft vehicles requiring low cost advanced avionics architectures for autonomous operations from engine pre-start to engine shutdown.

Trevino, Luis↗
NASA NTRS1994

A Third Arm for the Surgeon

In laparoscopic surgery, tiny incisions are made in the patient's body and a laparoscope (an optical tube with a camera at the end) is inserted. The camera's image is projected onto two video screens, whose views guide the surgeon through the procedure. AESOP, a medical robot developed by Computer Motion, Inc. with NASA assistance, eliminates the need for a human assistant to operate the camera. The surgeon uses a foot pedal control to move the device, allowing him to use both hands during the surgery. Miscommunication is avoided; AESOP's movement is smooth and steady, and the memory vision is invaluable. Operations can be completed more quickly, and the patient spends less time under anesthesia. AESOP has been approved by the FDA.

Source record↗
NASA NTRS2012

Stereo and IMU-Assisted Visual Odometry for Small Robots

This software performs two functions: (1) taking stereo image pairs as input, it computes stereo disparity maps from them by cross-correlation to achieve 3D (three-dimensional) perception; (2) taking a sequence of stereo image pairs as input, it tracks features in the image sequence to estimate the motion of the cameras between successive image pairs. A real-time stereo vision system with IMU (inertial measurement unit)-assisted visual odometry was implemented on a single 750 MHz/520 MHz OMAP3530 SoC (system on chip) from TI (Texas Instruments). Frame rates of 46 fps (frames per second) were achieved at QVGA (Quarter Video Graphics Array i.e. 320 240), or 8 fps at VGA (Video Graphics Array 640 480) resolutions, while simultaneously tracking up to 200 features, taking full advantage of the OMAP3530's integer DSP (digital signal processor) and floating point ARM processors. This is a substantial advancement over previous work as the stereo implementation produces 146 Mde/s (millions of disparities evaluated per second) in 2.5W, yielding a stereo energy efficiency of 58.8 Mde/J, which is 3.75 better than prior DSP stereo while providing more functionality.

Source record↗
NASA NTRS1989

Optical calculation of correlation filters for a robotic vision system

A method is presented for designing optical correlation filters based on measuring three intensity patterns: the Fourier transform of a filter object, a reference wave and the interference pattern produced by the sum of the object transform and the reference. The method can produce a filter that is well matched to both the object, its transforming optical system and the spatial light modulator used in the correlator input plane. A computer simulation was presented to demonstrate the approach for the special case of a conventional binary phase-only filter. The simulation produced a workable filter with a sharp correlation peak.

Knopp, Jerome↗
DOE OSTI2024

A multiscale model of immune surveillance in micrometastases gives insights on cancer patient digital twins

Abstract Metastasis is the leading cause of death in patients with cancer, driving considerable scientific and clinical interest in immunosurveillance of micrometastases. We investigated this process by creating a multiscale mathematical model to study the interactions between the immune system and the progression of micrometastases in general epithelial tissue. We analyzed the parameter space of the model using high-throughput computing resources to generate over 100,000 virtual patient trajectories. We demonstrated that the model could recapitulate a wide variety of virtual patient trajectories, including uncontrolled growth, partial response, and complete immune response to tumor growth. We classified the virtual patients and identified key patient parameters with the greatest effect on the simulated immunosurveillance. We highlight the lessons derived from this analysis and their impact on the nascent field of cancer patient digital twins (CPDTs). While CPDTs could enable clinicians to systematically dissect the complexity of cancer in each individual patient and inform treatment choices, our work shows that key challenges remain before we can reach this vision. In particular, we show that there remain considerable uncertainties in immune responses, unreliable patient stratification, and unpredictable personalized treatment. Nonetheless, we also show that in spite of these challenges, patient-specific models suggest strategies to increase control of clinically undetectable micrometastases even without complete parameter certainty.

Mathematical & Computational Biology↗
NASA NTRS1973

Robot Vision

The operation of a system is described that is built both to model the vision of primate animals, including man, and serve as a pre-prototype of possible object recognition system. It was employed in a series of experiments to determine the practicability of matching left and right images of a scene to determine the range and form of objects. The experiments started with computer generated random-dot stereograms as inputs and progressed through random square stereograms to a real scene. The major problems were the elimination of spurious matches, between the left and right views, and the interpretation of ambiguous regions, on the left side of an object that can be viewed only by the left camera, and on the right side of an object that can be viewed only by the right camera.

Sutro, L. L.↗
NASA NTRS1989

Robot acting on moving bodies (RAMBO): Preliminary results

A robot system called RAMBO is being developed. It is equipped with a camera, which, given a sequence of simple tasks, can perform these tasks on a moving object. RAMBO is given a complete geometric model of the object. A low level vision module extracts and groups characteristic features in images of the object. The positions of the object are determined in a sequence of images, and a motion estimate of the object is obtained. This motion estimate is used to plan trajectories of the robot tool to relative locations nearby the object sufficient for achieving the tasks. More specifically, low level vision uses parallel algorithms for image enchancement by symmetric nearest neighbor filtering, edge detection by local gradient operators, and corner extraction by sector filtering. The object pose estimation is a Hough transform method accumulating position hypotheses obtained by matching triples of image features (corners) to triples of model features. To maximize computing speed, the estimate of the position in space of a triple of features is obtained by decomposing its perspective view into a product of rotations and a scaled orthographic projection. This allows the use of 2-D lookup tables at each stage of the decomposition. The position hypotheses for each possible match of model feature triples and image feature triples are calculated in parallel. Trajectory planning combines heuristic and dynamic programming techniques. Then trajectories are created using parametric cubic splines between initial and goal trajectories. All the parallel algorithms run on a Connection Machine CM-2 with 16K processors.

Davis, Larry S.↗
NASA NTRS1989

Robot Acting on Moving Bodies (RAMBO): Interaction with tumbling objects

Interaction with tumbling objects will become more common as human activities in space expand. Attempting to interact with a large complex object translating and rotating in space, a human operator using only his visual and mental capacities may not be able to estimate the object motion, plan actions or control those actions. A robot system (RAMBO) equipped with a camera, which, given a sequence of simple tasks, can perform these tasks on a tumbling object, is being developed. RAMBO is given a complete geometric model of the object. A low level vision module extracts and groups characteristic features in images of the object. The positions of the object are determined in a sequence of images, and a motion estimate of the object is obtained. This motion estimate is used to plan trajectories of the robot tool to relative locations rearby the object sufficient for achieving the tasks. More specifically, low level vision uses parallel algorithms for image enhancement by symmetric nearest neighbor filtering, edge detection by local gradient operators, and corner extraction by sector filtering. The object pose estimation is a Hough transform method accumulating position hypotheses obtained by matching triples of image features (corners) to triples of model features. To maximize computing speed, the estimate of the position in space of a triple of features is obtained by decomposing its perspective view into a product of rotations and a scaled orthographic projection. This allows use of 2-D lookup tables at each stage of the decomposition. The position hypotheses for each possible match of model feature triples and image feature triples are calculated in parallel. Trajectory planning combines heuristic and dynamic programming techniques. Then trajectories are created using dynamic interpolations between initial and goal trajectories. All the parallel algorithms run on a Connection Machine CM-2 with 16K processors.

Davis, Larry S.↗
NASA NTRS1991

Dynamic edge warping - An experimental system for recovering disparity maps in weakly constrained systems

Dynamic edge warping (DEW), a technique for recovering reasonably accurate disparity maps from uncalibrated stereo image pairs, is presented. No precise knowledge of the epipolar camera geometry is assumed. The technique is embedded in a system including structural stereopsis on the front end and robust estimation in digital photogrammetry on the other for the purpose of self-calibrating stereo image pairs. Once the relative camera orientation is known, the epipolar geometry is computed and the system can use this information to refine its representation of the object space. Such a system will find application in the autonomous extraction of terrain maps from stereo aerial photographs, for which camera position and orientation are unknown a priori, and for online autonomous calibration maintenance for robotic vision applications, in which the cameras are subject to vibration and other physical disturbances after calibration. This work thus forms a component of an intelligent system that begins with a pair of images and, having only vague knowledge of the conditions under which they were acquired, produces an accurate, dense, relative depth map. The resulting disparity map can also be used directly in some high-level applications involving qualitative scene analysis, spatial reasoning, and perceptual organization of the object space. The system as a whole substitutes high-level information and constraints for precise geometric knowledge in driving and constraining the early correspondence process.

Boyer, K. L.↗
NASA NTRS2003

Evaluation of Alternate Concepts for Synthetic Vision Flight Displays With Weather-Penetrating Sensor Image Inserts During Simulated Landing Approaches

A simulation study was conducted in 1994 at Langley Research Center that used 12 commercial airline pilots repeatedly flying complex Microwave Landing System (MLS)-type approaches to parallel runways under Category IIIc weather conditions. Two sensor insert concepts of 'Synthetic Vision Systems' (SVS) were used in the simulated flights, with a more conventional electro-optical display (similar to a Head-Up Display with raster capability for sensor imagery), flown under less restrictive visibility conditions, used as a control condition. The SVS concepts combined the sensor imagery with a computer-generated image (CGI) of an out-the-window scene based on an onboard airport database. Various scenarios involving runway traffic incursions (taxiing aircraft and parked fuel trucks) and navigational system position errors (both static and dynamic) were used to assess the pilots' ability to manage the approach task with the display concepts. The two SVS sensor insert concepts contrasted the simple overlay of sensor imagery on the CGI scene without additional image processing (the SV display) to the complex integration (the AV display) of the CGI scene with pilot-decision aiding using both object and edge detection techniques for detection of obstacle conflicts and runway alignment errors.

Parrish, Russell V.↗
NASA NTRSDate not supplied

An Integrated Recursive Framework for Arbitrarily Multiscale and Multi-fidelity Modeling

The NASA Multiscale Analysis Tool (NAMSAT) serves as a state-of-the-art, “plug and play,” massively multiscale modeling (M3) platform for hierarchical materials and structures. The development of NASMAT has focused on modularity, upgradability and maintainability, interoperability, and utility. Application Program Interfaces (APIs) have been developed to facilitate the integration NASMAT into other programs (commercial, research, and user-defined) as well as the integration of other codes into NASMAT. NASMAT is an integrated, recursive platform that seamlessly allows for an arbitrary number of scales, and a variety of modeling fidelity, in a single, non-linear analysis. Thus, the macroscopic response of a material can be directly linked to the behavior of the microstructure(s), including subscale defects, making it a suitable tool for integrated computational materials engineering (ICME) because . Examples using NASMAT for simulation of polycrystalline metals at elevated temperatures will be presented.

Multiscale Modeling↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗
NASA NTRS2022

Low-Speed Performance Enhancement Using Localized Active Flow Control: Localized Active Flow Control Simulations on a Reference Aircraft (2/4)

A study of the potential implementations of localized active flow control (AFC) technology onto future airplanes is presented. This collaborative investigation addresses key objectives of the NASA Advanced Air Transport Technology (AATT) Project, in terms of reduction in fuel consumption and lower emission. It specifically targets the goals set forth in a roadmap developed by the NASA/Boeing team. The roadmap is a result of a series of meetings held between the two parties over the years and it represents a shared vision for practical implementations, leading up to flight demonstrations of localized flow control. If successful, localized flow control may lead to important ramifications for next generation airplanes from both the economic and environmental perspectives. Under this contract localized AFC has been used to improve aerodynamic performance during high-lift operations using Computational Fluid Dynamics (CFD). Specifically, AFC has been applied at the aileron and at various location in the wing leading edge (LE) regions. The applications target reduced drag and enhanced lift over the range of practical angles of attack, including stall. These benefits translate to airplane performance improvements, such as longer range or larger payload. The CFD results are used to quantify potential aerodynamic benefits, as well as the input required for actuation. This helps identify the most promising candidates, which potentially provide material net airplane level enhancements using onboard fluidic sources. The airplane configuration selected for the CFD study is a representative of a future short/medium-range twin-engine airplane dubbed the Reference Aircraft. A slew of AFC applications has been explored and their aerodynamic performance enhancements were benchmarked against the baseline Reference Aircraft. Promising AFC candidates have been deemed practical and potentially suitable for both the aileron and the wing LE implementations. The findings on the Reference Aircraft are used to guide the development of the AFC-enhanced aileron for the CRM-HL. The wind-tunnel model of the CRM-HL will be used by NASA to validate the AFC concepts, complementing the CFD-based analysis and the integration study (final report document #3).

CFD↗
NASA NTRS2002

Visions of our Planet's Atmosphere, Land and Oceans: NASA/NOAA Electronic Theater 2002

The NASA/NOAA Electronic Theater presents Earth science observations and visualizations in a historical perspective. Fly in from outer space to the Olympic Medals Plaza, the new Gateway Center, and the University of Utah Stadium Site of the Olympic Opening and Closing Ceremonies in Salt Lake City. Fly in and through the Park City, and Snow Basin sites of the 2002 Winter Olympic Alpine Venues using 1 m IKONOS "Spy Satellite" data. See the four seasons of the Wasatch Front as observed by Landsat 7 at 15m resolution and watch the trees turn color in the Fall, snow come and go in the mountains and the reservoirs freeze and melt. Go back to the early weather satellite images from the 1960s and see them contrasted with the latest US and international global satellite weather movies Including hurricanes & "tornadoes". See the latest visualizations of spectacular images from NASA/NOAA remote sensing missions like Terra, GOES, TRMM, SeaWiFS, Landsat 7 including new 1 - min GOES rapid scan image sequences of Nov 9th 2001 Midwest tornadic thunderstorms and have them explained. See how High-Definition Television (HDTV) is revolutionizing the way we communicate science. (In cooperation with the American Museum of Natural History in NYC) See dust storms in Africa and smoke plumes from fires in Mexico. See visualizations featured on the covers Of Newsweek, TIME, National Geographic, Popular Science & on National & International Network TV. New computer software. tools allow us to roam & zoom through massive global images e.g. Landsat tours of the US, and Africa, showing desert and mountain geology as well as seasonal changes in vegetation. See animations of the polar ice packs and the motion of gigantic Antarctic Icebergs from SeaWinds data. Spectacular new visualizations of the global atmosphere & oceans are shown. See vertexes and currents in the global oceans that bring up the nutrients to feed tin) algae and draw the fish, whales and fisherman. See the how the ocean blooms in response to these currents and El Nino/La Nina climate changes. See the city lights, fishing fleets, gas flares and biomass burning of the Earth at night observed by the "night-vision" DMSP military satellite. The demonstration is interactively driven by a SGI Octane Graphics Supercomputer with two CPUs, 4 Gigabytes of RAM and 0.5 Terabyte of disk using two projectors across a super sized panoramic 48 foot screen. In addition new HDTV technology will be demonstrated from a portable computer server.

Hasler, A. F.↗
NASA NTRS2001

Visions of our Planet's Atmosphere, Land and Oceans: NASA/NOAA Electronic Theater 2002

The NASA/NOAA Electronic Theater presents Earth science observations and visualizations in a historical perspective. Fly in from outer space to the Olympic Medals Plaza, the new Gateway Center, and the University of Utah Stadium Site of the Olympic Opening and Closing Ceremonies in Salt Lake City. Fly in and through the Park City, and Snow Basin sites of the 2002 Winter Olympic Alpine Venues using 1 m IKONOS "Spy Satellite" data. See the four seasons of the Wasatch Front as observed by Landsat 7 at 15m resolution and watch the trees turn color in the Fall, snow come and go in the mountains and the reservoirs freeze and melt. Go back to the early weather satellite images from the 1960s and see them contrasted with the latest US and international global satellite weather movies including hurricanes & "tornadoes". See the latest visualizations of spectacular images from NASA/NOAA remote sensing missions like Terra, GOES, TRMM, SeaWiFS, Landsat 7 including new 1 - min GOES rapid scan image sequences of Nov 9th 2001 Midwest tornadic thunderstorms and have them explained. See how High-Definition Television (HDTV) is revolutionizing the way we communicate science. (In cooperation with the American Museum of Natural History in NYC) See dust storms in Africa and smoke plumes from fires in Mexico. See visualizations featured on the covers of Newsweek, TIME, National Geographic, Popular Science & on National & International Network TV. New computer software tools allow us to roam & zoom through massive global images e.g. Landsat tours of the US, and Africa, showing desert and mountain geology as well as seasonal changes in vegetation. See animations of the polar ice packs and the motion of gigantic Antarctic Icebergs from SeaWinds data. Spectacular new visualizations of the global atmosphere & oceans are shown. See vortexes and currents in the global oceans that bring up the nutrients to feed tiny algae and draw the fish, whales and fisherman. See the how the ocean blooms in response to these currents and El Nino/La Nina climate changes. See the city lights, fishing fleets, gas flares and bio-mass burning of the Earth at night observed by the "night-vision" DMSP military satellite. The demonstration is interactively driven by a SGI Octane Graphics Supercomputer with two CPUs, 4 Gigabytes of RAM and 0.5 Terabyte of disk using two projectors across a super sized panoramic 48 foot screen. In addition new HDTV technology will be demonstrated from a portable computer server.

Hasler, A. F.↗