Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

FPGA Implementation of Stereo Disparity with High Throughput for Mobility Applications

High speed stereo vision can allow unmanned robotic systems to navigate safely in unstructured terrain, but the computational cost can exceed the capacity of typical embedded CPUs. In this paper, we describe an end-to-end stereo computation co-processing system optimized for fast throughput that has been implemented on a single Virtex 4 LX160 FPGA. This system is capable of operating on images from a 1024 x 768 3CCD (true RGB) camera pair at 15 Hz. Data enters the FPGA directly from the cameras via Camera Link and is rectified, pre-filtered and converted into a disparity image all within the FPGA, incurring no CPU load. Once complete, a rectified image and the final disparity image are read out over the PCI bus, for a bandwidth cost of 68 MB/sec. Within the FPGA there are 4 distinct algorithms: Camera Link capture, Bilinear rectification, Bilateral subtraction pre-filtering and the Sum of Absolute Difference (SAD) disparity. Each module will be described in brief along with the data flow and control logic for the system. The system has been successfully fielded upon the Carnegie Mellon University's National Robotics Engineering Center (NREC) Crusher system during extensive field trials in 2007 and 2008 and is being implemented for other surface mobility systems at JPL.

Random access memory↗
NASA NTRSDate not supplied

A NASA Perspective on Quantum AI, Error Correction, and Beyond

Quantum computing is one of the most enticing computational paradigms with the potential to revolutionize diverse areas of future-generation computational systems. While quantum computing hardware has advanced rapidly, from tiny laboratory experiments to quantum chips that can outperform even the largest supercomputers on specialized computational tasks, these noisy-intermediate scale quantum (NISQ) processors are still too small and non-robust to be directly useful for any real-world applications. We discuss the prospects for quantum computing and AI, highlighting advances in algorithms, both near- and longer-term. Quantum error correction is critical to the realization of any such vision. The talk with touch on some recent exciting advanced in quantum error correction, particularly in dynamical codes. The talk will conclude with an example of how the combination of quantum computing and artificial intelligence can help probe fundamental aspect of quantum physics.

quantum optimization algorithms and sampling↗
NASA NTRS2018

2040 Vision: A Roadmap for Integrated, Multiscale Materials and System Modeling and Simulation

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. While these advances have driven significant progress in the development of aerospace components and systems, that progress has been limited by persistent technology and infrastructure challenges that must be overcome to realize the full potential of integrated materials and systems design and simulation modeling throughout the supply chain. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will describe the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). This roadmap is a community consensus document and is a result of over 450 professionals input obtain via: i) four society workshops (AIAA, NAFEMS, and two TMS), ii) community-wide survey, and iii) the establishment of 9 expert panels (one per key element) consisting on average 10 non-team members from academia, government and industry to review, update content, and prioritize gaps and actions. It is NASA's hope and desire that this roadmap provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Multiscale Modeling↗
NASA NTRS2009

Hardware Implementation of a Bilateral Subtraction Filter

A bilateral subtraction filter has been implemented as a hardware module in the form of a field-programmable gate array (FPGA). In general, a bilateral subtraction filter is a key subsystem of a high-quality stereoscopic machine vision system that utilizes images that are large and/or dense. Bilateral subtraction filters have been implemented in software on general-purpose computers, but the processing speeds attainable in this way even on computers containing the fastest processors are insufficient for real-time applications. The present FPGA bilateral subtraction filter is intended to accelerate processing to real-time speed and to be a prototype of a link in a stereoscopic-machine- vision processing chain, now under development, that would process large and/or dense images in real time and would be implemented in an FPGA. In terms that are necessarily oversimplified for the sake of brevity, a bilateral subtraction filter is a smoothing, edge-preserving filter for suppressing low-frequency noise. The filter operation amounts to replacing the value for each pixel with a weighted average of the values of that pixel and the neighboring pixels in a predefined neighborhood or window (e.g., a 9 9 window). The filter weights depend partly on pixel values and partly on the window size. The present FPGA implementation of a bilateral subtraction filter utilizes a 9 9 window. This implementation was designed to take advantage of the ability to do many of the component computations in parallel pipelines to enable processing of image data at the rate at which they are generated. The filter can be considered to be divided into the following parts (see figure): a) An image pixel pipeline with a 9 9- pixel window generator, b) An array of processing elements; c) An adder tree; d) A smoothing-and-delaying unit; and e) A subtraction unit. After each 9 9 window is created, the affected pixel data are fed to the processing elements. Each processing element is fed the pixel value for its position in the window as well as the pixel value for the central pixel of the window. The absolute difference between these two pixel values is calculated and used as an address in a lookup table. Each processing element has a lookup table, unique for its position in the window, containing the weight coefficients for the Gaussian function for that position. The pixel value is multiplied by the weight, and the outputs of the processing element are the weight and pixel-value weight product. The products and weights are fed to the adder tree. The sum of the products and the sum of the weights are fed to the divider, which computes the sum of products the sum of weights. The output of the divider is denoted the bilateral smoothed image. The smoothing function is a simple weighted average computed over a 3 3 subwindow centered in the 9 9 window. After smoothing, the image is delayed by an additional amount of time needed to match the processing time for computing the bilateral smoothed image. The bilateral smoothed image is then subtracted from the 3 3 smoothed image to produce the final output. The prototype filter as implemented in a commercially available FPGA processes one pixel per clock cycle. Operation at a clock speed of 66 MHz has been demonstrated, and results of a static timing analysis have been interpreted as suggesting that the clock speed could be increased to as much as 100 MHz.

Huertas, Andres↗
DOE OSTI2015

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1971

Research and applications: Artificial intelligence

Research in the field of artificial intelligence is discussed. The focus of recent work has been the design, implementation, and integration of a completely new system for the control of a robot that plans, learns, and carries out tasks autonomously in a real laboratory environment. The computer implementation of low-level and intermediate-level actions; routines for automated vision; and the planning, generalization, and execution mechanisms are reported. A scenario that demonstrates the approximate capabilities of the current version of the entire robot system is presented.

Raphael, B.↗
NASA NTRS1991

Machine vision based teleoperation aid

When teleoperating a robot using video from a remote camera, it is difficult for the operator to gauge depth and orientation from a single view. In addition, there are situations where a camera mounted for viewing by the teleoperator during a teleoperation task may not be able to see the tool tip, or the viewing angle may not be intuitive (requiring extensive training to reduce the risk of incorrect or dangerous moves by the teleoperator). A machine vision based teleoperator aid is presented which uses the operator's camera view to compute an object's pose (position and orientation), and then overlays onto the operator's screen information on the object's current and desired positions. The operator can choose to display orientation and translation information as graphics and/or text. This aid provides easily assimilated depth and relative orientation information to the teleoperator. The camera may be mounted at any known orientation relative to the tool tip. A preliminary experiment with human operators was conducted and showed that task accuracies were significantly greater with than without this aid.

Hoff, William A.↗
NASA NTRS1995

Grayscale/resolution trade-off for text: Model predictions and psychophysical results for letter confusion and letter discrimination

In a series of papers presented in 1994, we examined the grayscale/resolution trade-off for natural images displayed on devices with discrete pixellation, such as AMLCD's. In the present paper we extend this study by examining the grayscale/resolution trade-off for text images on discrete-pixel displays. Halftoning in printing is an example of the grayscale/resolution trade-off. In printing, spatial resolution is sacrificed to produce grayscale. Another example of this trade-off is the inherent low-pass spatial filter of a CRT, caused by the point-spread function of the electron beam in the phosphor layer. On a CRT, sharp image edges are blurred by this inherent low-pass filtering, and the block noise created by spatial quantization is greatly reduced. A third example of this trade-off is text anti-aliasing, where grayscale is used to improve letter shape, size and location when rendered at a low spatial resolution. There are additional implications for display system design from the grayscale/resolution trade-off. For example, reduced grayscale can reduce system costs by requiring less complexity in the framestore, allowing the use of lower cost drivers, potentially increasing data transfer rates in the image subsystem, and simplifying the manufacturing processes that are used to construct the active matrix for AMLCD (active-matrix liquid-crystal display) or AMTFEL (active-matrix thin-film electroluminescent) devices. Therefore, the study of these trade-offs is important for display designers and manufacturing and systems engineers who wish to create the highest performance, lowest cost device possible. Our strategy for investigating this trade-off is to generate a set of simple test images, manipulate grayscale and resolution, predict discrimination performance using the ViDEOS(Sarnoff) Human Vision Model, conduct an empirical study of discrimination using psychophysical procedures, and verify the computational results using the psychophysical results.

Gille, Jennifer↗
DOE OSTI2015

Impact of Dutch nuclear fuel cycle scenarios on radionuclide inventory intended for disposal - 15201

One of the main subjects of Dutch five-year research program into geological disposal of radioactive waste, OPERA, is the post-closure radiological safety assessment. Reliable estimates of the radionuclide inventory and matrix composition are an important input for the safety assessment. The amounts and categories of waste foreseen to be disposed in 2130 the Netherlands have been compiled by the Dutch waste management organisation COVRA. Additionally, NRG has made a characterisation of the waste (radionuclides and matrix). This reference inventory is based on the Dutch base nuclear energy scenario of operating the Dutch single reactor, the Borssele NPP, until its presently scheduled shut-down in 2033. However, changes in the presently adopted nuclear fuel cycle strategy in the Netherlands may impact both the quantities of generated radioactive waste and its composition, and therefore the source term of the radiological safety assessment. To get a grip on this uncertainty a set of alternative future fuel cycle scenarios in the Netherlands, which are in compliance with scenarios formulated in the Dutch vision documents, has been considered and evaluated. The scenarios have been analysed with the computer code DANESS, 'Dynamic Analysis of Nuclear Energy System Strategies'. The result of the DANESS analyses concerns the amount and type of the radioactive waste to be finally disposed in a deep geological repository. This also includes the inventories of the individual radionuclides that are relevant for the post-closure safety assessment to be performed in a subsequent stage of the OPERA program. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2005

Creating Communications, Computing, and Networking Technology Development Road Maps for Future NASA Human and Robotic Missions

For human and robotic exploration missions in the Vision for Exploration, roadmaps are needed for capability development and investments based on advanced technology developments. A roadmap development process was undertaken for the needed communications, and networking capabilities and technologies for the future human and robotics missions. The underlying processes are derived from work carried out during development of the future space communications architecture, an d NASA's Space Architect Office (SAO) defined formats and structures for accumulating data. Interrelationships were established among emerging requirements, the capability analysis and technology status, and performance data. After developing an architectural communications and networking framework structured around the assumed needs for human and robotic exploration, in the vicinity of Earth, Moon, along the path to Mars, and in the vicinity of Mars, information was gathered from expert participants. This information was used to identify the capabilities expected from the new infrastructure and the technological gaps in the way of obtaining them. We define realistic, long-term space communication architectures based on emerging needs and translate the needs into interfaces, functions, and computer processing that will be required. In developing our roadmapping process, we defined requirements for achieving end-to-end activities that will be carried out by future NASA human and robotic missions. This paper describes: 10 the architectural framework developed for analysis; 2) our approach to gathering and analyzing data from NASA, industry, and academia; 3) an outline of the technology research to be done, including milestones for technology research and demonstrations with timelines; and 4) the technology roadmaps themselves.

Bhasin, Kul↗
DOE OSTI2012

Dosimetric Benefit of a New Ophthalmic Radiation Plaque

Purpose: To determine whether the computed dosimetry of a new ophthalmic plaque, EP917, when compared with the standard Collaborative Ocular Melanoma Study (COMS) plaques, could reduce radiation exposure to vision critical structures of the eye. Methods and Materials: One hundred consecutive patients with uveal melanoma treated with COMS radiation plaques between 2007 and 2010 were included in this study. These treatment plans were generated with the use of Bebig Plaque Simulator treatment-planning software, both for COMS plaques and for EP917 plaques using I-125. Dose distributions were calculated for a prescription of 85 Gy to the tumor apex. Doses to the optic disc, opposite retina, lens, and macula were obtained, and differences between the 2 groups were analyzed by standard parametric methods. Results: When compared with the COMS plaques, the EP917 plaques used fewer radiation seeds by an average difference of 1.94 (P<.001; 95% confidence interval [CI], -2.8 to -1.06) and required less total strength of radiation sources by an average of 17.74 U (air kerma units) (P<.001; 95% CI, -20.16 to -15.32). The total radiation doses delivered to the optic disc, opposite retina, and macula were significantly less by 4.57 Gy, 0.50 Gy, and 11.18 Gy, respectively, with the EP917 plaques vs the COMS plaques. Conclusion: EP917 plaques deliver less overall radiation exposure to critical vision structures than COMS treatment plaques while still delivering the same total therapeutic dose to the tumor.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2024

Employing artificial intelligence to steer exascale workflows with colmena

Computational workflows are a common class of application on supercomputers, yet the loosely coupled and heterogeneous nature of workflows often fails to take full advantage of their capabilities. We created Colmena to leverage the massive parallelism of a supercomputer by using Artificial Intelligence (AI) to learn from and adapt a workflow as it executes. Colmena allows scientists to define how their application should respond to events (e.g., task completion) as a series of cooperative agents. In this paper, we describe the design of Colmena, the challenges we overcame while deploying applications on exascale systems, and the science workflows we have enhanced through interweaving AI. The scaling challenges we discuss include developing steering strategies that maximize node utilization, introducing data fabrics that reduce communication overhead of data-intensive tasks, and implementing workflow tasks that cache costly operations between invocations. These innovations coupled with a variety of application patterns accessible through our agent-based steering model have enabled science advances in chemistry, biophysics, and materials science using different types of AI. In conclusion, our vision is that Colmena will spur creative solutions that harness AI across many domains of scientific computing.

Workflows↗
DOE OSTI2019

Real-Time Machine Learning Inferencing with Edge Computing Devices from Google and Intel

Machine Learning (ML) has been demonstrated to accelerate discovery and improve the accuracy of many measurements in astrophysics and high energy physics research. As an increasingly commonplace tool, we have reached a new set of challenges in the deployment of ML, at the forefront of which is their computational complexity. The goal of this project is to explore the viability of dedicated machine learning hardware, such as Google’s Coral/Edge TPU and Intel’s Movidius Myriad devices, in astrophysics and high energy physics applications. ML algorithms, while faster than traditional methods, can become the bottleneck in data processing pipelines --- which is a critical issue in systems that require low latency. Within the context of high energy physics and astrophysics, we test this hardware in an attempt to find if it is able to reduce the computational cost of machine learning. We have benchmarked some of these devices, specifically the Google Coral Dev Board and th e Google AIY Vision Kit (Containing Intel’s Movidius Myriad 2).This was done via a strong gravitational lens finding application and a known data set of lenses, simulating a realistic astrophysics application of machine learning, and compare their results to that of traditional computer hardware.

Hawks, Benjamin↗
NASA NTRS2000

Object Based Numerical Zooming Between the NPSS Version 1 and a 1-Dimensional Meanline High Pressure Compressor Design Analysis Code

Within NASA's High Performance Computing and Communication (HPCC) program, NASA Glenn Research Center is developing an environment for the analysis/design of propulsion systems for aircraft and space vehicles called the Numerical Propulsion System Simulation (NPSS). The NPSS focuses on the integration of multiple disciplines such as aerodynamics, structures, and heat transfer, along with the concept of numerical zooming between 0- Dimensional to 1-, 2-, and 3-dimensional component engine codes. The vision for NPSS is to create a "numerical test cell" enabling full engine simulations overnight on cost-effective computing platforms. Current "state-of-the-art" engine simulations are 0-dimensional in that there is there is no axial, radial or circumferential resolution within a given component (e.g. a compressor or turbine has no internal station designations). In these 0-dimensional cycle simulations the individual component performance characteristics typically come from a table look-up (map) with adjustments for off-design effects such as variable geometry, Reynolds effects, and clearances. Zooming one or more of the engine components to a higher order, physics-based analysis means a higher order code is executed and the results from this analysis are used to adjust the 0-dimensional component performance characteristics within the system simulation. By drawing on the results from more predictive, physics based higher order analysis codes, "cycle" simulations are refined to closely model and predict the complex physical processes inherent to engines. As part of the overall development of the NPSS, NASA and industry began the process of defining and implementing an object class structure that enables Numerical Zooming between the NPSS Version I (0-dimension) and higher order 1-, 2- and 3-dimensional analysis codes. The NPSS Version I preserves the historical cycle engineering practices but also extends these classical practices into the area of numerical zooming for use within a companies' design system. What follows here is a description of successfully zooming I-dimensional (row-by-row) high pressure compressor results back to a NPSS engine 0-dimension simulation and a discussion of the results illustrated using an advanced data visualization tool. This type of high fidelity system-level analysis, made possible by the zooming capability of the NPSS, will greatly improve the fidelity of the engine system simulation and enable the engine system to be "pre-validated" prior to commitment to engine hardware.

Follen, G.↗
DOE OSTI2018

Cancer epidemiology update, following the 2011 IARC evaluation of radiofrequency electromagnetic fields (Monograph 102)

Highlights: • Increased risk of brain, vestibular nerve and salivary gland tumors are associated with mobile phone use. • Nine studies (2011–2017) report increased risk of brain cancer from mobile phone use. • Four case-control studies (3 in 2013, 1 in 2014) report increased risk of vestibular nerve tumors. • Concern for other cancers: breast (male & female), testis, leukemia, and thyroid. • Based on the evidence reviewed it is our opinion that IARC's current categorization of RFR as a possible human carcinogen (Group 2B) should be upgraded to Carcinogenic to Humans (Group 1). Epidemiology studies (case-control, cohort, time trend and case studies) published since the International Agency for Research on Cancer (IARC) 2011 categorization of radiofrequency radiation (RFR) from mobile phones and other wireless devices as a possible human carcinogen (Group 2B) are reviewed and summarized. Glioma is an important human cancer found to be associated with RFR in 9 case-control studies conducted in Sweden and France, as well as in some other countries. Increasing glioma incidence trends have been reported in the UK and other countries. Non-malignant endpoints linked include acoustic neuroma (vestibular Schwannoma) and meningioma. Because they allow more detailed consideration of exposure, case-control studies can be superior to cohort studies or other methods in evaluating potential risks for brain cancer. When considered with recent animal experimental evidence, the recent epidemiological studies strengthen and support the conclusion that RFR should be categorized as carcinogenic to humans (IARC Group 1). Opportunistic epidemiological studies are proposed that can be carried out through cross-sectional analyses of high, medium, and low mobile phone users with respect to hearing, vision, memory, reaction time, and other indicators that can easily be assessed through standardized computer-based tests. As exposure data are not uniformly available, billing records should be used whenever available to corroborate reported exposures.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗
DOE OSTI2024

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Software-defined Radio Based Wireless Tomography: Experimental Demonstration and Verification

This letter presents an experimental demonstration of software-defined-radio-based wireless tomography using computer-hosted radio devices called Universal Software Radio Peripheral (USRP). This experimental brief follows our vision and previous theoretical study of wireless tomography that combines wireless communication and RF tomography to provide a novel approach to remote sensing. Automatic data acquisition is performed inside an RF anechoic chamber. Semidefinite relaxation is used for phase retrieval, and the Born iterative method is utilized for imaging the target. Experimental results are presented, validating our vision of wireless tomography.

Bonior, Jason D↗