Search NASA⌕ Search

SEARCH · Search NASA

Results for “vision transformers”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Machine Learning Airport Surface Model

Future needs of the National Airspace System require decision support tools to adopt a service-oriented architecture in alignment with the FAA’s vision for an Info-Centric NAS. To achieve this, many existing systems will need to undergo a digital transformation from a monolithic decision support tool to a service-oriented architecture where individual services are exposed through well defined Application Programming Interfaces (APIs). To enable this transformation, NASA has developed the Digital Information Platform as a cloud based foundation for development of aviation services with a special focus towards Artificial Intelligence and Machine Learning (ML) services. This paper describes the work required for the transformation of NASA’s legacy surface management system to a real-time ML based decision support system deployed in the cloud. Details of the Machine Learning Operations (MLOps) infrastructure and best practices are described which enabled the end-toend lifecycle management of ML within an integrated software system. Validation results are provided from an operational field evaluation where performance was benchmarked against the legacy approach.

Jeremy Coupe↗
NASA NTRS1992

Visual information processing; Proceedings of the Meeting, Orlando, FL, Apr. 20-22, 1992

Topics discussed in these proceedings include nonlinear processing and communications; feature extraction and recognition; image gathering, interpolation, and restoration; image coding; and wavelet transform. Papers are presented on noise reduction for signals from nonlinear systems; driving nonlinear systems with chaotic signals; edge detection and image segmentation of space scenes using fractal analyses; a vision system for telerobotic operation; a fidelity analysis of image gathering, interpolation, and restoration; restoration of images degraded by motion; and information, entropy, and fidelity in visual communication. Attention is also given to image coding methods and their assessment, hybrid JPEG/recursive block coding of images, modified wavelets that accommodate causality, modified wavelet transform for unbiased frequency representation, and continuous wavelet transform of one-dimensional signals by Fourier filtering.

Huck, Friedrich O.↗
NASA NTRS2019

2040 Vision Study: an Enlargement of Model Based Engineering

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA's Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations). The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms _ "design of the materials" (material scientist viewpoint) and "design with the materials" (structural analyst viewpoint) _ into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT's hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United States global competitiveness.

Arnold, Steven M.↗
NASA NTRSDate not supplied

2040 Vision Study: NASA’s T3 Implementation Activities

Over the last few decades, advances in high-performance computing, new materials characterization methods, and, more recently, an emphasis on integrated computational materials engineering (ICME) and additive manufacturing have been a catalyst for multiscale modeling and simulation-based design of materials and structures in the aerospace industry. As a result, NASA’s Transformational Tools and Technology (TTT) Project sponsored a study (performed by a team led by Pratt & Whitney) to define the potential 25-year future state required for integrated multiscale modeling of materials and systems (e.g., load-bearing structures) to accelerate the pace and reduce the expense of innovation in future aerospace and aeronautical systems. This talk will briefly review the findings of this 2040 Vision study (e.g., the 2040 vision state; the required interdependent core technical work areas, Key Element (KE); associated critical gaps and actions to close those gaps; and major recommendations) and discuss NASA’s TTT implementation activities, with special emphasis on recent accomplishments. The study, NASA CR 2018- 219771, envisions the development of a cyber-physical-social ecosystem comprised of experimentally verified and validated computational models, tools, and techniques, along with the associated digital tapestry, that marries two non-mutually exclusive paradigms – “design of the materials” (material scientist viewpoint) and “design with the materials” (structural analyst viewpoint) – into a concurrent transformational paradigm that impacts the entire supply chain to enable cost-effective, rapid, and revolutionary design of fit-for-purpose materials, components, and systems. Although the vision focused on aeronautics and space applications, it is believed that other engineering communities (e.g., automotive, biomedical, etc.) can benefit as well from the proposed framework with only minor modifications. Finally, it is TTT’s hope and desire that this vision provides the strategic guidance to both public and private research and development decision makers to make the proposed 2040 vision state a reality and thereby provide a significant advancement in the United State's global competitiveness

Materials↗
NASA NTRS2004

National Aeronautics and Space Administration Exploration Systems Interim Strategy

Contents include the following: 1. The Exploration Systems Mission Directorate within NASA. Enabling the Vision for Space Exploration. The Role of the Directorate. 2. Strategic Context and Approach. Corporate Focus. Focused, Prioritized Requirements. Spiral Transformation. Management Rigor. 3. Achieving Directorate Objectives. Strategy to Task Process. Capability Development. Research and Technology Development. 4. Beyond the Horizon. Appendices.

Source record↗
NASA NTRS1991

Autonomous proximity operations using machine vision for trajectory control and pose estimation

A machine vision algorithm was developed which permits guidance control to be maintained during autonomous proximity operations. At present this algorithm exists as a simulation, running upon an 80386 based personal computer, using a ModelMATE CAD package to render the target vehicle. However, the algorithm is sufficiently simple, so that following off-line training on a known target vehicle, it should run in real time with existing vision hardware. The basis of the algorithm is a sequence of single camera images of the target vehicle, upon which radial transforms were performed. Selected points of the resulting radial signatures are fed through a decision tree, to determine whether the signature matches that of the known reference signatures for a particular view of the target. Based upon recognized scenes, the position of the maneuvering vehicle with respect to the target vehicles can be calculated, and adjustments made in the former's trajectory. In addition, the pose and spin rates of the target satellite can be estimated using this method.

Cleghorn, Timothy F.↗
NASA NTRS1993

DCT quantization matrices visually optimized for individual images

This presentation describes how a vision model incorporating contrast sensitivity, contrast masking, and light adaptation is used to design visually optimal quantization matrices for Discrete Cosine Transform image compression. The Discrete Cosine Transform (DCT) underlies several image compression standards (JPEG, MPEG, H.261). The DCT is applied to 8x8 pixel blocks, and the resulting coefficients are quantized by division and rounding. The 8x8 'quantization matrix' of divisors determines the visual quality of the reconstructed image; the design of this matrix is left to the user. Since each DCT coefficient corresponds to a particular spatial frequency in a particular image region, each quantization error consists of a local increment or decrement in a particular frequency. After adjustments for contrast sensitivity, local light adaptation, and local contrast masking, this coefficient error can be converted to a just-noticeable-difference (jnd). The jnd's for different frequencies and image blocks can be pooled to yield a global perceptual error metric. With this metric, we can compute for each image the quantization matrix that minimizes the bit-rate for a given perceptual error, or perceptual error for a given bit-rate. Implementation of this system demonstrates its advantages over existing techniques. A unique feature of this scheme is that the quantization matrix is optimized for each individual image. This is compatible with the JPEG standard, which requires transmission of the quantization matrix.

Watson, Andrew B.↗
NASA NTRS2012

Revitalization of the NASA Langley Research Center's Infrastructure

The NASA Langley Research Center (Langley) was founded in 1917 as the nation's first civilian aeronautical research facility and NASA's first field center. For nearly 100 years, Langley has made significant contributions to the Aeronautics, Space Exploration, and Earth Science missions through research, technology, and engineering core competencies in aerosciences, materials, structures, the characterization of earth and planetary atmospheres and, more recently, in technologies associated with entry, descent, and landing. An unfortunate but inevitable outcome of this rich history is an aging infrastructure where the longest serving building is close to 80 years old and the average building age is 44 years old. In the current environment, the continued operation and maintenance of this aging and often inefficient infrastructure presents a real challenge to Center leadership in the trade space of sustaining infrastructure versus not investing in future capabilities. To address this issue, the Center has developed a forward looking revitalization strategy that ties future core competencies and technical capabilities to the Center Master Facility Plan to maintain a viable Center well into the future. This paper documents Langley's revitalization strategy which integrates the Center's missions, the Langley 2050 vision, the Center Master Facility Plan, and the New Town repair-by-replacement program through the leadership of the Vibrant Transformation to Advance Langley (ViTAL) Team.

Weiser, Erik S.↗
NASA NTRS2010

Multi-Stage System for Automatic Target Recognition

A multi-stage automated target recognition (ATR) system has been designed to perform computer vision tasks with adequate proficiency in mimicking human vision. The system is able to detect, identify, and track targets of interest. Potential regions of interest (ROIs) are first identified by the detection stage using an Optimum Trade-off Maximum Average Correlation Height (OT-MACH) filter combined with a wavelet transform. False positives are then eliminated by the verification stage using feature extraction methods in conjunction with neural networks. Feature extraction transforms the ROIs using filtering and binning algorithms to create feature vectors. A feedforward back-propagation neural network (NN) is then trained to classify each feature vector and to remove false positives. The system parameter optimizations process has been developed to adapt to various targets and datasets. The objective was to design an efficient computer vision system that can learn to detect multiple targets in large images with unknown backgrounds. Because the target size is small relative to the image size in this problem, there are many regions of the image that could potentially contain the target. A cursory analysis of every region can be computationally efficient, but may yield too many false positives. On the other hand, a detailed analysis of every region can yield better results, but may be computationally inefficient. The multi-stage ATR system was designed to achieve an optimal balance between accuracy and computational efficiency by incorporating both models. The detection stage first identifies potential ROIs where the target may be present by performing a fast Fourier domain OT-MACH filter-based correlation. Because threshold for this stage is chosen with the goal of detecting all true positives, a number of false positives are also detected as ROIs. The verification stage then transforms the regions of interest into feature space, and eliminates false positives using an artificial neural network classifier. The multi-stage system allows tuning the detection sensitivity and the identification specificity individually in each stage. It is easier to achieve optimized ATR operation based on its specific goal. The test results show that the system was successful in substantially reducing the false positive rate when tested on a sonar and video image datasets.

Chao, Tien-Hsin↗
NASA NTRSDate not supplied

Defining Services, Functions, and Capabilities for an Advanced Air Mobility (AAM) In-time Aviation Safety Management System (IASMS)

NASA’s vision for Advanced Air Mobility (AAM) Mission is to help emerging aviation markets to safely develop an air transportation system that moves people and cargo between places previously not served or underserved by aviation. The integration of new operational paradigms and vehicle classes in this system requires a transformation of the National Airspace System (NAS) that includes substantive changes critical for assuring safety. These changes are compelled by unique challenges posed by AAM to the safety management system (SMS). These challenges were assessed by committees of the National Academies in their reports on a vision for an In-time Aviation Safety Management System (IASMS) and a blueprint for AAM [1,2]. In their description of an IASMS, the top recommendation was development of a concept of operations (ConOps) for IASMS. This paper describes the high-priority recommendations from the National Academies for its IASMS vision and how they are addressed through a distributed system-of-systems architecture. The IASMS architecture is structured on the services, functions, and capabilities (SFCs) necessary for In-time System-wide Safety Assurance (ISSA)initially developed for urban air mobility (UAM). The paper then posits where these SFCs would reside across vehicles, airspace, or service suppliers such as Supplemental Data Service Providers (SDSPs), and how SFCs scale with increasing complexity in design and operations of AAM. SFCs are foundational building blocks for a system that targets an individual or family of risks using a Monitor-Assess-Mitigate risk paradigm for anomalies, precursors and trends. An IASMS could be conceived that uses a portfolio of SFCs for AAM in general or prioritizes SFCs for a specific domain or operation.

K Ellis↗
NASA NTRS2010

The Spatial Vision Tree: A Generic Pattern Recognition Engine- Scientific Foundations, Design Principles, and Preliminary Tree Design

New foundational ideas are used to define a novel approach to generic visual pattern recognition. These ideas proceed from the starting point of the intrinsic equivalence of noise reduction and pattern recognition when noise reduction is taken to its theoretical limit of explicit matched filtering. This led us to think of the logical extension of sparse coding using basis function transforms for both de-noising and pattern recognition to the full pattern specificity of a lexicon of matched filter pattern templates. A key hypothesis is that such a lexicon can be constructed and is, in fact, a generic visual alphabet of spatial vision. Hence it provides a tractable solution for the design of a generic pattern recognition engine. Here we present the key scientific ideas, the basic design principles which emerge from these ideas, and a preliminary design of the Spatial Vision Tree (SVT). The latter is based upon a cryptographic approach whereby we measure a large aggregate estimate of the frequency of occurrence (FOO) for each pattern. These distributions are employed together with Hamming distance criteria to design a two-tier tree. Then using information theory, these same FOO distributions are used to define a precise method for pattern representation. Finally the experimental performance of the preliminary SVT on computer generated test images and complex natural images is assessed.

Rahman, Zia-ur↗
NASA NTRS2005

In Situ Resource Utilization Technology Research and Facilities Supporting the NASA's Human Systems Research and Technology Life Support Program

The NASA Microgravity Science program has transitioned research required in support of NASA s Vision for Space Exploration. Research disciplines including the Materials Science, Fluid Physics and Combustion Science are now being applied toward projects with application in the planetary utilization and transformation of space resources. The scientific and engineering competencies and infrastructure in these traditional fields developed at multiple NASA Centers and by external research partners provide essential capabilities to support the agency s new exploration thrusts including In-Situ Resource Utilization (ISRU). Among the technologies essential to human space exploration, the production of life support consumables, especially oxygen and; radiation shielding; and the harvesting of potentially available water are realistically achieved for long-duration crewed missions only through the use of ISRU. Ongoing research in the physical sciences have produced a body of knowledge relevant to the extraction of oxygen from lunar and planetary regolith and associated reduction of metals and silicon for use meeting manufacturing and repair requirements. Activities being conducted and facilities used in support of various ISRU projects at the Glenn Research Center and Marshall Space Flight Center will be described. The presentation will inform the community of these new research capabilities, opportunities, and challenges to utilize their materials, fluids and combustion science expertise and capabilities to support the vision for space exploration.

Schlagheck, Ronald A.↗
NASA NTRS2016

Visions of the Future: Hybrid Electric Aircraft Propulsion

The National Aeronautics and Space Administration (NASA) is investing continually in improving civil aviation. Hybridization of aircraft propulsion is one aspect of a technology suite which will transform future aircraft. In this context, hybrid propulsion is considered a combination of traditional gas turbine propulsion and electric drive enabled propulsion. This technology suite includes elements of propulsion and airframe integration, parallel hybrid shaft power, turbo-electric generation, electric drive systems, component development, materials development and system integration at multiple levels.

electric motor vehicles↗
DOE OSTI2026

Project 1: COLLECTS Project and Project 2: M&V for Saputo Cheese Project: Cooperative Research and Development (Final Report)

Project 1: Combined Power's Hyperlight Energy and NLR will collaborate on the DOE Concentrating Optics for Lower Levelized Energy CosTS (COLLECTS) project, DE-FOA-0001268. COLLECTS funding opportunity announcement (FOA) seeks to further concentrated solar power (CSP) system technologies by soliciting disruptive, transformative projects for the concentrating solar collectors in the CSP plant. These innovative projects will seek to surpass the targets set out in the SunShot Vision Study, enabling CSP to be cost-competitive with conventional forms of electric power generation. Projects will target the design and manufacturing of novel solar collectors with the ability to significantly reduce the solar field contribution to the overall levelized cost of energy (LCOE) of the CSP plant, and which have not been previously specifically targeted by CSP FOAs. Project 2: Hyperlight will perform measurement and verification (M&V) of Green House Gases and NLR will evaluate energy consumption reduction.

14 SOLAR ENERGY↗
NASA NTRS1990

Programmable Remapper

Input image remapped rapidly and accurately onto different coordinate grid. Analog/digital electronic image-processing system developed to warp input images onto arbitrary coordinate grids at video rates. Advantages of system include antialiasing effect of many-to-one data path and speed of lookup-table operation. Lookup tables reprogrammed easily with help of computer that generates table values from mathematical description of desired transformation. Applications include real-time corrections of distortions in input optics of image sensors, corrections for repeatable nonlinear scanning, and aiding persons of impaired vision by deliberately distorting images onto remaining functional portions of retinas.

Juday, Richard D.↗
NASA NTRS1997

Head-Mounted and Head-Up Display Glossary

One of the problems in head-up and helmet-mounted display (HMD) literature has been a lack of standardization of words and abbreviations. Several different words have been used for the same concept; for example, flight path angle, flight path marker, velocity vector, and total velocity vector all refer to the same thing. In other cases, the same term has been used with two different meanings, such as binocular field-of-view which means the field-of-view visible to both left and right eyes according to some or the field-of-view visible to either the left or right eye or both according to others. Many of the terms used in HMD studies have not been well-defined. We need to have a common language to ensure that system descriptions are communicated. As an example, the term 'stabilized' has been widely used with two meanings. 'Roll-stabilized' has been used to mean a symbol which rotates to indicate the roll or bank of the aircraft. 'World-stabilized' and 'head-stabilized' have both been used to indicate symbols which move to remain fixed with respect to external objects. HMDs present unique symbology problems not found in HUDs. Foremost among these is the issue of maintaining spatial orientation of the symbols. All previous flight displays, round dial instruments, HDDs, and HUDs have been fixed in the cockpit. With the HMD, the flight display can move through a large angle. The coordinates use in transforming from the real-world to the aircraft to the HMD have not been consistently defined. This glossary contains terms relating to optics and vision, displays, and flight information, weapons and aircraft systems. Some definitions, such as Navigation Display, have been added to clarify the definitions for Primary Flight Display and Primary Flight Reference. A list of HUD/HMD related abbreviations is also included.

Newman, Richard L.↗
NASA NTRS2025

Distributed Sensing Node Configuration

A vision and radar sensor integration strategy for surveillance of Advance Air Mobility Mission concept of airspace is contained in the CAD drawing in this publication developed as part of NASA's Transformational Tools and Technology project. High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. Contained herein are drawings that are available in the stp and creo file formats of the distributed sensing nodes. Additional dovetail integration is included to enable rapid changing of embedded system. A day in the life node deployment is included in the 2023_last_flight_day.mp4. Please cite this publication if you use these drawings. This sensor configuration methodology is presented in detail in the publication reference below. Chester Dolph, Thomas Lombaerts, Corey A. Ippolito, Vahram Stepanyan, Evan Kawamura, Keerthana Kannan, George Szatkowski, Todd Ferante, Christopher Morris, Federica Vitiello, Flavia Causa, Roberto Opromolla and Giancarmine Fasano. "Distributed Sensor Fusion of Ground and Air Nodes using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds," AIAA 2024-1781. AIAA SCITECH 2024 Forum. January 2024.

Chester V Dolph↗