Search NASA⌕ Search

SEARCH · Search NASA

Results for “digital assistant”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Deep learning applications in visual data for benign and malignant hematologic conditions: a systematic review and visual glossary

Deep learning (DL) is a subdomain of artificial intelligence algorithms capable of automatically evaluating subtle graphical features to make highly accurate predictions, which was recently popularized in multiple imaging-related tasks. Because of its capabilities to analyze medical imaging such as radiology scans and digitized pathology specimens, DL has significant clinical potential as a diagnostic or prognostic tool. Coupled with rapidly increasing quantities of digital medical data, numerous novel research questions and clinical applications of DL within medicine have already been explored. Similarly, DL research and applications within hematology are rapidly emerging, although these are still largely in their infancy. Given the exponential rise of DL research for hematologic conditions, it is essential for the practising hematologist to be familiar with the broad concepts and pitfalls related to these new computational techniques. This narrative review provides a visual glossary for key deep learning principles, as well as a systematic review of published investigations within malignant and non-malignant hematologic conditions, organized by the different phases of clinical care. In order to assist the unfamiliar reader, this review highlights key portions of current literature and summarizes important considerations for the critical understanding of deep learning development and implementations in clinical practice.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1997

Computational Models of Human Performance: Validation of Memory and Procedural Representation in Advanced Air/Ground Simulation

The Man-Machine Interaction Design and Analysis System (MIDAS) under joint U.S. Army and NASA cooperative is intended to assist designers of complex human/automation systems in successfully incorporating human performance capabilities and limitations into decision and action support systems. MIDAS is a computational representation of multiple human operators, selected perceptual, cognitive, and physical functions of those operators, and the physical/functional representation of the equipment with which they operate. MIDAS has been used as an integrated predictive framework for the investigation of human/machine systems, particularly in situations with high demands on the operators. We have extended the human performance models to include representation of both human operators and intelligent aiding systems in flight management, and air traffic service. The focus of this development is to predict human performance in response to aiding system developed to identify aircraft conflict and to assist in the shared authority for resolution. The demands of this application requires representation of many intelligent agents sharing world-models, coordinating action/intention, and cooperative scheduling of goals and action in an somewhat unpredictable world of operations. In recent applications to airborne systems development, MIDAS has demonstrated an ability to predict flight crew decision-making and procedural behavior when interacting with automated flight management systems and Air Traffic Control. In this paper, we describe two enhancements to MIDAS. The first involves the addition of working memory in the form of an articulatory buffer for verbal communication protocols and a visuo-spatial buffer for communications via digital datalink. The second enhancement is a representation of multiple operators working as a team. This enhanced model was used to predict the performance of human flight crews and their level of compliance with commercial aviation communication procedures. We show how the data produced by MIDAS compares with flight crew performance data from full mission simulations. Finally, we discuss the use of these features to study communication issues connected with aircraft-based separation assurance.

Corker, Kevin M.↗
DOE OSTI2021

UEMtomaton: A Source-Available Platform to Aid in Start-up of Ultrafast Electron Microscopy Labs

The steady rise in the number of ultrafast electron microscopy (UEM) labs, in addition to the opacity and lack of detailed descriptions of current approaches that would enable point-by-point construction, has created an opportunity for sharing common methods and instrumentation for (for example) automating data acquisition to assist in efficient lab start-up and to learn about common and robust protocols. In the spirit of open sharing of methods, we provide here a description of an entry-level method and user interface (UI) for automating UEM experiments, and we provide access to the source code and scripts (source-available) for ease of implementation or as a starting reference point for those entering or seeking to enter the field (https://github.com/CEMSFlannigan/UEMtomaton/releases/tag/v1.0). Core instrumentation and physical connections in the UEM lab at Minnesota are described. Interface communication schemes consisting of duo server-client pairs between critical components – the optical delay stage and the UEM digital camera – are presented, with emphasis placed on describing the logic and communications sequence designed to conduct automated series acquisitions. An application designed and programmed with C++/CLI as Windows Forms in Microsoft Visual Studio – dubbed UEMtomaton – is also presented. Key to the UI layout is centralization of the automation tasks and establishment of communication within the software rather than by interfacing with each individual workstation. It is our hope that this note provides useful insight for current and future UEM researchers, particularly with respect to generalizability and portability of the approach to emerging labs. Here, we note that while this basic, entry-level approach is certainly not the most sophisticated or comprehensive of those currently in use, we feel there is nevertheless value in clearly communicating a proven straightforward method to hopefully lower the barrier to entry into the field.

47 OTHER INSTRUMENTATION↗
NASA NTRS2008

Characterization of Lunar Polar Illumination from a Power System Perspective

This paper presents the results of illumination analyses for the lunar south and north pole regions obtained using an independently developed analytical tool and two types of digital elevation models (DEM). One DEM was based on radar height data from Earth observations of the lunar surface and the other was a combination of the radar data with a separate dataset generated using Clementine spacecraft stereo imagery. The analysis tool enables the assessment of illumination at most locations in the lunar polar regions for any time and any year. Maps are presented for both lunar poles for the worst case winter period (the critical power system design and planning bottleneck) and for the more favorable best case summer period. Average illumination maps are presented to help understand general topographic trends over the regions. Energy storage duration maps are presented to assist in power system design. Average illumination fraction, energy storage duration, solar/horizon terrain elevation profiles and illumination fraction profiles are presented for favorable lunar north and south pole sites which have the potential for manned or unmanned spacecraft operations. The format of the data is oriented for use by power system designers to develop mass optimized solar and energy storage systems.

Fincannon, James↗
NASA NTRS1986

Research on enhancing the utilization of digital multispectral data and geographic information systems in global habitability studies

The University of Kansas Applied Remote Sensing (KARS) program is engaged in a continuing long term research and development effort designed to reveal and facilitate new applications of remote sensing technology for decision makers in governmental agencies and private firms. Some objectives of the program follows. The development of new modes of analyzing multispectral scanner, aerial camera, thermal scanner, and radar data, singly or in concert in order to more effectively use these systems. Merge data derived from remote sensing with data derived from conventional sources in geographic information systems to facilitate better environmental planning. Stimulation of the application of the products of remote sensing systems to problems of resource management and environmental quality now being addressed in NASA's Global Habitability directive. The application of remote sensing techniques and analysis and geographic information systems technology to the solution of significant concerns of state and local officials and private industry. The guidance, assistance and stimulation of faculty, staff and students in the utilization of information from the Earth Resources Satellite (LANDSAT) and Aircraft Programs of NASA in research, education, and public service activities carried at the University of Kansas.

Martinko, E. A.↗
DOE OSTI2024

True random number generation using the spin crossover in LaCoO 3

While digital computers rely on software-generated pseudo-random number generators, hardware-based true random number generators (TRNGs), which employ the natural physics of the underlying hardware, provide true stochasticity, and power and area efficiency. Research into TRNGs has extensively relied on the unpredictability in phase transitions, but such phase transitions are difficult to control given their often abrupt and narrow parameter ranges (e.g., occurring in a small temperature window). Here we demonstrate a TRNG based on self-oscillations in LaCoO 3 that is electrically biased within its spin crossover regime. The LaCoO 3 TRNG passes all standard tests of true stochasticity and uses only half the number of components compared to prior TRNGs. Assisted by phase field modeling, we show how spin crossovers are fundamentally better in producing true stochasticity compared to traditional phase transitions. As a validation, by probabilistically solving the NP-hard max-cut problem in a memristor crossbar array using our TRNG as a source of the required stochasticity, we demonstrate solution quality exceeding that using software-generated randomness.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2010

In-Flight Operation of the Dawn Ion Propulsion System: Status at One Year from the Vesta Rendezvous

The Dawn mission, part of NASA's Discovery Program, has as its goal the scientific exploration of the two most massive main-belt asteroids, Vesta and Ceres. The Dawn spacecraft was launched from Cape Canaveral Air Force Station on September 27, 2007 on a Delta-II 7925H-9.5 (Delta-II Heavy) rocket that placed the 1218 kg spacecraft into an Earth-escape trajectory. On-board the spacecraft is an ion propulsion system (IPS) developed at the Jet Propulsion Laboratory which will provide most of the delta V needed for heliocentric transfer to Vesta, orbit capture at Vesta, transfer among Vesta science orbits, departure and escape from Vesta, heliocentric transfer to Ceres, orbit capture at Ceres, and transfer among Ceres science orbits. The Dawn ion thruster [I thought we only called it a thruster. Both terms are used in the paper, but I think a replacement of every occurrence of "engine" with "thruster" would be clearer.] design is based on the design validated on NASA's Deep Space 1 (DS1) mission. However, because of the very substantial (11 km/s) delta V requirements for this mission Dawn requires two engines to complete its mission objectives. The power processor units (PPU), digital control and interface units (DCIU) slice boards and the xenon control assembly (XCA) are derivatives of the components used on DS1. The DCIUs and thrust gimbal assemblies (TGA) were developed at the Jet Propulsion Laboratory. The spacecraft was provided by Orbital Sciences Corporation, Sterling, Virginia, and the mission is managed by and operated from the Jet Propulsion Laboratory. Dawn partnered with Germany, Italy and Los Alamos National Laboratory for the science instruments. The mission is led by the principal investigator, Dr. Christopher Russell, from the University of California, Los Angeles. The first 80 days after launch were dedicated to the initial checkout of the spacecraft followed by cruise to Mars. Cruise thrusting leading to a Mars gravity assist began on December 17, 2007 and was successfully concluded as planned on October 31, 2008. During this time period the Dawn IPS was operated mostly at full power for approximately 6500 hours, consumed 71.7 kg of xenon and delivered approximately 1.8 km/s of delta V to the spacecraft. The thrusting to Mars was followed by a coasting period of approximately 3.5 months that included a Mars flyby in February of 2009. The Mars flyby provided a gravity assist (MGA) for a plane change and approximately 1 km/s of heliocentric energy increase and is the only part of the mission following launch in which a needed velocity change is not accomplished by the IPS. During the coast period IPS was operated for a trajectory correction maneuver and for engineering tests but was not operated for primary propulsion. Closest approach to Mars occurred as planned on February 17, 2009 and was followed by another coasting period of just under 4 months in duration. During this last coasting phase IPS was operated only for routine maintenance activities and for system engineering tests. Deterministic thrusting for heliocentric transfer to Vesta resumed on June 8, 2009. Since resumption of cruise to Vesta IPS has been operated at throttled power levels, most of the time at full power, and with a duty cycle of approximately 93%, leading to an arrival at Vesta in July of 2011 and arrival at Ceres in February 2015. This paper provides an overview of Dawn's mission objectives and the results of Dawn IPS mission operations through one year from the spacecraft's rendezvous with Vesta.

Garner, Charles E.↗
NASA NTRS2009

In-Flight Operation of the Dawn Ion Propulsion System Through Start of the Vesta Cruise Phase

The Dawn mission, part of NASA's Discovery Program, has as its goal the scientific exploration of the two most massive main-belt asteroids, Vesta and Ceres. The Dawn spacecraft was launched from Cape Canaveral Air Force Station on September 27, 2007 on a Delta-II 7925H-9.5 (Delta-II Heavy) rocket that placed the 1218 kg spacecraft into an Earth-escape trajectory. On-board the spacecraft is an ion propulsion system (IPS) which will provide most of the delta V needed for heliocentric transfer to Vesta, orbit capture at Vesta, transfer to Vesta science orbits, departure and escape from Vesta, heliocentric transfer to Ceres, orbit capture at Ceres, and transfer to Ceres science orbits. The Dawn ion design is based on the design validated on NASA's Deep Space 1 (DS1) mission. However, because of the very substantial (11 km/s) delta V requirements for this mission Dawn requires two engines to complete its mission objectives. The power processor units (PPU), digital control and interface units (DCIU) slice boards and the xenon control assembly (XCA) are derivatives of the components used on DS1. The DCIUs and thrust gimbal assemblies (TGA) were developed at the Jet Propulsion Laboratory. The spacecraft was provided by Orbital Sciences Corporation, Sterling, Virginia, and the mission is managed by and operated from the Jet Propulsion Laboratory. Dawn partnered with Germany, Italy and Los Alamos National Laboratory for the science instruments. The mission is led by the principal investigator, Dr. Christopher Russell, from the University of California, Los Angeles. The first 80 days after launch were dedicated to the initial checkout of the spacecraft followed by cruise to Mars. Cruise thrusting leading to a Mars gravity assist began on December 17, 2007 and was successfully concluded as planned on October 31, 2008. During this time period the Dawn IPS was operated mostly at full power for approximately 6500 hours, consumed 71.7 kg of xenon and delivered approximately 1.8 km/s of delta V to the spacecraft. The thrusting to Mars was followed by a coasting period of approximately 3.5 months that included a Mars flyby in February of 2009. The Mars flyby provided a gravity assist (MGA) for a plane change and approximately 1 km/s of heliocentric energy increase and is the only part of the mission following launch in which a needed velocity change is not accomplished by the IPS. During the coast period IPS was operated for a trajectory correction maneuver and for engineering tests but was not operated for primary propulsion. Closest approach to Mars occurred as planned on February 17, 2009 and was followed by another coasting period of just under 4 months in duration. During this last coasting phase IPS was operated only for routine maintenance activities and for system engineering tests. Deterministic thrusting for heliocentric transfer to Vesta resumed on June 8, 2009. IPS will be operated for over two years at throttled power levels leading to arrival at Vesta in September of 2011 and arrival at Ceres in February 2015. This paper provides an overview of Dawn's mission objectives and the results of Dawn IPS mission operations through the start of deterministic thrusting to Vesta.

Garner, Charles E.↗
NASA NTRSDate not supplied

Quantum-Compatible Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

Wildfire occurrences have been increasing for the past decade, leaving devastating traces across the world. In the recent efforts, remote sensing and airborne missions have been utilized to better understand and manage wildfires. This has resulted in an exponential increase in volume of remote sensing data, which has pushed the need for intelligent automation of data extraction for wildfire studies. Machine learning offers accurate automation in detecting such natural anomalies and enable decision-makers to take actions in a timely manner. Recent advances in machine learning algorithms, namely probabilistic generative methods, allow researchers and decisionmakers to step beyond detection and study “what-if” scenarios for wildfire occurrences. Additionally, they offer better imitations to the stochastic behavior of nature, and wildfire events. However, optimizing the performance of these probabilistic generative models is a computationally expensive process, specially using digital computers. On the other hand, quantum computers have recently shown a promise to reduce computationally costly training of such models and provide performance improvements. There is a body of research investigating the potential for improved machine learning methods in which key operations are performed on a quantum computer. In this study, we propose a probabilistic image-toimage segmentation approach combining a very well-known segmentation method, U-NET, with a Conditional Variational Auto-Encoder (CVAE) to not only detect wildfires but also describe the stochasticity of the phenomenon and be capable of running “what-if” scenarios. Our proposed model is compatible with training on quantum computers, which results in a quantum-assisted image-to-image segmentation approach and can be used to benchmark the potential benefit of quantum computing over the classical one.

quantum↗
DOE OSTI2022

Machine learning-assisted upscaling analysis of reservoir rock core properties based on micro-computed tomography imagery

Optimum solutions for geologic modeling and reservoir simulation in industries such as oil and gas recovery and carbon capture and storage require accurate characterization of reservoir properties, which are often heterogeneous. In this study, high-quality micro-computed tomography (CT) images (1.475-μm/pixel resolution) of a sandstone core acquired from the Bell Creek oil field, USA, were used to provide nondestructive analysis of pore- and core-scale heterogeneity across measurement scales of 94–566 μm. In addition to characterizing the as-received sample, the core sample was flooded with brine to evaluate the capacity of the core sample to receive injected fluids. The micro-CT images were systematically segmented into pore spaces and grains via machine learning (ML) steps including image preprocessing, label creation using a traditional ML method based on limited manual image annotation, and finally U-Net segmentation. The segmented image stacks were reconstructed into digital cubes of various scales of voxel lengths. The 3D porosity values were calculated for all the digital cubes, and the fractal dimensions of the cubes were estimated using a box-counting method. The results showed that smaller cubes had greater heterogeneity and that the porosity values could be accurately estimated by fractal dimension and voxel lengths using ML models. For the core sample with brine flooding, the ratio of pores filled by brine to the total pore space was related to the porosity and could also be accurately estimated by porosity, fractal dimension, and voxel lengths using ML models. In conclusion, the results of this study demonstrate that the concept of fractal dimension can be a useful vector to perform upscaling analysis of sandstone rock heterogeneity from the pore to core scale and that fractal dimensions can be used to estimate porosity values and pore space-filling capacity across those scales.

58 GEOSCIENCES↗
NASA NTRS1998

Monitoring of Volcanogenic CO2-Induced Tree Kills with AVIRIS Image Data at Mammoth Mountain, California

Elevated cold CO2 emissions from the flank of Mammoth Mountain volcano on the southwest rim of the Long Valley Caldera, eastern California, have been the cause of over 100 acres of dead trees in that area since 1990. The source of the CO2 gas is thought to be from one or more magmatic intrusion(s) beneath Mammoth Mountain and is probably related to a period of seismic unrest that began in 1989. The gas rises to the surface probably from depths of a few kilometers, along faults and fracture zones. The gas is at ambient temperature and diffuses from the soil rather than discharging from distinct vents. Typically, soil gas concentrations in tree-kill areas range from 10% to over 90% CO2 by volume, as compared to normal background of < 1% in healthy forest. The gas composition is predominantly CO2 mixed with air (sulfur gases are not elevated), and C and He isotopic ratios are consistent with a magmatic origin for the gas. The total CO2 emission has been estimated at 1200 tons/day, comparable to the emissions at Kilauea. Some of the dead trees are as old as 250 years, suggesting that similar anomalous gas discharge has not occurred over the previous few hundred years. The delta C-13/12 ratio in the Mammoth Mountain CO2 emission averages about -4.5 (PDB standard). This is consistent with a mantle source for the carbon. However, the large volume of the emission suggests that not all of the CO2 is necessarily being generated from the 1989 intrusion. The voluminous gas could be leaking from a vapor-rich zone, capped by an impermeable layer, that was supplied CO2 from degassing of many small magma bodies that intruded beneath the mountain over a period of decades or centuries. Earthquakes in 1989 could have fractured the capping layer and provided pathways for the escape Of CO2 to the surface. Alternatively, some of the CO2 could be derived from contact metamorphism of carbonate rocks intruded by magma. Carbonate-bearing Paleozoic roof pendents crop out in close proximity to Mammoth Mountain. It is possible that similar rocks could occur at depth beneath Mammoth Mountain, and could have contributed CO2 from thermal decomposition caused from recent intrusions. We hope to determine the C-13/12 ratio of a suite of samples to demonstrate if the carbonate rocks could be the source of at least part of the 1990-97 CO2 emission. To better understand the behavior of the CO2 gas, we have used hyperspectral imagery data of Mammoth Mountain acquired from the Airborne Visual/Infrared Imaging Spectrometer (AVIRIS) to map out areas of dead trees. The areas of tree kill have increased in size from about 50 acres in 1994 to about 100 acres in 1997. Tree kill is the major surface manifestation of the carbon dioxide flux at Mammoth Mountain, is widely dispersed, and has been cursorily mapped by regular field mapping techniques in the area. Initial investigations using airborne digital imagery from the Thematic Mapper Simulator (NS001) and AVIRIS instruments have shown extremely encouraging results for complete delineation of the vegetation anomalies. The most successful maps (when compared with ground truth) were developed using AVIRIS data with spectral angle mapper and matched filter algorithms with a data set that was reduced to maximum variance via the minimum noise fraction transformation. The result of this work is a series of maps that show the tree kill areas occurring in an halo-pattern surrounding the base of Mammoth Mountain. We are applying these same techniques to earlier AVIRIS images of Mammoth Mountain to examine the progression of the tree kill areas over time. Temporal maps of the tree kill areas may assist in constructing a picture of the structure beneath Mammoth Mountain.

Hausback, Brian P.↗
NASA NTRS2001

Compression of echocardiographic scan line data using wavelet packet transform

An efficient compression strategy is indispensable for digital echocardiography. Previous work has suggested improved results utilizing wavelet transforms in the compression of 2D echocardiographic images. Set partitioning in hierarchical trees (SPIHT) was modified to compress echocardiographic scanline data based on the wavelet packet transform. A compression ratio of at least 94:1 resulted in preserved image quality.

Non-NASA Center↗
NASA NTRS1987

Development of an LED display system for cross-track distance and velocity for Loran-C flight

The methodology for estimating cross-track velocity by combining rate-gyro and Loran-C data is illustrated in block diagrams. At present, preliminary analysis has established values for K sub 1, K sub 2, the parameters of the digital control loops. A computer program was written to implement a digital simulation of the system as illustrated. Given a model for the noise in the rate-gyro and Loran-C receiver, and their dynamic response, the simulation provides a working model to establish good control loop parameters. The layout of the LED display for flight testing of Loran-C approach flying, which was constructed during a visit to Langley Research Center, is shown. Four bar-graph LED displays are paired to provide cross-track distance and velocity from a Loran-C defined runway centerline. Two seven-segment LED displays are used to provide alphanumeric readout of range to touchdown and desired height. A metal case was built, a circuit board designed, and manufactured with the assistance of NASA Langley personnel.

Dogan, Norry↗
NASA NTRS1981

Some examples of the utility of HCMM data in geologic remote sensing

Examples of HCMM (Heat Capacity Mapping Mission) data in geologic remote sensing are presented, and the data set is composed of HCMM and aircraft digital scanner data and ground truth data from four western U.S. test sites. Data are used in the thermal model to test thermal data effectiveness, and changes in temperature with depth and time for dry soils are described by the model. It is found that the HCMM thermal inertia image is useful in the separability of bedrock and alluvium in Death Valley, and aa and pahoehoe flows in the Pisgah basalt flow. In a color composite of HCMM day temperature, night temperature, and day visible images of the Pisgah Crater test site, it is possible to distinguish alluvium, playa, aa and pahoehoe basalt flow, rhyolite intrusives, and other elements. Ground checking of units at a few points will extend capabilities to large areas and assist in creating telegeologic maps.

Kahle, A. B.↗
NASA NTRS2001

Aeronautical-Satellite-Assisted Process Being Developed for Information Exchange Through Network Technologies (Aero-SAPIENT)

Communications technologies are being developed to address safety issues during aviation travel. Some of these technologies enable the aircraft to be in constant bidirectional communications with necessary systems, people, and other aircraft that are not currently in place today. Networking technologies, wireless datalinks, and advanced avionics techniques are areas of particular importance that the NASA Glenn Research Center has contributed. Glenn, in conjunction with the NASA Ames Research Center, NASA Dryden Flight Research Center, and NASA Langley Research Center, is investigating methods and applications that would utilize these communications technologies. In mid-June 2000, the flight readiness of the network and communications technologies were demonstrated via a simulated aircraft. A van simulating an aircraft was equipped with advanced phased-array antennas (Advanced Communications/Air Traffic Management (AC/ATM) Advanced Air Transportation Technologies (AATT) project) that used commercial Ku-band satellite communications to connect Glenn, Dryden, and Ames in a combined system ground test. This test simulated air-ground bidirectional transport of real-time digital audio, text, and video data via a hybrid network configuration that demonstrated the flight readiness of the network and communications technologies. Specifically, a Controller Pilot Data Link Communications application was used with other applications to demonstrate a multiprotocol capability via Internet-protocol encapsulated ATN (Aeronautical Telecommunications Network) data packets. The significance of this combined ground test is its contribution to the Aero Information Technology Base Program Level I milestone (Software Technology investment area) of a real-time data link for the National Airspace System. The objective of this milestone was to address multiprotocol technology applicable for real-time data links between aircraft, a satellite, and the ground as well as the ability to distribute flight data with multilevel priorities among several sites.

Zernic, Michael J.↗
NASA NTRS2005

Real-time Enhanced Vision System

Flying in poor visibility conditions, such as rain, snow, fog or haze, is inherently dangerous. However these conditions can occur at nearly any location, so inevitably pilots must successfully navigate through them. At NASA Langley Research Center (LaRC), under support of the Aviation Safety and Security Program Office and the Systems Engineering Directorate, we are developing an Enhanced Vision System (EVS) that combines image enhancement and synthetic vision elements to assist pilots flying through adverse weather conditions. This system uses a combination of forward-looking infrared and visible sensors for data acquisition. A core function of the system is to enhance and fuse the sensor data in order to increase the information content and quality of the captured imagery. These operations must be performed in real-time for the pilot to use while flying. For image enhancement, we are using the LaRC patented Retinex algorithm since it performs exceptionally well for improving low-contrast range imagery typically seen during poor visibility conditions. In general, real-time operation of the Retinex requires specialized hardware. To date, we have successfully implemented a single-sensor real-time version of the Retinex on several different Digital Signal Processor (DSP) platforms. In this paper we give an overview of the EVS and its performance requirements for real-time enhancement and fusion and we discuss our current real-time Retinex implementations on DSPs.

Hines, Glenn D.↗
DOE OSTI2023

Architecture for Quantum-in-the Loop Real-Time Simulations for Designing Resilient Smart Grids

With the power grid growing more complex every day with the inclusion of new sensors and regulatory approvals that enable end-users and small local developers to participate in the grid, it is becoming challenging for conventional smart grid simulation, emulation, and testing technologies to keep up. In this work, we propose that quantum-encoded real-time simulations can be helpful under the new paradigm and operational circumstances to solve optimization problems for power grids. By leveraging the principles of quantum mechanics, the proposed quantum-in-loop (QIL) framework will enable better and faster optimization solutions based on real-world, real-time data streams, facilitating the real-time planning and operations of electrical grids that rely on millions of distributed sensors and controllers. Furthermore, QIL will allow researchers and engineers to assist utilities in designing, developing, and de-risking algorithms to optimize power grid operation and resilience by considering inputs from millions of grid-connected devices. QIL framework is being developed to have a self-limiting triage mechanism, which will help engineers and practitioners identify fundamental physical limits on quantum processors, revealing what quantum algorithms can and cannot do in utility-specific use cases and must continue to count on classical high-performance computing infrastructure.

digital real-time simulation↗
NASA NTRS1997

Image processing for improved eye-tracking accuracy

Video cameras provide a simple, noninvasive method for monitoring a subject's eye movements. An important concept is that of the resolution of the system, which is the smallest eye movement that can be reliably detected. While hardware systems are available that estimate direction of gaze in real-time from a video image of the pupil, such systems must limit image processing to attain real-time performance and are limited to a resolution of about 10 arc minutes. Two ways to improve resolution are discussed. The first is to improve the image processing algorithms that are used to derive an estimate. Off-line analysis of the data can improve resolution by at least one order of magnitude for images of the pupil. A second avenue by which to improve resolution is to increase the optical gain of the imaging setup (i.e., the amount of image motion produced by a given eye rotation). Ophthalmoscopic imaging of retinal blood vessels provides increased optical gain and improved immunity to small head movements but requires a highly sensitive camera. The large number of images involved in a typical experiment imposes great demands on the storage, handling, and processing of data. A major bottleneck had been the real-time digitization and storage of large amounts of video imagery, but recent developments in video compression hardware have made this problem tractable at a reasonable cost. Images of both the retina and the pupil can be analyzed successfully using a basic toolbox of image-processing routines (filtering, correlation, thresholding, etc.), which are, for the most part, well suited to implementation on vectorizing supercomputers.

NASA Discipline Space Human Factors↗