Search NASA⌕ Search

SEARCH · Search NASA

Results for “visual system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A single-cell atlas of the bobtail squid visual and nervous system highlights molecular principles of convergent evolution

Abstract The cephalopod and vertebrate visual systems are a textbook example of convergent evolution with unknown molecular underpinnings. Here we characterize 98,537 single-cell transcriptomes in the bobtail squidEuprymna berryito understand how the cephalopod retina and optic lobes relate to the vertebrate retina. We confirm the overall relative simplicity of the cephalopod retina but identify two related photoreceptor cell subtypes expressing distinct r-opsins. By contrast, the adult optic lobe contains a diverse repertoire of neuronal and glial cell types, with a predominance of dopaminergic neurons. We show that cephalopod-specific gene duplicates probably contributed to this cell type diversification. Comparing neuronal cell population in the optic lobes of hatchlings and adults, we reveal a switch towards dopaminergic neurotransmitter usage with age, indicative of a maturation process. We further identify an FMRF-amide-based retrograde signal from the optic lobe towards the retina that supports the functional analogy of the cephalopod optic lobe cortex and the vertebrate inner retina in visual signal processing from a molecular standpoint. Finally, comparative analyses with vertebrate and arthropod cells suggest a scenario in which two photoreceptor types and two neuronal populations may have already been present in the eye of the bilaterian ancestor.

Environmental Sciences & Ecology↗
DOE OSTI2022

Coordinated Ramping Product and Regulation Reserve Procurements in CAISO and MISO using Multi-Scale Probabilistic Solar Power Forecasts (Pro2R)

How can probabilistic solar forecasts lower costs and improve reliability for independent system operator (ISO) markets? We tackle this question in three steps. First, we enhance an existing solar forecasting system to provide well-calibrated hours-ahead probabilistic forecasts. We then relate the degree of uncertainty in those forecasts to error distributions for net load ramps for the California ISO (CAISO) using statistical and machine learning methods. Projected net load errors conditioned on solar uncertainty are translated into flexible ramp requirements that therefore reflect real-time meteorological and solar conditions, improving on typical ISO procedures. Finally, a multi-period look-ahead production cost model quantifies how conditional ramp requirements can a) decrease operating costs by lowering requirements compared to often conservative unconditional methods, and b) reduce generation scarcity events and consequently improve reliability by increasing flexibility requirements at times when unconditional forecast-based requirements understate actual ramp uncertainty. In addition to the products just described (quantification of solar uncertainty, its translation into requirements for ramp capability product, and quantification of the benefits of more accurate ramp requirements), this project also developed a visualization system that alerts system operators of ramp and uncertainty conditions within the network based on solar forecasts. The system is called Resource Forecast and Ramp Visualization for Situational Awareness (RaVIS). These four products represent significant advances in the state-of-the-art of probabilistic solar forecasting, development of weather-informed reserve requirements, production costing methods for estimating the benefits of more accurate reserve requirements, and visualization of system status, respectively. Yet the products are also practical and can be immediately implemented, potentially enabling system operators to save millions of dollars in ramp product procurement costs per year.

14 SOLAR ENERGY↗
DOE OSTI2023

Quantum Computing – Real-Time Data Processing from a Dilution Refrigerator

This poster presents a real-time data visualization system for monitoring and displaying data from a Bluefors control unit connected to a dilution refrigerator. The goal is to provide an aesthetically pleasing and user-friendly web-based interface that continuously updates and displays critical data such as temperature and flow rates at various points within the refrigerator. Leveraging WebSocket technology, the system establishes multiple connections to the dilution refrigerators, enabling simultaneous monitoring of several units. The interactive webpage dynamically updates the data, providing researchers and operators with instant insights into the system's performance. The system's ability to stream and visualize data in real-time enhances the understanding of the dilution refrigerator's behavior, aiding in optimizing its operation and ensuring efficient scientific experiments. The application's web-based nature makes it easily accessible from any device with internet connectivity, promoting seamless collaboration and remote monitoring capabilities. Overall, this poster offers a comprehensive solution for real-time data visualization and analysis of dilution refrigerators, catering to the needs of researchers and scientists working in low-temperature physics and quantum computing fields.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Retina-inspired narrowband perovskite sensor array for panchromatic imaging

The retina is the essential part of the human visual system that receives light, converts it to neural signal, and transmits to brain for visual recognition. The red, green, and blue (R/G/B) cone retina cells are natural narrowband photodetectors (PDs) sensitive to R/G/B lights. Connecting with these cone cells, a multilayer neuro-network in the retina provides neuromorphic preprocessing before transmitting to brain. Inspired by this sophistication, we develop the narrowband (NB) imaging sensor combining R/G/B perovskite NB sensor array (mimicking the R/G/B photoreceptors) with a neuromorphic algorithm (mimicking the intermediate neural network) for high-fidelity panchromatic imaging. Compared to commercial sensors, we use perovskite “intrinsic” NB PD to exempt the complex optical filter array. In addition, we use an asymmetric device configuration to collect photocurrent without external bias, enabling a power-free photodetection feature. These results display a promising design for efficient and intelligent panchromatic imaging.

42 ENGINEERING↗
DOE OSTI2025

Navigating Uncertainty: Challenges in Visualizing Ensemble Data and Surrogate Models for Decision Systems

Uncertainty visualization plays a critical role in transforming ensemble simulation data into actionable insights by effectively communicating various dimensions of uncertainty within a system. The emergence of artificial intelligence-driven surrogate models trained on multirun ensemble data offers a transformative opportunity to replace computationally intensive simulations with fast estimates, enabling users to explore data spaces with unprecedented depth and interactivity. However, integrating ensemble data and surrogate models into decision-making workflows and tools introduces novel challenges for uncertainty visualization. These include reconciling and clearly communicating the unique uncertainties associated with ensembles and their surrogate model estimates, and leveraging these approximations to inform actionable decisions. This work explores these challenges in the context of high-dimensional data visualization, bridging discrete datasets with their continuous representations and addressing the complexities of systems that support iterative navigation between input and output spaces. We evaluate the role of uncertainty visualization in fostering intuitive, actionable interactions and identify critical hurdles in advancing this frontier of computational simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Human Factors Evaluation of Energy Visualization Dashboards

Energy visualization systems provide information about use in real-time to assist users with energy efficiency. In this study, three energy visualization dashboards for small businesses were developed and tested. Performance measurement, NASA Task Load Index (TLX) workload assessment, and posttest survey were used to conduct the usability testing. Compared with the dashboards that were designed using line charts and tables, a dashboard designed using visuals (e.g., gauges, pie charts, and flashing lights) produced quicker response time, lower mental and temporal demand and effort ratings, and higher ratings of engagement, interest, and trustworthiness.

Nimbarte, Ashish D. (ORCID:0000000210599112)↗
DOE OSTI2023

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A simple convertible electrolyzer in membraneless and membrane-based modes for understanding water splitting mechanism

State-of-the-art membrane-based electrolyzers such as proton exchange membrane electrolyzer cells, are costly, susceptible to degradation, and time-consuming for electrode evaluation and triple-phase boundary electrochemical reaction studies. Here, a simple convertible electrolyzer in membraneless and membrane-based modes is proposed. For the first time, this enables comprehensive investigations of water splitting with pure water, acidic and alkaline electrolytes in one cell. With the simple electrolyzer and high-speed visualization system, the influences of flow rate, electrolytes, concentration, and Nafion membrane on the oxygen evolution reactions (OERs), hydrogen evolution reactions (HERs) and electrolyzer performance are comprehensively investigated. Visualization results reveal that water splitting only occurred at the edge between the electrode and the Nafion membrane in pure water. However, they occurred on the whole electrode surface in alkaline and acidic electrolytes, indicating easily tunable reaction sites with the convertible electrolyzer. This demonstrates the feasibility of using the simple convertible electrolyzer for understanding the water splitting mechanism. The relation between electrolyte thickness and resistances with different electrolytes is also quantified. This research provides an insight for optimizing electrochemical devices while delivering an inexpensive and fast way for electrode evaluations and electrochemical reaction studies.

25 ENERGY STORAGE↗
DOE OSTI2025

Adaptive stretching of representations across brain regions and deep learning model layers

Prefrontal cortex (PFC) is known to modulate the visual system to favor goal-relevant information by accentuating task-relevant stimulus dimensions. Does the brain broadly re-configures itself to optimize performance by stretching visual representations along task-relevant dimensions? We considered a task that required monkeys to selectively attend on a trial-by-trial basis to one of two dimensions (color or motion direction) to make a decision. Although effects were most prominent in frontal areas, representations stretched along task-relevant dimensions in all sites considered: V4, MT, lateral PFC, frontal eye fields (FEF), lateral intraparietal cortex (LIP), and inferotemporal cortex (IT). Spike timing was crucial to this code. A deep learning model was trained on the same visual input and rewards as the monkeys. Despite lacking an explicit selective attention or other control mechanism, by minimizing error during learning, the model’s representations stretched along task-relevant dimensions, indicating that stretching is an adaptive strategy.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗
DOE OSTI2025

Real-World Cyber Security Demonstration for Networked Electric Drives

In this article, we present the design and implementation of a cyber-physical security testbed for networked electric drive systems, aimed at conducting real-world security demonstrations. To our knowledge, this is one of the first security testbeds for networked electric drives, seamlessly integrating the domains of power electronics and computer science, and cybersecurity. By doing so, the testbed offers a comprehensive platform to explore and understand the intricate and often complex interactions between cyber and physical systems. The core of our testbed consists of four electric machine drives, meticulously configured to emulate small-scale but realistic information technology (IT) and operational technology (OT) networks. This setup both provides a controlled environment for simulating a wide array of cyber-attacks, and mirrors potential real-world attack scenarios with a high degree of fidelity. The testbed serves as an invaluable resource for the study of cyber-physical security, offering a practical and dynamic platform for testing and validating cybersecurity measures in the context of networked electric drive systems. As a concrete example of the testbed's capabilities, we have developed and implemented a Python-based script designed to execute step-stone attacks over a wireless local area network (WLAN). This script leverages a sequence of target IP addresses, simulating a real-world attack vector that could be exploited by adversaries. To counteract such threats, we demonstrate the efficacy of our developed cyber-attack detection algorithms, which are integral to our testbed's security framework. Furthermore, the testbed incorporates a real-time visualization system using InfluxDB and Grafana, providing a dynamic and interactive representation of networked electric drives and their associated security monitoring mechanisms. This visualization component not only enhances the testbed's usability but also offers insightful, real-time data for researchers and practitioners, thereby facilitating a deeper understanding of cyber-physical security dynamics in networked electric drive systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Role of electron pathway in dimensionally increasing water splitting reaction sites in liquid electrolytes

Hydrogen from water splitting is one of the most promising alternatives for fossil fuels in solving the global energy crisis, while its electrochemical reaction mechanism, especially in liquid electrolytes, remains unclear. Herein, how the electrode conductivity affects the reaction sites of oxygen evolution reactions (OERs) in acidic and alkaline solutions was investigated by employing visualization system and electrochemical testing. Inserting Au nanolayers greatly increased electrode conductivities, improved OER kinetics and reduced cell ohmic resistance, leading to excellent water splitting performances in both acidic and alkaline electrolytes. Furthermore, the in-situ visualization results showed more reaction sites and higher catalyst utilizations were achieved by augmenting the electrode conductivity, and reaction sites increased from 1-dimension to 2-dimension. Additionally, it was discovered that electrical conductivities of acidic and alkaline solutions are insufficient to overcome the sharp drop of potential in the electrical double layer for activating OER uniformly on low-conductivity catalysts, indicating the importance of electrical conductivity of the electrode in acidic and alkaline water electrolyzers. This study provided a guidance on how to develop efficient and compact electrodes for acidic and alkaline water electrolyzer stacks and other electrochemical devices, such as fuel cell, N2 reduction, CO 2 conversion, etc.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

“Understanding Robustness Lottery”: A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches

Deep learning approaches have provided state-of-the-art performance in many applications by relying on large and overparameterized neural networks. However, such networks are very brittle and are difficult to deploy on resource-limited platforms. Model pruning, i.e., reducing the size of the network, is a widely adopted strategy that can lead to a more robust and compact model. Many heuristics exist for model pruning, but our understanding of the pruning process remains limited due to the black-box nature of a neural network model. Empirical studies show that some heuristics improve performance whereas others can make models more brittle. Here, this work aims to shed light on how different pruning methods alter the network’s internal feature representation and the corresponding impact on model performance. To facilitate a comprehensive comparison and characterization of the high-dimensional model feature space, we introduce a visual geometric analysis of feature representations. We evaluated a set of critical geometric concepts decomposed from the commonly adopted classification loss and used them to design a visualization system to compare and highlight the impact of pruning on model performance and feature representation. The proposed tool provides an environment for an in-depth comparison of pruning methods and a comprehensive understanding of how the model responds to common data corruption. By leveraging the proposed visualization, machine learning researchers can reveal the similarities between pruning methods and redundancy in robustness evaluation benchmarks, obtain geometric insights about the differences between pruned models that achieve superior robustness performance, and identify samples that are robust or fragile to model pruning and common data corruption.

Li, Zhimin [Univ. of Utah, Salt Lake City, UT (Uni↗
DOE OSTI2021

Leveraging Prior Concept Learning Improves Generalization From Few Examples in Computational Models of Human Object Recognition

Humans quickly and accurately learn new visual concepts from sparse data, sometimes just a single example. The impressive performance of artificial neural networks which hierarchically pool afferents across scales and positions suggests that the hierarchical organization of the human visual system is critical to its accuracy. These approaches, however, require magnitudes of order more examples than human learners. We used a benchmark deep learning model to show that the hierarchy can also be leveraged to vastly improve the speed of learning. We specifically show how previously learned but broadly tuned conceptual representations can be used to learn visual concepts from as few as two positive examples; reusing visual representations from earlier in the visual hierarchy, as in prior approaches, requires significantly more examples to perform comparably. These results suggest techniques for learning even more efficiently and provide a biologically plausible way to learn new visual concepts from few examples.

Rule, Joshua S.↗
DOE OSTI2025

Development of Lighting Application Efficacy Measurement Framework

Lighting significantly contributes to electricity consumption in buildings. The most widely used measure of lighting energy efficiency, luminous efficacy, quantifies only the intensity of light generated by light sources, weighted by the spectral sensitivity of the human visual system (i.e., the energy efficiency of individual lighting devices). However, luminous efficacy does not fully address the use of lighting in architectural spaces. To address these limitations, we developed a framework to framework to calculate lighting application efficacy (LAE), the relationship between the electrical power consumed by lighting hardware, and the amount of light that contributes to the visual perception of building occupants. The proposed LAE framework is based on the primary pathway of light in architectural settings: the generation and emission of light from a luminaire, the travel of the light throughout the space and into the eyes of occupants, and the process of visual perception. The project’s primary outputs are a method for measuring lighting application efficacy and a framework for facilitating future research to improve the metric.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Q-VR: System-Level Design for Future Mobile Collaborative Virtual Reality

High Quality Mobile Virtual Reality (VR) is what the incoming graphics technology era demands: users around the world, regardless of their hardware and network conditions, can all enjoy the immersive virtual experience. However, the state-of-the-art software-based mobile VR designs cannot fully satisfy the realtime performance requirements due to the highly interactive nature of user's actions and complex environmental constraints during VR execution. Inspired by the unique human visual system effects and the strong correlation between VR motion features and realtime hardware-level information, we propose Q-VR, a novel dynamic collaborative rendering solution via software-hardware co-design for enabling future low-latency high-quality mobile VR. At software-level, Q-VR provides flexible high-level tuning interface to reduce network latency while maintaining user perception. At hardware-level, Q-VR accommodates a wide spectrum of hardware and network conditions across users by effectively leveraging the computing capability of the increasingly powerful VR hardware. Extensive evaluation on real-world games demonstrates that Q-VR can achieve an average end-to-end performance speedup of 3.4x (up to 6.7x) over the traditional local rendering design in commercial VR devices, and a 4.1x frame rate improvement over the state-of-the-art static collaborative rendering.

Xie, Chenhao↗
DOE OSTI2022

An EvoDevo Study of Salmonid Visual Opsin Dynamics and Photopigment Spectral Sensitivity

Salmonids are ideal models as many species follow a distinct developmental program from demersal eggs and a large yolk sac to hatching at an advanced developmental stage. Further, these economically important teleosts inhabit both marine- and freshwaters and experience diverse light environments during their life histories. At a genome level, salmonids have undergone a salmonid-specific fourth whole genome duplication event (Ss4R) compared to other teleosts that are already more genetically diverse compared to many non-teleost vertebrates. Thus, salmonids display phenotypically plastic visual systems that appear to be closely related to their anadromous migration patterns. This is most likely due to a complex interplay between their larger, more gene-rich genomes and broad spectrally enriched habitats; however, the molecular basis and functional consequences for such diversity is not fully understood. This study used advances in genome sequencing to identify the repertoire and genome organization of visual opsin genes (those primarily expressed in retinal photoreceptors) from six different salmonids [Atlantic salmon ( Salmo salar ), brown trout ( Salmo trutta ), Chinook salmon ( Oncorhynchus tshawytcha ), coho salmon ( Oncorhynchus kisutch ), rainbow trout ( Oncorhynchus mykiss ), and sockeye salmon ( Oncorhynchus nerka )] compared to the northern pike ( Esox lucius ), a closely related non-salmonid species. Results identified multiple orthologues for all five visual opsin classes, except for presence of a single short-wavelength-sensitive-2 opsin gene. Several visual opsin genes were not retained after the Ss4R duplication event, which is consistent with the concept of salmonid rediploidization. Developmentally, transcriptomic analyzes of Atlantic salmon revealed differential expression within each opsin class, with two of the long-wavelength-sensitive opsins not being expressed before first feeding. Also, early opsin expression in the retina was located centrally, expanding dorsally and ventrally as eye development progressed, with rod opsin being the dominant visual opsin post-hatching. Modeling by spectral tuning analysis and atomistic molecular simulation, predicted the greatest variation in the spectral peak of absorbance to be within the Rh2 class, with a ∼40 nm difference in λ max values between the four medium-wavelength-sensitive photopigments. Overall, it appears that opsin duplication and expression, and their respective spectral tuning profiles, evolved to maximize specialist color vision throughout an anadromous lifecycle, with some visual opsin genes being lost to tailor marine-based vision.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Synchrotron‐source micro‐x‐ray computed tomography for examining butterfly eyes

Comparative anatomy is an important tool for investigating evolutionary relationships among species, but the lack of scalable imaging tools and stains for rapidly mapping the microscale anatomies of related species poses a major impediment to using comparative anatomy approaches for identifying evolutionary adaptations. We describe a method using synchrotron source micro-x-ray computed tomography (syn-μXCT) combined with machine learning algorithms for high-throughput imaging of Lepidoptera (i.e., butterfly and moth) eyes. Our pipeline allows for imaging at rates of ~15 min/mm 3 at 600 nm 3 resolution. Image contrast is generated using standard electron microscopy labeling approaches (e.g., osmium tetroxide) that unbiasedly labels all cellular membranes in a species-independent manner thus removing any barrier to imaging any species of interest. To demonstrate the power of the method, we analyzed the 3D morphologies of butterfly crystalline cones, a part of the visual system associated with acuity and sensitivity and found significant variation within six butterfly individuals. Despite this variation, a classic measure of optimization, the ratio of interommatidial angle to resolving power of ommatidia, largely agrees with early work on eye geometry across species. We show that this method can successfully be used to determine compound eye organization and crystalline cone morphology. Our novel pipeline provides for fast, scalable visualization and analysis of eye anatomies that can be applied to any arthropod species, enabling new questions about evolutionary adaptations of compound eyes and beyond.

59 BASIC BIOLOGICAL SCIENCES↗