Search NASA⌕ Search

SEARCH · Search NASA

Results for “color vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Effective Visualization of Radar Data for Users Impacted by Color Vision Deficiency

Color vision deficiency (CVD) is a decreased ability to discern between particular colors. Eight percent of genetic males and half a percent of genetic females have some form of CVD, with many in the radar community falling into this group. When presenting data on a two-dimensional plane, it is common to use colors to represent values via a colormap. Colormap choice in the radar community is influenced by the ability to highlight scientifically interesting features in data, institutional choices, and domain dominance of legacy colormaps. The problem with these current colormaps is that many do not project well for those with CVD (i.e., green next to red). In working with the CVD community to address this problem, multiple colormaps for moments such as equivalent reflectivity factor and Doppler velocity were created for users with forms of CVD such as deuteranomaly, protanomaly, protanopia, and deuteranopia using Python tools such as colorspacious and viscm. We show how these colormaps can improve interpretability for four cases: a mesoscale convective system, a pyrocumulonimbus storm, a wintertime midlatitude cyclone, and widespread storms with a large bird migration. These new radar equivalent reflectivity factor, Doppler velocity, and polarization colormaps are designed to highlight rain, frozen precipitation, nonmeteorological targets, and velocity-based items, are perceptually uniform, and are visually friendly for those with CVD.

54 ENVIRONMENTAL SCIENCES↗

On the importance of color in mass spectrometry imaging

Mass spectrometry imaging (MSI) data visualization relies on heatmaps to show the spatial distribution and measured abundances of molecules within a sample. Non-uniform color gradients such as jet are still commonly used to visualize MSI data, increasing the probability of data misinterpretation and false conclusions. Also, the use of non-uniform color gradients and the combination of hues used in common colormaps makes it challenging for people with color vision deficiencies (CVDs) to visualize and accurately interpret data. Here we present best practices for choosing a colormap to accurately display MSI data, improve readability, and accommodate all CVDs. We also provide other resources on the misuse of color in the scientific field and resources on scientifically derived colormaps presented herein.

47 OTHER INSTRUMENTATION↗

Standard experimental paradigm designs and data exclusion practices in cognitive psychology can inadvertently introduce systematic “shadow” biases in participant samples

Abstract Standard cognitive psychology research practices can introduce inadvertent sampling biases that reduce the reliability and generalizability of the findings. Researchers commonly acknowledge and understand that any given study sample is not perfectly generalizable, especially when implementing typical experimental constraints (e.g., limiting recruitment to specific age ranges or to individuals with normal color vision). However, less obvious systematic sampling constraints, referred to here as “shadow” biases, can be unintentionally introduced and can easily go unnoticed. For example, many standard cognitive psychology study designs involve lengthy and tedious experiments with simple, repetitive stimuli. Such testing environments may 1) be aversive to some would-be participants (e.g., those high in certain neurodivergent symptoms) who may self-select not to enroll in such studies, or 2) contribute to participant attrition, both of which reduce the sample’s representativeness. Likewise, standard performance-based data exclusion efforts (e.g., minimum accuracy or response time) or attention checks can systematically remove data from participants from subsets of the population (e.g., those low in conscientiousness). This commentary focuses on the theoretical and practical issues behind these non-obvious and often unacknowledged “shadow” biases, offers a simple illustration with real data as a proof of concept of how applying attention checks can systematically skew latent/hidden variables in the included population, and then discusses the broader implications with suggestions for how to manage and reduce, or at a minimum acknowledge, the problem.

Siritzky, Emma M.↗

Toward the validation of crowdsourced experiments for lightness perception

Crowdsource platforms have been used to study a range of perceptual stimuli such as the graphical perception of scatterplots and various aspects of human color perception. Given the lack of control over a crowdsourced participant’s experimental setup, there are valid concerns on the use of crowdsourcing for color studies as the perception of the stimuli is highly dependent on the stimulus presentation. Here, we propose that the error due to a crowdsourced experimental design can be effectively averaged out because the crowdsourced experiment can be accommodated by the Thurstonian model as the convolution of two normal distributions, one that is perceptual in nature and one that captures the error due to variability in stimulus presentation. Based on this, we provide a mathematical estimate for the sample size needed to produce a crowdsourced experiment with the same power as the corresponding in-person study. We tested this claim by replicating a large-scale, crowdsourced study of human lightness perception with a diverse sample with a highly controlled, in-person study with a sample taken from psychology undergraduates. Our claim was supported by the replication of the results from the latter. These findings suggest that, with sufficient sample size, color vision studies may be completed online, giving access to a larger and more representative sample. With this framework at hand, experimentalists have the validation that choosing either many online participants or few in person participants will not sacrifice the impact of their results.

97 MATHEMATICS AND COMPUTING↗

An EvoDevo Study of Salmonid Visual Opsin Dynamics and Photopigment Spectral Sensitivity

Salmonids are ideal models as many species follow a distinct developmental program from demersal eggs and a large yolk sac to hatching at an advanced developmental stage. Further, these economically important teleosts inhabit both marine- and freshwaters and experience diverse light environments during their life histories. At a genome level, salmonids have undergone a salmonid-specific fourth whole genome duplication event (Ss4R) compared to other teleosts that are already more genetically diverse compared to many non-teleost vertebrates. Thus, salmonids display phenotypically plastic visual systems that appear to be closely related to their anadromous migration patterns. This is most likely due to a complex interplay between their larger, more gene-rich genomes and broad spectrally enriched habitats; however, the molecular basis and functional consequences for such diversity is not fully understood. This study used advances in genome sequencing to identify the repertoire and genome organization of visual opsin genes (those primarily expressed in retinal photoreceptors) from six different salmonids [Atlantic salmon ( Salmo salar ), brown trout ( Salmo trutta ), Chinook salmon ( Oncorhynchus tshawytcha ), coho salmon ( Oncorhynchus kisutch ), rainbow trout ( Oncorhynchus mykiss ), and sockeye salmon ( Oncorhynchus nerka )] compared to the northern pike ( Esox lucius ), a closely related non-salmonid species. Results identified multiple orthologues for all five visual opsin classes, except for presence of a single short-wavelength-sensitive-2 opsin gene. Several visual opsin genes were not retained after the Ss4R duplication event, which is consistent with the concept of salmonid rediploidization. Developmentally, transcriptomic analyzes of Atlantic salmon revealed differential expression within each opsin class, with two of the long-wavelength-sensitive opsins not being expressed before first feeding. Also, early opsin expression in the retina was located centrally, expanding dorsally and ventrally as eye development progressed, with rod opsin being the dominant visual opsin post-hatching. Modeling by spectral tuning analysis and atomistic molecular simulation, predicted the greatest variation in the spectral peak of absorbance to be within the Rh2 class, with a ∼40 nm difference in λ max values between the four medium-wavelength-sensitive photopigments. Overall, it appears that opsin duplication and expression, and their respective spectral tuning profiles, evolved to maximize specialist color vision throughout an anadromous lifecycle, with some visual opsin genes being lost to tailor marine-based vision.

59 BASIC BIOLOGICAL SCIENCES↗

van der Waals Semiconductor Empowered Vertical Color Sensor

We report biomimetic artificial vision is receiving significant attention nowadays, particularly for the development of neuromorphic electronic devices, artificial intelligence, and microrobotics. Nevertheless, color recognition, the most critical vision function, is missed in the current research due to the difficulty of downscaling of the prevailing color sensing devices. Conventional color sensors typically adopt a lateral color sensing channel layout and consume a large amount of physical space, whereas compact designs suffer from an unsatisfactory color detection accuracy. In this work, we report a van der Waals semiconductor-empowered vertical color sensing structure with the emphasis on compact device profile and precise color recognition capability. More attractive, we endow color sensor hardware with the function of chromatic aberration correction, which can simplify the design of an optical lens system and, in turn, further downscales the artificial vision systems. Also, the dimension of a multiple pixel prototype device in our study confirms the scalability and practical potentials of our developed device architecture toward the above applications.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hot, cold, or just right? An infrared biometric sensor to improve occupant comfort and reduce overcooling in buildings via closed-loop control

To improve occupant comfort and save energy in buildings, we have developed a closed-loop air conditioning (AC) sensor-controller that predicts occupant thermal sensation from the thermographic measurement of skin temperature distribution, then uses this information to reduce overcooling (cooling-energy overuse that discomforts occupants) by regulating AC output. Taking measures to protect privacy, it combines thermal-infrared (TIR) and color (visible spectrum) cameras with machine vision to measure the skin-surface temperature profile. Since the human thermoregulation system uses skin blood flow to maintain thermoneutrality, the distribution of skin temperature can be used to predict warm, neutral, and cool thermal states. We conducted a series of human-subject thermal-sensation trials in cold-to-hot environments, measuring skin temperatures and recording thermal sensation votes. We then trained random-forest classification machine-learning models (classifiers) to estimate thermal sensation from skin temperatures or skin-temperature differences. The estimated thermal sensation was input to a proportional integral (PI) control algorithm for the AC, targeting a sensation level between neutral and warm. Our sensor-controller includes a sensor assembly, server software, and client software. The server software orients the cameras and transmits images to the client software, which in turn assesses occupant skin temperature distribution, estimates occupant thermal sensation, and controls AC operation. A demonstration conducted in a conference room in an office building near Houston, TX showed that our system reduced overcooling, decreasing AC load by 42% when the room was occupied while improving occupant comfort (fraction of “comfortable” votes) by 15 percentage points.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Coaxial color channel focus evaluation to estimate standoff height in directed energy deposition additive manufacturing

Directed energy deposition (DED) is an additive manufacturing process that is being rapidly adopted by industry and is well suited for the fabrication of complex components in a variety of metal alloys. In laser cladding systems such as DED, powder is blown in a stream to a metal substrate coincident with a laser necessary to deposit molten metal with 3D spatial control. The focus of both the laser and the powder stream are crucial, and best deposition occurs at a predetermined standoff height between the build surface and the print head. Generally, no monitoring of this distance is implemented in commercial DED systems. Due to potential over or under building, the standoff height often changes over time but tends to self-correct. However, inexpensive and minimally intrusive methods to identify optimal standoff are required to provide real-time control to maintain the optimal distance. The present work explores the quantification of the focus of the three-color channels of a coaxial camera to determine the standoff height. An experiment was performed in which a 254 mm wall is built and the standoff height, initially 5.0 mm below the optimal position, was then intentionally increased every 25.4 mm of wall length by an amount of 1.0 mm to a final position 7.0 mm above optimal. Computer vision is demonstrated to monitor the amount of focus in each color band and estimate standoff distance. Finally, a response can be calculated in under 40 ms using simple hardware and can work in most laser-based DED systems.

36 MATERIALS SCIENCE↗

Automated Waterbox Inspection for Nuclear Power Plants Using Computer Vision - Based Change Detection

Nuclear power plant waterboxes require regular inspection for leaks, missing components, and structural damage during maintenance outages. Traditional manual inspection is time-consuming and poses safety risks from confined space entry. We developed an automated computer vision system for drone-based waterbox inspection in partnership with Florida Light and Power. Our approach uses feature detection and matching to identify critical changes between baseline and current inspection images, automatically flagging additions (leaks/debris), removals (missing plugs), and translations (displaced components) while compensating for drone movement and environmental variations. We systematically evaluated six feature matching methods, from classical approaches (SIFT+BF) to state-of-the-art neural networks (SuperPoint+SuperGlue), using both standard benchmarks (HPatches) and waterbox-specific validation with real-world augmentations. SuperPoint+SuperGlue achieved superior performance with 7.82 pixels RMSE and 100% success rate—2.8x better accuracy than our baseline. While the pre-trained model has commercial licensing restrictions for nuclear deployment, our findings validate this architecture for custom training. We implemented a real-time GUI demonstrating the SIFT+BF approach for immediate deployment, processing drone feeds at 30 FPS with color-coded change visualization. Future work includes training a custom SuperPoint+SuperGlue model on waterbox data and integrating Vision-Language Models for automated reporting and maintenance guidance.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

In Search of Optimum Fresh-Cut Raw Material: Using Computer Vision Systems as a Sensory Screening Tool for Browning-Resistant Romaine Lettuce Accessions

The popularity of ready-to-eat (RTE) salads has prompted novel technology to prolong the shelf life of their ingredients. Fresh-cut romaine lettuce is widely used in RTE salads; however, its tendency to quickly discolor continues to be a challenge for the industry. Selecting the ideal lettuce accessions for use in RTE salads is essential to ensure maximum shelf life, and it is critical to have a practical way to assess and compare the quality of multiple lettuce accessions that are being considered for use in fresh-cut applications. Thus, in this work we aimed to determine whether a computer vision system (CVS) composed of image acquisition, processing, and analysis could be effective to detect visual quality differences among 16 accessions of fresh-cut romaine lettuce during postharvest storage. The CVS involved a post-capturing color correction, effective image segmentation, and calculation of a browning index, which was tested as a predictor of quality and shelf life of fresh-cut romaine lettuce. The results demonstrated that machine vision software can be implemented to replace or supplement the scoring of a trained panel and instrumental quality measurements. Overall visual quality, a key sensory parameter that determines food preferences and consumer behavior, was highly correlated with the browning index, with a Pearson correlation coefficient of −0.85. Other important sensory decision parameters were also strongly or moderately correlated with the browning index, with Pearson correlation coefficients of −0.84 for freshness, 0.79 for off odor, and 0.57 for browning. The ranking of the accessions according to quality acceptability from the sensory evaluation produced a similar pattern to those obtained with the CVS. This study revealed that multiple lettuce accessions can be effectively benchmarked for their performance as fresh-cut sources via a CVS-based method. Future opportunities and challenges in using machine vision image processing to predict consumer preferences for RTE salad greens is also discussed.

Agriculture↗

Vegetation Detection Using Deep Learning and Conventional Methods

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer vision, and machine learning (ML) techniques, is also proposed. The vegetation detection methods were applied to high-resolution airborne color images which consist of RGB and near-infrared (NIR) bands. RGB color images alone were also used with the two deep learning methods to examine their detection performances without the NIR band. The detection performances of the deep learning methods with respect to the object-based detection approach are discussed and sample images from the datasets are used for demonstrations.

58 GEOSCIENCES↗

Chip-integrated metasurface full-Stokes polarimetric imaging sensor

Abstract Polarimetric imaging has a wide range of applications for uncovering features invisible to human eyes and conventional imaging sensors. Chip-integrated, fast, cost-effective, and accurate full-Stokes polarimetric imaging sensors are highly desirable in many applications, which, however, remain elusive due to fundamental material limitations. Here we present a chip-integrated Meta surface-based Full-Stokes Polar imetric Im aging sensor (MetaPolarIm) realized by integrating an ultrathin (~600 nm) metasurface polarization filter array (MPFA) onto a visible imaging sensor with CMOS compatible fabrication processes. The MPFA is featured with broadband dielectric-metal hybrid chiral metasurfaces and double-layer nanograting polarizers. This chip-integrated polarimetric imaging sensor enables single-shot full-Stokes imaging (speed limited by the CMOS imager) with the most compact form factor, records high measurement accuracy, dual-color operation (green and red) and a field of view up to 40 degrees. MetaPolarIm holds great promise to enable transformative applications in autonomous vision, industry inspection, space exploration, medical imaging and diagnosis.

47 OTHER INSTRUMENTATION↗

CRADA Number NFE-19-07847 with MantaPoole Technologies (CRADA Final Report)

As the world becomes more automated, smart and autonomous systems that utilize advanced 3D machine vision are becoming ever more prevalent. To function autonomously, these smart machines need to be able to identify the “what” and “where” of their application by capturing color and depth information. The color information provides the needed contrast information to identify the “what” of a scene while the depth information allows the smart machine to identify “where” an object in a 3D environment is. To capture both the color and depth information using only a single sensor, MantaPoole Technologies (MPT) is developing a new type of 3D light field camera. The approach leverages MPT’s active micro-optics technology which when aligned and placed over an imaging detector are designed to act as an advanced optical filter that controls the direction of light that reaches the underlying pixels.

47 OTHER INSTRUMENTATION↗

Process Image Analysis using Big Data, Machine Learning, and Computer Vision

The development of algorithms for machine learning and data analysis for the 3013 MIS corrosion surveillance program is a collaborative effort by SRNL, USC and GT. For corrosion detection, LCM image data is extracted from large binary files, with software written to convert the data to physical attributes (i.e. height, color and grayscale values; all as functions of a location in a plane projection). The user interface for the software permits selective downloading of binary data and interrogation of attributes. User input thresholds are used to flag attributes of interest. Machine learning algorithms, developed for this application, are used to determine whether the features are the result of corrosion. To address the fundamental mechanisms of corrosion, machine learning algorithms are being developed to derive interatomic potential force-fields from ab-initio DFT calculations. The goal is to apply molecular modeling on a large enough scale to guide the design of resistant materials.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Advances in phosphor two-color ratio method thermography for full-field surface temperature measurements

We report thermographic phosphors can be employed for optical sensing of surface, gas phase, and bulk material temperatures through different strategies including the time-decay method, time-integrated method, and frequency-domain method. We focus on the time-integrated method, also known as the ratio method, as it can be more practical in many situations. This work advances the ratio method using two machine vision cameras with CMOS detectors for full-field temperature measurements of a solid surface. A phosphor calibration coupon is fabricated using aerosol deposition and employed for in situ determination of the temperature-versus-intensity ratio relationship. Algorithms from digital image correlation are employed to determine the stereoscopic imaging system intrinsic and extrinsic parameters, and accurately register material points on the sample to subpixel locations in each image with 0.07 px or better accuracy. Detector nonlinearity is carefully characterized and corrected. Temperature-dependent, spatial non-uniformity of the full-field intensity ratio—posited to be caused by a blue-shift effect of the bandpass filter for non-collimated light and/or a wavelength-dependent transmission efficiency of the lens—is assessed and treated for cases where a standard flat-field correction fails to correct the non-uniformity. In sum, pixel-wise calibration curves relating the computed intensity ratio to temperature in the range of T = 300–430 K are generated, with an embedded error of less than 3 K. This work offers a full calibration methodology and several improvements on two-color phosphor thermography, opening the door for full-field temperature measurements in dynamic tests with deforming test articles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Automatic Image Point Matching

Sparse Image Point Matching (SIPM) is a foundational technology for photo triangulation, structure from motion (SfM), Simultaneous Location and Mapping (SLAM), and data fusion. The goal of the matching is to automatically generate sets of image coordinates that identify the same feature across images. Ideally, the process should be robust to lighting, scale, perspective, and modality changes. The scope of the image matching topic in the field of remote sensing (RS) is enormous because of the variety of collection platforms, modalities, sensor types, applications, and subjects. In this work, we report the history of and assess the state of the art of visible-spectrum (panchromatic and color) image matching of the Earth’s surface. Work specific to large-format images (LFI) (e.g., metric aerial cameras and Earth-observing satellites) will be highlighted. However, the state of the art in this century will mostly be traced through machine vision research and benchmarks because research specific to LFI is rare.

97 MATHEMATICS AND COMPUTING↗

Large‐Scale 2D Perovskite Nanocrystals Photodetector Array via Ultrasonic Spray Synthesis

Abstract 2D perovskite (PVSK) single crystals have received significant attention due to their unique optical and optoelectronic properties. However, current synthesis methods face limitations, particularly in large‐area fabrication, which remain critical barriers to practical applications. In this study, the synthesis of red/green/purple‐blue‐colored 2D PVSK nanocrystals over a large area (4‐inch wafer) and the fabrication of high‐performance photodetector arrays are presented via a facile yet efficient spray‐coating approach with a liquid‐bridge transport effect. The photodetector array achieves 100% working yield, high photo‐responsivity (1.5 × 10 6 A W −1 ) and specific‐detectivity (1.1 × 10 16 Jones) with competitive photomapping characteristics. An intelligent vision system for automatic shape recognition is further demonstrated with a recognition rate exceeding 90%. This study provides significant advances in the scalable synthesis of nanoscale 2D PVSK crystals, their integration into large‐area optoelectronic devices, and their potential use in artificial‐intelligence systems.

Lee, Yoon Ho [Davidson School of Chemical Engineer↗