SEARCH · Search NASA

Results for “SPATIAL PERCEPTION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

207 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2025

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding

Decoding visual experiences from fMRI offers a powerful avenue to understand human perception and develop advanced brain-computer interfaces. However, current progress often prioritizes maximizing reconstruction fidelity while overlooking interpretability, an essential aspect for deriving neuroscientific insight. To address this gap, we propose MoRE-Brain, a neuro-inspired framework designed for high-fidelity, adaptable, and interpretable visual reconstruction. MoRE-Brain uniquely employs a hierarchical Mixture-of-Experts architecture where distinct experts process fMRI signals from functionally related voxel groups, mimicking specialized brain networks. The experts are first trained to encode fMRI into the frozen CLIP space. A finetuned diffusion model then synthesizes images, guided by expert outputs through a novel dual-stage routing mechanism that dynamically weighs expert contributions across the diffusion process. MoRE-Brain offers three main advancements: First, it introduces a novel Mixture-of-Experts architecture grounded in brain network principles for neuro-decoding. Second, it achieves efficient cross-subject generalization by sharing core expert networks while adapting only subject-specific routers. Third, it provides enhanced mechanistic insight, as the explicit routing reveals precisely how different modeled brain regions shape the semantic and spatial attributes of the reconstructed image. Extensive experiments validate MoRE-Brain’s high reconstruction fidelity, with bottleneck analyses further demonstrating its effective utilization of fMRI signals, distinguishing genuine neural decoding from over-reliance on generative priors. Consequently, MoRE-Brain marks a substantial advance towards more generalizable and interpretable fMRI-based visual decoding.

Wei, Yuxiang [Georgia Institute of Technology]↗

NASA NTRS2020

Revisiting the Effectiveness Of HCHO/NO2 Ratios for Inferring Ozone Sensitivity to Its Precursors Using High Resolution Airborne Remote Sensing Observations in A High Ozone Episode During the KORUS-AQ Campaign

The nonlinear chemical processes involved in ozone production (P(O3)) have necessitated using proxy indicators to convey information about the primary dependence of P(O3) on volatile organic compounds (VOCs) or nitrogen oxides (NOx). In particular, the ratio of remotely sensed columns of formaldehyde (HCHO) to nitrogen dioxide (NO2) has been widely used for studying O3 sensitivity. Previous studies found that the errors in retrievals and the incoherent relationship between the column and the near-surface concentrations are a barrier in applying the ratio in a robust way. In addition to these obstacles, we provide calculational-observational evidence, using an ensemble of 0-D photochemical box models constrained by DC-8 aircraft measurements on an ozone event during the Korea-United States Air Quality (KORUS-AQ) campaign over Seoul, to demonstrate the chemical feedback of NO2 on the formation of HCHO is a controlling factor for the transition line between NOx-sensitive and NOx-saturated regimes. A fixed value (~2.7) of the ratio of the chemical loss of NOx (LNOx) to the chemical loss of HO2+RO2 (LROx) perceptibly differentiates the regimes. Following this value, data points with a ratio of HCHO/NO2 less than 1 can be safely classified as NOx-saturated regime, whereas points with ratios between 1 and 4 fall into one or the other regime. We attribute this mainly to the HCHO-NO2 chemical relationship causing the transition line to occur at larger (smaller) HCHO/NO2 ratios in VOC-rich (VOC-poor) environments. We then redefine the transition line to LNOx/LROx~2.7 that accounts for the HCHO-NO2 chemical relationship leading to HCHO = 3.7 × (NO2 – 1.14 × 1016 molec.cm-2). Although the revised formula is locally calibrated (i.e., requires for readjustment for other regions), its mathematical format removes the need for having a wide range of thresholds used in HCHO/NO2 ratios that is a result of the chemical feedback. Therefore, to be able to properly take the chemical feedback into consideration, the use of HCHO = a × (NO2 – b) formula should be preferred to the ratio in future works. We then use the Geostationary Trace gas and Aerosol Sensor Optimization (GeoTASO) airborne instrument to study O3 sensitivity in Seoul. The unprecedented spatial (250 × 250 m2) and temporal (~every 2 h) resolutions of HCHO and NO2 observations form the sensor enhance our understanding of P(O3) in Seoul; rather than providing a crude label for the entire city, more in-depth variabilities in chemical regimes are observed that should be able to inform mitigation strategies correspondingly.

KORUS-AQ; formaldehyde; NOx; VOC; OMI; GeoTASO; oz↗

NASA NTRS2001

Imagining physically impossible self-rotations: geometry is more important than gravity

Previous studies found that it is easier for observers to spatially update displays during imagined self-rotation versus array rotation. The present study examined whether either the physics of gravity or the geometric relationship between the viewer and array guided this self-rotation advantage. Experiments 1-3 preserved a real or imagined orthogonal relationship between the viewer and the array, requiring a rotation in the observer's transverse plane. Despite imagined self-rotations that defied gravity, a viewer advantage remained. Without this orthogonal relationship (Experiment 4), the viewer advantage was lost. We suggest that efficient transformation of the egocentric reference frame relies on the representation of body-environment relations that allow rotation around the observer's principal axis. This efficiency persists across different and conflicting physical and imagined postures.

NASA Discipline Space Human Factors↗

NASA NTRSDate not supplied

Manual Crew Override of Vehicle Landings Following G-Transitions

BACKGROUND Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during g-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that needs to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition to develop appropriate countermeasures. METHODS In this study, we will examine operational piloting tasks following International Space Station (ISS) missions in a simulated lunar landing using a six-degree-of-freedom (6DOF) motion base. The motion-based simulation will be implemented in our laboratory at the Johnson Space Center (JSC) and will be available within hours following the return from commercial crew landings. The primary goals of this study are (1) to understand the impact of spaceflight on crew ability to perform manual crew override tasks, (2) to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency, and (3) compare performance during late “just-in-time” on-board training with early post-flight crew performance. The impact of spaceflight on piloting capability will be assessed from pre- versus post-flight changes in crewmembers assigned to either short duration (< 30 day) or long duration (~6- month) missions to the International Space Station (ISS). Individual differences in post-flight vestibular and cognitive changes include motion sickness reports, measures of tilt motion perception accuracy and precision, and dual-task tracking. During the 6DOF lunar simulation, the crew will manually takeover attitude and rate-of-descent to the nominal or re-designated landing aim point during the approach phase. The outcome measures for the lunar crew override tasks will be the percent time maintaining actual vehicle states, e.g., attitude and rate-of-descent, within recommended guidance during the landing approach, number and maximum deviation outside limits, and root mean square error (RMSE). Given that “just-in-time” (JIT) training is an operational expectation for the Human Landing System (HLS) program, all participants will perform late inflight JIT training for each manual crew override task in which they will participate. Crew proficiency will be captured inflight during JIT training that will be implemented on a laptop with hand controllers to allow the crewmember to practice the landing task procedures like the approach implemented for JIT training with Shuttle landing and ISS telerobotic tasks. COUNTERMEASURE UPDATES The lunar lander simulation has been implemented onto a two-laptop display system where subjects select from alternative landing points, based upon avoiding hazards that the on-board system identifies during the landing. The subject makes inputs using a rotational hand controller (i.e., joystick) and a translational hand controller, which are processed by simulated vehicle dynamics to update the vehicle attitude and rate of descent. Subjects will utilize a combination of flight, situation, and status displays to monitor the state of the simulated vehicle. The simulation exports tilt and translation movements to a 6DOF motion base synced to visual movements and provides representative vestibular cues to the subject while performing the task inside an enclosed cabin featuring a simulated lunar out-the-window view and a heads-down lander cockpit view. RELEVANCE This project will deliver an operational demonstration of crew override capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew override performance will help better characterize the manual control risks associated with sensorimotor alterations. The inclusion of “just-in-time” on-board training will ensure we are characterizing changes in override proficiency with this expected countermeasure in place. ACKNOWLEDGEMENTS: The authors acknowledge contributions from Draper, HLS Joint Test Panel, Crew HLS Interfaces for Piloting Working Group, and Dynamic Skills Trainer (DST) Lab toward the development of the lunar landing simulation. This project is funded by the Human Health Countermeasures Element.

Austin M Bollinger↗

NASA NTRS1986

M.I.T./Canadian vestibular experiments on the Spacelab-1 mission: 4. Space motion sickness: symptoms, stimuli, and predictability

Space sickness symptoms were observed by 4 specially trained observers on Spacelab-1. Three reported persistent symptoms, and vomited repeatedly during the first and/or second day of flight. Head movements on all axes were provocative, particularly in pitch and roll. Head acceleration data recorded from 2 symptomatic crewmen showed that after several hours of physical activity in orbit, symptoms appeared, and thereafter both crewmen were compelled to limit head movements. Firm body contact with motionless surfaces helped alleviate symptoms. When crewmembers floated into unfamiliar body orientations in the cabin, inherent ambiguities in static visual orientation cues sometimes produced spatial reorientation episodes which were also provocative. Symptoms largely resembled those of other forms of prolonged motion sickness, superimposed upon other symptoms attributable to fluid shift. All 4 eventually used anti-motion sickness drugs. When they did, vomiting frequency was reduced. By the 4th day, symptoms subsided, and head accelerations again increased in magnitude and variability. Sickness intensity in orbit was not predicted by statistically concordant results of 6 acute preflight susceptibility tests. However, results from a longer duration preflight prism goggles test showed an apparent correlation. All subjects were asymptomatic making head movements in parabolic flight 4 days after the mission, but not 1 year later. Overall, results support the view that space sickness is a motion sickness.

Non-NASA Center↗

NASA NTRSDate not supplied

Manual Crew Override of Vehicle Landings Following G-Transitions

BACKGROUND Manual control during exploration spaceflight consists of both planned automated supervisory control and unplanned crew override. This crew override capability is critical to enable overall mission success during landing contingencies. However, the introduction of manual override capabilities must be implemented to enable crews to mitigate risks introduced by human error. Adaptive changes in the sensorimotor system can manifest during g-transitions as spatial disorientation. While training and landing aids enable successful landing through disorientation, these adaptive changes may increase cognitive demand that needs to be accounted for in the manual control strategy. It is important to characterize these effects as soon as possible following the G-transition to develop appropriate countermeasures. METHODS The following study seeks to inform the risk associated with altered sensorimotor and vestibular function impacting critical mission tasks. We aim to characterize the effects of short and long-duration weightlessness on manual control following G-transitions using simulated lunar landing on a six-degree-of-freedom (6DOF) motion base, a fixed base simulation, and a supervisory control tablet task. The primary goal is to understand the impact of spaceflight on crew ability to perform manual crew override and supervisory control. This aim will be assessed by comparing pre- versus postflight simulation performance in crewmembers assigned to either short duration (< 30 day) or long duration (~6- month) missions to the International Space Station (ISS). We hypothesize there will be postflight increases in the percent time that pilots are outside of the acceptable range for recommended vehicle state parameters and the reaction time for secondary cognitive tasks. Ground-based control subjects, who are demographically matched to the crew considering age (± 5 years) and gender, will undergo the same testing schedule as the crew to examine the effects of flight phase independent of microgravity exposure. The second aim is to examine how adaptive changes in vestibular and cognitive function relate to changes in manual crew override proficiency. Crew performance for a sensorimotor perceptual test battery will evaluate motion perception tracking, roll nulling, and/or vection sensitivity using the 6DOF motion base. We hypothesize that a higher severity of vestibular alterations will be associated with increased percent time outside of guidance limits. Motion sickness severity and sleepiness will also be evaluated. To determine the impact of “just-in-time” training, the third aim seeks to compare performance during on-board lunar landing tasks conducted late in-flight to early postflight. We hypothesize that proficiency on the “just-in-time” laptop trainer late in mission will be positively correlated with early postflight proficiency on the same task. The final aim will establish assessments of performance, training protocols, and the learning progression in a ground-control cohort of first-time users. RESULTS The assessment of the learning progression associated with the piloting task on the motion base system with thirty ground subjects will be reported. Learning curves will be established across four distinct sessions and within session considering trial difficulty. The difficulty of the landing task can be modulated with the landing divert distance and cross or downrange difficulty. Results may include changes in performance across multiple trials of a multi-attribute lunar tablet supervisory control task. Preliminary investigations of eighteen subjects who completed vestibular threshold and motion perception tasks offer expected performance ranges for upcoming preflight crew evaluations. The results yielded an average roll threshold of 0.46 ± 0.30 deg/s and an average roll nulling root mean square error performance of 2.52 ± 0.52 deg/s. RELEVANCE This project will deliver an operational demonstration of crew monitoring capability following spaceflight and identify potential deficits that may require remediation. Comparison of individual vestibular and cognitive changes with crew performance will help better characterize the manual control risks associated with sensorimotor alterations. Ground testing will evaluate learning progression, refine training protocols, and serve as a control cohort for comparisons to crew performance. ACKNOWLEDGEMENTS: The authors acknowledge contributions from Draper, the Dynamic Skills Trainer (DST) Lab, and the Software, Robotics, and Simulation Division toward the development of the lunar landing simulation platforms. This project is funded by the Human Health Countermeasures Element.

Hannah M. Weiss↗

NASA NTRS1998

Growth dynamics and cytoskeleton organization during stem maturation and gravity-induced stem bending in Zea mays L

Characterization of gravitropic bending in the maize stem pulvinus, a tissue that functions specifically in gravity responses, demonstrates that the pulvinus is an ideal system for studying gravitropism. Gravistimulation during the second of three developmental phases of the pulvinus induces a gradient of cell elongation across the non-growing cells of the pulvinus, with the most elongation occurring on the lower side. This cell elongation is spatially and temporally separated from normal internodal cell elongation. The three characterized growth phases in the pulvinus correspond closely to a specialized developmental sequence in which structural features typical of cells not fully matured are retained while cell maturation occurs in surrounding internodal and nodal tissue. For example, the lignification of supporting tissue and rearrangement of transverse microtubules to oblique that occur in the internode when cell elongation ceases are delayed for up to 10 d in the adjacent cells of the pulvinus, and only occurs as a pulvinus loses its capacity to respond to gravistimulation. Gravistimulation does not modify this developmental sequence. Neither wall lignification nor rearrangement of transverse microtubules occurs in the rapidly elongating lower side or non-responsive upper side of the pulvinus until the pulvinus loses the capacity to bend further. Gravistimulation does, however, lead to the formation of putative pit fields within the expanding cells of the pulvinus.

Non-NASA Center↗

NASA NTRS2020

Evaluation of Low Cost, User-Centered Alerting Devices for the Mitigation of Flight Crew Spatial Disorientation

The National Aeronautics and Space Administration (NASA) is conducting research into technologies which have the potential to reduce flight crew Spatial Disorientation (SD). While flight deck technology has advanced rapidly over the past fifty (50) years, the reported occurrences of flight crew SD have not decreased. The Cost-Effective Devices for Alerting Research (CEDAR) effort has focused on the identification and development of low cost, user-centered alerting solutions for the purpose of mitigating the occurrence of flight crew SD. This effort seeks to evaluate both existing technologies as well as new and emerging technologies which have a viable path to implementation in commercial aviation within the next five (5) years. This research is intended to develop a proof-of-concept for real-time SD mitigation which could eventually be utilized to improve safety in future air transport operations. NASA has partnered with the United States Naval Aeromedical Research Unit in Dayton, OH (NAMRU-D) to conduct flight crew SD research utilizing their Disorientation Research Device (DRD), dubbed “The Kraken”. This high-tech simulator features never-before-seen capabilities for side-by-side commercial aviation flight crew SD research, and is capable of re-creating the forces necessary to induce SD illusions in a safe and repeatable manner. Prototype SD mitigation solutions were incorporated into this simulator for scenario-based testing and evaluation using airline pilots within a contextually representative operational environment. SD mitigation technology prototypes designed to provide haptic feedback for both alerting and guidance, as well as innovative visual and aural alerting displays were evaluated. In December 2014, as a result of analyzing eighteen (18) loss-of-control events, the Commercial Aviation Safety Team (CAST) recommended research into flight deck technologies that have potential to mitigate the problems and contributing factors that lead to flight crew loss of airplane state awareness (ASA) and conditions likely to produce SD. The aviation community (government, industry and academia) have been charged with conducting research into cost-effective, user-centered flight deck alerting systems to alert flight crews; especially for the two conditions that produced SD (sub-threshold rolls and the somatogravic illusion). Somatogravic illusions are defined as illusions in which “there is a false perception of attitude on exposure to a force vector that differs in direction and/or magnitude from the normal gravitational force”. The sub-threshold roll illusion (aka the “leans” illusion) is a false sensation of roll attitude. A prolonged roll of less than two degrees becomes physiologically imperceptible to the pilot, and can lead to an incorrect perception of aircraft orientation. The sub-threshold roll illusion forms the entry point for the “graveyard spiral”, a maneuver in which the pilot’s corrective action (based on their false perception of aircraft orientation) causes the aircraft to spiral down into the ground. In both of these SD illusions, it is when the pilot attempts to correct the aircraft’s attitude (based on a false perception of its state) that problems arise, sometimes with lethal consequences.

Ronald J Daiker↗

NASA NTRSDate not supplied

Multiple Probe Measurements at Uranus Motivated By Spatial Variability

Motivation: Spatial variations in the temperature field and composition of Uranus' atmosphere demonstrate a need for multiple entry probes to characterize vertical profiles in multiple locations. We will review variation of composition and temperature, which are produced by dynamical processes on a range of scales from global (polar anomalies, zonal bands) to regional (vortices, storms) [1–2]. In particular, the spatial variation of convective activity is not well understood based on existing remote sensing observations [3]. Understanding how these processes operate, and how they modulate variable composition, is key to constraining bulk atmospheric abundances. Abundances in turn provide cosmochemical constraints on planetary origins. Secondary probes at Uranus: Key measurements for secondary probes are temperature-pressure profiles, along with compositional profiles. Radio occultations are limited to shallow levels less than ~2 bar [4]. In situ temperature-pressure measurements (or atmospheric structure measurements) can unambiguously extend these results to deeper levels. Measurements with vertical resolution of at least 2 km are needed to characterize anomalies like the 1.2-bar feature from the Voyager 2 occultation at 2–6° S [4], which supports a range of temperature gradients depending on assumptions of composition. Simultaneous measurements of temperature, pressure, and composition are key to understanding this class of features. Species such as methane, hydrogen sulfide, and ammonia must be measured along a probe descent profile because they vary over several orders of magnitude due to the strong temperature dependence of their saturation vapor pressures [e.g., 5]. Results of these measurements can be interpreted to understand the potential for moist convective activity in the atmosphere. Lessons from the other giant planets: On Jupiter, the Galileo Probe's entry into a meteorologically distinct five-micron hot spot led many to interpret the local composition as column-stretched, so that well-mixed abundances were reached at deeper levels than in surrounding, unperturbed regions [6–8]. Ground-based microwave measurements and Juno data now indicate that the deep depletion of ammonia is a very widespread atmospheric characteristic not limited to 5-µm hot spots [9–11]. But in the absence of multiple probes, we do not know if the other volatiles H2S and H2O behave in the same way. The open questions for the Jupiter case strongly motivate sending multiple probes to Uranus. On Saturn, retrievals of NH3 and PH3 abundances at shallow levels vary with latitude [12], but it is unknown how deep these differences extend, which is why a Saturn probe (or probes) was a mission theme for NASA's New Frontiers 4 and 5 opportunities [13]. Challenges for secondary probes: Cost is an issue due to the perception that it involves sacrifices to other mission elements. Spacecraft trajectories may be constrained by needs for orbit insertion that limit probe deliveries to different latitudes, and additional limitations may be placed on communication windows for probe descent phases (particularly if multiple probes are released from the orbiter simultaneously) [14]. Finally, composition sensors for miniature secondary probes are not at the required technological maturity [15]. Mass spectrometers are typically too large, massive, and powerhungry, while smaller nanosensors are only beginning to be developed for planetary missions. Finally, the need for probe survival heating is most easily met by radioisotope heat sources, but these require regulatory approvals that are even more difficult to satisfy compared to standard environmental reviews [16], unless the secondary probe is designed as a core element of a mission. References: [1] Molter E.M., et al. (2021) PSJ, 2, 3. [2] Rowe-Gurney N., et al. (2021) Icar, 365, 114506. [3] Hueso R., Sánchez-Lavega A. (2019) SSRv, 215, 52. [4] Lindal G.F., et al. (1987) JGR, 92, 14987– 15001. [5] Simon A.A., et al. (2022) RemS, 14, 1518. [6] Atreya, S.K., et al. (1997) in The Three Galileos: The Man, the Spacecraft, the Telescope, pp. 249–260 (C. Barbieri et al., eds.). [7] Showman A.P., Ingersoll A.P. (1998) Icar, 132, 205–220. [8] Friedson A.J. (2005) Icar, 177, 1–17. [9] de Pater I., et al. (2001) Icar, 149, 66–78. [10] Li C., et al. (2017) GeoRL, 44, 5317–5325. [11] de Pater I., et al. (2019) Icar, 322, 168–191. [12] Fletcher L.N., et al. (2009) Icar, 202, 543–564. [13] National Research Council (2011) Vision and Voyages. [14] Sayanagi K.M., et al. (2020) SSRv, 216, 72. [15] Wong M.H. et al. (2021) BAAS, 53, 486. [16] Zide A., Mendoza-Hill A., Cheney D. (2022) COSPAR Abstracts H0.6-0012-22.

Michael H Wong↗