Search NASA⌕ Search

SEARCH · Search NASA

Results for “scene understanding”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

132 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Assessing the Relationships Between Sensorimotor Biomarkers and Post-Landing Functional Task Performance

Spaceflight drives adaptive changes in healthy individuals appropriate for sensorimotor function in a microgravity environment. These changes are maladaptive for return to earth's gravity. The inter-individual variability of sensorimotor decrements is striking, although poorly understood. The goal of this study was to identify a set of behavioral, neuroimaging and genetic measures that can be used to predict early post-flight performance on a set of sensorimotor tasks. Astronauts were recruited who previously participated in sensorimotor field tests and/or posturography soon after long-duration spaceflight. Behavioral tests included assessments of sensory dependency and adaptability. Visual dependency involved treadmill walking while viewing a moving virtual visual scene. Vestibular perceptual thresholds were measured while seated during lateral translations. Proprioception dependency was measured during one-legged stance on a horizontal air-bearing surface. Ground assessment of adaptability was performed (1) during treadmill walking with a virtual linear hallway and a moving walking surface, and (2) during multiple trials of navigating an obstacle course while wearing reversing prisms (adaptive Functional Mobility Test, aFMT). The neuroimaging tests characterized individual differences in regional brain volumes (using Structural MRI) and white matter microstructure (using Diffusion Tensor Imaging) to serve as potential predictors of adaptive capacity. The genetic tests utilized saliva samples to examine variations in four genes chosen because of their ability to differentiate sensorimotor adaptation ability in a normative population, including Catechol-O-methyltransferase (COMT), Dopamine Receptor D2 (DRD2), Brain-derived neurotrophic factor (BDNF) and the α2-adrenergic receptor. Thirty ISS crewmembers were recruited, including 12 first-time fliers, 6F, and mission durations lasting 185.5 ± 45.5 days, mean ± std. We utilized a combination of three post-flight functional task outcomes: tandem walk, recovery from fall and dynamic posturography. There was considerable variability among all post-flight performance outcomes. Based on an ordinal scale survey, 72% indicated their ability to perform functional tasks were more impacted postflight relative to inflight with 50% indicating they needed to restrict movements for a longer period postflight relative to inflight. While there is a strong association within tests obtained at different R+0 timepoints, by R+24 hr performance on one post-flight test does not necessarily correlate with performance on other post-flight tests. Preliminary statistical analysis indicates combining biomarkers will increase predictive power and this will be explored with future analyses. Our preliminary findings underscore the importance of a comprehensive post-flight test battery including different types of tasks with varying sensory feedback. Understanding the relationships between these sensorimotor biomarkers and post-flight functional task performance improve both our understanding of the individual variability and our strategy to optimize sensorimotor countermeasures.

biomarkers↗
NASA NTRS2021

Confronting Future Models with Future Satellite Observations of Clouds and Aerosols

The NASA Aerosol, Clouds, Convection and Precipitation (ACCP) Study convened a workshop in November 2020 to understand the future of modeling aerosols, clouds, convection and precipitation, and how satellite data can contribute to that future. ACCP is a project to define a satellite mission to be launched late in the 2020’s to advance cloud and aerosol science, following the recommendations of the latest NASA Decadal Survey. The ACCP modeling workshop goal was to answer the following questions: 1. What will be the critical science questions for clouds and aerosols in 10 years? 2. Where will simulations of clouds and aerosols across scales of space (process models to global) and time (nowcasting to climate prediction) be in 10 years? 3. What data will be available from space? What data would provide the most benefit? 4. What are the state of the art methods for confronting models with cloud and aerosol observations, including assimilation and climatological analysis techniques? The virtual workshop was anchored by a series of pre-recorded talks. Two days of synchronous sessions focused on discussion of the talks, along with small group breakout exercises. After an introduction to the ACCP concept came a panel discussing the future of modeling clouds and aerosols across scales. Participants were then asked to contribute their ideas. On the second day, there were two panel discussions. First came a discussion of the future of satellite observing systems. Second was a discussion of model-data synthesis methods. Finally, participants were asked to develop their own model-data synthesis proposal. The meeting began with an overview of the ACCP mission concept by Graeme Stephens (NASA-JPL). ACCP is a satellite mission for clouds and aerosols, likely anchored by advanced active lidar and radar systems in space, designed to observe detailed aerosol profile and type information, as well as cloud microphysics and dynamics. ACCP will integrate across sensors and observational types to get multi-spectral views of the same scenes, with better resolution than is available today. Launch is scheduled for 2027 or 2029. ACCP is being thought of as a comprehensive mission that may comprise more than one platform and more than one orbit plane (i.e., inclined and polar), with multiple combinations of sensors.

Future Models↗
NASA NTRSDate not supplied

Using XR for Improving Scientific Discovery With Numerical Weather Models

Earth science (ES) digital twins will help us understand the complex interactions and interrelationships that make up our Earth system and the impacts of earth science phenomena on it. Our work addresses two underdeveloped areas in current ES digital twin work: improving the understanding and interaction with ES model outputs by using Virtual and Mixed Reality (XR) tools and improving the non-intuitive mapping of continuous ES natural phenomena to gridded reference frames in current numerical models. Traditionally, scientists working on ES view and analyze the results of calculated or measured observables with static 1-dimensional (1D), 2D or 3D plots displayed on flat computer screens or paper. Using such limited mediums, it can be very difficult to identify, track and understand the evolution of key features due to poor viewing angles and the nature of flat computer screens. In addition, numerical models, such as the NASA Goddard Earth Observing System (GEOS) ES model, are almost exclusively formulated, visualized and analyzed in an Eulerian reference frame with fixed grid points in space and time. However, ES phenomena such as convective clouds, hurricanes and wildfire smoke plumes are visualized and analyzed in a Lagrangian reference frame: therefore it is often difficult and unnatural to understand these phenomena in relation to each other, visualized either in an Eulerian or Lagrangian context. In 3D visualizations, data generally takes one of three forms: gridded (e.g., voxelized) data, where space is divided into regions; point clouds, where data is represented as a set of points; and meshes, where objects are rendered as surfaces composed of small polygons (usually triangles). A gridded, Eulerian reference frame has been the default representation for the 2D visual analysis of atmospheric data in part because the numerical methods used to generate atmospheric model data in the first place use a gridded approach, with equations defining the relationships between the physical variables in each of a grid's cells across successive timesteps. In our work, we are particularly interested in data from GEOS. Another reason why gridded representations tend to be used for visualizing data from such models is because trajectories are difficult to interpret from representations on 2D surfaces, due to line-of-sight ambiguity. Instead of a fixed grid from GEOS, we embed a trajectory model to simulate particles' movement throughout a GEOS run. We then ingest these particle trajectories as animated point clouds with a NASA open source XR toolkit, the Mixed Reality Exploration Toolkit (MRET), and merge GEOS data with ES phenomena data onto one combined visualization that the user can intuitively interact with. Efficient rendering of arbitrarily large point clouds is an ongoing challenge being addressed by the computer science community, with the GPU-based optimizations and efficient GPU memory utilization a common theme of recent advances, especially for XR, where sustained high frame rate is mandatory to save the user from suffering due to simulation sickness. In this work, we describe and evaluate our progress in choosing and implementing appropriate methods for rendering arbitrarily large point clouds within MRET for XR. While tracking the XR headset enables the immersion of a user within a 3D scene of a data visualization, tracking of XR handheld controllers or user’s hands enables us to implement intuitive user interactions with the visualized datasets. Conventional tools require a user working with an ES visualization to conduct many interactions to commit their intended selections or manipulations with a visualized dataset; for example to specify a set of points in 3D space. Doing so in a 2D flat screen interface has traditionally required specifying a set of points in three distinct 2D coordinate systems (XY, XZ, and YZ), which is cumbersome. In other scientific domains, it has been shown that specifying or selecting a location or volume in XR using handheld controllers or tracked hands allows for greater speed and accuracy. We anticipate the same will hold true for atmospheric data, and we will share initial results of measuring the utility of such an interface. Notably, as the data being visualized is generated by GEOS as a prediction based on initial conditions, an intended application of our tool is to serve as part of an iterative feedback loop. Through XR, a scientist will review and manipulate a GEOS model run, modifying the conditions as needed to do subsequent runs of GEOS. Thereby, XR-based improvements to speed and accuracy of 3D tagging of points minimizes the effort required by both the scientist and the computer cluster conducting the necessary calculations.

Thomas Grubb↗
NASA NTRS2015

Next-Generation Angular Distribution Models for Top-of-Atmosphere Radiative Flux Calculation from CERES Instruments: Validation

Radiative fluxes at the top of the atmosphere (TOA) from the Clouds and the Earth's Radiant Energy System (CERES) instrument are fundamental variables for understanding the Earth's energy balance and how it changes with time. TOA radiative fluxes are derived from the CERES radiance measurements using empirical angular distribution models (ADMs). This paper evaluates the accuracy of CERES TOA fluxes using direct integration and flux consistency tests. Direct integration tests show that the overall bias in regional monthly mean TOA shortwave (SW) flux is less than 0.2Wm(exp -2) and the RMSE is less than 1.1Wm(exp -2). The bias and RMSE are very similar between Terra and Aqua. The bias in regional monthly mean TOA LW fluxes is less than 0.5Wm(exp -2) and the RMSE is less than 0.8Wm(exp -)2 for both Terra and Aqua. The accuracy of the TOA instantaneous flux is assessed by performing tests using fluxes inverted from nadir- and oblique-viewing angles using CERES along-track observations and temporally and spatially matched MODIS observations, and using fluxes inverted from multi-angle MISR observations. The averaged TOA instantaneous SW flux uncertainties from these two tests are about 2.3% (1.9Wm(exp -2) over clear ocean, 1.6% (4.5Wm(exp -2) over clear land, and 2.0% (6.0Wm(exp -) over clear snow/ice; and are about 3.3% (9.0Wm(exp -2), 2.7% (8.4Wm(exp -2), and 3.7% (9.9Wm(exp -2) over ocean, land, and snow/ice under all-sky conditions. The TOA SW flux uncertainties are generally larger for thin broken clouds than for moderate and thick overcast clouds. The TOA instantaneous daytime LW flux uncertainties derived from the CERESMODIS test are 0.5% (1.5Wm(exp -2), 0.8% (2.4Wm(exp -2), and 0.7% (1.3Wm(exp -2) over clear ocean, land, and snow/ice; and are about 1.5% (3.5Wm(exp -2), 1.0% (2.9Wm(exp -2), and 1.1% (2.1Wm(exp -2) over ocean, land, and snow/ice under all-sky conditions. The TOA instantaneous nighttime LW flux uncertainties are about 0.5-1% (<2.0Wm(exp -2) for all surface types. Flux uncertainties caused by errors in scene identification are also assessed by using the collocated CALIPSO, CloudSat, CERES and MODIS data product. Errors in scene identification tend to underestimate TOA SW flux by about 0.6Wm(exp -2) and overestimate TOA daytime (nighttime) LW flux by 0.4 (0.2)Wm(exp -2) when all CERES viewing angles are considered.

Su, W.↗
NASA NTRSDate not supplied

Assessing the Relationships Between Sensorimotor Biomarkers and Post-Landing Functional Task Performance

Spaceflight drives adaptive changes in healthy individuals appropriate for sensorimotor function in a microgravity environment. These changes are maladaptive for return to earth's gravity. The inter-individual variability of sensorimotor decrements is striking, although poorly understood. The goal of this study is to identify a set of behavioral, neuroimaging and genetic measures that can be used to predict early post-flight performance on a set of sensorimotor tasks. Astronauts are recruited who previously participated in sensorimotor field tests and/or posturography soon after long-duration spaceflight. Behavioral tests include assessments of sensory dependency and adaptability. Visual dependency involves treadmill walking while viewing a moving virtual visual scene. Vestibular thresholds are measured while seated during lateral translations. Proprioception dependency is measured during one-legged stance on a horizontal air-bearing surface. Ground assessment of adaptability is performed (1) during treadmill walking with a virtual linear hallway and a moving walking surface, and (2) during multiple trials of navigating an obstacle course while wearing reversing prisms. The neuroimaging tests will characterize individual differences in regional brain volumes (using Structural MRI) and white matter microstructure (using Diffusion Tensor Imaging) to serve as potential predictors of adaptive capacity. The genetic tests will utilize saliva samples to examine variations in four genes chosen because of their ability to differentiate sensorimotor adaptation ability in a normative population, including Catechol-O-methyltransferase (COMT), Dopamine Receptor D2 (DRD2), Brain-derived neurotrophic factor (BDNF) and the α2-adrenergic receptor. Twenty-one ISS crewmembers have been tested to date, including 6 from this past year after testing resumed post-COVID. This cohort includes 9 first-time fliers, 4F, and mission durations lasting 182 ± 32 days, mean ± std. We are utilizing a combination of three post-flight functional task outcomes: tandem walk, recovery from fall and dynamic posturography. There is considerable variability among the post-flight performance outcomes for the 21 participants to date. Based on a partial sample using an ordinal scale survey, 80% indicated their ability to perform functional tasks were more impacted postflight relative to inflight with 50% indicating they needed to restrict movements for a longer period postflight relative to inflight. While there is a strong association within tests obtained at different R+0 timepoints, by R+24 hr performance on one post-flight test does not necessarily correlate with performance on other post-flight tests. There are apparent relationships between individual measures and specific post-flight outcome measures; however, additional data is needed to draw conclusions. Preliminary statistical analysis indicates combining biomarkers will increase predictive power and this will be explored with future analyses. Our preliminary findings underscore the importance of a comprehensive post-flight test battery including different types of tasks with varying sensory feedback. We expect that understanding the relationships between these sensorimotor biomarkers and post-flight functional task performance will improve both our understanding of the individual variability and our strategy to optimize sensorimotor countermeasures.

S J Wood↗
NASA NTRS2024

Assessing the Relationships Between Sensorimotor Biomarkers and Post-Landing Functional Task Performance

Spaceflight drives adaptive changes in healthy individuals appropriate for sensorimotor function in a microgravity environment. These changes are maladaptive for return to earth's gravity. The inter-individual variability of sensorimotor decrements is striking, although poorly understood. The goal of this study is to identify a set of behavioral, neuroimaging and genetic measures that can be used to predict early post-flight performance on a set of sensorimotor tasks. Astronauts are recruited who previously participated in sensorimotor field tests and/or posturography soon after long-duration spaceflight. Behavioral tests include assessments of sensory dependency and adaptability. Visual dependency involves treadmill walking while viewing a moving virtual visual scene. Vestibular perceptual thresholds are measured while seated during lateral translations. Proprioception dependency is measured during one-legged stance on a horizontal air-bearing surface. Ground assessment of adaptability is performed(1) during treadmill walking with a virtual linear hallway and a moving walking surface, and (2) during multiple trials of navigating an obstacle course while wearing reversing prisms(adaptive Functional Mobility Test, aFMT). The neuroimaging tests will characterize individual differences in regional brain volumes (using Structural MRI) and white matter microstructure(using Diffusion Tensor Imaging) to serve as potential predictors of adaptive capacity. The genetic tests will utilize saliva samples to examine variations in four genes chosen because of their ability to differentiate sensorimotor adaptation ability in a normative population, including Catechol-O-methyltransferase (COMT), Dopamine Receptor D2 (DRD2), Brain-derived neurotrophic factor (BDNF) and the α2-adrenergic receptor. Twenty-seven ISS crewmembers have been tested to date, including 6 from this past year. This cohort includes 10first-time fliers, 6F, and mission durations lasting 178.6 ± 30.5 days, mean ± std. We are utilizing a combination of three post-flight functional task outcomes: tandem walk, recovery from fall and dynamic posturography. There is considerable variability among the post-flight performance outcomes for the 27participants to date. Based on a partial sample using an ordinal scale survey, 70% indicated their ability to perform functional tasks were more impacted postflight relative to inflight with 50% indicating they needed to restrict movements for a longer period postflight relative to inflight. While there is a strong association within tests obtained at different R+0 timepoints, by R+24 hr performance on one post-flight test does not necessarily correlate with performance on other post-flight tests. There are apparent relationships between individual measures and specific post-flight outcome measures, e.g., the cumulative time to complete the aFMT is significantly correlated to pre-to-post-flight changes in tandem walk (rho= 0.64, p = 0.001). Preliminary statistical analysis indicates combining biomarkers will increase predictive power and this will be explored with future analyses. Our preliminary findings underscore the importance of a comprehensive post-flight test battery including different types of tasks with varying sensory feedback. We expect that understanding the relationships between these sensorimotor biomarkers and post-flight functional task performance will improve both our understanding of the individual variability and our strategy to optimize sensorimotor countermeasures

S J Wood↗