Search NASA⌕ Search

SEARCH · Search NASA

Results for “rendering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

The Namibia Early Flood Warning System, A CEOS Pilot Project

Over the past year few years, an international collaboration has developed a pilot project under the auspices of Committee on Earth Observation Satellite (CEOS) Disasters team. The overall team consists of civilian satellite agencies. For this pilot effort, the development team consists of NASA, Canadian Space Agency, Univ. of Maryland, Univ. of Colorado, Univ. of Oklahoma, Ukraine Space Research Institute and Joint Research Center(JRC) for European Commission. This development team collaborates with regional , national and international agencies to deliver end-to-end disaster coverage. In particular, the team in collaborating on this effort with the Namibia Department of Hydrology to begin in Namibia . However, the ultimate goal is to expand the functionality to provide early warning over the South Africa region. The initial collaboration was initiated by United Nations Office of Outer Space Affairs and CEOS Working Group for Information Systems and Services (WGISS). The initial driver was to demonstrate international interoperability using various space agency sensors and models along with regional in-situ ground sensors. In 2010, the team created a preliminary semi-manual system to demonstrate moving and combining key data streams and delivering the data to the Namibia Department of Hydrology during their flood season which typically is January through April. In this pilot, a variety of moderate resolution and high resolution satellite flood imagery was rapidly delivered and used in conjunction with flood predictive models in Namibia. This was collected in conjunction with ground measurements and was used to examine how to create a customized flood early warning system. During the first year, the team made use of SensorWeb technology to gather various sensor data which was used to monitor flood waves traveling down basins originating in Angola, but eventually flooding villages in Namibia. The team made use of standardized interfaces such as those articulated under the Open Cloud Consortium (OGC) Sensor Web Enablement (SWE) set of web services was good [1][2]. However, it was discovered that in order to make a system like this functional, there were many performance issues. Data sets were large and located in a variety of location behind firewalls and had to be accessed across open networks, so security was an issue. Furthermore, the network access acted as bottleneck to transfer map products to where they are needed. Finally, during disasters, many users and computer processes act in parallel and thus it was very easy to overload the single string of computers stitched together in a virtual system that was initially developed. To address some of these performance issues, the team partnered with the Open Cloud Consortium (OCC) who supplied a Computation Cloud located at the University of Illinois at Chicago and some manpower to administer this Cloud. The Flood SensorWeb [3] system was interfaced to the Cloud to provide a high performance user interface and product development engine. Figure 1 shows the functional diagram of the Flood SensorWeb. Figure 2 shows some of the functionality of the Computation Cloud that was integrated. A significant portion of the original system was ported to the Cloud and during the past year, technical issues were resolved which included web access to the Cloud, security over the open Internet, beginning experiments on how to handle surge capacity by using the virtual machines in the cloud in parallel, using tiling techniques to render large data sets as layers on map, interfaces to allow user to customize the data processing/product chain and other performance enhancing techniques. The conclusion reached from the effort and this presentation is that defining the interoperability standards in a small fraction of the work. For example, once open web service standards were defined, many users could not make use of the standards due to security restrictions. Furthermore, once an interoperable sysm is functional, then a surge of users can render a system unusable, especially in the disaster domain.

Mandl, Daniel↗
NASA NTRS2013

Robotics On-Board Trainer (ROBoT)

ROBoT is an on-orbit version of the ground-based Dynamics Skills Trainer (DST) that astronauts use for training on a frequent basis. This software consists of two primary software groups. The first series of components is responsible for displaying the graphical scenes. The remaining components are responsible for simulating the Mobile Servicing System (MSS), the Japanese Experiment Module Remote Manipulator System (JEMRMS), and the H-II Transfer Vehicle (HTV) Free Flyer Robotics Operations. The MSS simulation software includes: Robotic Workstation (RWS) simulation, a simulation of the Space Station Remote Manipulator System (SSRMS), a simulation of the ISS Command and Control System (CCS), and a portion of the Portable Computer System (PCS) software necessary for MSS operations. These components all run under the CentOS4.5 Linux operating system. The JEMRMS simulation software includes real-time, HIL, dynamics, manipulator multi-body dynamics, and a moving object contact model with Tricks discrete time scheduling. The JEMRMS DST will be used as a functional proficiency and skills trainer for flight crews. The HTV Free Flyer Robotics Operations simulation software adds a functional simulation of HTV vehicle controllers, sensors, and data to the MSS simulation software. These components are intended to support HTV ISS visiting vehicle analysis and training. The scene generation software will use DOUG (Dynamic On-orbit Ubiquitous Graphics) to render the graphical scenes. DOUG runs on a laptop running the CentOS4.5 Linux operating system. DOUG is an Open GL-based 3D computer graphics rendering package. It uses pre-built three-dimensional models of on-orbit ISS and space shuttle systems elements, and provides realtime views of various station and shuttle configurations.

Johnson, Genevieve↗
NASA NTRS2018

NASA's Centennial Challenge for 3D-Printed Habitat: Phase II Outcomes and Phase III Competition Overview

The 3D-Printed Habitat Challenge is part of NASA's Centennial Challenges Program. NASA's Centennial Challenges seek to accelerate innovation in aerospace technology development through public competitions. The 3D-Printed Habitat Challenge, launched in 2015, is part of the Centennial Challenges portfolio and focuses on habitat design and development of large-scale additive construction systems capable of fabricating structures from in situ materials and/or mission recyclables. The challenge is a partnership between NASA, Caterpillar (primary sponsor), Bechtel, Brick and Mortar Ventures, and Bradley University. Phase I of the challenge was an architectural concept competition in which participants generated conceptual renderings of habitats on Mars which could be constructed using locally available resources. Phase II asked teams to develop the printing systems and material formulations needed to translate these designs into reality. Work under the phase II competition, which concluded in August 2017 with a head to head competition at Caterpillar's Edward Demonstration Facility in Peoria, Illinois, is discussed, including the key technology development outcomes resulting from this portion of the competition. The phase III competition consists of both virtual and construction subcompetitions. Virtual construction asks teams to render high fidelity architectural models of a habitat and all the accompanying information required for construction of the pressure retaining and load bearing portions of the structure. In construction phase III, teams are asked to scale up their printing systems to produce a 1/3 scale habitat on-site at Caterpillar. The levels of the phase III construction competition (which include printing of a foundation and printing and hydrostatic testing of a habitat element) are discussed. Phase III construction also has an increased focus on autonomy, as these systems are envisioned for robotic precursor missions which would buildup infrastructure prior to the arrival of crew. Results of the phase III competition through July 2017 (which includes virtual construction level 1) are discussed. This Centennial Challenge enables an assessment of the scaleability and efficacy of various processes, material systems, and designs for planetary construction. There are also near-term terrestrial applications, from disaster response to affordable housing and infrastructure refurbishment, for these technologies.

Prater, T. J.↗
NASA NTRS2017

Zoledronate Prevents Simulated Weightlessness-Induced Bone Loss in the Cancellous Compartment While Blunting the Efficacy of a Mechanical Loading Countermeasure

Astronauts using high-force resistance training while weightless show a high-turnover remodeling state within the skeletal system, with resorption and formation biomarkers being elevated. One countermeasure for the skeletal health of astronauts includes an antiresorptive of the bisphosphonate (BP) drug class. We asked, does the combination of an anti-resorptive and high-force exercise during weightlessness have negative effects on bone remodeling and strength? In this study, we developed an integrated model to mimic the mechanical strain of exercise via cyclical loading (CL) in mice treated with the BP Zoledronate (ZOL) combined with hind limb unloading (HU) to simulate weightlessness. We hypothesized that ZOL prevents structural degradation from simulated weightlessness and that CL and ZOL interact to render CL less effective. Thirty-two C57BL/6 mice (male, 16 weeks old, n=8/group) were exposed to 3 weeks of either HU or normal ambulation (NA). Cohorts of mice received one subcutaneous injection of ZOL (45μg/kg), or saline vehicle (VEH), prior to the start of HU. The right tibia was axially compressed in vivo 60x/day to 9N (+1200μstrain on the periosteal surface) and repeated 3x/week during HU. Left tibiae served as a within subject, non-compressed control. Ex vivo μCT was performed on all subjects to determine cancellous and cortical architectural parameters. Static and dynamic histomorphometry were carried out for the left and right tibiae to determine osteoclast- and osteoblast relevant surfaces. Further, micro damage was assessed in select groups by basic-fuchsin staining to test whether CL had an effect. For all assays, a multivariate (2x2x2) ANCOVA model was used to account for body weight changes. Additionally, for the tibiae, we incorporated a random effect for the subject (hence, a mixed model) to account for observations of both left and right tibiae within each subject. P < 0.05 was considered significant. In the cancellous compartment of the proximal tibial metaphysis, we observed a main effect from each independent variable, as determined by structural and histomorphometric assays. Specifically, as expected, ZOL showed an increase in the cancellous bone volume to total volume fraction (BV/TV, +32%) and trabecular number (+18%) compared to the VEH. As expected, ZOL decreased osteoclast surface (OC/BS) by -45% compared to VEH. Surprisingly, ZOL reduced mineralizing surface (MS/BS) and bone formation rate (BFR), indicators of osteoblast activity, by -40% and -54%, respectively, compared to VEH. Altogether, ZOL-treated mice displayed a low turnover state of remodeling in the metaphysis. In the context of skeletal aging, we speculate that ZOL prevented age-related cancellous strut loss during the experiment. As a main effect, as expected, HU decreased BV/TV by - 31% via reductions in both trabecular thickness (-11%) and number (-22%) compared to NA controls. Additionally, HU decreased MS/BS by -38% and bone formation rate (BFR) by -50% compared to NA controls. Altogether, these data are consistent with structural degradation resulting from imbalanced remodeling that favors resorption. As a main effect, CL increased BV/TV by +15% via increased trabecular thickness (+12%) compared to the noncompressed limb. As expected, CL increased MS/BS (+20%) and BFR (+24%), indicating osteoblast mineralization contributed to bone gains. These data show that CL provided an anabolic stimulus to the cancellous tissue. We observed unique interactions in ZOL*CL and HU*CL. First, ZOL prevented CL-induced increases in BV/TV and trabecular number, as compared to VEH. In the context of skeletal aging, these data suggest no added benefit from CL in the ZOL-treated mice. Interestingly, no microdamage was observed in mice that were unloaded and treated with ZOL (independent of CL). Secondly, HU prevented CL-induced increases in BFR, as compared to NA controls. These data suggest that either exercise is less effective or the kinetics of formation are slower during simulated weightlessness. Osteoclast surface was unchanged by either treatment. Thus, in contrast to exercising astronauts, these data do not suggest a high-turnover state in the metaphysis. To assess mechanical properties as a function of HU or ZOL, we tested the left femur in three-point bending ex vivo. As expected, HU decreased stiffness (-30%) compared to NA, and ZOL increased stiffness compared to VEH (+28%). Interestingly, HU increased the post-yield displacement, related to collagenous tensile loading, compared to NA (+20%). ZOL increased yield force (+11%) and ultimate force (+17%), which seems to explain the significant effect of ZOL increasing total energy (work-to-fracture, +15%), while not affecting the post yield displacement. Taken together, ZOL did not have detrimental affect on mechanical properties. Our integrated model simulates the combination of weightlessness, exercise-induced mechanical strain, and anti-resorptive treatment that astronauts experience during space missions. We conclude that Zoledronate was an effective countermeasure against weightlessness-induced bone loss, though zoledronate, as well as weightlessness, rendered exercise-related mechanical loading less effective.

bone↗
NASA NTRS2017

Interactive Visualization of High-Dimensional Petascale Ocean Data

We describe an application for interactive visualization of 5 petabytes of time-varying multivariate data from a high-resolution global ocean circulation model. The input data are 10311 hourly (ocean time) time steps of various 2D and 3D fields from a 22-billion point 1/48- degree “lat-lon cap” configuration of the MIT General Circulation Model (MITgcm). We map the global horizontal model domain onto our 128-screen (8x16) tiled display wall to produce a canonical tiling with approximately one MITgcm grid point per display pixel, and using this tiling we encode the entire time series for multiple native and computed scalar quantities at a collection of ocean depths. We reduce disk bandwidth requirements by converting the model’s floating point data to 16-bit fixed point values, and compressing those values with a lossless video encoder, which together allow synchronized playback at 24 time steps per second across all 128 displays. The application allows dynamic assignment of any two encoded tiles to any display, and has multiple interfaces for quickly specifying various orderly arrangements of tiles. All subsequent rendering is done on the fly, with run time control of colormaps, transfer functions, histogram equalization, and labeling. The two data streams on each screen can be rendered independently and combined in various ways, including blending, differencing, horizontal/ vertical wipes, and checkerboarding. The two data streams on any screen can optionally be displayed as a scatterplot in their joint attribute space. All scatterplots and map-view plots from the same x/y location and depth are linked so they all show the current brushable selection. Ocean scientists have used the system, and have found previously unidentified features in the data.

Interactive↗
NASA NTRS2019

High-Fidelity Multiple-Flyby Trajectory Optimization Using Multiple-Shooting

Rendering a complex spacecraft trajectory in high fidelity can be an expensive endeavor, both computationally and from a human time/cost standpoint. However, in many cases, a low-fidelity trajectory that reasonably approximates a high-fidelity counterpart is much easier to obtain. Thus, it is important to have an efficient process for converting a trajectory from lower-fidelity model to high fidelity. We present a method for converting low-fidelity trajectories into high fidelity that relies on multiple shooting, nonlinear programming, and numerical integration. The procedure converts any zero-radius sphere-of-influence gravity-assist events to fully integrated flyby events. Several numerical examples are presented that showcase the flexibility of the high-fidelity rendering process across multiple mission types and flight regimes.

high-fidelity↗
NASA NTRSDate not supplied

Visualizing UPSP Data with Python

The Unsteady Pressure-Sensitive Paint (uPSP) projects uses Pressure-Sensitive paint applied over aerospace models during wind tunnel testing to collect pressure data with high spatial and temporal resolution in order to inform unsteady aerodynamics studies. For each of the 800+ experimental runs, four cameras generate up to 50 GB of video data, which must then be processed, analyzed, and visualized on the NASA Advanced Supercomputing system (NAS) to assess the result. One of the final data analysis products is the dynamic modal decomposition (DMD) results, which decomposes the pressure reading signals by their frequency component. The goal of this project is to visualize the DMD results over a 3D rendering of the model, using efficient and parallelized python routines. The software uses the pytecplot library, a high-level API that connects python scripting to a Tecplot 360 engine. Tecplot is an industry standard high-performance visualization tool that can handle large datasets and workflow. Various animation, rendering, and image-combination techniques were investigated to generate the final videos using OpenCV on the NAS. The final result is a software tool that takes in data products from the uPSP processing chain and generates high resolution visualization videos in parallel for every data file, allowing researchers to view their results efficiently and at an unprecedentedly detailed level.

Emma Dolores McMillian↗
NASA NTRSDate not supplied

DLES Unreal Simulation Tool (DUST)

NASA’s future Artemis missions to the Moon seek to explore areas around the Lunar South Pole. Though humans have previously set foot on the lunar surface, the proposed region provides unique and challenging environments that require insight and investigation prior to arrival. Several teams throughout the agency are performing this site and mission planning, design, and analysis to support areas like the Human Landing System (HLS), surface mobility, habitation elements, and scientific exploration. The NASA Exploration Systems Simulation (NExSyS) team at Johnson Space Center is developing a graphical environment of the Lunar South Pole region. Lunar terrain information collected from the Lunar Reconnaissance Orbiter (LRO) is compiled and made available through Johnson Space Center’s Digital Lunar Exploration Sites (DLES) data sets. The DLES data is used to build this graphic environment. The process of ingesting and accurately modeling this information in a meaningful way for analysis creates its own challenges such as generating a performant model from the source data and the application of curvature. Additionally, the area around the Lunar South Pole experiences different lighting conditions than those observed from the Apollo missions. The need to use the lunar environmental data products provided by DLES combined with the capability to calculate date specific ephemerides in real-time has given rise to the development of the DLES Unreal Simulation Tool (DUST). DUST incorporates augmented terrain from the DLES product into a desktop application that allows exploration of the Lunar South Pole region and its complex lighting conditions. DUST leverages advanced capabilities in the recently released Unreal Engine 5 renderer by Epic Games such as double precision for positioning of planetary bodies and surface elements, multiple infinite light sources to represent the Sun and eventually Earthshine, high resolution shadow maps for dynamic shadow accuracy, real-time software ray-tracing for multi-surface bounce lighting to render sunlight reflected off surface elements and terrain features, and performance optimized level of detail shifting as the eyepoint changes in a scene. This paper details the DUST application, the technologies of the engine platform that enable scientific and engineering analysis, the unique techniques and processes developed to consume the DLES data sets, and how the tool is being used to support the Artemis program.

Lunar Visualization↗
NASA NTRS2023

What’s That Supposed to Mean? Capturing Micro-Behaviors in Teams

Future long-duration space exploration (LDSE) crews will require extensive coordination, cooperation, and team functioning as they face a myriad of challenges rooted in both taskwork and teamwork (Bell et al., 2015; Landon et al., 2018). While exposed to extreme conditions, crew members must navigate living and working together in prolonged confinement. Moreover, astronaut teams are becoming increasingly diverse, introducing significant variability in team composition. This increasing diversity, alongside traditional constraints of LDSE, introduces additional challenges into effective team functioning. To date, most methods for capturing team functioning rely on self-report measures. Such measures are prone to several limitations, including but not limited to social desirability bias, halo effect, and leniency effects (Trull & Ebner-Priemer, 2013), which skew data and limit nuanced understandings of phenomena at play. Self-report measures broadly capture team functioning, lending the nature of such methods to identifying underlying “macro”-behaviors (i.e., behaviors that are long-standing and last over time). However, team functioning is far more complex than a series of macro-behaviors, rendering reliance on self-report data deficient for accurate measurement. Recent research demonstrates the potential of alternative methods for capturing team functioning, such as speech and physiological data (Chaffin et al., 2017; Murray & Oertel, 2018). Consequently, these methods are more suitable for capturing micro-behaviors: brief, often unconscious expressions that affect the extent to which an individual feels included by others around them (Paletz et al., 2013). Micro-behaviors can be further classified into microaggressions (i.e., subtle, negative exchanges; Keller & Galgay, 2010) or micro-affirmations (i.e., subtle, positive exchanges; Kyte et al. 2020), both of which influence team functioning. Due to the subtle nature of micro-behaviors, contextual factors have a significant impact when determining if it is aggressive or affirmative. Additionally, several iterations of microbehaviors can have lingering effects on team interactions. For example, the use of “mm-hmm” by a crew member can function as both a micro-affirmation and micro-aggression. Specifically, it can be indication of active listening (i.e., micro-affirmation) or as an expression of annoyance (i.e., aggression) depending on the context in which it occurs. Auditory features (e.g., tone, frequency) can help delineate between the two forms; however, the contextual factors (e.g., previous interactions between team members, crew demographics) add a layer of complexity that render auditory features alone as insufficient to capture micro-behaviors. Consequently, this paper seeks to provide a novel approach in which multi-modal data (i.e., auditory features and contextual features) are used in a random-forest model to better identify distinguishing characteristics between micro-affirmations and micro-aggressions. In turn, detected micro-behaviors are used to predict team performance, thereby demonstrating the value of capturing micro-behaviors as supplemental data to macro-behaviors.

Sydney R. Begerowski↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

distributed sensing↗
NASA NTRSDate not supplied

A Simulation Architecture for Air Traffic Over Urban Environments Supporting Autonomy Research in Advanced Air Mobility

As part of its research, NASA investigates concepts, aircraft, and operations related to Advanced Air Mobility (AAM). One of the most challenging scenarios for AAM will be enabling safe routine access near densely populated urban centers. AAM flight operations over a regional area require a moderately high-fidelity simulation capability to develop and evaluate autonomy technologies in the urban environment. This paper aims to describe a system to simulate flight operations around regions such as the San Francisco-Oakland Bay area at a moderately-high scale (tens to hundreds of flights) that incorporates detailed vehicle models and control necessary to support research in airborne autonomy. The flight vehicle utilizes NASA AAM concept vehicle dynamics integrated with a custom flight management system and flight control system to simulate all flight phases accurately. The simulation incorporates a detailed simulated urban environment and includes glass cockpit displays to monitor aircraft operations. Simulation models integrate to simulate air and ground-based sensors, such as Radar and LiDAR. As a commercially available rendering engine, X-Plane 11 is used as the renderer to simulate vision-based sensors (such as onboard and ground-based cameras) with a detailed graphical model of a city at different times of the day and weather conditions. This paper presents the simulation and software architecture used for simulating AAM traffic over this urban region. This system enables the evaluation of NASA research concepts in autonomy for urban AAM operations on the path toward flight test evaluation.

Distributed sensing↗
NASA NTRS2023

Approaches for Validation of Lighting Environments in Realtime Lunar South Pole Simulations

NASA’s Artemis campaign is making heavy use of simulation to help return humans to the lunar surface by the end of the decade. There are several aspects of the lunar surface and its environment which must be accurately modeled before these simulations can be relied upon to influence decisions being made under these programs. Digital Lunar Exploration Sites, a paper submitted to the 2022 IEEE Aerospace Conference, outlined the process used to generate the lunar surface in a digital environment. This paper will expand upon this topic and delve into the steps being taken by the NASA Exploration Systems Simulations (NExSyS) team at NASA’s Johnson Space Center (JSC) to properly verify and validate these simulations, with a focus on the visual aspects of the environment. Natural lighting validation relies in part on the wealth of data generated during the Apollo program. Many images taken by Apollo astronauts on the lunar surface have been replicated in the simulated environments to gain confidence in the accuracy of terrain and lighting models. However, because the environment the Artemis astronauts will experience at the Lunar South Pole (LSP) is dissimilar from the near-equatorial Apollo sites, other validation techniques must be applied. At the LSP, the sun crests only about 1.5 degrees above the horizon and when combined with the lack of a lunar atmosphere, lighting in this region is often very different than what a human would experience on Earth. Solar illumination, earthshine, human eye response, solar blooming, lunar regolith optical properties, and shadows cast by rocks and crater walls will play a significant role in an astronaut’s ability to safely conduct an Extra-Vehicular Activity (EVA) or perform a traverse with a lunar rover. Approaches for validation of these aspects of the rendered LSP environment are considered in this paper. In addition to natural lighting, approaches for the validation of artificial lighting models at the LSP are discussed. The JSC Lighting Lab has been studying the illumination profile of the Exploration Informatics Subsystem (xINFO) lighting on the Exploration EVA Mobility Unit (xEMU). How these lights interact with the solar illumination and the shadows being cast on the lunar surface is of particular interest, so the validity of models representing these lights in a human-in-the-loop virtual reality environment becomes very important. This paper also touches on some of the simulation performance considerations when a Human in the Loop (HITL) is present, which drives the need for realtime rendering of the environment. Natural and artificial lighting will play a crucial role to decisions being made when planning and executing missions at the Lunar South Pole (LSP) and it is vitally important to understand the LSP environment before we return.

Lunar↗
NASA NTRS2022

IRIS: High-fidelity Perception Sensor Modeling for Closed-Loop Planetary Simulations

Perception plays a key role in autonomous and semi-autonomous planetary exploration vehicles. For instance, landers can use computer vision techniques for identifying safe landing locations, aerial vehicles use cameras as navigation sensors, and planetary rovers use them for localization and hazard detection. Engineering simulations of such systems requires the accurate modeling of perception and vision sensors for simulating autonomy scenarios. In addition, the modeling of sensors for landers, aerial and ground vehicles requires the ability to handle large and high-resolution terrains, the accurate modeling of illumination, hi-fidelity rendering via ray/path tracing and the inclusion of sensor characteristics. Vision sensor models strive to simulate sensor reality by using physics principles to model the interaction of light and objects. Furthermore, high frame rate performance is highly desirable for in-the-loop simulations involving vehicle dynamics and control software. In this paper we describe a new sensor modeling capability called Inter-planetary Rendering for Imaging and Sensors (IRIS) that meets these requirements for the real-time and high-fidelity simulation of vision sensors for planetary aerospace and robotics applications.

Elmquist, Asher↗
NASA NTRS2023

What’s That Supposed to Mean? Capturing Micro-Behaviors in Teams

Future long-duration space exploration (LDSE) crews will require extensive coordination, cooperation, and team functioning as they face a myriad of challenges rooted in both taskwork and teamwork (Bell et al., 2015; Landon et al., 2018). While exposed to extreme conditions, crew members must navigate living and working together in prolonged confinement. Moreover, astronaut teams are becoming increasingly diverse, introducing significant variability in team composition. This increasing diversity, alongside traditional constraints of LDSE, introduces additional challenges into effective team functioning. To date, most methods for capturing team functioning rely on self-report measures. Such measures are prone to several limitations, including but not limited to social desirability bias, halo effect, and leniency effects (Trull & Ebner-Priemer, 2013), which skew data and limit nuanced understandings of phenomena at play. Self-report measures broadly capture team functioning, lending the nature of such methods to identifying underlying “macro”-behaviors (i.e., behaviors that are long-standing and last over time). However, team functioning is far more complex than a series of macro-behaviors, rendering reliance on self-report data deficient for accurate measurement. Recent research demonstrates the potential of alternative methods for capturing team functioning, such as speech and physiological data (Chaffin et al., 2017; Murray & Oertel, 2018). Consequently, these methods are more suitable for capturing micro-behaviors: brief, often unconscious expressions that affect the extent to which an individual feels included by others around them (Paletz et al., 2013). Micro-behaviors can be further classified into micro-aggressions (i.e., subtle, negative exchanges; Keller & Galgay, 2010) or micro-affirmations (i.e., subtle, positive exchanges; Kyte et al. 2020), both of which influence team functioning. Due to the subtle nature of micro-behaviors, contextual factors have a significant impact when determining if it is aggressive or affirmative. Additionally, several iterations of micro-behaviors can have lingering effects on team interactions. For example, the use of “mm-hmm” by a crew member can function as both a micro-affirmation and micro-aggression. Specifically, it can be indication of active listening (i.e., micro-affirmation) or as an expression of annoyance (i.e., aggression) depending on the context in which it occurs. Auditory features (e.g., tone, frequency) can help delineate between the two forms; however, the contextual factors (e.g., previous interactions between team members, crew demographics) add a layer of complexity that render auditory features alone as insufficient to capture micro-behaviors. Consequently, this paper seeks to provide a novel approach in which multi-modal data (i.e., auditory features and contextual features) are used in a random-forest model to better identify distinguishing characteristics between micro-affirmations and micro-aggressions. In turn, detected micro-behaviors are used to predict team performance, thereby demonstrating the value of capturing micro-behaviors as supplemental data to macro-behaviors.

Sydney Begerowski↗
NASA NTRSDate not supplied

Global 3D Data Visualization and Analysis Platform With Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks [1]. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration [2]. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera [3], Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) [5] is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools [5, 7]. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [8]. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers [5,6]. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗
NASA NTRSDate not supplied

Separation of isobaric Amino Acids and Small Molecule Metabolites Using Multipass Ion Mobility Analysis

Amino acids along with small molecule metabolites are important biomarkers for the study and detection of diseases that are initially analyzed in untargeted omics fashion. Amino acids and many metabolites are isomeric, and their specific form can have a significant impact on biological function. Chromatographic separation of isomers is challenging, and they cannot be resolved by mass spectrometry alone. Ion mobility is a technique that allows the separation of ions based on their size, shape, and charge. Here we present the results of the separation of isobaric amino acids and small molecule metabolites using a system that allows for multi-pass ion mobility separation which, in turn, enhances the ion mobility resolution of the separation. Amino acid standards and small molecule metabolites commercially available were infused directly into a SELECT SERIES™ Cyclic™ IMS system. Solutions of individual and mixture of the isobaric species were used and the mobility conditions were optimized for multiple passes for each corresponding set of isobaric species. Both ionization polarities and various solvent adducts were tested to provide the best signal intensity and separation. Amino acids such as leucine and isoleucine have previously been separated with ion mobility in a system with lower ion mobility resolution (SYNAPT™ G2 mass spectrometer) rendering about 90% of valley and mobility resolution of around 40 Ω/ΔΩ. With the enhanced ion mobility resolution using the cyclic IMS technique we have obtained almost complete separation of those amino acids rendering a valley of about 10% after 15 passes. For this case, the mobility resolution is around 250 Ω/ΔΩ. Another example is the separation of glucose-6-phosphate from glucose-1-phosphate, and fructose-6phosphate which were separated after 10 passes. For this case, the mobility resolution is around 205 Ω/ΔΩ.

Hernando J Olivos↗
NASA NTRSDate not supplied

Global 3D Data Visualization and Analysis Platform with Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera, Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗
NASA NTRS2024

Digital Lunar Exploration Sites (DLES) Terrain Crafting

Humans will soon be returning to the surface of the Moon with NASA’s Artemis program. The Artemis program is an international collaboration that will consist of a complex series of space systems and missions to explore the lunar surface and pave the way for the future exploration of Mars. NASA and its partners rely heavily on simulation for lighting and navigation studies as well as training astronauts, flight controllers, and mission support staff. The NASA Exploration Systems Simulations (NExSyS) team in the Simulation and Graphics Branch (ER7) in the Engineering Directorate at NASA’s Johnson Space Center has built up many simulation products to support this effort, one of which is the Digital Lunar Exploration Sites (DLES). DLES is a collection of products used to simulate and render the lunar surface in a digital environment. We discussed and presented an overview of the DLES products at the 2022 IEEE Aerospace Conference in Big Sky, MT with a paper titled "Digital Lunar Exploration Sites". This “DLES Terrain Crafting” paper will expand on the information previously provided in “DLES” paper and dive deeper into the details of the terrain crafting process and the toolsets used to support this task. The best digital data currently available of the lunar surface is provided by the Lunar Reconnaissance Orbiter (LRO). Its Lunar Orbiter Laser Altimeter (LOLA) achieves an impressive resolution of 5m per pixel at the Lunar South Pole (LSP) and can generate datasets covering a large continuous region near the LSP. There are a few additional methods, such as Shape from Shading which can infer higher resolution data (up to 1m per pixel) from the LRO Narrow Angle Camera (NAC) images. However, surface-based simulations require higher-resolution data, and this paper will discuss the process of enhancing the terrain to meet that need. The process begins with capturing statistical data of craters in the regions of interest using images provided by the LRO NAC. This data is then used to scatter artificial features which are not captured in the truth data, resulting in an enhanced DEM with a much higher resolution of 20cm per pixel. Many tools were built up to assist in the creation of these artificial Digital Elevation Models (DEM), which this paper will discuss in detail. DEMs themselves are a very powerful representation of a planetary surface, and many operations and tools can utilize the data they contain. This paper includes a description of the rendering of the lunar surface in a graphics engine, generation of contact patches to simulate tire to ground interaction, and ray tracing utilities to model Line of Sight (LOS) interactions with the terrain. This paper will also explore some new tool sets currently under development which aim to utilize Machine Learning (ML) to assist in the identification of craters from LRO NAC imagery. While this is not a novel idea, the NExSyS team is developing a unique approach which may result in more robust identification of crater characteristics.

Artemis↗