Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cognitive map”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Beyond Visual Analytics: Human-Machine Teaming for AI-Driven Data Sensemaking

"Detect the expected, discover the unexpected" was the founding principle of the field of visual analytics. This mantra implies that human stakeholders, like a domain expert or data analyst, could leverage visual analytics techniques to seek answers to known unknowns and discover unknown unknowns in the course of the data sensemaking process. We argue that in the era of AI-driven automation, we need to recalibrate the roles of humans and machines (e.g., a machine learning model) as teammates. We posit that by realizing human-machine teams as a stakeholder unit, we can better achieve the best of both worlds: automation transparency and human reasoning efficacy. However, this also increases the burden on analysts and domain experts towards performing more cognitively demanding tasks than what they are used to. In this paper, we reflect on the complementary roles in a human-machine team through the lens of cognitive psychology and map them to existing and emerging research in the visual analytics community. We discuss open questions and challenges around the nature of human agency and analyze the shared responsibilities in human-machine teams.

Sensemaking, human-machine teaming, agency, artifi↗

Cortical localization of cognitive function by regression of performance on event-related potentials

This paper demonstrates a new method of mapping cortical localization of cognitive function, using electroencephalographic data. Cross-subject regression analyses are used to identify cortical sites and post-stimulus latencies where there is a high correlation between subjects' performance and their cognitive event-related potential amplitude. The procedure was tested using a mental arithmetic task and was found to identify essentially the same cortical regions that have been associated with such tasks on the basis of research with patients suffering localized cortical lesions. Thus, it appears to offer an inexpensive, noninvasive tool for exploring the dynamics of localization in neurologically normal subjects.

Montgomery, R. W.↗

Map display design

This paper presents a cognitive model of a pilot's navigation task and describes an experiment comparing a visual momentum map display to the traditional track-up and north-up approaches. The data show the advantage to a track-up map is its congruence with the ego-centered forward view; however, the development of survey knowledge is hindered by the inconsistency of the rotating display. The stable alignment of a north-up map aids the acquisition of survey knowledge, but there is a cost associated with the mental rotation of the display to a track-up alignment for ego-centered tasks. The results also show that visual momentum can be used to reduce the mental rotation costs of a north-up display.

Aretz, Anthony J.↗

Impact Mapping for Geospatial Reasoning and Decision Making

Objective The reported study evaluated a novel approach to aiding geospatial reasoning and decision making. Background Impact mapping aims to alleviate the cognitive demands of geospatial tasks in part by externalizing data in the form of an integrated decision surface. This is achieved by aggregating data across multiple sources of information and visualizing their combined utility rather than objective measurements or individual utility. Previous research has shown that geospatial decisions improve when aided in this manner, but it remains unknown if dynamic decision making, often plagued by fatigue and anchoring bias, would benefit similarly. Method The experiment implemented a systematic manipulation of the presence of a composite impact map and the number of attributes present in a two-stage disaster relief, resource allocation task to investigate when and how impact mapping is beneficial or deleterious to decision makers. Results The presence of the composite impact map increased the utility of selected sites, increased re-planning decisions, reduced information display views, and reduced workload. Generally, the effect of the composite impact map was greater when participants were asked to evaluate more attributes. Conclusion Composite impact maps appear to improve repeated geospatial reasoning and minimize anchoring bias because they alleviate the cognitive demands otherwise necessary to interpret and maintain information from multiple attributes. Application Data visualization techniques, such as impact mapping, can improve repeated geospatial decision making in environments that include high cognitive demand.

Illingworth, David A.↗

Contributions of major tau kinase activation and phospho-tau accumulation to cortical and hippocampal tangle formation and cognition in older adults

Aberrant activation of tau kinases (tauK) has been proposed as a major step in tau hyperphosphorylation and misfolding, and subsequent formation of neurofibrillary tangles (NFT) in Alzheimer's disease (AD). However, evidence of tauK hyperactivation in actual AD brains is scarce and inconsistent, and their role in age-related cognitive decline remains undocumented. We evaluated activated/inhibited species of CDK5/p35/p25, GSK3a/ß, and ERK1/2 as well as ten tau/phospho-tau (ptau) peptides (mapping Ser 202 , Thr 217 , Ser 262 , Ser 305 , and Ser 404 phospho-residues) by Western blot or selected reaction monitoring proteomics, respectively, in postmortem dorsolateral prefrontal cortex (DLPFC) and hippocampal samples of 150 participants from the Rush Memory and Aging Project (MAP). Regression models and mediation analyses assessed the contributions of these variables to tau phosphorylation, NFT deposition and antemortem cognitive status of MAP participants. Surprisingly, greater p25 and p35 (indices for CDK5 activation) and lower pSer 21/9 -GSK3a/ß (inhibited species) immunodensities were associated with lower ptau peptide amounts. Individuals with higher p25 cortical densities displayed better cognitive outcomes, particularly working memory. Statistical mediation analyses indicated that the beneficial effect of CDK5/p25 on cognition was mediated by lower densities of phospho-Thr 217 -tau and NFT deposition in DLPFC, and also identified Thr 217 and Ser 262 as the ptau sites with greatest influence in both NFT accumulation and cognitive impairment. The present data suggest that tau hyperphosphorylation, tangle deposition, and the subsequent cognitive impairment do not rely on aberrant activation of major tauKs. Additionally, novel evidence was provided for the beneficial contribution of cortical CDK5/p25 to the maintenance of working memory.

60 APPLIED LIFE SCIENCES↗

Therapeutic targeting of membrane-associated proteins in central nervous system tumors

The activity of the most complex system, the central nervous system (CNS) is profoundly regulated by a huge number of membrane-associated proteins (MAP). A minor change stimulates immense chemical changes and the elicited response is organized by MAP, which acts as a receptor of that chemical or channel enabling the flow of ions. Slight changes in the activity or expression of these MAPs lead to severe consequences such as cognitive disorders, memory loss, or cancer. CNS tumors are heterogeneous in nature and hard-to-treat due to random mutations in MAPs; like as overexpression of EGFRvIII/TGFβR/VEGFR, change in adhesion molecules α5β3 integrin/SEMA3A, imbalance in ion channel proteins, etc. Extensive research is under process for developing new therapeutic approaches using these proteins such as targeted cytotoxic radiotherapy, drug-delivery, and prodrug activation, blocking of receptors like GluA1, developing viral vector against cell surface receptor. The combinatorial approach of these strategies along with the conventional one might be more potential. Henceforth, our review focuses on in-depth analysis regarding MAPs aiming for a better understanding for developing an efficient therapeutic approach for targeting CNS tumors.

60 APPLIED LIFE SCIENCES↗

Optimizing the Energy Usage and Cognitive Value of Extreme-Scale Data-Analysis Approaches

This report serves as a record that we have successfully completed work on the proposal Optimizing the Energy Usage and Cognitive Value of Extreme Scale Analysis Approaches, or, more succinctly, ECX. This includes successful completion of all three phases of the project, findings as summarized below, strong publications across the fields represented in the proposal, and a set of artifacts (code, websites, and other documentation) available to the public. In total, the results of this project represent significant findings in each domain, and a toolkit that will allow the community to engage with this work, advancing it and contributing to it in the years ahead. They also form the basis for a successfully funded follow-on project.

97 MATHEMATICS AND COMPUTING↗

Brain Connectomics: Opportunities for High-Performance Computing (Final Report)

The human brain is estimated to contain approximately 100 trillion neural connections. This complex map of connectivity (human connectome) underlies cognitive processes and informs disease states, but until recently, studying the human connectome has been hampered by the difficulty of collecting and processing suitable data for analysis. In this context, an initiative denominated The Human Connectome Project (HCP) was created to acquire and collect the largest, most cohesive set of brain data to accelerate neuroscience research. Recently the HCP released a magnetic resonance (MR) dataset of brain imagery with unprecedented scale and organization, together with high quality spatial and temporal resolution; however, fully taking advantage of this high-resolution brain imagery to estimate neurological connectivity networks requires high-performance computing (HPC). In this project, we explored the feasibility of using HPC resources at Lawrence Livermore to effectively estimate brain connectivity networks from this large set of imagery. Specifically, we addressed one of the main current challenges in brain connectomics, which is to advance the computation of individual structural and functional connectomes.

42 ENGINEERING↗

Structure and strategy in encoding simplified graphs

Tversky and Schiano (1989) found a systematic bias toward the 45-deg line in memory for the slopes of identical lines when embedded in graphs, but not in maps, suggesting the use of a cognitive reference frame specifically for encoding meaningful graphs. The present experiments explore this issue further using the linear configurations alone as stimuli. Experiments 1 and 2 demonstrate that perception and immediate memory for the slope of a test line within orthogonal 'axes' are predictable from purely structural considerations. In Experiments 3 and 4, subjects were instructed to use a diagonal-reference strategy in viewing the stimuli, which were described as 'graphs' only in Experiment 3. Results for both studies showed the diagonal bias previously found only for graphs. This pattern provides converging evidence for the diagonal as a cognitive reference frame in encoding linear graphs, and demonstrates that even in highly simplified displays, strategic factors can produce encoding biases not predictable solely from stimulus structure alone.

Schiano, Diane J.↗

GeoAI advances in specific landform mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation. References: Arundel, Samantha T., Wenwen Li, and Sizhe Wang. 2020. “GeoNat v1.0: A Dataset for Natural Feature Mapping with Artificial Intelligence and Supervised Learning.” Transactions in GIS 24 (3): 556–72. https://doi.org/10.1111/tgis.12633. Arundel, Samantha T, and Gaurav Sinha. 2018. “Validating GEOBIA Based Terrain Segmentation and Classification for Automated Delineation of Cognitively Salient Landforms BT - Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017).” In Proceedings of Workshops and Posters at the 13th International Conference on Spatial Information Theory (COSIT 2017), Lecture Notes in Geoinformation and Cartography, edited by Paolo Fogliaroni, Andrea Ballatore, and Eliseo Clementini, 9–14. Cham: Springer International Publishing. Arundel, Samantha T., Gaurav Sinha, Wenwen Li, David P. Martin, Kevin G. McKeehan, and Philip T. Thiem. 2023. “Historical Maps Inform Landform Cognition in Machine Learning.” Abstracts of the ICA 6 (August): 1–2. https://doi.org/10.5194/ica-abs-6-10-2023. Evans, Ian S. 2012. “Geomorphometry and Landform Mapping: What Is a Landform?” Geomorphology 137 (1): 94–106. https://doi.org/10.1016/j.geomorph.2010.09.029.

machine learning↗

Vision science and technology for supervised intelligent space robots

The focus of recent work in robotic vision for application in intelligent space robots such as the Extravehicular Activity (EVA) Retriever is in visual function, that is, how information about the space world is derived and then conveyed to cognition. The goal of this work in visual function is first to understand how the relevant structure of the surrounding world is evidenced by regularities among the pixels of images, then to understand how these regularities are mapped on the premises that form the primitive elements of cognition, and then to apply these understandings with the elements of visual processing (algorithms) and visual mechanism (machine organization) to intelligent space robot simulations and test beds. Since visual perception is the process of recognizing regularities in images that are known on the basis of a model of the world to be reliable related to causal structure in the environment (because perception attaches meaning to the link between a conception of the environment and the objective environment), the work involves understanding generic, generally applicable models of world structure (not merely objects) and how that structure evidences itself in images.

Erickson, Jon D.↗

Subventricular Accumulation of Cu in the Aging Mouse Brain Does Not Associate with Anticipated Increases in Markers of Oxidative Stress

Natural aging is associated with mild memory loss and cognitive decline, and age is the greatest risk factor for neurodegenerative diseases, such as Alzheimer’s disease. There is substantial evidence that oxidative stress is a major contributor to both natural aging and neurodegenerative disease, and coincidently, levels of redox active metals such as Fe and Cu are known to be elevated later in life. Recently, a pronounced age-related increase in Cu content has been reported to occur in mice and rats around a vital regulatory brain region, the subventricular zone of lateral ventricles. In our study herein, we have characterized lateral ventricle Cu content in a unique murine model of accelerated aging, senescence accelerated mouse-prone 8 (SAMP8) mice. Our results confirm an age-related increase in ventricle Cu content, consistent with the studies by others in wild-type mice and rats. Specifically, we observed Cu content to increase over the time frame 1 to 5 months and 5 to 9 months, but interestingly, no significant increase occurred between 9 and 12 months (although brain Cu content at 12 months was significantly elevated relative to 1 and 5 month-old animals). Despite the magnitude of Cu increase observed within the cells that comprise the subventricular zone of lateral ventricles (average 3 mM Cu, with isolated subcellular concentrations of 17 mM), we did not detect spectroscopic markers of thiol oxidation, protein aggregation, or lipid oxidation. The lack of evidence for oxidative stress in ex vivo animal tissue is in contrast to in vitro studies demonstrating that thiol, protein, and lipid oxidation is pronounced at these Cu concentrations. We suggest that our findings most likely indicate that the Cu ions in this brain region are sequestered in an unreactive form, possibly extended chains of Cu-thiolate complexes, which do not readily redox cycle in the aqueous cytosol. In conclusion, these results also appear to partially challenge the long-held view that age-related increases in brain metal content drive oxidative stress as we did not observe a concomitant association between age-related Cu increase and markers of oxidative stress, nor did we observe a net increase in Cu content between mice aged 9 and 12 months.

X-ray fluorescence↗

IMPACT 1.0—Task Impairment: A Novel Approach for Assessing Impairment during Exploration-Class Missions

Exploration-class and International Space Station (ISS) missions have significantly different levels of associated medical risk for crewmembers. The Integrated Medical Model (IMM), the probabilistic risk assessment tool used for ISS medical trade-space analyses, uses a Functional Impairment (FI) metric to determine quality time lost should a crewmember be afflicted with a medical condition. While IMM-based FI has been successful for ISS operations, it has limitations when applied to exploration-class missions. As the National Aeronautics and Space Administration (NASA) looks ahead to Gateway, Artemis, and Martian missions, a novel, dynamic, and mission-appropriate impairment paradigm is necessary for accurate contingency planning. This paradigm, Task Impairment (TI), fulfills that need by utilizing mission-specific tasks. TI will allow future capability for a loss of mission metric, previously not available with IMM. TI serves as a replacement metric for FI within IMPACT, the next-generation trade-space analysis tool suite created to replace the IMM. IMPACT significantly increases the fidelity of probabilistic risk assessment for exploration-class missions. The Human Exploration of Mars Preliminary List of Crew Tasks (MTL, a source of 1100+ exploration-class mission-specific tasks for crewmembers) was used to calculate TI. Using the Task List, 18 individual Human System Categories were identified as being required to perform each task (e.g., Cardiopulmonary, Cognitive, etc.). Each of the 1200+ tasks were mapped to the Human System categories listed in the Task List. The total number of tasks in each category were tallied to determine how many tasks required each Human System. Lastly, each of the 120 medical conditions from the IMPACT condition list were mapped to the Human System categories to complete the TI calculation. NASA subject matter experts across five medical specialties established consensus for the mapping of each condition. The resulting total tasks impaired by each condition were used to calculate discrete TI values. This process was repeated for each of the four severity/resource utilization variants of each condition, and for each of the three phases of clinical care. Through this process, discrete TI values were calculated for each of the 120 IMPACT medical conditions and their variants. The Task Impairment metric provides higher fidelity, dynamic utility, and quicker analysis of medical impairment compared to the previous Functional Impairment metric used for the Integrated Medical Model. TI will be used for higher fidelity medical impairment analysis and contingency planning during Lunar, Martian, and other long-term exploration-class missions.

William L Fernandez↗

A model of electronic map interpretation

This paper describes an experiment that provides data for the development of a cognitive model of pilot flight navigation. The model views navigation as a process involving the alignment of mental images with the perceptual view out of the cockpit. The data support a three stage model: (1) the perceptual encoding of the map display, (2) mental rotation of the mental image, and (3) comparison of the image to the environment. The variables that significantly influence the processes embodied in the model in decreasing importance are: speed of processing, display sequencing, map complexity, and rotation angle of the map. The model can be used as a preliminary computational tool in predicting the navigational component of pilot situational awareness.

Aretz, Anthony J.↗

Galvanic Vestibular Reduction Modifies Perception of Coriolis Cross-Coupling and Delays Motion Sickness Onset

INTRODUCTION: Alterations in vestibular sensory processing following G-transitions lead to head movement sensitivity and motion sickness upon return to Earth’s gravity. The purpose of this study was to evaluate whether a non-pharmaceutical tool using galvanic vestibular reduction (GVR) could suppress disorienting illusions and mitigate motion sickness. A similar approach using anodal (inhibitory) currents delivered to both ears has been shown to result in a selective reversible ablation of irregular vestibular afferents [1]. METHODS: Using a repeated measures counter-balanced design, motion sickness and perception were obtained in 26 subjects during Coriolis cross-coupling stimuli on a rotating chair across three GVR treatment interventions: throughout stimulus testing (prevention), following symptom onset (rescue), and placebo control. The GVR peak current was maintained at 2.5 mA across subjects and across prevention / rescue sessions. Subjects performed up to 10 sets of pitch head movements during constant rotation. For each set, head movement was cued every 10 seconds, alternating between pitch forward (chin resting to chest) and pitch backward (head upright) for a total of 7 forward and backward movements. During each head movement, subjects were asked to use a joystick to record the magnitude of their perceived rotation along three axes. During the 2-minute pause between sets, motion sickness symptom scoring was obtained using the Pensacola Diagnostic Index and subject discomfort (0-20) ratings. Performance on a sensorimotor and cognitive test battery was measured during a fourth session to map changes in GVR level with functional performance. RESULTS: Fourteen of the 26 subjects were not susceptible to the motion stressor (i.e., did not reach an endpoint in the control condition). While the time to endpoint, or number of head movements, did not significantly vary across the three GVR conditions in the remaining subjects, the symptom levels were significantly lower through the third set of head movements when GVR was on throughout the testing. Initiating GVR following symptom onset did not appear to alter the symptom progression nor time to motion sickness endpoint. Based on the joystick measures, GVR significantly modified the perceived roll and pitch sensation during head movements, reducing the amplitude of tilt in most subjects. It is important to note that comparable levels of GVR did not impair performance on a functional test battery including mobility, balance and cognitive tasks. DISCUSSION: Our findings suggest GVR may be useful in reducing disorienting roll and pitch illusions and delaying the onset of motion sickness. Further enhancements will be required to individualize the stimulation amplitude and optimize the waveform delivery. Adapting this non-pharmaceutical countermeasure approach to allow self-administered titration of current amplitude during recovery would enable transfer to post-flight treatment of motion sickness. [1] Minor L. B. and Goldberg J. M. (1991) J Neurosci 11, 1636-48. 109, 889-894.

G N Pradhan↗

Preliminary Results Using Galvanic Vestibular Reduction as a Non-Pharmaceutical Tool for Motion Sickness Mitigation

Introduction: Alterations in vestibular sensory processing following G-transitions lead to motion sickness and spatial disorientation upon return to Earth’s gravity. The use of non-pharmaceutical mitigation for motion sickness has several potential advantages over drug treatment options. The purpose of this study was to validate a non-pharmaceutical tool using galvanic vestibular reduction (GVR) to mitigate G-transitional induced motion sickness and spatial disorientation. Methods: Using a repeated measures counter-balanced design, motion sickness and perception are obtained during Coriolis cross-coupling stimuli on a rotating chair across three GVR treatment interventions: throughout stimulus testing (prevention), following symptom onset (rescue), and placebo control. Subjects perform up to 10 sets of pitch head movements during constant rotation. For each set, head movement is cued every 10 seconds, alternating between pitch forward (chin resting to chest) and pitch backward (head upright) for a total of 7 forward and backward movements. During each head movement, subjects are asked to use a joystick to record the magnitude of their perceived rotation along all three axes. During the 2-minute pause between sets, motion sickness symptom scoring was obtained using the Pensacola Diagnostic Index and subject discomfort (0-20) ratings. Performance on a sensorimotor and cognitive test battery is measured during a fourth session to map changes in GVR level with functional performance. Results: Fifteen of 30 subjects have completed testing to date. Preliminary findings suggest GVR may be more effective in reducing symptoms in subjects who self-report less susceptibility on a pre-test motion sickness susceptibility questionnaire. Based on the joystick measures, GVR significantly reduces both the magnitude (mean 22% - 34%) and duration (mean 42% - 49%) of perceived roll and pitch sensation with head movements during constant rotation. It is important to note that comparable levels of GVR (up to 2.5mA) does not impair performance on a functional test battery including mobility and balance tasks. Discussion: Our preliminary findings suggest GVR may be useful in reducing disorienting roll and pitch illusions associated with Coriolis cross-coupling stimuli. While transfer to post-flight treatment will need to be validated, the potential advantages of our non-pharmaceutical countermeasure approach would be to provide rapid therapeutic effect while allowing continuous titration of GVR amplitude during recovery to maintain operational performance.

Gaurav Pradhan↗

Concept Maps Applied to Mars Exploration Public Outreach

This paper describes CMEX Mars, an effort in the creation of a comprehensive set of concept maps to describe all aspects of Mars exploration. These concept maps, created using the CmapTools software developed by the Institute for Human and Machine Cognition, are available on the Internet at http:/cmex.arc.nasa.gov/CMEX and are linked among themselves as well as to resources on the Internet. The work described took place mainly between 1998 and 2001 and combined the goals of: 1) developing a library of concept maps for educational outreach while also 2) refining the capabilities of the software used to create the interactive maps and 3) making them available on the Internet. Here we focus on the library of Mars exploration concept maps that has been created.

Briggs, Geoffrey↗

GeoAI Advances in Specific Landform Mapping

Landform mapping (also referred to as geomorphology or geomorphometry) can be divided into two domains: general and specific (Evans 2012). Whereas general landform mapping categorizes all elements of the study area into landform classes, such as ridges, valleys, peaks, and depressions, the mapping of specific landforms requires the delineation (even if fuzzy) of individual landforms. The former is mainly driven by physical properties such as elevation, slope, and curvature. The latter, however, must consider the cognitive (human) reasoning that discriminates individual landforms in addition to these physical properties (Arundel and Sinha 2018). Both mapping forms are important. General geomorphometry is needed to understand geological and ecological processes and as boundary layer input to climate and environmental models. Specific geomorphometry supports such activities as disaster management and recovery, emergency response, transportation, and navigation. In the United States, individual landforms of interest are named in the U.S. Geological Survey (USGS) Geographic Names Information System, a point dataset captured specifically to digitize geographic names from the USGS Historical Topographic Map Collection (HTMC). Named landform extent is represented only by the name placement in the HTMC. Recent work has investigated CNN-based deep learning methods to capture these extents in machine-readable form. These studies first relied on physical properties (Arundel et al. 2020) and then included the HTMC as a band in RGB images in limited testing (Arundel et al. 2023). Results from the HTMC dataset surpassed those using just physical properties and using the HTMC alone performed best due to the hillshading and elevation (contour) data incorporated into the topographic maps. However, results fell short of an operational capacity to map all named landforms in the United States. Thus, our current work expands upon past research by focusing on the HTMC and physical information as inputs and the named landform label extents. Specifically, we propose to leverage pre-trained foundation models for segmentation and optical character recognition (OCR) models to jointly map landforms in the United States. Our approach aims to bridge the disparities among the independent information sources to facilitate informed decision-making. The modeling pipeline performs (1) segmentation using the physical information and (2) information extraction using OCR, in parallel. Then a computer vision approach merges the two branches into a labeled segmentation.

machine learning↗