Search NASA⌕ Search

SEARCH · Search NASA

Results for “Adaptive learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Towards the Development of a Multi-Agent Cognitive Networking System for the Lunar Environment

This paper details the development of a multi-agent cognitive system intended to optimize networking performance in the lunar environment. One concept of the future of lunar communication, LunaNet, outlines a complex network of networks. Challenges such as scalability, interoperability, and reliability must first be addressed to successfully fulfill this vision. Machine intelligence can greatly reduce the reliance on human operators and enable efficient operations for tasks such as scheduling and network management. Machine learning, artificial intelligence, and other automated decision-making techniques can be used to allow network nodes to intelligently sense and adapt to changes in the environment such as link disruptions, new nodes joining the network, and support for a diverse range of protocols. Cognitive networking seeks to evolve these technologies into an autonomous system with improved science data return, reliability, and scalability. In this paper, we study four main areas as a means to further develop cognitive networking capabilities: networking protocol development, analysis of wireless data for modeling and simulation, development of algorithms for a multi-agent system, and spectrum sensing technology.

cognitive networking↗

The Development of Two Science Investigator-led Processing Systems (SIPS) for NASA's Earth Observation System (EOS)

In 2001, NASA Goddard Space Flight Center's Laboratory for Terrestrial Physics started the construction of a science Investigator-led Processing System (SIPS) for processing data from the Ozone Monitoring Instrument (OMI) which will launch on the Aura platform in mid 2004. The Ozone Monitoring Instrument (OMI) is a contribution of the Netherlands Agency for Aerospace Programs (NIVR) in collaboration with the Finnish Meteorological Institute (FMI) to the Earth Observing System (EOS) Aura mission. It will continue the Total Ozone Monitoring System (TOMS) record for total ozone and other atmospheric parameters related to ozone chemistry and climate. OMI measurements will be highly synergistic with the other instruments on the EOS Aura platform. The LTP previously developed the Moderate Resolution Imaging Spectrometer (MODIS) Data Processing System (MODAPS), which has been in full operations since the launches of the Terra and Aqua spacecrafts in December, 1999 and May, 2002 respectively. During that time, it has continually evolved to better support the needs of the MODIS team. We now run multiple instances of the system managing faster than real time reprocessings of the data as well as continuing forward processing. The new OMI Data Processing System (OMIDAPS) was adapted from the MODAPS. It will ingest raw data from the satellite ground station and process it to produce calibrated, geolocated higher level data products. These data products will be transmitted to the Goddard Distributed Active Archive Center (GDAAC) instance of the Earth Observing System (EOS) Data and Information System (EOSDIS) for long term archive and distribution to the public. The OMIDAPS will also provide data distribution to the OMI Science Team for quality assessment, algorithm improvement, calibration, etc. We have taken advantage of lessons learned from the MODIS experience and software already developed for MODIS. We made some changes in the hardware system organization, database and software to adapt the system for OMI. We replaced the fundamental database system, Sybase, with an Open Source RDBMS called PostgreSQL, and based the entire OMIDAPS on a cluster of Linux based commodity computers rather than the large SGI servers that MODAPS uses. Rather than relying on a central I/O server host, the new system distributes its data archive among multiple server hosts in the cluster. OMI is also customizing the graphical user interfaces and reporting structure to more closely meet the needs of the OMI Science Team. Prior to 2003, simulated OMI data and the science algorithms were not ready for production testing. We initially constructed a prototype system and tested using a 25 year dataset of Total Ozone Mapping Spectrometer (TOMS) and Solar Backscatter Ultraviolet Instrument (SBUV) data. This prototype system provided a platform to support the adaptation of the algorithms for OMI, and provided reprocessing of the historical data aiding in its analysis. In a recent reanalysis of the TOMS data, the OMIDAPS processed 108,000 full orbits of data through 4 processing steps per orbit, producing about 800,000 files (400 GiB) of level 2 and greater data files. More recently we have installed two instances of the OMIDAPS for integration and testing of OM1 science processes as they get delivered from the Science Team. A Test instance of the OMIDAPS has also supported a series of "Interface Confidence Tests" (ICTs) and End-to-End Ground System tests to ensure the launch readiness of the system. This paper will discuss the high-level hardware, software, and database organization of the OMIDAPS and how it builds on the MODAPS heritage system. It will also provide an overview of the testing and implementation of the production OMIDAPS.

Tilmes, Curt↗

TCR-H: explainable machine learning prediction of T-cell receptor epitope binding on unseen datasets

Artificial-intelligence and machine-learning (AI/ML) approaches to predicting T-cell receptor (TCR)-epitope specificity achieve high performance metrics on test datasets which include sequences that are also part of the training set but fail to generalize to test sets consisting of epitopes and TCRs that are absent from the training set, i.e., are ‘unseen’ during training of the ML model. We present TCR-H, a supervised classification Support Vector Machines model using physicochemical features trained on the largest dataset available to date using only experimentally validated non-binders as negative datapoints. TCR-H exhibits an area under the curve of the receiver-operator characteristic (AUC of ROC) of 0.87 for epitope ‘hard splitting’ (i.e., on test sets with all epitopes unseen during ML training), 0.92 for TCR hard splitting and 0.89 for ‘strict splitting’ in which neither the epitopes nor the TCRs in the test set are seen in the training data. Furthermore, we employ the SHAP (Shapley additive explanations) eXplainable AI (XAI) method for post hoc interrogation to interpret the models trained with different hard splits, shedding light on the key physiochemical features driving model predictions. TCR-H thus represents a significant step towards general applicability and explainability of epitope:TCR specificity prediction.

60 APPLIED LIFE SCIENCES↗

Alternating prism exposure causes dual adaptation and generalization to a novel displacement

In two experiments, we examined the hypothesis that repeatedly adapting and readapting to two mutually conflicting sensory environments fosters the development of a separate adaptation to each situation (dual adaptation) as well as an increased ability to adapt to a novel displacement (adaptive generalization). In the preliminary study, subjects alternated between adapting their visuomotor coordination to 30-diopter prismatic displacement and readapting to normal vision. Dual adaptation was observed by the end of 10 alternation cycles. However, an unconfounded test of adaptive generalization was prevented by an unexpected prism-adaptive shift in preexposure baselines for the dual-adapted subjects. In the primary experiment, the subjects adapted and readapted to opposite 15-diopter displacements for a total of 12 cycles. Both dual adaptation and adaptive generalization to a 30-diopter displacement were obtained. These findings may be understood in terms of serial reversal learning and 'learning to learn'.

Welch, Robert B.↗

Journal of Gravitational Physiology, Volume 12, Number 1

The following topics were covered: System Specificity in Responsiveness to Intermittent -Gx Gravitation during Simulated Microgravity in Rats; A Brief Overview of Animal Hypergravity Studies; Neurovestibular Adaptation to Short Radius Centrifugation; Effect of Artificial Gravity with Exercise Load by Using Short-Arm Centrifuge with Bicycle Ergometer as a Countermeasure Against Disused Osteoporosis; Perception of Body Vertical in Microgravity during Parabolic Flight; Virtual Environment a Behavioral and Countermeasure Tool for Assisted Gesture in Weightlessness: Experiments during Parabolic Flight; Artificial Gravity: Physiological Perspectives for Long-Term Space Exploration; Comparison of the Effects of DL-threo-Beta-Benzyloxyaspartate on the Glutamate Release from Synaptosomes before and after Exposure of Rats to Artificial Gravity; Do Perception and Postrotatory Vestibulo-Ocular Reflex Share the Same Gravity Reference?; Vestibular Adaptation to Changing Gravity Levels and the Orientation of Listing's Plane; Compound Mechanism Hypothesis on +Gz - Induced Brain Injury and Dysfunction of Learning and Memory; Environmental Challenge Impairs Prefrontal Brain Functions; Effect of 6-Days of Support Withdrawal on Characteristics of Balance Function; Hypergravity-Induced Changes of Neuronal Activities in CA1 Region of Rat Hippocampus; Audiological Findings in Antiorthostatic Position Modelling Microgravitation; Investigating Human Cognitive Performance during Spaceflight; The Relevance of the Minimization of Torque Exchange with the Environment in Weightlessness is Confirmed by Asimulation Study; Characteristics of the Eyes Pursuit Function during Readaptation to Terrestrial Gravity after Prolonged Flights Aboard the International Space Station; Comparison of Cognitive Performance Tests for Promethazine Pharmacodynamics in Human Subjects; Structural Reappraisal of Dendritic Tree of Cerebellar Purkinje Cell for Novel Functional Modeling of Elementary Sensorimotor Adaptive Processes; Orpheus 0 G or Ear in Microgravity to Establish Symptoms Concomittant of Inner and Middle Ear and Osteoporosis in Microgravity; Understanding Visual Perception in the Perspective of Gravity; Cortical Regions Associated with Orthostatic Stress in Conscious Humans; Restoration of Central Blood Volume: Application of a Simple Concept and Simple Device to Counteract Cardiovascular Instability in Syncope and Hemorrhage; WISE-2005: Integrative Cardiovascular Responses with LBNP during 60-Day Bed Rest in Women; Intracranial Pressure Increases during Weightlessness. A Parabolic Flights Study; Lower Limb & Portal Veins Echography for Predicting Risk of Thrombosis during a 90-D Bed Rest; Calf Tissue Liquid Stowage and Muscular and Deep Vein Distension in Orthostatic Tests after a 90-Day Head Down Bed Rest; Morphology of Brain Vessels in the Tail Suspended Rats Exposed to Intermittent 2 G; Alterations in Vasoreactivity of Femoral Artery Induced by Hindlimb Unweighting are Related to the Changes of Contractile Protein in Rats; and Respiratory Sinus Arrhythmia: A Marker of Decreased Parasympathetic Modulation after Short Duration.

Fuller, Charles A.↗

Tools for unbinned unfolding

Machine learning has enabled differential cross section measurements that are not discretized. Going beyond the traditional histogram-based paradigm, these unbinned unfolding methods are rapidly being integrated into experimental workflows. Here, in order to enable widespread adaptation and standardization, we develop methods, benchmarks, and software for unbinned unfolding. For methodology, we demonstrate the utility of boosted decision trees for unfolding with a relatively small number of high-level features. This complements state-of-the-art deep learning models capable of unfolding the full phase space. To benchmark unbinned unfolding methods, we develop an extension of existing dataset to include acceptance effects, a necessary challenge for real measurements. Additionally, we directly compare binned and unbinned methods using discretized inputs for the latter in order to control for the binning itself. Lastly, we have assembled two software packages for the OmniFold unbinned unfolding method that should serve as the starting point for any future analyses using this technique. One package is based on the widely-used RooUnfold framework and the other is a standalone package available through the Python Package Index (PyPI).

47 OTHER INSTRUMENTATION↗

Implementation and (Inverse Modified) Error Analysis for Implicitly Templated ODE-Nets

We focus on learning unknown dynamics from data using ODE-nets templated on implicit numerical initial value problem solvers. First, we perform inverse modified error analysis of the ODE-nets using unrolled implicit schemes for ease of interpretation. It is shown that training an ODE-net using an unrolled implicit scheme returns a close approximation of an inverse modified differential equation (IMDE). In addition, we establish a theoretical basis for hyperparameter selection when training such ODE-nets, whereas current strategies usually treat numerical integration of ODE-nets as a black box. We thus formulate an adaptive algorithm which monitors the level of error and adapts the number of (unrolled) implicit solution iterations during the training process, so that the error of the unrolled approximation is less than the current learning loss. This helps accelerate training while maintaining accuracy. Several numerical experiments are performed to demonstrate the advantages of the proposed algorithm compared to nonadaptive unrollings and validate the theoretical analysis. Here, we also note that this approach naturally allows for incorporating partially known physical terms in the equations, giving rise to what is termed “gray box” identification.

ODE-nets↗

Task path planning, scheduling and learning for free-ranging robot systems

The development of robotics applications for space operations is often restricted by the limited movement available to guided robots. Free ranging robots can offer greater flexibility than physically guided robots in these applications. Presented here is an object oriented approach to path planning and task scheduling for free-ranging robots that allows the dynamic determination of paths based on the current environment. The system also provides task learning for repetitive jobs. This approach provides a basis for the design of free-ranging robot systems which are adaptable to various environments and tasks.

Wakefield, G. Steve↗

Attention theory and training research

This study used elements of attention theory as a methodological basis to decompose a complex training task in order to improve training efficiency. The complex task was a microcomputer flight simulation where subjects were required to control the stability of their own helicopter while acquiring and engaging enemy helicopers in a threat enviroment. Subjects were divided into whole-task, part-task, and part/open loop adaptive task groups in a transfer of training paradigm. The effect of reducing mental workload at the early stages of learning was examined with respect to the degree that subordinate elements of the complex task could be automated through practice of consistent, learnable stimulus-response relationships. Results revealed trends suggesting the benefit of isolating consistently mapped sub-tasks for part-task training and the presence of a time-sharing skill over and above the skill required for the separate subtasks.

Connelly, James G., Jr.↗

Accuracy and adaptation of reaching and pointing in pitched visual environments

Visually perceived eye level (VPEL) and the ability of subjects to reach with an unseen limb to targets placed at VPEL were measured in a statically pitched visual surround (pitchroom). VPEL was shifted upward and downward by upward and downward room pitch, respectively. Accuracy in reaching to VPEL represented a compromise between VPEL and actual eye level. This indicates that VPEL shifts reflect in part a change in perceived location of objects. When subjects were provided with terminal visual feedback about their reaching, accuracy improved rapidly. Subsequent reaching, with the room vertical, revealed a negative aftereffect (i.e., reaching errors that were opposite those made initially in the pitched room). In a second study, pointing accuracy was assessed for targets located both at VPEL and at other positions. Errors were similar for targets whether located at VPEL or elsewhere. Additionally, pointing responses were restricted to a narrower range than that of the actual target locations. The small size of reaching and pointing errors in both studies suggests that factors other than a change in perceived location are also involved in VPEL shifts.

NASA Center ARC↗

Imbalanced Learning for Functional State Assessment

This paper presents results of several imbalanced learning techniques applied to operator functional state assessment where the data is highly imbalanced, i.e., some function states (majority classes) have much more training samples than other states (minority classes). Conventional machine learning techniques usually tend to classify all data samples into majority classes and perform poorly for minority classes. In this study, we implemented five imbalanced learning techniques, including random undersampling, random over-sampling, synthetic minority over-sampling technique (SMOTE), borderline-SMOTE and adaptive synthetic sampling (ADASYN) to solve this problem. Experimental results on a benchmark driving lest dataset show thai accuracies for minority classes could be improved dramatically with a cost of slight performance degradations for majority classes,

Li, Feng↗

Control Systems with Normalized and Covariance Adaptation by Optimal Control Modification

Disclosed is a novel adaptive control method and system called optimal control modification with normalization and covariance adjustment. The invention addresses specifically to current challenges with adaptive control in these areas: 1) persistent excitation, 2) complex nonlinear input-output mapping, 3) large inputs and persistent learning, and 4) the lack of stability analysis tools for certification. The invention has been subject to many simulations and flight testing. The results substantiate the effectiveness of the invention and demonstrate the technical feasibility for use in modern aircraft flight control systems.

Nguyen, Nhan T.↗

Unveiling the Potential of MeshGraphNets for Predicting Subsurface Evolution in Carbon Storage Projects

This is the conference paper accompanying an oral presentation “Unveiling the Potential of MeshGraphNets for Predicting Subsurface Evolution in Carbon Storage Projects” at the 17th International Conference on Greenhouse Gas Control Technologies GHGT-17 held in Calgary, Canada, October 20-24 , 2024. Carbon capture and storage (CCS) technology is critical for mitigating climate change but requires effective subsurface reservoir management to ensure safe containment of injected CO2. Accurate predictions of reservoir pressure and saturation are essential for assessing long-term CCS performance. Traditional numerical simulations, while effective, are computationally intensive, time-consuming, and constrained by data discretization. Previous work has shown the effectiveness of MeshGraphNets (MGN), a graph-based machine learning framework, as an innovative alternative for predicting reservoir behavior. MGN leverages graph neural networks (GNNs) and mesh representations to model complex geological formations, offering superior adaptability across different discretizations and reservoir configurations. Classic MGN implementations utilize an autoregressive technique to predict future behavior based on current predictions, but this technique is hampered by error accumulation over time. To enhance the model accuracy in time-series predictions, this study implemented a multi-step rollout strategy that integrates autoregressive predictions during training to stabilize prediction of saturation over time. Using the Illinois Basin – Decatur Project (IBDP) dataset, comprising 100 simulations of CO2 injection, pressure, and saturation changes, the framework demonstrated its ability to learn spatial dependencies and temporal dynamics. With inputs including permeabilities, porosities, and injection rates, MGN accurately predicted CO2 plume evolution over time, even with limited training data. Moreover, the addition of a multi-step rollout procedure during training improved the ability of MGN to predict stably over time by ~15%. This research positions MGN, enhanced with multi-step rollout capabilities, as a robust and efficient tool for CCS applications. It advances the field by enabling precise, computationally efficient predictions of reservoir behavior, providing a foundation for the broader adoption of machine learning frameworks in CCS and other geoscience domains.

Holcomb, Paul↗

Lunar Balance and Locomotion

Balance control and locomotor patterns were altered in Apollo crewmembers on the lunar surface, owing, presumably, to a combination of sensory-motor adaptation during transit and lunar surface operations, decreased environmental affordances associated with the reduced gravity, and restricted joint mobility as well as altered center-of-gravity caused by the EVA pressure suits. Dr. Paloski will discuss these factors, as well as the potential human and mission impacts of falls and malcoordination during planned lunar sortie and outpost missions. Learning objectives: What are the potential impacts of postural instabilities on the lunar surface? CME question: What factors affect balance control and gait stability on the moon? Answer: Sensory-motor adaptation to the lunar environment, reduced mechanical and visual affordances, and altered biomechanics caused by the EVA suit.

Paloski, William H.↗

Wildfire Segmentation From Remotely Sensed Data Using Quantum-Compatible Conditional Vector Quantized-Variational Autoencoders

Wildfires represent a critical environmental hazard with multifaceted implications for ecosystems, communities, and public health [1]. The escalating frequency and intensity of wildfires globally have intensified the urgency for robust segmentation methodologies to facilitate effective mitigation, response, and recovery strategies [2]. Accurate wildfire segmentation is pivotal for delineating fire boundaries, assessing progression patterns, and prioritizing resource allocation during emergency scenarios. Furthermore, precise segmentation enables stakeholders, including policymakers, environmental scientists, and emergency responders, to formulate evidence-based strategies, thereby minimizing socio-economic disruptions and ecological degradation. Consequently, advancing wildfire segmentation techniques through innovative technological interventions remains a paramount research imperative. Although foundational in wildfire segmentation, traditional deterministic models exhibit inherent limitations that compromise their efficacy in dynamic and uncertain environments. These models often operate on rigid algorithms prioritizing deterministic classifications, thereby overlooking the inherent complexities and uncertainties associated with wildfire behavior and satellite data variability. Such deterministic frameworks tend to produce oversimplified representations that fail to capture the intricate nuances of evolving fire dynamics, spatial heterogeneity, and environmental interactions [1]. Consequently, the deterministic approach’s propensity for uncertainty collapsing [1, 3] hampers the accuracy, reliability, and applicability of segmentation outcomes in real-world scenarios. Contrastingly, stochastic models offer a more nuanced and adaptable framework for wildfire segmentation. By integrating probabilistic elements into the modeling paradigm, stochastic approaches, particularly probabilistic approaches such as variational auto encoders (VAEs) [4], facilitate comprehensive uncertainty assessment, enabling researchers to quantify and incorporate uncertainties into segmentation outcomes effectively. This probabilistic nature empowers stochastic models to encapsulate variability, account for data inconsistencies, and adapt to evolving environmental conditions, enhancing segmentation accuracy, reliability, and robustness. Embracing stochastic methodologies thus catalyzes advancements in wildfire science by fostering a more holistic, adaptive, and resilient segmentation framework. Despite VAEs demonstrating significant promise in various applications, they come with inherent limitations that have garnered attention within the machine learning community. One of the primary drawbacks lies in their reliance on static priors, which essentially assume a fixed distribution for latent variables, thereby limiting the model’s flexibility to capture complex data structures effectively [5]. This static nature leads to suboptimal representations, especially when dealing with complex and high-dimensional data. Additionally, VAEs often struggle with generating sharp and realistic samples, a phenomenon commonly referred to as mode collapse [5, 7, 6]. Furthermore, the optimization process in VAEs, which involves balancing the reconstruction loss and the regularization term, can sometimes be challenging to fine-tune [7]. In recent efforts to address these shortcomings, alternative approaches like Vector Quantized Variational Auto encoders(VQ-VAEs) [7], address the challenges by incorporating discrete latent variables and leveraging techniques that enhance the quality and diversity of generated samples while maintaining efficient training dynamics. VQ-VAEs propose a dynamic prior distribution generation mechanism that diverges from the static priors commonly associated with traditional VAEs. This dynamic approach allows for more adaptive and context-aware latent variable representations, thereby potentially capturing complex data structures more effectively. Unlike autoregressive prior models such as PixelCNN, which, despite their ability to model dependencies across data dimensions, suffer from significant computational inefficiencies and lack flexibility in handling diverse datasets. In our work, we propose to use a generative quantum-compatible approach to help alleviate the shortcomings of autoregressive prior model in VQ-VAEs. Restricted Boltzmann Machines (RBMs) are a viable alternative prior model that can learn prior distributions in a faster and more flexible manner. In this research endeavor, we meticulously curate a state-of-the-art dataset leveraging satellite MODIS data in conjunction with VIIRS fire masks, derived from Fire Radiative Power (FRP), thereby encapsulating diverse wildfire scenarios and environmental contexts. We developed a conditional VQ-VAE architecture with the RBM prior model that is trained in a supervised manner for segmenting wildfire masks. This innovative approach synergistically harnesses deep learning capabilities, enabling the generation of segmentation maps characterized by heightened precision, granularity, and contextual relevance. Furthermore, replacing the autoregressive prior learning method proposed by the original VQ-VAE with a prior density approximation via quantum-compatible RBM facilitates expedited inference processes, augments flexibility in prior sampling, optimizes computational efficiency and establishes a groundbreaking benchmark in wildfire segmentation methodologies.

quantum machine learning↗

Effective Engagement for Community Action with NASA’s Indigenous Peoples Initiative

NASA’s Indigenous Peoples Initiative (IPI) seeks to support and cultivate efforts within Indigenous communities and NASA to increase the use of Earth Observations (EO) to inform decisions, policies, and actions. IPI is dedicated to building lasting relationships with Indigenous communities by creating a trusted, reliable, and Indigenous-centric geospatial community with a focus on environmental justice and climate issues on Indigenous lands and territories. Indigenous communities through conservation, restoration, and adaptation have the opportunity to further empower their landscape work through the potential use of EO and other NASA data and tools. We will outline our guiding principles, multiple approaches, and lessons learned for working alongside Indigenous communities in a respectful and reciprocal manner. These include the recognition of multiple ways of knowing, co-development of trainings, acknowledgement of all sovereignty, maintaining healthy relationships with tribal natural resource managers and building bridges for their engagement with NASA researchers and other federal agency partners, and making space for reflection and adaptation of our practices as we grow. Future activities, such as dialogue sessions with Indigenous communities around EO needs, aim to enhance these practices and ultimately benefit the ability for Indigenous communities to maintain and protect their lands, people, and practices in the face of environmental injustices and climate change.

Effective↗

Operating advanced scientific instruments with AI agents that learn on the job

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.

Large Language Models↗

Deep Domain Adaptation based Cloud Type Detection using Active and Passive Satellite Data

Domain adaptation techniques have been developed to handle data from multiple sources or domains. Most existing domain adaptation models assume that source and target domains are homogeneous, i.e., they have the same feature space. Nevertheless, many real world applications often deal with data from heterogeneous domains that come from completely different feature spaces. In our remote sensing application, data in source domain (from an active spaceborne Lidar sensor CALIOP onboard CALIPSO satellite) contain 25 attributes, while data in target domain (from a passive spectroradiometer sensor VIIRS onboard Suomi-NPP satellite) contain 20 different attributes. CALIOP has better representation capability and sensitivity to aerosol types and cloud phase, while VIIRS has wide swaths and better spatial coverage but has inherent weakness in differentiating atmospheric objects on different vertical levels. To address this mismatch of features across the domains/sensors, we propose a novel end-to-end deep domain adaptation with domain mapping and correlation alignment (DAMA) to align the heterogeneous source and target domains in active and passive satellite remote sensing data. It can learn domain invariant representation from source and target domains by transferring knowledge across these domains, and achieve additional performance improvement by incorporating weak label information into the model (DAMA-WL). Our experiments on a collocated CALIOP and VIIRS dataset show that DAMA and DAMA-WL can achieve higher classification accuracy in predicting cloud types.

domain adaptation↗