SEARCH · Search NASA

Results for “interaction network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Including Physics-Informed Atomization Constraints in Neural Networks for Reactive Chemistry

Machine learning interatomic potentials (MLIPs) have emerged as powerful tools for investigating atomistic systems with high accuracy and a relatively low computational cost. However, a common and unaddressed challenge with many current neural network (NN) MLIP models is their limited ability to accurately predict the relative energies of systems containing isolated or nearly isolated atoms, which appear in various reactive processes. To address this limitation, we present a mathematical technique for modifying any existing atom-centered NN architecture to account for the energies of isolated atoms. The result produces a consistent prediction of the atomization energy (AE) of a system using minimal constraints on the model. Using this technique, we build a model architecture that we call hierarchically interacting particle neural network (HIP-NN)-AE, an AE-constrained version of the HIP-NN, as well as ANI-AE, the AE-constrained version of the accurate NN engine for molecular energies (ANI). Our results demonstrate AE consistency of AE-constrained models, which drastically improves the AE predictions for the models. We compare the AE-constrained approach to unconstrained models as well as models from the literature in other scenarios, such as bond dissociation energies, bond dissociation pathways, and extensibility tests. These results show that the constraints improve the model performance in some of these tasks and do not negatively affect the performance on any tasks. The AE constraint approach thus offers a robust solution to the challenges posed by isolated atoms in energy prediction tasks.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2024

Effective many-body interactions in reduced-dimensionality spaces through neural network models

Accurately describing properties of challenging problems in physical sciences often requires complex mathematical models that are unmanageable to tackle head on. Therefore, developing reduced-dimensionality representations that encapsulate complex correlation effects in many-body systems is crucial to advance the understanding of these complicated problems. However, a numerical evaluation of these predictive models can still be associated with a significant computational overhead. To address this challenge, in this paper we discuss a combined framework that integrates recent advances in the development of active-space representations of coupled cluster (CC) downfolded Hamiltonians with neural network approaches. The primary objective of this effort is to train neural networks to eliminate the computationally expensive steps required for evaluating hundreds or thousands of Hugenholtz diagrams, which correspond to multidimensional tensor contractions necessary for evaluating a many-body form of downfolded effective Hamiltonians. Using small molecular systems (the H 2 O and HF molecules) as examples, we demonstrate that training neural networks employing effective Hamiltonians for a few nuclear geometries of molecules can accurately interpolate or extrapolate their forms to other geometrical configurations characterized by different intensities of correlation effects. We also discuss differences between effective interactions that define CC downfolded Hamiltonians with those of bare Hamiltonians defined by Coulomb interactions in the active spaces. Published by the American Physical Society 2024

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

A dynamic protein interactome drives energy conservation and electron flux in Thermococcus kodakarensis

ABSTRACT Life is supported by energy gains fueled by catabolism of a wide range of substrates, each reliant on the selective partitioning of electrons through redox ( red uction and ox idation) reactions. Electron flux through tunable and regulated protein interactions provides dynamic routes for energy conservation, but how electron flux is regulated in vivo , particularly for archaeal metabolisms that support rapid growth at the thermodynamic limits of life, is poorly understood. Identification of bona fide in vivo protein assemblies and how such assemblies dictate the totality of electron flux is critical to our understanding of the regulation imposed on metabolism, energy production, and energy conservation. Here, 25 key proteins in central metabolic redox pathways in the model, genetically accessible, hyperthermophilic archaeon Thermococcus kodakarensis , were purified to reveal an extensive, dynamic, and tightly interconnected network of protein interactions that responds to environmental cues (such as the availability of various reductive sinks) to direct electron flux to maximize energetic gains. Interactions connecting disparate functions suggest many catabolic and anabolic activities occur in spatial proximity in vivo , and while protein complexes have been historically defined under optimal conditions, many of these complexes appear to maintain alternative partnerships in changing conditions. The totality of the results obtained redefines our understanding of in vivo assemblies driving ancient metabolic strategies supporting the growth of modern Archaea. IMPORTANCE Given the potential for rational genetic manipulations of biofuel- and biotech-promising archaea to yield transformative results for major markets, it is a priority to define how the metabolisms of such species are controlled, at least in part, by in vivo protein assemblies, and from such, define routes of energy flux that can be most efficiently altered toward biofuel or biotechnological gains. Proteinaceous electron carriers (PECs, such as ferredoxins) offer the potential for specific protein–protein interactions to coordinate selective reductive flow. Employing the model, genetically accessible, hyperthermophilic archaeon, Thermococcus kodakarensis , we establish the metabolic protein interactome of 25 key redox proteins, revealing that each redox active protein has a dynamic partnership profile, suggesting catabolic and anabolic activities may occur in concert and in temporal and spatial proximity in vivo . These results reveal critical importance in evaluating the newly identified partnerships and their role and utility in providing regulated redox flux in T. kodakarensis .

Williams, Sere A. (ORCID:0000000235509590)↗

NASA NTRS2020

NeMO-Net – The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment

We present NeMO-Net, the Srst open-source deep convolutional neural network (CNN) and interactive learning and training software aimed at assessing the present and past dynamics of coral reef ecosystems through habitat mapping into 10 biological and physical classes. Shallow marine systems, particularly coral reefs, are under significant pressures due to climate change, ocean acidification, and other anthropogenic pressures, leading to rapid, often devastating changes, in these fragile and diverse ecosystems. Historically, remote sensing of shallow marine habitats has been limited to meter-scale imagery due to the optical effects of ocean wave distortion, refraction, and optical attenuation. NeMO-Net combines 3D cm-scale distortion-free imagery captured using NASA FluidCam and Fluid lensing remote sensing technology with low resolution airborne and spaceborne datasets of varying spatial resolutions, spectral spaces, calibrations, and temporal cadence in a supercomputer-based machine learning framework. NeMO-Net augments and improves the benthic habitat classification accuracy of low-resolution datasets across large geographic ad temporal scales using high-resolution training data from FluidCam.NeMO-Net uses fully convolutional networks based upon ResNet and ReSneNet to perform semantic segmentation of remote sensing imagery of shallow marine systems captured by drones, aircraft, and satellites, including WorldView and Sentinel. Deep Laplacian Pyramid Super-Resolution Networks (LapSRN) alongside Domain Adversarial Neural Networks (DANNs) are used to reconstruct high resolution information from low resolution imagery, and to recognize domain-invariant features across datasets from multiple platforms to achieve high classification accuracies, overcoming inter-sensor spatial, spectral and temporal variations.Finally, we share our online active learning and citizen science platform, which allows users to provide interactive training data for NeMO-Net in 2D and 3D, integrated within a deep learning framework. We present results from the PaciSc Islands including Fiji, Guam and Peros Banhos 1 1 2 1 3 1 where 24-class classification accuracy exceeds 91%.

Chirayath, Ved↗

DOE OSTI2025

Breaking the curse of dimensionality: Solving configurational integrals for crystalline solids by tensor networks

Accurately evaluating configurational integrals for dense solids remains a central and difficult challenge in the statistical mechanics of condensed systems. Here, we present a tensor network approach that reformulates the high-dimensional configurational integral for identical-particle crystals into a sequence of computationally efficient summations. We represent the integrand as a high-dimensional tensor and apply tensor-train (TT) decomposition together with a custom TT-cross interpolation. This approach circumvents the need to explicitly construct the full tensor. We introduce tailored rank-1 and rank-2 schemes optimized for sharply peaked Boltzmann probability densities, typical for identical-particle crystals. When applied to the calculation of internal energy and pressure-temperature curves for crystalline Cu and Ar at high (GPa) pressures, as well as the alpha-to-beta phase transition diagram of Sn, our method accurately reproduces molecular dynamics simulation results using tight-binding, machine learning, hierarchical interacting particle–neural network, and modified embedded atom method potentials,all within seconds of computation time.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NASA NTRS2017

NeMO-Net: The Neural Multi-Modal Observation and Training Network for Global Coral Reef Assessment

In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8 percent error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets. We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Pythons extensive libraries for machine learning, as well as extending integration to GPU and High-End Computing Capability (HECC) on the Pleiades supercomputing cluster, located at NASA Ames. The project is being supported by NASAs Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST-16) Program.

NeMO-Net↗

DOE OSTI2025

Coupled cluster and dislocation dynamics modeling of microstructure evolution in irradiated materials

We develop here a coupled cluster and dislocation dynamics framework to study the microstructure evolution of irradiated materials. The framework not only accounts for the three dimensional diffusion of radiation-generated clusters, but also their interaction with dislocation networks and the resultant climb motion of discrete dislocations within finite crystals. The framework is solved with a superposition solution scheme, and is applied to investigate the evolution of the irradiation-induced dislocation loops in zirconium (Zr), considering the effects of various bias factors including the diffusion anisotropy difference (DAD) of interstitials and interstitial clusters, the dislocation bias of defects to discrete dislocation segments, and the production bias of defects from the radiation cascade. We find that the DAD is the most critical factor influencing the kinetics of the loop evolution in Zr, while the recombination/interaction of mobile defects can induce a strong spatial dependence of the loop evolution together with the DAD. Here, the method is also adopted to study the evolution of interstitial $\langle$a$\rangle$ and vacancy $\langle$c$\rangle$ dislocation loop ensembles consistent with the microstructure observed during irradiation-induced growth of Zr. Our findings not only reveal the spatial dependence of the size and ellipticity of the dislocation loops, but also suggest a limit on the anisotropy factor of interstitials to reproduce the co-growth of $\langle$a$\rangle$ and $\langle$c$\rangle$ loops in zirconium, in good agreement with experimental observations and other simulation results.

Bias factors↗

DOE OSTI2025

Supramolecular Support of Cuprophilic Network Bonding in 2-D Copper n -Alkanethiolates

Here, the development of heterogeneous materials, catalysts, and semiconductors is often reliant on precise control of self-assembly and crystal packing. Many new materials are initially synthesized as microcrystalline powders, making them incompatible with typical methods of structure determination, such as single-crystal X-ray diffraction. This resultant lack of structural information has made thorough investigation into the effect of metal substitution on crystal structure in metal-organic chalcogenolates (MOChas) challenging. Here, we use small molecule serial femtosecond crystallography (smSFX) to present the structures of four copper n-alkanethiolates: CuSC4, CuSC5, CuSC6, and CuSC7. Divergent patterns of alkyl chain packing are identified from microcrystalline powders via smSFX. An odd-even effect in crystal packing has been identified and attributed to different orientations of symmetry elements in the even- and odd-numbered chains. This results in minute changes in the azimuthal organization of the even-numbered chains and the network of cuprophilic interactions. Additionally, we present a synthesis of crystalline gold n-alkanethiolates to provide the first comparison between three d 10 coinage metals (Cu, Ag, and Au) and their resultant n-alkanethiolates.

Willson, Maggie C. [Univ. of Connecticut, Storrs, ↗

DOE OSTI2026

Investigation of onshore wind farm wake recovery with in situ aircraft measurements during AWAKEN

The share of wind power for electricity supply is increasing worldwide. This highly variable resource requires the improved prediction of power output for network stability. The interaction between wind farm wakes and the atmospheric boundary layer (ABL) introduces uncertainties in power production that warrant detailed investigation. The flow downwind of wind farms is characterized by a reduction in wind speed and an increase in turbulence, which both vary with atmospheric conditions. During the American WAKE experimeNt (AWAKEN), the Technische Universität Braunschweig conducted measurement flights with a research aircraft upwind and downwind of onshore wind farms in the southern Great Plains in Oklahoma in the USA. This study utilizes data from 20 flights conducted at approximately hub height in September 2023 to investigate the wind field variability downwind of the wind farms and vertical profiles to observe atmospheric stratification. The flights were aligned perpendicular to the main wind direction downwind of the King Plains and Armadillo Flats wind farms. Additionally, lidar data from both upwind and downwind ground-based measurement sites and sonic anemometer data were used for comprehensive analysis. Results indicate that under stable ABL conditions, the wake persists at greater downwind distances with a higher velocity deficit in the wake relative to the undisturbed flow compared to unstable stratification. In homogeneous terrain under stable conditions, wake recovery to 95 % occurs between a distance of 4.5 and 9 km downwind of the wind farm. In the semi-complex terrain characterized by shallow hills, slopes, and valleys, the wake exhibits a higher velocity deficit compared to homogeneous terrain, while in some cases the wake was amplified by the terrain resulting in higher velocity deficit 10 km downwind of the wind farm compared to the measurements closer to the wind farm. The turbulent kinetic energy (TKE) and “TKE difference” was found to be a valuable measure in understanding wakes in a semi-complex terrain, showing a clear wake recovery and formation depending on the stratification of the ABL.

17 WIND ENERGY↗

NASA NTRS2000

The Evolution of Networks in Extreme and Isolated Environment

This article reports on the evolution of network structure as it relates to the formal and informal aspects of social roles in well bounded, isolated groups. Research was conducted at the Amundsen-Scott South Pole Station over a 3-year period. Data was collected on crewmembers' networks of social interaction and personal advice over each of the 8.5-month winters during a time of complete isolation. In addition, data was collected on informal social role structure (e.g., instrumental leadership, expressive leadership). It was hypothesized that development and maintenance of a cohesive group structure was related to the presence of and group consensus on various informal social roles. The study found that core-periphery structures (i.e., reflecting cohesion) in winter-over groups were associated with the presence of critically important informal social roles (e.g., expressive leadership) and high group consensus on such informal roles. On the other hand, the evolution of clique structures (i.e., lack of cohesion) were associated with the absence of critical roles and a lack of consensus on these roles, particularly the critically important role of instrumental leader.

Johnson, Jeffrey C.↗

NASA NTRS1997

Early Evolution of Earth's Geochemical Cycle and Biosphere: Implications for Mars Exobiology

Carbon (C) has played multiple key roles for life and its environment. C has formed organics, greenhouse gases, aquatic pH buffers, redox buffers, and magmatic constituents affecting plutonism and volcanism. These roles interacted across a network of reservoirs and processes known as the biogeochemical C cycle. Changes in the cycle over geologic time were driven by increasing solar luminosity, declining planetary heat flow, and continental and biological evolution. The early Archean C cycle was dominated by hydrothermal alteration of crustal rocks and by thermal emanations of CO2 and reduced species (eg., H2, Fe(2+) and sulfides). Bioorganic synthesis was achieved by nonphotosynthetic CO2-fixing bacteria (chemoautotrophs) and, possibly, bacteria (organotrophs) utilizing any available nonbiological organic C. Responding both to abundant solar energy and to a longterm decline in thermal sources of chemical energy and reducing power, the blaspheme first developed anoxygenic photosynthesis, then, ultimately, oxygenic photosynthesis. O2-photosynthesis played a central role in transforming the ancient environment and blaspheme to the modem world. The geochemical C cycles of early Earth and Mars were quite similar. The principal differences between the modem C cycles of these planets arose during the later evolution of their heat flows, crusts, atmospheres and, perhaps, their blasphemes.

DesMarais, David J.↗

NASA NTRS2003

Interactions of Hydrazine and Blowby Gases

The interactions between hydrazine and blowby gases from pyrovalves was explored in this research project. Investigating the decomposition chemistry of hydrazine through detailed chemical kinetic modeling is a project started last summer while participating in the Summer Faculty Fellowship program. During the 1999-2000 academic year, the chemical kinetic mechanism for hydrazine decomposition developed while a SFF at NASA's White Sands Test Facility was further revised and validated against the limited experimental data in the literature. This mechanism was then used in assessing the effects of blowby gas species on hydrazine decomposition. The combustion products introduced into the fuel line by pyrovalve actuation consist primarily of hydrogen gas. Hydrogen is also a product of the decomposition of hydrazine. Additional gaseous chemical species are introduced into the fuel, as well as metals and metal salts that deposit onto the walls of the fuel line. The deposition process is undoubtedly very rapid, and exothermic. Therefore, the major focus of this summer's work was examining the effects of hydrogen presence on hydrazine decomposition, with some representative calculations including the remaining gaseous species found to exist in blowby gases. Since hydrogen is a product of hydrazine decomposition, all reactions necessary to evaluate its effect on hydrazine decomposition chemistry were in the original mechanism developed. However, the mechanism needed to be considerably expanded to include the reactions of the other gaseous blowby species with hydrazine, all the intermediate species formed in its decomposition, and each other. The expanded mechanism consists of 70 species interacting via a network of 452 reactions. Calculations with molecular hydrogen introduced into hydrazine gas in an inert bath gas indicate that H2 presence as an initial reactant in substantial amounts can dramatically impact the decomposition process for hydrazine. The other gaseous blowby species (CO, CO2, H2O, CH4, O2, and N2) were found to have little effect compared to the inclusion of hydrogen itself as an initial reagent. This result is undoubtedly due, in part, to the fact that the blowby gas used in these calculations consisted of 94.6% H2. A more rigorous examination of the behavior of the full detailed mechanism under a variety of conditions was not performed.

Meagher, Nancy E.↗

NASA NTRS2004

Biogeochemical Cycles of Carbon and Sulfur on Early Earth (and on Mars?)

The physical and chemical interactions between the atmosphere, hydrosphere, geosphere and biosphere can be examined for elements such as carbon (C) and sulfur (S) that have played central roles for both life and the environment. The compounds of C are highly important, not only as organic matter, but also as atmospheric greenhouse gases, pH buffers in seawater, oxidation-reduction buffers virtually everywhere, and key magmatic constituents affecting plutonism and volcanism. S assumes important roles as an oxidation-reduction partner with C and Fe in biological systems, as a key constituent in magmas and volcanic gases, and as a major influence upon pH in certain environments. These multiple roles of C and S interact across a network of elemental reservoirs interconnected by physical, chemical and biological processes. These networks are termed biogeochemical C and S cycles.

DesMarais, D. J.↗

NASA NTRS2006

Proton conducting membranes for high temperature fuel cells with solid state water free membranes

A water free, proton conducting membrane for use in a fuel cell is fabricated as a highly conducting sheet of converted solid state organic amine salt, such as converted acid salt of triethylenediamine with two quaternized tertiary nitrogen atoms, combined with a nanoparticulate oxide and a stable binder combined with the converted solid state organic amine salt to form a polymeric electrolyte membrane. In one embodiment the membrane is derived from triethylenediamine sulfate, hydrogen phosphate or trifiate, an oxoanion with at least one ionizable hydrogen, organic tertiary amine bisulfate, polymeric quaternized amine bisulfate or phosphate, or polymeric organic compounds with quaternizable nitrogen combined with Nafion to form an intimate network with ionic interactions.

Narayanan, Sekharipuram R.↗

NASA NTRS2008

The Citizens and Remote Sensing Observational Network (CARSON) Guide: Merging NASA Remote Sensing Data with Local Environmental Awareness

"Citizen science" generally refers to observatoinal research and data collection conducted by non-professionals, commonly as volunteers. In the environmental science field, citizen scientists may be involved with local nad regional issues such as bird and wildlife populations, weather, urban sprawl, natural hazards, wetlands, lakes and rivers, estuaries, and a spectrum of public health concerns. Some citizen scientists may be primarily motivated by the intellectual challenge of scientific observations. Citizen scientists may now examine and utilize remote-sensing data related to their particular topics of interest with the easy-to-use NASA Web-based tools Giovanni and NEO, which allow exploration and investigation of a wide variety of Earth remote sensing data sets. The CARSON (Citizens and Remote Sensing Observational Network) Guide will be an online resource consisting of chapters each demonstrating how to utilize Giovanni and NEO to access and analyze specific remote-sensing data. Integrated in each chapter will be descriptions of methods that citizen scientists can employ to collect, monitor, analyze, and share data related to the chapter topic which pertain to environmental and ecological conditions in their local region. A workshop held in August 2008 initiated the development of prototype chapters on water quality, air quality, and precipitation. These will be the initial chapters in the first release of the CARSON Guide, which will be used in a pilot project at the Maryland Science Center in spring 2009. The goal of the CARSON Guide is to augment and enhance citizen scientist environmental research with NASA satellite data by creating a participatory network consisting of motivated individuals, environmental groups and organizations, and science-focused institutions such as museuma and nature centers. Members of the network could potentially interact with government programs, academic research projects, and not-for-profit organizations focused on environmental issues.

Acker, James↗

NASA NTRS2011

A Team Mental Model Perspective of Pre-Quantitative Risk

This study was conducted to better understand how teams conceptualize risk before it can be quantified, and the processes by which a team forms a shared mental model of this pre-quantitative risk. Using an extreme case, this study analyzes seven months of team meeting transcripts, covering the entire lifetime of the team. Through an analysis of team discussions, a rich and varied structural model of risk emerges that goes significantly beyond classical representations of risk as the product of a negative consequence and a probability. In addition to those two fundamental components, the team conceptualization includes the ability to influence outcomes and probabilities, networks of goals, interaction effects, and qualitative judgments about the acceptability of risk, all affected by associated uncertainties. In moving from individual to team mental models, team members employ a number of strategies to gain group recognition of risks and to resolve or accept differences.

Cooper, Lynne P.↗

NASA NTRS2017

NeMO-Net The Neural Multi-Modal Observation Training Network for Global Coral Reef Assessment

In the past decade, coral reefs worldwide have experienced unprecedented stresses due to climate change, ocean acidification, and anthropomorphic pressures, instigating massive bleaching and die-off of these fragile and diverse ecosystems. Furthermore, remote sensing of these shallow marine habitats is hindered by ocean wave distortion, refraction and optical attenuation, leading invariably to data products that are often of low resolution and signal-to-noise (SNR) ratio. However, recent advances in UAV and Fluid Lensing technology have allowed us to capture multispectral 3D imagery of these systems at sub-cm scales from above the water surface, giving us an unprecedented view of their growth and decay. Exploiting the fine-scaled features of these datasets, machine learning methods such as MAP, PCA, and SVM can not only accurately classify the living cover and morphology of these reef systems (below 8 error), but are also able to map the spectral space between airborne and satellite imagery, augmenting and improving the classification accuracy of previously low-resolution datasets.We are currently implementing NeMO-Net, the first open-source deep convolutional neural network (CNN) and interactive active learning and training software to accurately assess the present and past dynamics of coral reef ecosystems through determination of percent living cover and morphology. NeMO-Net will be built upon the QGIS platform to ingest UAV, airborne and satellite datasets from various sources and sensor capabilities, and through data-fusion determine the coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. To achieve this, we will exploit virtual data augmentation, the use of semi-supervised learning, and active learning through a tablet platform allowing for users to manually train uncertain or difficult to classify datasets. The project will make use of Pythons extensive libraries for machine learning, as well as extending integration to GPU and High-End Computing Capability (HECC) on the Pleiades supercomputing cluster, located at NASA Ames. The project is being supported by NASAs Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST-16) Program.

Remote Sensin↗

NASA NTRS2018

NeMO-Net & Fluid Lensing: The Neural Multi-Modal Observation & Training Network for Global Coral Reef Assessment Using Fluid Lensing Augmentation of NASA EOS Data

We present preliminary results from NASA NeMO-Net, the first neural multi-modal observation and training network for global coral reef assessment. NeMO-Net is an open-source deep convolutional neural network (CNN) and interactive active learning training software in development which will assess the present and past dynamics of coral reef ecosystems. NeMO-Net exploits active learning and data fusion of mm-scale remotely sensed 3D images of coral reefs captured using fluid lensing with the NASA FluidCam instrument, presently the highest-resolution remote sensing benthic imaging technology capable of removing ocean wave distortion, as well as hyperspectral airborne remote sensing data from the ongoing NASA CORAL mission and lower-resolution satellite data to determine coral reef ecosystem makeup globally at unprecedented spatial and temporal scales. Aquatic ecosystems, particularly coral reefs, remain quantitatively misrepresented by low-resolution remote sensing as a result of refractive distortion from ocean waves, optical attenuation, and remoteness. Machine learning classification of coral reefs using FluidCam mm-scale 3D data show that present satellite and airborne remote sensing techniques poorly characterize coral reef percent living cover, morphology type, and species breakdown at the mm, cm, and meter scales. Indeed, current global assessments of coral reef cover and morphology classification based on km-scale satellite data alone can suffer from segmentation errors greater than 40%, capable of change detection only on yearly temporal scales and decameter spatial scales, significantly hindering our understanding of patterns and processes in marine biodiversity at a time when these ecosystems are experiencing unprecedented anthropogenic pressures, ocean acidification, and sea surface temperature rise. NeMO-Net leverages our augmented machine learning algorithm that demonstrates data fusion of regional FluidCam (mm, cm-scale) airborne remote sensing with global low-resolution (m, km-scale) airborne and spaceborne imagery to reduce classification errors up to 80% over regional scales. Such technologies can substantially enhance our ability to assess coral reef ecosystems dynamics.

satellite data↗