SEARCH · Search NASA
Results for “hyperspectral data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
CHESS 2025: Spectrometer orthorectified at-sensor radiance from NEON AOP imaging spectroscopy surveys
This dataset provides Level 1 (L1) orthorectified at-sensor radiance derived from measurements collected by the Imaging Spectrometer-1 (NIS-1) onboard the NEON (National Ecological Observatory Network) Airborne Observation Platform (AOP) for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). NIS-1 captures light reflected from the Earth’s surface in 426 discrete wavelength bands as raw digital numbers (DNs; Level 0). These data are then calibrated to physical units (uW/cm²·sr·nm) following the processing steps described in the NEON Imaging Spectrometer Level 1B Calibrated Radiance Algorithm Theoretical Basis Document (ATBD; Gallery 2022). The data delivered here are the primary inputs for the surface reflectance product in “Custom surface reflectance, shade masks, and equivalent water thickness maps for the Colorado Headwaters Ecological Spectroscopy Study” (Carroll et al. 2026). For intertemporal comparison, the radiance data here are most directly relatable to the v2 radiance data in “NEON AOP Imaging Spectroscopy Survey of Upper East River Colorado Watersheds: Raw-Space Radiance and Observational Variable Dataset” (Goulden et al. 2018), to which the same processing methodology was applied. Together, the radiance and reflectance data enable users to exploit the unique reflection signatures of different surface objects for land cover classification, foliar trait mapping, plant vigor assessment, water content estimation, trace-element identification, and other scientific applications. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. Within each domain, data are delivered by flightline as orthorectified and calibrated hyperspectral rasters in Hierarchical Data Format version 5 (HDF5) format, with radiance values provided in uW/cm²·sr·nm on a fixed, uniform Universal Transverse Mercator (UTM) grid at 1 meter spatial resolution. The radiance rasters include all 426 NIS-1 spectral bands, along with associated quality-assurance (QA) and diagnostic and ancillary layers needed for atmospheric correction workflows. Orthorectified radiance is produced from pushbroom spectrometer observations by applying NEON’s radiometric calibration (including bad pixel masking, dark subtract, dark pedestal shift correction, electronic panel ghost correction, grating ghost correction, deblur correction and flat-fielding) and spectral calibration (using spectral response function band centers and full-width at half-maximum intensity), followed by geolocation and regridding to the fixed grid. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.
One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery
To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.
Carbon–Nutrient Economy of the Rhizosphere: Improving Biogeochemical Prediction and Scaling Feedbacks from Ecosystem to Regional Scales
Our project has advanced the science of plant-soil-microbial dynamics across these areas: i) nutrient cycling and plant uptake; ii) root exudation and priming; and, iii) mycorrhizal dynamics. Our project has accomplished 5 main developments: 1) Incorporation of phosphorus cycling into the Fixation & Uptake of Nutrients (FUN 3.0) model. 2) Coupling of FUN 3.0 into the E3SM Land Model (ELM). 3) Data collection across a large mycorrhizal gradient in the US, as well data in the tropics, to parameterize, test, and validate the model. 4)Scaling up mycorrhizal association measurements across landscapes using airborne hyperspectral remote sensing data. 5) Evaluation of global carbon and nutrient cycle impacts in the Community Land Model (CLM5.0) from a suite of new global mycorrhizal association maps. Over 25 publications resulted from this project, with more continuing past the project funded lifetime. Paper highlights from most of these publications have already been submitted to the DOE paper submission online system. These publications include journals such as Science and PNAS, as well as top disciplinary journals from the Nature journals, Global Change Biology, New Phytologist, and Ecology Letters, for example. Our project also contributed to improving the process representation, capabilities, and accuracy of the DOE ELM. Overall, this project significantly advanced the science of belowground plant-soil-microbial interactions as well as technical capabilities from remote sensing to modeling.
Hyperspectral remote sensing-based plant community map for region around NGEE-Arctic intensive research watersheds at Seward Peninsula, Alaska, 2017-2019
Using airborne hyperspectral remote sensing data from NASA Airborne Visible-Infrared Imaging Spectrometer- Next Generation (AVIRIS-NG) platforms in a region near NGEE-Arctic intensive watersheds at Seward peninsula of Alaska, high resolution (5m) maps of plant community distribution were developed and included in this data collected. AVIRIS-NG data collected over 2017-2019 period were used to develop deep neural networks, trained using vegetation plot observations collected at NGEE-Arctic watersheds at Kougarok, Council and Teller. A hierarchical vegetation classification scheme consisting of six classes at Level I, and 16 classes at Level II contained in two .txt files were used to developed the plant community maps for the region. Two geospatial raster data files (.tif) at both thematic levels are shared in this data collection. Data files in this collection use Alaska Albers Equal Area projection. Readme files available in three formats (*.html, *.md, *.pdf) and one *.png visualization map.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments
In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.
Optical recognition of constructs using hyperspectral imaging and detection (ORCHID)
Abstract Challenges to deep sample imaging have necessitated the development of special techniques such as spatially offset optical spectroscopy to collect signals that have travelled through several layers of tissue. However, these techniques provide only spectral information in one dimension (i.e., depth). Here, we describe a general and practical method, referred to as Optical Recognition of Constructs Using Hyperspectral Imaging and Detection (ORCHID). The sensing strategy integrates (1) the spatial offset detection concept by computationally binning 2D optical data associated with digital offsets based on selected radial pixel distances from the excitation source; (2) hyperspectral imaging using tunable filter; and (3) digital image binding and collation. ORCHID is a versatile modality that is designed to collect optical signals deep inside samples across three spatial (X, Y, Z) as well as spectral dimensions. The ORCHID method is applicable to various optical techniques that exhibit narrow-band structures, from Raman scattering to quantum dot luminescence. Samples containing surface-enhanced Raman scattering (SERS)-active gold nanostar probes and quantum dots embedded in gel were used to show a proof of principle for the ORCHID concept. The resulting hyperspectral data cube is shown to spatially locate target emitting nanoparticle volumes and provide spectral information for in-depth 3D imaging.
Leaf traits and canopy structure together explain canopy functional diversity: an airborne remote sensing approach
Plant functional diversity is strongly connected to photosynthetic carbon assimilation in terrestrial ecosystems. However, many of the plant functional traits that regulate photosynthetic capacity, including foliar nitrogen concentration and leaf mass per area, vary significantly between and within plant functional types and vertically through forest canopies, resulting in considerable landscape-scale heterogeneity in three dimensions. Hyperspectral imagery has been used extensively to quantify functional traits across a range of ecosystems but is generally limited to providing information for top-of-canopy leaves only. On the other hand, lidar data can be used to retrieve the vertical structure of forest canopies. Because these data are rarely collected at the same time, there are unanswered questions about the effect of forest structure on the 3-D spatial patterns of functional traits across ecosystems. In the United States, the National Ecological Observatory Network's Airborne Observation Platform (NEON AOP) provides an opportunity to address this structure-function relationship by collecting lidar and hyperspectral data together across a variety of ecoregions. With a fusion of hyperspectral and lidar data from the NEON AOP and field-collected foliar trait data, we assessed the impacts of forest structure on spatial patterns of N. In addition, we examine the influence of abiotic gradients and management regimes on top of canopy %N and total canopy N (i.e. the total amount of N (g/m 2 ) within a forest canopy) at a NEON site consisting of a mosaic of open longleaf pine and dense broadleaf deciduous forests. Here, our resulting maps suggest that in contrast with top-of-canopy values, total canopy N variation is dampened across this landscape resulting in relatively homogeneous spatial patterns. At the same time, we found that leaf functional diversity and canopy structural diversity showed distinct dendritic patterns related to the spatial distribution of plant functional types.
Towards mapping biodiversity from above: Can fusing lidar and hyperspectral remote sensing predict taxonomic, functional, and phylogenetic tree diversity in temperate forests?
Abstract Aim Rapid global change is impacting the diversity of tree species and essential ecosystem functions and services of forests. It is therefore critical to understand and predict how the diversity of tree species is spatially distributed within and among forest biomes. Satellite remote sensing platforms have been used for decades to map forest structure and function but are limited in their capacity to monitor change by their relatively coarse spatial resolution and the complexity of scales at which different dimensions of biodiversity are observed in the field. Recently, airborne remote sensing platforms making use of passive high spectral resolution (i.e., hyperspectral) and active lidar data have been operationalized, providing an opportunity to disentangle how biodiversity patterns vary across space and time from field observations to larger scales. Most studies to date have focused on single sites and/or one sensor type; here we ask how multiple sensor types from the National Ecological Observatory Network’s Airborne Observation Platform (NEON AOP) perform across multiple sites in a single biome at the NEON field plot scale (i.e., 40 m × 40 m). Location Eastern USA. Time period 2017–2018. Taxa studied Trees. Methods With a fusion of hyperspectral and lidar data from the NEON AOP, we assess the ability of high resolution remotely sensed metrics to measure biodiversity variation across eastern US temperate forests. We examine how taxonomic, functional, and phylogenetic measures of alpha diversity vary spatially and assess to what degree remotely sensed metrics correlate with in situ biodiversity metrics. Results Models using estimates of forest function, canopy structure, and topographic diversity performed better than models containing each category alone. Our results show that canopy structural diversity, and not just spectral reflectance, is critical to predicting biodiversity. Main conclusions We found that an approach that jointly leverages spectral properties related to leaf and canopy functional traits and forest health, lidar derived estimates of forest structure, fine‐resolution topographic diversity, and careful consideration of biogeographical differences within and among biomes is needed to accurately map biodiversity variation from above.
A Multi-Sensor Unoccupied Aerial System Improves Characterization of Vegetation Composition and Canopy Properties in the Arctic Tundra
Changes in vegetation distribution, structure, and function can modify the canopy properties of terrestrial ecosystems, with potential consequences for regional and global climate feedbacks. In the Arctic, climate is warming twice as fast as compared to the global average (known as ‘Arctic amplification’), likely having stronger impacts on arctic tundra vegetation. In order to quantify these changes and assess their impacts on ecosystem structure and function, methods are needed to accurately characterize the canopy properties of tundra vegetation types. However, commonly used ground-based measurements are limited in spatial and temporal coverage, and differentiating low-lying tundra plant species is challenging with coarse-resolution satellite remote sensing. The collection and processing of multi-sensor data from unoccupied aerial systems (UASs) has the potential to fill the gap between ground-based and satellite observations. To address the critical need for such data in the Arctic, we developed a cost-effective multi-sensor UAS (the ‘Osprey’) using off-the-shelf instrumentation. The Osprey simultaneously produces high-resolution optical, thermal, and structural images, as well as collecting point-based hyperspectral measurements, over vegetation canopies. In this paper, we describe the setup and deployment of the Osprey system in the Arctic to a tundra study site located in the Seward Peninsula, Alaska. We present a case study demonstrating the processing and application of Osprey data products for characterizing the key biophysical properties of tundra vegetation canopies. In this study, plant functional types (PFTs) representative of arctic tundra ecosystems were mapped with an overall accuracy of 87.4%. The Osprey image products identified significant differences in canopy-scale greenness, canopy height, and surface temperature among PFTs, with deciduous low to tall shrubs having the lowest canopy temperatures while non-vascular lichens had the warmest. The analysis of our hyperspectral data showed that variation in the fractional cover of deciduous low to tall shrubs was effectively characterized by Osprey reflectance measurements across the range of visible to near-infrared wavelengths. Therefore, the development and deployment of the Osprey UAS, as a state-of-the-art methodology, has the potential to be widely used for characterizing tundra vegetation composition and canopy properties to improve our understanding of ecosystem dynamics in the Arctic, and to address scale issues between ground-based and airborne/satellite observations.
Detection of the Metabolic Response to Drought Stress Using Hyperspectral Reflectance
Drought is the most important limitation on crop yield. Understanding and detecting drought stress in crops is vital for improving water use efficiency through effective breeding and management. Leaf reflectance spectroscopy offers a rapid, non-destructive alternative to traditional techniques for measuring plant traits involved in a drought response. We measured drought stress in six glasshouse-grown agronomic species using physiological, biochemical and spectral data. In contrast to physiological traits, leaf metabolite concentrations revealed drought stress before it was visible to the naked eye. We used full-spectrum leaf reflectance data to predict metabolite concentrations using partial least-squares regression, with validation R2 values of 0.49 to 0.87. We show for the first time that spectroscopy may be used for the quantitative estimation of proline and abscisic acid, demonstrating the first use of hyperspectral data to detect a phytohormone. We used linear discriminant analysis and partial least squares discriminant analysis to differentiate between droughted and watered plants based on measured traits (accuracy: 71%) and raw spectral data (66%). Finally, we validated our glasshouse-developed models in an independent field trial. We demonstrate that spectroscopy can detect drought stress via underlying biochemical changes, before visual differences occur, representing a powerful advance for measuring limitations on yield.
Chlorophyll- a dynamics in the lower Amazon River: insights from in situ and hyperspectral remote sensing using OCI-PACE
Chlorophyll-a concentration (Chla) is a key indicator of phytoplankton biomass and aquatic trophic status. However, satellite-derived Chla in sediment-rich waters, such as those found in the Lower Amazon River, remains challenging. The present study characterizes in situ Chla levels and their relationships with geographic, physical, and biogeochemical parameters in the Lower Amazon. Data collected between 2014 and 2017 across four hydrological seasons included measurements of Chla, remote sensing reflectance, and water quality parameters such as total suspended sediment, conductivity, water surface temperature, dissolved oxygen, pH, dissolved organic carbon and coloured dissolved organic matter. An empirical model was developed to estimate Chla using simulated hyperspectral bands from NASA’s PACE mission, achieving high performance (R 2 = 0.76; RMSE = 0.11 μg·L −1 ). Red bands proved particularly effective for Chla retrieval, while the addition of ultraviolet bands further enhanced model accuracy. The application of the developed model to satellite imagery yielded results consistent with in situ observations for the same hydrologic season. Seasonal variation and geographic location were major factors influencing Chla dynamics. This study provides a novel contribution to Chla estimation in optically complex, highly turbid waters and highlights the potential of the PACE mission to enhance global aquatic ecosystem monitoring. In conclusion, by offering freely available hyperspectral data with high radiometric resolution, PACE represents a significant advancement in the realm of remote sensing of aquatic environments.
Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators
Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.
Grass Evolutionary Lineages Can Be Identified Using Hyperspectral Leaf Reflectance
Hyperspectral remote sensing has the potential to map numerous attributes of the Earth’s surface, including spatial patterns of biological diversity. Grasslands are one of the largest biomes on Earth. Accurate mapping of grassland biodiversity relies on spectral discrimination of endmembers of species or plant functional types. We focused on spectral separation of grass lineages that dominate global grassy biomes: Andropogoneae (C 4 ), Chloridoideae (C 4 ), and Pooideae (C 3 ). We examined leaf reflectance spectra (350–2,500 nm) from 43 grass species representing these grass lineages from four representative grassland sites in the Great Plains region of North America. Here, we assessed the utility of leaf reflectance data for classification of grass species into three major lineages and by collection site. Classifications had very high accuracy (94%) that were robust to site differences in species and environment. We also show an information loss using multispectral sensors, that is, classification accuracy of grass lineages using spectral bands provided by current multispectral satellites is much lower (accuracy of 85.2% and 61.3% using Sentinel 2 and Landsat 8 bands, respectively). Our results suggest that hyperspectral data have an exciting potential for mapping grass functional types as informed by phylogeny. Leaf-level hyperspectral separability of grass lineages is consistent with the potential increase in biodiversity and functional information content from the next generation of satellite-based spectrometers.
Airborne hyperspectral imaging of cover crops through radiative transfer process-guided machine learning
Cover cropping between cash crop growing seasons is a multifunctional conservation practice. Timely and accurate monitoring of cover crop traits, notably aboveground biomass and nutrient content, is beneficial to agricultural stakeholders to improve management and understand outcomes. Currently, there is a scarcity of spatially and temporally resolved information for assessing cover crop growth. Remote sensing has a high potential to fill this need, but conventional empirical regression operated with coarse-resolution multispectral data has large uncertainties. Therefore, this study utilized airborne hyperspectral imaging techniques and developed new process-guided machine learning approaches (PGML) for cover crop monitoring. Specifically, we deployed an airborne hyperspectral system covering visible to shortwave-infrared wavelengths (400–2400 nm) to acquire high spatial (0.5 m) and spectral (3–5 nm) resolution reflectance over 23 cover crop fields across Central Illinois in March and April of 2021. Airborne hyperspectral surface reflectance with high spectral and spatial resolution can be well matched with field data to quantify cover crop traits. Furthermore, the PGML models were pre-trained by synthetic data from soil-vegetation radiative transfer modeling (one million records), and then fine-tuned with field data of cover crop biomass and nutrient content. Results show that airborne hyperspectral data with PGML can achieve high accuracy to predict cover crop aboveground biomass (R 2 = 0.72, relative RMSE = 15.16%) and nitrogen content (R 2 = 0.69, relative RMSE = 16.59%) through leave-one-field-out cross-validation. Unlike the pure data-driven approach (e.g., partial least-squares regression), PGML incorporated radiative transfer knowledge and obtained higher predictive performance with fewer field data. Meanwhile, with field data for model fine-tuning, PGML predicted biomass more accurately than the inversion of radiative transfer models. Here we also found that the red edge has a high contribution in quantifying aboveground biomass and nitrogen content, followed by green and shortwave spectra. This study demonstrated the first attempt of utilizing hyperspectral remote sensing to accurately quantify cover crop traits. We highlight the strength of PGML in exploiting sensing data to quantify ecosystem variables to advance agroecosystem monitoring for sustainable agricultural management.
Uncovering multiscale structure-property correlations via active learning in scanning tunneling microscopy
Atomic arrangements and local sub-structures fundamentally influence emergent material functionalities. These structures are conventionally probed using spatially resolved studies and the property correlations are deciphered by a researcher based on sequential explorations, thereby limiting the efficiency and scope. Here we demonstrate a multi-scale Bayesian deep-learning based framework that automatically correlates material structure with its electronic properties using scanning tunneling microscopy (STM) measurements in real-time. Its predictions are used to autonomously direct exploration toward regions of the sample that optimize a given material property. This method is deployed on a low-temperature ultra-high vacuum STM to understand the structure-property relationship in a europium-based semimetal, EuZn 2 As 2 , a promising candidate relevant to magnetism-driven topological phenomena. The framework employs a sparse-sampling approach to efficiently construct the scalar-property space using minimal measurements, about 1–10% of the data required in standard hyperspectral methods. Moreover, we formulate the problem hierarchically across length scales, implementing autonomous workflow to locate mesoscopic and atomic structures that correspond to a target material property. This framework offers the choice to design scalar-property from the spectroscopic data to steer sample exploration. Our findings reveal correlations of the electronic properties unique to surface terminations, local defect density, and point defects.
Randomized Algorithms for Scientific Computing (RASC)
Randomized algorithms have propelled advances in artificial intelligence (AI) and represent a foundational research area in advancing AI for Science. Future advancements in DOE Office of Science priority areas such as climate science, astrophysics, fusion, advanced materials, combustion, and quantum computing all require randomized algorithms for surmounting challenges of complexity, robustness, and scalability. Advances in data collection and numerical simulation have changed the dynamics of scientific research and motivate the need for randomized algorithms. For instance, advances in imaging technologies such as X-ray ptychography, electron microscopy, electron energy loss spectroscopy, or adaptive optics lattice light-sheet microscopy collect hyperspectral imaging and scattering data in terabytes, at breakneck speed enabled by state-of-the-art detectors. The data collection is exceptionally fast compared with its analysis. Likewise, advances in high-performance architectures have made exascale computing a reality and changed the economies of scientific computing in the process. Floating-point operations that create data are essentially free in comparison with data movement. Thus far, most approaches have focused on creating faster hardware. Ironically, this faster hardware has exacerbated the problem by making data still easier to create. Under such an onslaught, scientists often resort to heuristic deterministic sampling schemes (e.g., low-precision arithmetic, sampling every nth element) and sacrifice potentially valuable accuracy. Dramatically better results can be achieved via randomized algorithms, reducing the data size as much as or more than naive deterministic subsampling can achieve, while retaining the high accuracy of computing on the full data set. By randomized algorithms we mean those algorithms that employ some form of randomness in internal algorithmic decisions to accelerate time to solution, increase scalability, or improve reliability. Examples include matrix sketching for solving large-scale least-squares problems (see Figure 1) and stochastic gradient descent for training machine learning models. We are not recommending heuristic methods but rather randomized algorithms that have certificates of correctness and probabilistic guarantees of optimality and near-optimality. Such approaches can be useful beyond acceleration, for example, in understanding how to avoid measure zero worst-case scenarios that plague methods such as QR matrix factorization.
Hyper Spectral Anomaly Detection
Anomaly detection is a common machine learning (ML) task with growing importance in the fields of imaging, quality assurance, and multiple security related disciplines. Anomaly detection is more difficult than traditional machine learning methods due to the inherent unlabeled nature of the datasets. Existing anomaly detection architectures commonly face challenges with explainability, retaining information related to the relational structure of the data, and false positive rates. Hyperspectral Imaging Anomaly Detection (HSI) is a statistical model that employs vertex and edge weighted graphs to preserve the data’s relationships on different topographical scales. The model is able to generalize from anomaly detection in 2D images to novel datasets related to cyber-security. Furthermore, the use of multi-spectral and other filtering methods results in fewer false positives and increases the explainability of model predictions. When applying HSI to cyber-security datasets, we are able to successfully detect malicious activity with a relatively high degree of accuracy.