SEARCH · Search NASA

Results for “multiple input images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

72 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2020

System-Independent X-Ray Characterization

We have developed a method for image reconstruction and analysis of dual-energy X-ray scans that has been demonstrated to yield a physically intuitive characterization of materials (by electron density and effective atomic number) in a system-independent way. Our methodology stands in contrast to common practice of reconstructing images to yield linear attenuation coefficients, which depend strongly on system spectral response. At the core of our method, a technique called dual-energy decomposition is used to generate spectral energy-independent characterizations of the attenuation properties of a material. Inputs to this decomposition include system spectral response estimates and dual-energy X-ray projection data. X-ray cross-section tables are used to convert decomposition results to physical feature estimates (electron density, effective atomic number). Our method currently works best for materials with atomic numbers below 22 (titanium). In prior work for DHS, we demonstrated in a controlled, no-clutter environment that the decomposition technique could be applied to scans of a well-characterized materials on multiple systems with different X-ray spectral responses. In cases where LAC values showed a standard deviation of as much as 20% of mean value, application of our method yielded results with standard deviations as low as 1–3% of mean value.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Universal linear intensity transformations using spatially incoherent diffractive processors

Abstract Under spatially coherent light, a diffractive optical network composed of structured surfaces can be designed to perform any arbitrary complex-valued linear transformation between its input and output fields-of-view (FOVs) if the total number ( N ) of optimizable phase-only diffractive features is ≥~2 N i N o , where N i and N o refer to the number of useful pixels at the input and the output FOVs, respectively. Here we report the design of a spatially incoherent diffractive optical processor that can approximate any arbitrary linear transformation in time-averaged intensity between its input and output FOVs. Under spatially incoherent monochromatic light, the spatially varying intensity point spread function ( H ) of a diffractive network, corresponding to a given, arbitrarily-selected linear intensity transformation, can be written as H ( m , n ; m ′, n ′) = | h ( m , n ; m ′, n ′)| 2 , where h is the spatially coherent point spread function of the same diffractive network, and ( m , n ) and ( m ′, n ′) define the coordinates of the output and input FOVs, respectively. Using numerical simulations and deep learning, supervised through examples of input-output profiles, we demonstrate that a spatially incoherent diffractive network can be trained to all-optically perform any arbitrary linear intensity transformation between its input and output if N ≥ ~2 N i N o . We also report the design of spatially incoherent diffractive networks for linear processing of intensity information at multiple illumination wavelengths, operating simultaneously. Finally, we numerically demonstrate a diffractive network design that performs all-optical classification of handwritten digits under spatially incoherent illumination, achieving a test accuracy of >95%. Spatially incoherent diffractive networks will be broadly useful for designing all-optical visual processors that can work under natural light.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Statistics of Wide Pre-main-sequence Binaries in the Orion OB1 Association

Statistics of low-mass pre-main-sequence binaries in the Orion OB1 association with separations ranging from 0."6 to 20" (220 to 7400 au at 370 pc) are studied using images from the VISTA Orion mini survey and astrometry from Gaia. The input sample based on the CVSO catalog contains 1137 stars of K and M spectral types (masses between 0.3 and 0.9 M ⊙ ), 1021 of which are considered to be association members. There are 135 physical binary companions to these stars with mass ratios above ~0.13. The average companion fraction is 0.09 ± 0.01 over 1.2 decades in separation, slightly less than, but still consistent with, the field. We found a difference between the Ori OB1a and OB1b groups, the latter being richer in binaries by a factor of 1.6 ± 0.3. No overall dependence of the wide-binary frequency on the observed underlying stellar density is found, although in the Ori OB1a off-cloud population, these binaries seem to avoid dense clusters. The multiplicity rates in Ori OB1 and in sparse regions like Taurus differ significantly, hinting that binaries in the field may originate from a mixture of diverse populations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Large Area Detection of Microstructural Defects with Multi-Mode Ultrasonic Signals

Cyclic loading or other stresses can lead to development of cracks and crack growth in mechanical structures, leading to eventual failure. While ultrasound imaging can be used for non-destructive testing of such structures, conventional ultrasound techniques are often limited by crack size, density, and areal coverage. An effective characterization of real-world, large-area structures is required at an early damage stage to prevent catastrophic failure and predict remaining life. In this study, a new nonlinear ultrasonic testing (NUT) method is proposed for large-area monitoring of practical structures with arbitrary complexity by using multiple-mode guided-wave ultrasonic signals. The proposed guided-wave NUT technique requires single-element transducers, simple electronics, and a mixed time-frequency domain signal processing. As a proof-of-concept demonstration, numerical simulations and experiments are performed on an A36 carbon steel beam assembly with previously formed microstructural defects that cause nonlinearities in ultrasonic response. The quadratic dependence of the nonlinear wave excitation on the input ultrasonic signal amplitude is shown by numerical simulations, and such a nonlinear ultrasonic response is experimentally observed in the zone with a high density of microstructural defects.

36 MATERIALS SCIENCE↗

DOE OSTI2022

BioTransformer 3.0 – A Web Server for Accurately Predicting Metabolic Transformation Products

BioTransformer 3.0 is a freely available web server that supports accurate, rapid and comprehensive in silico metabolism prediction. It combines machine learning approaches with a rule-based system to predict small-molecule metabolism in human tissues, the human gut as well as the external environment (soil and water microbiota). Simply stated, BioTransformer takes a molecular structure as input (SMILES or SDF) and outputs an interactively viewable/sortable table of the predicted metabolites or transformation products (SMILES, PNG images) along with the enzymes that are predicted to be responsible for those reactions and richly annotated downloadable files (CSV and JSON). The entire process typically takes a few seconds. Previous versions of BioTransformer focused exclusively on predicting the metabolism of xenobiotics (such as plant natural products, drugs, cosmetics and other synthetic compounds) using a limited number of pre-defined steps and somewhat limited rule-based methods. BioTransformer 3.0, uses much more sophisticated methods and incorporates new databases, new constraints and new prediction modules to not only more accurately predict the metabolic transformation products of exogenous xenobiotics but also the transformation products of endogenous metabolites, such as amino acids, peptides, carbohydrates, organic acids, and lipids. BioTransformer 3.0 can also support customized sequential combinations of these transformations along with multiple iterations to simulate multi-step human and/or environmental biotransformation events. Performance tests indicate that BioTransformer 3.0 is 40-50% more accurate, much less prone to combinatorial “explosions” and far more comprehensive in terms of metabolite coverage/capabilities than previous versions of BioTransformer.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Design of a multichannel photonic crystal dielectric laser accelerator

To be useful for most scientific and medical applications, compact particle accelerators will require much higher average current than enabled by current architectures. For this purpose, we propose a photonic crystal architecture for a dielectric laser accelerator, referred to as a multi-input multi-output silicon accelerator (MIMOSA), that enables simultaneous acceleration of multiple electron beams, increasing the total electron throughput by at least 1 order of magnitude. To achieve this, we show that the photonic crystal must support a mode at the Γ point in reciprocal space, with a normalized frequency equal to the normalized speed of the phase-matched electron. We show that the figure of merit of the MIMOSA can be inferred from the eigenmodes of the corresponding infinitely periodic structure, which provides a powerful approach to design such devices. Additionally, we extend the MIMOSA architecture to electron deflectors and other electron manipulation functionalities. These additional functionalities, combined with the increased electron throughput of these devices, permit all-optical on-chip manipulation of electron beams in a fully integrated architecture compatible with current fabrication technologies, which opens the way to unconventional electron beam shaping, imaging, and radiation generation.

43 PARTICLE ACCELERATORS↗

DOE OSTI2021

Modeling and experimental validation of a W f /W-fabrication by chemical vapor deposition and infiltration

Tungsten (W) has a unique combination of excellent thermal properties, low sputter yield, low hydrogen retention, and acceptable activation. Therefore, W is presently the main candidate for the first wall material in future fusion devices. However, its intrinsic brittleness and its further embrittlement during operation bears the risk of a sudden and catastrophic component failure. As a countermeasure, tungsten fiber-reinforced tungsten (W f /W) with extrinsic toughening is being developed. A possible synthesis route is chemical vapor deposition (CVD) using heated W fabrics as substrate. The challenge is that the growing CVD-W can isolate domains from precursor access leading to strength-reducing pores. To deepen the process understanding and to optimize the CVD parameters, models were developed with COMSOL Multiphysics and validated experimentally. W deposition rate equations as function of the temperature and the partial pressures of the precursors H 2 and WF 6 were experimentally validated in previous work. In the present article, these equations are applied to obtain partial pressures within the CVD reactor. The results are taken as input for transient simulations in the microscale, in which W coatings, growing onto multiple adjacent W fibers, were simulated via mesh deformation and remeshing. The surface-to-surface contact of the W coatings and the corresponding potential pore formation were simulated by implementing sophisticated deposition rate stop conditions. Within the measuring uncertainties of ≃ ±1%, the models are validated successfully by experimental comparison regarding the deposition rate, pore structure, and relative densities ranging from 0.6 to 0.9.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

AICCA: AI-Driven Cloud Classification Atlas

Clouds play an important role in the Earth’s energy budget, and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study describes a new analysis approach that reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique based on a convolutional autoencoder, an artificial intelligence (AI) method good at identifying patterns in spatial data. Our technique combines a rotation-invariant autoencoder and hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Cloud classes are therefore defined based on spectral properties and spatial textures without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua and Terra instruments—198 million patches, each roughly 100 km × 100 km (128 × 128 pixels)—into 42 AI-generated cloud classes, a number determined via a newly-developed stability protocol that we use to maximize richness of information while ensuring stable groupings of patches. AICCA thereby translates 801 TB of satellite images into 54.2 GB of class labels and cloud top and optical properties, a reduction by a factor of 15,000. The 42 AICCA classes produce meaningful spatio-temporal and physical distinctions and capture a greater variety of cloud types than do the nine International Satellite Cloud Climatology Project (ISCCP) categories—for example, multiple textures in the stratocumulus decks along the West coasts of North and South America. We conclude that our methodology has explanatory power, capturing regionally unique cloud classes and providing rich but tractable information for global analysis. AICCA delivers the information from multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Measurement and calibration of non-linear shear terms in galaxy cluster fields

Introduction Galaxy cluster lensing is a powerful tool for measuring the mass of galaxy clusters, but accurate shear measurement and calibration are critical to obtaining reliable results. This study focuses on the measurement and calibration of weak lensing shears to improve mass estimates in cluster lensing. To deal with the problem, we first developed an image simulation pipeline, jedisim, which utilizes galaxy images extracted from the Hubble Space Telescope (HST) Ultra Deep Field (UDF) and the Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey (CANDELS). Methods The simulations represent realistic galaxy distributions and morphologies as input sources. The foreground halo with a Navarro–Frenk–White (NFW) profile is constructed such that the lensing signals of background galaxies can be measured by the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) Science Pipelines. By comparing the measured reduced shear g meas and the true reduced shear g true , we observe non-linearity up to g ≲ 0.6 . We fit polynomials to the data with quadratic correction adequate to g ≲ 0.4 . Meanwhile, we conduct mass estimates using the pzmassfitter code on four different clusters. Results The mass estimate results are significantly improved after applying the shear calibration derived from the present work—from 4.954 ± 0.504 × 1 0 14 M ⊙ to 10.507 ± 0.498 × 1 0 14 M ⊙ after calibration for a simulated cluster with the mass of 10 × 1 0 14 M ⊙ . In multiple cases of validation, the estimated results are all consistent with true cluster mass. Discussion This study yields the first relationship between reality and shape measurement of the LSST Science Pipelines and serves as the first step toward the overall goal of mass calibration in cluster lensing. By addressing the challenges in shear measurement and calibration, we aim to enhance the accuracy and reliability of mass estimates in galaxy cluster lensing studies.

Astronomy & Astrophysics↗

DOE OSTI2024

Dimensionally Aligned Signal Projection Algorithms Library

Dimensionally aligned signal projection (DASP) algorithms are used to analyze fast Fourier transforms (FFTs) and generate visualizations that help focus on the harmonics for specific signals. At a high level, these algorithms extract the FFT segments around each harmonic frequency center, and then align them in equally sized arrays ordered by increasing distance from the base frequency. This allows for a focused view of the harmonic frequencies, which, among other use cases, can enable machine learning algorithms to more easily identify salient patterns. This work seeks to provide an effective open-source implementation of the DASP algorithms proposed by Vann et al. (2018) as well as functionality to help explore and test how these algorithms work with an interactive dashboard and signal-generation tool. The DASP library is implemented in Python and contains four types of algorithms for implementing these feature engineering techniques: fixed harmonically aligned signal projection (HASP), decimating HASP, interpolating HASP, and frequency aligned signal projection (FASP). Each algorithm returns a numerical array, which can be visualized as an image. The HASP algorithms are variations of the algorithms originally presented by Vann et al. (2018). For consistency, FASP, which is the terminology used for the short-time Fourier transform (STFT), has been implemented as part of the library to provide a similar interface to the STFT of the raw signal. Additionally, the library contains an algorithm to generate artificial signals with basic customizations such as the base frequency, sample rate, duration, number of harmonics, noise, and number of signals. Finally, the library provides multiple interactive visualizations, each of which is implemented using IPyWidgets and works in a Jupyter environment. A dashboard-style visualization is provided, which contains some common signal-processing visual components (signal, FFT, spectogram) updating in unison with the HASP functions (see Figure 1 below). Separate from the dashboard, an independent visualization is provided for each of the DASP algorithms as well as for the artifical signal generator. These visualizations are included in the library to aid in developing an intuitive understanding how the algorithms are affected by different input signals and parameter selections.

harmonics↗

DOE OSTI2023

Using angular two-point correlations to self-calibrate the photometric redshift distributions of DECaLS DR9

Calibrating the redshift distributions of photometric galaxy samples is essential in weak lensing studies. The self-calibration method combines angular auto- and cross-correlations between galaxies in multiple photometric redshift (photo-z) bins to reconstruct the scattering rates matrix between redshift bins. In this paper, we test a recently proposed self-calibration algorithm using the DECaLS Data Release 9 and investigate to what extent the scattering rates are determined. We first mitigate the spurious angular correlations due to imaging systematics by a machine learning based method. We then improve the algorithm for χ 2 minimization and error estimation. Finally, we solve for the scattering matrices, carry out a series of consistency tests, and find reasonable agreements: (1) finer photo-z bins return a high-resolution scattering matrix, and it is broadly consistent with the low-resolution matrix from wider bins; (2) the scattering matrix from the Northern Galactic Cap is almost identical to that from Southern Galactic Cap; (3) the scattering matrices are in reasonable agreement with those constructed from the power spectrum and the weighted spectroscopic subsample. We also evaluate the impact of cosmic magnification. Although it changes little the diagonal elements of the scattering matrix, it affects the off-diagonals significantly. The scattering matrix also shows some dependence on scale cut of input correlations, which may be related to a known numerical degeneracy between certain scattering pairs. In conclusion, this work demonstrates the feasibility of the self-calibration method in real data and provides a practical alternative to calibrate the redshift distributions of photometric samples.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Neutral gas analysis for JET DT operation

Neutral gas analysis, the measurement and evaluation of total and partial pressures, is a key technique to study the impact of neutral gas dynamics on retention, recycling and release processes of fuel or impurity species in fusion devices. At JET, the experiment closest to ITER in terms of operating parameters and size, various detectors and techniques for partial pressure and total pressure measurements are deployed together to characterise neutral gas dynamics during and after plasma operation on various toroidal and poloidal locations. An extensive modification of JET's sub-divertor neutral gas diagnostic system aims at retaining and extending established measurement capabilities in the forthcoming Deuterium-Tritium (DT) experiments (DTE2). To achieve DT compatibility, a separation of radiation-sensitive electronics from the sensor and adequate radiation shielding is required, as well as utilisation of a DT compatible differential pumping system with adjustable throughput to account for the strong pressure variation in the sub-divertor region. Finally, the sub-divertor neutral gas diagnostic will be equipped with multiple Residual Gas Analysers (RGAs), utilising quadrupole mass spectrometry and electrostatic ion-trap-principles, all operating with remote electronics located behind the biological radiation shield. These RGAs will record data in a fast selected discrete mass mode during plasma pulses (cycle ~2 s) and will automatically switch back to continuous data recording (cycle ~100 s) afterwards. They will be complemented by a newly improved Penning gauge spectroscopy configuration in particular supporting the He and D 2 separation relevant for DT operation. The distance between these devices and their associated control unit is typically 15m . A newly developed RGA with a cable length of 80 m, compatible with the ITER environment, will also be employed for the first time. Finally, this set-up and its operation in DTE2 will provide vital input to the development of the ITER divertor RGA in the most relevant environment currently available.

47 OTHER INSTRUMENTATION↗

DOE OSTI2025

PDF Entity Annotation Tool (PEAT)

While different text mining approaches – including the use of Artificial Intelligence (AI) and other machine based methods - continue to expand at a rapid pace, the tools used by researchers to create the labeled datasets required for training, modeling, and evaluation remain rudimentary. Labeled datasets contain the target attributes the machine is going to learn; for example, training an algorithm to delineate between images of a car or truck would generally require a set of images with a quantitative description of the underlying features of each vehicle type. Development of labeled textual data that can be used to build natural language machine learning models for scientific literature is not currently integrated into existing manual workflows used by domain experts. Published literature is rich with important information, such as different types of embedded text, plots, and tables that can all be used as inputs to train ML/natural language processing (NLP) models, when extracted and prepared in machine readable formats. Currently, both normalized data extraction of use to domain experts and extraction to support development of ML/NLP models are labor intensive and cumbersome manual processes. Automatic extraction of data and information from formats such as PDFs that are optimized for layout and human readability, not machine readability. The PDF (Portable Document Format) Entity Annotation Tool (PEAT) was developed with the goal of allowing users to annotate publications within their current print format, while also allowing those annotations to be captured in a machine-readable format. One of the main issues with traditional annotation tools is that they require transforming the PDF into plain text to facilitate the annotation process. While doing so lessens the technical challenges of annotating data, the user loses all structure and provenance that was inherent in the underlying PDF. Also, textual data extraction from PDFs can be an error prone process. Challenges include identifying sequential blocks of text and a multitude of document formats (multiple columns, font encodings, etc.). As a result of these challenges, using existing tools for development of NLP/ML models directly from PDFs is difficult because the generated outputs are not interoperable. We created a system that allows annotations to be completed on the original PDF document structure, with no plain text extraction. The result is an application that allows for easier and more accurate annotations. In addition, by including a feature that grants the user the ability to easily create a schema, we have developed a system that can be used to annotate text for different domain-centric schemas of relevance to subject matter experts. Different knowledge domains require distinct schemas and annotation tags to support machine learning.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗

DOE OSTI2020

Improved Infrared Optical Constants from Pressed Pellets: II. Ellipsometric n and k Values for Ammonium Sulfate with Variability Analysis

Infrared spectral imaging is facilitated via the comparison of spectra recorded in situ to a databank of actual or synthetic infrared reflectance spectra. It has recently been shown that reference spectra corresponding to the many different morphological forms of the same chemical can be generated synthetically using the imaginary, k, and real, n, components of the complex refractive index, n~ = n + ik. One method to obtain the n and k vectors is infrared ellipsometry, which measures the changes in amplitude, tan ?, and phase, ?, of polarized light reflected from the sample both as a function of wavenumber and angle of incidence. The method requires specularly reflected light so best results are usually obtained with polished planar samples of large surface area. Due to the difficulties of obtaining such samples, however, we investigate the possibility of pressing powders of neat materials and obtaining the corresponding optical constants from the pellets. In this paper, variability in the sample pellet and preparation method is investigated, as is variability in the fitting procedure for the derived optical constants. The n/k vectors are derived from the measured ellipsometric parameters, tan ? and ?, as they are fit by an oscillator model which yield n(?) and k(?) vectors as a function of wavenumber, ?. Construction of the oscillator model is not automatic and depends on significant input from the analyst as well as the sample’s physical characteristics. For the pellet pressing, the experimental variability was found to be minimized for size-selected powdered samples as gauged by the minimal variance in ? and ? for three different pellets; similarly, the analytical precision for multiple measurements of the same pellet was also quite good, suggesting that a pressed pellet is a viable sample preparation method. The greatest variability came in the analytic fitting procedure with differences up to 20% arising from four different fits to the same data set. The final ellipsometric n/k data are compared to literature values obtained from crystalline (NH4)2SO4 samples as well as single-angle reflectance measurements that also used pressed pellets. Comparison with the previous literature values shows generally good agreement although higher k-values are observed for the independent sets of data derived from pressed pellets. These data are suggested as an improved set of optical constants for (NH4)2SO4.

optical constants, ellipsometry, ammonium sulfate,↗

DOE OSTI2026

Field and Model Data Associated with the Manuscript “Drivers of Streamflow Intermittency in Humid Regions: 1. Evaluating Above- and Below-ground Controls of Flow Persistence in a Forested Catchment”

This package contains field data, modeling files, and scripts supporting the investigation of the drivers of streamflow intermittency in a forested catchment. It includes the field data collected from electrical resistivity tomography (ERT) surveys, ground penetrating radar (GPR), continuous self-potential (SP) monitoring, electromagnetic (EM) imaging, groundwater and stilling well. In addition, it contains the data and results of the coupled water- and electrical-flow model developed using the COMSOL Multiphysics and Advanced Terrestrial Simulator (ATS), as well as software files and Jupyter notebooks used to process the data and generate figures in the manuscript submitted for peer review. The data archive is organized in the following directories: 1) Climate Includes hourly precipitation and daily evapotranspiration time series (2024 – 2025) provided as CSV files, alongside a text file detailing dataset units. 2) Coupled_model Contains two subfolders: Synthetic and Field_Application subfolder. Synthetic subfolder contains the ATS XML input script (can be opened using any code editor) for the four synthetic hydrological cases tested (Connected and gaining, Connected and losing, Disconnected and losing, and dry stream). It also includes other experimental cases to test the influence of precipitation and concentration gradient. For each synthetic case, the flow model simulation is executed using the ATS XML scripts and the included Python script (generate_data_set.py) to convert ATS output to COMSOL-ready input. COMSOL Multiphysics template (.mph can be opened with the commercial software COMSOL and requires a license) is executed using the ATS output data to simulate the potential field. It also includes the Synthetic_model_plot.ipynb (can be opened using any code editor) to visualize the SP result and generate manuscript figures. The data subfolder contains mesh files to run both the ATS (.exo and .stl files can be viewed using Paraview; .h5 files can be opened using HDFView software and h5py Python package) and COMSOL models. Field_Application subfolder contains two subfolders: ES_MDA_inversion and Final_Model. ES_MDA_inversion contains the Python script (.py can be opened using any code editor) and SP observation data used to run the Ensemble Smoother with Multiple Data Assimilation (ES-MDA) inversion sequence to get the optimal model parameters. The Final_model subfolder contains the ATS XML input scripts, data files, output data for the two SP sites. The same workflow steps outlined for the Synthetic subfolder apply here. It also contains the Jupyter notebook (Plot_final_calib.ipynb) to visualize the results of the modeled SP, stream-groundwater exchange and moisture content. 3) Discharge Includes the electrical conductivity (EC) time series (provided as CSV files) from salt slug injections. It also includes the Jupyter notebook (Discharge_process.ipynyb) used to estimate discharge. All discharge measurements collated into rating_curve_processed.csv 4) EM Contains the CSV file of the EM data from the DUALEM-42, including spatial coordinates (x, y, z), apparent conductivity, and in-phase measurements at 2 m coil separations for horizontal coplanar (HCP) and perpendicular (PRP) geometries. 5) ERT Contains raw resistivity data (provided as CSV files), spatial location of each of the electrodes (provided as CSV files), and files used for the resistivity inversion (.resipy can be opened with the open-source ResIPy software). 6) GPR Includes GPR field datasets collected at 100 MHz and 250 MHz antenna frequencies, along with the processing/interpretation project file (GPR_process.gpz can be viewed using EKKO_Project 6, a commercial software by Sensors & Software that requires a license). 7) Slug_test Includes the slug test data at all the groundwater wells provided as CSV files, as well as the Jupyter notebook (Slug_test.ipynb) for calculating hydraulic conductivity. 8) SP Contains the SP data collected in field at the two SP sites (one in the perennial reach and the other in the intermittent reach), provided as DAT files. 9) Well_data Contains two subfolders: 1) Raw, which provides unprocessed pressure, electrical conductivity and temperature timeseries downloaded from the loggers in all the groundwater and stilling wells, and 2) Processed, which contains sorted, QA/QC timeseries data for each well. The data archive also contains data_process.ipynb, a Jupyter notebook used for field data analysis and generating figures (plotting well, SP, climate, and discharge data, as well as calculating head gradient at sites with nested groundwater wells). It also includes DTW.ipynb, a Jupyter notebook containing the code for the dynamic time warping (DTW) with sliding window to evaluate SP signal synchronicity.

ATS↗

DOE OSTI2024

Multi-Scale Integrated Monitoring System for Enhancing Methane Emission Detection, Quantification & Prediction

This report details the progress and findings of a comprehensive study on reviewing existing solutions, identifying technology gaps, and formulating an “all-in-one” integrated strategy for developing the next-generation multiscale methane monitoring and modeling platform, conducted under grant number DE-FE0032292. Co-led by Dr. David Ebert, Dr. Binbin Weng, and Dr. Chenghao Wang at the University of Oklahoma, the project’s goal was to develop an integrated approach for building this engineering platform to detect, quantify, and mitigate methane emissions across various temporal scale, spatial scales, and sectors. The planning grant study began with an extensive review of various methane sensing and monitoring technologies and systems, surveying over 100 technology providers globally. This review revealed the prevalence of optical methods over chemical methods in commercially available sensors, with Non-Dispersive Infrared (NDIR), Tunable Diode Laser Absorption Spectroscopy (TDLAS), and Optical Gas Imaging (OGI) cameras being the most prevalent options. A trend towards more advanced optical techniques was observed, driven by increased regulatory focus and technological advancements. The technical evaluation of these sensing technologies provided crucial insights into their capabilities and limitations. The study examined emerging technologies such as Differential Absorption LiDAR (DIAL), which show promise for high-precision and long-range detection. The team then investigated the features and application bandwidth of various sensing platforms, including handheld, fixed/stationary, mobile, aerials, and spaceborne monitors. Pilot field studies were conducted to assess the capabilities of solutions for different emission scenarios. Field work with sensor deployments was conducted at three distinct site types: an oil & gas industry site, a cattle ranching operation, and a waste processing facility. The team also conducted a thorough review of methane flux inverse modeling approaches, focused on physically based methods. These approaches were categorized into simple, intermediate, and advanced methods. A realtime WRF-GHG (Weather Research and Forecasting-Greenhouse Gas) modeling system was developed and applied, incorporating multiple data sources to guide field experiments and inform methane plume detection. The project identified and analyzed numerous categories of methane data sources, including satellite measurements, ground-based sensors, and inventory databases. Key platforms examined include EDGAR, EPA GHGI, NASA TROPOMI, Carbon Mapper, and Climate TRACE, among others. The team proposed an architecture for a comprehensive methane monitoring platform. This system incorporates multi-source data acquisition, advanced data processing and assimilation, interactive visualization tools, and analytical capabilities for emissions forecasting and scenario analysis. The proposed platform aims to provide a user-friendly interface catering to various stakeholders, from researchers to policymakers. The architecture includes sophisticated data ingestion methods, a centralized data warehouse, and advanced analytical tools for data fusion and interpretation. To ensure the relevance and effectiveness of the proposed system, a comprehensive survey was conducted to gather stakeholder input on system requirements. Key findings include a strong need for integrating various data types and formats, a preference for real-time data updates and advanced visualization tools, and a demand for user-friendly interfaces catering to different expertise levels.

03 NATURAL GAS↗

DOE OSTI2021

Version 4 CALIPSO Imaging Infrared Radiometer ice and liquid water cloud microphysical properties – Part I: The retrieval algorithms

Following the release of the version 4 Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data products from the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission, a new version (version 4; V4) of the CALIPSO Imaging Infrared Radiometer (IIR) Level 2 data products has been developed. The IIR Level 2 data products include cloud effective emissivities and cloud microphysical properties such as effective diameter and ice or liquid water path estimates. Dedicated retrievals for water clouds were added in V4, taking advantage of the high sensitivity of the IIR retrieval technique to small particle sizes. This paper (Part I) describes the improvements in the V4 algorithms compared to those used in the version 3 (V3) release, while results will be presented in a companion (Part II) paper. The IIR Level 2 algorithm has been modified in the V4 data release to improve the accuracy of the retrievals in clouds of very small (close to 0) and very large (close to 1) effective emissivities. To reduce biases at very small emissivities that were made evident in V3, the radiative transfer model used to compute clear-sky brightness temperatures over oceans has been updated and tuned for the simulations using Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data to match IIR observations in clear-sky conditions. Furthermore, the clear-sky mask has been refined compared to V3 by taking advantage of additional information now available in the V4 CALIOP 5 km layer products used as an input to the IIR algorithm. After sea surface emissivity adjustments, observed and computed brightness temperatures differ by less than ±0.2 K at night for the three IIR channels centered at 08.65, 10.6, and 12.05 µm, and inter-channel biases are reduced from several tens of Kelvin in V3 to less than 0.1 K in V4. We have also improved retrievals in ice clouds having large emissivity by refining the determination of the radiative temperature needed for emissivity computation. The initial V3 estimate, namely the cloud centroid temperature derived from CALIOP, is corrected using a parameterized function of temperature difference between cloud base and top altitudes, cloud absorption optical depth, and CALIOP multiple scattering correction factor. As shown in Part II, this improvement reduces the low biases at large optical depths that were seen in V3 and increases the number of retrievals. As in V3, the IIR microphysical retrievals use the concept of microphysical indices applied to the pairs of IIR channels at 12.05 and 10.6 µm and at 12.05 and 08.65 µm. The V4 algorithm uses ice look-up tables (LUTs) built using two ice habit models from the recent “TAMUice2016” database, namely the single-hexagonal-column model and the eight-element column aggregate model, from which bulk properties are synthesized using a gamma size distribution. Four sets of effective diameters derived from a second approach are also reported in V4. Here, the LUTs are analytical functions relating microphysical index applied to IIR channels 12.05 and 10.6 µm and effective diameter as derived from in situ measurements at tropical and midlatitudes during the Tropical Composition, Cloud, and Climate Coupling (TC4) and Small Particles in Cirrus Science and Operations Plan (SPARTICUS) field experiments.

54 ENVIRONMENTAL SCIENCES↗