Search NASA⌕ Search

SEARCH · Search NASA

Results for “preprocessing sites”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

47 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Integrating Analytical Solutions and U-Net Model for Predicting Groundwater Contaminant Plumes in Pump-and-Treat Systems

Pump-and-treat (P&T) is a common technique for groundwater remediation involving the extraction and treatment of contaminated water above ground. Optimizing the design and operation of the P&T well network is essential for maximizing the system’s effectiveness and efficiency. However, this optimization often necessitates many model evaluations, leading to computationally demanding tasks. This study introduces a novel approach that integrates analytical solutions for groundwater dynamics with the U-Net (Ronneberger et al., 2015) deep learning framework to predict groundwater contaminant plume migration under dynamic pumping conditions. By incorporating the Thiem equation (Thiem, 1906) into the input preprocessing, the U-Net model transforms sparse well data into a continuous spatial field that captures the hydraulic impacts of pumping activities. This integration enables the model to leverage both deep learning capabilities and classical physics-based groundwater theories, enhancing prediction accuracy and computational efficiency. These advancements can facilitate rapid, large-scale evaluations of P&T optimization simulations, allowing for timely and effective decision-making in well placement and system management. We demonstrate the model's robust performance across both simplified transient 2D models and a more complex 3D heterogeneous site model at the 200 West P&T facility at the Hanford Site. The U-Net-based model offers substantial computational advantages, reducing simulation times significantly compared to full physics-based models and providing a powerful tool for rapid site evaluation and P&T system optimization, such as evaluating alternative P&T well network designs. Our findings highlight the potential of advanced machine learning models to significantly enhance the efficiency and sustainability of groundwater remediation efforts, offering a novel application of U-Net architecture in environmental science.

Pump-and-treat↗
NASA NTRS2008

Mapping Snow Grain Size over Greenland from MODIS

This paper presents a new automatic algorithm to derive optical snow grain size (SGS) at 1 km resolution using Moderate Resolution Imaging Spectroradiometer (MODIS) measurements. Differently from previous approaches, snow grains are not assumed to be spherical but a fractal approach is used to account for their irregular shape. The retrieval is conceptually based on an analytical asymptotic radiative transfer model which predicts spectral bidirectional snow reflectance as a function of the grain size and ice absorption. The analytical form of solution leads to an explicit and fast retrieval algorithm. The time series analysis of derived SGS shows a good sensitivity to snow metamorphism, including melting and snow precipitation events. Preprocessing is performed by a Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, which includes gridding MODIS data to 1 km resolution, water vapor retrieval, cloud masking and an atmospheric correction. MAIAC cloud mask (CM) is a new algorithm based on a time series of gridded MODIS measurements and an image-based rather than pixel-based processing. Extensive processing of MODIS TERRA data over Greenland shows a robust performance of CM algorithm in discrimination of clouds over bright snow and ice. As part of the validation analysis, SGS derived from MODIS over selected sites in 2004 was compared to the microwave brightness temperature measurements of SSM\I radiometer, which is sensitive to the amount of liquid water in the snowpack. The comparison showed a good qualitative agreement, with both datasets detecting two main periods of snowmelt. Additionally, MODIS SGS was compared with predictions of the snow model CROCUS driven by measurements of the automatic whether stations of the Greenland Climate Network. We found that CROCUS grain size is on average a factor of two larger than MODIS-derived SGS. Overall, the agreement between CROCUS and MODIS results was satisfactory, in particular before and during the first melting period in mid-June. Following detailed time series analysis of SGS for four permanent sites, the paper presents SGS maps over the Greenland ice sheet for the March-September period of 2004.

Lyapustin, Alexei↗
NASA NTRS2007

Generating a Long-Term Land Data Record from the AVHRR and MODIS Instruments

The goal of NASA's Land Long Term Iiata Record (LTDR) project is to produce a consistent long term data set from the AVHRR and MODIS instruments for land climate studies. The project will create daily surface reflectance and normalized difference vegetation index (NDVI) products at a resolution of 0.05 deg., which is identical to the Climate Modeling Grid (CMG) used for MODIS products from EOS Terra and Aqua. Higher order products such as burned area, land surface temperature, albedo, bidirectional reflectance distribution function (BRDF) correction, leaf area index (LAI), and fraction of photosyntheticalIy active radiation absorbed by vegetation (fPAR), will be created. The LTDR project will reprocess Global Area Coverage (GAC) data from AVHRR sensors onboard NOAA satellites by applying the preprocessing improvements identified in the AVHRR Pathfinder Il project and atmospheric and BRDF corrections used in MODIS processing. The preprocessing improvements include radiometric in-flight vicarious calibration for the visible and near infrared channels and inverse navigation to relate an Earth location to each sensor instantaneous field of view (IFOV). Atmospheric corrections for Rayleigh scattering, ozone, and water vapor are undertaken, with aerosol correction being implemented. The LTDR also produces a surface reflectance product for channel 3 (3.75 micrometers). Quality assessment (QA) is an integral part of the LTDR production system, which is monitoring temporal trands in the AVHRR products using time-series approaches developed for MODIS land product quality assessment. The land surface reflectance products have been evaluated at AERONET sites. The AVHRR data record from LTDR is also being compared to products from the PAL (Pathfinder AVHRR Land) and GIMMS (Global Inventory Modeling and Mapping Studies) systems to assess the relative merits of this reprocessing vis-a-vis these existing data products. The LTDR products and associated information can be found at http://ltdr.nascom.nasa.gov/ltdr/ltdr.html.

Pedelty, Jeffrey↗
DOE OSTI2020

Performance Prediction of Big Data Transfer Through Experimental Analysis and Machine Learning

Big data transfer in next-generation scientific applications is now commonly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) through advance bandwidth reservation. To use HPN resources efficiently, provisioning agents need to carefully schedule data transfer requests and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized by the requesting user, could be simply wasted or cause extra overhead and complexity in management due to exclusive access. This calls for the capability of performance prediction to reserve bandwidth resources that match actual needs. Towards this goal, we employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements, which are collected over a span of several years from a large number of data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated HPN testbeds. We first identify a comprehensive list of attributes involved in a typical big data transfer process, including end host system configurations, network connection properties, and control parameters of data transfer methods. We then conduct an in-depth exploratory analysis of their impacts on application-level throughput, which provides insights into big data transfer performance and motivates the use of machine learning. We also investigate the applicability of machine learning algorithms and derive their general performance bounds for performance prediction of big data transfer in HPNs. Experimental results show that, with appropriate data preprocessing, the proposed machine learning-based approach achieves 95% or higher prediction accuracy in up to 90% of the cases with very noisy real-life performance measurements.

Yun, Daqing↗
NASA NTRS2006

Medical Signal-Conditioning and Data-Interface System

A general-purpose portable, wearable electronic signal-conditioning and data-interface system is being developed for medical applications. The system can acquire multiple physiological signals (e.g., electrocardiographic, electroencephalographic, and electromyographic signals) from sensors on the wearer s body, digitize those signals that are received in analog form, preprocess the resulting data, and transmit the data to one or more remote location(s) via a radiocommunication link and/or the Internet. The system includes a computer running data-object-oriented software that can be programmed to configure the system to accept almost any analog or digital input signals from medical devices. The computing hardware and software implement a general-purpose data-routing-and-encapsulation architecture that supports tagging of input data and routing the data in a standardized way through the Internet and other modern packet-switching networks to one or more computer(s) for review by physicians. The architecture supports multiple-site buffering of data for redundancy and reliability, and supports both real-time and slower-than-real-time collection, routing, and viewing of signal data. Routing and viewing stations support insertion of automated analysis routines to aid in encoding, analysis, viewing, and diagnosis.

Braun, Jeffrey↗
NASA NTRS1974

Image data processing of earth resources management

The Earth Resources Technology Satellite (ERTS-1) was launched on July 23, 1972. Since that date, the vehicle has been acquiring and transmitting to earth a vast amount of information relating to the earth's resources. Scientific investigators throughout the world have been analyzing photographic products produced from this data with significant results. Recently, there has been a major shift of emphasis from the visual analysis of photo products to the use of sophisticated digital information extraction techniques. Specialized equipment, such as the GE IMAGE 100 System, has been developed that operates directly from Computer Compatible Tapes, (CCT’s), which contain preprocessed digital data acquired from the ERTS spacecraft. Analysis of CCT data avoids the losses in image resolution and quality which are inherent to all photo processing techniques, thereby greatly increasing the utility of ERTS data. Future ground processing systems will turn out fully corrected (radiometric and geometric) digital tapes which will further increase the utility of ERTS data. This paper is presented in two parts: the first part deals with the subject of present and future generations of image processing and information extraction systems under development at the General Electric Company; the second part describes in more detail the design and operation of GE1s interactive multispectral information extraction systems, IMAGE 100, and discusses results of analyses of ERTS data over a number of U.S. sites.

A W DeSio↗
NASA NTRS2013

Mars Science Laboratory Entry, Descent, and Landing Trajectory and Atmosphere Reconstruction

On August 5th 2012, The Mars Science Laboratory entry vehicle successfully entered Mars atmosphere and landed the Curiosity rover on its surface. A Kalman filter approach has been implemented to reconstruct the entry, descent, and landing trajectory based on all available data. The data sources considered in the Kalman filtering approach include the inertial measurement unit accelerations and angular rates, the terrain descent sensor, the measured landing site, orbit determination solutions for the initial conditions, and a new set of instrumentation for planetary entry reconstruction consisting of forebody pressure sensors, known as the Mars Entry Atmospheric Data System. These pressure measurements are unique for planetary entry, descent, and landing reconstruction as they enable a reconstruction of the freestream atmospheric conditions without any prior assumptions being made on the vehicle aerodynamics. Moreover, the processing of these pressure measurements in the Kalman filter approach enables the identification of atmospheric winds, which has not been accomplished in past planetary entry reconstructions. This separation of atmosphere and aerodynamics allows for aerodynamic model reconciliation and uncertainty quantification, which directly impacts future missions. This paper describes the mathematical formulation of the Kalman filtering approach, a summary of data sources and preprocessing activities, and results of the reconstruction.

Karlgaard, Christopher D.↗
DOE OSTI2021

Multiscale Catalytic Fast Pyrolysis of Grindelia Reveals Opportunities for Generating Low Oxygen Content Bio-Oils from Drought Tolerant Biomass

Grindelia squarrosa (curlycup gumweed) biomass possesses unique biochemistry, cell wall composition, and leaf architecture tailored for prolific growth in arid and semiarid climates. Most notably, this plant has developed high levels of extractable resins that have high effective H/C eff ratios ((mol H - 2 x mol O)/mol C), which is hypothesized to lead to low coke formation during catalytic fast pyrolysis (CFP) over the ZSM-5 catalyst. In microscale experiments with high ZSM-5 loadings (biomass-to-catalyst mass ratio (B/C) ~ 0.1), in situ CFP generated high yields of aromatic hydrocarbons (30% carbon yield) while ex situ CFP favored aliphatic hydrocarbons (25% carbon yield). The difference between the two configurations was attributed to the constant catalyst temperature during ex situ CFP. Deactivation leading to partially deoxygenated vapor products occurred rapidly until B/C ≤ 0.5 by the adsorption of organic species blocking access to acid sites inside the micropores of the catalyst. This was followed by more gradual deactivation leading to primary vapor breakthrough, which we attribute to coke formation on acid sites on the external surface of ZSM-5 crystallites. Noncatalytic fast pyrolysis of Grindelia in a bench scale reactor produced oils with oxygen content (18 wt % on dry basis) and carbon yield (33%) comparable to those of CFP of woody biomass. The CFP of Grindelia further reduced the oxygen content to 7 wt % for in situ CFP and 4 wt % for ex situ CFP at B/C of 2-3. The good deoxygenation was attributed to a combination of a high H/C eff ratio and overall better quality of the pyrolysis vapors that were passed over the ZSM-5 catalyst. The high inorganic content of the Grindelia likely catalyzed pyrolysis to remove oxygenated coke precursors. This integrated CFP study demonstrated that Grindelia could be an important feedstock for generating stabilized noncatalytic and CFP oils for downstream processing into fuels and/or extraction of high-value chemicals. The preprocessing of this feedstock will be required to remove inorganics, which cause an irreversible deactivation of ZSM-5.

BIOMASS FUELS↗
NASA NTRS1995

Extraction of ozone and chlorophyll-A distribution from AVIRIS data

The potential of airborne imaging spectrometry for assessing and monitoring natural resources is studied. Therefore, an AVIRIS scene of the NASA's MacEurope 1991 campaign - acquired in Central Switzerland - is used. The test site consists of an urban area, the Lake Zug with its surrounding fields, the Rigi mountain in the center of the test site, and the Lake of Four Cantons. The region is covered by the AVIRIS flight #910705, run 6 and 7 of the NASA ER-2 aircraft resulting in an average nominal pixel size of about 18 m. Simultaneous to the ER-2 overflight spectroradiometric measurements have been taken in various locations. Preselected reference targets were measured in the field with a GER Mark V spectroradiometer, and radiance measurements were taken to the lake using a Li-Cor LI 1800UW specroradiometer below and above the water surface. A comprehensive meteorological data set was obtained by joining the POLLUMET experiment which carried out measurements to investigate the summer smog in Switzerland on the same day. The quality assessment for the actual data set can be found in detail in Meyer et al. A parametric approach calculating the location of the airplane was used to simulate the observation geometry. This parametric preprocessing procedure, which takes care of effects of flight line and attitude variations as well as the pixel-by-pixel topographic corrections is described in Meyer.

Schaepman, M.↗
DOE OSTI2024

Models, data, and scripts associated with “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning”

This data package is associated with the publication “Prediction of Distributed River Sediment Respiration Rates using Community-Generated Data and Machine Learning’’ submitted to the Journal of Geophysical Research: Machine Learning and Computation (Scheibe et al. 2024). River sediment respiration observations are expensive and labor intensive to obtain and there is no physical model for predicting this quantity. The Worldwide Hydrobiogeochemisty Observation Network for Dynamic River Systems (WHONDRS) observational data set (Goldman et al.; 2020) is used to train machine learning (ML) models to predict respiration rates at unsampled sites. This repository archives training data, ML models, predictions, and model evaluation results for the purposes of reproducibility of the results in the associated manuscript and community reuse of the ML models trained in this project. One of the key challenges in this work was to find an optimum configuration for machine learning models to work with this feature-rich (i.e. 100+ possible input variables) data set. Here, we used a two-tiered approach to managing the analysis of this complex data set: 1) a stacked ensemble of ML models that can automatically optimize hyperparameters to accelerate the process of model selection and tuning and 2) feature permutation importance to iteratively select the most important features (i.e. inputs) to the ML models. The major elements of this ML workflow are modular, portable, open, and cloud-based, thus making this implementation a potential template for other applications. This data package is associated with the GitHub repository found at Please see the file level metadata (flmd; “sl-archive-whondrs_flmd.csv”) for a list of all files contained in this data package and descriptions for each. Please see the data dictionary (dd; “sl-archive-whondrs_dd.csv”) for a list of all column headers contained within comma separated value (csv) files in this data package and descriptions for each. The GitHub repository is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning models trained on the data in “input_data”; (3) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; (4) “examples” contains the visualization of the results in this repository including plotting scripts for the manuscript (e.g., model evaluation, FPI results) and scripts for running predictions with the ML models (i.e., reusing the trained ML models); (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. Furthermore, depending on the number of features used to train the ML models, the preprocessing and postprocessing scripts, and their intermediate results, can also be different branch-to-branch. The “main-*” branches are meant to be starting points (i.e. trunks) for each model branch (i.e. sprouts). Please see the Branch Navigation section in the top-level README.md in the GitHub repository for more details. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please the top-level README.md in the GitHub repository for more details on the automation.

13C↗
DOE OSTI2025

Machine learning model inputs, outputs, and scripts associated with “Artificial intelligence-guided iterations between observations and modeling significantly improve environmental predictions”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “Artificial intelligence-guided iterations between observations and modeling significantly improve environmental predictions” (Malhotra et al., in prep). This effort was designed following ICON (integrated, coordinated, open, and networked) principles to facilitate a model-experiment (ModEx) iteration approach, leveraging crowdsourced sampling across the contiguous United States (CONUS). New machine learning models were created every month to guide sampling locations. Data from the resulting samples were used to test and rebuild the machine learning models for the next round of sampling guidance. Associated sediment and water geochemistry and in situ sensor data can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1923689, https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1729719, and https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1603775. This data package is associated with two GitHub repositories found at https://github.com/parallelworks/dynamic-learning-rivers and https://github.com/WHONDRS-Hub/ICON-ModEx_Open_Manuscript. In addition to this readme, this data package also includes two file-level metadata (FLMD) files that describes each file and two data dictionaries (DD) that describe all column/row headers and variable definitions. This data package consists of two main folders (1) dynamic-learning-rivers and (2) ICON-ModEx_Open_Manuscript which contain snapshots of the associated GitHub repositories. The input data, output data, and machine learning models used to guide sampling locations are within dynamic-learning-rivers. The folder is organized into five top-level directories: (1) “input_data” holds the training data for the ML models; (2) “ml_models” holds machine learning (ML) models trained on the data in “input_data”; (3) “examples” contains files for direct experimentation with the machine learning model, including scripts for setting up “hindcast” run; (4) “scripts” contains data preprocessing and postprocessing scripts and intermediate results specific to this data set that bookend the ML workflow; and (5) “output_data” holds the overall results of the ML model on that branch. Each trained ML model resides on its own branch in the repository; this means that inputs and outputs can be different branch-to-branch. There is also one hidden directory “.github/workflows”. This hidden directory contains information for how to run the ML workflow as an end-to-end automated GitHub Action but it is not needed for reusing the ML models archived here. Please see the top-level README.md in the GitHub repository for more details on the automation. The scripts and data used to create figures in the manuscript are within ICON-ModEx_Open_Manuscript. The folder is organized into four folders which contain the scripts, data, and pdf for each figure. Within the “fig-model-score-evolution” folder, there is a folder called “intermediate_branch_data” which contains some intermediate files pulled from dynamic-learning-rivers and reorganized to easily integrate into the workflows. NOTE: THIS FOLDER INCLUDES THE FILES AT THE POINT OF PAPER SUBMISSION. IT WILL BE UPDATED ONCE THE PAPER IS ACCEPTED WITH ANY REVISIONS AND WILL INCLUDE A DD/FLMD AT THAT POINT. We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Washington State Parks and Recreation Commission (Scientific Research Permit #210901), and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the samples labeled “SSS” were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate sample collection and optimization of data usage according to their values and worldview. WHONDRS consortium members were asked to provide any acknowledgments for the collection of samples labeled “CM” and the following is a list of acknowledgments that were submitted with their corresponding Site IDs: (MART) Research activities were conducted in part on the Wind River Experimental Forest within the Gifford Pinchot National Forest; (MP- 100379) Philadelphia is part of Lenapehoking, the ancestral homelands of the Lenape peoples; (MP-102398) Land surveyed is the ancestral homelands of the Nookhose'iinenno (Arapaho), Tsis tsis'tas (Cheyenne), and Nuuchu (Ute); (MP-100749 and MP- 100747) Georgia Coastal Ecosystem LTER, OCE-1832178; (SP-70 and SP-72) Eastern Shoshone, Shoshone-Bannock; (MP- 102944) Funded by Oregon Watershed Enhancement Board. On the traditional lands of the Confederated Tribes of the Siletz, Confederated Tribes of the Grand Rhonde, and the Clatsop-Nehalem Confederated Tribe; (MP- 100607) Holiday Creek is located on the traditional territory of the Monacan Indian Nation; (SP-45) Lafayette Blue Springs State Park; (MP-102420) NSF DEB-2016749; (MP-100019) New Hampshire Agriculture Experiment Station; (SP-35) Rayonier (land owner; https://www.rayonier.com/); (MP- 101276) US Department of Energy, Office of Science, Biological and Environmental Research, Subsurface Biogeochemical Research, Watershed Dynamics and Evolution SFA at ORNL; (MP- 103224) Watershed Dynamics and Evolution SFA at ORNL; (MP- 101584) Traditional lands of the Oceti Sakowin (Dakota, Lakota, Nakoda) and Anishinaabe Peoples.

54 ENVIRONMENTAL SCIENCES↗