SEARCH · Search NASA

Results for “Preprocessing Tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Statistical characterization of experimental magnetized liner inertial fusion stagnation images using deep-learning-based fuel–background segmentation

Significant variety is observed in spherical crystal x-ray imager (SCXI) data for the stagnated fuel–liner system created in Magnetized Liner Inertial Fusion (MagLIF) experiments conducted at the Sandia National Laboratories Z-facility. As a result, image analysis tasks involving, e.g., region-of-interest selection (i.e. segmentation), background subtraction and image registration have generally required tedious manual treatment leading to increased risk of irreproducibility, lack of uncertainty quantification and smaller-scale studies using only a fraction of available data. We present a convolutional neural network (CNN)-based pipeline to automate much of the image processing workflow. This tool enabled batch preprocessing of an ensemble of N scans = 139 SCXI images across N exp = 67 different experiments for subsequent study. The pipeline begins by segmenting images into the stagnated fuel and background using a CNN trained on synthetic images generated from a geometric model of a physical three-dimensional plasma. The resulting segmentation allows for a rules-based registration. Our approach flexibly handles rarely occurring artifacts through minimal user input and avoids the need for extensive hand labelling and augmentation of our experimental dataset that would be needed to train an end-to-end pipeline. Here we also fit background pixels using low-degree polynomials, and perform a statistical assessment of the background and noise properties over the entire image database. Our results provide a guide for choices made in statistical inference models using stagnation image data and can be applied in the generation of synthetic datasets with realistic choices of noise statistics and background models used for machine learning tasks in MagLIF data analysis. We anticipate that the method may be readily extended to automate other MagLIF stagnation imaging applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Sandia Injury Biomechanics Laboratory Library

The Sandia Injury Biomechanics Laboratory (SIBL) Library is a collection of scripts and tools used to preprocess, process, and postprocess data for analysis of injury biomechanics data. SAND2020-3663 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hovey, Chad↗

NASA NTRS2001

Computational Aeroacoustic Analysis System Development

Many industrial and commercial products operate in a dynamic flow environment and the aerodynamically generated noise has become a very important factor in the design of these products. In light of the importance in characterizing this dynamic environment, Rocketdyne has initiated a multiyear effort to develop an advanced general-purpose Computational Aeroacoustic Analysis System (CAAS) to address these issues. This system will provide a high fidelity predictive capability for aeroacoustic design and analysis. The numerical platform is able to provide high temporal and spatial accuracy that is required for aeroacoustic calculations through the development of a high order spectral element numerical algorithm. The analysis system is integrated with well-established CAE tools, such as a graphical user interface (GUI) through PATRAN, to provide cost-effective access to all of the necessary tools. These include preprocessing (geometry import, grid generation and boundary condition specification), code set up (problem specification, user parameter definition, etc.), and postprocessing. The purpose of the present paper is to assess the feasibility of such a system and to demonstrate the efficiency and accuracy of the numerical algorithm through numerical examples. Computations of vortex shedding noise were carried out in the context of a two-dimensional low Mach number turbulent flow past a square cylinder. The computational aeroacoustic approach that is used in CAAS relies on coupling a base flow solver to the acoustic solver throughout a computational cycle. The unsteady fluid motion, which is responsible for both the generation and propagation of acoustic waves, is calculated using a high order flow solver. The results of the flow field are then passed to the acoustic solver through an interpolator to map the field values into the acoustic grid. The acoustic field, which is governed by the linearized Euler equations, is then calculated using the flow results computed from the flow solver.

Hadid, A.↗

NASA NTRS2014

Review and Analysis of Algorithmic Approaches Developed for Prognostics on CMAPSS Dataset

Benchmarking of prognostic algorithms has been challenging due to limited availability of common datasets suitable for prognostics. In an attempt to alleviate this problem several benchmarking datasets have been collected by NASA's prognostic center of excellence and made available to the Prognostics and Health Management (PHM) community to allow evaluation and comparison of prognostics algorithms. Among those datasets are five C-MAPSS datasets that have been extremely popular due to their unique characteristics making them suitable for prognostics. The C-MAPSS datasets pose several challenges that have been tackled by different methods in the PHM literature. In particular, management of high variability due to sensor noise, effects of operating conditions, and presence of multiple simultaneous fault modes are some factors that have great impact on the generalization capabilities of prognostics algorithms. More than 70 publications have used the C-MAPSS datasets for developing data-driven prognostic algorithms. The C-MAPSS datasets are also shown to be well-suited for development of new machine learning and pattern recognition tools for several key preprocessing steps such as feature extraction and selection, failure mode assessment, operating conditions assessment, health status estimation, uncertainty management, and prognostics performance evaluation. This paper summarizes a comprehensive literature review of publications using C-MAPSS datasets and provides guidelines and references to further usage of these datasets in a manner that allows clear and consistent comparison between different approaches.

Uncertainty↗

DOE OSTI2026

Short‐Term Hourly Weather Forecasting Using PredRNN With Image Preprocessing

Global weather forecast models are vital tools with numerous applications, including public safety, agriculture, and transportation. Recent advancements in artificial intelligence (AI) and deep learning (DL) have shown the potential to enhance weather forecasting accuracy and speed. In this study, we developed a short-term hourly weather forecast framework with a wavelet transform function for data preprocessing and a spatiotemporal DL model, PredRNN, for predicting five surface atmospheric variables, including wind speed and direction, mean sea level pressure (MSLP), temperature, and precipitation. The framework demonstrated promising results. It produces global forecasts at 0.25° (∼25 km) with a 1-day lead time RMSE of 1.8 m/s for wind components, 180 Pa for MSLP, and 1.8 K for temperature. Although our model does not surpass state-of-the-art AI weather forecast models across all metrics, it outperforms these models in precipitation forecasting and wind prediction at short lead times and achieves comparable accuracy for MSLP. Its native hourly forecasting capability, together with training on widely accessible GPU hardware, contributes meaningfully to the advancement of accessible DL weather forecasting methods. Our work highlights the importance of integrating temporal components and data transformation techniques to improve the predictability and accuracy of weather forecasts.

Tran, Hoang [Pacific Northwest National Laboratory↗

DOE OSTI2021

Removal of spurious data in Bragg coherent diffraction imaging: an algorithm for automated data preprocessing

Bragg coherent diffraction imaging (BCDI) provides a powerful tool for obtaining high-resolution structural information from nanocrystalline materials. Here a BCDI sample consisting of a large number of randomly oriented nanoscale crystals is considered. Ideally, only one crystal is oriented to produce a Bragg peak on the detector. However, diffraction from other crystals often produces additional signals on the detector. Before the measured diffraction patterns can be processed into structural images, scientists routinely need to manually identify and remove the `alien' intensities from sources other than the intended crystal. With the development of modern high-coherence storage rings, such as the upgraded Advanced Photon Source (APS), the already slow process of manual preprocessing will be untenable for the large volumes of data that will be produced. An automated method of identifying and deleting alien intensities is proposed. This method exploits the fact that BCDI of a perfect crystal produces diffraction data with inversion symmetry around the Bragg peak. This approach uses the machine learning clustering method DBSCAN to distinguish between diffraction from multiple sources, and then calculates cluster size and inversion symmetry to assess whether clusters of intensity belong to desired data or alien signals. This approach can dramatically reduce the amount of time spent manually processing data, allowing BCDI data processing capabilities to keep pace with the technological advances of fourth-generation synchrotron light sources.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Digital Analytics, Causal Knowledge Acquisition and Reasoning for Technical Language Processing

Complex engineering systems such as nuclear power plants (NPPs) generate and collect large amounts of equipment reliability (ER) data elements that contain information on the status of components, assets, and systems. Some of this information is textual in form and can be found in documents such as incident reports (IRs) and work orders (WOs). Analyses of textual data in current NPPs-using natural language processing (NLP) methods-have been expanded over the last decade, and it is only recently that the true potential of such analyses has emerged. So far, applications of NLP methods have mostly been limited to classification and prediction, the goal being to identify the nature of the textual element (e.g., safety or non-safety related). Here, we target a more complex problem: automatically extracting knowledge from a textual element in order to assist system engineers in conducting system health assessments. Knowledge extraction is a very broad concept, and its definition may vary depending on the application context. Our methods are a blend of both rule-based and machine learning (ML) algorithms. For our purposes, knowledge extraction means identifying the systems or assets mentioned in a given textual element, as well as the type of event described (e.g., component failure or maintenance activity). In addition, we want to capture details such as measured quantities and the temporal/cause-effect relations between events. In this tool, we also demonstrate how textual data elements are preprocessed in order to handle typos, acronyms, and abbreviations. One main feature of these methods is that they are not based solely on data, but are in fact model-based. In other words, they also rely on MBSE models that are designed to capture-from a functional point of view-the architecture of the systems/assets under consideration. The main purpose of such models is to digitally emulate system engineers' knowledge of system and asset architecture and to identify dependencies among systems, assets, and components. Provided these models, analyses of textual and numeric ER data can be performed by first identifying the OPM model elements to which the ER data elements are referring. The relationships between ER data elements are then identified by checking for any temporal or logical dependencies.

Mandelli, Diego [Idaho National Laboratory (INL), ↗

DOE OSTI2026

HydraGNN_GFM_FineTuning4Materials v1.0

This repository enables fine-tuning of the HydraGNN Predictive GFM 2026 — an open-source ensemble of pre-trained graph foundation models for atomistic materials modeling, developed at Oak Ridge National Laboratory. The GFM 2026 is freely available and downloadable via Globus from the OLCF Data Constellation (DOI: 10.13139/OLCF/2562660). Starting from these pre-trained weights, this repository provides a complete transfer learning pipeline for adapting the GFM ensemble to domain-specific molecular and materials property prediction tasks. It includes: 1) Utilities for ensemble fine-tuning with task-specific output heads 2) Example pipelines for eight widely-used materials and molecular datasets 3) Tools for model adaptation and head configuration 4) Data preprocessing utilities for each supported dataset 5) Benchmarking and evaluation scripts

Ungerboeck, Linda↗

DOE OSTI2023

Automated, high-accuracy classification of textured microstructures using a convolutional neural network

Crystallographic texture is an important descriptor of material properties but requires time-intensive electron backscatter diffraction (EBSD) for identifying grain orientations. While some metrics such as grain size or grain aspect ratio can distinguish textured microstructures from untextured microstructures after significant grain growth, such morphological differences are not always visually observable. This paper explores the use of deep learning to classify experimentally measured textured microstructures without knowledge of crystallographic orientation. A deep convolutional neural network is used to extract high-order morphological features from binary images to distinguish textured microstructures from untextured microstructures. The convolutional neural network results are compared with a statistical Kolmogorov–Smirnov tests with traditional morphological metrics for describing microstructures. Results show that the convolutional neural network achieves a significantly improved classification accuracy, particularly at early stages of grain growth, highlighting the capability of deep learning to identify the subtle morphological patterns resulting from texture. The results demonstrate the potential of a convolutional neural network as a tool for reliable and automated microstructure classification with minimal preprocessing.

36 MATERIALS SCIENCE↗

NASA NTRS2012

Linguistic Preprocessing and Tagging for Problem Report Trend Analysis

Mr. Robert Beil, Systems Engineer at Kennedy Space Center (KSC), requested the NASA Engineering and Safety Center (NESC) develop a prototype tool suite that combines complementary software technology used at Johnson Space Center (JSC) and KSC for problem report preprocessing and semantic tag extraction, to improve input to data mining and trend analysis. This document contains the outcome of the assessment and the Findings, Observations and NESC Recommendations.

Beil, Robert J.↗

NASA NTRS1992

Image masking using polygon fills and morphological transformations

Polygon-fill operations and morphological transformations are effective computational tools for the land-masking and coastline-correction preprocessing operations often applied to AVHRR data prior to oceanographic applications. These masking operations, in conjunction with cloud-screening techniques, can be used on such other oceanographically significant remote-sensing data as those of the Coastal Zone Color Scanner, GOES, and Landsat. The sensitivity of the methods to regional variations in atmospheric conditions and land-ocean temperature gradients is assessed for tropical, midlatitude, and high latitude regions.

Simpson, James J.↗

DOE OSTI2022

Understanding Biomass and Polymer Feedstock Variability Through Analytical Pyrolysis and Two Dimensional Gas Chromatography and Mass Spectrometry

Moving toward a circular carbon economy requires enabling reuse of carbon-based macromolecules like those in biomass and polymers. Meeting this goal requires increased upcycling of waste products into higher value products. For biomass waste such as corn stover, pine needles, or bark, one approach is using pyrolysis to convert these feedstocks into bio-oil that can be used for liquid fuel or transformed into other hydrocarbon based products, like bio-polymers. Waste plastics can be upcycled or recycled into new products, or alternatively converted into bio-oil by pyrolysis. Macromolecules from biomass and polymers are challenging to convert into liquid fuel or chemical feedstocks, due to large and sometimes heterogeneous networks of polymeric bonds. We work with the Idaho National Laboratory’s Biomass Feedstock National User Facility and Department of Energy’s Feedstock Conversion Interface Consortium to develop a molecular understanding of biomass variability that occurs naturally and as a result of storage or preprocessing techniques applied to feedstocks, to understand chemical reactions occurring during pyrolysis and other biomass or polymer conversion techniques. Using two dimensional gas chromatography mass spectrometry coupled to analytical pyrolysis provides insight into the molecular changes that occur during the pyrolysis event, and these insights can extend to bench or pilot scale pyrolysis conversions. Understanding pyrolysis of biomass and polymers at a molecular level contributes to development of new tools to predict and manipulate the optimum conditions and identify the best storage, preprocessing, and conversion techniques to maximize output of specific high-value chemical species in the conversion to fuels, or to characterize feedstocks for blending before pyrolysis. Identification and understanding of the molecular level changes resulting from novel preprocessing techniques that can be used to control and manipulate the chemical output of bench or pilot scale pyrolysis is another focus of investigation, including the use of gamma irradiation, acid, or enzyme pre-treatments. We also focus on the impacts of storage conditions and techniques, which can affect moisture levels, degradation, and impacts from naturally occurring microbes in the environment.

09 BIOMASS FUELS↗

NASA NTRSDate not supplied

Using Earth Observations to Analyze Vegetation Phenology and Climatology in Bhutan to Identify Forest Disturbance

Changes in climate in the Himalayan region cause variability in temperature, precipitation, and phenology. It can also impact the health of coniferous forest ecosystems including increased damage due to aggressive forest pests. Forest disturbance from bark beetle is a major concern in Bhutan, sometimes causing extensive tree mortality to pine and spruce forests. Climatological trends and changes in vegetation phenology were analyzed and incorporated into a tool in Google Earth Engine that identified patches of forest disturbance in Bhutan. Preprocessed phenology and meteorological data from the Advanced Very High-Resolution Radiometer (AVHRR) and Terra and Aqua Moderate Resolution Imaging Spectroradiometer (MODIS), along with Climate Hazards Center Infrared Precipitation with Station (CHIRPS), Famine Early Warning System Network Land Data Assimilation System (FLDAS), Sentinel-2 Multispectral Instrument (MSI), and Landsat 5 Thematic Mapper (TM), Landsat 7 Enhanced Thematic Mapper (ETM)+, and Landsat 8 Operational Land Imager (OLI) were used within the tool. Changes in temperature, precipitation, and phenology were analyzed throughout Bhutan, and forest disturbance caused by bark beetle was investigated in two districts of the country

Tashi Choden↗

NASA NTRS2010

Data Access Services that Make Remote Sensing Data Easier to Use

This slide presentation reviews some of the processes that NASA uses to make the remote sensing data easy to use over the World Wide Web. This work involves much research into data formats, geolocation structures and quality indicators, often to be followed by coding a preprocessing program. Only then are the data usable within the analysis tool of choice. The Goddard Earth Sciences Data and Information Services Center is deploying a variety of data access services that are designed to dramatically shorten the time consumed in the data preparation step. On-the-fly conversion to the standard network Common Data Form (netCDF) format with Climate-Forecast (CF) conventions imposes a standard coordinate system framework that makes data instantly readable through several tools, such as the Integrated Data Viewer, Gridded Analysis and Display System, Panoply and Ferret. A similar benefit is achieved by serving data through the Open Source Project for a Network Data Access Protocol (OPeNDAP), which also provides subsetting. The Data Quality Screening Service goes a step further in filtering out data points based on quality control flags, based on science team recommendations or user-specified criteria. Further still is the Giovanni online analysis system which goes beyond handling formatting and quality to provide visualization and basic statistics of the data. This general approach of automating the preparation steps has the important added benefit of enabling use of the data by non-human users (i.e., computer programs), which often make sub-optimal use of the available data due to the need to hard-code data preparation on the client side.

Lynnes, Christopher↗

NASA NTRSDate not supplied

WET Water Resources: A Google Earth Engine Python API Tool to Automate Wetland Extent Mapping Using Radar Satellite Sensors for Wetland Management and Monitoring

Wetland ecosystems are annually or seasonally wet transition zones between land and water. They provide a range of ecosystem services such as water filtration, flood mitigation, and carbon sequestration, as well as hosting biodiversity hotspots. Although they fulfill fundamental physical and natural processes, wetland extent and health are threatened by anthropogenic influences related to urbanization, population increase, pollution, and climate change. Recognizing the need to quantitatively monitor changes in these recently threatened ecosystems in a timely and cost-effective way, we developed a Google Earth Engine (GEE) Python API tool for automated wetland extent mapping using optical and radar satellite sensors that can be applied globally. The tool will significantly improve wetland change analysis and monitoring as the optical and SAR data proves high resolution (5-10 m) imagery, and SAR data is unaffected by cloud cover and light availability (day vs. night), which are common limitations for other remotely sensed sensors. The tool utilizes Copernicus Sentinel-1 C-band and NISAR L-band synthetic aperture radar (SAR) imagery. During image preprocessing, we applied a MODIS snow mask product to mask global snow coverage, which would affect land classification sensitivity. Calibration and validation were conducted through a historical change and sensitivity analysis of the Sudd watershed located in central Sudan. The tool was the first of its kind, as it enables NISAR data processing through an open-source GEE repository, further expanding and improving the utility of NASA Earth observations and contributing to NASA Open Science initiatives. We anticipate the tool will be used by researchers and practitioners interested in wetland monitoring and management..

Lori Berberian↗

DOE OSTI2025

Enhancing the shredder durability for biomass preprocessing by utilizing wear-resistant cutter materials

Shredders are widely used to reduce biomass feedstock size through the shearing action of the cutter teeth that are susceptible to wear. A series of wear tests using a custom-built shredder was conducted on corn stover feedstock with three cutter materials: a conventional D2 tool steel, iron boriding as a candidate surface treatment, and M42 tool steel as a candidate alloy. Wear tests showed that the iron borided D2 steel significantly increased the tool life compared with the non-treated D2 and M42. Although the M42 cutters initially exhibited less wear than the D2 cutters, the benefit faded as preprocessing progressed. In conclusion, the experimental results demonstrated that the durability of shredder cutters can be substantially improved by applying more wear-resistant tool materials.

09 - BIOMASS FUELS↗

DOE OSTI2023

Improving multiwell petrophysical interpretation from well logs via machine learning and statistical models

Well-log interpretation estimates in situ rock properties along well trajectory, such as porosity, water saturation, and permeability, to support reserve-volume estimation, production forecasts, and decision making in reservoir development. However, due to measurement errors, variability of well logs caused by multiple measurement vendors, different borehole tools, and nonuniform drilling/borehole conditions, estimations of rock properties with original well logs without proper preprocessing may not be accurate, especially in the context of multiwell estimation. Well-log normalization techniques such as two-point scaling and mean-variance normalization are commonly used to improve the robustness of multiwell rock-property estimation. However, these techniques do not consider the correlation between well logs and require subjective knowledge for their effective implementation. To reduce uncertainties and processing time associated with multiwell rock-property estimation from well logs, we develop discriminative adversarial (DA) and linear constraint models for well-log normalization and rock-property estimation. The DA neural network model developed for well-log normalization and interpretation can perform linear and nonlinear well-log normalization while considering the joint distribution of each well log and rock properties. However, the linear constraint model uses an ensemble of predictions from linear models to constrain well-log normalization and rock-property estimation. We also develop a divergence-based type well identification method to select type (training) wells for a test well based on the statistical similarity of associated well-log distributions instead of the interwell distance. We apply the DA model to perform well-log normalization and prediction of permeability for the Seminole San Andres Unit carbonate reservoir. Compared with the permeability predicted with the classical machine learning model without well-log normalization and models with two-point scaling normalization, the DA model yields the most accurate permeability prediction by decreasing the mean-squared error of permeability prediction by 20%–50%.

Geochemistry & Geophysics↗

NASA NTRSDate not supplied

Implementing Geometric Surface Imperfections into Sandwich Composite Cylinder Finite Element Method Models

The buckling responses of certain cylindrical shell structures are extremely sensitive to geometric imperfections. The NASA Engineering and Safety Center (NESC) Shell Buckling Knockdown Factor Project (SBKF) is conducting research to develop analysis-based buckling design recommendations. Experiments are used to verify the analysis-based factors, but the sensitivity of the test articles to geometric imperfections requires implementing as-manufactured imperfections into high-fidelity finite element method (FEM) models. Geometry measurement methods such as structured light scanning are used for all geometric surface data used in this work. Common preprocessing and visualization steps used in SBKF are discussed, and steps of how surface scans are prepared for implementation into a finite element model is described. The Python Tool for Implementing Geometric Imperfections in Reduced Structures (Py_TIGIRS), written specifically for the use with SBKF, is briefly described and uses eight functions to extract, modify, and write geometric imperfections into Abaqus input files. Results of the preprocessing methods and results from Py_TIGIRS are provided and compared for Composite Test Articles (CTA) 8.2, 8.2B, and 8.3. Excellent agreement between the visualized scan data and the FEM-extracted geometry is demonstrated. A brief example of why geometric surface imperfections are significant in nonlinear numerical analyses for thin cylinders in axial compression is provided as motivation to use tools such as Py_TIGIRS. Future developments of Py_TIGIRS including expansion to structures of arbitrary geometry is planned.

Geometric imperfections↗