Search NASA⌕ Search

SEARCH · Search NASA

Results for “Preprocessing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Aggregation Methods for Quantifying PTM and Structural Changes in Bottom-Up Proteomics

Bottom-up proteomic workflows rely on sequential preprocessing steps, commonly including peptide-to-protein aggregation (“roll-up”), to enhance data reliability and interpretability. While roll-up is effective for protein-centered analyses, it may be suboptimal for applications focused on post-translational modifications (PTMs) or protein structural changes, such as limited proteolysis–mass spectrometry (LiP-MS). Here, we investigate how different roll-up strategies influence site-level quantification in PTM differential analysis. Moreover, we introduce a novel site-centric roll-up approach tailored for LiP-MS, which quantifies proteolytic fragments rather than solely tryptic peptides. We benchmark these methods through simulation studies, comparing their sensitivity and specificity in detecting structural and PTM-driven changes. We found that the median and mean roll-up methods outperform the sum method in both PTM and LiP proteomics, and site-level quantification in LiP outperforms peptide-level quantification. Our findings offer the first systematic, data-driven guidance for selecting roll-up techniques in site-level proteomic analyses, with implications for both PTM-focused and structural proteomics studies.

aggregation↗
DOE OSTI2025

Tutorial: Machine-Learning-Based CREASE-2D Analysis of 2D SAXS Profiles to Characterize Anisotropic Nanostructures in Soft Materials

We present a tutorial to guide users on how to extend the Computational Reverse Engineering Analysis of Scattering Experiments-2D (CREASE-2D) framework to interpret their experimental two-dimensional small-angle scattering (SAS) data from soft materials (e.g., polymers, peptide amphiphiles, biomolecular fibrils). Unlike most traditional SAS analysis approaches, which typically rely on azimuthally averaged onedimensional (1D) profiles, CREASE-2D utilizes the complete 2D scattering profile to reveal information about anisotropy in the structure. In past applications, CREASE has provided insights into complex structural features, including the cross-sectional shapes of assembled nanostructures and dispersity in these features, which are difficult to discern with existing analytical models. While (1D- ) CREASE has been applied to SANS and SAXS data, this tutorial shares the steps for implementing CREASE-2D using an example of a dipeptide solution system, for which we have SAXS data. We present details for these steps involved in using CREASE-2D to interpret SAXS profiles: how to preprocess SAXS data, define relevant structural features, generate three-dimensional real-space structures for specific values of these features, train a machine learning (ML) surrogate model to predict scattering profiles for given structural features, and optimize these features using genetic algorithms (GA). Then, we use these steps to interpret complex 2DSAXS data collected from dipeptide solutions that, in microscopy images, exhibit nanoscale structures that could be elliptical tubes/ flat tapes/cylinders or a combination of these cross sections. Open-source codes, computational hardware, and software requirements, as well as the strengths and limitations of this protocol, are also presented. We expect researchers working with (soft) biomaterials, peptide amphiphiles, amphiphilic polymer solutions, polymer nanocomposites, and blends of particles/polymers will find this CREASE-2D method and this tutorial of use.

CREASE↗
DOE OSTI2020

Composition-Preserving Extraction and Characterization of Biomass Extrinsic and Intrinsic Inorganic Compounds

The inorganic content of biomass impairs size reduction tool life and the conversion process. Conventional ash extraction relies on furnace combustion that inevitably alters the inorganic compounds due to oxidation and decomposition. This study developed composition-preserving methods for extracting and analyzing extrinsic and intrinsic inorganic compounds. Comprehensive characterization was carried out on selected biomass feedstocks, including corn stover, pine residue, and pine anatomical fractions, to reveal their inorganic species and morphology. The extrinsic inorganic compounds were found to be dominated by quartz, along with other minor minerals, such as albite, microcline, and gehlenite, and have particle sizes ranging from tens to hundreds of micrometers. Among the pine anatomical fractions, the needles contain the highest intrinsic silicon content while the bark trapped the most extrinsic minerals. By correlation of the total ash and extrinsic inorganic contents to the wear behavior, both the extrinsic and intrinsic inorganic compounds were concluded to have made significant contributions to the wear process. Finally, the results here validated a new approach to characterize inorganic compounds in biomass and provided fundamental insights for their potential impact on preprocessing tool wear.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Signatures of Biologically Driven Hemicellulose Modification Quantified by Analytical Pyrolysis Coupled with Multidimensional Gas Chromatography Mass Spectrometry

Biomass storage operation is one major source of feedstock quality variability that impacts on downstream preprocessing, feeding, handling and conversion into biofuels, chemicals and products. In field Ccorn stover biomass bales undergoes degradation and cell wall components modification resulting from microbial biological heating occurring during storage. A molecular characterization of the modification was achieved to unveil and understand the changes of structural cell wall modification in corn stover samples by conducting low temperature (400°C) pyrolysis, comparing samples that were mildly biologicallyun heated to those that had been subjected to microbial severe biological heating (~60°C). Pyrolysis of the samples originating from biomass that had been heated during storage generated small oxygenates such as furfural, 5-methylfurfural and 2-(5H)-furanone with efficiencies that were as much as ten times greater than those measured for the mildly unheated samples. Most of the compounds having enhanced efficiencies were C5 oxygenates, suggesting that the pyrolysis products may be formed from hemicellulosic precursor polymers in the corn stover. The findings suggest that microbial heating may be disrupting the cell wall structure, fragmenting the hemicellulose or cellulose chains, generating more polymer termini that have higher efficiency for generating the oxygenates at lower temperatures. Pyrolysis variability with temperature may be a beneficial strategy for improved biomass cell wall characterization, and for guiding control strategies for enhanced control over product distributions , providing insights to understand and manage the feedstock variability as well as to inform harvest and storage best management practices.

09 BIOMASS FUELS↗
DOE OSTI2020

Dynamic Life-Cycle Analysis of Fast Pyrolysis Biorefineries: Impacts of Feedstock Moisture Content and Particle Size

The commercialization of biorefineries has been met with significant obstacles due to the technical difficulties of handling solid biomass feedstocks, which are highly variable in physical properties and chemical compositions. An understanding of the principles of unit operations along the supply chain is key to the success of the biofuel industry. This study applies a dynamic life-cycle analysis (DLCA) methodology by developing quantitative relationships between the inputs and outputs for each unit operation based on scientific understanding of the causal effects. Using the DLCA, we assessed system sustainability of drop-in fuel production from fast pyrolysis of pine residues followed by hydro-processing. Life-cycle greenhouse gas (GHG) emissions were calculated for 4641 runs involving two key feedstock parameters: moisture content after field drying and particle size of the feed to pyrolyzer. Moisture contents varied between 25% and 35%, while particle sizes varied between 0.5 and 5 mm in these runs. The life-cycle GHG emissions of these cases vary from 22 to 40 g/MJ. Close examination of each unit operation's contribution to the total GHG emissions reveals that low moisture content after field drying produces savings in energy consumption during feedstock transportation and on-site drying. However, although small particle size leads to overall higher fuel yield, it also requires a significant amount of energy for feedstock size reduction and fuel production. The energy penalty outweighs the benefit of increased fuel yields, especially when fine particles (<1 mm) are used for pyrolysis; thus, small particle size leads to increased GHG emissions overall. The results highlight the trade-offs between the energy demand for preprocessing and the conversion yields, which can be addressed with DLCA.

09 BIOMASS FUELS↗
DOE OSTI2021

Defect detection in atomic-resolution images via unsupervised learning with translational invariance

Abstract Crystallographic defects can now be routinely imaged at atomic resolution with aberration-corrected scanning transmission electron microscopy (STEM) at high speed, with the potential for vast volumes of data to be acquired in relatively short times or through autonomous experiments that can continue over very long periods. Automatic detection and classification of defects in the STEM images are needed in order to handle the data in an efficient way. However, like many other tasks related to object detection and identification in artificial intelligence, it is challenging to detect and identify defects from STEM images. Furthermore, it is difficult to deal with crystal structures that have many atoms and low symmetries. Previous methods used for defect detection and classification were based on supervised learning, which requires human-labeled data. In this work, we develop an approach for defect detection with unsupervised machine learning based on a one-class support vector machine (OCSVM). We introduce two schemes of image segmentation and data preprocessing, both of which involve taking the Patterson function of each segment as inputs. We demonstrate that this method can be applied to various defects, such as point and line defects in 2D materials and twin boundaries in 3D nanocrystals.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Forecasting of in situ electron energy loss spectroscopy

Abstract Forecasting models are a central part of many control systems, where high-consequence decisions must be made on long latency control variables. These models are particularly relevant for emerging artificial intelligence (AI)-guided instrumentation, in which prescriptive knowledge is needed to guide autonomous decision-making. Here we describe the implementation of a long short-term memory model (LSTM) for forecasting in situ electron energy loss spectroscopy (EELS) data, one of the richest analytical probes of materials and chemical systems. We describe key considerations for data collection, preprocessing, training, validation, and benchmarking, showing how this approach can yield powerful predictive insight into order-disorder phase transitions. Finally, we comment on how such a model may integrate with emerging AI-guided instrumentation for powerful high-speed experimentation.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Cryo2StructData: A Large Labeled Cryo-EM Density Map Dataset for AI-based Modeling of Protein Structures

The advent of single-particle cryo-electron microscopy (cryo-EM) has brought forth a new era of structural biology, enabling the routine determination of large biological molecules and their complexes at atomic resolution. The high-resolution structures of biological macromolecules and their complexes significantly expedite biomedical research and drug discovery. However, automatically and accurately building atomic models from high-resolution cryo-EM density maps is still time-consuming and challenging when template-based models are unavailable. Artificial intelligence (AI) methods such as deep learning trained on limited amount of labeled cryo-EM density maps generate inaccurate atomic models. To address this issue, we created a dataset called Cryo2StructData consisting of 7,600 preprocessed cryo-EM density maps whose voxels are labelled according to their corresponding known atomic structures for training and testing AI methods to build atomic models from cryo-EM density maps. Cryo2StructData is larger than existing, publicly available datasets for training AI methods to build atomic protein structures from cryo-EM density maps. We trained and tested deep learning models on Cryo2StructData to validate its quality showing that it is ready for being used to train and test AI methods for building atomic models.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

In situ melt pool measurements for laser powder bed fusion using multi sensing and correlation analysis

Laser powder bed fusion is a promising technology for local deposition and microstructure control, but it suffers from defects such as delamination and porosity due to the lack of understanding of melt pool dynamics. To study the fundamental behavior of the melt pool, both geometric and thermal sensing with high spatial and temporal resolutions are necessary. This work applies and integrates three advanced sensing technologies: synchrotron X-ray imaging, high-speed IR camera, and high-spatial-resolution IR camera to characterize the evolution of the melt pool shape, keyhole, vapor plume, and thermal evolution in Ti–6Al–4V and 410 stainless steel spot melt cases. Aside from presenting the sensing capability, this paper develops an effective algorithm for high-speed X-ray imaging data to identify melt pool geometries accurately. Preprocessing methods are also implemented for the IR data to estimate the emissivity value and extrapolate the saturated pixels. Quantifications on boundary velocities, melt pool dimensions, thermal gradients, and cooling rates are performed, enabling future comprehensive melt pool dynamics and microstructure analysis. The study discovers a strong correlation between the thermal and X-ray data, demonstrating the feasibility of using relatively cheap IR cameras to predict features that currently can only be captured using costly synchrotron X-ray imaging. Such correlation can be used for future thermal-based melt pool control and model validation.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Cost function for low-dimensional manifold topology assessment

Abstract In reduced-order modeling, complex systems that exhibit high state-space dimensionality are described and evolved using a small number of parameters. These parameters can be obtained in a data-driven way, where a high-dimensional dataset is projected onto a lower-dimensional basis. A complex system is then restricted to states on a low-dimensional manifold where it can be efficiently modeled. While this approach brings computational benefits, obtaining a good quality of the manifold topology becomes a crucial aspect when models, such as nonlinear regression, are built on top of the manifold. Here, we present a quantitative metric for characterizing manifold topologies. Our metric pays attention to non-uniqueness and spatial gradients in physical quantities of interest, and can be applied to manifolds of arbitrary dimensionality. Using the metric as a cost function in optimization algorithms, we show that optimized low-dimensional projections can be found. We delineate a few applications of the cost function to datasets representing argon plasma, reacting flows and atmospheric pollutant dispersion. We demonstrate how the cost function can assess various dimensionality reduction and manifold learning techniques as well as data preprocessing strategies in their capacity to yield quality low-dimensional projections. We show that improved manifold topologies can facilitate building nonlinear regression models.

42 ENGINEERING↗
DOE OSTI2022

Electron energy loss spectroscopy database synthesis and automation of core-loss edge recognition by deep-learning neural networks

Abstract The ionization edges encoded in the electron energy loss spectroscopy (EELS) spectra enable advanced material analysis including composition analyses and elemental quantifications. The development of the parallel EELS instrument and fast, sensitive detectors have greatly improved the acquisition speed of EELS spectra. However, the traditional way of core-loss edge recognition is experience based and human labor dependent, which limits the processing speed. So far, the low signal–noise ratio and the low jump ratio of the core-loss edges on the raw EELS spectra have been challenging for the automation of edge recognition. In this work, a convolutional-bidirectional long short-term memory neural network (CNN-BiLSTM) is proposed to automate the detection and elemental identification of core-loss edges from raw spectra. An EELS spectral database is synthesized by using our forward model to assist in the training and validation of the neural network. To make the synthesized spectra resemble the real spectra, we collected a large library of experimentally acquired EELS core edges. In synthesize the training library, the edges are modeled by fitting the multi-Gaussian model to the real edges from experiments, and the noise and instrumental imperfectness are simulated and added. The well-trained CNN-BiLSTM network is tested against both the simulated spectra and real spectra collected from experiments. The high accuracy of the network, 94.9%, proves that, without complicated preprocessing of the raw spectra, the proposed CNN-BiLSTM network achieves the automation of core-loss edge recognition for EELS spectra with high accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Unsupervised classification for region of interest in X-ray ptychography

X-ray ptychography offers high-resolution imaging of large areas at a high computational cost due to the large volume of data provided. To address the cost issue, we propose a physics-informed unsupervised classification algorithm that is performed prior to reconstruction and removes data outside the region of interest (RoI) based on the multimodal features present in the diffraction patterns. The preprocessing time for the proposed method is inconsequential in contrast to the resource-intensive reconstruction process, leading to an impressive reduction in the data workload to a mere 20% of the initial dataset. This capability consequently reduces computational time dramatically while preserving reconstruction quality. Through further segmentation of the diffraction patterns, our proposed approach can also detect features that are smaller than beam size and correctly classify them as within the RoI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Explainable tokamak-agnostic forecasting of fusion plasma instability via megahertz turbulent fluctuations

Scientific applications of artificial intelligence (AI) often remain limited by device-specific training and unexplained “black-box” approaches, creating fundamental barriers to cross-system generalization. This challenge is critical for nuclear fusion, where future reactors will have limited operational data for AI training. Here, we demonstrate that our neural network, trained solely on megahertz-scale turbulence measurements from one machine (DIII-D), forecasts Type-I edge localized mode (ELM) onsets in a different tokamak (KSTAR) through zero-shot weight transfer following physics-consistent preprocessing without device-specific retraining. Through an explainable AI framework combining gradient-weighted class activation mapping with physics validation, we reveal that our network can internalize physics relationships governing the ELM instabilities rather than memorizing device-specific patterns. The network perceives spatiotemporal features that correlate consistently with independently calculated instability growth rates, magnetohydrodynamic stability limits, and pedestal structure dynamics. Statistical analyses of dimensionally-reduced saliency features reveal the identical triangular features between the saliency representations, instability growth rates, and prediction probability across tokamaks, providing evidence that our forecasting system can show tokamak-agnostic generalization. This work contributes to a foundation for explainable scientific AI systems, where cross-system developments are essential for transcending traditional domain-specific constraints.

AI↗
DOE OSTI2019

Lignin valorization process control under feedstock uncertainty through a dynamic stochastic programming approach

The randomness introduced by reactants is an issue when processing renewable bioresources. In this paper, we apply tools from dynamic stochastic programming theory to the biochemical process. Instead of introducing extra preprocessing units, we consider the inherent randomness of the process and optimize in expectation the performance of the system. In a general setting, this is a multistage stochastic optimization problem and we investigate its approximate solution via two approaches, namely stochastic dual dynamic programming (SDDP) and the finite state, finite action Markov decision process (MDP) framework. These two methods are implemented to a case study of lignin valorization that is crucial to a cost-effective biorefinery process using biomass as the feedstock.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

ChemPren: a new and economical technology for conversion of waste plastics to light olefins

With the ever-increasing demand for plastics, sustainable recycling methods are key necessities. Here, the current plastics industry can manage to recycle only 10% of the 400 million metric tons of plastic produced globally. Waste plastics, in the current infrastructure, land up mostly in landfills. Although a lot of research efforts have been spent on processing and recycling co-mingled mixed plastics, energy-efficient sustainable and scalable routes for plastic upcycling are still lacking. Catalytic valorization of waste plastic feedstock is one of the potential scalable routes for plastic upcycling. Silica-alumina based materials, and zeolites have shown a lot of promise. A major interest lies in restricting catalyst deactivation, and refining product selectivity and yield for such catalytic processes. This article highlights ChemPren technology as a clean energy solution to waste plastic recycling. Co-mingled, mixed plastic feedstock along with spray dried, attrition resistant, ZSM-5 containing catalysts is preprocessed with an extruder to form optimally sized particles and fed into a fluidized bed reactor for short contact times to produce selectively and in high yields ethylenes, propylenes and butylenes. This techno-economic perspective indicates that the ChemPren technology can produce propylene at $\$$0.16 per lb, whereas the current selling price of virgin propylene is $0.54 per lb. This technology can serve as a platform for mixed plastic upcycling, with more advancements necessary in the form of robust and resilient catalysts and reactor operation strategies for tuning product selectivity.

25 - ENERGY STORAGE↗
DOE OSTI2019

Towards an Intelligent Data Delivery Service

The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

New Physics Agnostic Selections For New Physics Searches

We discuss a model-independent strategy for boosting new physics searches with the help of an unsupervised anomaly detection algorithm. Prior to a search, each input event is preprocessed by the algorithm - a variational autoencoder (VAE). Based on the loss assigned to each event, input data can be split into a background control sample and a signal enriched sample. Following this strategy, one can enhance the sensitivity to new physics with no assumption on the underlying new physics signature. Our results show that a typical BSM search on the signal enriched group is more sensitive than an equivalent search on the original dataset.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗