Search NASA⌕ Search

SEARCH · Search NASA

Results for “process data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗
DOE OSTI2024

metabCombiner 2.0: Disparate Multi-Dataset Feature Alignment for LC-MS Metabolomics

Liquid chromatography–high-resolution mass spectrometry (LC-HRMS), as applied to untargeted metabolomics, enables the simultaneous detection of thousands of small molecules, generating complex datasets. Alignment is a crucial step in data processing pipelines, whereby LC-MS features derived from common ions are assembled into a unified matrix amenable to further analysis. Variability in the analytical factors that influence liquid chromatography separations complicates data alignment. This is prominent when aligning data acquired in different laboratories, generated using non-identical instruments, or between batches from large-scale studies. Previously, we developed metabCombiner for aligning disparately acquired LC-MS metabolomics datasets. Here, we report significant upgrades to metabCombiner that enable the stepwise alignment of multiple untargeted LC-MS metabolomics datasets, facilitating inter-laboratory reproducibility studies. To accomplish this, a “primary” feature list is used as a template for matching compounds in “target” feature lists. We demonstrate this workflow by aligning four lipidomics datasets from core laboratories generated using each institution’s in-house LC-MS instrumentation and methods. We also introduce batchCombine, an application of the metabCombiner framework for aligning experiments composed of multiple batches. metabCombiner is available as an R package on Github and Bioconductor, along with a new online version implemented as an R Shiny App.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2018

Real-time software upgrade

The various technologies presented herein relate to upgrading industrial control software in real-time. During utilization of a first software to control an industrial process, a determination can be made that the first software needs to be replaced (e.g., partially or entirely) owing to a newer version of software is ready to be deployed, a vulnerability in the first software has been determined, etc. Rather than closing the industrial process down while the first software is replaced, a second software can be deployed such that the first software and the second software are operating in parallel (e.g., receiving the same operational data, process states). When a critical point (upgrade location) in the first software has been reached, control of the industrial process can be switched to the second software, thereby enabling control of the industrial process to occur without having to temporarily cease operation and/or monitoring of the industrial process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗
DOE OSTI2023

Effects of error, chimera, bias, and GC content on the accuracy of amplicon sequencing

ABSTRACT Targeted amplicon sequencing is widely used in microbial ecology studies. However, sequencing artifacts and amplification biases are of great concern. To identify sources of these artifacts, a systematic analysis was performed using mock communities comprised of 16S rRNA genes from 33 bacterial strains. Our results indicated that while sequencing errors were generally isolated to low-abundance operational taxonomic units, chimeric sequences were a major source of artifacts. Singleton and doubleton sequences were primarily chimeras. Formation of chimeric sequences was significantly correlated with the GC content of the targeted sequences. Low-GC-content mock community members exhibited lower rates of chimeric sequence formation. GC content also had a large impact on sequence recovery. The quantitative capacity was notably limited, with substantial recovery variations and weak correlation between anticipated and observed strain abundances. The mock community strains with higher GC content had higher recovery rates than strains with lower GC content. Amplification bias was also observed due to the differences in primer affinity. A two-step PCR strategy reduced the number of chimeric sequences by half. In addition, comparative analyses based on the mock communities showed that several widely used sequence processing pipelines/methods, including DADA2, Deblur, UCLUST, UNOISE, and UPARSE, had different advantages and disadvantages in artifact removal and rare species detection. These results are important for improving sequencing quality and reliability and developing new algorithms to process targeted amplicon sequences. IMPORTANCE Amplicon sequencing of targeted genes is the predominant approach to estimate the membership and structure of microbial communities. However, accurate reconstruction of community composition is difficult due to sequencing errors, and other methodological biases and effective approaches to overcome these challenges are essential. Using a mock community of 33 phylogenetically diverse strains, this study evaluated the effect of GC content on sequencing results and tested different approaches to improve overall sequencing accuracy while characterizing the pros and cons of popular amplicon sequence data processing approaches. The sequencing results from this study can serve as a benchmarking data set for future algorithmic improvements. Furthermore, the new insights on sequencing error, chimera formation, and GC bias from this study will help enhance the quality of amplicon sequencing studies and support the development of new data analysis approaches.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Marine Energy Environmental Permitting and Compliance Costs

Costs to permit Marine Energy projects are poorly understood. In this paper we examine environmental compliance and permitting costs for 19 projects in the U.S., covering the last 2 decades. Guided discussions were conducted with developers over a 3-year period to obtain historical and ongoing project cost data relative to environmental studies (e.g., baseline or pre-project site characterization as well as post-installation effects monitoring), stakeholder outreach, and mitigation, as well as qualitative experience of the permitting process. Data are organized in categories of technology type, permitted capacity, pre- and post-installation, geographic location, and funding types. We also compare our findings with earlier logic models created for the Department of Energy (i.e., Reference Models). Environmental studies most commonly performed were for Fish and Fisheries, Noise, Marine Habitat/Benthic Studies and Marine Mammals. Studies for tidal projects were more expensive than those performed for wave projects and the range of reported project costs tended to be wider than ranges predicted by logic models. For eight projects reporting full project costs, from project start to FERC or USACE permit, the average amount for environmental permitting compliance was 14.6%.

16 TIDAL AND WAVE POWER↗
DOE OSTI2025

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Determination of monitor unit check tolerances based on a comparison with measurement and treatment planning system data

ABSTRACT: This work describes the experimental validation of treatment planning system monitor unit (MU) calculations against measurement for a range of scenarios. This, together with a comparison of treatment planning system MUs and an independent MU check method, allows the derivation of confidence intervals for the check process. Data were collected for open and 60° motorized wedge fields using an Elekta Synergy linac at 6 and 8 MV using homogeneous and heterogeneous phantoms. Masterplan (Version 4.0) pencil-beam and collapsed cone algorithms were used for the primary MU calculations with full inhomogeneity correction. Results show that both algorithms agree with measurement to acceptable tolerance levels in the majority of the cases studied. The confidence interval for the pencil-beam algorithm MU against an independent check was determined as + 1.6% to −3.4%. This is modified to + 2.3% to −2.5% when data collected with low-density heterogeneities are removed as this algorithm is not used clinically for these cases. The corresponding interval for the collapsed cone algorithm was + 1.2% to −4.3%, indicating that an offset tolerance for the independent check is appropriate. Analysis of clinical conformal treatment plan data generated using the pencil-beam algorithm (1393 beams) returned 93% of beams within the independent check tolerance. Similarly, using the collapsed cone algorithm as the primary MU calculation, 77% (of 1434 beams) were within the confidence interval.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2018

Binary interaction parameters from reacting mixture data. Supercritical biodiesel process with CO 2 as cosolvent

A method is presented for the calculation of binary interaction parameters from reacting mixture data. The process studied is the supercritical methanol transesterification of triolein with CO 2 as cosolvent. The reaction proceeds through 3 reversible reactions in series, on a solid catalyst (Nafion(R) SAC-13), for which the kinetics is known. To describe the reactor performance, the kinetic constants and the binary interaction parameters for the Peng-Robinson equation of state, are necessary, and were included in the reactor model. Previously published view-cell observations and thermodynamic calculations indicate that no condensation occurs in the reactor. Kinetic and thermodynamic parameters were determined by a global optimisation procedure. From the rate constants obtained, the process exhibits some reversibility, despite the excess of methanol used. Our methodology allows to obtain the binary interaction coefficients for the intermediate reaction species (dioleins and monooleins) that were unavailable so far. The method is sensitive to the errors in the measured concentrations.

09 BIOMASS FUELS↗
DOE OSTI2012

Upstream Measurements of Wind Profiles with Doppler Lidar for Improved Wind Energy Integration

New upstream measurements of wind profiles over the altitude range of wind turbines will be produced using a scanning Doppler lidar. These long range high quality measurements will provide improved wind power forecasts for wind energy integration into the power grid. The main goal of the project is to develop the optimal Doppler lidar operating parameters and data processing algorithms for improved wind energy integration by enhancing the wind power forecasts in the 30 to 60 minute time frame, especially for the large wind power ramps. Currently, there is very little upstream data at large wind farms, especially accurate wind profiles over the full height of the turbine blades. The potential of scanning Doppler lidar will be determined by rigorous computer modeling and evaluation of actual Doppler lidar data from the WindTracer system produced by Lockheed Martin Coherent Technologies, Inc. of Louisville, Colorado. Various data products will be investigated for input into numerical weather prediction models and statistically based nowcasting algorithms. Successful implementation of the proposed research will provide the required information for a full cost benefit analysis of the improved forecasts of wind power for energy integration as well as the added benefit of high quality wind and turbulence information for optimal control of the wind turbines at large wind farms.

17 WIND ENERGY↗
DOE OSTI2021

Charged Particle Transport Libraries (Final Report FY2020 Level-2 Milestone #7127)

This document is the final report on the status and developments of the Charged-Particle Transport (CPT) Level-2 (“CP2020”) ASC/PEM Milestone work. This section gives an overview of the CP2020 work partitioned into two subsections: 1) a summary of the code tools used for generating CP (and other) data in Section 1.2; and 2) and library data and codes access information for end users in Section 1.3. Section 2 gives an overview of the status of previous work on charged-particle (CP) nuclear data, particularly focused on the work of the FY2011 CP Level-2 Milestone. New work for CP2020 is detailed in the following Section 3. Section 4 discusses testing and validation of the evaluated and processed data for the CP2020 library. Conclusions based on the experience of this Level-2 work and the outlook for future development of CPT-relevant data are given in the final Section 5. Appendices, detailed throughout the report, are provided for further information. This report, related documentation, codes, and the CPT nuclear data libraries are available via online repository.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

User Manual for MC 2 -3 Gamma Library Generation

This report provides the documentation for the revised procedure to generate the MC 2 -3 gamma library with the latest versions of PreGAMMA and GenGAMMA which have recently been updated to fix the program errors and inconsistent data processing for some isotopes identified in a recent verification and validation study of the MC 2 -3 gamma library. A few associated errors associated with gamma processing were also identified and fixed in the MC 2 -3 code. Addressing the changes in MC 2 -3, the procedure to generate the PMATRX and GAMISO datasets is discussed as well. The input data of PreGAMMA and GenGAMMA are discussed in detail using sample input data. In addition, the structure and formats of the MC 2 -3 gamma library are provided in detail.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2017

OpenMSI Arrayed Analysis Toolkit: Analyzing Spatially Defined Samples Using Mass Spectrometry Imaging

Mass spectrometry imaging (MSI) has primarily been applied in localizing biomolecules within biological matrices. Although well-suited, the application of MSI for comparing thousands of spatially defined spotted samples has been limited. One reason for this is a lack of suitable and accessible data processing tools for the analysis of large arrayed MSI sample sets. In this paper, the OpenMSI Arrayed Analysis Toolkit (OMAAT) is a software package that addresses the challenges of analyzing spatially defined samples in MSI data sets. OMAAT is written in Python and is integrated with OpenMSI (http://openmsi.nersc.gov), a platform for storing, sharing, and analyzing MSI data. By using a web-based python notebook (Jupyter), OMAAT is accessible to anyone without programming experience yet allows experienced users to leverage all features. OMAAT was evaluated by analyzing an MSI data set of a high-throughput glycoside hydrolase activity screen comprising 384 samples arrayed onto a NIMS surface at a 450 μm spacing, decreasing analysis time >100-fold while maintaining robust spot-finding. The utility of OMAAT was demonstrated for screening metabolic activities of different sized soil particles, including hydrolysis of sugars, revealing a pattern of size dependent activities. Finally, these results introduce OMAAT as an effective toolkit for analyzing spatially defined samples in MSI. OMAAT runs on all major operating systems, and the source code can be obtained from the following GitHub repository: https://github.com/biorack/omaat.

47 OTHER INSTRUMENTATION↗
DOE OSTI2019

Data Management at the Advanced Photon Source

Data are crucial to the scientific discoveries enabled by experiments performed at the APS. Presently the APS generates approximately 10 PB of raw experimental data per year from its sixty-six operating beamlines that house over 100 unique instruments. This data is generated as a part of over 6,000 annual experiments performed by over 5,500 facility users each year. Similar to other synchrotrons, the amount of data generated at the APS continues to quickly increase due to beamline advances, such as new measurement techniques, technological advances in detectors, high-throughput instrumentation, multi-modal instruments that can acquire several measurements in a single experiment, and advanced data processing algorithms. This trend is expected to continue in the future. The revolutionized high-energy synchrotron facility proposed in the APS-U project will increase brightness and coherence, leading to further increases in data rates. Successful management of data is of vital importance to the current and future scientific productivity of the APS.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2024

RectifHydPlus Data Pipeline

The RectifHydPlus Data Pipeline is an open source and fully reproducible data processing pipeline for creating RectifHydPlus—a dataset of historical monthly net electricity generation for all US hydropower plants (>10MW). The pipeline is coded in R, applying tidyverse libraries and code principles, and using the targets data pipeline framework. All data inputs to the RectifHydPlus Data Pipeline are available from public sources. References to all data inputs, as well as instructions for running the RectifHydPlus Data Pipeline, are available on the GitLab code repository: https://code.ornl.gov/turnersw/rectifhydplus

Turner, SeanWilliam Donald [Oak Ridge National Lab↗
DOE OSTI2025

RectifHydPlus Data Pipeline v1.1.0

The RectifHydPlus Data Pipeline is an open source and fully reproducible data processing pipeline for creating RectifHydPlus—a dataset of historical monthly net electricity generation for all US hydropower plants (>10MW). The pipeline is coded in R, applying tidyverse libraries and code principles, and using the targets data pipeline framework. All data inputs to the RectifHydPlus Data Pipeline are available from public sources. References to all data inputs, as well as instructions for running the RectifHydPlus Data Pipeline, are available on the GitLab code repository: https://code.ornl.gov/turnersw/rectifhydplus

Turner, SeanWilliam Donald [Oak Ridge National Lab↗
DOE OSTI2021

MIGHTEE: total intensity radio continuum imaging and the COSMOS/XMM-LSS Early Science fields

ABSTRACT MIGHTEE is a galaxy evolution survey using simultaneous radio continuum, spectropolarimetry, and spectral line observations from the South African MeerKAT telescope. When complete, the survey will image ∼20 deg2 over the COSMOS, E-CDFS, ELAIS-S1, and XMM-Newton Large Scale Structure field (XMM-LSS) extragalactic deep fields with a central frequency of 1284 MHz. These were selected based on the extensive multiwavelength data sets from numerous existing and forthcoming observational campaigns. Here, we describe and validate the data processing strategy for the total intensity continuum aspect of MIGHTEE, using a single deep pointing in COSMOS (1.6 deg2) and a three-pointing mosaic in XMM-LSS (3.5 deg2). The processing includes the correction of direction-dependent effects, and results in thermal noise levels below 2 $\mathrm{\mu }$Jy beam−1 in both fields, limited in the central regions by classical confusion at ∼8 arcsec angular resolution, and meeting the survey specifications. We also produce images at ∼5 arcsec resolution that are ∼3 times shallower. The resulting image products form the basis of the Early Science continuum data release for MIGHTEE. From these images we extract catalogues containing 9896 and 20 274 radio components in COSMOS and XMM-LSS, respectively. We also process a close-packed mosaic of 14 additional pointings in COSMOS and use these in conjunction with the Early Science pointing to investigate methods for primary beam correction of broad-band radio images, an analysis that is of relevance to all full-band MeerKAT continuum observations, and wide-field interferometric imaging in general. A public release of the MIGHTEE Early Science continuum data products accompanies this article.

Heywood, I. (ORCID:0000000168645057)↗
DOE OSTI2018

Auto-generated materials database of Curie and Néel temperatures via semi-supervised relationship extraction

article presents an auto-generated database of 39,822 records containing chemical compounds and their associated Curie and Néel magnetic phase transition temperatures. The database was produced using natural language processing and semi-supervised quaternary relationship extraction, applied to a corpus of 68,078 chemistry and physics articles. Evaluation of the database shows an estimated overall precision of 73%. Therein, records processed with the text-mining toolkit, ChemDataExtractor, were assisted by a modified Snowball algorithm, whose original binary relationship extraction capabilities were extended to quaternary relationship extraction. Consequently, its machine learning component can now train with ≤500 seeds, rather than the 4,000 originally used. Data processed with the modified Snowball algorithm affords 82% precision. Database records are available in MongoDB, CSV and JSON formats which can easily be read using Python, R, Java and MatLab. As a result, this makes the database easy to query for tackling big-data materials science initiatives and provides a basis for magnetic materials discovery.

36 MATERIALS SCIENCE↗