Search NASA⌕ Search

SEARCH · Search NASA

Results for “data processing steps”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Multiphysics Integrated Coupling Environment (MICE) User Manual

The complex, multi-part nature of waste glass melters used in nuclear waste vitrification poses significant modeling challenges. The focus of this project has been to couple a 1D MATLAB model of the cold cap region within a melter with a 3D STAR-CCM+ model of the melter itself. The Multiphysics Integrated Coupling Environment (MICE) has been developed to create a cohesive simulation of a waste glass melter that accurately represents the cold cap. The one-dimensional mathematical model of the cold cap uses material properties, axial heat, and mass fluxes to obtain a temperature profile for the cold cap, the region where feed-to-glass conversion occurs. The results from Matlab are used to update simulation data in the three-dimensional STAR-CCM+ model so that the cold cap is appropriately incorporated into the 3D simulation. The two processes are linked through ModelCenter integration software using time steps that are specified for each process. Data is to be exchanged circularly between the two models, as the inputs and outputs of each model depend on the other.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

2.3.3.404 - National Lab and University Collaboration for MHK Instrumentation and Data Processing Tools

Field and laboratory validation, testing, demonstration, and operation are critical steps for increasing the technology readiness level of marine energy (ME) converters because they provide high-quality testing and performance data that are critical information used to feed all aspects of technology development. This project, in partnership with industry, enables the marine and hydrokinetic energy (MHK) community to reliably and efficiently collect, process, manage, and share quality data by facilitating access to and development of instrumentation, guidelines and data processing/QA tools. Under this project, open-source data processing code (MHKiT) and tools (ME Data Pipeline, MRE Code Hub, PRIMRE Code Catalog), instrumentation (loads measurements), data acquisition systems (miniDAQ), and measurement guidance tools (Telesto, high EMI guidance) were developed to facilitate the collection and processing of quality laboratory and field data. Overall, this project is intended to improve the quality of the data collected during laboratory and field demonstration projects by standardizing the collection and processing techniques, as well as by improving access to instrumentation, code, and measurement guidance. Quality data will, in turn, lead to improved knowledge capture following ME device testing.

data processing↗

A Practical Solver for Scalar Data Topological Simplification

This paper presents a practical approach for the optimization of topological simplification, a central pre-processing step for the analysis and visualization of scalar data. Given an input scalar field f and a set of “signal” persistence pairs to maintain, our approaches produces an output field g that is close to f and which optimizes (i) the cancellation of “non-signal” pairs, while (ii) preserving the “signal” pairs. In contrast to pre-existing simplification algorithms, our approach is not restricted to persistence pairs involving extrema and can thus address a larger class of topological features, in particular saddle pairs in three-dimensional scalar data. Our approach leverages recent generic persistence optimization frameworks and extends them with tailored accelerations specific to the problem of topological simplification. Extensive experiments report substantial accelerations over these frameworks, thereby making topological simplification optimization practical for real-life datasets. Our approach enables a direct visualization and analysis of the topologically simplified data, e.g., via isosurfaces of simplified topology (fewer components and handles). We apply our approach to the extraction of prominent filament structures in three-dimensional data. Specifically, we show that our pre-simplification of the data leads to practical improvements over standard topological techniques for removing filament loops. Here, we also show how our approach can be used to repair genus defects in surface processing. Finally, we provide a C++ implementation for reproducibility purposes.

97 MATHEMATICS AND COMPUTING↗

DETECTION OF THERMAL EMISSION FROM A SUPER-EARTH

We report on the detection of infrared light from the super-Earth 55 Cnc e, based on four occultations obtained with Warm Spitzer at 4.5 {mu}m. Our data analysis consists of a two-part process. In a first step, we perform individual analyses of each data set and compare several baseline models to optimally account for the systematics affecting each light curve. We apply independent photometric correction techniques, including polynomial detrending and pixel mapping, that yield consistent results at the 1{sigma} level. In a second step, we perform a global Markov Chain Monte Carlo analysis, including all four data sets that yield an occultation depth of 131 {+-} 28 ppm, translating to a brightness temperature of 2360 {+-} 300 K in the IRAC 4.5 {mu}m channel. This occultation depth suggests a low Bond albedo coupled to an inefficient heat transport from the planetary day side to the night side, or else possibly that the 4.5 {mu}m observations probe atmospheric layers that are hotter than the maximum equilibrium temperature (i.e., a thermal inversion layer or a deep hot layer). The measured occultation phase and duration are consistent with a circular orbit and improves the 3{sigma} upper limit on 55 Cnc e's orbital eccentricity from 0.25 to 0.06.

79 ASTRONOMY AND ASTROPHYSICS↗

Carbon Storage Open Database

The Carbon Storage Open Database is a collection of spatial data obtained from publicly available sources published by several NATCARB Partnerships and other organizations. The carbon storage open database was collected from open-source data on ArcREST servers and websites in 2018, 2019, 2021, and 2022. The original database was published on the former GeoCube, which is now EDX Spatial, in July 2020, and has since been updated with additional data resources from the Energy Data eXchange (EDX) and external public data resources. The shapefile geodatabase is available in total, and has also been split up into multiple databases based on the maps produced for EDX spatial. These are topical map categories that describe the type of data, and sometimes the region for which the data relates. The data is separated in case there is only a specific area or data type that is of interest for download. In addition to the geodatabases, this submission contains: 1. A ReadMe file describing the processing steps completed to collect and curate the data. 2. A data catalog of all feature layers within the database. Additional published resources are available that describe the work done to produce the geodatabase: Morkner, P., Bauer, J., Creason, C., Sabbatino, M., Wingo, P., Greenburg, R., Walker, S., Yeates, D., Rose, K. 2022. Distilling Data to Drive Carbon Storage Insights. Computers & Geosciences. https://doi.org/10.1016/j.cageo.2021.104945 Morkner, P., Bauer, J., Shay, J., Sabbatino, M., and Rose, K. An Updated Carbon Storage Open Database - Geospatial Data Aggregation to Support Scaling -Up Carbon Capture and Storage. United States: N. p., 2022. Web. https://www.osti.gov/biblio/1890730 Morkner, P., Rose, K., Bauer, J., Rowan, C., Barkhurst, A., Baker, D.V., Sabbatino, M., Bean, A., Creason, C.G., Wingo, P., and Greenburg, R. Tools for Data Collection, Curation, and Discovery to Support Carbon Sequestration Insights. United States: N. p., 2020. Web. https://www.osti.gov/biblio/1777195 Disclaimer: This project was funded by the United States Department of Energy, National Energy Technology Laboratory, in part, through a site support contract. Neither the United States Government nor any agency thereof, nor any of their employees, nor the support contractor, nor any of their employees, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States Government or any agency thereof. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States Government or any agency thereof.

carbon storage↗

Liquid-phase oxidation of cyclohexane. Elementary steps in the developed process, reactivity, catalysis, and problems of conversion and selectivity

The literature data concerning features of the kinetics and mechanisms of elementary steps of liquid-phase oxidation of cyclohexane and its oxygen derivatives are considered and analyzed. A comparison of rates of intermolecular and intramolecular reactions of cyclohexylperoxyl radicals under the industrial conditions indicated a necessity to take into account intramolecular interactions. The occurrence of cross recombination of hydroperoxyl and α-hydroxyperoxyl radicals without chain termination in the course of cyclohexanol and 2-hydroxycyclohexanol oxidation was proved. A significance of degenerate branching reactions involving cyclohexyl hydroperoxide in the industrial process of cyclohexane oxidation at 423 K was evaluated. The influence of the electron-withdrawing functional groups on the reactivity of carbon–hydrogen bonds of organic compounds in the reactions with electrophilic peroxyl radicals was studied. The low conversion of a substrate in the industrial process are mainly caused by the radicalchain oxidation of cyclohexanone leading only to by-products. The catalysts of cyclohexane oxidation, viz., compounds of variable valence metals, affect the reaction rate and ratio of the yields of the target products (cyclohexyl hydroperoxide, cyclohexanol, and cyclohexanone) but exert no effect on their relative reactivity. The use of the catalytic additives increasing the yield of cyclohexanone in the step of cyclohexane oxidation in the production of caprolactam is revealed to be inexpedient.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SU-E-T-48: Automated Quality Assurance for XML Controlled Linacs

Purpose: To automate routine imaging QA procedures so that complying with TG 142 and TG 179 can be efficient and reliable. Methods: Two QA tests for a True Beam Linac were automatized. A Winston Lutz test as described by Lutz et al{sup 1} using the Winston Lutz test kit from BrainLab, Germany and a CBCT Image Quality test as described in TG 179 using the EMMA phantom, Siemens Medical Physics, Germany were performed in our True Beam. For each QA procedure tested, a 3 step paradigm was used. First, the data was automatically acquired using True Beam Developer Mode and XML scripting. Second, the data acquired in the first step was automatically processed using in-home grown Matlab GUIs. Third, Machine Learning algorithms were used to automatically classify the processed data and reports generated. Results: The Winston Luzt test could be performed by an experienced medical physicist in 29.0 ± 8.0 min. The same test, if automated using our paradigm, could be performed in 3.0 ± 0.1 min. In the same lieu, time could be substantially saved for image quality tests. In this case, the amount of time saved will depend on the phantoms used and the initial localization method. Additionally, machine learning algorithms could automatically identify the roots of the problems if any and possibly help reduce machine down time. Conclusion: Modern linear accelerators are equipped with advanced 2D and 3D imaging that are used for patient alignment substantially improving IGRT protocols. However, this extra complexity exponentially increases the number of QA tests needed. Using the new paradigm described above, not only bare minimum but best practice QA programs could be implemented with the same manpower. This work is supported by Varian, Palo Alto, CA.

60 APPLIED LIFE SCIENCES↗

Savannah River Site HB-Line Plutonium Oxide Production Process Simulation Model - 17458

The AFS II/Plutonium Oxide Production process is in its initial operational phase at the Savannah River Site's (SRS) HB-Line. The process is new for the facility where it is being performed, but the facility itself has been in use on and off for over 50 years. Beginning this process inside the facility has resulted in multiple process delays, due to both equipment issues and process restrictions. In order to better understand the process and to identify ways to improve facility performance, Savannah River Nuclear Solutions (SRNS), in conjuncture with Newport News Shipbuilding (NNS), developed the HB-Line Process Simulation Model. This tool completely replicates the operations that comprise the HB-Line process and simulates all of the constraints associated with the process. The model realistically accounts for the number of personnel required for a process step, the time required for a process step to occur, rules related to the parallel operation of process steps, and realistic equipment and operational delay data. The result is a tool that allows SRNS to test different scenarios for improving the process throughput, while realistically accounting for potential process delays and restrictions. The tool is currently in use and has allowed SRNS to present to their customer, the National Nuclear Security Administration (NNSA), estimated production capabilities over wide-ranging timetables and assumptions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Gross and Net Soil Methane Flux and Ancillary Data, Edgewater, MD, USA, summer 2022

This data package contains measurements used to quantify methane cycling and environmental conditions in coastal forest soils during the 2022 growing season. It includes time‑series data of soil methane flux, soil respiration, soil temperature, and volumetric water content collected from soil monoliths transplanted along an inundation and salinity gradient. The package also provides one‑time measurements from a stable‑isotope pool‑dilution incubation, including gravimetric water content, methane headspace concentrations, and ¹³CH₄ enrichment over time. Data files are provided in comma‑separated values (CSV) format, with accompanying metadata and readme documentation in PDF and plain‑text formats. All files can be opened with standard software such as R, Python, or spreadsheet programs capable of handling CSV files. The metadata file describes variable definitions, units, processing steps, and the structure of each data table to support reuse and integration with other datasets.

13-C↗

Scalable Data Management of the Uintah Simulation Framework for Next-Generation Engineering Problems with Radiation

The need to scale next-generation industrial engineering problems to the largest computational platforms presents unique challenges. This paper focuses on data management related problems faced by the Uintah simulation framework at a production scale of 260K processes. Uintah provides a highly scalable asynchronous many-task runtime system, which in this work is used for the modeling of a 1000 megawatt electric (MWe) ultra-supercritical (USC) coal boiler. At 260K processes, we faced both parallel I/O and visualization related challenges, e.g., the default file-per-process I/O approach of Uintah did not scale on Mira. In this paper we present a simple to implement, restructuring based parallel I/O technique. We impose a restructuring step that alters the distribution of data among processes. The goal is to distribute the dataset such that each process holds a larger chunk of data, which is then written to a file independently. This approach finds a middle ground between two of the most common parallel I/O schemes–file per process I/O and shared file I/O–in terms of both the total number of generated files, and the extent of communication involved during the data aggregation phase. To address scalability issues when visualizing the simulation data, we developed a lightweight renderer using OSPRay, which allows scientists to visualize the data interactively at high quality and make production movies. Finally, this work presents a highly efficient and scalable radiation model based on the sweeping method, which significantly outperforms previous approaches in Uintah, like discrete ordinates. The integrated approach allowed the USC boiler problem to run on 260K CPU cores on Mira.

97 MATHEMATICS AND COMPUTING↗

Custom Accessors: Enabling Scalable Data Ingestion, (Re-)Organization, and Analysis on Distributed Systems

The emerging class of high velocity and high volume data analytic workflows comprise interwoven data ingestion, organization, and processing stages, with ingestion and organization steps often contributing comparable or even higher computational costs than actual processing steps. Since complex workflows consist of a variety of phases that view and use data differently, being able to construct efficient, scalable, distributed data structures (arrays, vectors, sets, maps, and multi-maps) is essential and requires custom methods to extend and shrink containers, analyze and position data, and, maintain globallyconsistent meta-data. In this paper, we propose a novel datastructure access paradigm based on the concept of Accessors. At a high level, accessors are customizable callable objects that can modify the behavior of insert, read, update, and delete operations for distributed containers while preserving atomicity guarantees. Accessors provide a very clean and natural way to implement a variety of programming patterns, e.g., conditional insertion/deletion and cascading computations, which would be otherwise hard (or even impossible) to express in parallel and distributed settings without using locks. We demonstrate the practicality and usefulness of our approach with two representative use cases and study the performance of these applications on a distributed High-Performance Computing system. Our analysis highlights that our proposed abstraction allows for an effective overlapping and concurrent execution of different workflow steps (e.g., data ingestion and analysis), which in a conventional analytics pipeline would execute sequentially, contributing cumulatively to the overall latency.

Castellana, Vito G. [BATTELLE (PACIFIC NW LAB)] (O↗

Asynchronous in situ connected-components analysis for complex fluid flows

Fluid flow in porous media is at the heart of problems such as groundwater contamination and carbon sequestration, and presents an important challenge for scientific computing. For this class of problem, large three-dimensional simulations are performed to advance scientific inquiry. On massively parallel computing systems, the volume of data generated by such approaches can become a productivity bottleneck if the raw data generated from the simulation is analyzed in a post-processing step. We present a physics-based framework for in situ data reduction that is theoretically grounded in multiscale averaging theory. We show how task parallelism can be exploited to concurrently perform a variety of analysis tasks with data-dependent costs, including the generation of iso-surfaces, morphological analyses, and connected components analysis. A task management framework is constructed to launch asynchronous analysis threads, manage dependencies between different tasks, promote data locality and hide the impact of data transfers. The framework is applied to analyze GPU-based simulations of two-fluid flow in porous media, generating a set of averaged measures that represents the overall system behavior. We demonstrate how the approach can be applied to perform physically-consistent averaging over fluid subregions using connected components analysis. Simulations performed on Oak Ridge National Lab s Titan supercomputer are profiled to demonstrate the performance of the associated multi-threaded in situ analysis for typical production simulation of two-fluid flow.

Mcclure, James↗

Ptychography: Pushing the Limits of X-Ray Microscopy

Ptychography is an advanced diffraction based imaging technique that can achieve resolution of 5 nm, and below. It is done by scanning a sample through a beam of focused x-rays using discrete yet overlapping scan steps. Scattering data is collected on a CCD camera, and the phase of the scattered light is reconstructed with sophisticated iterative algorithms. Because the experimental setup is similar, ptychography setups can be created by retrofitting existing STXM beam lines with new hardware. The other challenge comes in the reconstruction of the collected scattering images. Scattering data must be adjusted and packaged with experimental parameters to calibrate the reconstruction software. The necessary pre-processing of data prior to reconstruction is unique to each beamline setup, and even the optical alignments used on that particular day. Pre-processing software must be developed to be flexible and efficient in order to allow experimenters appropriate control and freedom in the analysis of their hard-won data. This paper will describe the implementation of pre-processing software which successfully connects data collection steps to reconstruction steps, letting the user accomplish accurate and reliable ptychography.

47 OTHER INSTRUMENTATION↗

Coupling fracture facies with in-situ permeability measurements to generate stochastic simulations of tight carbonate aquifer properties: Example from the Lower Cretaceous aquifer, Northern Provence, SE France

The relationships between fracture facies and permeability distribution have been explored using a well-constrained 3D implicit structural model of hemipelagic low porosity/low permeability carbonate from the Northern Provence region, SE France. Fracture and permeability facies were determined using an extensive dataset of 99 hydrogeological wells. Data processing was undertaken using a step-by-step approach, involving: (i) identification of the fracture facies based on well logs detailing structure and stratigraphy; (ii) determination of permeability facies from the a priori correlation between the dimension of the hydraulic radius of influence (deduced from slug test analyses) and the type of reservoir heterogeneity (fissure, fracture, fault zone, etc.); (iii) three dimensional plot of fracture and permeability facies in the geological model using a variographic analysis of data. Thirty-three sequential indicator simulations (SIS) based on geostatistic analyses were realised on both fracture and permeability facies. Finally, a connectivity algorithm was developed to compute the probability of connection between selected infiltration areas and the major aquifer springs via moderate- to high-permeability geological bodies. Key results are: (i) fault zones have a greater role in controlling permeability facies distribution than on fracture facies repartition; (ii) there is little correlation between permeability and fracture facies distributions; (iii) connectivity results highlight the compartmentalisation of aquifers in the Cadarache area, the extensions of permeable geological bodies being limited by the N130 faults.

58 GEOSCIENCES↗

Performance characterization of irregular I/O at the extreme scale

Here, this paper reports our experience with irregular I/O and describes lessons learned when running applications with such I/O on supercomputers at the extreme scale. Specifically, we study how irregularities in I/O patterns (i.e., irregular amount of data written per process at each I/O step) in scientific simulations can cause increasing I/O times and substantial loss in scalability. To this end, we quantify the impact of irregular I/O patterns on the I/O performance of scientific applications at the extreme scale by statistically modeling the irregular I/O behavior of two scientific applications: the Monte Carlo application QMCPack and the adaptive mesh refinement application ENZO. For our testing, we feed our model into I/O kernels of two well-known I/O data models (i.e., ADIOS and HDF) to measure the performance of the two applications’ I/O under different I/O settings. Empirically, we show how the growing data sizes and the irregular I/O patterns in these applications are both relevant factors impacting performance.

97 MATHEMATICS AND COMPUTING↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

Characterization of Fuel Cladding Chemical Interaction on a High Burnup U-10Zr Metallic Fuel via Electron Energy Loss Spectroscopy Enhanced by Machine Learning

Fuel cladding chemical interaction (FCCI) is one of the main performance limiting factors for metallic nuclear fuels. The interaction destabilizes the martensitic microstructure and deteriorates mechanical properties of HT-9 cladding. The detection of low atomic number elements (Z<10) and overlapping of elemental peaks can be problematic in interpreting energy dispersive X-ray spectroscopy (EDS) data. Electron energy loss spectroscopy (EELS) provides precise elemental edge energy values and can detect elements with a low atomic number. This work utilizes EELS to study the distribution of lanthanides and light elements at the interaction region. The sample was prepared from the FCCI region of a U-10Zr (wt.%) solid fuel with HT-9 cladding, irradiated to a burnup of 13.2 at.%. Processing the EELS data included three major steps: 1) enhance the signal to noise ratio by denoising the spectrum with principal component analysis (PCA) method, removing background and performing deconvolution; 2) identify chemical elements with core energy loss edges; 3) confirm different phases using a popular machine learning method, K-means. This work presents qualitative assessment of lanthanides and light elements like carbon (C) and oxygen (O) enhanced by the application of machine learning algorithms. By comparing with EDS elemental maps, EELS provides higher resolution chemical maps, reveals the distribution of carbon at the interaction region supporting the formation of zirconium carbide, a rind-like microstructure feature that was proposed to mitigate the chemical interaction. Furthermore, the plasmon peak map was also found to indicate an energy shift associated with the formation of phases/compounds. K-means clustering method was used on the processed electron energy loss (EEL) spectrum to automatically reveal different phases. The resulting clustered maps from K-means clustering align well with elemental maps confirming certain phases, especially Fe-Ce and Zr-C, in the FCCI region.

EELS↗

Atmospheric parameters and metallicities for 2191 stars in the globular cluster M4

We report new metallicities for stars of Galactic globular cluster M4 using the largest number of stars ever observed at high spectral resolution in any cluster. We analyzed 7250 spectra for 2771 cluster stars gathered with the Very Large Telescope (VLT) FLAMES+GIRAFFE spectrograph at VLT. These medium-resolution spectra cover a small wavelength range, and often have very low signal-to-noise ratios. We approached this data set by reconsidering the whole method of abundance analysis of large stellar samples from beginning to end. We developed a new algorithm that automatically determines the atmospheric parameters of a star. Nearly all of the data preparation steps for spectroscopic analyses are processed on the syntheses, not the observed spectra. For 322 red giant branch (RGB) stars with V ≤ 14.7, we obtain a nearly constant metallicity, ([Fe/H]) = –1.07 (σ = 0.02). No difference in the metallicity at the level of 0.01 dex is observed between the two RGB sequences identified by Monelli et al. For 1869 subgiant and main-sequence stars with V > 14.7, we obtain ([Fe/H]) = –1.16 (σ = 0.09) after fixing the microturbulent velocity. These values are consistent with previous studies that have performed detailed analyses of brighter RGB stars at higher spectroscopic resolution and wavelength coverage. It is not clear if the small mean metallicity difference between brighter and fainter M4 members is real or is the result of the low signal-to-noise characteristics of the fainter stars. The strength of our approach is shown by recovering a metallicity close to a single value for more than 2000 stars, using a data set that is non-optimal for atmospheric analyses. This technique is particularly suitable for noisy data taken in difficult observing conditions.

79 ASTRONOMY AND ASTROPHYSICS↗