SEARCH · Search NASA

Results for “stream processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

All sources NASA NTRS DOE OSTI

NASA NTRS2014

Designing Liquid Rocket Engine Injectors for Performance, Stability, and Cost

NASA is using computational fluid dynamics (CFD) simulations to lower the cost and increase the performance and stability of fuel injector designs for next-generation liquid rocket engines (LREs). The Loci-STREAM CFD code is used to simulate the complex combustion processes inside the LRE. These analyses enable efficient evaluation of the performance and stability characteristics of injector design concepts, while decreasing reliance on the costly test-fail-fix cycle of traditional design approaches. These injector simulations were recently employed as a key part of the design process for an Advanced Booster concept for NASA's heavy-lift Space Launch System (SLS).

Westra, Douglas G.↗

NASA NTRSDate not supplied

Global 3D Data Visualization and Analysis Platform With Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks [1]. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration [2]. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera [3], Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) [5] is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools [5, 7]. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [8]. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers [5,6]. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗

NASA NTRSDate not supplied

Global 3D Data Visualization and Analysis Platform with Advanced Machine Learning Capabilities in Support of Lunar Exploration

Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera, Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.

Maps↗

NASA NTRSDate not supplied

The Nasa SRA Process as It Relates to Open-Source Workflows Developed for GeneLab Data Processing

To release open, standards-compliant processed data sets in the Open Science Data Repository (OSDR), the GeneLab Data Processing team works with the scientific community through the OSDR Analysis Working Groups to design and build open-source data processing pipelines. Once baselined internally, these pipelines are wrapped into workflows and published on the NASA GeneLab Data Processing public GitHub repository along with detailed instructions for installation and use. Each workflow must be approved through NASA's Software Release Authorization (SRA) process prior to publishing. However, the SRA process lacks sufficient documentation and clarity regarding which forms are applicable for new open-source software that utilizes publicly available 3rd party tools, and the SRA process can take several months to complete, making sharing software outside of NASA cumbersome and in contradiction with the concept of Open Science. Furthermore, the SRA process was designed as a one-size fits all approach and thus many of the questions asked are not applicable to our open-source workflows. Here we describe the software provided on the NASA GeneLab Data Processing GitHub repository, summarize our experiences with the SRA process to release these software, and propose a more stream-lined approach for review of open-source projects.

Software Release Authorization↗

NASA NTRSDate not supplied

The NASA SRA Process as it Relates to Open-Source Workflows Developed for GeneLab Data Processing

Software Release Authorization↗

DOE OSTI2024

Functional Verification for Endcap Concentrator ASICs in the High-Granularity Calorimeter Upgrade of CMS

The High-Granularity Calorimeter (HGCAL) of CMS will undergo a major upgrade during Long-Shutdown 3. The Endcap Concentrator (ECON) ASICs represent key elements in the readout chain, processing trigger (ECON-T) and data (ECON-D) streams from the HGCROC to the lpGBT. The ECONs will operate in a radiation environment with a High-Energy Hadron (HEH) flux of $3\cdot10^{6} cm^{-2}s^{-1}$. This contribution describes the Universal Verification Methodology (UVM)-based functional verification of the ECON ASICs focusing on the re-use of existing components to manage the complexity of the verification environment.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

NASA NTRS1998

Numerical Simulations of a Lobed Fuel Injector

Numerical modeling of the nonreactive mixing processes associated with a lobed fuel injector in a coflowing air stream is presented. The lobed fuel injector is a device which generates strong streamwise vorticity, producing locally high strain rates which can enhance the molecular mixing of reactants while delaying ignition in a controlled manner. Vortex element modeling is used to simulate flow field evolution and fuel element mixing characteristics for this lobed fuel injector. Quantitative predictions for vorticity generation and qualitative results for streamwise rollup compare well qualitatively with recent experimental investigations of this flow field [Smith et al, Phys. Fluids 9, 667 (1997)]. Parametric studies of the effects of lobe amplitude-to-wavelength ratio, lobe angle, and lobe shape for given flow conditions suggest that geometrical features may be optimized to enhance mixing and control reaction processes.

Strickland, J. H.↗

DOE OSTI2024

A high fidelity and user-friendly equation-oriented optimization model for carbon capture using a novel water-lean solvent

Research Triangle Institute (RTI) International and SLB have developed a novel water-lean solvent technology for carbon capture, demonstrating low specific reboiler duty (SRD) values at capture rates exceeding 90%. At the Technology Centre Mongstad (TCM) pilot plant, the technology achieved an SRD of 2.55 GJ/t-CO2 at 95% capture, utilizing an intercooler and a 5°C temperature approach in the lean/rich solvent cross exchanger. To meet varying carbon capture targets for Front End Engineering and Design (FEED) studies and to enable real-time optimization and advanced process control, an efficient optimization model is required. This model needs to minimize energy demand for a given capture rate and determine optimal operating parameters in response to fluctuating flue gas conditions. While an existing Aspen Plus simulation model, developed by RTI and SLB, accurately matches TCM plant data, its sequential modular (SM) strategy is too slow for real-time applications due to recycle streams and tight heat integration inherent in solvent-based carbon capture processes. Although an equation-oriented (EO) modeling strategy is more suitable for optimizing these processes, its adoption has been limited by several factors: feature limitations in Aspen Plus EO mode (e.g., lack of balance block support), a less user-friendly interface for variable identification and loop solving, complex troubleshooting of convergence issues, and the necessity for accurate initial values.

carbon capture↗

NASA NTRS2011

First Results from ARTEMIS, a New Two-Spacecraft Lunar Mission: Counter-Streaming Plasma Populations in the Lunar Wake

We present observations from the first passage through the lunar plasma wake by one of two spacecraft comprising ARTEMIS (Acceleration, Reconnection, Turbulence, and Electrodynamics of the Moon's Interaction with the Sun), a new lunar mission that re-tasks two of five probes from the THEMIS magnetospheric mission. On Feb 13, 2010, ARTEMIS probe P1 passed through the wake at 3.5 lunar radii downstream from the Moon, in a region between those explored by Wind and the Lunar Prospector, Kaguya, Chandrayaan, and Chang'E missions. ARTEMIS observed interpenetrating proton, alpha particle, and electron populations refilling the wake along magnetic field lines from both flanks. The characteristics of these distributions match expectations from self-similar models of plasma expansion into vacuum, with an asymmetric character likely driven by a combination of a tilted interplanetary magnetic field and an anisotropic incident solar wind electron population. On this flyby, ARTEMIS provided unprecedented measurements of the interpenetrating beams of both electrons and ions naturally produced by the filtration and acceleration effects of electric fields set up during the refilling process. ARTEMIS also measured electrostatic oscillations closely correlated with counter-streaming electron beams in the wake, as previously hypothesized but never before directly measured. These observations demonstrate the capability of the comprehensively instrumented ARTEMIS spacecraft and the potential for new lunar science from this unique two spacecraft constellation.

Halekas, J. S.↗

NASA NTRS2014

First Results from ARTEMIS, A New Two-Spacecraft Lunar Mission: Counter-Streaming Plasma Populations in the Lunar Wake

We present observations from the first passage through the lunar plasma wake by one of two spacecraft comprising ARTEMIS (Acceleration, Reconnection, Turbulence, and Electrodynamics of the Moon's Interaction with the Sun), a new lunar mission that re-tasks two of five probes from the THEMIS magnetospheric mission. On Feb 13, 2010, ARTEMIS probe P1 passed through the wake at approximately 3.5 lunar radii downstream from the Moon, in a region between those explored by Wind and the Lunar Prospector, Kaguya, Chandrayaan, and Chang'E missions. ARTEMIS observed interpenetrating proton, alpha particle, and electron populations refilling the wake along magnetic field lines from both flanks. The characteristics of these distributions match expectations from self-similar models of plasma expansion into vacuum, with an asymmetric character likely driven by a combination of a tilted interplanetary magnetic field and an anisotropic incident solar wind electron population. On this flyby, ARTEMIS provided unprecedented measurements of the interpenetrating beams of both electrons and ions naturally produced by the filtration and acceleration effects of electric fields set up during the refilling process. ARTEMIS also measured electrostatic oscillations closely correlated with counter-streaming electron beams in the wake, as previously hypothesized but never before directly measured. These observations demonstrate the capability of the comprehensively instrumented ARTEMIS spacecraft and the potential for new lunar science from this unique two spacecraft constellation.

Plasma↗

NASA NTRS2007

Monitoring by Use of Clusters of Sensor-Data Vectors

The inductive monitoring system (IMS) is a system of computer hardware and software for automated monitoring of the performance, operational condition, physical integrity, and other aspects of the health of a complex engineering system (e.g., an industrial process line or a spacecraft). The input to the IMS consists of streams of digitized readings from sensors in the monitored system. The IMS determines the type and amount of any deviation of the monitored system from a nominal or normal ( healthy ) condition on the basis of a comparison between (1) vectors constructed from the incoming sensor data and (2) corresponding vectors in a database of nominal or normal behavior. The term inductive reflects the use of a process reminiscent of traditional mathematical induction to learn about normal operation and build the nominal-condition database. The IMS offers two major advantages over prior computational monitoring systems: The computational burden of the IMS is significantly smaller, and there is no need for abnormal-condition sensor data for training the IMS to recognize abnormal conditions. The figure schematically depicts the relationships among the computational processes effected by the IMS. Training sensor data are gathered during normal operation of the monitored system, detailed computational simulation of operation of the monitored system, or both. The training data are formed into vectors that are used to generate the database. The vectors in the database are clustered into regions that represent normal or nominal operation. Once the database has been generated, the IMS compares the vectors of incoming sensor data with vectors representative of the clusters. The monitored system is deemed to be operating normally or abnormally, depending on whether the vector of incoming sensor data is or is not, respectively, sufficiently close to one of the clusters. For this purpose, a distance between two vectors is calculated by a suitable metric (e.g., Euclidean distance) and "sufficiently close" signifies lying at a distance less than a specified threshold value. It must be emphasized that although the IMS is intended to detect off-nominal or abnormal performance or health, it is not necessarily capable of performing a thorough or detailed diagnosis. Limited diagnostic information may be available under some circumstances. For example, the distance of a vector of incoming sensor data from the nearest cluster could serve as an indication of the severity of a malfunction. The identity of the nearest cluster may be a clue as to the identity of the malfunctioning component or subsystem. It is possible to decrease the IMS computation time by use of a combination of cluster-indexing and -retrieval methods. For example, in one method, the distances between each cluster and two or more reference vectors can be used for the purpose of indexing and retrieval. The clusters are sorted into a list according to these distance values, typically in ascending order of distance. When a set of input data arrives and is to be tested, the data are first arranged as an ordered set (that is, a vector). The distances from the input vector to the reference points are computed. The search of clusters from the list can then be limited to those clusters lying within a certain distance range from the input vector; the computation time is reduced by not searching the clusters at a greater distance.

Iverson, David L.↗

NASA NTRS2007

ISPATOM: A Generic Real-Time Data Processing Tool Without Programming

Information Sharing Protocol Advanced Tool of Math (ISPATOM) is an application program allowing for the streamlined generation of comps, which subscribe to streams of incoming telemetry data, perform any necessary computations on the data, then send the data to other programs for display and/or further processing in NASA mission control centers. Heretofore, the development of comps was difficult, expensive, and time-consuming: Each comp was custom written manually, in a low-level computing language, by a programmer attempting to follow requirements of flight controllers. ISPATOM enables a flight controller who is not a programmer to write a comp by simply typing in one or more equation( s) at a command line or retrieving the equation(s) from a text file. ISPATOM then subscribes to the necessary input data, performs all of necessary computations, and sends out the results. It sends out new results whenever the input data change. The use of equations in ISPATOM is no more difficult than is entering equations in a spreadsheet. The time involved in developing a comp is thus limited to the time taken to decide on the necessary equations. Thus, ISPATOM is a real-time dynamic calculator.

Dershowitz, Adam↗

NASA NTRS2011

Fischer-Tropsch Catalyst for Aviation Fuel Production

As the oil supply declines, there is a greater need for cleaner alternative fuels. There will undoubtedly be a shift from crude oil to non-petroleum sources as a feedstock for aviation (and other transportation) fuels. The Fischer-Tropsch process uses a gas mixture of carbon monoxide and hydrogen which is converted into various liquid hydrocarbons; this versatile gas-to-liquid technology produces a complex product stream of paraffins, olefins, and oxygenated compounds such as alcohols and aldehydes. The Fischer-Tropsch process can produce a cleaner diesel oil fraction with a high cetane number (typically above 70) without any sulfur and aromatic compounds. It is most commonly catalyzed by cobalt supported on alumina, silica, or titania or unsupported alloyed iron powders. Cobalt is typically used more often than iron, in that cobalt is a longer-active catalyst, has lower water-gas shift activity, and lower yield of modified products. Promoters are valuable in improving Fischer-Tropsch catalyst as they can increase cobalt oxide dispersion, enhance the reduction of cobalt oxide to the active metal phase, stabilize a high metal surface area, and improve mechanical properties. Our goal is to build up the specificity of the Fischer-Tropsch catalyst while adding less-costly transition metals as promoters; the more common promoters used in Fischer-Tropsch synthesis are rhenium, platinum, and ruthenium. In this report we will describe our preliminary efforts to design and produce catalyst materials to achieve our goal of preferentially producing C8 to C18 paraffin compounds in the NASA Glenn Research Center Gas-To-Liquid processing plant. Efforts at NASA Glenn Research Center for producing green fuels using non-petroleum feedstocks support both the Sub-sonic Fixed Wing program of Fundamental Aeronautics and the In Situ Resource Utilization program of the Exploration Technology Development and Demonstration program.

deLaRee, Ana B.↗

NASA NTRS2012

Fischer-Tropsch Catalyst for Aviation Fuel Production

As the oil supply declines, there is a greater need for cleaner alternative fuels. There will undoubtedly be a shift from crude oil to nonpetroleum sources as a feedstock for aviation (and other transportation) fuels. The Fischer-Tropsch process uses a gas mixture of carbon monoxide and hydrogen which is converted into various liquid hydrocarbons; this versatile gas-to-liquid technology produces a complex product stream of paraffins, olefins, and oxygenated compounds such as alcohols and aldehydes. The Fischer-Tropsch process can produce a cleaner diesel oil fraction with a high cetane number (typically above 70) without any sulfur and aromatic compounds. It is most commonly catalyzed by cobalt supported on alumina, silica, or titania or unsupported alloyed iron powders. Cobalt is typically used more often than iron, in that cobalt is a longer-active catalyst, has lower water-gas shift activity, and lower yield of modified products. Promoters are valuable in improving Fischer-Tropsch catalyst as they can increase cobalt oxide dispersion, enhance the reduction of cobalt oxide to the active metal phase, stabilize a high metal surface area, and improve mechanical properties. Our goal is to build up the specificity of the Fischer-Tropsch catalyst while adding less-costly transition metals as promoters; the more common promoters used in Fischer-Tropsch synthesis are rhenium, platinum, and ruthenium. In this report we will describe our preliminary efforts to design and produce catalyst materials to achieve our goal of preferentially producing C8 to C18 paraffin compounds in the NASA Glenn Research Center Gas-To-Liquid processing plant. Efforts at NASA Glenn Research Center for producing green fuels using non-petroleum feedstocks support both the Sub-sonic Fixed Wing program of Fundamental Aeronautics and the In Situ Resource Utilization program of the Exploration Technology Development and Demonstration program.

DeLaRee, Ana B.↗

NASA NTRS2013

Contemplating Synergistic Algorithms for the NASA ACE Mission

ACE is a proposed Tier 2 NASA Decadal Survey mission that will focus on clouds, aerosols, and precipitation as well as ocean ecosystems. The primary objective of the clouds component of this mission is to advance our ability to predict changes to the Earth's hydrological cycle and energy balance in response to climate forcings by generating observational constraints on future science questions, especially those associated with the effects of aerosol on clouds and precipitation. ACE will continue and extend the measurement heritage that began with the A-Train and that will continue through Earthcare. ACE planning efforts have identified several data streams that can contribute significantly to characterizing the properties of clouds and precipitation and the physical processes that force these properties. These include dual frequency Doppler radar, high spectral resolution lidar, polarimetric visible imagers, passive microwave and submillimeter wave radiometry. While all these data streams are technologically feasible, their total cost is substantial and likely prohibitive. It is, therefore, necessary to critically evaluate their contributions to the ACE science goals. We have begun developing algorithms to explore this trade space. Specifically, we will describe our early exploratory algorithms that take as input the set of potential ACE-like data streams and evaluate critically to what extent each data stream influences the error in a specific cloud quantity retrieval.

precipitation↗

DOE OSTI2025

The Artificial Scientist: in-Transit Machine Learning of Plasma Simulations

Large-scale simulations or scientific experiments produce petabytes of data per run. This poses massive challenges for I/O and storage when scientific analysis workflows are run manually offline. Unsupervised deep learning-based techniques to extract patterns and non-linear relations from these large amounts of data provide a way to build scientific understanding from raw data, reducing the need for manual pre-selection of analysis steps, but require exascale compute and memory to process the full dataset available. In this paper, we demonstrate a heterogeneous streaming workflow in which plasma simulation data is streamed directly to a Machine Learning (ML) application training a model on the simulation data in-transit, completely circumventing the capacity-constrained filesystem bottleneck. This workflow employs openPMD to provide a high level interface to describe scientific data and also uses ADIOS2, to transfer volumes of data that exceed the capabilities of the filesystem. We employ experience replay to avoid catastrophic forgetting in learning from this non-steady state process in a continual manner and adapt it to improve model convergence while learning in-transit. As a proof-of-concept, we approach the ill-posed inverse problem of predicting particle dynamics from radiation in a particle-incell (PIConGPU) simulation of the Kelvin-Helmholtz instability (KHI). We detail hardware-software co-design challenges as we scale PIConGPU to full Frontier, the Top-1 system as of June 2024 Top500 list.

Kelling, Jeffrey [Helmholtz-Zentrum Dresden Rossen↗

DOE OSTI2025

A co-registered in-situ and ex-situ dataset from wire arc additive manufacturing process

Recent progress in sensing techniques and data analytics tools have significantly accelerated the development of Wire Arc Additive Manufacturing (WAAM) systems. This data-centric approach emphasizes leveraging sensor data available throughout the production process to optimize performance. Integration of extensive data analysis provides opportunities for improving precision, reducing waste, and enhancing the quality of produced parts. This method relies on AI/ML models and optimization techniques, which are developed using the data collected from various sources, including in-situ sensors, ex-situ imaging, and manufacturing process parameters. The quality and diversity of this data, along with the alignment between different data streams (achieved through spatiotemporal registration) are critical for the successful development of AI/ML and optimization models. In this work, we present a spatiotemporally registered dataset generated during the WAAM process of deposition of a rectangular block. The dataset includes a comprehensive description of the deposition process, process parameters, welding characteristics and acoustic data collected in-situ, and X-Ray Computed Tomography data of the build.

42 ENGINEERING↗

DOE OSTI2024

A Co-Registered In-Situ and Ex-Situ Dataset of Electrical, Acoustic, and CT Characteristics from Wire Arc Additive Manufacturing Process

Recent progress in sensing techniques and data analytics tools have significantly accelerated the development of Wire Arc Additive Manufacturing (WAAM) systems. This data centric approach emphasizes leveraging available data throughout the production process to optimize performance. Integration of extensive data analysis provides the opportunity to improve precision, reduce waste, and enhance the quality of produced parts. This method relies on AI/ML models and optimization techniques, which are developed using the data collected from various sources, including in-situ sensors, ex-situ imaging, and manufacturing process parameters. The quality and diversity of this data, along with the alignment between different data streams (achieved through spatiotemporal registration) are critical for the successful development of AI/ML and optimization models. In this work, we present a spatiotemporally registered dataset generated during the WAAM process of deposition of a rectangular block. The dataset includes the comprehensive description of deposition process, process parameters, in-situ collected welding characteristics, acoustic data, and X-Ray Computed Tomography analysis data for the build. Dataset A Co-Registered In-Situ and Ex-Situ Dataset of Electrical, Acoustic, and CT Characteristics from Wire Arc Additive Manufacturing Process has arisen under UT-Battelle, LLC’s Prime Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy (DOE) to manage and operate the Oak Ridge National Laboratory. UT-Battelle, LLC will not assert any rights under United States law or under the Prime Contract it has in the dataset against any user of the dataset, including any copyrights or patent rights. UT-Battelle, LLC requests that attribution to the dataset is provided as academically appropriate.

42 ENGINEERING↗