Search NASA⌕ Search

SEARCH · Search NASA

Results for “data taking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

DuraMAT Data Hub

The DuraMAT Data Hub has been supporting the consortium for the past six years. The Data Hub has had success in supporting the projects, providing a platform for sharing data within projects and to the public, and learning how to better leverage the existing software platform and the available Amazon Web Services environment. During this new generation of the Data Hub, we are looking at ways to help improve the data hub architecture, user experience, and improve operations by taking advantage of new technology platforms and software that will be more impactful on the consortium researchers and the broader scientific community. In this poster we will look at the current operational capabilities, data dissemination, and development that will improve the system in the near and far future.

14 SOLAR ENERGY↗
DOE OSTI2025

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗
DOE OSTI2025

HPC Campaign Management: Remote data access with user-defined error bound using ADIOS and ZFP

Remote access to large-scale scientific datasets, like those generated by combustion simulations or other high-performance computing (HPC) applications, presents a significant challenge. Downloading entire datasets is often impractical due to their size and the bandwidth limitations of typical networks. To address this challenge, we propose a novel approach that enables efficient remote access to large datasets distributed across multiple facilities. Our method enables technologies to download only the data values of a select variable, in a select region of interest, to a user-defined accuracy. For this purpose, we extended the ADIOS IO library to provide read functions with user-defined accuracy, a remote data server that understands multidimensional selections of specific variables, steps and accuracy from an ADIOS dataset, and which uses lossy compression on the remote site to reduce the data to be transferred back to the client. In addition, our extension of the ADIOS library collects metadata from multiple datasets in small files called Campaign Archives, which can be shared among project participants on any HPC, cloud or laptop, and which can easily facilitate the discovery of content and pointers to the data location as well as remote access to the data by local tools as if data was local. This feature called Campaign Management, enables a group of scientists to manage related datasets stored in multiple files, across multiple facilities as if it was in a single file/database. We demonstrate the effectiveness of our approach using a 1.5 TB dataset from the S3D combustion simulation on Frontier at the Oak Ridge Leadership Facility. Even a single variable from this dataset, at 64 GB, is too large to be processed on a standard laptop. We show two different reading patterns for 2D plots and 3D visualization, with careful settings that a scientist studying combustion data would do and show that running the same Python scripts on Frontier directly takes comparable time than running them on the local laptop with remote access to the data on Frontier.

Podhorszki, Norbert [ORNL] (ORCID:000000019647542X↗
DOE OSTI2020

Chromatographic Modeling of 1-Foot Detritiation Test Column Results for the Optimization of Regeneration Time

This report documents the methods and results of a modeling study on a series of data generated by 1-foot test columns for the Water Detritiation project. In order to compliment modeling work already in progress on this project, a purely empirical curve-fitting approach is used in this study to determine chromatographic performance indicators such as retention time, curve width, and the number of chromatographic stages. The data used in this study comes from four sets of chromatographic test separations performed in March through May of 2017 using 1-foot columns. All are using the same flow rates and temperature (room temperature, nominally 25 C°). The first set of data (referred to in this report as the Column 1 data) is a series of twelve breakthrough curve measurements. Prior to each of these twelve runs, the column was regenerated by flowing hydrogen gas through the column, for increasing amounts of time, ranging from 2 hours to 25 hours. The second set of data (referred to as the Column 2 data) is comprised of five measurements of breakthrough curves measured in similar fashion as the Column 1 data, across a range of regeneration times from 2 to 21 hours. The third set of data (referred to as the Purge data) is of three breakthrough curves, measured after a regeneration time of 8 hours, which takes place after a nitrogen purge of 15, 30, or 45 minutes. The fourth data set is a series of five breakthrough curve measurements using a 2 nd batch of stationary phase, taken after regeneration times ranging from 2 to 20 hours. The overall modeling approach is as follows. First, the data is pre-processed for formatting, artifact removal, and is normalized. The data is then fit by integrated versions of four common chromatographic models. The best model is chosen based on the predictive performance of the model, and chromatographic performance values are calculated based on the best model’s fit parameters. Each of these processes are detailed below.

42 ENGINEERING↗
DOE OSTI2025

Evaluation of cloud height, optical thickness, and phase retrievals from the CHROMA algorithm applied to Sentinel-3 OLCI data

We previously developed the Cloud Height Retrieval from O 2 Molecular Absorption (CHROMA) algorithm for the Ocean Color Instrument (OCI) on the new NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission. Here, we apply CHROMA to observations from the Ocean Land Colour Instrument (OLCI) to guide expectations for PACE, as it will take some time to obtain large-scale validation data for OCI. We use cloud top height (CTH), phase, and (for liquid clouds) cloud optical thickness (COT) data from the ground-based Atmospheric Radiation Measurement (ARM) network to evaluate the OLCI retrievals. We found that OLCI and Moderate Resolution Imaging Spectroradiometer (MODIS) CTH compare similarly well to the ARM reference. OLCI has a tendency to underestimate CTH as CTH increases, and algorithm assumptions about cloud geometric thickness may contribute to this. ARM COT from multifilter shadowband radiometers (MFRSR) and Sun photometers are well-correlated with one another, albeit with a roughly 30 % offset on average; OLCI and MODIS COT agree more closely with the MFRSR data. OLCI retrieval uncertainty estimates show skill at telling low-uncertainty cases from high-uncertainty ones, although CTH uncertainties are underestimated. Additionally, we compare the OLCI data to satellite retrievals based on thermal infrared measurements from MODIS and Sea and Land Surface Temperature Radiometer (SLSTR) data. Differences are broadly consistent with physical expectations based on the A-band vs. thermal techniques, although one key challenge in such aggregated comparisons is different cloud masking sensitivities and algorithm failure rates meaning additional sampling differences are introduced. We conclude by discussing the transition to and possible enhancements for PACE OCI.

Sayer, Andrew M. [Univ. of Maryland Baltimore Coun↗
DOE OSTI2021

Optimal Bayesian supervised domain adaptation for RNA sequencing data

Abstract Motivation When learning to subtype complex disease based on next-generation sequencing data, the amount of available data is often limited. Recent works have tried to leverage data from other domains to design better predictors in the target domain of interest with varying degrees of success. But they are either limited to the cases requiring the outcome label correspondence across domains or cannot leverage the label information at all. Moreover, the existing methods cannot usually benefit from other information available a priori such as gene interaction networks. Results In this article, we develop a generative optimal Bayesian supervised domain adaptation (OBSDA) model that can integrate RNA sequencing (RNA-Seq) data from different domains along with their labels for improving prediction accuracy in the target domain. Our model can be applied in cases where different domains share the same labels or have different ones. OBSDA is based on a hierarchical Bayesian negative binomial model with parameter factorization, for which the optimal predictor can be derived by marginalization of likelihood over the posterior of the parameters. We first provide an efficient Gibbs sampler for parameter inference in OBSDA. Then, we leverage the gene-gene network prior information and construct an informed and flexible variational family to infer the posterior distributions of model parameters. Comprehensive experiments on real-world RNA-Seq data demonstrate the superior performance of OBSDA, in terms of accuracy in identifying cancer subtypes by utilizing data from different domains. Moreover, we show that by taking advantage of the prior network information we can further improve the performance. Availability and implementation The source code for implementations of OBSDA and SI-OBSDA are available at the following link. https://github.com/SHBLK/BSDA. Supplementary information Supplementary data are available at Bioinformatics online.

Biochemistry & Molecular Biology↗
DOE OSTI2020

Parametrically designed surface topography on CAD models of additively manufactured lattice structures for improved design validation

Additively Manufactured (AM) lattice structures of the laser powder bed fusion (LPBF) process generally have different surface geometries depending on the overhang angle and location. This means that the design validation stage is often challenging, considering it is based on an ideal Computer Aided Design (CAD) model that is not truly representative, since the AM part will be different in terms of dimensional accuracy and surface finish. Previous studies have relied on the design of surface textures that are independent of the overhang angle, or techniques based on directly using X-ray Computed Tomography (XCT) data. In this paper, a new technique for designing surface texture on the CAD of lattices has been investigated and correlated with areal surface roughness parameters. After extracting areal surface parameters from the XCT data of the lattice, the method allowed for the design of this surface texture on the part CAD taking in consideration if its up skin or down skin, without using XCT data as the main input. By applying this method, it is possible to obtain a lattice CAD model with a designed surface texture and geometry that is more representative of the actual AM lattice. The mean deviation between the CAD model with the designed surface and the XCT was a third of the one between the XCT and the initial CAD. The proposed method allows for designing and replicating LPBF AM surfaces on the CAD of a lattice, taking into consideration the dimensional deviation caused by AM surfaces, especially on overhangs. Assuming that an LPBF AM process is stable and produces approximately the same AM surface, this method can be used to predict the geometry of a lattice, providing a cost-effective and efficient methodology that minimizes the time needed for design validation.

42 ENGINEERING↗
DOE OSTI2024

A Novel Authentication Management for the Data Security of Smart Grid

Bidirectional wireless communication is employed in various smart grid components such as smart meters and control and monitoring applications where security is vital. The Trusted Third Party (TTP) and wireless connectivity between the smart meter and the third party in the key management-based encryption techniques for the smart grid are expected to be totally trustworthy and dependable. In a wired/wireless medium, however, a man-in-the-middle may seek to disrupt, monitor and manipulate the network, or simply execute a replay attack, revealing its vulnerability. Recognizing this, this study presents a novel authentication management (model) comprised of two layer security schema. The first layer implements an efficient novel encryption method for secure data exchange between meters and control center with the help of two partially trusted simple servers (constitutes the TTP). In this setting, one server handles the data encryption between the meter and control center/central database, and the other server administers the random sequence of data transmission. The second layer monitors and verifies exchanged data packets among smart meters. It detects abnormal packets from suspicious sources. To implement this node-to-node authentication, One class support vector machine algorithm is proposed which takes advantages of the location information as well as the data transmission history (node identification, packet size, and data transmission frequency). This schema secures data communication, and imposes a comprehensive privacy throughout the system without considerably extending the complexity of the conventional key management scheme.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Data Integration and Visualization for Enhanced Resilience and Sustainability in Hydropower (DIVERS-H)

U.S. hydropower plants face potential threats from shrinking water supply, rising demands, and warmer stream temperatures from various causes. Power plant owners, operators, and regulators require new tools to take advantage of and interpret the diverse range of scientific data being produced by both observational methods (for example, satellite, radar, stream gauges) and computer modeling methods that evaluate and predict how earth's dynamic systems (atmosphere, oceans, land surface, and sea ice) are changing and interacting. Combining datasets such as these with AI-based analyses introduces a novel decision support system to help users anticipate and address potential impacts on power generation stations. This new technology has been named DIVERS-H for "Data Integration and Visualization for Enhanced Resilience and Sustainability in Hydropower." In Phase I, technical feasibility was established with the development and demonstration of all the new technologies that are required. Most notably, DIVERS-H will use new artificial intelligence (AI) methods to capture the complex dynamics of water availability, demand, and environmental changes. In addition, new data management software was developed, and a prototype user interface was implemented as the precursor to a full scale decision support system. With technical research complete, the project focus now shifts to development of a commercial software product to provide users with actionable insight into water availability and the risk/resilience of critical systems at their locations of interest. Although DIVER-H was originally conceived as a tool for hydroelectric power applications, the same underlying technology can be readily applied to other water-consuming systems including coal, natural gas, oil, and nuclear power plants.

Chaudhary, Aashish [Kitware, Inc., Clifton Park, N↗
DOE OSTI2022

Neural operator prediction of linear instability waves in high-speed boundary layers

Here, we investigate if neural operators can predict the linear evolution of instability waves in high-speed boundary layers. To this end, we extend the design of the DeepOnet to ensure accurate and robust predictions, and also to perform data assimilation. In particular, we train DeepONet to take as inputs an upstream disturbance and a downstream location of interest, and to provide as output the perturbation field downstream in the boundary layer. DeepONet thus approximates the linearized and parabolized Navier-Stokes operator for this flow. For successful application to the high-speed boundary layer problem, we add sample weighting and Fourier input features to the regular DeepONet formulation. Once trained, the DeepOnet can perform fast and accurate predictions of the downstream disturbances within the range of training frequencies (inside the distribution). In addition, we show that DeepONet can solve the inverse problem, where downstream wall measurements are adopted as input, and a trained network can predict the upstream disturbances that led to these observations. This capability, along with the forward predictions, allows us to perform a full data assimilation cycle efficiently: starting from wall-pressure data, we predict the upstream disturbance using the inverse DeepONet and its evolution using the forward DeepONet. Finally, we introduce three new metrics to benchmark the training, evaluation and break-even cost of neural operators.

42 ENGINEERING↗
DOE OSTI2023

The solenoidal large intensity device (SoLID) for JLab 12 GeV

The solenoidal large intensity device (SoLID) is a new experimental apparatus planned for Hall A at the Thomas Jefferson National Accelerator Facility (JLab). SoLID will combine large angular and momentum acceptance with the capability to handle very high data rates at high luminosity. With a slate of approved high-impact physics experiments, SoLID will push JLab to a new limit at the QCD intensity frontier that will exploit the full potential of its 12 GeV electron beam. In this paper, we present an overview of the rich physics program that can be realized with SoLID, which encompasses the tomography of the nucleon in 3D momentum space from semi-inclusive deep inelastic scattering, expanding the phase space in the search for new physics and novel hadronic effects in parity-violating DIS, a precision measurement of J/ψ production at threshold that probes the gluon field and its contribution to the proton mass, tomography of the nucleon in combined coordinate and momentum space with deep exclusive reactions, and more. To meet the challenging requirements, the design of SoLID described here takes full advantage of recent progress in detector, data acquisition and computing technologies. In addition, we outline potential experiments beyond the currently approved program and discuss the physics that could be explored should upgrades of CEBAF become a reality in the future.

3D imaging↗
DOE OSTI2022

The Effect of Inverter Loading Ratio on Energy Estimate Bias: Preprint

Subhourly effects, particularly variability in solar irradiance, can lead to underestimation of inverter clipping losses and overestimation of energy in hourly photovoltaic system performance models, particularly for systems with high inverter loading ratios. Direct simulation of this error can be complicated by factors such as the representation of spatial and temporal variability in hourly weather data and transient system conditions. In this work we take an alternative approach using real system power measurements to show that energy predictions from typical industry models suffer from a bias that increases with inverter loading ratio. We also show that this loading ratio-dependent bias is strongly correlated with an empirical subhourly inverter clipping bias derived from real power plant data. Finally, we show that this bias is not necessarily specific to any one model or weather dataset by recreating similar biases with alternatives of each.

clipping↗
DOE OSTI2022

Nonnegative canonical tensor decomposition with linear constraints: nnCANDELINC

Abstract There is an emerging interest for tensor factorization applications in big‐data analytics and machine learning. To speed up the factorization of extra‐large datasets, organized in multidimensional arrays (also known as tensors), easy to compute compression‐based tensor representations, such as, Tucker and tensor train formats, are used to approximate the initial large‐tensor. Further, tensor factorization is used to extract latent features that can facilitate discoveries of new mechanisms and signatures hidden in the data, where the explainability of the latent features is of principal importance. Nonnegative tensor factorization extracts latent features that are naturally sparse and parts of the data, which makes them easily interpretable. However, to take into account available domain knowledge and subject matter expertise, often additional constraints need to be imposed, which lead us to canonical decomposition with linear constraints (CANDELINC), a canonical polyadic decomposition with rank deficient factors. In CANDELINC, Tucker compression is used as a preprocessing step, which lead to a larger residual error but to more explainable latent features. Here, we propose a nonnegative CANDELINC (nnCANDELINC) accomplished via a specific nonnegative Tucker decomposition; we refer to as minimal or canonical nonnegative Tucker. We derive several results required to understand the specificity of nnCANDELINC, focusing on the difficulties of preserving the nonnegative rank of a tensor to its Tucker core and comparing the real valued to nonnegative case. Finally, we demonstrate nnCANDELINC performance on synthetic and real‐world examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Predicting Execution Times for Disk-based and In-Situ Parallel Data Analytics (Final Technical Report)

In recent years, there has been a significant amount of interests in in-situ analytics on simulation programs. For a variety of reasons, it is desirable to be able to predict the execution time of an analytics program. At the same time, frameworks such as MapReduce have become popular for scientific data analytics. This paper focuses on developing performance models for predicting execution time of parallel data analytics, with a special emphasis on in-situ analytics. We take two distinct approach towards performance prediction. We first expand SKOPE (a SKeleton framewOrk for Performance Exploration) with performance models for disk data read, cache performance, and page fault penalty. Second, an analytical performance model is also developed. We have evaluated our performance prediction framework as well as the analytical model on three hardware setups with well-known data mining algorithms implemented in three programming paradigms, MapReduce, MATE (a MapReduce-like parallel system with an alternate API for multi-core environments) and Smart (a MapReduce-like framework for in-situ analytics). Results show that our performance prediction framework along with the incorporated performance models are capable of accurately predicting execution times for parallel scientific analytics on different hardware setups.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Multiplicity dependence of (multi-)strange hadron production in proton-proton collisions at $\sqrt{s}$s = 13 TeV

The production rates and the transverse momentum distribution of strange hadrons at mid-rapidity ( | y | < 0.5 ) are measured in proton-proton collisions at $\sqrt{s}$ = 13 TeV as a function of the charged particle multiplicity, using the ALICE detector at the LHC. The production rates of K$^0_S$, Λ, &#x039E;<!-- Ξ --> , and Ω ncrease with the multiplicity faster than what is reported for inclusive charged particles. The increase is found to be more pronounced for hadrons with a larger strangeness content. Possible auto-correlations between the charged particles and the strange hadrons are evaluated by measuring the event-activity with charged particle multiplicity estimators covering different pseudorapidity regions. When comparing to lower energy results, the yields of strange hadrons are found to depend only on the mid-rapidity charged particle multiplicity. Several features of the data are reproduced qualitatively by general purpose QCD Monte Carlo models that take into account the effect of densely-packed QCD strings in high multiplicity collisions. However, none of the tested models reproduce the data quantitatively. This work corroborates and extends the ALICE findings on strangeness production in proton-proton collisions at 7 TeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

An In-Depth Exploration of the Electrochemical Oxygen Reduction Reaction (ORR) Phenomenon on Carbon-Based Catalysts in Alkaline and Acidic Mediums

Detailed studies of the electrochemical oxygen reduction reaction (ORR) on catalyst materials are crucial to improving the performance of different electrochemical energy conversion and storage systems (e.g., fuel cells and batteries), as well as numerous chemical synthesis processes. In the effort to reduce the loading of expensive platinum group metal (PGM)-based catalysts for ORR in the electrochemical systems, many carbon-based catalysts have already shown promising results and numerous investigations on those catalysts are in progress. Most of these studies show the catalyst materials’ ORR performance as current density data obtained through the rotating disk electrode (RDE), rotating ring-disk electrode (RRDE) experiments taking cyclic voltammograms (CV) or linear sweep voltammograms (LSV) approaches. However, the provided descriptions or interpretations of those data curves are often ambiguous and recondite which can lead to an erroneous understanding of the ORR phenomenon in those specific systems and inaccurate characterization of the catalyst materials. In this paper, we presented a study of ORR on a newly developed carbon-based catalyst, the nitrogen-doped graphene/metal-organic framework (N-G/MOF), through RDE and RRDE experiments in both alkaline and acidic mediums, taking the LSV approach. The functions and crucial considerations for the different parts of the RDE/RRDE experiment such as the working electrode, reference electrode, counter electrode, electrolyte, and overall RDE/RRDE process are delineated which can serve as guidelines for the new researchers in this field. Experimentally obtained LSV curves’ shapes and their correlations with the possible ORR reaction pathways within the applied potential range are discussed in depth. We also demonstrated how the presence of hydrogen peroxide (H2O2), a possible intermediate of ORR, in the alkaline electrolyte and the concentration of acid in the acidic electrolyte can maneuver the ORR current density output in compliance with the possible ORR pathways.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Spin cutoff factor and level density for Ni 59 from an analysis of compound nuclear reactions

The spin cutoff parameter for 59 Ni has been studied from different types of experimental data, including neutron angular distributions from the 56 Fe(α,n) 59 Ni reaction, spin of discrete levels, the level density from the proton evaporation spectrum of the 54 Fe( 6 Li,p) 59 Ni reaction and neutron resonance spacing. Experimental data points were compared with calculations using models widely used in literature. It was found that the available empirical models overestimate data points in the energy region below the neutron separation energy, while microscopic calculations which take into account pairing correlations within Hartree-Fock +Bardeen-Cooper-Schrieffer approach are consistent with data. As a result, it confirmed earlier findings that pairing correlations play an important role and need to be taken into account when the spin cutoff parameter is calculated below the neutron separation energy.

(a,n) reaction↗
DOE OSTI2020

Petz reconstruction in random tensor networks

We illustrate the ideas of bulk reconstruction in the context of random tensor network toy models of holography. Specifically, we demonstrate how the Petz reconstruction map works to obtain bulk operators from the boundary data by exploiting the replica trick. We also take the opportunity to comment on the differences between coarse-graining and random projections.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗