Search NASA⌕ Search

SEARCH · Search NASA

Results for “data taking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Integrating Multi-Source Data for Bi-Level Traffic Simulator Calibration: A Literature Review and Highway Case Study

Traffic simulation serves as a powerful tool for pre-evaluating policies and technologies. In this context, simulation-based Dynamic traffic assignment (DTA) models are capable of capturing traffic dynamics. They are well-known as critical tools in controlling and predicting traffic situations. The reliability of simulation results heavily depends on the calibration process. Most studies in the literature formulate and calibrate simulators based on a single source of collected data or multiple data sets with the same spatiotemporal characteristics. However, in practice, traffic data is collected by various tools with usually different spatial and temporal resolutions. This study introduces a novel approach to taking into account diverse input data from a variety of sources. An iterative bi-level solution is proposed. to equally treat traffic flow and speed data. The upper level solves flow calibration with the exact solution method, and the lower level calibrates the speed with the simultaneous perturbation stochastic approximation (SPSA) algorithm. Subsequently, the effectiveness of the proposed model is investigated using data from a six-mile section of Nashville's I-24 highway in Tennessee. The results demonstrate that our proposed model creates an effective feedback loop between the optimizer and the simulator for calibrating flow and speed to reduce the error between simulated and real data.

42 ENGINEERING↗
DOE OSTI2021

Multi-Scenario Extreme Weather Simulator

The Multi-scenario Extreme Weather Simulator (MEWS) takes existing historical weather data and inserts trends and extreme events such as heat waves, hurricanes, extreme precipitation, or winter storms. The code includes functionality for projecting increasing frequency and duration of such events over a large range of statistically sampled realizations of the future. These weather files can then be used in building energy simulations through the Energy Plus software created by DOE. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525 SAND2021-8658 O

Villa, Daniel↗
DOE OSTI2021

RISE: Reducing I/O Contention in Staging-based Extreme-Scale In-situ Workflows

While in-situ workflow formulations have addressed some of the data-related challenges associated with extreme-scale scientific workflows, these workflows involve complex interactions and different modes of data exchange. In the context of increasing system complexity, such workflows present significant resource management challenges, requiring complex cost-performance tradeoffs. This paper presents RISE, an intelligent staging-based data management middleware, which builds on the DataSpaces framework and performs intelligent scheduling of data management operations to reduce I/O contention. In RISE, data are always written immediately to local buffers to reduce the effect of the transfer impact upon application performance. RISE identifies applications’ data access patterns and moves data towards data consumers only when the network is expected to be idle, reducing the impact of asynchronous background data movement upon critical data read/write requests. Here, we experimentally demonstrate that RISE can take advantage of staging nodes to offload data during writes without degrading application data movement performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The Exploitation of Data Reduction for Visualization

The disparity between the computational speed and storage bandwidth, as demonstrated in Figure 1, is a well known problem that grows with each successive generation. The visualization community is principally responding to this issue by using in situ to reduce which data must be written to storage. However, other communities are taking different, possibly complementary approaches. In particular, data compression is a common general approach to reduce storage demands. Data compression technologies are typically not designed with post processing in mind. The principal metrics measured are compression ratio, the improved bandwidth to storage, and the error introduced. It is assumed that data is inflated to its full size before any post processing can happen. Although when talking about bandwidth disparities, HPC’s dirty little secret is that no part of the memory nor interconnect hardware is increasing at the rate of computation. For example, the Summit supercomputer has a peak computation rate almost 10 times its predecessor, Titan, but only about 4 times the memory, less than twice the aggregate memory bandwidth, and almost no improvement in the interconnect bisection bandwidth. Naively inflating data for post processing does not help with limitations in the memory and interconnect systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Automating Analysis of Neutron Scattering Time-of-Flight Single Crystal Phonon Data

This article introduces software called Phonon Explorer that implements a data mining workflow for large datasets of the neutron scattering function, S(Q, ω), measured on time-of-flight neutron spectrometers. This systematic approach takes advantage of all useful data contained in the dataset. It includes finding Brillouin zones where specific phonons have the highest scattering intensity, background subtraction, combining statistics in multiple Brillouin zones, and separating closely spaced phonon peaks. Using the software reduces the time needed to determine phonon dispersions, linewidths, and eigenvectors by more than an order of magnitude.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

Semiclassical shell-structure micro-macroscopic approach for the level density

Level density ρ(E,A) is derived for a one-component nucleon system with a given energy E and particle number A within the mean-field semiclassical periodic-orbit theory beyond the saddle-point method of the Fermi gas model. We obtain ρ∝I ν (S)/S ν , with I ν (S) being the modified Bessel function of the entropy S. Within the micro-macro-canonical approximation (MMA), for a small thermal excitation energy U, with respect to rotational excitations E rot , one obtains ν = 3/2 for ρ(E,A). In the case of excitation energy U larger than E rot but smaller than the neutron separation energy, one finds a larger value of ν = 5/2. A role of the fixed spin variables for rotating nuclei is discussed. The MMA level density ρ reaches the well-known grand-canonical ensemble limit (Fermi gas asymptote) for large S related to large excitation energies, and also reaches the finite micro-canonical limit for small combinatorial entropy S at low excitation energies (the constant “temperature” model). Fitting the ρ(E,A) of the MMA to the experimental data for low excitation energies, taking into account shell and, qualitatively, pairing effects, one obtains for the inverse level density parameter K a value which differs essentially from that parameter derived from data on neutron resonances.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

The anomaly of the CMB power with the latest Planck data

Abstract The lack of power anomaly is an unexpected feature observed at large angular scales in the maps of Cosmic Microwave Background (CMB) produced by the COBE, WMAP andPlancksatellites. This signature, which consists in a missing of power with respect to that predicted by the ΛCDM model, might hint at a new cosmological phase before the standard inflationary era.The main point of this paper is taking into account the latestPlanckpolarisation data to investigate how the CMB polarisation improves the understanding of this feature. With this aim, we apply to the latestPlanckdata, both PR3 (2018) and PR4 (2020) releases, a new class of estimators capable of evaluating this anomaly by considering temperature and polarisation data both separately and in a jointly way. This is the first time that the PR4 dataset has been used to study this anomaly. To critically evaluate this feature, taking into account the residuals of known systematic effects present in thePlanckdatasets, we analyse the cleaned CMB maps using different combinations of sky masks, harmonic range and binning on the CMB multipoles.Our analysis shows that the estimator based only on temperature data confirms the presence of a lack of power with a lower-tail-probability (LTP), depending on the component separation method, ≤ 0.33% and ≤ 1.76% for PR3 and PR4, respectively. To our knowledge, the LTP≤ 0.33% for the PR3 dataset is the lowest one present in the literature obtained fromPlanck2018 data, considering thePlanckconfidence mask. We find significant differences between these two datasets when polarisation is taken into account most likely due to a different level of systematics. Especially, the analysis with PR3 data, unlike that with PR4, seems to point towards a lack of power at large scales also for polarisation.Moreover, we also show that for the PR3 dataset the inclusion of the subdominant polarisation information provides estimates that are less likely accepted in a ΛCDM cosmological model than the only-temperature analysis over the entire harmonic-range considered. In particular, at ℓ max = 26, we found that no simulation has a value as low as the data for all the pipelines.

Astronomy & Astrophysics↗
DOE OSTI2025

System Engineers and Decisions: It?s All about Knowledge

In order to guarantee that a system meets adequate levels of reliability and availability, system performances are continuously monitored and analyzed thanks to the technological advancements driving the Industry 4.0 revolution. An Industry 4.0 approach is typically based on advanced statistical, big data mining, machine learning, and internet-of-things methods designed to detect anomalies in the behavior of system, detect the most likely failure modes, and provide indications to system engineers on when maintenance activities should be performed before system performance are deemed unacceptable (which can be generated by diagnostic and prognostic methods). However, these analyses, which are designed to automatize and increase the efficacy of the system maintenance program, require large amount of data which can come in various forms: numeric, textual, images, sounds etc. Such data constitutes the historic knowledge benchmark to track system performances and support system engineer decisions. Here we claim that data is not sufficient to support this kind of analyses when applied to systems characterized by complex architectures and behaviors. Robust system engineer decisions require the ability to understand the system operational context that lies behind the observed data elements. In this respect, system models are in fact necessary to “put data in context” and capture relationships between data elements. Industry 4.0 methods require in fact contextual knowledge as a basis upon which hypotheses can be generated and assumptions tested. In our view, for complex systems, model-based system engineering (MBSE) models can afford this contextual knowledge, as they are typically used to describe systems architecture and dynamic behaviors. System knowledge is here intended as the blending of collected data and system architecture which takes the form of a “knowledge graph”. A knowledge graph is a database which consists of a large set of nodes (in our case an entity can be either a data or an MBSE element) which are linked to each other. The types of nodes and links follow a pre-defined topology, sometimes also refers as an ontology, that is designed to fit the actual decisions that needs to be performed. We show here how a knowledge graph can be defined to support system engineer maintenance decisions and how the same graph can be built based on system MBSE models and pre-processed data from numeric (through anomaly detections and diagnostic methods) and textual elements (through technical language processing TLP).

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

The case for data science in experimental chemistry: examples and recommendations

The physical sciences community is increasingly taking advantage of the possibilities offered by modern data science to solve problems in experimental chemistry and potentially to change the way we design, conduct and understand results from experiments. Successfully exploiting these opportunities involves considerable challenges. In this Expert Recommendation, we focus on experimental co-design and its importance to experimental chemistry. We provide examples of how data science is changing the way we conduct experiments, and we outline opportunities for further integration of data science and experimental chemistry to advance these fields. Our recommendations include establishing stronger links between chemists and data scientists; developing chemistry-specific data science methods; integrating algorithms, software and hardware to ‘co-design’ chemistry experiments from inception; and combining diverse and disparate data sources into a data network for chemistry research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Development of Real-Time High-Density Pulsar Data Transmission and Processing for Grid Synchronization

Taking advantage of the extreme stability of the pulsar period, it can serve as the timing source for grid synchronization to compensate for the timing drift instigated by the loss of GPS signal. Nevertheless, the real-time transmission and processing of the pulsar data suffer from its high-frequency data rate, varying from megahertz to gigahertz, resulting in reduced computing speed and increased time delay. To mitigate this issue, the hardware and software frameworks are implemented for the high-density pulsar data transmission and processing for grid synchronization in this research. Initially, the high-density pulsar data is transferred using open-source software. The complementary duty cycle timing module is designed to coordinate the operation of the dual-channel high-speed interface and software. Subsequently, the multiple-threading is applied to the receiving, parsing, and splicing pulsar data. Next, the pulsar signal extraction method is implemented based on the polyphase filterbank and time of arrival estimation. Ultimately, real-time performance verification experiments are carried out for different components under two hardware platforms. Finally, the results demonstrate that only 0.482 s is required for processing 4 Gigabyte data through multiple-threading, which is 3.8 times faster than the single thread. The pulsar signal extraction can also be executed within 707 ms for 4.8 seconds of data, thereby indicating that real-time requirements can be met.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Differential Property Prediction: A Machine Learning Approach to Experimental Design in Advanced Manufacturing

Advanced manufacturing techniques have enabled the production of materials with state-of-the-art properties. In many cases however, the development of physics-based models of these techniques lags behind their development in the lab. This means that material and process development proceeds largely via trial and error. This is sub-optimal since experiments are cost-, time-, and labor-intensive. In this work we propose a machine learning framework, differential property classification (DPC), which enables an experimenter to leverage machine learning's unparalleled pattern matching capability to pursue data-driven experimental design. DPC takes two possible experiment parameter sets and outputs a prediction of which will produce a material with a more desirable property specified by the operator. We demonstrate the success of DPC on AA7075 tube manufacturing process and mechanical property data using shear assisted processing and extrusion (ShAPE), an emerging solid phase processing technology. We show that by focusing on the experimenter's need to choose between multiple candidate experimental parameters, we can reframe the challenging regression task of predicting material properties from processing parameters, into a classification task on which machine learning models can achieve good performance.

advanced manufacturing, machine learning, ShAPE↗
DOE OSTI2024

An Intermediate Level Trigger Supernova Pointing Trigger for DUNE Using In-Storage AI

We propose a near-data approach to reduce the buffered supernova data on the DUNE DAQ front-end computers using ML techniques. Based on simulations, we are able to reduce the data by 5 orders of magnitude to 0(100)MB which can then be transferred quickly over ethernet to a single server that executes a full reconstruction and pointing analysis to determine the SN direction. The entire process of reducing the data and executing reconstruction and pointing analysis pipeline takes less time than that required to transfer all the data back to Fermilab before performing more processing to determine the direction of the supernova, which was the baseline plan for DUNE.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Additional Degree of Freedom for WEC Model

'Additional Degree of Freedom for WEC' - WEC-Sim numerical model from RFTS 1 TEAMER project. An increase in wave energy converter (WEC) efficiency requires not only consideration of the nonlinear effects in the WEC dynamics and the power take-off (PTO) mechanisms, but also more integrated treatment of the whole system, i.e., the buoy dynamics, the PTO system, and the control strategy. It results in an optimization formulation that has a nonquadratic and nonstandard cost functional. This model presents the application of real-time nonlinear model predictive controller (NMPC) to two degrees of freedom point absorber type WEC with highly nonlinear PTO characteristics. The nonlinear effects, such as the fluid viscous drag, are also included in the plant dynamics. The controller may be implemented on a real-time target machine, and the WEC device is emulated in real-time using the WECSIM toolbox. Please see the ‘ReadMe’ within the root directory for an explanation of how to set-up and run the model. An article covering the development of this model is attached as "Real-Time Nonlinear Model Predictive Controller for Multiple Degrees of Freedom Wave Energy Converters with Non-Ideal Power Take-Off"

16 TIDAL AND WAVE POWER↗
DOE OSTI2020

A Survey of Singular Value Decomposition Methods for Distributed Tall/Skinny Data

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD inclue Principal Components Analysis (PCA) and regression. Usually these applications arise on data that has far more rows than columns, so-called "tall/skinny" matrices. In the big data analytics context, this may take the form of hundreds of millions to billions of rows with only a few hundred columns. There is a need, therefore, for fast, accurate, and scalable tall/skinny SVD implementations which can fully utilize modern computing resources. To that end, we present a survey of three different algorithms for computing the SVD for these kinds of tall/skinny data layouts using MPI for communication. We contextualize these with common big data analytics techniques. Finally, we present both CPU and GPU timing results from the Summit supercomputer, and discuss possible alternative approaches.

Schmidt, Drew↗
DOE OSTI2022

Perspectives on the integration between first-principles and data-driven modeling

Efficiently embedding and/or integrating mechanistic information with data-driven models is essential if it is desired to simultaneously take advantage of both engineering principles and data-science. Further the opportunity for hybridization occurs in many scenarios, such as the development of a faster model of an accurate high-fidelity computer model; the correction of a mechanistic model that does not fully-capture the physical phenomena of the system; or the integration of a data-driven component approximating an unknown correlation within a mechanistic model. At the same time, different techniques have been proposed and applied in different literatures to achieve this hybridization, such as hybrid modeling, physics-informed Machine Learning (ML) and model calibration. In this paper we review the methods, challenges, applications and algorithms of these three research areas and discuss them in the context of the different hybridization scenarios. Moreover, we provide a comprehensive comparison of the hybridization techniques with respect to their differences and similarities, as well as advantages and limitations and future perspectives. Finally, we apply and illustrate hybrid modeling, physics-informed ML and model calibration via a chemical reactor case study.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

GraphCH: A Deep Framework for Assessing Cyber-Human Aspects in Insider Threat Detection

Insider threat is one of the most damaging cyber attacks that could cause the loss of intellectual property and enterprise data security breaches. Action sequence data such as host logs are used to investigate such threats and develop anomaly-based AI detectors. However, insider threat actions are similar to legitimate user activities, causing AI detectors to fail and suffer from high false alarm rates. Therefore, user cyber activity logs are inadequate to fully unfold insider threats. In this study, we adopt human psychological principles of risk-taking and impulsiveness along with host data to assess the influence and usefulness of human behavioral aspects in insider threat detection. Here, we hypothesize that individuals' impulsive and risk-taking behavior correlates with cyberspace activities. To validate our hypothesis, we conducted an IRB-approved study recruiting 35 participants who work in a large U.S. university and collected their cyber and psychological data for 90 days. Host and human-behavioral data analysis and mapping indicate that impulsive and risk-taking users trigger more system errors causing (un)intentional insider threats and are susceptible to attackers' social engineering and cognitive hacking. Utilizing cyber-human aspects, we introduce a Cyber-Human Graph Neural Network (GNN) based framework GraphCH to identify abnormal user behaviors and detect insider threats.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An Evaluation of Advanced Tools for Distributed Wind Turbine Performance Estimation

We evaluate various classes of distributed wind turbine performance tools across two sites in the United States. The class of tools ranges from the simple mass conservation model to the coupled Reynolds-averaged Navier-Stokes model, all initiated by the WIND Toolkit data set. The resource estimation at the site is evaluated against measured data at the mast location. Taking a sample 100-kW wind turbine and constant losses, we evaluate Openwind, Continuum, and WindNinja tools and document annual energy production (AEP) and time-series statistics associated with the performance estimation of the wind turbine. Using a methodology that is consistent and unbiased across the three options currently available in the industry, we elaborate results at the two sample locations and discuss the probable sources of discrepancy in the AEP estimates. Two main sources of the discrepancy come from the input WIND Toolkit data and the spatial modeling techniques of the tools to capture atmospheric physics. The discussion includes additional values that these tools may bring into the energy assessment process to enhance the owners' confidence over the distributed wind power systems.

17 WIND ENERGY↗