Search NASA⌕ Search

SEARCH · Search NASA

Results for “data ordering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Arizona State University Requirements Analysis Report

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Between October 2021 and February 2022 staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from Arizona State University (ASU) for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff to better understand the needs of the researchers within the community.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

St. Mary’s University Requirements Analysis Report

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Between September and December 2022, staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from LEARN and St. Mary’s University for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff to better understand the needs of the researchers within the community.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

National Institute of Standards and Technology Requirements (Analysis Report)

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. In October of 2022, staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from the National Institute of Standards and Technology (NIST) for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff to better understand the needs of the researchers within the community. Material for this event included the written documentation from each of the profiled research areas, documentation about the current state of technology support, and a write-up of the discussion that took place via e-mail and video conferencing. The case studies highlighted the ongoing challenges and opportunities that NIST has in supporting a cross-section of established and emerging research use cases. Each case study mentioned unique challenges which were summarized into common needs.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

New York-Presbyterian and Columbia University Irving Medical Center Requirements (Analysis Report)

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Between February and June 2024, staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from New York-Presbyterian (NYP), Columbia University Irving Medical Center (CUIMC), and NYSERNet for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff to better understand the needs of the researchers within the community. Material for this event included the written documentation from each of the profiled research areas, documentation about the current state of technology support, and a write-up of the discussion that took place via e-mail and video conferencing. The case studies highlighted the ongoing challenges and opportunities that NYP and CUIMC have in supporting a cross-section of established and emerging research use cases. Each case study mentioned unique challenges which were summarized into common needs.

97 MATHEMATICS AND COMPUTING↗

Salk Institute for Biological Studies Requirements (Analysis Report)

EPOC uses the Deep Dive process to discuss and analyze current and planned science, research, or education activities and the anticipated data output of a particular use case, site, or project to help inform the strategic planning of a campus or regional networking environment. This includes understanding future needs related to network operations, network capacity upgrades, and other technological service investments. A Deep Dive comprehensively surveys major research stakeholders’ plans and processes in order to investigate data management requirements over the next 5–10 years. Between February and March 2024, staff members from the Engagement and Performance Operations Center (EPOC) met with researchers and staff from the Salk Institute for Biological Studies (Salk) for the purpose of a Deep Dive into scientific and research drivers. The goal of this activity was to help characterize the requirements for a number of campus use cases, and to enable cyberinfrastructure support staff better to understand the needs of the researchers within the community. Material for this event included the written documentation from each of the profiled research areas, documentation about the current state of technology support, and a write-up of the discussion that took place via e-mail and video conferencing. The case studies highlighted the ongoing challenges and opportunities that Salk Institute for Biological Studies have in supporting a cross-section of established and emerging research use cases. Each case study mentioned unique challenges which were summarized into common needs.

59 BASIC BIOLOGICAL SCIENCES↗

gLaSDI: Parametric physics-informed greedy latent space dynamics identification

A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the proposed gLaSDI framework, an autoencoder discovers intrinsic nonlinear latent representations of high-dimensional data, while dynamics identification (DI) models capture local latent-space dynamics. Here, an interactive training algorithm is adopted for the autoencoder and local DI models, which enables identification of simple latent-space dynamics and enhances accuracy and efficiency of data-driven reduced-order modeling. To maximize and accelerate the exploration of the parameter space for the optimal model performance, an adaptive greedy sampling algorithm integrated with a physics-informed residual-based error indicator and random-subset evaluation is introduced to search for the optimal training samples on the fly. Further, to exploit local latent-space dynamics captured by the local DI models for an improved modeling accuracy with a minimum number of local DI models in the parameter space, a -nearest neighbor convex interpolation scheme is employed. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including Burgers equations, nonlinear heat conduction, and radial advection. The proposed adaptive greedy sampling outperforms the conventional predefined uniform sampling in terms of accuracy. Compared with the high-fidelity models, gLaSDI achieves 17 to 2,658× speed-up with 1 to 5% relative errors.

97 MATHEMATICS AND COMPUTING↗

Local and long-range atomic/magnetic structure of non-stoichiometric spinel iron oxide nanocrystallites

Spinel iron oxide nanoparticles of different mean sizes in the range 10–25 nm have been prepared by surfactant-free up-scalable near- and super-critical hydrothermal synthesis pathways and characterized using a wide range of advanced structural characterization methods to provide a highly detailed structural description. The atomic structure is examined by combined Rietveld analysis of synchrotron powder X-ray diffraction (PXRD) data and time-of-flight neutron powder-diffraction (NPD) data. The local atomic ordering is further analysed by pair distribution function (PDF) analysis of both X-ray and neutron total-scattering data. It is observed that a non-stoichiometric structural model based on a tetragonal γ-Fe 2 O 3 phase with vacancy ordering in the structure (space group P 4 3 2 1 2) yields the best fit to the PXRD and total-scattering data. Detailed peak-profile analysis reveals a shorter coherence length for the superstructure, which may be attributed to the vacancy-ordered domains being smaller than the size of the crystallites and/or the presence of anti-phase boundaries, faulting or other disorder effects. The intermediate stoichiometry between that of γ-Fe 2 O 3 and Fe 3 O 4 is confirmed by refinement of the Fe/O stoichiometry in the scattering data and quantitative analysis of Mössbauer spectra. The structural characterization is complemented by nano/micro-structural analysis using transmission electron microscopy (TEM), elemental mapping using scanning TEM, energy-dispersive X-ray spectroscopy and the measurement of macroscopic magnetic properties using vibrating sample magnetometry. Notably, no evidence is found of a Fe 3 O 4 /γ-Fe 2 O 3 core-shell nanostructure being present, which had previously been suggested for non-stoichiometric spinel iron oxide nanoparticles. Finally, the study is concluded using the magnetic PDF (mPDF) method to model the neutron total-scattering data and determine the local magnetic ordering and magnetic domain sizes in the iron oxide nanoparticles. The mPDF data analysis reveals ferrimagnetic collinear ordering of the spins in the structure and the magnetic domain sizes to be ∼60–70% of the total nanoparticle sizes. The present study is the first in which mPDF analysis has been applied to magnetic nanoparticles, establishing a successful precedent for future studies of magnetic nanoparticles using this technique.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An Algorithmic and Software Pipeline for Very Large Scale Scientific Data Compression with Error Guarantees

Efficient data compression is becoming increasingly critical for storing scientific data because many scientific applications produce vast amounts of data. This paper presents an end-to-end algorithmic and software pipeline for data compression that guarantees both error bounds on primary data (PD) and derived data, known as Quantities of Interest (QoI).We demonstrate the effectiveness of the pipeline by compressing fusion data generated by a large-scale fusion code, XGC, which produces tens of petabytes of data in a single day. We demonstrate that the compression is conducted by setting aside computational resources known as staging nodes, and does not impact the simulation performance. For efficient parallel I/O, the pipeline uses ADIOS2, which many codes such as XGC already use for their parallel I/O. We show that our approach can compress the data by two orders of magnitude while guaranteeing high accuracy on both the PD and the QoIs. Further, the amount of resources required by compression is a few percent of the resources required by simulation while ensuring that the compression time for each stage is less than the corresponding simulation time.This pipeline consists of three main steps. The first step decomposes the data using domain decomposition into small subdomains. Each subdomain is then compressed independently to achieve a high level of parallelism. The second step uses existing techniques that guarantee error bounds on the primary data for each subdomain. The third step uses a post-processing optimization technique based on Lagrange multipliers to reduce the QoI errors for data corresponding to each subdomain. The Lagrange multipliers generated can be further quantized or truncated to increase the compression level. All of the above characteristics of our approach make it highly practical to apply on-the-fly compression while guaranteeing errors on QoIs that are critical to the scientists.

Banerjee, Tania↗

Engineering & Microstructure Scale PIE Report on EBR-II X441A Metallic Fuel Pins for the MORPH Experiment

The objectives of this project are to increase fundamental understanding of irradiation induced metallic U-Pu-Zr fuel behavior and to obtain data needed for the development of irradiation models for metallic fuels in MARMOT. The requested metallic fuel pins are from the X441A experiment irradiated in Experimental Breeder Reactor (EBR)-II and will be provided by the PIs for the duration of the experiment. The purpose of the pins irradiated in the X441A assembly was to vary Zr composition and fuel slug diameter in order to provide data for the metallic fuel performance code “LIFEMETAL” [ANL-IFR-125]. The fuels of interest to this project are metallic fuels with several Zr compositions (in wt.%): U-19Pu-6Zr, U-19Pu-10Zr, and U-19Pu-14Zr, which were irradiated to a peak burnup of approximately 11 at.%. The cladding was the same for all three fuel pins (austenitic stainless steel D9), which allows investigation of fuel-cladding interaction (FCI) phenomena. Varying Zr content in fuel pins enables investigation of the effect of Zr on fuel restructuring and fuel-cladding compatibility. Engineering and microstructure scale PIE activities will be focused on investigation of fundamental aspect of fuel performance such as species diffusion and migration, fission product behavior, and constituent redistribution. Obtained microstructural information will be used as the basis for the development of MARMOT models of U-Pu-Zr fuel performance at the mesoscale. Experimental data obtained through this proposal will be used to provide this fundamental understanding which will serve as the foundation of the development of radiation models for U-Pu-Zr in MARMOT. It will also provide a starting point for the design of new experiments to provide data for the validation of these MARMOT models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Reduced‐Order Modeling for Linearized Representations of Microphysical Process Rates

Abstract Representing cloud microphysical processes in large scale atmospheric models is challenging because many processes depend on the details of the droplet size distribution (DSD, the spectrum of droplets with different sizes in a cloud). While full or partial statistical moments of droplet size distributions are the typical variables used in bulk models, prognostic moments are limited in their ability to represent microphysical processes across the range of conditions experienced in the atmosphere. Microphysical parameterizations employing prognostic moments are known to suffer from structural uncertainty in their representations of inherently higher dimensional cloud processes, which limit model fidelity and lead to forecasting errors. Here we investigate how data‐driven reduced‐order modeling can be used to learn predictors for microphysical process rates in bulk microphysics schemes in an unsupervised manner from higher dimensional bin distributions. Using simulations characteristic of marine stratiform clouds, we simultaneously learn lower dimensional representations of droplet size distributions and predict the evolution of the microphysical state of the system. Droplet collision‐coalescence, the main process for generating warm rain, is estimated to have an intrinsic dimension of three. This intrinsic dimension provides a lower limit on the number of degrees of freedom needed to accurately represent collision‐coalescence in models. We demonstrate how deep learning based reduced‐order modeling can be used to discover intrinsic coordinates describing the microphysical state of the system, where process rates such as collision‐coalescence are globally linearized. These implicitly learned representations of the DSD retain more information about the DSD than typical moment‐based representations.

54 ENVIRONMENTAL SCIENCES↗

Data-driven recovery of hidden physics in reduced order modeling of fluid flows

In this article, we introduce a modular hybrid analysis and modeling (HAM) approach to account for hidden physics in reduced order modeling (ROM) of parameterized systems relevant to fluid dynamics. The hybrid ROM framework is based on using first principles to model the known physics in conjunction with utilizing the data-driven machine learning tools to model the remaining residual that is hidden in data. This framework employs proper orthogonal decomposition as a compression tool to construct orthonormal bases and Galerkin projection (GP) as a model to build the dynamical core of the system. Our proposed methodology hence compensates structural or epistemic uncertainties in models and utilizes the observed data snapshots to compute true modal coefficients spanned by these bases. The GP model is then corrected at every time step with a data-driven rectification using a long short-term memory (LSTM) neural network architecture to incorporate hidden physics. A Grassmannian manifold approach is also adopted for interpolating basis functions to unseen parametric conditions. The control parameter governing the system's behavior is thus implicitly considered through true modal coefficients as input features to the LSTM network. The effectiveness of the HAM approach is then discussed through illustrative examples that are generated synthetically to take hidden physics into account. Furthermore, our approach thus provides insights addressing a fundamental limitation of the physics-based models when the governing equations are incomplete to represent underlying physical processes.

42 ENGINEERING↗

Design and performance of an in-vacuum, magnetic field mapping system for the Muon g-2 experiment

The Muon g - 2 experiment at Fermilab (E989) aims to measure the anomalous magnetic moment, a μ , of the muon with a precision of 140 parts-per-billion. This requires a precise measurement of both the anomalous spin precession frequency, ω α , of muons stored in a magnetic field of 1.45 T, and a precise measurement of that magnetic field in terms of the shielded proton Larmor frequency, ω' ρ . The measurement of ω' ρ with a total systematic uncertainty of 70 parts-perbillion involves a combination of various nuclear magnetic resonance (NMR) probes. There are 378 probes mounted in fixed locations that constantly monitor field drifts. A water-based, cylindrical calibration probe provides the calibration in terms of the shielded proton Larmor frequency. A crucial element for the multi-step measurement of ω' ρ is the regular mapping of the magnetic field over the muon storage region. The former experiment at Brookhaven National Laboratory (BNL) employed an in-vacuum field mapping system equipped with 17 NMR probes, which was developed by the University of Heidelberg. We have refurbished and upgraded this system with new probes and electronics. The upgrades include the addition of 16-bit, 1 MSPS digitization of the NMR signals, which replaced the hardware-implemented zero-crossing counting of the system at Brookhaven. The digitized signals offer new capabilities in the NMR frequency analysis and its related systematic uncertainties. To sustain the higher data rates, a new communication scheme with time-division multiplexing was implemented to separate the important NMR reference clock from the data communication in order to reach the specifications for the accuracy and stability of the reference clock. A new barcode reader provides more precise azimuthal position determination during the measurement and calibration. While the mechanical systems that move the field mapper inside the storage ring have been mostly refurbished from BNL, the motion control system was completely replaced with a custom-built electronics centered around a commercial Galil motion controller. Both the field mapping NMR system and its motion control were successfully commissioned at Fermilab and have been in reliable operation during the first three data taking periods of the experiment at Fermilab. Finally, this article will provide the details of the upgrades of the field mapper and its performance.

47 OTHER INSTRUMENTATION↗

A Comparison of Time Series Gap-Filling Methods to Impute Solar Radiation Data

Complete solar resource datasets play a critical role at every stage of solar project phases. However, measured or modeled solar resource data come with significant uncertainties and usually suffer from several issues, including but not limited to, data gaps, data quality issue, etc. In order to mitigate these issues an appropriate data imputation method should be implemented to build a complete and reliable temporal (and spatial) database. Being motivated by this, in this study we compare the performances of eight different gap filling methods extensively by creating random and artificial data gaps in (i) hourly irradiance data for one year using a few locations of the National Solar Radiation Database (NSRDB) and (ii) one-minute ground measurement dataset from Surface Radiation Budget Network (SURFRAD) stations.

clearness index↗

PROTEUS: Machine Learning Driven Resilience for Extreme-scale Systems

The objective of this project is to design, develop, and evaluate scalable software to enhance resilience, data checkpointing, program restart, and analysis. The proposed tasks are to 1) develop scalable machine learning techniques to learn temporal change patterns in a scalable and in-situ manner, and to minimize data movement and maximize learning locally closest to data; 2) design a concise data representation and indexing mechanism to capture the distribution of changes in data that can guarantee point-wise user-defined tolerable errors while reducing the data storage requirements by an order of magnitude or more; 3) develop data reduction techniques as library modules; 4) exploit local SSD for minimizing data movement in storage hierarchy; 5) develop anomaly detection algorithms that can predict corruptions based on learning of emerging patterns; 6) develop software libraries to be incorporated within widely used data formats and APIs; and 7) evaluate the proposed software using DOE scientific applications. The outcomes of the proposed work are to satisfy many synergistic data reduction and resilience requirements for large-scale data intensive applications executed on extreme-scale computing systems. The developed mechanism for error-bound data approximation is directly applicable to existing scientific applications. Through machine learning from historical events and change distribution, this work will enable anomaly detection for DOE computer facility.

97 MATHEMATICS AND COMPUTING↗

Development of neural network force fields for corrosion studies

To fully understand the chemistry and physics of corrosion, novel methods of simulation must be developed. One approach is designing machine learning (ML) algorithms integrated with density functional theory to develop adaptive force fields to gain insight into corrosion behavior namely at the surface of metal oxides. Current methods of modeling corrosion are slow due to the computational cost of resolving both reaction mechanics and mass transport processes. Machine learning methods can be implemented to obtain structure-activity relationships at both the molecular and bulk scale while still retaining the accuracy of density functional theory (DFT) and significantly decreasing the time needed for simulations of complex chemical processes in the various environments of corrosion. Multiscale models are needed for corrosion studies to fully understand its processes not only at the atomic length scale (chemical bonding, energies, and forces), but also at the nano and meso length scales (solid-state physics and material science processes). Current methods of study include DFT, molecular dynamics, and Monte Carlo. The limitation of DFT is that only a small number of atoms or molecules can be simulated at that level of theory. Density functional theory is used to study the electronic structure of atoms and molecules, and calculate the force component of each atom. However, these calculations are limited to about 1000 atoms. Custom periodic boundary conditions (PBC) can be used to describe the various environments and defects that affect the atomic forces to produce a large data set from which a training set can be derived. Machine learning can be utilized to overcome the barrier of modeling macroscopic and multi-scale processes from ab initio calculations through the development of adaptive force fields. Local environments determine the atomic forces of a given system, therefore adaptive force fields must be created to produce reliable quantum mechanical calculations. This can be achieved by developing a learning algorithm that uses the mapped atomic forces or fingerprint as an input to produce energies and magnetic moments as output. A systematic approach was used to begin to build a data set in order to accurately describe the atomic forces in various environments. In Figure 4 below, a simple PBC cell of Fe{sub 2}O{sub 3} was first optimized. A surface optimization was performed next, followed by a hydroxylated surface optimization. Once this calculation has converged, the adsorption of halide species to the hydroxylated surface will be investigated. TensorFlow is an open source platform for machine learning developed by Google. Using a high level application program interface (API) such as Keras allows for building and training ML models easily in a number of different environments and languages. For this project, a neural network was developed within Anaconda in Python. Future Work: Further development of reference data set; Refining neural network and learning algorithm; Fingerprinting atomic environment to enable mapping of atomic force components; Choosing appropriate training set from reference data; Learning from training set and enabling non-linear mapping of training set fingerprints and the atomic forces; Estimation of uncertainty to identify ranges of outside applicability; Testing and analysis of molecular dynamic simulations.

36 MATERIALS SCIENCE↗

Nucleon momentum fraction, helicity and transversity from 2+1-flavor lattice QCD

A detailed analysis of the systematic uncertainties in the calculation of the isovector momentum fraction, ( x ) u - d , helicity moment, ( x ) Δ u - Δ d , and the transversity moment, ( x ) δu - δd , of the nucleon is presented using high-statistics data on seven ensembles of gauge configurations generated by the JLab/W&M/LANL/MIT collaborations using 2 + 1-flavors of dynamical Wilson-clover quarks. The much higher statistics have facilitated better control over all systematics compared to previous lattice calculations. The least understood systematic — excited-state contamination — is quantified by studying the variation of the results as a function of different estimates of the mass gap of the first excited state, obtained from two- and three-point correlation functions, and as a function of the pion mass M π . The final results are obtained using a simultaneous fit in the lattice spacing a , pion mass M π and the finite volume parameter M π L keeping leading order corrections. The data show no significant dependence on the lattice spacing and some evidence for finite-volume corrections. Our final results, in the $ \overline{\mathrm{MS}} $ scheme at 2 GeV, are ( x ) u - d = 0 . 155(17)(20), ( x ) Δ u - Δ d = 0 . 183(14)(20) and ( x ) δu - δd = 0 . 220(18)(20), where the first error is the overall analysis uncertainty assuming excited-state contributions have been removed, and the second is an additional systematic uncertainty due to possible residual excited-state contributions. These results are consistent with phenomenological global fit values.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PV Fleet Performance Data Initiative Program and Methodology

The US Department of Energy’s PV Fleet Performance Data Initiative has been launched in order to collect and evaluate production data across multiple PV fleet partners. Performance statistics are anonymized, aggregated and shared to represent a snapshot of the US commercial and utility-scale fleet. Production data have been collected from over 1500 systems representing more than 1.3 GWdc capacity. Preliminary analysis indicates median performance loss rates are in line with previous publications of system degradation, on the order of –0.6%/yr to –0.9%/yr (preliminary numbers subject to change). These values are higher than module-only degradation rates which are often used in pro-forma estimates of project performance and economics, potentially exposing owner/operators to increased risk if systems under-perform over time.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Estimating Energy Market Schedules using Historical Price Data

The global climate crisis is expected to reshape the energy generation landscape in the coming decades. Increasing integration of non-dispatchable renewable energy resources into energy infrastructures and markets creates uncertainty as well as new opportunities for flexible energy systems. To conduct proper economic evaluation of flexible energy systems, such as integrated energy systems (IES), advancements in modelling of market interactions, such as bidding, is crucial. This work presents a shortcut algorithm which uses two mixed integer linear programs to compute dispatch schedules (e.g., hourly power production targets) that are constrained by the resource's bid information and characteristics (e.g., minimum up and down times) based on historical locational marginal price (LMP) data. The proposed algorithm is approximately 100 times faster and uses orders of magnitude less data than a full production cost model (PCM). We find the shortcut simulator recapitulates generator dispatch signals for the Prescient PCM with approximately 4% error for the RTS-GMLC test system.

electricity generation↗