RAPIDS-2: a SciDAC Institute for Resource and Application Productivity through Computation, Information, and Data Science Final Report (University of Oregon)
Final report
Malony, Allen D. [University of Oregon] (ORCID:000↗
SEARCH · Search NASA
Results for “computational data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Low cost, hardened single board computer for command and data handling
A radiation hardened single board computer (SBC) includes a processor; static random-access memory (SRAM); non-volatile memory; a field programmable gate array (FPGA); and board-level physical layer interfaces.
97 MATHEMATICS AND COMPUTING↗
Towards Scaling Law Analysis For Spatiotemporal Weather Data
Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively homogeneous. Weather forecasting is harder to characterize in the same framework: autoregressive rollouts compound errors over long horizons, outputs couple many physical channels with disparate scales and predictability, and globally pooled test metrics can disagree sharply with per-channel, late-lead behavior implied by short-horizon training. We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics. We quantify (1) how prediction error is distributed across channels and how its growth rate evolves with forecast horizon, (2) if power law scaling holds for test error, relative to rollout length when error is pooled globally, and (3) how that fit varies jointly with horizon and channel for parameter, data, and compute-based scaling axes. We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads. We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.
Kiefer Jr, Alexander [ORNL] (ORCID:000000025398874↗
RCSB Protein Data Bank: visualizing groups of experimentally determined PDB structures alongside computed structure models of proteins
Recent advances in Artificial Intelligence and Machine Learning (e.g., AlphaFold, RosettaFold, and ESMFold) enable prediction of three-dimensional (3D) protein structures from amino acid sequences alone at accuracies comparable to lower-resolution experimental methods. These tools have been employed to predict structures across entire proteomes and the results of large-scale metagenomic sequence studies, yielding an exponential increase in available biomolecular 3D structural information. Given the enormous volume of this newly computed biostructure data, there is an urgent need for robust tools to manage, search, cluster, and visualize large collections of structures. Equally important is the capability to efficiently summarize and visualize metadata, biological/biochemical annotations, and structural features, particularly when working with vast numbers of protein structures of both experimental origin from the Protein Data Bank (PDB) and computationally-predicted models. Moreover, researchers require advanced visualization techniques that support interactive exploration of multiple sequences and structural alignments. This paper introduces a suite of tools provided on the RCSB PDB research-focused web portal RCSB. org, tailor-made for efficient management, search, organization, and visualization of this burgeoning corpus of 3D macromolecular structure data.
3D visualization↗
Parallel IO Libraries for Managing HEP Experimental Data
The computing and storage requirements of the energy and intensity frontiers will grow significantly during the Run 4 & 5 and the HL-LHC era. Similarly, in the intensity frontier, with larger trig ger readouts during supernovae explosions, the Deep Underground Neutrino Experiment (DUNE) will have unique computing challenges that could be addressed by the use of parallel and accelerated dataprocessing capabilities. Most of the requirements of the energy and intensity frontier experiments rely on increasing the role of high performance computing (HPC) in the HEP community. In this presentation, we will describe our ongoing efforts that are focused on using HPC resources for the next generation HEP experiments. The HEPCCE (High Energy Physics-Center for Computational Excellence) IOS (Input/Output and Storage) group has been developing approaches to map HEP data to the HDF5 , an IO library optimized for the HPC platforms to store the intermediate HEP data. The complex HEP data products are serialized using ROOT to allow for experiment independent general mapping approaches of the HEP data to the HDF5 format. The mapping approaches can be optimized for high performance parallel IO. Similarly, simpler data can be directly mapped into the HDF5, which can also be suitable for offloading into the GPUs directly. We will present our works on both complex and simple data model models.
Bashyal, Amit↗
In situ Visible Light and Thermal Imaging Data from a Laser Powder Bed Fusion Additive Manufacturing Process Co-Registered to X-ray Computed Tomography and Fatigue Data
This dataset is comprised of in situ sensing data collected during a laser-based powder bed fusion additive manufacturing process, as well as rasterized scan path information, post-build X-ray computed tomography (XCT), and fatigue test results. A total of 64 cylinders, approximately 15 mm in diameter and 102 mm tall, were printed out of stainless steel 316H on a Colibrium Additive Concept Laser M2 Series 5 machine. Parameters known to produce dense material were used to construct 56 of these cylinders, while the remaining 8 cylinders were printed with relatively high energy density parameters prone to producing keyhole pores. In addition, two spatter generation blocks were constructed upstream of the 64 cylinders such that ejecta produced during the melting of the spatter generators were stochastically seeded onto the 64 cylinders. Based on previous experiments, these spatter particles were theorized to produce stochastic lack-of-fusion pores. During the construction of the build, high-resolution images of reflected light in the visible spectrum were captured both before and after recoating for each print layer. Additionally, temporally integrated thermal imaging in the near infrared spectrum produced integrated sum and max images on a layerwise basis. The multimodal in situ data has been co-registered to the build plate coordinate system, allowing for identification of process anomalies (e.g., spatter particles) apparent in the two sensors. Following construction of the build, the cylinders were subjected to XCT to identify internal flaws, and the resulting data have also been registered to the build plate coordinate system. Finally, 60 of the 64 cylinders were machined into fatigue coupons conforming to ASTM E466 and subsequently subjected to either high- or -low-cycle fatigue testing. The results of the fatigue tests have also been included in the dataset, and the XCT data corresponded to the approximate location of the gauge sections of the machine fatigue specimen geometry.
42 ENGINEERING↗
Alternative mixed integer linear programming optimization for joint job scheduling and data allocation in grid computing
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm setting.
97 MATHEMATICS AND COMPUTING↗
Smoky Mountain Data Challenge 2021: An Open Call to Solve Scientific Data Challenges Using Advanced Data Analytics and Edge Computing
The 2021 Smoky Mountains Computational Sciences and Engineering Conference enlists scientists from across Oak Ridge National Laboratory (ORNL) and industry to be data sponsors and help create data analytics and edge computing challenges for eminent datasets in a variety of scientific domains. This work describes the significance of each of the eight datasets and their associated challenge questions. The challenge questions for each dataset were required to cover multiple difficulty levels. An international call for participation was sent to students, asking them to form teams of up to six people and apply novel data analytics and edge computing methods to solve these challenges.
Devineni, Pravallika↗
Process Image Analysis using Big Data, Machine Learning, and Computer Vision
The development of algorithms for machine learning and data analysis for the 3013 MIS corrosion surveillance program is a collaborative effort by SRNL, USC and GT. For corrosion detection, LCM image data is extracted from large binary files, with software written to convert the data to physical attributes (i.e. height, color and grayscale values; all as functions of a location in a plane projection). The user interface for the software permits selective downloading of binary data and interrogation of attributes. User input thresholds are used to flag attributes of interest. Machine learning algorithms, developed for this application, are used to determine whether the features are the result of corrosion. To address the fundamental mechanisms of corrosion, machine learning algorithms are being developed to derive interatomic potential force-fields from ab-initio DFT calculations. The goal is to apply molecular modeling on a large enough scale to guide the design of resistant materials.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Automated analysis of lattice structures using computed tomography
Systems, methods, and computer-readable media for evaluating a set of computed tomography data associated with a lattice structure. The lattice structure may be additively manufactured. The computed tomography data may be segmented using a filter for identifying blob-like structures to identify nodes present within the lattice structure. A three-dimensional path traversal is applied to volumetric data to identify a plurality of struts within the lattice structure that are compared to corresponding struts within a set if three-dimensional mesh data of the lattice structure to identify defective struts. Further, two-dimensional slices may be extracted from each of the computed tomography data and the mesh data and compared to identify one or more inconsistencies indicative of defects within the lattice structure.
Schiefelbein, Bryan E.↗
Automated analysis of lattice structures using computed tomography
Systems, methods, and computer-readable media for evaluating a set of computed tomography data associated with a lattice structure. The lattice structure may be additively manufactured. The computed tomography data may be segmented using a filter for identifying blob-like structures to identify nodes present within the lattice structure. A three-dimensional path traversal is applied to volumetric data to identify a plurality of struts within the lattice structure that are compared to corresponding struts within a set if three-dimensional mesh data of the lattice structure to identify defective struts. Further, two-dimensional slices may be extracted from each of the computed tomography data and the mesh data and compared to identify one or more inconsistencies indicative of defects within the lattice structure.
Schiefelbein, Bryan E.↗
Magnetic structure, excitations and short-range order in honeycomb Na 2 Ni 2 TeO 6
Na 2 Ni 2 TeO 6 has a layered hexagonal structure with a honeycomb lattice constituted by Ni 2+ and a chiral charge distribution of Na + that resides between the Ni layers. In the present work, the antiferromagnetic transition temperature of Na 2 Ni 2 TeO 6 is confirmed at TN˜ 27 K, and further, it is found to be robust up to 8 T magnetic field and 1.2 GPa external pressure; and, without any frequency-dependence. Slight deviations from nominal Na-content (up to 5%) does not seem to influence the magnetic transition temperature, TN. Isothermal magnetization curves remain almost linear up to 13 T. Our analysis of neutron diffraction data shows that the magnetic structure of Na 2 Ni 2 TeO 6 is faithfully described by a model consisting of two phases described by the commensurate wave vectors vec kc, (0.5 0 0) and (0.5 0 0.5), with an additional short-range order component incorporated in to the latter phase. Consequently, a zig-zag long-range ordered magnetic phase of Ni 2+ results in the compound, mixed with a short-range ordered phase, which is supported by our specific heat data. Theoretical computations based on density functional theory (DFT) predict predominantly in-plane magnetic exchange interactions that conform to a J1-J2-J3 model with a strong J3 term. The computationally predicted parameters lead to a reliable estimate for TN and the experimentally observed zig-zag magnetic structure. A spin wave excitation in Na 2 Ni 2 TeO 6 at E ˜ 5 meV at T = 5 K is mapped out through inelastic neutron scattering experiments, which is reproduced by linear spin wave theory calculations using the J values from our computations. Our specific heat data and inelastic neutron scattering data strongly indicate the presence of short-range spin correlations, at T > TN, stemming from incipient antiferromagnetic clusters.
36 MATERIALS SCIENCE↗
Sparsity Based Approaches for Distribution Grid State Estimation - A Comparative Study
Not Available
97 MATHEMATICS AND COMPUTING↗
UAS remote sensing (Autel EVO II platform): Red-green-blue (RGB) imagery and derived products (Level 0-2 data), Seward Peninsula, Alaska, 2022
Airborne remote sensing data collected using a optical red-green-blue (RGB) sensor installed on an Autel EVO II unoccupied aerial system (UAS). This package includes data from 15 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71, Kougarok MM64, and Teller MM27 sites on the Seward Peninsula, Alaska USA, in July 2022. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors, and Level 1-2 processed products including digital surface models (DSM), photo orthomosaics, canopy height models (CHM) and digital terrain models (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as image (*.jpg, *.tif), point cloud (*.laz), tabular (*.csv) and *.pdf formats. Raw images are compressed as tar.gz. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the data and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
54 ENVIRONMENTAL SCIENCES↗
UAS remote sensing (Autel EVO II platform): Red-green-blue (RGB) imagery and derived products (Level 0-2 data), Seward Peninsula, Alaska, 2023
Airborne remote sensing data collected using a optical red-green-blue (RGB) sensor installed on an Autel EVO II unoccupied aerial system (UAS). This package includes data from 4 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71 and Teller MM27 sites on the Seward Peninsula, Alaska USA, in July 2023. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors, and Level 1-2 processed products including digital surface models (DSM), photo orthomosaics, canopy height models (CHM) and digital terrain models (DTM). Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as image (*.jpg, *.tif), point cloud (*.laz), tabular (*.csv) and *.pdf formats. Raw images are compressed as tar.gz. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the data and file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
54 ENVIRONMENTAL SCIENCES↗
UAS remote sensing (AltaX platform): Red-green-blue (RGB) imagery, thermal infrared (TIR) imagery, and canopy reflectance (Level 0 data), Seward Peninsula, Alaska, 2023
Airborne remote sensing data collected using Brookhaven National Laboratory’s (BNL) heavy-lift unoccupied aerial system (UAS) AltaX platform on the Seward Peninsula, Alaska, USA. This package includes raw (L0) data from 11 flights flown over the NGEE-Arctic Kougarok mile marker 64 (MM64) and Teller MM 27 sites in July, 2023. The AltaX is a multi-sensor UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) and thermal infrared (TIR) surface “skin” temperature imagery, as well as near-surface surface reflectance at 1 nm intervals in the visible to near-infrared spectral range from ~350 – 1000 nm. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors. Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as text (*.txt, *.json), binary (*.dat, *.ulg), tabular (*.csv), geospatial (*.kml. *kmz), image (*.jpg, *.png, *.tif) and pdf formats. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the L0 data and the file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
54 ENVIRONMENTAL SCIENCES↗
UAS remote sensing (AltaX platform): Red-green-blue (RGB) imagery, thermal infrared (TIR) imagery, and canopy reflectance (Level 0 data), Seward Peninsula, Alaska, 2022
Airborne remote sensing data collected using Brookhaven National Laboratory’s (BNL) heavy-lift unoccupied aerial system (UAS) AltaX platform on the Seward Peninsula, Alaska, USA. This package includes raw (L0) data from 10 flights flown over the NGEE-Arctic Kougarok mile marker 64 (MM64) and Teller MM 27 sites in July, 2022. The AltaX is a multi-sensor UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) and thermal infrared (TIR) surface “skin” temperature imagery, as well as near-surface surface reflectance at 1 nm intervals in the visible to near-infrared spectral range from ~350 – 1000 nm. This package provides the Level 0 (raw, unprocessed) data collected by the platform and sensors. Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as text (*.txt, *.json), binary (*.dat, *.ulg), tabular (*.csv), geospatial (*.kml. *kmz), image (*.jpg, *.png, *.tif) and pdf formats. The metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the L0 data and the file naming scheme.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
54 ENVIRONMENTAL SCIENCES↗
UAS remote sensing (Osprey platform): Red-green-blue (RGB) imagery, thermal infrared (TIR) imagery, and canopy reflectance, Seward Peninsula, Alaska, 2017
Airborne remote sensing data collected using the Brookhaven National Laboratory's (BNL) heavy-lift unoccupied aerial system (UAS) octocopter platform - the Osprey - operated by the Terrestrial Ecosystem Science and Technology (TEST) group (https://www.bnl.gov/testgroup). This package includes raw (L0) data from 14 flights flown over the NGEE-Arctic Council Mile Marker 71 (MM71), Kougarok MM64, and Teller MM 27 sites in August, 2017. The Osprey is a multi-sensor UAS platform that simultaneously measures very high spatial resolution optical red/green/blue (RGB) and thermal infrared (TIR) surface "skin" temperature imagery, as well as near-surface surface reflectance at 1 nm intervals in the visible to near-infrared spectral range from ~350-1000 nm measured at regular intervals along each flight path. This package provides the Level 0 (raw, unprocessed) data collected by the Osprey platform. Ancillary aircraft data, flight mission parameters, and general flight conditions provided by the onboard flight and data collection computers are also included. Data and metadata are provided as text (*.txt, *.json), tabular (*.dat, *.csv, *.waypoint), and image (*.jpg) formats. This metadata documents contain flight campaign, platform, sensor, flight and file metadata, along with a description of the L0 data and the file naming scheme. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
54 ENVIRONMENTAL SCIENCES↗