Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

CORRLA-RS

The CORRLA-RS package provides a suite of statistical methods for sampling multidimensional distributions and to conduct sensitivity and correlation analysis of large scale data in the Rust programming language. The software provides a unique solution to multidimensional constrained sampling problems utilizing a combination of parallelized Markov Chain Monte Carlo methods and traditional rejection sampling. The sensitivity and correlation analysis methods are backed by a high performance randomized singular value decomposition implementation which enables datasets larger than the random access memory (RAM) size to be analyzed. Additionally, CORRLA-RS implements the active subspace identification method using a KD-Tree and the randomized singular value decomposition acting in concert.

Gurecky, William [Oak Ridge National Laboratory (O↗
DOE OSTI2026

BoBa

BoBa is a C++ software library for working with large matrices, tensors, and tensor decompositions. The library provides tools for dense matrix and tensor operations, tensor decompositions, and tensor decomposition methods that support modern CPU and GPU architectures. It includes portable abstractions for linear algebra, tensor algebra, and multidimensional computation. BoBa is intended for scientific computing applications that involve large multidimensional data sets or high dimensional mathematical models. Its capabilities support tasks such as data compression, linear algebra, efficient numerical computation, and the development of scalable algorithms for heterogeneous hardware. Tutorials, tests, and example applications are included to help users learn and apply the library.

Yao, Jin [Lawrence Livermore National Laboratory (↗
DOE OSTI2023

Three-dimensional nanoscale reduced-angle ptycho-tomographic imaging with deep learning (RAPID)

X-ray ptychographic tomography is a nondestructive method for three dimensional (3D) imaging with nanometer-sized resolvable features. The size of the volume that can be imaged is almost arbitrary, limited only by the penetration depth and the available scanning time. Here we present a method that rapidly accelerates the imaging operation over a given volume through acquiring a limited set of data via large angular reduction and compensating for the resulting ill-posedness through deeply learned priors. The proposed 3D reconstruction method “RAPID” relies initially on a subset of the object measured with the nominal number of required illumination angles and treats the reconstructions from the conventional two-step approach as ground truth. It is then trained to reproduce equal fidelity from much fewer angles. After training, it performs with similar fidelity on the hitherto unexamined portions of the object, previously not shown during training, with a limited set of acquisitions. In our experimental demonstration, the nominal number of angles was 349 and the reduced number of angles was 21, resulting in a x140 aggregate speedup over a volume of 4.48 x 93.18 x 3.92 μm 3 and with (14nm) 3 feature size, i.e. ~ 10 8 voxels. RAPID’s key distinguishing feature over earlier attempts is the incorporation of atrous spatial pyramid pooling modules into the deep neural network framework in an anisotropic way. We found that adjusting the atrous rate improves reconstruction fidelity because it expands the convolutional kernels’ range to match the physics of multi-slice ptychography without significantly increasing the number of parameters.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Learning epistatic polygenic phenotypes with Boolean interactions

Detecting epistatic drivers of human phenotypes is a considerable challenge. Traditional approaches use regression to sequentially test multiplicative interaction terms involving pairs of genetic variants. For higher-order interactions and genome-wide large-scale data, this strategy is computationally intractable. Moreover, multiplicative terms used in regression modeling may not capture the form of biological interactions. Building on the Predictability, Computability, Stability (PCS) framework, we introduce the epiTree pipeline to extract higher-order interactions from genomic data using tree-based models. The epiTree pipeline first selects a set of variants derived from tissue-specific estimates of gene expression. Next, it uses iterative random forests (iRF) to search training data for candidate Boolean interactions (pairwise and higher-order). We derive significance tests for interactions, based on a stabilized likelihood ratio test, by simulating Boolean tree-structured null (no epistasis) and alternative (epistasis) distributions on hold-out test data. Finally, our pipeline computes PCS epistasis p-values that probabilisticly quantify improvement in prediction accuracy via bootstrap sampling on the test set. We validate the epiTree pipeline in two case studies using data from the UK Biobank: predicting red hair and multiple sclerosis (MS). In the case of predicting red hair, epiTree recovers known epistatic interactions surrounding MC1R and novel interactions, representing non-linearities not captured by logistic regression models. In the case of predicting MS, a more complex phenotype than red hair, epiTree rankings prioritize novel interactions surrounding HLA-DRB1 , a variant previously associated with MS in several populations. Taken together, these results highlight the potential for epiTree rankings to help reduce the design space for follow up experiments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

EBS Task Force: Task 9/FEBEX Modeling Final Report: Thermo-Hydrological Modeling with PFLOTRAN

This report outlines Sandia National Laboratories modeling studies applied to Stage 1 and Stage 2 of the Full-scale Engineered Barriers Experiment in Crystalline Host Rock (FEBEX) in situ test for the SKB EBS Task Force Task 9. The FEBEX test was a full-scale test conducted over ~18 years at the Grimsel, Switzerland Underground Research Laboratory (URL) managed by NAGRA. It involved emplacing simulated waste packages, in the form of welded cylindrical heaters, inside a tunnel in crystalline granitic rock and surrounded by a bentonite barrier and cement plug. Sensors emplaced within the bentonite monitored the wetting-up, heating, and drying out of the bentonite barrier, and the large resulting data set provides an excellent opportunity for validation of multiphysics Thermal-Hydrological (TH), Thermal-Hydrologic-Chemical (THC), and Thermal-Hydrological-Mechanical (THM) modeling approaches for underground nuclear waste storage and the performance of engineered bentonite barriers. The present status of the EBS Task Force is finalizing Task 9, which follows years of modeling studies of the FEBEX test, by many notable modeling teams (Gens et al., 2009; Sanchez et al. 2010; 2012; Samper et al., 2018). These modeling studies generally use two-dimensional axisymmetric meshes, ignoring threedimensional effects, gravity and asymmetric wetting and dry out of the bentonite engineered barrier. This study investigates these effects with use of the PFLOTRAN THC code with massively parallel computational methods in modeling FEBEX Stage 1 and Stage 2 results. The PFLOTRAN numerical code is an open source, state-of-the-art, massively parallel subsurface flow and reactive transport code operating in a high-performance computing environment (Hammond et al., 2014). Section 2 describes the applied partial differential equations describing mass, momentum and energy balance used in this study, considerations derived by assuming phase equilibrium between gas and liquid phases, constitutive equations for granite, cement plug, and bentonite domains, and specific approaches for use inthe PFLOTRAN code. Section 3 describes the geometry, meshing, and model set-up. Section 4 describes modeling results, Section 5 compares modeling results to field testing data, and Section 6 gives conclusions. The Appendix provides detailed information required by the EBSTask Force for final reporting.

42 ENGINEERING↗
DOE OSTI2020

Determination of γ-ray branching ratios for ⁹⁵Zr and ¹⁴⁷Nd

For many fission products, the γ rays emitted following decay provide an easily-detectable signature that can be used to identify their quantities and distributions in a sample. As a result, γ-ray spectroscopy is often exploited to study fission-product yields (FPYs), provided sufficiently accurate information on the γ-ray branching ratio is available. However, in many cases, the uncertainties in the existing nuclear data are large enough that they compromise the precision achievable for modern experiments and applications. To address this need, we have developed a new experimental method that is well suited to precisely measure the γ-ray branching ratios in the decay of long-lived fission products. The approach involves the production of a radiopure sample by implantation of a mass-separated ion beam from the CAlifornium Rare Isotope Breeder Upgrade (CARIBU) facility on a thin carbon foil. The emitted β -decay radiation is detected with a 4π gas proportional counter and a meticulously efficiency-calibrated high-purity germanium (HPGe) detector. As a first measurement to demonstrate the approach, we studied the γ-ray branching ratios of the strongest transitions following the decay of ⁹⁵Zr and decay-daughter ⁹⁵Nb and determined these branching ratios to fractional precisions of 1%. We then applied this approach to determine the γ-ray branching ratios for the β decay of ¹⁴⁷Nd. The results for the γ-ray branching ratios are presented here and compared to previous results and evaluations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Investigating Application of LiDAR for Nuclear Power Plants

Many evaluation, assessment, and modeling tasks at nuclear power plants require spatial in-formation; this often requires physical visits to locations within the facility because the 2D or 3D schematics and current models do not contain enough detail or do not capture as-built and real-world conditions. These visits require extensive manual labor for not only the requesting party, but also support groups, such as security. Light Detection and Ranging (LiDAR) mapping is trying to solve that problem by providing very detailed 3D models for low costs. However, the use of these models can be very limited because either component reference information is missing and too costly to add or there is no way to extract specific spatial data needed for other tools. This report outlines two main efforts. First, to reduce the effort of “Tagging” data in large 3D models, a general Application Programming Interface (API) was developed to import a variety of existing plant database information into a 3D-visualization engine. Filters allow the user to have only zone-specific items listed; then, they can simply click and assign the information to a specific spot or component in the 3D model. The second part of the work is the development of an interface for importing pieces from the3D-LiDAR model into other systems needed for modeling and simulation, outlined around fire modeling. This interface allows for the retrieval of item location and boundaries, enabling the auto generation of models for varying tools.

3D Modelling↗
DOE OSTI2021

AI to Predict Glass Compositions Satisfying Property and Cooling Rate Criteria

This project aimed to develop a predictive, artificial intelligence/machine learning-based model to identify glass compositions satisfying specified property requirements. Such a model would provide a systematic approach for narrowing down the nearly infinite range of possible compositions for glasses and minimize unnecessary experimental trial and error. A large empirical data set for training and testing the algorithm was obtained from the SciGlass database. It contains glass compositions and corresponding property data from a wide range of literature sources. However, the currently available form of this data, recently released under an open database license, is not conducive to easy querying and use. The data structure was deciphered and a customized parsing code developed to make this data more usable for the current and future work. Neural network models were developed and trained on viscosity data from the database and demonstrated potential for improving prediction accuracy over a traditional regression model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Report on Mowry Shale Thermal Maturity Mapping in the Powder River Basin, Wyoming

The Enhanced Oil Recovery Institute (EORI) has completed a map of thermal maturity of the Mowry Shale in the Powder River Basin (PRB). Thermal maturity, the degree to which the total organic carbon in a formation has been transformed from kerogen to producible hydrocarbons due to heat and pressure, is an important measure for not just the quality of a source rock, but also helps for delineating areas more favorable for unconventional drilling. There is a dearth of published Mowry maturity maps available for the PRB and this publication endeavors to provide a detailed map based on a large, public data set covering the Wyoming portion of the PRB. Additional data, currently held confidential by operators in the basin, would be of benefit to future iterations of this map.

02 PETROLEUM↗
DOE OSTI2023

Quantifying the effect of 3D models on moment tensor results using synthetic data

Moment tensors provide vital information on seismic source properties for seismic events. Moment tensors require seismic wavespeed models to compute Green’s functions, which measure the impulse response between a given source and receiver. Traditionally, researchers have used one-dimensional velocity models to calculate Green’s functions since 1D Green’s functions are computationally cheap to compute. Local 1D velocity models can also accurately model waveforms at short distances (< 500 km). However, 1D velocity models do not account for lateral heterogeneity, which can cause significant misfit in tectonically complex regions such as the Middle East (Covellone and Savage, 2012). Green’s functions calculated using 3D seismic wavespeed models have been shown to perform better in tectonically complex regions (Covellone and Savage, 2012; Kintner and Modrak, 2022), so we are interested in quantifying the effect of considering 3D structure on moment tensor inversion results. The Middle East is an ideal study area for a synthetic moment tensor test for two reasons. Firstly, the Middle East is a tectonically complex region that has been heavily studied. Secondly, the Middle East has significant seismic activity throughout the region, but imperfect station coverage due to limited open data through large swaths of the domain. The tectonic complexity and uneven station coverage will test real-world performance even in a synthetic experiment.

58 GEOSCIENCES↗
DOE OSTI2021

Multi-fidelity modeling to predict the rheological properties of fiber suspensions

Unveiling the rheological properties of fiber suspensions is of paramount interest to many industrial applications like biofuel production. The 3D numerical simulations of the suspension of fibers are often computationally expensive and time-consuming. Machine learning methods such as neural networks can simplify the prediction of rheological behavior; however, they require a relatively large training data set. Multi -fidelity models, which combine high-fidelity data from numerical simulations and less expensive lower fidelity data from resources such as simplified physical equations, can lead to optimized predictions. Here, we focus on a neural network with two levels of fidelity, i.e., high and low fidelity networks. To produce high-fidelity data, we perform direct numerical simulations to model the fibers as one-dimensional inextensible slender bodies that obey the Euler- Bernoulli beam equation. The Navier-Stokes equations govern the suspended fluid, and an immersed boundary method is used to couple the fluid and solid motion. The low-fidelity data is produced by using constitutive equations. Noticeable improvements have been observed in the accuracy of predicting the rheological behavior when a multi-fidelity network is used compared to the single-fidelity network.

Boodaghidizaji, Miad↗
DOE OSTI2024

CORN (Crop Optimization Realized through Neuralnets)

Traditional models of predicting plant traits are limited because they often rely on linear assumptions that do not fully capture the complexity of biological interactions and DNA-based markers which are static across environments. This project generated a set of RNA-based data from large multi-environment field trials and combined it with advanced machine learning techniques to account for these complex interactions and improve the accuracy of predictions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Leveling-Up for Big-Format Modules

Like Mario grabbing a super mushroom, PV modules just keep getting bigger! As they grow, so do the challenges of handling, installing, and testing them in the field. At NREL, we've embarked on our own New Hope - adapting to this size revolution across our tools, transportation, ergonomics, and field compatibility. Join us as we navigate this galactic expansion and keep PV testing at the cutting edge.

14 SOLAR ENERGY↗
DOE OSTI2026

Scientific Discovery with Physics-Informed System Identification (Abbreviated Report)

My fellowship research focused on making physics-based simulations faster and more useful through machine learning. Many problems in science and engineering are governed by partial differential equations, but high-fidelity simulations are often too expensive to run repeatedly. I worked on improving Latent Space Dynamics Identification (LaSDI), a reduced-order modeling framework that compresses large simulation data sets into a smaller representation and then learns how that representation evolves over time. The motivation was to develop reduced models that remain accurate for more challenging systems, especially when predictions must remain reliable over long time intervals or when the underlying dynamics are more complicated than standard methods can easily handle. I also contributed to related work on Quandary, a high-performance software effort for simulation and control of open quantum systems, before focusing primarily on Latent Space Dynamics Identification methods. The main outcomes of the fellowship were two new algorithms (both of which were published), Rollout-LaSDI and Higher-Order LaSDI, together with supporting work on multi-stage Latent Space Dynamics Identification. Rollout-LaSDI improved long-term prediction by training the model to stay accurate over extended time horizons, and Higher-Order LaSDI broadened the method so it could model systems with higher-order time dynamics. My contributions to multistage Latent Space Dynamics Identification also helped show that its later training stages could be simplified without losing effectiveness, and that this behavior held across different model architectures and training strategies. Taken together, these advances improved the accuracy, flexibility, and practical value of reduced-order modeling tools for computational science.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Accelerating fissile material detection with a neutron source

A system discriminating fissile material from nonfissile material wherein a digital data acquisition unit collects data at high rate, and processes large volumes of data directly to count neutrons from the unknown source and detect excess grouped neutrons to identify fission. The system includes a Poisson neutron generator for in-beam interrogation of a possible fissile neutron source and inducing neutron emission therefrom, and a DC power supply that exhibits electrical ripple of less than one part per million. A neutron count histogram and Poisson count distribution are overlaid to provide a visual indication of the difference in correlation of natural and induced emitted neutrons from the radiation source to characterize the neutron source as fissile material or non-fissile material.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Accelerating fissile material detection with a neutron source

A method of discriminating fissile material from non-fissile material with a digital data acquisition system that collects data at high rate, and processes large volumes of data directly to count neutrons from the unknown source and detect excess grouped neutrons to identify fission. The system includes a Poisson neutron generator for in-beam interrogation of a possible fissile neutron source and inducing neutron emission therefrom, and a DC power supply that exhibits electrical ripple of less than one part per million. A neutron count histogram and Poisson count distribution are overlaid to provide a visual indication of the difference in correlation of natural and induced emitted neutrons from the radiation source to characterize the neutron source as fissile material or non-fissile material.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

TriC: Distributed-memory Triangle Counting by Exploiting the Graph Structure

Graph analytics has emerged as an important tool in the analysis of large scale data from diverse application domains such as social networks, cyber security and bioinformatics. Counting the number of triangles in a graph is a fundamental kernel with several applications such as detecting the community structure of a graph or in identifying important vertices in a graph. The ubiquity of massive datasets is driving the need to scale graph analytics on parallel systems. However, numerous challenges exist in efficiently parallelizing graph algorithms, especially on distributed-memory systems. Irregular memory accesses and communication patterns, low computation to communication ratios, and the need for frequent synchronization are some of the leading challenges. In this paper, we present TriC, our distributed-memory implementation of triangle counting in graphs using the Message Passing Interface (MPI), as a submission to the 2020 GraphChallenge competition. Using a set of synthetic and real-world inputs from the challenge, we demonstrate a speedup of up to 90x relative to previous work on 32 processor-cores of a NERSC Cori node. We also provide details from distributed runs with up to8192 processes along with strong scaling results. The observations presented in this work provide an understanding of the system-level bottlenecks at scale that specifically impact sparse-irregular workloads and will therefore benefit other efforts to parallelize graph algorithms.

Halappanavar, Mahantesh↗