Search NASA⌕ Search

SEARCH · Search NASA

Results for “Large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Seascape Interface Control Document

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source software, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Building Initial Dynamic System Models for Digital Twins of the Cryogenic Moderator System at the ORNL Spallation Neutron Source

This work describes the initial development of dynamic system models of the cryogenic moderator system (CMS) of the Spallation Neutron Source (SNS) at ORNL as a part of the ORNL LDRD funded project Building TRANSFORM to Accelerate Digital Twin Applications for Nuclear Systems, LOIS 10563. The goal of the work is to start the dynamic system modeling effort with the end goal of using them for real-time applications as digital twins. The CMS is a cryogenic liquid hydrogen flow loop that provides moderation of the neutrons that are generated by the SNS. For optimal neutron production, the CMS needs to maintain a steady and controlled density of cryogenic hydrogen in the moderator section thus requiring precise temperature and pressure control. Due to the varied time scales and system characteristics, control of the system is complex, and diagnostics are also difficult. Difficulty in accessing the flow loop during operations, limited instrumentation and unknown design details of the equipment combine to make the case for having sophisticated digital twin models of the system. Operationally the CMS also provides a strong use case for digital twins due to the constant need of optimization and for troubleshooting/diagnostics. The large amount of data collected which are freely available for using in building the model and verifying and validating the model also makes it a great candidate for a proof-of-concept for digital twins. The project extends ORNL's capacity of development and implementation of the open-source dynamic system modeling tool TRANSFORM for engineering design and digital twin/real-time applications. Specific system configuration data for the CMS have been gathered and an initial dynamic model was created in the TRANSFORM library using Dymola as the solution platform. Models of increasing complexity are created to demonstrate the need for a multi-layered approach in digital twin modeling depending on the scale and phenomena being focused on. The dynamic modeling is shown to bring the dynamic operational aspects to the design process for systems as well as serve as a digital twin to the hardware and allow for models to be tuned and compared against real time operational data. These aims should help to push forward strategic goals of application of digital twins and increase the impact of ORNL systems modeling capabilities with TRANSFORM/Modelica for various advanced energy systems.

42 ENGINEERING↗
DOE OSTI2022

An Assessment of Non-Powered Dam Hydropower Development Opportunities in the United States

Retrofitting non-powered dams (NPDs) to add hydropower offers multiple benefits over traditional, new hydropower development. Since much of the civil works infrastructure already exists, many retrofits require minimal new construction and can leverage existing water conveyances and discharge for generation. Although NPDs vary considerably in terms of their defining characteristics, identifying similarities helps support targeted investment and find opportunities to develop solutions for common challenges. With the publication of NPD-related data in 2022 (Hansen et al. 2022b), the US Department of Energy and relevant stakeholders are equipped with key information across roughly 89,000 US NPDs. These data represent the best-available information to date and extend beyond previous assessments of potential power capacity by describing design, operational, socioeconomic, environmental aspects of NPDs (Hadjerioua et al. 2012). To capitalize on these efforts to improve breadth and depth of NPD data access, this study uses a data-driven approach to assess NPD hydropower development opportunities in the United States. To help describe project feasibility drivers for NPDs, recent NPD retrofits were reviewed to examine variability with respect to a variety of characteristics. Based on the assessment of recent retrofits and data availability, several attributes were selected to characterize the remaining NPD population: (1) owner type, (2) 30% exceedance flow (a common design flow that describes the flow that is exceeded by 30% of the flow in the record), (3) hydraulic head, and (4) maximum reservoir storage. These four characteristics were used as inputs to a statistical clustering analysis (a common technique for grouping individuals of a population based on similarities or how closely associated individuals are to one another) of a set of 2,709 NPDs with at least 100 kW potential capacity and recently retrofit dams with available data. With the large dataset of NPDs, the clusters help describe how the population breaks down into different types (i.e., how many types of dams there are and what portion of the population belongs to each cluster).

13 HYDRO ENERGY↗
DOE OSTI2022

MalGen: Malware Generation with Specific Behaviors to Improve Machine Learning-based Detectors

In recent years, infections and damage caused by malware have increased at exponential rates. At the same time, machine learning (ML) techniques have shown tremendous promise in many domains, often out performing human efforts by learning from large amounts of data. Results in the open literature suggest that ML is able to provide similar results for malware detection, achieving greater than 99% classifcation accuracy [49]. However, the same detection rates when applied in deployed settings have not been achieved. Malware is distinct from many other domains in which ML has shown success in that (1) it purposefully tries to hide, leading to noisy labels and (2) often its behavior is similar to benign software only differing in intent, among other complicating factors. This report details the reasons for the diffcultly of detecting novel malware by ML methods and offers solutions to improve the detection of novel malware.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Automated Sorghum Phenotyping and Trait Development Platform

There is an urgent need to accelerate energy crop development for the production of renewable transportation fuels from biomass. Our interdisciplinary team developed mobile, ground-based and aerial phenotyping platforms and advanced remote sensing data analysis tools to acquire and process imagery from different types of cameras (e.g. RGB, multispectral, hyperspectral, and thermal sensors) and LiDAR point cloud data in large-scale sorghum field trials during phase 1 of the project. Phase 2 focused on Technology to Market activities to deliver these systems to the market place coupled with targeted research programs to address specific limitations or challenges for these systems.

09 BIOMASS FUELS↗
DOE OSTI2024

Machine Learning for DUNE Supernova Trigger

One of the major scientific goals of the Deep Underground Neutrino Experiment (DUNE) is to detect and measure the neutrino flux from galactic core-collapse supernovae. These neutrinos, which exist in the low energy range of up to a few tens of MeV and are responsible for carrying away over 99% of the gravitational binding energy of the supernova, provide an opportunity to study the end of life evolution of massive stars, as well as unique properties and interactions of neutrinos. Because galactic supernovae are expected to occur only on the timespan of every few decades, it is crucial that DUNE is able to detect supernova neutrino interactions when they occur. However, detecting these supernova interactions requires sifting through a large amount of data, and DUNE detectors require a trigger to signal when supernova neutrino events occur. Machine learning provides a potential approach to creating this trigger. This project generates ADC and ground truth images of neutrino interactions in a LArTPC detector as simulated by the Model of Argon Reaction Low Energy Yields (MARLEY) to be used for machine learning. The eventual goal of this work is to facilitate DUNE s detection of supernova neutrino interactions by building a machine learning pipeline that will train the trigger algorithm.

Damish, Stephanie↗
DOE OSTI2025

Feasibility of an Accelerometer-Based Structural Health Monitoring System for the LANL Blast Tube

A modeling- and simulation-based study was conducted on the feasibility of implementing an accelerometer-based SHM system on the Los Alamos National Laboratory blast tube. A blast tube experiment was modeled using the Abaqus explicit finite element solver. A custom user subroutine was written to apply test-like pressure loading to the inside surface of the blast tube. The subroutine applies analytically defined pressure loads derived from tracer output taken from a Compressible Flow Computational Fluid Dynamics Solver model of the blast tube. Five unique versions of the model were created: an undamaged reference model at 65°F was used as the baseline and compared to equivalent models at 10°F and 100°F. These three models were compared to models with small damage at the reference temperature. The two types of damage considered were a radial (circumferential) crack in the main tube body and a longitudinal crack in the supports. Acceleration outputs were extracted from accelerometer bodies included in the model and were post processed using a variety of standard SHM techniques. Different potential features signaling failure were extracted and compared using statistical methods in the time and frequency domains. A method was identified that clearly shows that differences in structural response resulting from the modeled damage can be differentiated from the structural response resulting from changing environmental conditions. However, the amount of damage applied to create observable differences in the accelerometer data was so large that simpler methods of damage detection would be more cost effective in locating damage.

42 ENGINEERING↗
DOE OSTI2021

Transient Testing of Nuclear Fuels Performed in the Original Operation of TREAT, Third Edition

TREAT core was upgraded at the end of the 1980s. The tests performed since about 1970 are summarized in considerable detail. Earlier tests are noted by their designated series and by some parameters that help to identify and distinguish each series from the others. The detailed summary descriptions are intended to help inform future researchers regarding the large, historical, empirical data base generated from that 35-year span during which hundreds of TREAT experiments were performed to investigate and demonstrate the transient behavior of a wide variety of nuclear fuels during severe off-normal and accident conditions -- using direct nuclear heating of the test samples. That empirical basis is foundational and valuable for guiding future qualification and safety evaluation of improved fuel designs and for future transient test planning and performance in TREAT. The second edition of this report added descriptions of the following test series: D, E, EOS, F, H, J, R, RX, and S. This third edition includes descriptions of an additional four test series: the HUT, HOP (& HUC), ORNL-TR, and PNL.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Enabling Innovative Analysis on Heterogeneous Clusters through HTCdaskgateway

High energy particle (HEP) physics research is going through fundamental changes as we move to collect larger amounts of data from the Large Hadron Collider (LHC). Analysis facilities and distributed computing, through HTCs, have come together to create the next pythonic generation of analysis by utilizing HTCdaskgateway, a Dask gateway extension, allowing users to spawn workers compatible with both their analysis and heterogeneous clusters in line with authentication requirements. This is enabling physicists to engage with scientific python in ways they had not before because of domain specific C++ tools. An example of HTCdaskgateway’s use is Fermilab’s Elastic Analysis Facility.

Chavez, Elise [U. Wisconsin, Madison (main)]↗
DOE OSTI2023

Joint Analysis of the Epidemic Evolution and Human Mobility During the First Wave of COVID-19 in Spain: Retrospective Study

Background The initial wave of the COVID-19 pandemic placed a tremendous strain on health care systems worldwide. To mitigate the spread of the virus, many countries implemented stringent nonpharmaceutical interventions (NPIs), which significantly altered human behavior both before and after their enactment. Despite these efforts, a precise assessment of the impact and efficacy of these NPIs, as well as the extent of human behavioral changes, remained elusive. Objective In this study, we conducted a retrospective analysis of the initial wave of COVID-19 in Spain to better comprehend the influence of NPIs and their interaction with human behavior. Such investigations are vital for devising future mitigation strategies to combat COVID-19 and enhance epidemic preparedness more broadly. Methods We used a combination of national and regional retrospective analyses of pandemic incidence alongside large-scale mobility data to assess the impact and timing of government-implemented NPIs in combating COVID-19. Additionally, we compared these findings with a model-based inference of hospitalizations and fatalities. This model-based approach enabled us to construct counterfactual scenarios that gauged the consequences of delayed initiation of epidemic response measures. Results Our analysis demonstrated that the pre–national lockdown epidemic response, encompassing regional measures and heightened individual awareness, significantly contributed to reducing the disease burden in Spain. The mobility data indicated that people adjusted their behavior in response to the regional epidemiological situation before the nationwide lockdown was implemented. Counterfactual scenarios suggested that without this early epidemic response, there would have been an estimated 45,400 (95% CI 37,400-58,000) fatalities and 182,600 (95% CI 150,400-233,800) hospitalizations compared to the reported figures of 27,800 fatalities and 107,600 hospitalizations, respectively. Conclusions Our findings underscore the significance of self-implemented prevention measures by the population and regional NPIs before the national lockdown in Spain. The study also emphasizes the necessity for prompt and precise data quantification prior to enacting enforced measures. This highlights the critical interplay between NPIs, epidemic progression, and human behavior. This interdependence presents a challenge in predicting the impact of NPIs before they are implemented.

Public, Environmental & Occupational Health↗
DOE OSTI2020

Sensitivity of D meson azimuthal anisotropies to system size and nuclear structure

Recent experimental data at the Large Hadron Collider (LHC) confirmed that the soft sector azimuthal anisotropies in central XeXe collisions are sensitive to deformations in the wave function of the Xenon nucleus. Additionally, the CMS experiment found that D meson flow is slightly suppressed compared to other particle species when considering quark number scaling in small systems of pPb compared to PbPb. In this talk we used the D and B Mesons Modular (DAB-MOD) code coupled to Trento+v-USPhydro to calculate the R AA and v n ’s of D mesons using different energy loss models and Langevin techniques. Comparing D mesons R AA and v n in PbPb to XeXe collisions it is found that in central collisions D meson azimuthal anisotropies are sensitive to details in the nuclear structure wave function of Xenon. Additionally, we find that in mid-central collisions the smaller system size of XeXe suppresses D meson flow.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Rasterization with Data-Parallel Primitives

Parallel rasterization can suffer from race conditions during fragment generation, which is traditionally addressed by using specialized hardware accessible via vendor graphics APIs. Unfortunately, graphics APIs are increasingly problematic on high-performance computers, either because they are not provided or because of concerns about dependencies with in situ visualization. In response, we present a hardware-agnostic rasterization algorithm that handles race conditions using only data-parallel primitives (DPPs), enabling efficient rendering on HPC systems without graphics API dependencies and aligning with recent efforts to deliver visualization software with DPPs. Our evaluation consists of three phases: (1) evaluating portability across different CPU and GPU architectures, (2) evaluating competitiveness with a community standard, and (3) evaluating performance across varying workloads and available parallelism. The supporting experiments run on both AMD and NVIDIA GPUs, considering data sets as large as 460 million triangles and 160 million pixels. While performance generally falls short of graphics API baselines, it achieves interactive frame rates on most workloads. As a result, we conclude our approach is a viable solution for rasterization on high-performance computers since our approach is portably performant across different architectures without the need for specialized vendor support.

Buckley, Makani [University of Oregon] (ORCID:0009↗
DOE OSTI2024

Efficient Distributed Sequence Parallelism for Transformer-Based Image Segmentation

We introduce an efficient distributed sequence parallel approach for training transformer-based deep learning image segmentation models. The neural network models are comprised of a combination of a Vision Transformer encoder with a convolutional decoder to provide image segmentation mappings. The utility of the distributed sequence parallel approach is especially useful in cases where the tokenized embedding representation of image data are too large to fit into standard computing hardware memory. To demonstrate the performance and characteristics of our models trained in sequence parallel fashion compared to standard models, we evaluate our approach using a 3D MRI brain tumor segmentation dataset. We show that training with a sequence parallel approach can match standard sequential model training in terms of convergence. Furthermore, we show that our sequence parallel approach has the capability to support training of models that would not be possible on standard computing resources.

Lyngaas, Isaac↗
DOE OSTI2023

FPGA Acceleration of GCN in Light of the Symmetry of Graph Adjacency Matrix

Graph Convolutional Neural Networks (GCNs) are widely used to process large-scale graph data. Different from deep neural networks (DNNs), GCNs are sparse, irregular, and unstructured, posing unique challenges to hardware acceleration with regular processing elements (PEs). In particular, the adjacency matrix of a GCN is extremely sparse, leading to frequent but irregular memory access, low spatial/temporal data locality and poor data reuse. Furthermore, a realistic graph usually consists of unstructured data (e.g., unbalanced distributions), creating significantly different processing times and imbalanced workload for each node in GCN acceleration. To overcome these challenges, we propose an end-to-end hardware-software co-design to accelerate GCNs on resource-constrained FPGAs with the features including: (1) A custom dataflow that leverages symmetry along the diagonal of the adjacency matrix to accelerate feature aggregation for undirected graphs. We utilize either the upper or the lower triangular matrix of the adjacency matrix to perform aggregation in GCN to improve data reuse. (2) Unified compute cores for both aggregation and transform phases, with full support to the symmetry-based dataflow. These cores can be dynamically reconfigured to the systolic mode for transformation or as individual accumulators for aggregation in GCN processing. (3) Preprocessing of the graph in software to rearrange the edges and features to match the custom dataflow. This step improves the regularity in memory access and data reuse in the aggregation phase. Moreover, we quantize the GCN precision from FP32 to INT8 to reduce the memory footprint without losing the inference accuracy. We implement our accelerator design in Intel Stratix10 MX FPGA board with HBM2, and demonstrate 1.3x-110.5x improvement in end-to-end GCN latency as compared to the state-of the-art FPGA implementations, on the graph datasets of Cora, Pubmed, Citeseer and Reddit.

Nair, Gopikrishnan R.↗
DOE OSTI2025

An Innovative High Throughput Genome Releaser for Rapid and Efficient PCR Screening

High-throughput PCR screening is vital in synthetic biology and metabolic engineering as it allows researchers to rapidly analyze and detect numerous targeted genetic mutation in the genome. Current challenges for high-throughput PCR screening in synthetic biology include efficiently preparing genomic DNA, optimizing protocols for diverse sample types, managing contamination risks, and effectively analyzing the large volumes of data generated while ensuring consistent and accurate results. In this study, we present the development of a High Throughput Genome Releaser (HTGR), an innovative device addressing common challenges in screening PCR. This genome DNA releaser is designed based on a squash method for rapid, cost-effective, and efficient DNA release, optimized for subsequent PCR reactions. After experimenting with various synthetic materials, we selected a plastic that closely replicates the smooth surface and compression properties of microscope slides, ensuring reliable performance. We engineered a device featuring a 96-Well Plate and a shear applicator, operable both manually and automatically, and compatible with standard liquid-handling robot platform. This compatibility enhances ease of use in high-throughput PCR workflows. Additionally, we developed software to support its automatic functions. Our results demonstrated that the specially engineered 96-Well Plate and HTGR can effectively squash fungal spores , which release enough genome DNA for PCR screening. The genome releaser facilitates the preparation of PCR-amplifiable genomic DNA substrate from 96 samples within minutes, eliminates the need for extraction buffers, and is adaptable to a wide range of microorganisms and cells, which could significantly advance biomanufacturing processes.

Yuan, Guoliang [BATTELLE (PACIFIC NW LAB)]↗
DOE OSTI2024

PyPop: a mature open-source software pipeline for population genomics

Python for Population Genomics (PyPop) is a software package that processes genotype and allele data and performs large-scale population genetic analyses on highly polymorphic multi-locus genotype data. In particular, PyPop tests data conformity to Hardy-Weinberg equilibrium expectations, performs Ewens-Watterson tests for selection, estimates haplotype frequencies, measures linkage disequilibrium, and tests significance. Standardized means of performing these tests is key for contemporary studies of evolutionary biology and population genetics, and these tests are central to genetic studies of disease association as well. Here, we present PyPop 1.0.0, a new major release of the package, which implements new features using the more robust infrastructure of GitHub, and is distributed via the industry-standard Python Package Index. New features include implementation of the asymmetric linkage disequilibrium measures and, of particular interest to the immunogenetics research communities, support for modern nomenclature, including colon-delimited allele names, and improvements to meta-analysis features for aggregating outputs for multiple populations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Individual Nest Site Preferences Do Not Explain Upslope Population Shifts of a Secondary Cavity-Nesting Species

Geographic ranges of plants and animals are shifting due to environmental change. While some species are shifting towards the poles and upslope in elevation, the processes leading to these patterns are not well known. We analyzed 22 years of western bluebird (Sialia mexicana) data from a large nest box network in northern New Mexico at elevations between 1860 m and 2750 m. This population has shifted to higher elevations over time, but whether this is due to changes in nesting behavior and preference for higher elevation within the population or driven by immigration is unclear. We banded adults and nestlings from nest boxes and examined nesting location and elevation for individual birds captured two or more times. Most recaptured birds nested at the same nest boxes in subsequent years, and the number of birds that moved upslope did not significantly differ from the number that moved downslope. Fledglings moved greater distances and elevations than adults, but these movements were not upslope specific. Female fledglings showed greater changes in elevation and distance compared to male fledglings, but again, movements were not consistently upslope. The upslope shift in this population may be due to birds immigrating into the population and not from changes in individual nesting behavior.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Deposition, Diagenesis, and Sequence Stratigraphy of the Pennsylvanian Morrowan and Atokan Intervals at Farnsworth Unit

Farnsworth Field Unit (FWU), a mature oilfield currently undergoing CO2-enhanced oil recovery (EOR) in the northeastern Texas panhandle, is the study area for an extensive project undertaken by the Southwest Regional Partnership on Carbon Sequestration (SWP). SWP is characterizing the field and monitoring and modeling injection and fluid flow processes with the intent of verifying storage of CO2 in a timeframe of 100–1000 years. Collection of a large set of data including logs, core, and 3D geophysical data has allowed us to build a detailed reservoir model that is well-grounded in observations from the field. This paper presents a geological description of the rocks comprising the reservoir that is a target for both oil production and CO2 storage, as well as the overlying units that make up the primary and secondary seals. Core descriptions and petrographic analyses were used to determine depositional setting, general lithofacies, and a diagenetic sequence for reservoir and caprock at FWU. The reservoir is in the Pennsylvanian-aged Morrow B sandstone, an incised valley fluvial deposit that is encased within marine shales. The Morrow B exhibits several lithofacies with distinct appearance as well as petrophysical characteristics. The lithofacies are typical of incised valley fluvial sequences and vary from a relatively coarse conglomerate base to an upper fine sandstone that grades into the overlying marine-dominated shales and mudstone/limestone cyclical sequences of the Thirteen Finger limestone. Observations ranging from field scale (seismic surveys, well logs) to microscopic (mercury porosimetry, petrographic microscopy, microprobe and isotope data) provide a rich set of data on which we have built our geological and reservoir models.

04 OIL SHALES AND TAR SANDS↗