Search NASA⌕ Search

SEARCH · Search NASA

Results for “resource data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Tidal Resource Gaps Analysis Technical Report

The tidal resource gaps project was created to address a growing body of evidence that models underpredict tidal current speeds compared to measurements at a number of the top-ranking tidal energy sites. In response, this project compared opportunistic tidal power density measurements from 16 tidal energy hot spot sites with estimates from resource assessment data to identify discrepancies. To improve the accuracy of resource estimates from model data, updated data from eight improved model simulations were obtained. Model improvements included grid refinement, domain coupling, and the use of unstructured or nested grids. New resource estimates were calculated from the updated models, and these data were used to update the tidal hot spots-a list of promising tidal energy sites around the United States.

16 TIDAL AND WAVE POWER↗
DOE OSTI2021

Data for: Spatial access and resource limitations control carbon mineralization in soils

This dataset contains data and code used for the paper "Spatial access and resource limitations control carbon mineralization in soils", https://doi.org/10.1016/j.soilbio.2021.108427. Core-scale soil carbon fluxes are ultimately regulated by pore-scale dynamics of substrate availability and microbial access. These are constrained by physicochemical and biochemical phenomena (e.g. spatial access and hydrologic connectivity, physical occlusion, adsorption-desorption with mineral surfaces, nutrient and resource limitations). We conducted an experiment to determine how spatial access and resource limitations influence core-scale water-soluble soil organic matter (SOM) mineralization, and how these are regulated by antecedent moisture conditions. Intact soil cores were incubated at field-moist vs. drought conditions, after which they were saturated from above (to simulate precipitation) or below (to simulate groundwater recharge). Soluble carbon (acetate) and nitrogen (nitrate) forms were added to some cores during the rewetting process to alleviate potential nutrient limitations. Soil respiration was measured during the incubation, after which pore water was extracted from the saturated soils and analyzed for water soluble organic carbon concentrations and characterization. Our results showed that carbon (C) amendments increased the cumulative carbon dioxide (CO2) evolved from the soil cores, suggesting that the soils were C-limited. Drought and rewetting increased soil respiration, and there was a greater abundance of complex aromatic molecules in pore waters sampled from these soils. This newly available substrate appeared to alleviate nutrient limitations on respiration, because there were no further respiration increases with subsequent C and N amendments. We had hypothesized that respiration would be influenced by wetting direction, as simulated precipitation would mobilize C from the surface. However, as a main effect, this response was seen only in the C-amended soils, indicating that surface-C may not have been bioavailable. At the pore scale (pore water samples), drought and the C, N amendments caused a net loss of identified molecules when the soils were rewet from below, whereas wetting from above caused a net increase in identified molecules, suggesting that fresh inputs stimulated the C-and N-limited microbial populations present deeper in the soil profile. Our experiment highlights the complex and interactive role of antecedent moisture conditions, wetting direction, and resource limitations in driving core-scale C fluxes.This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/TES_spatial_access_2021 (DOI: 10.5281/zenodo.5522938).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data Science Infrastructure SOFTWARE

LANL science workflows generate complex data sets and ensembles of data requiring significant compute and storage resources. The Data Science Infrastructure (DSI) project focuses on data-driven approaches to make data more readily available to LANL projects. DSI workflows leverage metadata stored in data-agnostic databases, supported by an abstraction layer API to simplify searching and accessing data across simulation runs, experimental runs, filesystems and environments. The abstraction layer API allows the user to query a range of data types: raw output, processed data, configuration data, machine learning models, performance data, etc. In addition to the abstraction backend API, the DSI project is developing client-driven query APIs and UIs to support specific user workflows.

Turton, Terece↗
DOE OSTI2024

A Refined Method to Translate Solar Data Quality Assessment Flags to Estimated Measurement Uncertainty

Integrating solar resource uncertainties due to radiometer measurement performance and operational data quality assessment can provide improved estimates of economic bankability, system design performance, and compliance of solar energy conversion systems. Estimating radiometer measurement uncertainty is an established procedure consistent with recognized best practices and international guidelines. SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report, the fourth of six for the Data Quality and Uncertainty Integration Project, presents a refined algorithm description for software to translate solar resource data quality assessment results into estimated uncertainty values in a Solar Resource Operational Uncertainty Integrator (SROUI) application. This algorithm requires three-component solar irradiance measurements - global horizontal irradiance, direct normal irradiance, and diffuse horizontal irradiance - collected at 1- to 60-minute intervals, as described in the previous deliverables. The development of this report as Deliverable 6.4 was an iterative process that included reviews and feedback from the project team on initial drafts designed to refine how the new software could best support determining solar resource data uncertainty. The results of this effort will contribute to the final software system development by National Renewable Energy Laboratory staff.

14 SOLAR ENERGY↗
DOE OSTI2023

Multi-decade high-resolution regional hindcasts for wave energy resource characterization in U.S. coastal waters

Long-term, high-resolution, regional wave hindcast datasets were generated using unstructured-grid Simulating WAves Nearshore (SWAN) models for the U.S. coastal waters to support nearshore wave energy development in the U.S. including those bordering U.S. territorial islands. The model domains resolved the entire U.S. exclusive economic zones, with a spatial resolution of approximately 200 m nearshore. The regional SWAN models were driven by the global WAVEWATCH III® model outputs and run for a 42-year period from 1979 to 2020. Extensive model validations were performed using buoy observations and altimeter data. Regional resource characterization was performed based on hindcast data points at 2 km from shore and along the 100 m isobath. Aggregations of wave resource parameters were produced, and spatial and seasonal variations were analyzed for all the regions. Wave resource metrics recommended by international standards, including a 3-hour time series of six resource parameters, hourly frequency- and directionally resolved wave spectra at selected “virtual buoy” locations, and average-annual values of omni-directional wave power, significant wave height, and energy period are publicly disseminated through an Amazon Web Service and a Marine Energy Atlas web application tool to facilitate wave energy research and a wide range of coastal ocean applications.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

Improvement of aerosol optical depth data for localized solar resource assessment

Solar irradiance, especially for direct normal irradiance (DNI), is sensitive to the atmospheric aerosols, which can strongly extinguish DNI over areas with elevated aerosol loadings. The National Solar Radiation Database (NSRDB), developed by the National Renewable Energy Laboratory (NREL), uses AOD from MERRA-2 reanalysis and is further downscaled from 0.5° to 2-km based on elevation. However, the elevation-based downscaling may not accurately represent AOD, especially over the areas with large AOD gradients. This study examined whether the 1-km MODIS MAIAC satellite-retrieved AOD product can better represent the AOD distribution and be used to improve solar irradiance assessment. We focused on areas with relatively high AOD over North America (California, and New York City, US, and Mexico City in Mexico, in particular). The evaluation of MAIAC AOD and MERRA-2 AOD against ground-truth AERONET AOD shows that MAIAC AOD exhibits smaller RMSE by about 0.05 and higher correlation coefficient by 0.1-0.6 than MERRA-2 AOD. In addition, MERRA-2 AOD shows larger negative bias. The simulated DNI using MAIAC AOD (DNIMAIAC) and using MERRA-2 AOD (DNINSRDB) were evaluated with DNI observations. The results show the performance of DNIMAIAC is better than that of DNINSRDB with smaller RMSE by 0.5-1.5%, smaller positive mean bias by 0.8-3.1% and comparable correlation for the 3 sites analyzed. Overall, 1-km MAIAC AOD shows higher accuracy than 2-km elevation-based MERRA-2 AOD, leading to better performance of the simulated DNI using MAIAC AOD. Therefore, 1-km MAIAC AOD can be used to improve the accuracy of solar resource assessment.

14 SOLAR ENERGY↗
DOE OSTI2025

PvaPy streaming framework for real-time data processing

User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X-ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real-time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data-processing rates for various detector image sizes.

EPICS pvAccess↗
DOE OSTI2024

DUNE Database Development

The DUNE experiment will produce vast amounts of metadata, which describe the data coming from the read-out of the primary DUNE detectors. Various databases will make up the overall DB architecture for this metadata. ProtoDUNE at CERN is the largest existing prototype for DUNE and serves as a testing ground for - among other things - possible database solutions for DUNE. The subset of all metadata that is accessed during offline data reconstruction and analysis is referred to as ‘conditions data’ and it is stored in a dedicated database. As offline data reconstruction and analysis will be deployed on HTC and HPC resources, conditions data is expected to be accessed at very high rates. It is therefore crucial to store it in a granularity that matches the expected access patterns allowing for extensive caching. This requires a good understanding of the sources and use cases of conditions data. This contribution will briefly summarize the database architecture deployed at ProtoDUNE and explain the various sources of conditions data. We will present how the conditions data is retrieved and streamed from the databases and how it is handled to match expected access patterns.

Vizcaya Hernandez, Ana Paula↗
DOE OSTI2024

DUNE Database Development

The DUNE experiment will produce vast amounts of metadata, which describe the data coming from the read-out of the primary DUNE detectors. Various databases will make up the overall DB architecture for this metadata. ProtoDUNE at CERN is the largest existing prototype for DUNE and serves as a testing ground for - among other things - possible database solutions for DUNE. The subset of all metadata that is accessed during offline data reconstruction and analysis is referred to as ‘conditions data’ and it is stored in a dedicated database. As offline data reconstruction and analysis will be deployed on HTC and HPC resources, conditions data is expected to be accessed at very high rates. It is therefore crucial to store it in a granularity that matches the expected access patterns allowing for extensive caching. This requires a good understanding of the sources and use cases of conditions data. This contribution will briefly summarize the database architecture deployed at ProtoDUNE and explain the various sources of conditions data. We will present how the conditions data is retrieved and streamed from the databases and how it is handled to match expected access patterns.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Pumped Storage Hydropower Potential and Opportunities

Pumped storage hydropower (PSH) is a flexible energy storage technology with the potential to improve grid reliability, resiliency, and stability in the electric grid of the future. NREL has developed a range of data and tools to help understand opportunities for new PSH deployment, including nationwide resource assessment data, a bottom-up component-level cost model, and a lifecycle greenhouse gas emissions calculator. These datasets can then be used to inform grid planning models, analysis, and decision making to understand the role PSH can play in the power sector.

cost↗
DOE OSTI2021

Fostering Remote Visualization: Experiences in Two Different HPC Sites

Visualization of scientific data is crucial for scientific discovery to gain insight into the results of simulations and experiments. Remote visualization is of crucial importance to access infrastructure, data and computational resources and, to avoid data movement from where data is produced and to where data will be analyzed. Remote visualization enables geographically diverse collaboration and enhances user experience through graphical user interfaces. This paper presents two approaches deployed by two different HPC centers: The SC3 - Supercomputación y Cálculo Científico Center in Colombia and the Oak Ridge Leadership Computing Facility in USA. We overview our remote visualization experiences, adopted technologies, use cases, and challenges encountered. Our contribution is to signal the commonality between approaches in terms of the end goal, showing their fitness for their contexts, while not focusing only on attempting to provide a general picture of remote visualization, given the differences between centers in terms of purposes, needs, resources, and national impact.

Gelvez Cortes, Sergio Augusto↗
DOE OSTI2024

GeoThermalCloud: Cloud Fusion of Big Data and Multi-Physics Models using Machine Learning for Discovery, Exploration, and Development of Hidden Geothermal Resources

The primary goals of this project are identifying hidden geothermal resources in the USA and designing profitable enhanced geothermal systems (EGS). Many non-obvious processes and parameters could characterize geothermal resources and could control the ultimate energy potential of geothermal fields. Diverse datasets (e.g., geology, geochemistry, geophysics, satellite, airborne geophysics) are available to help characterize geothermal resources, but this data is sparse and multi-scale that has hindered attempts to leverage the datasets for geothermal exploration and profitable EGS design. Recent advancements in machine learning (ML) give promise to overcome these issues. Modern ML methods and tools can (1) analyze large datasets, (2) assimilate model ensembles that include a multitude of inputs and outputs, (3) process sparse datasets, (4) perform transfer learning between sites with different data quality, (5) extract hidden geothermal signatures from field and simulation data, (6) label geothermal resources and processes, (7) identify highvalue data acquisition targets, and (8) guide geothermal exploration and production by selecting optimal exploration, production, and drilling strategies.

58 GEOSCIENCES↗
DOE OSTI2021

SMC 2021 : Analyzing Resource Utilization and User Behavior on Titan Supercomputer

Resource utilization statistics of submitted jobs on a supercomputer can help us understand how users from various scientific domains use HPC platforms and better design a job scheduler. We explore to generate insight regarding workload distribution and usage pattern domains from job scheduler trace, GPU failure information, and project-specific information collected from Titan supercomputer. Furthermore, we want to know how the scheduler performance varies over time and how the users' scheduling behavior changes following a system failure. These observations have the potential to provide valuable insight, which is helpful to prepare for system failures. These practices will help us develop and apply novel machine learning algorithms in understanding system behavior, requirement, and better scheduling of HPC systems. There are two datasets, RUR and GPU. RUR: This dataset is the job scheduler traces collected from the Titan supercomputerfrom 01/01/2015 to 07/31/2019 (2015.csv - 2019.csv). These were collected usingResource Utilization Report (RUR), a Cray-developed resource-usage data collectionand reporting system. It contains the usage information of its critical resources (CPU,Memory, GPU, and I/O) of each running job on Titan during that period [2]. ProjectAreas: Every job is associated with a project ID. TheProjectAreas.csvdatasetprovides a mapping of the project ID to its domain science. GPU: There have been some hardware-related issues in the GPUs in Titan that caused some GPUs to fail, sometimes irrecoverably during some job runs. This dataset provides information regarding these failures during the execution of the submitted jobs. GPUs on Titan are uniquely identified by a serial number (SN), and they are installed in a location. A GPU can be installed in a location, then removed from that location following a failure, and then re-installed in a different location after fixing the problem. If the failure can't be recovered, the GPU might be removed entirely from Titan. There are two prominent types of failures that resulted in the removal of GPUs from Titan: Double Bit Error (DBE) and Out of the Bus (OTB). The dataset (gc_full.csv) has the following fields: 1. SN : Serial number of a GPU 2. location : The location where it is installed 3. insert : The time when it was inserted into that location 4. remove : The time when it was removed from that location 5. duration : Amount of time the GPU spent in this location 6. out : If the device was taken out entirely w/o a re-installment into a new location. 7. event : If the GPU was taken out entirely, the reason for its removal. To learn more about this dataset, please refer to the git repositoryhttps://github.com/olcf/TitanGPULifeand the related publication [1]. References [1] George Ostrouchov, Don Maxwell, Rizwan A Ashraf, Christian Engelmann, MallikarjunShankar, and James H Rogers. Gpu lifetimes on titan supercomputer: Survival analysisand reliability. InSC20: International Conference for High Performance Computing,Networking, Storage and Analysis, pages 1-14. IEEE, 2020. [2] Feiyi Wang, Sarp Oral, Satyabrata Sen, and Neena Imam. Learning from five-yearresource-utilization data of titan system. In2019 IEEE International Conference onCluster Computing (CLUSTER), pages 1-6. IEEE, 2019.

42 ENGINEERING↗
DOE OSTI2020

End-to-end online performance data capture and analysis for scientific workflows

With the increased prevalence of employing workflows for scientific computing and a push towards exascale computing, it has become paramount that we are able to analyze characteristics of scientific applications to better understand their impact on the underlying infrastructure and vice-versa. Such analysis can help drive the design, development, and optimization of these next generation systems and solutions. Here, we present the architecture, integrated with existing well-established and newly developed tools, to collect online performance statistics of workflow executions from various, heterogeneous sources and publish them in a distributed database (Elasticsearch). Using this architecture, we are able to correlate online workflow performance data, with data from the underlying infrastructure, and present them in a useful and intuitive way via an online dashboard. We have validated our approach by executing two classes of real-world workflows, both under normal and anomalous conditions. The first is an I/O-intensive genome analysis workflow; the second, a CPU- and memory-intensive material science workflow. Based on the data collected in Elasticsearch, we are able to demonstrate that we can correctly identify anomalies that we injected. The resulting end-to-end data collection of workflow performance data is an important resource of training data for automated machine learning analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Overview of System Integration Analysis Activities for Integrated Waste Management

Spent nuclear fuel (SNF) generated by the current fleet of commercial nuclear reactors is being stored at the reactor sites in spent fuel pools (SFPs) and in dry independent spent fuel storage installations (ISFSIs). The US Department of Energy Office of Nuclear Energy (DOE-NE) is developing an Integrated Waste Management Program (IWMP) comprising a suite of options and supporting analyses to enable future informed choices. The IWMP is organized into the following five major areas: 1) Consent-Based Siting, 2) IWM Facilities and Equipment Concepts and Development, 3) Transportation Capability Analysis and Support, 4) Information Technology Solutions and Support, and 5) System Integration Analysis and Support. This paper discusses the activities ongoing in the IWMP System Integration Analysis and Support area. Two main areas of research in system integration are data and tools development, as well as system analysis assessments. One of the tools being developed in the system integration area is the Used Nuclear Fuel-Storage, Transportation & Disposal Analysis Resource and Data System (UNF-ST&DARDS) tool. It is being developed as a foundational resource for DOE-NE to manage SNF data, along with several compatible analysis tools for time-dependent characterization of SNF and related systems. UNF-ST&DARDS has the unparalleled ability to track SNF through the entire back end of the fuel cycle—from the time the fuel is discharged from a reactor through its disposal in a geological repository. UNF ST&DARDS interfaces with the SCALE code system for nuclear analysis and COBRA-SFS for thermal analysis. Another main tool being developed is the Next Generation System Analysis Model (NGSAM). NGSAM is an agent-based simulation software tool expressly designed to be capable of modeling the waste management system. NGSAM has been developed to enable informed decision-making by providing the capability of analyzing various potential system options for the management of SNF and HLW. Using NGSAM, system architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). System analysis assessments may investigate the implications of various strategies such as different acceptance rates, acceptance queues, facility capacities and options, standardized canisters, and different assumed system operation start dates. Recently, some system analysis effort has begun to look at how the waste management system might operate for advanced reactor fuel cycles.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

A Geo-Data Science Method for Assessing Unconventional Rare-Earth Element Resources in Sedimentary Systems

Abstract Rare-earth elements (REEs) supply raw materials that constitute many of our modern critical infrastructure, defense, technology, and electrification needs. Despite REE accumulations occurring in conventional bedrock and ion-adsorption deposits sourced from weathering of igneous rocks, unconventional host materials such as coal and related sedimentary strata have been identified as promising sources of REEs to meet growing demand. To maximize the potential of unconventional resources such as REE-coal systems, new approaches are needed overcome challenges from mineral systems with no known deposits and areas with sparse geochemical data. This article presents a systematic knowledge-data resource assessment method for predicting and identifying REE resource potential and occurrence in these unconventional systems. The method utilizes a geologic and geospatial knowledge-data approach informed and guided by REE accumulation mechanisms to systematically assess and identify areas of higher enrichment. An assessment of the Powder River Basin is presented as a test case to demonstrate the method workflow and results. The key output is a potential enrichment score map reported with varying confidence levels based on the amount of supporting evidence. Results from the test case indicate several locations with promising potential for different types of coal-REE deposits, demonstrating the viability of the method for exploration and assessment of unconventional REE resources. The method is flexible by design and, with sufficient applicable knowledge and data, can be adapted for assessing critical mineral systems in other sedimentary systems as well.

58 GEOSCIENCES↗
DOE OSTI2023

Data and Tools for Exploring New Pumped Storage Hydropower Deployment Opportunities

Pumped storage hydropower (PSH) is a flexible energy storage technology with the potential to facilitate variable renewable energy integration into the decarbonized electric grid of the future. NREL is developing new data and tools to help understand opportunities for new PSH deployment, including nationwide resource assessment data, a bottom-up component-level cost model, and a lifecycle greenhouse gas emissions calculator. These datasets lay the foundation for better-informed grid planning decisions about how PSH fits into a future portfolio of generation, transmission, and storage assets.

CEM↗