Search NASA⌕ Search

SEARCH · Search NASA

Results for “proxy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Towards Online Machine Learning in DUNE Data Acquisition

Processing the large volumes of data produced by liquid argon time projection chamber (LArTPC) experiments presents a significant challenge, especially those at the scale of DUNE. This is a particular challenge when aiming to trigger on low-energy neutrinos from core-collapse supernovae, which are typically buried in a high-rate radiological background. To enable real-time event selection suitable for such rare signals, we are developing machine learning based data filtering methods. In order to demonstrate the feasibility of this approach, we implemented such pipeline using the ICEBERG detector at Fermilab as a small-scale LArTPC, with a focus on identifying Michel electrons as a proxy for low-energy neutrino interactions. This poster will present the current status of integrating these machine learning models into the data acquisition (DAQ) system of this detector.

Dalager, Olivia [Fermilab]↗

NOW-23: the 2023 National Offshore Wind Data Set

In this report, we present the latest wind resource data specifically tailored for offshore regions in the United States. The data set, known as the 2023 National Offshore Wind data set (NOW-23), has been developed by the National Renewable Energy Laboratory (NREL) and its partners, and surpasses the previous resource data set, the Wind Integration National Dataset (WIND) Toolkit, which was released approximately ten years ago, in its offshore component. The WIND Toolkit has been widely utilized by stakeholders involved in wind resource assessments across the continental United States. However, with significant advancements in numerical weather prediction modeling over the past decade, the NOW-23 data set incorporates the latest research and development progress to provide stakeholders with an updated and cutting-edge resource for offshore wind analysis. The NOW-23 data set is created using the Weather Research and Forecasting (WRF) model and its output is available, as for its predecessor, at 5-minute time resolution and 2-kilometer horizontal spatial resolution. However, the NOW-23 data set improves upon the WIND Toolkit through: 1. A modeling period of at least 20 years (and as long as 23 years in selected regions), starting in 2000 (compared to the 7-year 2007–2013 modeling period in the WIND Toolkit). 2. For several offshore regions, a region-specific sensitivity analysis, driven by an ensemble of WRF simulations, to assess the most adequate region-specific WRF setup. 3. An updated WRF model, from Version 3.4 used in the WIND Toolkit to Version 4.2.1 used for the NOW-23 data set, which incorporates significant research advancements. 4. The use of the state-of-the-art reanalysis product ERA5 (which supersedes the older ERA-Interim used in the WIND Toolkit) to provide atmospheric forcing at the WRF domain boundaries. Figure 1 shows the NOW-23 mean wind speed at 160 m above sea level (asl), which we use as proxy for hub-height of a commercial offshore wind turbine in this report across all regions.

17 WIND ENERGY↗

RectifHydPlus: Forty Year Hydropower Generation Reanalysis for Conterminous United States, Version 1.1.

This dataset contains monthly hydropower net-generation totals for 590 plants (each >10 MW) across the conterminous United States (CONUS) from 1980 to 2019. RectifHydPlus v1.1 includes one harmonized table of historical monthly generation—backfilled with observed monthly values where available—and two companion tables: (i) an estimates-only version with no backfill and (ii) a hydrological-control version that removes the effects of capacity and operational change. Each table comprises 23,600 records (590 plants × 40 years). The dataset was developed to address temporal gaps and inconsistencies in publicly available hydropower generation data as available through EIA-923 survey reports. Each record includes a quality label denoting the underlying proxy—from best (direct reservoir releases) to weakest (pattern copied from similar years). By combining the agency-reported survey records with observed and simulated hydrologic releases, RectifHydPlus offers complete, quality-labeled monthly estimates suitable for trend analysis and generation of hydropower generation inputs for energy-water modeling.

Turner, Sean [Oak Ridge National Laboratory (ORNL)↗

Jet charge modification in dense QCD matter

In these proceedings we report a recent calculation of the jet charge modification in heavy-ion relative to proton collisions at the LHC. Jets have played an essential role in constraining theories of in-medium parton shower evolution and in determining the properties of the quark-gluon plasma created in ultra-relativistic nuclear reactions. It is important to extend these studies to flavor-tagged jets and explore observables that are sensitive to their partonic origin. The average jet charge, introduced early on in the history of quantum chromodynamics, is a proxy for the electric charge of the quark or gluon that initiates the jet. In the framework of soft-collinear effective theory, we show how to evaluate the jet charge in a dense strongly-interacting matter environments. We identify observables that can isolate the contribution of in-medium branching from isospin effects and present predictions for the transverse momentum dependence of the jet charge distribution in nucleus-nucleus collisions and its modification relative to the proton case.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2018

The most recent version of these data are available https://doi.org/10.25581/spruce.100/1874948 and supersedes all previous versions. This dataset consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming in August 2015 through March-31 of 2019, with start- and end-of-season phenological transition dates derived through the end of autumn 2018. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating: Picea trees (vegetation type EN, for evergreen needleleaf); Larix trees (vegetation type DN, for deciduous needleleaf); and the mixed shrub layer (vegetation type SH).

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2019

The most recent version of these data are available https://doi.org/10.25581/spruce.100/1874948 and supersedes all previous versions. This dataset consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming in August 2015 through March-31 of 2020, with start- and end-of-season phenological transition dates derived through the end of autumn 2019. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating: Picea trees (vegetation type EN, for evergreen needleleaf); Larix trees (vegetation type DN, for deciduous needleleaf); and the mixed shrub layer (vegetation type SH).

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2020

The most recent version of these data are available https://doi.org/10.25581/spruce.100/1874948 and supersedes all previous versions. This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2021, with start- and end-of-season phenological transition dates derived through the end of autumn 2020. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). User note: A list of previous versions can be found in the Related Datasets section of the user guide.

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2021

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2022, with start- and end-of-season phenological transition dates derived through the end of autumn 2021. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). User Note: This dataset supersedes previous versions of SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery. A list of previous versions can be found in the Related Datasets section of the user guide.

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2022

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2023, with start- and end-of-season phenological transition dates derived through the end of autumn 2022. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step Contains 35 files in *.csv format inside a compressed (*.zip) file. Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) Contains one file in *.csv format Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. Contains three files in HTML format, one for each vegetation type One additional file in HTML format with the transition dates plotted for each vegetation type, by year R files for processing Phenocam files and flags. Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/y7z5mau7. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released phenocam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

SPRUCE Experiment, Marcell Experimental Forest, Sp↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2023

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2024, with start- and end-of-season phenological transition dates derived through the end of autumn 2023. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e. vegetation type) • Contains one file in *.csv format (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure • Contains two files in *.csv format, one for snow on trees and one for snow on ground This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type • One additional file in HTML format with the transition dates plotted for each vegetation type, by year (2) R files for processing Phenocam files and flags. • Contains five files in R file (*.R) format in one compressed (*.zip) file User Note: All imagery is posted in near-real time to the PhenoCam Project web page (http://phenocam.sr.unh.edu/), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. The data reported here are based on the complete camera record from SPRUCE and supersedes the previously released data inclusive of the 2015-2022 data (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

Spruce and Peatland Responses Under Changing Envir↗

SPRUCE Vegetation Phenology in Experimental Plots from PhenoCam Imagery, 2015-2024

This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming (Hanson et al. 2017) in August 2015 through March 31 of 2025 (2015-08-24 to 2025-03-31), with start- and end-of-season phenological transition dates derived through the end of autumn 2024. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Three separate regions of interest (ROIs) were defined for each camera field of view, corresponding to different vegetation types and demarcating (1) Picea trees (vegetation type EN, for evergreen needleleaf); (2) Larix trees (vegetation type DN, for deciduous needleleaf); and (3) the mixed shrub layer (vegetation type SH). This data set consists of three sets of data files: (1) 3-day summary product files: One file for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step. • Contains 36 files in *.csv format inside a compressed (*.zip) file. (2) Transition date file: Estimates “greenness rising” (spring) and “greenness falling” (autumn) transition dates derived from the smoothed daily green chromatic coordinate (GCC) values, for each camera and each ROI (i.e., vegetation type). • Contains one file in *.csv format. (3) Snow flag files: Indicate days with snow on trees or snow on ground for each experimental enclosure. • Contains two files in *.csv format, one for snow on trees and one for snow on ground. This data set consists of two sets of companion files: (1) Accompanying HTML files show the 90th quantiles of the mean GCC plotted together with transition dates for each vegetation type and plot. • Contains three files in HTML format, one for each vegetation type. • One additional file in HTML format with the transition dates plotted for each vegetation type, by year. (2) R files for processing PhenoCam files and flags. • Contains five files in R file(*.R) format and the components of the phenocamr package (Version 1.1.4) used for calculating transition dates for 2015-2024. These are contained in a compressed (*.zip) file. User Note: All imagery is posted in near-real time to the PhenoCam Project web page (https://phenocam.nau.edu), where it is publicly available. Scroll to “spruce” in the Gallery or link directly to the 29 SPRUCE cameras at https://tinyurl.com/sprucecams. This data set is based on the complete camera record from SPRUCE and supersedes all previously released PhenoCam datasets (see Related Data Sets). The estimated transition dates for previously released datasets may differ slightly (in most cases, by ±3 days or less), because following standard PhenoCam processing protocols (Richardson et al. 2018, Scientific Data), smoothing and interpolation, outlier removal, and transition date estimation are always conducted using the full data record.

54 ENVIRONMENTAL SCIENCES↗

SPRUCE Redox-Active Subsurface Organic Matter, Marcell Experimental Forest, Minnesota, 2023

This dataset contains measurements that report on the effects of the SPRUCE experimental treatments on redox-active organic matter (RAOM) reduction (Valenzuela and Cervantes, 2021). Measurements occurred at the SPRUCE Experiment site in the Marcell Experimental Forest in northern Minnesota, USA. This work is also a follow-up to Rush et al. (2021a) which investigated effects of temperature on RAOM reduction after two years of experimental warming (Rush et al. 2021b). This follow-up dataset addresses two main questions; (i) How does warming and elevated carbon dioxide (CO2) directly affect in situ RAOM reduction, and subsequent methane (CH4) and CO2 production, across the peat depth profile? and (ii) How has long-term warming and elevated CO2 changed the total RAOM pool, and subsequent CH4 and CO2 production, across the peat depth profile? This dataset reports electron shuttling capacity (a proxy for RAOM reduction; Keller, and Takagi, 2013) and carbon dioxide (CO2) and methane (CH4) concentrations both in one-week in situ incubations (2023-05-31 to 2023-08-01) and 42-day laboratory incubations from peat collected in 2023 (2023-05-31 to 2023-06-26). Laboratory incubations also measured acetate concentrations. The 2023 laboratory incubations were also compared with laboratory incubations conducted on peat collected in 2016 (Rush et al. 2021b). This dataset contains three data files in comma-separate (.csv) format. Additional metadata are provided: three data dictionaries and a file-level metadata file in comma separate (.csv) format and a user guide in PDF (*.pdf) format.

54 ENVIRONMENTAL SCIENCES↗

Dataset for "Development of heterogeneous ice nucleation rate coefficient parameterizations from ambient measurements"

Ice nucleating particles (INPs) are a rare subset of particles that can have an outsized impact relative to their prevalence. To simulate INP variability, models require parameterizations for the most important sources of INPs. Most parameterizations in the literature were developed from laboratory experiments that used proxies for ambient particles. Whether these laboratory models effectively represent ambient aerosol is still not well understood and parameterizations developed from field measurements may be more atmospherically relevant. Expanding on previous work in which we used an ice chamber and an single particle mass spectrometer (SPMS) to characterize INP composition, we use the combined measurements to calculate heterogeneous ice nucleation rate coefficients for ambient particles. We find good agreement between our results for dust and sea spray aerosol with previous results. We also determine the relative contribution of each measurement to the total measurement uncertainty using a Monte Carlo approach and find that the biggest source of uncertainty is the sampling efficiency of the SPMS.

Cornwell, Gavin C↗

SPRUCE Vegetation Phenology in Experimental Plots from Phenocam Imagery, 2015-2017

The most recent version of these data are available https://doi.org/10.25581/spruce.100/1874948 and supersedes all previous versions. See Schädel et al., 2019. (https://doi.org/10.25581/spruce.071/1556082). This data set consists of PhenoCam data from the SPRUCE experiment from the beginning of whole ecosystem warming in August 2015 through the end of 2017. Digital cameras, or phenocams, installed in each SPRUCE enclosure track seasonal variation in vegetation “greenness”, a proxy for vegetation phenology and associated physiological activity. Regions of interest (ROIs) were defined for vegetation types (1) Picea trees (EN, evergreen needleleaf); (2) Larix trees (DN, deciduous needleleaf); and (3) the mixed shrub layer (SH, shrubs). This data set consists of two sets of data files: (1) standard “3-day summary product files” for each camera and each ROI (i.e. vegetation type), characterizing vegetation color at a 3-day time step and (2) a “transition date file” containing the estimated “greenness rising” (spring) and “greenness falling” (autumn) transition dates.

54 ENVIRONMENTAL SCIENCES↗

Machine Learning for Solar Accessibility: Implications for Low-Income Solar Expansion and Profitability

The solar industry in the US typically uses a credit score such as the FICO score as an indicator of consumer utility payment performance and credit worthiness to approve customers for new solar installations. Using data on over 800,000 utility payment performance and over 5,000 demographic variables, we compare machine learning and econometric models to predict the probability of default to credit-score cutoffs. Here, we compare these models across a variety of measures, including how they affect consumers of different socio-economic backgrounds and profitability. We find that a traditional regression analysis using a small number of variables specific to utility repayment performance greatly increases accuracy and LMI inclusivity relative to FICO score, and that using machine learning techniques further enhances model performance. Relative to FICO, the machine learning model increases the number of low-to-moderate income consumers approved for community solar by 1.1% to 4.2% depending on the stringency used for evaluating potential customers, while decreasing the default rate by 1.4 to 1.9 percentage points. Using electricity utility repayment as a proxy for solar installation repayment, shifting from a FICO score cutoff to the machine learning model increases profits by 34% to 1882% depending on the stringency used for evaluating potential customers.

Davuluri, Sruthi↗

Application of Multi-Criteria Decision Analysis Techniques for Informing Select Agent Designation and Decision Making

The Centers for Disease Control and Prevention (CDC) Select Agent Program establishes a list of biological agents and toxins that potentially threaten public health and safety, the procedures governing the possession, utilization, and transfer of those agents, and training requirements for entities working with them. Every 2 years the Program reviews the select agent list, utilizing subject matter expert (SME) assessments to rank the agents. In this study, we explore the applicability of multi-criteria decision analysis (MCDA) techniques and logic tree analysis to support the CDC Select Agent Program biennial review process, applying the approach broadly to include non-select agents to evaluate its generality. We conducted a literature search for over 70 pathogens against 15 criteria for assessing public health and bioterrorism risk and documented the findings for archiving. The most prominent data gaps were found for aerosol stability and human infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. Analysis of results obtained from a two-dimensional plot of weighted scores for difficulty of attack (i.e., exposure and production criteria) vs. consequences of an attack (i.e., consequence and mitigation criteria) provided greater fidelity for understanding agent placement compared to a 1-to-n ranking and was used to define a region in the upper right-hand quadrant for identifying pathogens for consideration as select agents. A sensitivity analysis varied the numerical weights attributed to various properties of the pathogens to identify potential quantitative (x and y) thresholds for classifying select agents. The results indicate while there is some clustering of agent scores to suggest thresholds, there are still pathogens that score close to any threshold, suggesting that thresholding “by eye” may not be sufficient. The sensitivity analysis indicates quantitative thresholds are plausible, and there is good agreement of the analytical results with select agent designations. A second analytical approach that applied the data using a logic tree format to rule out pathogens for consideration as select agents arrived at similar conclusions.

60 APPLIED LIFE SCIENCES↗

Application of multi-criteria decision analysis techniques and decision support framework for informing select agent designation for agricultural animal pathogens

The United States Department of Agriculture (USDA), Division of Agricultural Select Agents and Toxins (DASAT) established a list of biological agents and toxins (Select Agent List) that potentially threaten agricultural health and safety, the procedures governing the transfer of those agents, and training requirements for entities working with them. Every 2 years the USDA DASAT reviews the Select Agent List, using subject matter experts (SMEs) to perform an assessment and rank the agents. To assist the USDA DASAT biennial review process, we explored the applicability of multi-criteria decision analysis (MCDA) techniques and a Decision Support Framework (DSF) in a logic tree format to identify pathogens for consideration as select agents, applying the approach broadly to include non-select agents to evaluate its robustness and generality. We conducted a literature review of 41 pathogens against 21 criteria for assessing agricultural threat, economic impact, and bioterrorism risk and documented the findings to support this assessment. The most prominent data gaps were those for aerosol stability and animal infectious dose by inhalation and ingestion routes. Technical review of published data and associated scoring recommendations by pathogen-specific SMEs was found to be critical for accuracy, particularly for pathogens with very few known cases, or where proxy data (e.g., from animal models or similar organisms) were used to address data gaps. The MCDA analysis supported the intuitive sense that select agents should rank high on the relative risk scale when considering agricultural health consequences of a bioterrorism attack. However, comparing select agents with non-select agents indicated that there was not a clean break in scores to suggest thresholds for designating select agents, requiring subject matter expertise collectively to establish which analytical results were in good agreement to support the intended purpose in designating select agents. The DSF utilized a logic tree approach to identify pathogens that are of sufficiently low concern that they can be ruled out from consideration as a select agent. In contrast to the MCDA approach, the DSF rules out a pathogen if it fails to meet even one criteria threshold. Both the MCDA and DSF approaches arrived at similar conclusions, suggesting the value of employing the two analytical approaches to add robustness for decision making.

60 APPLIED LIFE SCIENCES↗

Fast GPU-Based Generation of Large Graph Networks From Degree Distributions

Synthetically generated, large graph networks serve as useful proxies to real-world networks for many graph-based applications. The ability to generate such networks helps overcome several limitations of real-world networks regarding their number, availability, and access. Here, we present the design, implementation, and performance study of a novel network generator that can produce very large graph networks conforming to any desired degree distribution. The generator is designed and implemented for efficient execution on modern graphics processing units (GPUs). Given an array of desired vertex degrees and number of vertices for each desired degree, our algorithm generates the edges of a random graph that satisfies the input degree distribution. Multiple runtime variants are implemented and tested: 1) a uniform static work assignment using a fixed thread launch scheme, 2) a load-balanced static work assignment also with fixed thread launch but with cost-aware task-to-thread mapping, and 3) a dynamic scheme with multiple GPU kernels asynchronously launched from the CPU. The generation is tested on a range of popular networks such as Twitter and Facebook, representing different scales and skews in degree distributions. Results show that, using our algorithm on a single modern GPU (NVIDIA Volta V100), it is possible to generate large-scale graph networks at rates exceeding 50 billion edges per second for a 69 billion-edge network. GPU profiling confirms high utilization and low branching divergence of our implementation from small to large network sizes. For networks with scattered distributions, we provide a coarsening method that further increases the GPU-based generation speed by up to a factor of 4 on tested input networks with over 45 billion edges.

97 MATHEMATICS AND COMPUTING↗