Search NASA⌕ Search

SEARCH · Search NASA

Results for “Tabular data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

The Astronomy Commons Platform: A Deployable Cloud-based Analysis Platform for Astronomy

Abstract We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular data sets. The presented platform is built on Amazon Web Services (over Kubernetes and S3 abstraction layers), utilizes Apache Spark and the Astronomy eXtensions for Spark for parallel data analysis and manipulation, and provides the familiar JupyterHub web-accessible front end for user access. We outline the architecture of the analysis platform, provide implementation details and rationale for (and against) technology choices, verify scalability through strong and weak scaling tests, and demonstrate usability through an example science analysis of data from the Zwicky Transient Facility’s 1Bn+ light-curve catalog. Furthermore, we show how this system enables an end user to iteratively build analyses (in Python) that transparently scale processing with no need for end-user interaction. The system is designed to be deployable by astronomers with moderate cloud engineering knowledge, or (ideally) IT groups. Over the past 3 yr, it has been utilized to build science platforms for the DiRAC Institute, the ZTF partnership, the LSST Solar System Science Collaboration, and the LSST Interdisciplinary Network for Collaboration and Computing, as well as for numerous short-term events (with over 100 simultaneous users). In a live demo instance, the deployment scripts, source code, and cost calculators are accessible. 4 4 http://hub.astronomycommons.org/

79 ASTRONOMY AND ASTROPHYSICS↗

Data and scripts associated with the manuscript "Organic Molecules are Deterministically Assembled in River Sediments"

This data package is associated with the publication "Organic Molecules are Deterministically Assembled in River Sediments" submitted to Scientific Reports (Stegen et al., 2024). The study applies community ecology methods to dissolved organic matter (DOM) chemistry from variably inundated riverbed sediments to uncover principles governing DOM composition at a reach-scale. This data package documents the workflow used to process and generate the main findings in the manuscript. The R scripts reference the raw, unprocessed Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS) data from another data package, available on ESS-DIVE at https://data.ess-dive.lbl.gov/view/doi:10.15485/1834208. The scripts then process the raw FTICR-MS data and generate the findings and figures presented in the associated manuscript. In brief, this study demonstrates that DOM assemblages in variably inundated sediments are primarily governed by deterministic variable selection, including sediment moisture effecting the degree of deterministic assembly. See the manuscript for more details pertaining to interpretation and implications of the findings. This data package is associated with the GitHub repository found at https://github.com/WHONDRS-Hub/ECA_2020_Sed.This data package is comprised of 6 scripts and 7 folders. The file-level metadata file (file ending in "flmd.csv") lists all files contained in this data package and descriptions for each. The data dictionary (file ending in "dd.csv) describes all tabular data columns and their respective definitions and units. The FTICR_Processing_Scripts produce the outputs found in the "Processed_Data" folder. The remaining scripts (located in the parent directory) produce the outputs found in the following four folders: (1) "MCD_Dendrograms", "MCD_Randomizations", "MCD_bNTI_Outcomes", and "OM_Null_Modeling". The fifth script additionally takes the three comma-separated values (CSV) files found in the parent directory as input ("VGC_texture.csv", "merged_weights.csv", and "ECA2_FTICR_BetaDisp.csv"). The outputs of each of the five scripts serve as the input to the following script, with the final outputs stored in the folder "OM_Null_Modeling".

54 ENVIRONMENTAL SCIENCES↗

Data and scripts associated with: “Burn severity and vegetation type control phosphorus concentration, molecular composition, and mobilization”

This data package is associated with the publication “Burn severity and vegetation type control phosphorus concentration, molecular composition, and mobilization” published in European Geophysical Union - Biogeosciences (Barnes et al. 2025). This study investigates how phosphorus (P) biogeochemistry is altered by burn severity in contrasting types of vegetation chars. This data package documents the workflow used to process and generate the main figures and statistics in the manuscript. The R scripts reference minimally processed P nuclear magnetic resonance (P-NMR) and X-ray absorption near edge structure (P-XANES) data, as well as fully processed data including total elemental composition of the solid chars, total elemental composition of the char leachates (particulate and aqueous phases), and leachate aqueous phase molybdate reactive P concentration. These source data and associated metadata can be found on ESS-DIVE at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/1894135 (Grieger et al. 2022; v3). Files and scripts included in this data package finish the processing workflow for P-NMR and P-XANES data. These data can be used to gain a better understanding of bulk chemical changes in chars and their leachates, as well as detailed molecular changes to P. This data package is associated with the GitHub repository found at https://github.com/river-corridors-sfa/rcsfa-RC3-BSLE_P. This data package is comprised of a “data” folder and a series of data processing and analysis scripts. Details on how to recreate the workflow can be found in the Critical Details section of the readme and the “workflow_readme.md” file. The file-level metadata file (file ending in “flmd.csv”) lists all files contained in this data package and descriptions for each. The data dictionary (file ending in “dd.csv”) describes all tabular data columns and their respective definitions and units.

54 ENVIRONMENTAL SCIENCES↗

GIS @ LANL

Why is GIS important to LANL, how is it being used, and what can the GIS Program do for you? The GIS Program is an institutional resource for all things related to GIS/spatial data/mapping. We have a robust Enterprise GIS platform with over 25 years worth of LANL operational spatial data. We are constantly making ties to additional tabular data sources to integrate information so that it can be leveraged through interactive mapping applications.

97 MATHEMATICS AND COMPUTING↗

Supporting HEP Data as the Exascale Era Approaches

We describe our work on the use of HPC data formats and storage technologies to efficiently describe, store and access High Energy Physics (HEP) data. In the HEP community, important data sets are large, currently at the scale of tens of PiB, and are expected to grow dramatically in the next decade. These data require different data representations—ranging from complex C++ objects to tabular data—that are used at the many varied stages of data analysis. Traditionally, these data have been stored in large collections of files at each stage. This approach does not scale well on HPC resources. To obtain good scalability, without requiring that analysts have parallel programming expertise, our work stresses the use of HPCoptimized tools and implicit data-parallelism. We describe data organization and the performance and scaling of data processing using examples from three HEP experiments (LArIAT, NOvA and DUNE), and for three different stages of analysis. We compare the performance of our HPC-oriented solutions to the traditional HEP approaches.

Buchanan, Norman↗

Data and scripts associated with “Riverine dissolved organic matter transformations increase with watershed area, water residence time, and Damköhler numbers in nested watersheds” (v2)

This data package is associated with the publication “Riverine dissolved organic matter transformations increase with watershed area, water residence time, and Damköhler numbers in nested watersheds” submitted to Biogeochemistry by Ryan et al., 2024 (DOI: https://doi.org/10.1007/s10533-024-01169-5). This study aims to investigate fundamental and transferable drivers of dissolved organic matter (DOM) diversity across five nested watersheds within the contiguous United States. DOM diversity was explored using ultrahigh-resolution Fourier transform ion cyclotron resonance mass spectrometry (FTICR-MS). The samples and the unprocessed FTICR-MS data used in this study are publicly available on the Environmental System Science Data Infrastructure for a Virtual Ecosystem (ESS-DIVE) data repository (see DOIs below). The data for the Willamette, Gunnison, Connecticut, and Deschutes basins were collected as part of a collaboration between the Watershed Rules of Life (WROL) project and Worldwide Hydrobiogeochemistry Observation Network for Dynamic River Systems (WHONDRS). The data for the Yakima River basin (YRB) was collected by the PNNL River Corridor SFA. The raw, unprocessed FTICR-MS data with additional (meta)data can be found at doi:10.15485/1895159 for WROL samples and doi:10.15485/1898912 for YRB samples. This data package contains the processed data used in the associated manuscript. This package also contains ancillary geospatial, hydrological, and geochemical information that supports the interpretation of the FTICR-MS data within Ryan et al., 2024. This data package is associated with the GitHub repository found at https://github.com/WHONDRS-Hub/rcsfa-RC4-WROL-YRB_DOM_Diversity. This data package was originally published August 2024. It was updated January 2025 (modified files). See the change history in the readme more details. At the directory level, the data package is comprised of three folders: (1) data, (2) output, and (3) src; and five additional files including the data dictionary (file ending in "_dd.csv”) and file-level metadata (file ending in “_flmd.csv”). The “src” folder contains the scripts used to process the FTICR data, conduct the analyses, and produce the manuscript figures. The inputs for these scripts are in the “data” folder and the returned outputs in the “output” folder. Inputs include temporal and spatial metadata associated with the sampling efforts, processed FTICR data, and total and normalized putative biochemical transformations per sample. Outputs include cleaned and combined data presented as tables, descriptive statistics, and plots. The file-level metadata file lists all files contained in this data package and descriptions for each. The data dictionary describes the units and definitions for each tabular data column or row header.

54 ENVIRONMENTAL SCIENCES↗

Raft River EGS Project: A GIS-Centric Review of Geology

The Raft River thermal anomaly is located on the northern margin of the Great Basin. This area has undergone numerous studies due its juxtaposition with the Raft River and Albion metamorphic core complexes, associated low-angle detachment faults, and the presence of the thermal anomaly. Miocene movement along the Raft River detachment displaced a large mass of Paleozoic and Mesozoic rock about 24 km to the east unroofing the shear zone and creating the Raft River Valley. The rocks in the Raft River detachment footwall/shear zone are Archean and Proterozoic in age and are overlain by late Miocene/Pliocene ash-flow tuff, tuffaceous sediments, rhyolite, and mixed Quaternary sediments. Work described here supports the DOE/U.S. Geothermal, Inc. supported Raft River EGS project which is aimed toward improving permeability in well RRG-9. A GIS data suite was developed from historical data and new data produced by this study to help underpin this project. The GIS includes well survey, lithologic, mineralogic, and geophysical data that were incorporated from disparate datasets ranging from scanned images to tabular data in spreadsheets. This data has been visualized and analyzed using GIS-based tools to help build a better understanding of the study area geology. Finally, this includes a possible structural explanation of ground water/geothermal fluid compartmentalization.

15 GEOTHERMAL ENERGY↗

Engineering Privacy at the Edge: A Practical Guide to Differential Privacy in System Architectures

The rapid expansion of distributed and edge computing platforms—spanning autonomous vehicles, IoT sensors, and healthcare monitors—has heightened concerns about data privacy. Differential Privacy (DP) offers a rigorous mathematical framework to protect sensitive information while retaining analytical utility. This tutorial introduces the foundations of DP for both numerical and categorical datasets and extends the discussion to correlation-aware techniques tailored for structured and high-dimensional data. Hands-on demonstrations will begin with the PETINA (Privacy prEservaTIoN Algorithms) package for numerical data and continue with MIC-DP (Maximum Information Correlated Differential Privacy) for tabular data. Designed for researchers and practitioners in secure systems, embedded architectures, and AI accelerators, the tutorial emphasizes practical and scalable methods for integrating DP into real-world system designs.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗

COMPASS-FME Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) Experiment Level 2 Sensor Data v2-1

This is the version v2-1 Level 2 (L2) data release for COMPASS-FME environmental sensors located at our Terrestrial Ecosystem Manipulation to Probe the Effects of Storm Treatments (TEMPEST) experimental site. This manipulative, ecosystem-scale TEMPEST experiment addresses the potential for freshwater and estuarine-water disturbance events to alter tree function, species composition, and ecosystem processes in a deciduous coastal forest in MD, USA. The experiment uses a large-unit (2000 m2), un-replicated experimental design, with three 50 m × 40 m plots serving as control, freshwater, and estuarine-water treatments. Level 2 (L2) data consist of sensor observations from the COMPASS-FME synoptic sites, TEMPEST, and DELUGE. Compared to the L1 data, these are more consistent (always 15-minute timestamps for the entire year); better QA/QC’d (out of bounds, out of service, and extreme outlier values are removed); and more complete, with a gap-filled time series available alongside the main observations, and additional derived (calculated) variables. L2 data are intended to be rapidly and easily usable in analyses and simulations. However, algorithmic outlier identification always carries the risk of removing valid data, and Level 1 data may be more suitable for analyses that focus on variability or extreme events. This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific Parquet (a high performance, space efficient format; see https://parquet.apache.org) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are reported every 15 minutes. Please see v2-1 TEMPEST L2 Sensor Package Quick Start.pdf for detailed information on data package structure, temporal coverage, and versioning. Data files are in Apache Parquet, a high performance, space efficient format for tabular data. These files can be read using R's `arrow` package (https://arrow.apache.org/docs/r/), with similar tools available in other languages. The TEMPEST flood events occurred on the following dates. They lasted for ~10 hours each day and delivered ~80,000 gallons to each plot; many data streams are available at 1 or 5 minute frequency during these periods. * Tests: Aug 25 (fresh plot) and Sep 9 (salt plot), 2021 * TEMPEST 1: June 22, 2022 * TEMPEST 2: June 6-7, 2023 * TEMPEST 3: June 11-13, 2024

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗

COMPASS-FME Synoptic Sites Level 2 Sensor Data v2-1

This is the version 2-1 Level 2 (L2) data release for COMPASS-FME environmental sensors located at our synoptic field sites. COMPASS-FME is studying sites in two distinct regions, the Chesapeake Bay and the Western Lake Erie Basin. We established the network at seven "synoptic" (observational) sites along the Chesapeake Bay and Lake Erie coastlines, collectively generating over three million observations per month, to track and comprehend environmental changes where land and water intersect. Additionally, the two regions provide an interesting contrast of saltwater and freshwater coasts that allow us to differentiate the impacts of inundation and coastal water chemistries in two nationally important coastal systems. Level 2 (L2) data consist of sensor observations from the COMPASS-FME synoptic sites, TEMPEST, and DELUGE. Compared to the L1 data, these are more consistent (always 15-minute timestamps for the entire year); better QA/QC’d (out of bounds, out of service, and extreme outlier values are removed); and more complete, with a gap-filled time series available alongside the main observations, and additional derived (calculated) variables. L2 data are intended to be rapidly and easily usable in analyses and simulations. However, algorithmic outlier identification always carries the risk of removing valid data, and Level 1 data may be more suitable for analyses that focus on variability or extreme events. This dataset includes: - An overall dataset README file that describes the current version, gives citation and contact information, etc. - Site- and year-specific folders, each holding variable-specific Parquet (a high performance, space efficient format; see https://parquet.apache.org) data files for each site and plot in that year. - Metadata files within each site-year folder provide full information on data units, expected ranges, contact information, detailed flood times, as well as a general description of the site. - Environmental sensor types that appear in the data files include weather (ClimaVUE50, CS, RM Young, and LI instruments in the graphs below); soil conditions (TEROS12); soil redox state (Redox); groundwater variables (AquaTROLL200 and AquaTROLL600); open water sondes (Exo); tree sap velocity (Sapflow); and system voltage and state (Datalogger). Data are reported every 15 minutes. Data files are in Apache Parquet, a high performance, space efficient format for tabular data. These files can be read using R's `arrow` package (https://arrow.apache.org/docs/r/), with similar tools available in other languages. Please see v2-1 L2 Sensor Package QStart.pdf for detailed information on data package structure, temporal coverage, and versioning.

EARTH SCIENCE > ATMOSPHERE > ATMOSPHERIC TEMPERATU↗

Improving Predictive Capability in REHEDS Simulations with Fast, Accurate, and Consistent Non-Equilibrium Material Properties

Predictive design of REHEDS experiments with radiation-hydrodynamic simulations requires knowledge of material properties (e.g. equations of state (EOS), transport coefficients, and radiation physics). Interpreting experimental results requires accurate models of diagnostic observables (e.g. detailed emission, absorption, and scattering spectra). In conditions of Local Thermodynamic Equilibrium (LTE), these material properties and observables can be pre-computed with relatively high accuracy and subsequently tabulated on simple temperature-density grids for fast look-up by simulations. When radiation and electron temperatures fall out of equilibrium, however, non-LTE effects can profoundly change material properties and diagnostic signatures. Accurately and efficiently incorporating these non-LTE effects has been a longstanding challenge for simulations. At present, most simulations include non-LTE effects by invoking highly simplified inline models. These inline non-LTE models are both much slower than table look-up and significantly less accurate than the detailed models used to populate LTE tables and diagnose experimental data through post-processing or inversion. Because inline non-LTE models are slow, designers avoid them whenever possible, which leads to known inaccuracies from using tabular LTE. Because inline models are simple, they are inconsistent with tabular data from detailed models, leading to ill-known inaccuracies, and they cannot generate detailed synthetic diagnostics suitable for direct comparisons with experimental data. This project addresses the challenge of generating and utilizing efficient, accurate, and consistent non-equilibrium material data along three complementary but relatively independent research lines. First, we have developed a relatively fast and accurate non-LTE average-atom model based on density functional theory (DFT) that provides a complete set of EOS, transport, and radiative data, and have rigorously tested it against more sophisticated first-principles multi-atom DFT models, including time-dependent DFT. Next, we have developed a tabular scheme and interpolation methods that compactly capture non-LTE effects for use in simulations and have implemented these tables in the GORGON magneto-hydrodynamic (MHD) code. Finally, we have developed post-processing tools that use detailed tabulated non-LTE data to directly predict experimental observables from simulation output.

36 MATERIALS SCIENCE↗

The art and power of data imaging

Data imaging and visual data assessment are veritable gold mines in the scientist's quest to understand and accurately interpret numerical data. Graphical displays of various aspects of a dataset offer the analyst insight to the data that no mathematical computation or statistic can provide. It is difficult, at best, for even a skilled and observant statistician to understand the underlying structure of a dataset. Often, there is either too little data to get a good 'picture' of the structure that might be present or there is so much data that one cannot readily assimilate it. Of course, the latter problem (too much data) is, in reality, no problem at all given the abilities of modern computers and software systems to manage large amounts of data. Advances in computer technology and the advent of the global positioning satellite system have enabled scientists from many fields of endeavor to collect and view data in its spatial context. Visual images constructed from spatially referenced data reveal the inherent richness and structure in the data and lead to more informed conclusions. So powerful is data collected with spatial context that a relatively new branch of mathematical statistics, geo-spatial statistics, has emerged. Geo-spatial statistics seek to exploit this context rich data form to better understand the spatial and co-relationships that might exist, but would be otherwise hidden in tabular data or obscured with classic statistical approaches. This paper (and accompanying presentation) will show the power that visual data assessment possesses to understand radiological scanning data and to make confident and accurate decisions based on the data images. It will challenge the traditional mathematical concept of detection limits for scanning. It will demonstrate that more data, even if the individual datum comprising the dataset is of 'poorer quality' (i.e., has a larger uncertainty and, thus, a larger calculated minimum detection value), is significantly more powerful than a smaller dataset comprised of higher quality measurements. This presentation will cause the open-minded health physicist to rethink how they prescribe, collect, evaluate, and make decisions based upon radiological scan data. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Efficient and Accurate Pre-Inversion of Equation of State Data

In this report, we evaluate the trade-offs between accuracy and performance in three equation of state interpola- tion strategies- EOSPAC, SpinerEOSDependsRhoT, and SpinerEOSDependsRhoSie-using SESAME tabular data. We also investigate ways to reduce nonlinearity in the data through invertible transformations within the SpinerEOS- DependsRhoSie class with the goal of impacting interpolation accuracy. We include a variety of benchmarking tests that vary the grid densities and how memory is accessed.

36 MATERIALS SCIENCE↗

Individual Motorist Data - Ohio EV Ownership Trends

The individual motorist dataset contains data and analysis of consumer electric vehicle (EV) ownership trends in rural Appalachian Ohio in comparison with statewide trends. The data span four years, from Q1 2020 to Q2 2023 (partial). They are sourced from the Ohio Bureau of Motor Vehicles registration records and contain detail on drivetrain type (battery-electric vehicle [BEV] or plug-in hybrid electric vehicle [PHEV]); specific vehicle make and model; and registration location at county, city, and ZIP code levels of spatial resolution. Registration data are analyzed at the county level against such indicators as median income, poverty status, urban-rural status, and density of public charging infrastructure. In addition to tabular data, a GIS shapefile with many analysis fields joined is included.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Feature Extraction: Improving Remote Sensor Classification of Non-Proliferation

This research focuses on developing algorithms for nuclear non-proliferation detection using remote sensor modeling. To improve the performance of classification models, we implemented a data pipeline with feature extraction. This pipeline takes raw data and transforms it into smaller data points called features that still describe the model. Improving this classification works towards the departments of energy’s missions of ensuring American’s security and prosperity by creating technology that addresses nuclear challenges. To conduct this analysis, we used the Python programming language and some key packages, including tsfresh and TSFEL. Originally tsfresh was selected because it has the most statistical features out of all the packages. Later TSFEL was incorporated due to the additional features it can extract from data, such as temporal and spectral. However, feature extraction becomes challenging in the presence of missing values. In this case, two additional Python packages were added to our workflow, NumPy and pandas, allowing for the feature extraction process to handle unknown values. Our data pipeline was tested on data collected from a simulation that describes the process state of a physical example. The results show the pipeline’s capability to consume and extract a total 17 features from tabular data. Future work includes producing classifications using decision tree-based models such as XGBoost and improving data collection by analyzing feature importance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

SU-F-T-521: Flattening-Filter-Free Beam Parameters Comparison From Different Linac Machine Types

Purpose: Novel linac machines, TrueBeam (TB) and Elekta Versa have updated head designing and software control system, include flattening-filter-free (FFF) photon and electron beams. Later on FFF beams were also introduced on C-Series machines. In this work FFF beams for same energy 6MV but from different machine versions were studied with reference to beam data parameters. Methods: The 6MV-FFF percent depth doses, profile symmetry and flatness, dose rate tables, and multi-leaf collimator (MLC) transmission factors were measured during commissioning process of both C-series and Truebeam machines. The scanning and dosimetric data for 6MV-FFF beam from Truebeam and C-Series linacs was compared. A correlation of 6MV-FFF beam from Elekta Versa with that of Varian linacs was also found. Results: The scanning files were plotted for both qualitative and quantitative analysis. The dosimetric leaf gap (DLG) for C-Series 6MV-FFF beam is 1.1 mm. Published values for Truebeam dosimetric leaf gap is 1.16 mm. 6MV MLC transmission factor varies between 1.3 % and 1.4 % in two separate measurements and measured DLG values vary between 1.32 mm and 1.33 mm on C-Series machine. MLC transmission factor from C-Series machine varies between 1.5 % and 1.6 %. Some of the measured data values from C-Series FFF beam are compared with Truebeam representative data. 6MV-FFF beam parameter values like dmax, OP factors, beam symmetry and flatness and additional parameters for C-Series and Truebeam liancs will be presented and compared in graphical form and tabular data form if selected. Conclusion: The 6MV flattening filter (FF) beam data from C-Series & Truebeam and 6MV-FFF beam data from Truebeam has already presented. This particular analysis to compare 6MV-FFF beam from C-Series and Truebeam provides opportunity to better elaborate FFF mode on novel machines. It was found that C-Series and Truebeam 6MV-FFF dosimetric and beam data was quite similar.

60 APPLIED LIFE SCIENCES↗

Examining the Characteristics of the Cropland Data Layer in the Context of Estimating Land Cover Change

The United States Department of Agriculture (USDA) Cropland Data Layer (CDL) provides spatially explicit information about crop production area and has served as a prevalent data source for characterizing cropland change in the U.S. in the last decade. Understanding the accuracy of the CDL is paramount because of the reliance on it for management and policy making. This study examined the characteristics of the CDL from 2007 to 2017 using comparisons to other USDA datasets. The results showed when examining the cropland area for the same year, the CDL produced comparable trends with other datasets (R 2 > 0.95), but absolute area differed. The estimated area of cropland changes from 2007 to 2012, 2008 to 2012 and 2012 to 2017 varied from weak to moderate correlation between the CDL and the tabular data (R 2 = 0.005~0.63). Differences in area of cropland change varied widely between data sources with the CDL estimating much larger change area. A series of image processing techniques designed to improve the confidence in cropland change estimated using the CDL reduced the area of estimated cropland change. The techniques also, unexpectedly, lowered the correlation in change estimated between the CDL and the tabular datasets. Estimated land cover change area varied widely based on analyses applied and could reverse from increasing to declining area in cropland. Further analyses showed unlikely change scenarios when comparing different year combinations. The authors recommend the CDL only be used for land cover change analysis if the error can be estimated and is within change estimates.

58 GEOSCIENCES↗

Scaling SQL to the Supercomputer for Interactive Analysis of Simulation Data

AI and simulation workloads consume and generate large amounts of data that need to be searched, transformed and merged with other data. With the goal of treating data as a first-class citizen inside a traditionally compute-centric HPC environment, we explore how the use of accelerators and high-speed interconnects can speed up tasks which otherwise constitute bottlenecks in computational discovery workflows. BlazingSQL is SQL engine that runs natively on NVIDIA GPUs and supports internode communication for fast analytics on terabyte-scale tabular data sets. We show how a fast interconnect improves query performance if leveraged through the Unified Communication X (UCX) middleware. We envision that future computing platforms will integrate accelerated database query capabilities for immediate and interactive analysis of large simulation data.

Glaser, Jens↗