AI Surrogate Model for Distributed Computing Workloads
Explore the source record for details and available documents.
97 MATHEMATICS AND COMPUTING↗
SEARCH · Search NASA
Results for “tabular”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
libjustify
The libjustify library allows dynamic justification of tabular data in native C. Existing formatting support requires a compile-time commitment to worst-case column widths or complex handcrafted solutions. With libjustify, tabular data is transformed from long, machine-readable format into a human-readable format.
Rountree, BarryL↗
CTGAN-TVAE
SAND2026-18914O CTGAN-TVAE (Conditional Tabular Generative Adversarial Networks-Tabular Variational Autoencoders) generates extensive sets of variable generation data through a hybrid framework. It enhances latent space representation by combining TVAE's robust feature-embedding with CTGAN's ability to condition categorical variables such as time. CTGAN-TVAE employs a fully connected neural network within a conditional generative adversarial network framework to manage continuous and categorical data effectively, capturing complex feature interactions without needing sequential modeling. This was developed as part of NNSA-MSIPP: Minority Serving Institution Partnership Program, Grant Number DE-NA0004016. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.
Newlun, Cody [Sandia National Lab. (SNL-CA), Liver↗
ESS-DIVE Reporting Format for Comma-separated Values (CSV) File Structure
The ESS-DIVE reporting format for Comma-separated Values (CSV) file structure is based on a combination of existing guidelines and recommendations including some found within the Earth Science Community with valuable input from the Environmental Systems Science (ESS) Community. The CSV reporting format is designed to promote interoperability and machine-readability of CSV data files while also facilitating the collection of some file-level metadata content. Tabular data in the form of rows and columns should be archived in its simplest form, and we recommend submitting these tabular data following the ESS-DIVE reporting format for generic comma-separated values (CSV) text format files. In general, the CSV file format is more likely accessible by future systems when compared to a proprietary format and CSV files are preferred because this format is easier to exchange between different programs increasing the interoperability of a data file. By defining the reporting format and providing guidelines for how to structure CSV files and some field content within, this can increase the machine-readability of the data file for extracting, compiling, and comparing the data across files and systems.Data package files are in .csv, .png, and .md. Open the .csv with e.g. Microsoft Excel, LibreOffice, or Google Sheets. Open the .md files by downloading and using a text editor (e.g., notepad or TextEdit). Open the .png in e.g. a web browser, photo viewer/editor, or Google Drive.
54 ENVIRONMENTAL SCIENCES↗
Data from: 'Abiotic influences on continuous conifer forest structure across a subalpine watershed'
This package archives the core data used for analysis and inference in 'Abiotic influences on continuous conifer forest structure across a subalpine watershed' (Worsham et al., 2025). All data were collected in the East River, Washington Gulch, Slate River, and Coal Creek watersheds of Colorado. In the paper, we quantified the relative influence of climate, topographic, edaphic, and geologic factors on conifer stand structure and composition, and their functional relationships, at the watershed scale. We used waveform LiDAR data to derive spatially continuous stand structure metrics. We fused these with a species-level classification map to estimate tree species abundance. We applied generalized additive and generalized boosted models to evaluate the covariability of structural and compositional metrics with abiotic variables. The package contains the essential products required for reproducing our analysis and the tables and figures reported in the publication. The products comprise four classes: (1) geospatial data, (2) tabular data used for inferential analysis, (3) tabular data describing analytical results and performance statistics, and (4) a data user guide. (1) includes discretized waveform LiDAR data, locations and attributes of individual tree crowns, sampling locations and domain boundaries, a canopy height model, and raster files of estimated forest structural and compositional metrics at 100 m grid scale. (2) includes all response and explanatory variable values applied in inferential models. Response variables include conifer forest stand density, basal area, 95th percentile height, quadratic mean diameter, and others. Explanatory variables include climatic water deficit, actual evapotranspiration, elevation, heat load, soil available water content, and others. (3) includes results of training and testing several individual tree detection (ITD) algorithms, as well as inferential modeling results. (4) is a PDF user guide for this data package, including detailed descriptions and data dictionaries for all files. The data package root contains 17 assets: 8 compressed tape archive (.tar.gz) files, 5 comma-separated values (.csv) files, 3 Geographic Tagged Image File Format (GeoTIFF) (.tif) files, and 1 Portable Document Format (.pdf) file. The compressed .tar.gz archives contain ESRI shapefiles (.shp) .tif, compressed LASer (.laz), and .csv files. The archives must first be decompressed using the widely distributed command-line software utility TAR. All other files, including constituent files within the .tar.gz archives, can be opened in the open-source R statistical computing environment. Alternatively, .csv files may also be read in any simple text editor software or Microsoft Excel. Geospatial files including .shp and .tif files can also be opened in GIS software, such as QGIS (open-source) or ESRI ArcGIS (proprietary). The .pdf Data User Guide can be read with Adobe Acrobat Reader or other compatible readers.
2018 NEON and 2025 CHESS Campaigns↗
Using density functional theory to construct multiphase equations of state: tin as an example
We present a general methodology for using density functional theory (DFT) calculations as a basis for constructing multiphase equations of state (EOS). Focusing on tin as an example, we discuss the full process of generating a tabular EOS, starting from first-principles calculations and arriving at a full EOS in agreement with existing experimental data. We begin by describing DFT calculations for the five solid phases and liquid phase of tin, including cold curve, phonon, and DFT-based molecular dynamics calculations. We then discuss methods for incorporating DFT results into materials models used in OpenSesame, the program used to create a full tabular multiphase EOS. Next, we outline a general strategy for adjusting model parameters in OpenSesame to fit to a variety of experimental data, including isobaric data, isothermal data, shock data, solid-solid phase boundary measurements, and measurements of the melt curve. We end with a discussion of the advantages of using DFT data as a foundation for EOS generation and discuss potential strategies for automated EOS generation based on the fitting process highlighted in this work.
74 ATOMIC AND MOLECULAR PHYSICS↗
Examining the Characteristics of the Cropland Data Layer in the Context of Estimating Land Cover Change
The United States Department of Agriculture (USDA) Cropland Data Layer (CDL) provides spatially explicit information about crop production area and has served as a prevalent data source for characterizing cropland change in the U.S. in the last decade. Understanding the accuracy of the CDL is paramount because of the reliance on it for management and policy making. This study examined the characteristics of the CDL from 2007 to 2017 using comparisons to other USDA datasets. The results showed when examining the cropland area for the same year, the CDL produced comparable trends with other datasets (R 2 > 0.95), but absolute area differed. The estimated area of cropland changes from 2007 to 2012, 2008 to 2012 and 2012 to 2017 varied from weak to moderate correlation between the CDL and the tabular data (R 2 = 0.005~0.63). Differences in area of cropland change varied widely between data sources with the CDL estimating much larger change area. A series of image processing techniques designed to improve the confidence in cropland change estimated using the CDL reduced the area of estimated cropland change. The techniques also, unexpectedly, lowered the correlation in change estimated between the CDL and the tabular datasets. Estimated land cover change area varied widely based on analyses applied and could reverse from increasing to declining area in cropland. Further analyses showed unlikely change scenarios when comparing different year combinations. The authors recommend the CDL only be used for land cover change analysis if the error can be estimated and is within change estimates.
58 GEOSCIENCES↗
PandAna: A Python Analysis Framework for Scalable High Performance Computing in High Energy Physics
Modern experiments in high energy physics analyze millions of events recorded in particle detectors to select the events of interest and make measurements of physics parameters. These data can often be stored as tabular data in files with detector information and reconstructed quantities. Current techniques for event selection in these files lack the scalability needed for high performance computing environments. We describe our work to develop a high energy physics analysis framework suitable for high performance computing. This new framework utilizes modern tools for reading files and implicit data parallelism. Framework users analyze tabular data using standard, easy-to-use data analysis techniques in Python while the framework handles the file manipulations and parallelism without the user needing advanced experience in parallel programming. In future versions, we hope to provide a framework that can be utilized on a personal computer or a high performance computing cluster with little change to the user code.
Groh, Micah↗
Self-Supervised Anomaly Detection via Neural Autoregressive Flows with Active Learning
Many self-supervised methods have been proposed with the target of image anomaly detection. These methods often rely on the paradigm of data augmentation with predefined transformations such as flipping, cropping, and rotations. However, it is not straightforward to apply these techniques for non-image data, such as time series or tabular data, while the performance of the existing deep approaches has been under our expectation on tasks beyond images. In this work, we propose a novel active learning (AL) scheme that relied on neural autoregressive flows (NAF) for self-supervised anomaly detection, specifically on small-scale data. Unlike other generative models such as GANs or VAEs, flow-based models allow to explicitly learn the probability density and thus can assign accurate likelihoods to normal data which makes it usable to detect anomalies. The proposed NAF-AL method is achieved by efficiently generating random samples from latent space and transforming them into feature space along with likelihoods via invertible mapping. The samples with lower likelihoods are selected and further checked by outlier detection using Mahalanobis distance. The augmented samples incorporating with normal samples are used for training a better detector so as to approach decision boundaries. Compared with random transformations, NAF-AL can be interpreted as a likelihood-oriented data augmentation that is more efficient and robust. Extensive experiments show that our approach outperforms existing baselines on multiple time series and tabular datasets, and a real-world application in advanced manufacturing, with significant improvement on anomaly detection accuracy and robustness over the state-of-the-art.
Zhang, Jiaxin↗
Complete Equations of State for Cyclotetramethylene Tetranitramine
Complete equations of state for the volumetric deformation of the β-polymorph of cyclotetramethylene tetranitramine (β-HMX) have been derived from its Helmholtz free energy. Dispersion-corrected density functional theory calculations were used to compute the dependence of the frequencies of the vibrational normal modes on specific volume. Here, the normal mode frequencies were used directly to generate both a tabular equation of state and an approximate model where the sum over normal mode frequencies is replaced by a set of five Debye models.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Scaling SQL to the Supercomputer for Interactive Analysis of Simulation Data
AI and simulation workloads consume and generate large amounts of data that need to be searched, transformed and merged with other data. With the goal of treating data as a first-class citizen inside a traditionally compute-centric HPC environment, we explore how the use of accelerators and high-speed interconnects can speed up tasks which otherwise constitute bottlenecks in computational discovery workflows. BlazingSQL is SQL engine that runs natively on NVIDIA GPUs and supports internode communication for fast analytics on terabyte-scale tabular data sets. We show how a fast interconnect improves query performance if leveraged through the Unified Communication X (UCX) middleware. We envision that future computing platforms will integrate accelerated database query capabilities for immediate and interactive analysis of large simulation data.
Glaser, Jens↗
Further Development of the Tamped Richtmyer-Meshkov Instability Method and Application to Molybdenum Dynamic Strength Calibration and Tabulation
The high pressure and high strain rate dynamic strength of Mo is experimentally and computationally investigated in the 3–20 GPa stress, 50–600 C temperature, and 10 5 –10 6 /s strain rate regimes using a modified tamped Richtmyer-Meshkov instability (RMI) method. Modifications to the tamped RMI method include a method to determine loading states during strain, a new strength calibration function based on interface shape, and a robust uncertainty quantification method. These modifications improve fidelity of the tamped RMI method, allowing evaluation of the compensating effects of pressure hardening, strain rate hardening, strain hardening, and thermal softening. The new calibration function based on interface shape is not limited to sinusoidal corrugations and could be applied to additional interface shapes. Plate impact experiments are performed at Argonne National Laboratory’s Advanced Photon Source’s Dynamic Compression Sector operated by Washington State University (DCS), driving a planar shock front through a corrugated Mo-D 2 O or Mo-C 8 F 18 interface, forcing the corrugation to significantly deform. The extent of interfacial deformation, RMI growth, is experimentally observed using X-ray phase contrast imaging at the DCS. RMI jet lengths and jet shapes are extracted from the experimental radiographs, then used to calibrate numerical simulations performed with the Sandia National Laboratories (SNL) hydrocode CTH. Mo yield strength, Y, as a function of shock pressure, P, strain rate, $\dot{\varepsilon }$, accumulated strain, ϵ, relative volumetric compression, RD , and temperature, T , is determined for each impact experiment and presented. The calibrated Mo yield strength values range 1.2–1.8 GPa, with strength generally decreasing as the impact stress increases. This trend is likely caused by thermal softening or strain localization. The tabular yield strength versus loading condition data presented in this paper can be used to fit complex strength models.
Voorhees, T. J. [Sandia National Lab. (SNL-CA), Li↗
Zinc aluminate (ZnAl 2 O 4 ) refractory aggregates: Dilatometric sintering studies and thermal expansion coefficient
ZnAl 2 O 4 has recently been reported to enhance thermomechanical properties and slag corrosion resistance of refractory castables. The pore generation and deleterious expansion during in situ ZnAl 2 O 4 formation can limit their amount in a refractory composition. A comprehensive dilatometric study is presented, identifying the optimum raw materials and processing conditions. Preformed ZnAl 2 O 4 refractory aggregates were synthesized from industrial ZnO and reactive Al 2 O 3 by two-stage firing at 1050 °C and 1700 °C resulting in 0% open porosity. The ZnAl 2 O 4 powder calcined at 1050 °C is also a good refractory matrix material as it has better sinterability than preformed refractory-grade MgAl 2 O 4 and calcined alumina. The thermal expansion coefficient of ZnAl 2 O 4 aggregate in the range of 70–1600 °C was found to be 10.7 × 10 –6 K –1 , which is similar to tabular Al 2 O 3 (10.3 × 10 –6 K –1 ) and MgAl 2 O 4 (10.3 × 10 –6 K –1 ), but lower than dead burned MgO (16.4 × 10 –6 K –1 ), creating the possibility of developing thermal shock resistant refractories by utilizing this mismatch.
36 MATERIALS SCIENCE↗
Cascading economic losses from port disruptions under capacity constrained multimodal freight networks
This study quantifies how throughput disruptions at major seaports cascade through capacity-constrained multimodal freight networks and interregional production systems. We couple an agent-based model (ABM) multimodal freight simulation that resolves rerouting, terminal queueing, and inventory drawdown under binding modal and facility capacities with a multiregional output loss input-output (MRIIM) model that propagates realized delivery shortfalls across regions and sectors. The framework is demonstrated for the Port of Los Angeles using Freight Analysis Framework flows and Bureau of Economic Analysis input-output accounts and is evaluated over a 52-week horizon under deterministic sector targeted shocks and stochastic disruption realizations with uncertain severity and duration. Results indicate nonlinear amplification: realized national losses concentrate in manufacturing and transportation/warehousing even when exogenous port shocks are dispersed, suggesting that congestion spillback and limited short-run substitution can dominate the initial shock allocation. We further evaluate a tabular reinforcement-learning (Q-learning) intervention layer that selects among a small set of implementable system level levers (truck-to-rail and truck-to-barge shift settings) without overriding shipper routing, finding that such interventions reduce total losses for moderate disruptions but yield diminishing returns once substitute modes approach capacity. By linking operational freight behavior to system wide impacts under uncertainty, the proposed ABM-MRIIM pipeline provides a reusable workflow for port disruption stress testing, identification of structurally critical sectors/corridors, and evaluation of resilience interventions under realistic capacity limits.
42 ENGINEERING↗
An NCrystal extension for thermal neutron scattering in MCNP
A new extension for MCNP has been developed that incorporates the NCrystal thermal scattering package in the form of a Fortran to C++ wrapper, which adds the capability to describe thermal neutron scattering in the NCrystal formalism instead of the ACE tabular format. This can be used to described poly- or single-crystalline materials as well as liquids. In conclusion, the functionality of this extension to MCNP is illustrated using a layered crystal monochromator, leakage of neutrons from a moderating sphere of material, and by simulating criticality benchmarks.
MCNP↗
Automatic recognition system for document digitization in nuclear power plants
With the increasing number of data-driven models in nuclear applications, large volumes of numerical data are required to accurately model and predict the health status of a plant component. However, many historical operation logs that contain useful information are not fully utilized due to the lack of a systematic approach of digitization. To overcome this issue, this study proposes an automatic pipeline for extracting information from handwritten tabular documents collected from nuclear power plants. In our pipeline, we first denoise scanned documents with morphological operations, and then extract relevant parts from individual pages using both traditional computer vision and neural network methods. Handwriting recognition is applied to obtain text and numbers. As the most challenging step is how to crop only relevant information, the main focus of our paper is to detect tables and cells from scanned handwritten documents. Here we evaluate the efficiency and accuracy of our proposed method on handwritten operational reports obtained from a real-world case study. The results demonstrate the high accuracy and practicality of our proposed method.
21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
Measured and satellite-derived albedo data for estimating bifacial photovoltaic system performance
The albedo of the ground surface is an important factor in the cost-effectiveness of a bifacial photovoltaic (PV) system. To improve the availability of reliable albedo data, datasets of ground albedo and associated meteorological data were developed by using existing measurement network data and data measured by the PV industry. The measured datasets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Satellite-derived values of albedo are available from the National Solar Radiation Data Base (NSRDB). The NSRDB albedos were compared to the measured albedos for Surface Radiation budget (SURFRAD) network locations for the period 2001–2017, and the mean bias difference results were from -0.044 to +0.056. Overall, these differences are greater than the albedo measurement uncertainty of ±0.02; consequently, the NSRDB albedos should be used with caution for estimating the performance of bifacial PV systems. Differences between SURFRAD and NSRDB albedos are attributed to the NSRDB method for determining albedo and to the ground surfaces within the NSRDB 4 km spatial resolution pixel consisting of a mixture of surface types rather than just the single surface types viewed by the albedometers at the SURFRAD stations.
14 SOLAR ENERGY↗
A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes
When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.
97 MATHEMATICS AND COMPUTING↗