Search NASA⌕ Search

SEARCH · Search NASA

Results for “spreadsheet”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Solid Oxide Cell Manufacturing Cost Tool

NETL has developed a detailed solid oxide cell (SOC) cost modeling tool. The tool provides a fully customizable spreadsheet that aids in cost estimation of large volume manufacturing of SOC (both fuel cell and electrolysis cell). The tool can be used to assist commercial developers and other end users to evaluate the costs of producing cells and stack components as SOC systems increase in scale. The manufacturing materials, labor, component costs, and specific equipment can be tailored to accurately reflect the desired manufacturing process. The tool is paired with a detailed user manual to assist in the understanding of the full functionality. This document is the spreadsheet tool. To access the associated user guide, please visit: <a href="https://netl.doe.gov/energy-analysis/details?id=f5823130-0d20-4a04-9c53-341682e58ac1" rel="noopener noreferrer">Energy Analysis | netl.doe.gov</a>

cost modeling↗
DOE OSTI2022

Baseline Characterization Database Verification Report – 2114 Billet A20568

This ECAR provides the results of a validity evaluation of the physical and mechanical property data collected on a billet of nuclear-grade graphite (i.e., 2114 Billet A20568) in support of the ART Baseline Graphite Characterization Program.1,2 Millions of raw data points have been collected during testing and quantification analyses for these billets. The summary scalar property values and supplementary traceability data are collected into comprehensive spreadsheets. Data sets are composed of single billets of graphite for any given grade, organized by mechanical test-specimen type, and further subdivided into individual spreadsheet tabs according to the specific test or evaluation being performed. A direct analysis of properties was not conducted, and this report does not provide information on the validity or performance characteristics of the graphite itself. Rather, this report is intended as a verification of the completeness of actual data collected in accordance with PLN-3467, “Baseline Graphite Characterization Plan: Electromechanical Testing,”3 and their representation of the measurement and test results with sole regard to the graphite billets under evaluation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Example Alternative Compliance Waiver Application: EPAct State and Alternative Provider Fleet Program Guidance Document

The U.S. Department of Energy developed an electronic planning spreadsheet to facilitate fleets' preparation of a complete Alternative Compliance (AC) waiver application. All fleets that participate in AC are encouraged to use the spreadsheet. The example in this guidance document includes all components that must be included in a fleet’s AC waiver application.

AC waiver↗
DOE OSTI2020

Modeling and analysis of heat emissions from buildings to ambient air

Heat emissions from buildings is a significant source of anthropogenic heat influencing the urban microclimate; however, they are usually oversimplified in urban climate and microclimate modeling. This study developed a bottom-up physics-based approach to calculate heat emissions from buildings to the ambient air and implemented the approach in EnergyPlus. In this work, a simple result verification was conducted by comparing the EnergyPlus simulated results against the spreadsheet calculations. Simulations covering 16 commercial building types, four climates, and two energy efficiency levels were conducted to understand and evaluate the building heat emissions and their temporal patterns as well as three major components: (1) building envelope (convective heat transfer to ambient air), (2) zones (air exfiltration and exhaust air), and (3) HVAC systems (relief air and heat rejection from condensers or cooling towers). The main findings are: (1) heat emissions are usually higher than the site energy use (about 2.5 times), and their dynamics should be considered; (2) building characteristics and their energy systems lead to differences in heat emission contributions from the three components, and their dynamics, for example, in the warehouse models, the envelope component accounts for 90.4%, while it is 12.7% for the large office models; (3) for most building typologies, the climate has a strong impact on heat emissions, for example, buildings with dominant heat emissions from the zone exhaust air and/or the HVAC reject heat, a general decrease in heat emissions in hotter climates is observed, while envelope-dominated buildings show the opposite; and (4) building technologies that reduce energy use in buildings may perform differently in reducing heat emissions. The developed heat emissions calculation method can be adopted in EnergyPlus and most other building energy modeling programs. It can provide dynamic building heat emissions as an input to urban climate computational fluid dynamics (CFD) models at a higher spatial and temporal resolution than is currently available, to improve the simulation accuracy of the urban microclimate and capture the urban heat island effect and urban overheating.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Techno-economic analysis of carbon dioxide capture from low concentration sources using membranes

Rising carbon dioxide (CO 2 ) levels in the atmosphere lead to global warming, causing climate change. As such, carbon capture has become necessary to slow the increase and reduce CO 2 levels in the atmosphere. Point source emissions have a wide range of CO 2 concentrations, but emissions below 3% CO 2 have mostly been ignored because Carbon capture from these sources has been viewed as costly and economically unsustainable. Membrane technologies are considered the most viable solution by virtue of more energy-efficient operation. Our group at Idaho National Laboratory (INL) has developed poly[bis((2-methoxyethoxy)ethoxy)phosphazene] (MEEP)-based carbon dioxide selective membranes with CO 2 /N 2 selectivity greater than 40 and CO 2 permeability greater than 450 Barrer. To understand the economics of carbon capture, a spreadsheet-based techno-economic analysis (TEA) model was developed to consider multiple parameters, including selectivity and permeability of the membranes, performance conditions such as the number of stages, module material, electricity price, membrane price, and capital financing. The cost of carbon capture in US $\$$/metric ton was calculated at various purities and compared with other membrane processes, cryogenic capture, solvent-based capture, and pressure swing adsorption-based capture. It was determined that a MEEP-based three-stage process had a capture cost of US $\$$ 50.1/metric ton for 99.8% purity CO 2 from a 1% CO 2 feed source in nitrogen (N 2 ). In conclusion, the capture cost using the best performing Pebax-based membrane was 464% higher, cryogenic capture was 60%–140% higher, pressure swing adsorption was 55%–165% higher, and chemical absorption was -10%–110% higher than MEEP-based membrane capture, respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Machine learning in nuclear materials research

Nuclear materials are often demanded to function for extended time in extreme environments, including high radiation fluxes with associated transmutations, high temperature and temperature gradients, mechanical stresses, and corrosive coolants. They also have a wide range of microstructural and chemical makeups, resulting in multifaceted and often out-of-equilibrium interactions. Machine learning (ML) is increasingly being used to tackle these complex time-dependent interactions and aid researchers in developing models and making predictions, sometimes with better accuracy than traditional modeling that focuses on one or two parameters at a time. Conventional practices of acquiring new experimental data in nuclear materials research are often slow and expensive, limiting the opportunity for data-centric ML, but new methods are changing that paradigm. Here we review high-throughput computational and experimental data approaches, especially robotic experimentation and active learning that is based on Gaussian process and Bayesian optimization. We show ML examples in structural materials (e.g., reactor pressure vessel (RPV) alloys and radiation detecting scintillating materials) and highlight new techniques of high-throughput sample preparation and characterizations, and automated radiation/environmental exposures and real-time online diagnostics. Herein, this review suggests that ML models of material constitutive relations in plasticity, damage, and even electronic and optical responses to radiation are likely to become powerful tools as they develop. Finally, we speculate on how the recent trends of using natural language processing (NLP) to aid the collection and analysis of literature data, interpretable artificial intelligence (AI), and the use of streamlined scripting, database, workflow management, and cloud computing platforms that will soon make the utilization of ML techniques as commonplace as the spreadsheet curve-fitting practices of today.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Automated descriptor selection, volcano curve generation, and active site determination using the DescMAP software

The material space for catalyst discovery is expansive. Volcano curves are traditionally employed to provide physical insights into optimal catalyst characteristics for new material selection. Their generation lies on a single descriptor picked using expert knowledge. Here we present DescMAP, a Python-based software, to automate the selection of descriptors, the generation of volcano maps, and the identification of active sites for structure-sensitive reactions. Here, we consider traditional energy-based and geometric descriptors for structure-sensitive reactions. DescMAP is integrated with the Virtual Kinetic Laboratory (VLab) to provide multiple functionalities. It inputs spreadsheets or template files for flexibility and outputs interactive graphs for post-processing. We demonstrate its features using the non-oxidative dehydrogenation of ethane to ethylene over (111) closed-packed surfaces and the methane total oxidation over various Pt facets. It can be easily applied to other complex chemistries and achieves quick screening of potential catalysts.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A dataset of eco-evidence tools to inform early-stage environmental impact assessments of hydropower development

The datasets described herein provide the foundation for a decision support prototype (DSP) toolkit aimed at assisting stakeholders in determining evidence of which aspects of river ecosystems have been impacted by hydropower. The DSP toolkit and its application are presented and described in the article “Evidence-based indicator approach to guide preliminary environmental impact assessments of hydropower development” [1]. Development of the DSP and the output for decision support centralize around 42 river function indicators describing the dimensionality of river ecosystems through six main categories: biota and biodiversity, water quality, hydrology, geomorphology, land cover, and river connectivity. Three main tools are represented in the DSP: A science-based questionnaire (SBQ), an environmental envelope model (EEM), and a river function linkage assessment tool (RFLAT). The SBQ is a structured survey-style questionnaire whose objective is to provide evidence of which indicators have been impacted by hydropower. Based on a global literature review, 140 questions were developed from general hypotheses regarding the impacts of dams on rivers. The EEM is a model to predict the likelihood of hydropower impacting indicators based on a several variables. The intended use of the EEM is for situations of new hydropower development where results of the SBQ are incomplete or highly uncertain. The EEM was developed through the compilation of a dataset containing attributes of dams, reservoirs, and geospatial information on environmental concerns, which was combined with data on ecological indicators documented at those sites through literature review. The model operates through 247 “envelopes” and weighting factors, representing the individual effect of each variable on each indicator, all available through spreadsheets. Finally, the RFLAT is a tool to examine causal relationships amongst indicators. Inter-indicator relationships were hypothesized based on literature review and summarized into node and edge datasets to represent the structure of a graphical network. Bayes theorem was used estimate conditional probabilities of inter-indicator relationships based on the output of the SBQ. Nodes and edges were imported into R programming environment to visualize ecological indicator networks. The datasets can be expanded upon and enriched with more detailed questions for the SBQ, building upon the EEM with to develop more sophisticated models, and identifying new relationships for the RFALT. Additionally, once the tools are applied to numerous hydropower developments, the output of the tools (e.g. evidence of impacted indicators) becomes a very useful dataset for meta-analyses of hydropower impacts.

13 HYDRO ENERGY↗
DOE OSTI2025

Determining the profitability of energy storage over its life cycle using levelized cost of storage

Levelized cost of storage (LCOS) can be a simple, intuitive, and useful metric for determining whether a new energy storage plant would be profitable over its life cycle and to compare the cost of different energy storage technologies. However, researchers and industry decision makers still use conflicting definitions of LCOS. For example, some include charging cost, while others only include round trip efficiency (RTE) losses. Additionally, inputs to the existing formulations are not specific enough to generate repeatable results across studies, which reduces trust in the metric. To push for standardization in economic assessment of batteries and other energy storage devices, the authors review existing definitions of LCOS and identify the desired characteristics for a standard. They then propose a new definition and demonstrate that it fits these characteristics very well relative to other prominent options. Unit analysis is applied to this proposed definition to provide a deeper understanding of the equations and to demonstrate its effectiveness. Finally, the sensitivity of LCOS to different input parameters is investigated to help users understand how to compare analyses from literature to their own. The authors also provide a spreadsheet and a Python script to streamline adoption of the proposed definition.

25 ENERGY STORAGE↗
DOE OSTI2024

A Review of the Lawrence Livermore Nuclear Accident Dosimeter 1980s-present

A Nuclear Accident Dosimetry program is a federal requirement for all facilities that have the potential to have a criticality accident. Personnel Nuclear Accident Dosimeter (PNAD) theory and analytical procedures are driven by various scientific needs and interacting regulations. A brief history of the status of USA Department of Energy (DOE) nuclear accident dosimetry regulations, recommendations, and performance testing criteria are given. Then, the history of the Lawrence Livermore National Laboratory (LLNL) PNAD is explored, including changes in the physical dosimeter and adjustments of the analysis method through the last four decades. Finally, the performance of LLNL’s PNAD at criticality accident intercomparison training exercises since 2009 is explored. In general, reported neutron doses have been within or close to DOE-STD-1098 performance criteria while reported gamma doses have been outside of DOE-STD-1098 performance criteria. Reported total absorbed doses have varied in meeting ANSI/HPS N13.3 and ANSI/HPS N13.3 (R2019) performance criteria. Dosimetry staff retirement and turnover have left historical knowledge gaps, yet provided opportunities within the NAD program at LLNL. This review paper serves as an overview of the history and status of the NAD program. Brief technical, procedural and programmatic recommendations to improve LLNL’s NAD program are given. Technical recommendations include investigating orientation factors through modeling or empirical experimentation, investigating gamma dosimetry methods for high-dose scenarios, and exploring other dosimetric methods for simpler, quicker NAD analysis. Procedural recommendations include better documentation of conversion factor (activity-to-fluence and fluence-to-dose) derivations and spectrum uses, and updated analysis spreadsheets or simple Graphic User Interfaces for dose calculations. In conclusion, programmatic recommendations include formalized training for NAD analysts, and having multiple SMEs trained on the NAD program.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

LinkML: an open data modeling framework

Background Scientific research relies on well-structured, standardized data; however, much of it is stored in formats such as free-text lab notebooks, nonstandardized spreadsheets, or data repositories. This lack of structure challenges interoperability, making data integration, validation, and reuse difficult. Findings LinkML (Linked Data Modeling Language) is an open framework that simplifies the process of authoring, validating, and sharing data. LinkML can describe a range of data structures, from flat, list-based models to complex, interrelated, and normalized models that utilize polymorphism and compound inheritance. It offers an approachable syntax that is not tied to any one technical architecture and can be integrated seamlessly with many existing frameworks. The LinkML syntax provides a standard way to describe schemas, classes, and relationships, allowing modelers to build well-defined, stable, and optionally ontology-aligned data structures. Once defined, LinkML schemas may be imported into other LinkML schemas. These key features make LinkML an accessible platform for interdisciplinary collaboration and a reliable way to define and share data semantics. Conclusions LinkML helps reduce heterogeneity, complexity, and the proliferation of single-use data models while simultaneously enabling compliance with FAIR (Findable, Accessible, Interoperable, and Reusable) data standards. LinkML has seen increasing adoption in various fields, including biology, chemistry, biomedicine, microbiome research, finance, electrical engineering, transportation, and commercial software development. In short, LinkML makes implicit models explicitly computable and allows data to be standardized at their origin. LinkML documentation and code are available at https://linkml.io/.

AI-ready data↗
DOE OSTI2021

A Rapid Decision Support Tool for Estimating Impacts of a Vadose Zone Volatile Organic Compound Source on Groundwater and Soil Gas

Diminishing rates of subsurface volatile contaminant removal by soil vapor extraction (SVE) oftentimes warrants an in‐depth performance assessment to guide remedy decision‐making processes. Such a performance assessment must include quantitative approaches to better understand the impact of remaining vadose zone contamination on soil gas and groundwater concentrations. The spreadsheet‐based Soil Vapor Extraction Endstate Tool (SVEET) software functionality has recently been expanded to facilitate quantitative performance assessments. The updated version, referred to as SVEET2, includes expansion of the input parameter ranges for describing a site (site geometry, source characteristics, etc.), an expanded list of contaminants, and incorporation of elements of the Vapor Intrusion Estimation Tool for Unsaturated‐zone Sources software to provide soil gas concentration estimates for use in vapor intrusion evaluation. As part of the update, SVEET2 was used to estimate the impact of a tetrachloroethene (PCE) vadose zone source on groundwater concentrations, comparing SVEET2 results to field‐observed values at an undisclosed site where SVE was recently terminated. PCE concentrations from three separate monitoring wells were estimated by SVEET2 to be within the range of 6.0–6.7 μg/L, as compared to actual field concentrations that ranged from 3 to 11 μg/L PCE. These data demonstrate that SVEET2 can rapidly provide representative quantitative estimates of impacts from a vadose zone contaminant source at field sites. Finally, in the context of the SVE performance assessment, such quantitative estimates provide a basis to support remedial and/or regulatory decisions regarding the continued need for vadose zone volatile organic compound remediation or technical justification for SVE termination, which can significantly reduce the cost to complete for a site.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Methods for Estimating Hydrogen Fuel Tank Characteristics

The pressure vessels needed to store hydrogen for next-generation hydrogen fuel cell vehicles are expected to be a substantial portion of the total system mass, volume, and cost. Gravimetric capacity, volumetric capacity, and cost per kilogram of usable hydrogen are key performance metrics that the U.S. Department of Energy (DOE) uses to determine the viability of hydrogen fuel cell systems. Research and development related to hydrogen storage systems covers a wide range of potential operating conditions, from cryogenic temperatures to high temperatures (above ambient) and low pressure to high pressure. Researchers at PNNL have developed methods for estimating these key pressure vessel characteristics to support on-board hydrogen storage system design and performance evaluation and to support decision-making about DOE hydrogen storage system research investments. This article describes the pressure tank estimation methodology that has been used as a stand-alone calculation and has been incorporated into larger system evaluation tools. The methodology estimates the geometry, mass, and material cost of type I, type III, and type IV pressure vessels based on operating pressure and material strength at the system's operating temperature, using classical thin-wall and thick-wall pressure vessel stress calculations. The geometry, mass, and material cost requirements of the pressure vessel have significant impacts on the total system performance. For example, hydrogen storage materials that can separately achieve a very high hydrogen density can be deemed impractical for use in fuel cell vehicle hydrogen storage systems because the pressure tank containing them is too large, heavy, or expensive. This article describes the design philosophy and analytical process of the tank characteristic estimation methodology, which has been implemented in spreadsheet calculation tools and system-level analysis tools used by DOE researchers. Each of the three tank types (type I, type III, and type IV) uses a different analysis methodology with some common elements. This article also provides examples of implementing the methodology to perform parametric studies of all three pressure vessel types. The goal of this article is to present the methodology in sufficient detail so it can be implemented in other hydrogen fuel cell vehicle design and analysis tools.

42 ENGINEERING↗
DOE OSTI2021

Simulation Dataset - Input files

The input data that are required to run the model are divided into fundamental data and advanced data. The fundamental data are essential to run the model, while the advanced data allow optional model features to be activated. The names of all input data files are to be entered as ASCII characters in a tabular format. Spaces, commas, or tabs can separate numeric fields, the use of any other special visible or hidden characters must be avoided. It may be useful to note that all files are generally read in using standard free-format style FORTRAN READ statements. The input data files can be generated/modified using any standard editor, spreadsheet or word processor (in non-document mode), given that the above guidelines are complied with. However, the inclusion of special formatting characters and the insertion of blank lines must be avoided. The input data files may also be generated through the use of special purpose translation programs that convert the input data files that were initially generated for another traffic simulation or transportation planning model into an INTEGRATION format.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Credibility Framework (CF) v.1.0

Credibility Framework provides tools such as PIRT (Phenomena Identification and Ranking Table) and PCMM (Predictive Capability Maturity Model) configurable by non-programmers through simple Excel spreadsheets for tailoring the credibility process to meet the needs of the analysis provider organizations, customers and regulatory agencies. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525. SAND2020-10230 M

Clay, RobertL.↗
DOE OSTI2020

GHEP WIBT (Guidelines for Home Energy Professionals Weatherization Installer Badges Toolkit) [SWR-20-69]

The National Renewable Energy Laboratory (NREL) and the U.S. Department of Energy's (DOE) Weatherization Assistance Program (WAP) are collaborating with the home energy retrofit industry to support the development of skilled workers. The Installer Badges Toolkit provides a flexible, customizable, and voluntary approach to training and skills recognition for WAP implementers, utility programs, private-sector workers, and contractors. In Fiscal Year 2018, DOE, along with the Crew Leader scheme committee, determined the Retrofit Installer Technician (RIT) Job Task Analysis (JTA) could be eliminated and its tasks inserted in the Crew Leader JTA. The RIT tasks became the basis of the Installer Badges. The Badges Toolkit was updated in 2020 to add licensing and copyright agreements. Users must cite the copyright information when using or distributing copies of the Badges Toolkit in any way. The technical content has remained unchanged from previous versions of the Badges Toolkit. The Toolkit for home retrofits consists of 25 Badges, each representing different energy efficiency tasks that an installer could perform on a home. Each Badge defines the desired outcome, criteria to verify, applicable material requirements, and references to Standard Work Specifications (SWS) or other relevant standards. The Badges provide a consistent approach to training by ensuring that installers in different regions are learning the same skills nationwide. Organizations can also customize the Toolkit by choosing only those Badges that are relevant to their program. The Badges Toolkit includes five pieces: "How to Use the Badges Toolkit" provides a brief overview of how a Grantee, Subgrantee, or training provider may approach using the toolkit. The "Badges Toolkit: Worksheet" includes what to consider when determining whether and how to best incorporate the Badges into a weatherization assistance program. The "Crew Leader Job Task Analysis Spreadsheet" indicates how the Badges align with specific areas of the JTA. The "Installer Badges Passport" features separate pages for each Badge, which include places for the installer and the supervisor/trainer to record the number of times a task has been successfully completed. The "Installer Badges Verification Criteria" includes sample inspection checklists for each Badge. These can be modified as needed based on approved variance requests or more stringent requirements. They also provide a basis for consistent inspections and awarding of Badges. Note: All elements of the Badges Toolkit are designed for use by potential program implementers. They are not off-the-shelf products intended for immediate deployment. Program implementers must review and modify as needed, revise verification criteria to match local requirements, complete worksheets, and otherwise define the parameters of their own badging program.

Desai, Jal↗
DOE OSTI2025

Datum: A Scientific Metadata Catalog

The data catalog market is currently flooded with a myriad of different products, but none serve the scientific community well. There are cloud-native tools like Databricks, Snowflake,to on-premise solutions like Collibra and Datahub. The common failing of all these tools however, is their inability to serve the scientific data community directly. Most catalogs are targeted towards financial, health, or user data - not sensor or scientific domain data. They also prioritize integrations that often don’t exist or are just starting to be used in the scientific realm - all while ignoring common scientific tools and file types. Datum is a catalog which targets the scientific data directly, including the tools and networks in which those tools are used. We work with the producers and consumers of the data where they are, targeting cloud and on-premise with a focus on classified networks. Datum is an Erlang/Elixir application. Technical Features Note: The features listed below are still under development and may change, slightly, upon final delivery of the product. File Formats - Datum has the ability to read additional metadata and provides processing pipelines for the following file formats: Plain Text, PDF, LaTeX, HTML, Open Document Format (.odt), XML, CSV/TSV (and other standard delimiters), OpenDocument Database and Spreadsheets, Geo-Referenced TIFF, Common Data Format, HDF/HDF5, LabView TDMS, Excel, DeltaTables, Parquet, Apache Iceberg, Apache Hudi and many others. Metadata Collection - Scanners for the local and networked file systems and cloud storage providers. Network integration with common databases such as MSSQL and MySQL. User Plugin System - Users are able to provide either file processing, metadata extraction, or sampling plugins in the programming language of their choice. Authentication/Authorization -: OIDC integration, SCIM provisioning and EntraID integration out of the box. Full user and group management system with a “least privilege” operating mode. Governance - Customizable data governance platform; dictate and enforce required metadata, enforce data embargos, and enforce user agreements and NDAs before data access. Ability to create health checks on data, rejecting abandoned or poorly curated data and automatically removing it from the search index. Ability for users to submit corrections. Search - Semantic search is a first class citizen. No licenses to expensive, external software required. Integrated use of vectors and vector-based search allows for AI agent integration at all levels of operation. Metadata Model - Display and control data’s lineage and connections to other data and data directories. Data is modeled after a filesystem - an organization instantly recognizable and navigable by most any user. CLI and SDK - Ships with a Command Line Interface (CLI) tool and with a fully-featured Python SDK. This allows for rapid and programmatic use of Datum by every level of user. Minimal Infrastructure - Datum ships as a single executable file and can be run on any operating system and most CPU architectures. Datum has no reliance on external databases, search indexing tools, or other outside services - and it runs equally well on edge computing devices, cloud services, or in a clustered HPC environment.

darrington, john↗