LLM Information Extraction Toolkit
A modular Python framework for information extraction using large language models with support for multiple backends and optional verification workflows.
Yoon, Hong-Jun [Oak Ridge National Laboratory (ORN↗
SEARCH · Search NASA
Results for “Python toolkit”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Mapped Moments to a Cartesian Grid (MMCG) Value-Added Product Report
Objective analysis (OA) is a method of mapping unstructured data to a structured grid. In the context of scanning radar data, OA is used to interpolate data in antenna coordinates (range, azimuth, and elevation) onto a regularly spaced Cartesian grid (Trapp and Doswell 2000). The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Mapped Moments to a Cartesian Grid (MMCG) Value-Added Product (VAP) uses the Python ARM Radar Toolkit (Py-ART), a data model-driven interactive architecture for working with weather radar data, to map the data to a Cartesian grid (Helmus and Collis 2016). MMCG, with Py-ART built in, has the ability to take radar data in antenna coordinates and map the gates to a Cartesian grid using inverse distance weight functions such as Cressman (square) and Barnes (exponential), but also can filter the data during the interpolation. MMCG also allows arbitrary formulations for the radius of influence, which are matched to particular radar scanning strategies. This creates a complex parameter space for optimizing the retention of storm structure detail while minimizing artifacts. MMCG takes data processed with ARM’s Corrected Precipitation Radar Moments in Antenna Coordinates (CMAC) VAP and maps it to a Cartesian grid as the output product. A variety of fields that have been mapped to the Cartesian grid are then saved to plots to complement each grid file.
54 ENVIRONMENTAL SCIENCES↗
RadTraQ (Radar Tracking and Quality Toolkit
RadTraQ is a python library housing routines related to assessing and monitoring the quality of a radar's quality and calibration. This library is a work in progress, currently housing scripts to plot radar CFADs, plot and analyze corner reflector scans, calculate noise floors, create cloud masks, and plot up average profiles for comparisons.
THEISEN, ADAMK↗
Fat Crayon Toolkit
The Fat Crayon Toolkit (FCT) provides python modules for assisting in the design and visualization of boreholes and tunnels and their relationship with natural features such as fractures. Distances of closest approach among the boreholes can be calculated, along with other key design metrics. Additionally, the shear propensity of natural fractures (either deterministic or stochastic) can be visualized in either 3D (as VTK files) or in 2D (stereonets). The example provided demonstrates a test bed developed for the Enhanced Geothermal Systems (EGS) Collab project. This material is based upon work supported by the Geothermal Office of the Department of Energy and the Sanford Underground Research Facility and was prepared by LLNL under Contract DE-AC52-07NA27344.
Morris, JosephP.↗
The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data
The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.
54 ENVIRONMENTAL SCIENCES↗
The Satellite Image Simulation Toolkit
The Satellite Image Simulation Toolkit (SatIST) is a python software package designed to generate diverse and realistic satellite imaging scenarios. It serves as a toolkit for simulating data that supports the development and testing of algorithms used in satellite detection, calibration, and characterization. SIST provides a suite of simulation tools that allow users to replicate various satellite observation conditions, including sidereal and target tracking. By enabling the creation of scenarios that mimic real-world satellite operations, SIST facilitates advancements in satellite image data processing and the study of satellite behavior under different observational parameters.
Perloff, AlexxS [Lawrence Livermore National Labor↗
GAT (Grid Analysis Toolkit) [SWR-25-41]
Grid Analysis Toolkit (GAT) is a unified Python API and plotting for power system PCM and CEM results (Sienna, PLEXOS, ReEDS™). It's a toolkit for wrangling data for Bulk Grid Dispatch and Transmission Analysis. GAT aims to provide simplified access to PCM and CEM results in a standard format while also allowing raw data access to underlying datasets specific to the model. This software can also be found on PyPI at For plotting, GAT defaults to standard National Lab of the Rockies (NLR) color schemes and standard styles while allowing customization.
Webb, Micah [National Laboratory of the Rockies (N↗
hfem3d_parfrac
A toolkit of FORTRAN90 and PYTHON routines to automate calculation of electrostatic response of fracture networks in geomaterials, specifically designed for distributed memory compute clusters. Software integrates pre-processing of Cubit-generated meshes with calculations from HFEM3D and post-processing for aggregate data analysis.SAND2019-11083 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Beskardes, Gungor↗
VAST: the Void Analysis Software Toolkit
Voids are expansive regions in the universe containing significantly fewer galaxies than surrounding galaxy clusters and filaments. They are a fundamental feature of the cosmic web and provide important information about galaxy physics and cosmology. For example, correlations between voids and luminous tracers of large-scale structure improve constraints on the expansion of the universe as compared to using tracers alone, and numerous studies have shown that the void environment influences the evolution of galaxies. However, what constitutes a void is vague and formulating a concrete definition to use in a void-finding algorithm is not trivial. As a result, several different algorithms exist to identify these cosmic underdensities. Our Void Analysis Software Toolkit, or VAST, provides Python 3 implementations of two such algorithms: VoidFinder and V 2 . This consolidation of two popular void-finding algorithms allows the user to, for example, easily compare the results of their analysis using different void definitions.
97 MATHEMATICS AND COMPUTING↗
Uncertainty in master-equation-based rate coefficient calculations
Rate coefficients are key quantities in gas phase kinetics and can be determined theoretically via master equation (ME) calculations. Rate coefficients characterize how fast a certain chemical species reacts away due to collisions into a specific product. Some of these collisions are simply transferring energy between the colliding partners, in which case the initial chemical species can undergo a unimolecular reaction: dissociation or isomerization. Other collisions are reactive, and the colliding partners either exchange atoms, these are direct reactions, or form complexes that can themselves react further or get stabilized by deactivating collisions with a bath gas. The input of MEs are molecular parameters: geometries, energies, and frequencies determined from ab initio calculations. While the calculation of these rate coefficients using ab initio data is becoming routine in many cases, the determination of the uncertainties of the rate coefficients are often ignored, sometimes crudely assessed by varying independently just a few of the numerous parameters, and only occasionally studied in detail. In this study, molecular frequencies, barrier heights, well depths, and imaginary frequencies (needed to calculate quantum mechanical tunneling) were automatically perturbed in an uncorrelated fashion. Our Python tool, MEUQ, takes user requests to change all or specified well, barrier, or bimolecular product parameters for a reaction. We propagate the uncertainty in these input parameters and perform global sensitivity analysis in the rate coefficients for the ethyl + O 2 system using state-of-the-art uncertainty quantification (UQ) techniques via Python interface to UQ Toolkit (www . sandia.gov/uqtoolkit). A total of 10,000 sets of rate coefficients were collected after perturbing 240 molecular parameters. With our methodology, sensitive mechanistic steps can be revealed to a modeler in a straightforward manner for identification of significant and negligible influences in bimolecular reactions.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Uncertainty in master-equation-based rate coefficient calculations
Rate coefficients are key quantities in gas phase kinetics and can be determined theoretically via master equation (ME) calculations. Rate coefficients characterize how fast a certain chemical species reacts away due to collisions into a specific product. Some of these collisions are simply transferring energy between the colliding partners, in which case the initial chemical species can undergo a unimolecular reaction: dissociation or isomerization. Other collisions are reactive, and the colliding partners either exchange atoms, these are direct reactions, or form complexes that can themselves react further or get stabilized by deactivating collisions with a bath gas. The input of MEs are molecular parameters: geometries, energies, and frequencies determined from ab initio calculations. While the calculation of these rate coefficients using ab initio data is becoming routine in many cases, the determination of the uncertainties of the rate coefficients are often ignored, sometimes crudely assessed by varying independently just a few of the numerous parameters, and only occasionally studied in detail. In this study, molecular frequencies, barrier heights, well depths, and imaginary frequencies (needed to calculate quantum mechanical tunneling) were automatically perturbed in an uncorrelated fashion. Our Python tool, MEUQ, takes user requests to change all or specified well, barrier, or bimolecular product parameters for a reaction. We propagate the uncertainty in these input parameters and perform global sensitivity analysis in the rate coefficients for the ethyl + O 2 system using state-of-the-art uncertainty quantification (UQ) techniques via Python interface to UQ Toolkit (www.sandia.gov/uqtoolkit). A total of 10,000 sets of rate coefficients were collected after perturbing 240 molecular parameters. With our methodology, sensitive mechanistic steps can be revealed to a modeler in a straightforward manner for identification of significant and negligible influences in bimolecular reactions.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
The Impact of Void-finding Algorithms on Galaxy Classification
We explore how the definition of a void influences the conclusions drawn about the impact of the void environment on galactic properties using two void-finding algorithms in the Void Analysis Software Toolkit: Voronoi Voids (V 2 ), a Python implementation of ZOnes Bordering On Voidness (ZOBOV); and VoidFinder, an algorithm that grows and merges spherical void regions. Using the Sloan Digital Sky Survey Data Release 7, we find that galaxies found in VoidFinder voids tend to be bluer and fainter and to have higher (specific) star formation rates than galaxies in denser regions. Conversely, galaxies found in V 2 voids show less significant differences when compared to galaxies in denser regions, less consistent with the large-scale environmental effects on galaxy properties expected from both simulations and previous observations. These results align with previous simulation results that show V 2 -identified voids “leak” into the dense walls between voids because their boundaries extend up to the density maxima in the walls. As a result, when using ZOBOV-based void-finders, galaxies likely to be part of wall regions are instead classified as void galaxies, a misclassification that can be critical to our understanding of galaxy evolution.
cosmic web↗
PyDDA: A Pythonic Direct Data Assimilation Framework for Wind Retrievals
This software assimilates data from an arbitrary number of weather radars together with other spatial wind fields (eg numerical weather forecasting model data) in order to retrieve high resolution three dimensional wind fields. PyDDA uses NumPy and SciPy’s optimization techniques combined with the Python Atmospheric Radiation Measurement (ARM) Radar Toolkit (Py-ART) in order to create wind fields using the 3D variational technique (3DVAR). PyDDA is hosted and distributed on GitHub at https://github.com/openradar/PyDDA. PyDDA has the potential to be used by the atmospheric science community to develop high resolution wind retrievals from radar networks. These retrievals can be used for the evaluation of numerical weather forecasting models and plume modelling. This paper shows how wind fields from 2 NEXt generation RADar (NEXRAD) WSR-88D radars and the High Resolution Rapid Refresh can be assimilated together using PyDDA to create a high resolution wind field inside Hurricane Florence.
54 ENVIRONMENTAL SCIENCES↗
sympl (v. 0.4.0) and climt (v. 0.15.3) – towards a flexible framework for building model hierarchies in Python
sympl (System for Modelling Planets) andclimt (Climate Modelling and Diagnostics Toolkit) are anattempt to rethink climate modelling frameworks from the ground up. The aimis to use expressive data structures available in the scientific Pythonecosystem along with best practices in software design to allow scientists toeasily and reliably combine model components to represent the climate systemat a desired level of complexity and to enable users to fully understandwhat the model is doing. sympl is a framework which formulates the model in terms of astate that gets evolved forward in time or modified within a specifictime by well-defined components. sympl's design facilitates buildingmodels that are self-documenting, are highly interoperable, and providefine-grained control over model components and behaviour. symplcomponents contain all relevant information about the input they expect andoutput that they provide. Components are designed to be easily interchanged,even when they rely on different units or array configurations.sympl provides basic functions and objects which could be used inany type of Earth system model. climt is an Earth system modelling toolkit that contains scientificcomponents built using sympl base objects. These include both purePython components and wrapped Fortran libraries. climt providesfunctionality requiring model-specific assumptions, such as stateinitialization and grid configuration. climt's programming interfacedesigned to be easy to use and thus appealing to a wide audience. Model building, configuration and execution are performed through a Pythonscript (or Jupyter Notebook), enabling researchers to build an end-to-endPython-based pipeline along with popular Python data analysis andvisualization tools.
97 MATHEMATICS AND COMPUTING↗
Panel-Segmentation: A Python Package for Automated Solar Array Metadata Extraction Using Satellite Imagery
The NREL Python Panel-Segmentation package is a toolkit that automates the process of extracting accurate and valuable metadata related to solar array installations, using publicly available Google Maps satellite imagery. Previously published work includes automated azimuth estimation for individual solar installations in satellite images. Our continued research focuses on automated detection and classification of solar installation mounting configuration (tracking or fixed-tilt; rooftop, ground, or carport). Specifically, a Faster-RCNN Resnet-50 feature pyramid network (FPN) model was trained and validated on 862 manually labeled satellite images. This model was used to perform object detection on satellite imagery, locating and classifying individual solar installations' mounting configuration and type. Model results showed a mean average precision score (mAP) of 77.79%, with the model strongest at detecting fixed-tilt ground mount and fixed-tilt carport installations. The object detection model and its outputs have been incorporated into the Panel-Segmentation package's automated metadata extraction pipeline, which returns the mounting configuration and azimuth for individual solar arrays in satellite imagery. The complete image data set with labels has been released on the U.S. Department of Energy (DOE) DuraMAT DataHub, to encourage further research in this area.
deep learning↗
DFTTK: Density Functional Theory ToolKit for high-throughput lattice dynamics calculations
In this work, we present a software package in Python for high-throughput first-principles calculations of thermodynamic properties at finite temperatures, which we refer to as DFTTK (Density Functional Theory ToolKit). DFTTK is based on the atomate package and integrates our experiences in the last decades on the development of theoretical methods and computational softwares. It includes task submissions on all major operating systems and task executions on high-performance computing environments. Furthermore, the distribution of the DFTTK package comes with examples of calculations of phonon density of states, heat capacity, entropy, enthalpy, and free energy under the quasi-harmonic phonon scheme for the stoichiometric phases of Al, Ni, Al 3 Ni, AlNi, AlNi 3 , Al 3 Ni 4 , and Al 3 Ni 5 , and the fcc solution phases treated using the special quasirandom structures at the compositions of Al 3 Ni, AlNi, and AlNi 3 .
97 MATHEMATICS AND COMPUTING↗
Likeness: a toolkit for connecting the social fabric of place to human dynamics
The ability to produce richly-attributed synthetic populations is key for understanding human dynamics, responding to emergencies, and preparing for future events, all while protecting individual privacy. The Likeness toolkit accomplishes these goals with a suite of Python packages: pymedm/pymedm\_legacy, livelike, and actlike. This production process is initialized in pymedm (or pymedm\_legacy) that utilizes census microdata records as the foundation on which disaggregated spatial allocation matrices are built. The next step, performed by livelike, is the generation of a fully autonomous agent population attributed with hundreds of demographic census variables. The agent population synthesized in livelike is then attributed with residential coordinates in actlike based on block assignment and, finally, allocated to an optimal daytime activity location via the street network. We present a case study in Knox County, Tennessee, synthesizing 30 populations of public K–12 school students \& teachers and allocating them to schools. Validation of our results shows they are highly promising by replicating reported school enrollment and teacher capacity with a high degree of fidelity.
Tuccillo, Joe↗