Search NASA⌕ Search

SEARCH · Search NASA

Results for “script”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Guidelines for Publicly Archiving Terrestrial Model Data to Enhance Usability, Intercomparison, and Synthesis

Scientific communities are increasingly publishing data to evaluate, accredit, and build on published research. However, guidelines for curating data for publication are sparse for model-related research, limiting the usability of archived simulation data. In particular, there are no established guidelines for archiving data related to terrestrial models that simulate land processes and their coupled interactions with climate. Terrestrial modelers have a unique set of challenges when publishing data due to the diversity of scientific domains, research questions, and the types and scales of simulations. Researchers in the U.S. Department of Energy’s (DOE) projects use a variety of multiscale models to advance robust predictions of terrestrial and subsurface ecosystem processes. Here, we synthesize archiving needs for data associated with different DOE models, and provide guidelines for publishing terrestrial model data components following FAIR (Findable, Accessible, Interoperable, Reusable) principles. The guidelines recommend archiving model inputs and testing data used in final simulation runs along with associated codes, workflow scripts, and metadata in public repositories. Researchers should consider archiving model outputs if they are within the storage limits of the repository. We also provide considerations for how to bundle files into different data publications with citable digital object identifiers. Finally, we identify repository features and tools that would enable storage and reuse of model data. Given the diversity of DOE terrestrial models, these guidelines are transferable to other model types and will enable efficient reuse of simulation data for purposes such as model intercomparisons, initialization, benchmarking, synthesis, and comparisons with field observations.

58 GEOSCIENCES↗
DOE OSTI2018

A Subgrid Approach for Modeling Microtopography Effects on Overland Flow: Modeling Archive

This Modeling Archive is in support of an NGEE Arctic publication. A new subgrid model was implemented in the Advanced Terrestrial simulator (ATS) to capture micro-topography effects on surface flow. Model evaluation was performed on disparate landscapes including: 1) seven individual ice-wedge polygons and a cluster of ice-wedge polygons from Barrow Alaska, 2) hummocky microtopography from Spruce field site in Minnesota, 3) synthetic rills, and 4) synthetic multGaussian realizations. Results of the subgrid model are compared to benchmark (fine-scale) and null hypothesis (model ignoring microtopography). Our finding confirms that the effects of small-scale spatial heterogeneities can be captured in the coarsened models. The dataset contains variety of files including meshes, input files, and subgrid parameters required to run the simulations. Python scripts (jupyter notebooks) for post-processing and files for geometric analyses are also included. More details are provided in file "simulations_info", which has been provided in both .docx and .pdf formats. This dataset is a zip file.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Feedbacks Between Surface Deformation and Permafrost Degradation in Ice Wedge Polygons: Modeling Archive

This Modeling Archive is in support of an NGEE Arctic publication "Feedbacks between surface deformation and permafrost degradation in ice wedge polygons," submitted for review to the Journal of Geophysical Research: Earth Surface. The goals of the study were: 1) to determine how variability in microtopographic conditions (i.e., rim height, trough width, and trough depth) and hydrologic conditions in the trough (i.e., inundated or well-drained) of an ice wedge polygon impact active layer thickness above an ice wedge; and 2) to determine how microtopographic and hydrologic controls on active layer thickness may influence thermokarst trajectories in ice wedge polygon terrain. Toward these objectives, an ensemble of fine-scale simulations of the hydrologic and thermal regimes in ice wedge polygons of variable microtopography was conducted, each polygon being subjected to identical meteorological forcing data, characteristic of the last twenty years near Prudhoe Bay, Alaska. Simulations incorporated solutions of conservation of water and mass at the surface, in the subsurface, and in the snowpack. Active layer thickness in the trough (i.e., above the ice wedge) was extracted from each simulation at the end of a 19 year spin-up, and at the end of a markedly warm summer which followed the spin-up. This archive includes mesh files, meteorological forcing data, and input files needed to reproduce the analysis described in the paper. Due to the large file sizes, raw model output has been omitted. However, post-processing scripts and time series of several variables extracted from the raw output have been included. All data are included in one zipped file with a user guide as a pdf. All simulations were conducted using Amanzi-ATS, v 0.86 (https://doi.org/10.11578/dc.20190911.1).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Leaf Area Index (LAI) of vegetation at the Teller site, Seward Peninsula, Alaska, 2017

Measurements of leaf area index (LAI) at 299 locations on the "tall shrub transect" at the NGEE Arctic Teller field site. Measurements were made on 2017-07-27 using a LiCor LAI-2200. The dataset includes 9 files as dGPS locations, raw measurements, processed data and R script used for processing. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Importance of Freeze/Thaw Cycles on Lateral Transport in Ice-Wedge Polygons: Modeling Archive

This Modeling Archive is in support of an NGEE Arctic publication "The importance of freeze/thaw cycles on lateral transport in ice-wedge polygons". The dataset includes xml input/configuration files. These files are compatible with the ATS version 1.0 and higher. The mesh folder contains mesh files used for high-centered polygon (hcp) and low-centered polygon (lcp). The mesh files represent the transect of the polygonal tundra (Fig 1). Here we used two types of mesh with impermeable layer and without. The mesh with an impermeable layer corresponds to the synthetic permafrost (no freezeup case). The freeze up case uses mesh without impermeable layer to simulated frozen ground start at the same depth where the impermeable layer is for the no freezeup case. The meteorological data used drive the model saved in the "inputs" folder. The processed tracer flow rates are saved in the "tracer-flow-ratesCfolder. To plot figures 1 and 2, we used VisIt software. To plot all the flow rates, we used ipython notebook script. All required inputs are saved in "freezeup" and "no freezeup" folders. Each folder includes the corresponding "lcp" and "hcp" folders. The "freezeup" folder has also flat-centered polygon (fcp) case, low porosity "lpor", and low permeability "lper" cases. Included are *.xml, *.exo, *.h5, *pdf, *.ipynb, *.sh, *.py, and *.out files. NGEE Arctic Project Summary: The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Arctic Soil Patterns Analogous to Fluid Instabilities: Supporting Data

This dataset characterizes solifluction lobe morphology and spatial patterns using pre-existing LiDAR-derived digital elevation models of 25 sites across Norway with accompanying long term climate data for each site. Data were collected as part of an effort to better understand controls on the formation of solifluction patterns and to test the idea that they are analogous to fluid instabilities. We also provide soil velocity profiles and estimates of effective viscosity from across the world, drawn from literature. They were collected to improve our understanding of the rheology of soliflucting soil. See this article for more information on the theoretical motivation behind this dataset see "Arctic soil patterns analogous to fluid instabilities" (Glade et al., 2021). Data files arranged in a hierarchy and include image files *.tif and *.png, GIS shapefiles and geopackages (*.gpkg), *.csv (with same file as *.xlsx), and *.py (Python scripts readable with a text editor). Files also bundled into *.zip files. Note (2021-10-20): unit corrections made on two files: RR.csv and snowfall.csv. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Maps of ice wedge thermokarst pool expansion from twenty-seven circumpolar survey areas

This repository includes data and code to accompany the manuscript 'Topography controls variability in circumpolar permafrost thaw pond expansion' by Abolt et al. The data include satellite imagery and derived maps of thermokarst pools from twenty-seven survey areas in North America and Siberia. The code, written in MATLAB (R2021a), contains demonstrations of the workflow for generating the maps. The demonstrations include training a generalized UNet for mapping thermokarst pools using data from three survey areas, 'fine tuning' the UNet for use at a specific survey area using transfer learning, applying a trained UNet to infer thermokarst pool extent within satellite imagery, and performing histogram matching as a pre-processing step to improve satellite imagery contrast. Contains MATLAB script files and M files, TIF files, shape files, XML, Excel, TXT, and CSV files.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Soil pH Buffering Capacity, Geochemical Characterization, and Soil Water Retention for Arctic Soils of Seward Peninsula and Utqiagvik, Alaska, 2013-2019

This dataset provides pH titration data and soil pH buffering capacities of 21 Arctic soils that were collected between 2013-2019. Geochemical data including soil organic carbon, carbon:nitrogen ratio, initial pH, and gravimetric water content are also reported. Additional measurements of cation exchange capacity and soil water retention (dry range) are presented for selected soils. A script, developed in R, is also included for a simple biogeochemical simulation that incorporates soil pH buffering capacity. This dataset contains 7 csv files and one R script.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Rapidly changing high-latitude seasonality: Implications for the 21st century carbon cycle in Alaska: Modeling Archive

This Modeling Archive is in support of an NGEE Arctic publication "Rapidly changing high-latitude seasonality: Implications for the 21st century carbon cycle in Alaska" DOI: 10.1088/1748-9326/ac4362.The dataset contains "ecosys" model outputs reported in Shirley et al. (2022) that explored how climate warming will shift carbon cycle seasonality in Alaska. The study used analysis of seasonal dynamics to support the prediction that high-latitude ecosystems are carbon sinks and will continue to accumulate carbon throughout the century. The study predicts surprisingly large increases in spring net carbon uptake that result in larger net carbon uptake in spring than in summer by year 2100. Included as *.nc files are modeled daily net ecosystem exchange (NEE), net primary productivity (NPP), heterotrophic respiration (Rh), autotrophic respiration (Ra), gross primary productivity (GPP), and plant nitrogen uptake. The output is provided (1) at 25 km resolution across Alaska; (2) for years 2010 through 2100. Scripts to generate publication figures included as text files (*.m) from MATLAB. A user guide included as *.pdf.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Drying of tundra landscapes will limit subsidence-induced acceleration of permafrost thaw: Modeling Archive

This Modeling Archive is in support of a NGEE Arctic publication in review "Drying of tundra landscapes will limit subsidence-induced acceleration of permafrost thaw". The study used a cryohydrology model to assess the potential risk of abrupt permafrost thaw triggered by melting ground ice, a key open question associated with permafrost response to a warming Arctic. The spatially resolved simulations are for a small catchment 465 ice-wedge polygons in polygonal tundra near Utqiagvik, Alaska in the high-emissions RCP8.5 climate scenario. The simulations are compared to runoff, evapotranspiration and subsidence in the current climate and agree well. The study used the ATS code configured as an intermediate-scale cryohydrology model (Advanced Terrestrial Simulator, Version v2). The archive includes input files for spinup (1985 to 2005) and projections (2006 to 2100 - the manuscript reports 2006 to 2098). Three of the projections include the effects of subsidence and microtopography change with different depth profiles of ice content corresponding to the median, 20th percentile and 80th percentile. The fourth projection has subsidence turnoff and uses the reference case (median) ice content. Spatially averaged or aggregated output variables are included for the projections. Selected checkpoint files for the projections and postprocessing scripts are also included. Files included are *.xml; *.h5; *.exo; *.py; *.sh, *. nb, mesh files, and one file in the original Excel format plus *.csv and *.pdf to conserve formatting contained in the original file. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

NGEE Arctic Rainfall Simulator Validation Data from Los Alamos National Laboratory, New Mexico, Summer 2022

Experiments evaluating the uniformity and intensity of rainfall produced by the NGEE Arctic Rainfall Simulator (NARS) were conducted at Los Alamos National Laboratory, New Mexico, over summer 2022. Petri dishes were placed in a grid within the NARS plot. Simulated rainfall was collected in each petri dish and the intensity and uniformity of the simulator was subsequently calculated. This data package contains two .csv files, one that summarizes the rainfall intensity and uniformity for each experiment, the other that contains individual petri dish water volume and intensity for each plot location and experiment. The Python scripts to control NARS are also included. The NGEE Arctic Rainfall Simulator (NARS) is a variable intensity rainfall simulator (RFS) with a frame design based on the Humphry et al. (2002) RFS and a water delivery system based on the Walnut Gulch (Paige et al., 2004) RFS. The NARS uses an aluminum frame that is fully deconstructable for transportation to field locations and a water system that enables variable rain intensity. Rain intensity control and data collection are automated using a Raspberry Pi microcomputer. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

CLMU Anthropogenic Heat Sensitivity Experiments

User namelist settings, code changes, and driving scripts to set to CLM5 on NERSC for deciphering the sensitivity of urban canopy air temperature to anthropogenic heat flux experiments. More details are available in README.md.

Earth Systems↗
DOE OSTI2022

A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County

The dataset contains hourly Anthropogenic heat (AH) from buildings in Los Angeles County, based on weather data from 2018. The hourly AH is aggregated at three spatial resolutions: 450m x 450m grid, 12km x 12km grid, and census tract. The AH is broken down into three components: building envelope surface convection, heating, ventilation, and air conditioning (HVAC) system heat release, and zone exfiltration and exhaust air heat loss. The dataset is created with the physics-based EnergyPlus building energy models to calculate individual buildings' AH considering WRF-UCM simulated microclimate conditions. Please refer to the paper "A multi-scale time-series dataset of anthropogenic heat from buildings in Los Angeles County" for more information about the data generation workflow and the data validation procedure. The data set contains two folders: the "output_data" folder holds the simulation results (EP_output and EP_output_csv), building metadata (building_metadata.geojson and building_metadata.csv), aggregated heat emission and energy consumption time-series data (hourly_heat_energy), and geographical data (geo_data) associated with the GEOID referenced in heat and energy consumption data. The "input_data" folder contains the raw data used to generate files in the "output_data" folder as well as data sets used in the validation. The code repository (https://github.com/IMMM-SFA/xu_etal_2022_sdata) holds the processing scripts for data curation, validation, and visualization.

Energy↗
DOE OSTI2023

CLMU Interactions between UHIs and HWs Experiments

User namelist settings, code changes, and driving scripts to set to CLM5 on NERSC for investigating the interactions between urban heat islands (UHI) and heat waves (HWs) at the continental and daily mean scales over the Contiguous United States (CONUS). More details are available in README.md.

Climate Change↗
DOE OSTI2024

Synthetic Streamflow Datasets to Support Emulation of Water Allocations via LSTM

This archive is the data companion to the bonney_et-al_2026_erc metarepo which generates synthetic data, trains an LSTM model, and generates performance metrics on the trained model. While the generation of the synthetic data is fully reprodicible, it is a computationally expensive process. This data archive contains the synthetic datasets needed for training and testing an LSTM model and reproduction of figures and tables. In addition, supplemenatary data products generating and visualizing results is also included, such as geospatial data for the basin. Contents There are two high level directories: `WRAP_archive/` and `repo_data/`. The `WRAP_archive` directory contains compressed intermediate dataproducts from the dataset generation workflow (marked as "I_Dataset_Generation" in the metarepo). These data products are not required by any scripts in the metarepo, but they are archived as they are expensive to generate and may have useful information for other analyses. The `repo_data` directory contains the necessary data for reproducing the workflow in the metarepo and should be decompressed and moved into the top level of the metarepo. Additional details are provided in README.md.

drought↗
DOE OSTI2024

HarDWR - Harmonized Water Rights Records

A dataset within the Harmonized Database of Western U.S. Water Rights (HarDWR). For a detailed description of the database, please see the meta-record v2.0. Changelog v2.0 - Recalculated based on data sourced from WestDAAT - Changed using a Site ID column to identify unique records to using aa combination of Site ID and Allocation ID - Removed the Water Management Area (WMA) column from the harmonized records. The replacement is a separate file which stores the relationship between allocations and WMAs. This allows for allocations to contribute to water right amounts to multiple WMAs during the subsequent cumulative process. - Added a column describing a water rights legal status - Added "Unspecified" was a water source category - Added an acre-foot (AF) column - Added a column for the classification of the right's owner v1.02 - Added a .RData file to the dataset as a convenience for anyone exploring our code. This is an internal file, and the one referenced in analysis scripts as the data objects are already in R data objects. v1.01 - Updated the names of each file with an ID number less than 3 digits to include leading 0s v1.0 - Initial public release Description Here we present an updated database of Western U.S. water right records. This database provides consistent unique identifiers for each water right record, and a consistent categorization scheme that puts each water right record into one of seven broad use categories. These data were instrumental in conducting a study of the multi-sector dynamics of inter-sectoral water allocation changes though water markets (Grogan et al., *in review*). Specifically, the data were formatted for use as input to a process-based hydrologic model, Water Balance Model (WBM), with a water rights module (Grogan et al., *in review*). While this specific study motivated the development of the database presented here, water management in the U.S. West is a rich area of study (e.g., Anderson and Woosly, 2005; Tidwell, 2014; Null and Prudencio, 2016; Carney et al., 2021) so releasing this database publicly with documentation and usage notes will enable other researchers to do further work on water management in the U.S. West. We produced the water rights database presented here in four main steps: (1) data collection, (2) data quality control, (3) data harmonization, and (4) generation of cumulative water rights curves. Each of steps (1)-(3) had to be completed in order to produce (4), the final product that was used in the modeling exercise in Grogan et al. (*in review*). All data in each step is associated with a spatial unit called a Water Management Area (WMA), which is the unit of water right administration utilized by the state in which the right came from. Steps (2) and (3) required use to make assumptions and interpretation, and to remove records from the raw data collection. We describe each of these assumptions and interpretations below so that other researchers can choose to implement alternative assumptions an interpretation as fits their research aims. Motivation for Changing Data Sources The most significant change has been a switch from collecting the raw water rights directly from each state to using the water rights records presented in WestDAAT, a product of the Water Data Exchange (WaDE) Program under the Western States Water Council (WSWC). One of the main reasons for this is that each state of interest is a member of the WSWC, meaning that WaDE is partially funded by these states, as well as many universities. As WestDAAT is also a database with consistent categorization, it has allowed us to spend less time on data collection and quality control and more time on answering research questions. This has included records from water right sources we had previously not known about when creating v1.0 of this database. The only major downside to utilizing the WestDAAT records as our raw data is that further updates are tied to when WestDAAT is updated, as some states update their public water right records daily. However, as our focus is on cumulative water amounts at the regional scale, it is unlikely most records updates would have a significant effect on our results. The structure of WestDAAT led to several important changes to how HarWR is formatted. The most significant change is that WaDE has calculated a field known as `SiteUUID`, which is a unique identifier for the Point of Diversion (POD), or where the water is drawn from. This separate from `AllocationNativeID`, which is the identifier for the allocation of water, or the amount of water associated with the water right. It should be noted that it is possible for a single site to have multiple allocations associated with it and for an allocation to be able to be extracted from multiple sites. The site-allocation structure has allowed us to adapt a more consistent, and hopefully more realistic, approach in organizing the water right records than we had with HarDWR v1.0. This was incredibly helpful as the raw data from many states had multiple water uses within a single field within a single row of their raw data, and it was not always clear if the first water use was the most important, or simply first alphabetically. WestDAAT has already addressed this data quality issue. Furthermore, with v1.0, when there were multiple records with the same water right ID, we selected the largest volume or flow amount and disregarded the rest. As WestDAAT was already a common structure for disparate data formats, we were better able to identify sites with multiple allocations and, perhaps more importantly, allocations with multiple sites. This is particularly helpful when an allocation has sites which cross WMA boundaries, instead of just assigning the full water amount to a single WMA we are now able to divide the amount of water between the number of relevant WMAs. As it is now possible to identify allocations with water used in multiple WMAs, it is no longer practical to store this information within a single column. Instead the stAllocationToWMATab.csv file was created, which is an allocation by WMA matrix containing the percent Place of Use area overlap with each WMA. We then use this percentage to divide the allocation's flow amount between the given WMAs during the cumulation process to hopefully provide more realistic totals of water use in each area. However, not every state provides areas of water use, so like HarDWR v1.0, a hierarchical decision tree was used to assign each allocation to a WMA. First, if a WMA could be identified based on the allocation ID, then that WMA was used; typically, when available, this applied to the entire state and no further steps were needed. Second was the spatial analysis of Place of Use to WMAs. Third was a spatial analysis of the POD locations to WMAs, with the assumption that allocation's POD is within the WMA it should belong to; if an allocation still had multiple WMAs based on its POD locations, then the allocation's flow amount would be divided equally between all WMAs. The fourth, and final, process was to include water allocations which spatially fell outside of the state WMA boundaries. This could be due to several reasons, such as coordinate errors / imprecision in the POD location, imprecision in the WMA boundaries, or rights attached with features, such as a reservoir, which crosses state boundaries. To include these records, we decided for any POD which was within one kilometer of the state's edge would be assigned to the nearest WMA. Other Changes WestDAAT has Allowed In addition to a more nuanced and consistent method of assigning water right's data to WMAs, there are other benefits gained from using the WestDAAT dataset. Among those is a consistent categorization of a water right's legal status. In HarDWR v1.0, legal status was effectively ignored, which led to many valid concerns about the quality of the database related to the amounts of water the rights allowed to be claimed. The main issue was that rights with legal status' such as "application withdrawn", "non-active", or "cancelled" were included within HarDWR v1.0. These, and other water rights status' which were deemed to not be in use have been removed from this version of the database. Another major change has been the addition of the "unspecified water source category. This is water that can come from either surface water or groundwater, or the source of which is unknown. The addition of this source category brings the total number of categories to three. Due to reviewer feedback, we decided to add the acre-foot (AF) column so that the data may be more applicable to a wider audience. We added the ownerClassification column so that the data may be more applicable to a wider audience. File Descriptions The dataset is a series of various files organized by state sub-directories. In addition, each file begins with the state's name, in case the file is separate from its sub-directory for some reason. After the state name is the text which describes the contents of the file. Here is each file described in detail. Note that st is a placeholder for the state's name. stFullRecords_HarmonizedRights.csv: A file of the complete water records for each state. The column headers for each of this type of file are: state - The name of the state to which the allocations belong to. FIPS - The two digit numeric state ID code. siteID - The site location ID for POD locations. A site may have multiple allocations, which are the actual amount of water which can be drawn. In a simplified hypothetical, a farm stead may have an allocation for "irrigation" and an allocation for "domestic" water use, but the water is drawn from the same pumping equipment. It should be noted that many of the site ID appear to have been added by WaDE, and therefore may not be recognized by a given state's water rights database. allocationID - The allocation ID for the water right. For most states this is the water right ID, and what is recommended to use should a right be looked up on a given state's water rights database. The water amounts associated with these IDs tend to be finer scaled than those associated with siteID. It should be noted that some allocations may be extracted from multiple sites, particularly for larger Places of Use. ownerClassification - A classification of the types of owners for water rights. The most common is `Private` which incorporates a wide range of entities. Several classifications would be grouped into a government category, most of which are for the U.S. Federal Government. These allocations could be listed as "Federal", "United States of America", or as the names of any number of federal agencies. The last major grouping of entities is for "Native American"s. priorityDate - The date we use as the water right priority date for our modeling analysis. This is the legal priority date when it is available. However, for some rights, specifically from California and New Mexico, we used a pseudo priority date (e.g. well completion date or start of well drilling date) when a legal priority date was not available. The most questionable dates come from New Mexico, where the only date associated with certain water right records was the date the allocation was recorded in the database. As the allocation record creation tended to be within a few months of the filing of the application of the water right, from manually double checking the water rights, and our analysis focuses on aggregating water rights on the timescale of years, we determined it was acceptable to use such dates to include as many records as possible. primaryBeneficialUse - From the numerous state water use categories, WaDE categorized them into 21 categories WestDAAT. This column is the original WaDE category for the primary water use at the PoD site. allocationBeneficialUse - From the numerous state water use categories, WaDE categorized them into 21 categories for WestDAAT. This column is the original WaDE category

Economics↗
DOE OSTI2025

Supporting Information - How Can Crop Production Adapt to growing groundwater restrictions in the West?

Abstract This data plan outlines the structure and content of datasets generated and utilized in the research presented in the manuscript abstract. Groundwater overdraft has led to serious water supply issues in the US West. Most western states manage groundwater use through a permitting system, but California has only recently begun to restrict groundwater use statewide with the 2014 passage of groundwater restrictions which target the elimination of groundwater overdraft practices by 2042. With groundwater extraction curtailed, crop production in the US West (a $95 billion industry annually) will be affected, and appropriate response strategies will be needed to ensure minimal disruption to food production and the regional economy. In this paper, we explore the adoption of alternative adaptive responses: (a) deficit irrigation; (b) switching to less water-intensive crops; (c) changing the extent of irrigated land (including fallowing); and (d) geographically shifting crop production. Employing an integrated modeling approach, we explicitly capture the interactions and feedbacks between local hydrology, changes in crop yields, crop and land use decision-making, changes in crop prices, and regional shifts in crop production. We find that the optimal adaptive response is spatially heterogeneous and comprises a portfolio of strategies. Southwestern states and California will be the most impacted by groundwater restrictions. The optimal responses in these states are to both adopt deficit irrigation strategies and reduce a portion of their irrigated croplands, resulting in a shift in crop production to northwestern states with a larger supply of water. The datasets detailed in this repository represent the output from these integrated models, specifically designed to support the analysis and visualization presented in the manuscript and supplemental information. These datasets, used in conjunction with the scripts available at our associated GitHub repository (https://github.com/pches/Femeena_etal_How_can_crop_production_adapt), enable the reproduction of figures and facilitate a comprehensive understanding of the optimal adaptive strategies in agriculture for mitigating water stress under varying groundwater extraction scenarios, as outlined in the abstract.

DNDCe↗
DOE OSTI2025

Supporting Information - How Can Crop Production Adapt to growing groundwater restrictions in the West?

Abstract This data plan outlines the structure and content of datasets generated and utilized in the research presented in the manuscript abstract. Groundwater overdraft has led to serious water supply issues in the US West. Most western states manage groundwater use through a permitting system, but California has only recently begun to restrict groundwater use statewide with the 2014 passage of groundwater restrictions which target the elimination of groundwater overdraft practices by 2042. With groundwater extraction curtailed, crop production in the US West (a $95 billion industry annually) will be affected, and appropriate response strategies will be needed to ensure minimal disruption to food production and the regional economy. In this paper, we explore the adoption of alternative adaptive responses: (a) deficit irrigation; (b) switching to less water-intensive crops; (c) changing the extent of irrigated land (including fallowing); and (d) geographically shifting crop production. Employing an integrated modeling approach, we explicitly capture the interactions and feedbacks between local hydrology, changes in crop yields, crop and land use decision-making, changes in crop prices, and regional shifts in crop production. We find that the optimal adaptive response is spatially heterogeneous and comprises a portfolio of strategies. Southwestern states and California will be the most impacted by groundwater restrictions. The optimal responses in these states are to both adopt deficit irrigation strategies and reduce a portion of their irrigated croplands, resulting in a shift in crop production to northwestern states with a larger supply of water. The datasets detailed in this repository represent the output from these integrated models, specifically designed to support the analysis and visualization presented in the manuscript and supplemental information. These datasets, used in conjunction with the scripts available at our associated GitHub repository (https://github.com/pches/Femeena_etal_How_can_crop_production_adapt), enable the reproduction of figures and facilitate a comprehensive understanding of the optimal adaptive strategies in agriculture for mitigating water stress under varying groundwater extraction scenarios, as outlined in the abstract.

DNDCe↗