Search NASA⌕ Search

SEARCH · Search NASA

Results for “climate data analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

DOE Cold Climate Heat Pump Challenge Field Validation: Data Collection and Analysis Plan

This document details the data collection, storage, and analysis plan and methodologies for conducting the field validation portion of DOE’s Cold Climate Heat Pump (CCHP) Challenge. The study is focused on validating the in-field heating performance of prototypical CCHPs that have successfully demonstrated that they meet or exceed the Challenge specification in a laboratory setting. The units that have passed laboratory testing will be installed in real homes along with sensors and loggers for monitoring performance over an entire heating season. Data collected through monitoring will be cleaned and stored in a secure database. The data will be analyzed for calculating the key metrics defined by the Challenge including heating capacities at low outdoor air temperatures (below 32 °F), efficiency in terms of the Coefficient of Performance (COP), switchover temperatures and auxiliary heat staging. Demand Response (DR) capabilities will also be tested using specially designed DR events. In most cases, shoulder season and cooling season performance will also be determined and reported.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Finding Tropical Cyclones on a Cloud Computing Cluster: Using Parallel Virtualization for Large-Scale Climate Simulation Analysis

Extensive computing power has been used to tackle issues such as climate changes, fusion energy, and other pressing scientific challenges. These computations produce a tremendous amount of data; however, many of the data analysis programs currently only run a single processor. In this work, we explore the possibility of using the emerging cloud computing platform to parallelize such sequential data analysis tasks. As a proof of concept, we wrap a program for analyzing trends of tropical cyclones in a set of virtual machines (VMs). This approach allows the user to keep their familiar data analysis environment in the VMs, while we provide the coordination and data transfer services to ensure the necessary input and output are directed to the desired locations. This work extensively exercises the networking capability of the cloud computing systems and has revealed a number of weaknesses in the current cloud system software. In our tests, we are able to scale the parallel data analysis job to a modest number of VMs and achieve a speedup that is comparable to running the same analysis task using MPI. However, compared to MPI based parallelization, the cloud-based approach has a number of advantages. The cloud-based approach is more flexible because the VMs can capture arbitrary software dependencies without requiring the user to rewrite their programs. The cloud-based approach is also more resilient to failure; as long as a single VM is running, it can make progress while as soon as one MPI node fails the whole analysis job fails. In short, this initial work demonstrates that a cloud computing system is a viable platform for distributed scientific data analyses traditionally conducted on dedicated supercomputing systems.

97 MATHEMATICS AND COMPUTING↗

Data and code for Daily and Multi-Day Extreme Rainfall Analysis Under Future Climates Using Stochastic Storm Transposition and NEX-GDDP-CMIP6 Over CONUS

This data package provides inputs, codes, and outputs for a comprehensive analysis of projected changes in extreme precipitation across 10 regions of the continental United States, using 34 downscaled Earth System Models (ESMs) from the NASA Earth Exchange Global Daily Downscaled Projections, Coupled Model Intercomparison Project Phase 6 (NEX-GDDP-CMIP6) dataset. These models are part of the Coupled Model Intercomparison Project Phase 6 (CMIP6), a coordinated climate modeling framework widely used to assess climate change impacts. The analysis applies a stochastic storm transposition method to quantify changes in extreme rainfall under two Shared Socioeconomic Pathway (SSP) climate scenarios—SSP2-4.5 (moderate emissions) and SSP5-8.5 (high emissions)—compared to historical conditions (1995–2014 vs. 2081–2100). The dataset includes rainfall depth estimates for extreme events with return periods from 2 to 500 years across multiple storm durations (1, 3, and 5 days) for each of the 10 U.S. regions. Weighted ensemble statistics are derived from individual ESM performance against historical precipitation patterns, enabling robust uncertainty quantification through both sign-based and permutation-test-based model agreement assessments. Key analyses address: (1) relative changes in extreme precipitation for each climate scenario, (2) differences between SSP scenarios (SSP5-8.5 vs. SSP2-4.5), (3) contrasts between rare and frequent events, and (4) variations between multi-day and daily storm durations. The workflow produces ensemble statistics—median, 5th, 25th, 75th, and 95th percentiles—along with model agreement metrics that identify regions and event types with robust climate change signals. The dataset includes: processed rainfall depth outputs (netCDF format) from the RainyDay Python package, ESM weights from historical performance evaluation using DayMet observations, ensemble statistics across all storm dimensions, and figures summarizing key findings.

54 ENVIRONMENTAL SCIENCES↗

Meteorological and Hydrological Drought Analysis Datasets for Livneh, ClimRR, and TGW

The current dataset contains data upload links to the following SPI & SRI drought analysis data over CONUS: Climate Forcing and Simulation Scenario: Livneh (https://www.nature.com/articles/sdata201542): Historical ClimRR (https://climrr.anl.gov/climrrdata): Historical, Mid-Century, End-Century TGW (https://tgw-data.msdlive.org/): Historical, Mid-Century, End-Century Analysis Period: Vary by Climate Forcing Drought Type: Meteorological (Precipitation) and Hydrological (Runoff) Drought (3-Month SRI) Output Format: NetCDF and CSV Spatial Resolution: 1/16th Degree for NetCDF and HUC4 for CSV Temporal Resolution: Monthly

Tidwell, Vincent C [Pacific Northwest National Lab↗

Research, Development and Demonstration of Micro-CHP System for Residential Applications

ECR International and its joint venture company, Climate Energy, are at the forefront of the effort to deliver residential-scale combined heat and power (Micro-CHP) products to the USA market. Part of this substantial program is focused on the development of a new class of steam expanders that offers the potential for significantly lower costs for small-scale power generation technology. The heart of this technology is the scroll expander, a machine that has revolutionized the HVAC refrigerant compressor industry in the last 15 years. The liquid injected cogeneration (LIC) technology is at the core of the efforts described in this report, and remains an excellent option for low cost Micro-CHP systems. ECR has demonstrated in several prototype appliances that the concept for LIC can be made into a practical product. The continuing challenge is to identify economical scroll machine designs that will meet the performance and endurance requirements needed for a long life appliance application. This report describes the numerous advances made in this endeavor by ECR International. Several important advances are described in this report. Section 4 describes a marketing and economics study that integrates the technical performance of the LIC system with real-world climatic data and economic analysis to assess the practical impact that different factors have on the economic application of Micro-CHP in residential applications. Advances in the development of a working scroll steam expander are discussed in Section 5. A rigorous analytical assessment of the performance of scroll expanders, including the difficult to characterize impact of pocket to pocket flank leakage, is presented in Section 5.1. This is followed with an FEA study of the thermal and pressure induced deflections that would result from the normal operation of an advanced scroll expander. Section 6 describes the different scroll expanders and test fixtures developed during this effort. Another key technical challenge to the development of a long life LIC system is the development of a reliable and efficient steam generator. The steam generator and support equipment development is described in Section 7. Just one year ago, ECR International announced through its joint venture company, Climate Energy, that it was introducing to the USA market a new class of Micro-CHP product using the state-of-the-art Honda MCHP gas fired internal combustion (IC) engine platform. We now have installed Climate Energy Micro-CHP systems in 20 pilot demonstration sites for the 2005/2006 heating season. This breakthrough success with IC engine based systems paves the way for future advanced steam cycle Micro-CHP systems to be introduced.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Ten questions on future and extreme weather data for building simulation and analysis in a changing climate

Weather plays a significant role in building operations as it directly influences HVAC loads and in turn the building energy and thermal performance. In a changing climate, future trends and extreme weather events become critical concerns in the global building decarbonization and clean energy transition. This paper aims to address ten key questions concerning extreme and future weather data for building applications, and more importantly to identify research gaps and guide the curation and selection of future and extreme weather data for use in building performance simulation and assessment. The paper intends to inform architects and engineers, operators, owners, policy makers, and other stakeholders on considering the impacts of future and extreme weather data and adopting strategies for selecting and applying this data in various use cases related to building design, operation, and retrofit for energy efficiency, electrification, and climate resilience.

Yan, Da↗

Towards an Open (Data) Science Analytics-Hub for Reproducible Multi-Model Climate Analysis at Scale

Open Science is key to future scientific research and promotes a deep transformation in the whole scientific research process encouraging the adoption of transparent and collaborative scientific approaches aimed at knowledge sharing. Open Science is increasingly gaining attention in the current and future research agenda worldwide. To effectively address Open Science goals, besides Open Access to results and data, it is also paramount to provide tools or environments to support the whole research process, in particular the design, execution and sharing of transparent and reproducible experiments, including data provenance (or lineage) tracking. This work introduces the Climate Analytics-Hub, a new component on top of the Earth System Grid Federation (ESGF), which joins big data approaches and parallel computing paradigms to provide an Open Science environment for reproducible multi-model climate change data analytics experiments at scale. An operational implementation has been set up at the SuperComputing Centre of the Euro- Mediterranean Center on Climate Change, with the main goal of becoming a reference Open Science hub in the climate community regarding the multi-model analysis based on the Coupled Model Intercomparison Project (CMIP).

analytics-hub↗

ARM User Survey Report

The objective of this survey was to obtain user feedback to, among other things, determine how to organize the exponentially growing data within the Atmospheric Radiation Measurement (ARM) Climate Research Facility, and identify users’ preferred data analysis system. The survey findings appear to have met this objective, having received approximately 300 responses that give insight into the type of work users perform, usage of the data, percentage of data analysis users might perform on an ARM-hosted computing resource, downloading volume level where users begin having reservations, opinion about usage if given more powerful computing resources (including ability to manipulate data), types of tools that would be most beneficial to them, preferred programming language and data analysis system, level of importance for certain types of capabilities, and finally, level of interest in participating in a code-sharing community.

54 ENVIRONMENTAL SCIENCES↗

Clumped isotope constraints on changes in latest Pleistocene hydroclimate in the northwestern Great Basin: Lake Surprise, California

Abstract During the Last Glacial Maximum (LGM) and subsequent deglaciation, the Great Basin in the southwestern United States was covered by numerous extensive closed-basin lakes, in stark contrast with the predominately arid climate observed today. This transition from lakes in the Late Pleistocene to modern aridity implies large changes in the regional water balance. Whether these changes were driven by increased precipitation rates due to changes in atmospheric dynamics, decreased evaporation rates resulting from temperature depression and summer insolation changes, or some combination of the two remains uncertain. The factors contributing to these large-scale changes in hydroclimate are critical to resolve, given that this region is poised to undergo future anthropogenic-forced climate changes with large uncertainties in model simulations for the 21st century. Furthermore, there are ambiguous constraints on the magnitude and even the sign of changes in key hydroclimate variables between the Last Glacial Maximum and the present day in both proxy reconstructions and climate model analyses of the region. Here we report thermodynamically derived estimates of changes in temperature, precipitation, and evaporation rates, as well as the isotopic composition of lake water, using clumped isotope data from an ancient lake in the northwestern Great Basin, Lake Surprise (California). Compared to modern climate, mean annual air temperature at Lake Surprise was 4.7 °C lower during the Last Glacial Maximum, with decreased evaporation rates and similar precipitation rates to modern. During the mid-deglacial period, the growth of Lake Surprise implied that the lake hydrologic budget briefly departed from steady state. Our reconstructions indicate that this growth took place rapidly, while the subsequent lake regression took place over several thousand years. Using models for precipitation and evaporation constrained from clumped isotope results, we determine that the disappearance of Lake Surprise coincided with a moderate increase in lake temperature, along with increasing evaporation rates outpacing increasing precipitation rates. Concomitant analysis of proxy data and climate model simulations for the Last Glacial Maximum are used to provide a robust means to understand past climate change, and by extension, predict how current hydroclimates may respond to expected future climate forcings. We suggest that an expansion of this analysis to more basins across a larger spatial scale could provide valuable insight into proposed climate forcings, and aid in climate model process depiction. Ultimately, our analysis highlights the importance of temperature-driven evaporation as a mechanism for lake growth and retreat in this region.

Geology↗

Contributions of the Atmospheric Radiation Measurement (ARM) Program and the ARM Climate Research Facility to the U.S. Climate Change Science Program

The Earth’s surface temperature is determined by the balance between incoming solar radiation and thermal (or infrared) radiation emitted by the Earth back to space. Changes in atmospheric composition, including greenhouse gases, clouds, and aerosols can alter this balance and produce significant climate change. Global climate models (GCMs) are the primary tool for quantifying future climate change; however, there remain significant uncertainties in the GCM treatment of clouds, aerosol, and their effects on the Earth’s energy balance. The 2007 assessment (AR4) by the Intergovernmental Panel on Climate Change (IPCC) reports a substantial range among GCMs in climate sensitivity to greenhouse gas emissions. The largest contributor to this range lies in how different models handle changes in the way clouds absorb or reflect radiative energy in a changing climate (Solomon et al. 2007). In 1989, the U.S. Department of Energy (DOE) Office of Science created the Atmospheric Radiation Measurement (ARM) Program within the Office of Biological and Environmental Research (BER) to address scientific uncertainties related to global climate change, with a specific focus on the crucial role of clouds and their influence on the transfer of radiation in the atmosphere. To address this problem, BER has adopted a unique two-pronged approach: * The ARM Climate Research Facility (ACRF), a scientific user facility for obtaining long-term measurements of radiative fluxes, cloud and aerosol properties, and related atmospheric characteristics in diverse climate regimes. * The ARM Science Program, focused on the analysis of ACRF data to address climate science issues associated with clouds, aerosols, and radiation, and to improve GCMs. This report describes accomplishments of the BER ARM Program toward addressing the primary uncertainties related to climate change prediction as identified by the IPCC.

54 ENVIRONMENTAL SCIENCES↗

Understanding the Evolution of Biomass Burning Particles in the Atmosphere: Analysis of BBOP Data, Laboratory Experiments, and Model Integration

Submicron particles in the atmosphere can have a profound influence on Earth’s climate [Stocker et al., 2013]. Particulate matter (PM) affects climate via both direct effects (scattering or absorption of radiation) and indirect effects (changes to the formation and properties of clouds). Biomass burning (BB) is the largest global source of submicron, carbonaceous particles [Wiedinmyer et al., 2011]. Field campaigns have shown that BB aerosol (BBA) can evolve through rapid transformations and removal processes in the atmosphere, with changing radiative and hygroscopic properties, but these processes are not well characterized. Better understanding of the evolution of biomass burning PM in the atmosphere is critical for improving the accuracy of regional to global climate models. In order to address uncertainties in the initial physical, chemical and radiative forcing of BBA and the evolution of these parameters, DOE ASR conducted an airborne field campaign, the Biomass Burning Observation Project (BBOP), during the summer and fall of 2013 to make measurements in the plumes of northwest U.S. wildfires and southeast U.S. agricultural burns. BBOP provided unique, extremely detailed trace gas and particle measurements in fresh biomass burning plumes and captured large, rapid downwind transformations within a few hours of the sources. These fast changes in properties have also been observed in laboratory-generated BB smoke in a smog chamber, but in general the controlling factors and most likely outcomes in the real atmosphere are still not clear. The goals of this project were to 1) analyze and interpret the BBOP measurements in detail, 2) conduct laboratory experiments to explore the formation of tar balls, and 3) to incorporate our findings into improved models of biomass burning emissions and aging. This research focuses on understanding the chemical, physical and optical properties and transformations of BB emissions in the near-field within hours downwind of the burn and on a more regional scale and, in turn, how BB emissions relate to climate forcing. Analysis of the BBOP data paid particular attention to relating SOA production, changes in size distribution, and mixing state to the environmental conditions (gas-phase precursors, relative humidity, radiation, oxidants, NO x , etc.). This project included subcontracts and unfunded collaborations with many of the key participants in the BBOP campaign. Professor Robert Yokelson at the University of Montana is an expert on biomass burning fuels and emissions and participated in BBOP as an unfunded collaborator. Professor Peter Buseck at Arizona State University collected particle samples during BBOP and analyzed some of them as part of this project. Unfunded collaborators include Dr. Arthur Sedlacek, III at Brookhaven National Laboratory (BNL) and Dr. Rahul Zaveri at the Pacific Northwest National Laboratory (PNNL) who were both principal investigators in the BBOP campaign, focusing on measurements and modeling, respectively. We are also working closely with Prof. Qi Zhang at UC Davis to coordinate analysis of BBOP flight data and data from the Mt. Bachelor Observatory (MBO), and with Dr. Kouji Adachi at the Meteorological Institute (Japan) to analyze laboratory-generated tar ball samples.

09 BIOMASS FUELS↗

Using feature importance as an exploratory data analysis tool on Earth system models

Abstract. Machine learning (ML) models are commonly used to generate predictions, but these models can also support the discovery of new science. Generating accurate predictions necessitates that a model captures the structure of the underlying data. If the structure is properly extracted, ML could be a useful exploratory and evidential tool. In this paper, we present a case study that demonstrates the use of ML for exploratory data analysis (EDA) in the climate space. We apply the ML explainability method of spatiotemporal zeroed feature importance (stZFI) to understand how climate-variable associations evolve over space and time. Our analyses focus on data from ensembles of Earth system models (ESMs) which provide data on different climate states and conditions. We elect to work with ESM ensembles since they allow us to compare feature importance across alternative scenarios not available with observed data. The ensembles also account for natural variability so that we can distinguish between signal and noise due to natural climate variability when computing feature importance. The use of perturbed initial condition ensembles introduces variability mimicking the natural variability in the atmosphere; thus the signals emerging using feature importance (FI) can be evaluated against the natural variability in the climate system. For our analyses, we consider the 1991 volcanic eruption of Mount Pinatubo, which was a large stratospheric aerosol injection. We explore the climate pathway associated with the eruption from aerosols to radiation to temperature at both the near-surface and stratospheric levels. In addition to applying the method to data generated from two different ESMs, we apply stZFI to reanalysis data to compare the associations identified by stZFI. We show how stZFI tracks the importance of aerosol optical depth over time on forecasting temperatures. This case study illustrates usefulness of an ML tool (stZFI) for EDA on a well-studied climate exemplar.

Ries, Daniel (ORCID:0000000250294647)↗

The Quasi-Biennial Oscillation in Model-Simulated and Observed Equatorial Temperature of the Lower Stratosphere

In an otherwise thorough survey of metrics for models that simulate the Quasi-Biennial Oscillation, Schenzinger et al. say “there is no comparable observational dataset” to compare with model-simulated stratospheric temperatures (Geosci. Model Dev. 10, 2157-2168, 2017). They compare model temperatures only with reanalysis datasets, which come from numerical weather prediction models and therefore are not direct observations. But stratospheric brightness temperatures have been directly observed by microwave radiometers on board a series of satellites since 1979. Christy and Drouilhet (J. Climate 7, 106-120, 1994) found a QBO signal in 1979-1992 data from the Microwave Sounding Unit’s lower stratospheric Channel 4 (with peak weighting function at the 75hPa pressure level and half-power values at 120 and 40hPa, about 20±5 km altitude). To detect the QBO signal, Christy and Drouilhet used a latitude weighting that matches the QBO’s anti-correlation between the Equator and ±15°. Fernandez et al. also found a QBO signal in 1979-2000 MSU data, using EOF analysis (J. Climate 17, 3934-3946, 2004). Recently, Christy and Covey extended Christy and Drouilhet’s analysis through 2017 (“Stratospheric Temperature,” Section 2b5 in State of the Climate in 2017. Bull. Amer. Meteor. Soc. 99, S150–S152; Figure 2.10c). The QBO signal was again clearly visible. Although temperature trends for the lower atmosphere are sensitive to inter-satellite calibration and other processing details, giving rise to some controversy, data for the lower stratosphere are more robust. Christy and Covey’s Figure 2.9 shows that data processed separately by the National Oceanic and Atmospheric Administration (NOAA) and by Remote Sensing Systems (RSS) gives a QBO index that is virtually identical to that of Christy’s group at the University of Alabama at Huntsville (UAH).

58 GEOSCIENCES↗

Advance Network Reservation and Provisioning for Science

We are witnessing a new era that offers new opportunities to conduct scientific research with the help of recent advancements in computational and storage technologies. Computational intensive science spans multiple scientific domains, such as particle physics, climate modeling, and bio-informatics simulations. These large-scale applications necessitate collaborators to access very large data sets resulting from simulations performed in geographically distributed institutions. Furthermore, often scientific experimental facilities generate massive data sets that need to be transferred to validate the simulation data in remote collaborating sites. A major component needed to support these needs is the communication infrastructure which enables high performance visualization, large volume data analysis, and also provides access to computational resources. In order to provide high-speed on-demand data access between collaborating institutions, national governments support next generation research networks such as Internet 2 and ESnet (Energy Sciences Network). Delivering network-as-a-service that provides predictable performance, efficient resource utilization and better coordination between compute and storage resources is highly desirable. In this paper, we study network provisioning and advanced bandwidth reservation in ESnet for on-demand high performance data transfers. We present a novel approach for path finding in time-dependent transport networks with bandwidth guarantees. We plan to improve the current ESnet advance network reservation system, OSCARS [3], by presenting to the clients, the possible reservation options and alternatives for earliest completion time and shortest transfer duration. The Energy Sciences Network (ESnet) provides high bandwidth connections between research laboratories and academic institutions for data sharing and video/voice communication. The ESnet On-Demand Secure Circuits and Advance Reservation System (OSCARS) establishes guaranteed bandwidth of secure virtual circuits at a certain time, for a certain bandwidth and length of time. Though OSCARS operates within the ESnet, it also supplies end-to-end provisioning between multiple autonomous network domains. OSCARS gets reservation requests through a standard web service interface, and conducts a Quality-of-service (QoS) path for bandwidth guarantees. Multi-protocol Label Switching (MPLS) and the Resource Reservation Protocol (RSVP) enable to create a virtual circuit using Label Switched Paths (LSP's). It contains three main components: a reservation manager, a bandwidth scheduler, and a path setup subsystem. The bandwidth scheduler needs to have information about the current and future states of the network topology in order to accomplish end-to-end bandwidth guaranteed paths.

97 MATHEMATICS AND COMPUTING↗

Field and Model Data Associated with the Manuscript “Drivers of Streamflow Intermittency in Humid Regions: 2. Evaluating Controls on Flow Persistence in an Urbanized Catchment”

This package contains field data, modeling files, and scripts supporting the investigation of the drivers of streamflow intermittency in an urbanized catchment. It includes the field data collected from electrical resistivity tomography (ERT) surveys, distributed temperature sensing (DTS), continuous self-potential (SP) monitoring, groundwater and stilling well. In addition, it contains the data and results of the coupled water- and electrical-flow model developed using the COMSOL Multiphysics and Advanced Terrestrial Simulator (ATS), as well as software files and Jupyter notebooks used to process the data and generate figures in the manuscript submitted for peer review. The data archive is organized in the following directories: 1) Climate Includes hourly precipitation and daily evapotranspiration time series (2024 – 2025) provided as CSV files, alongside a text file detailing dataset units. 2) Coupled_model Field_Application subfolder contains the ATS XML input scripts, data files, output data for the SP site. It also contains the Jupyter notebook (Plot_final_calib.ipynb) to visualize the results of the modeled SP, stream-groundwater exchange and moisture content. The flow model simulation is executed using the ATS XML scripts and the included Python script (generate_data_set.py) to convert ATS output to COMSOL-ready input. COMSOL Multiphysics template (.m can only be used with COMSOL with MATLAB) is executed using the ATS output data to simulate the potential field. 3) Discharge Includes the electrical conductivity (EC) time series (provided as CSV files) from salt slug injections. It also includes the Jupyter notebook (Discharge_process.ipynyb) used to estimate discharge. All discharge measurements collated into rating_curve_processed.csv 4) DTS Contains collated DTS data including raw Stokes and anti-Stokes measurement (provided as .h5 file). It also includes DTS processing.ipynb, a Jupyter notebook for calibrating the DTS data using dts_calibration Python package. cooler_calibration.csv is the DTS calibration CSV used in the calibration sequence. 5) ERT Contains raw resistivity data (provided as CSV files), spatial location of each of the electrodes (provided as CSV files), and files used for the resistivity inversion. 6) Slug_test Includes the slug test data at all the groundwater wells provided as CSV files, as well as the Jupyter notebook (Slug_test.ipynb) for calculating hydraulic conductivity. 7) SP Contains the SP data collected in field at the SP sites (provided as CSV files). 8) Well_data Contains two subfolders: 1) Raw, which provides unprocessed pressure, electrical conductivity and temperature timeseries downloaded from the loggers in all the groundwater and stilling wells, and 2) Processed, which contains sorted, QA/QC timeseries data for each well. The data archive also contains data_process.ipynb, a Jupyter notebook used for field data analysis and generating figures (plotting well, SP, climate, and discharge data, as well as calculating head gradient at sites with nested groundwater wells). Note: Code files (.ipynb, .py, .xml) can be opened in any standard code editor, .exo file can be viewed using Paraview, .h5 files can be opened using HDFView software and h5py Python package, and .resipy file can be opened with the open-source ResIPy software.

ATS↗

Field and Model Data Associated with the Manuscript “Drivers of Streamflow Intermittency in Humid Regions: 1. Evaluating Above- and Below-ground Controls of Flow Persistence in a Forested Catchment”

This package contains field data, modeling files, and scripts supporting the investigation of the drivers of streamflow intermittency in a forested catchment. It includes the field data collected from electrical resistivity tomography (ERT) surveys, ground penetrating radar (GPR), continuous self-potential (SP) monitoring, electromagnetic (EM) imaging, groundwater and stilling well. In addition, it contains the data and results of the coupled water- and electrical-flow model developed using the COMSOL Multiphysics and Advanced Terrestrial Simulator (ATS), as well as software files and Jupyter notebooks used to process the data and generate figures in the manuscript submitted for peer review. The data archive is organized in the following directories: 1) Climate Includes hourly precipitation and daily evapotranspiration time series (2024 – 2025) provided as CSV files, alongside a text file detailing dataset units. 2) Coupled_model Contains two subfolders: Synthetic and Field_Application subfolder. Synthetic subfolder contains the ATS XML input script (can be opened using any code editor) for the four synthetic hydrological cases tested (Connected and gaining, Connected and losing, Disconnected and losing, and dry stream). It also includes other experimental cases to test the influence of precipitation and concentration gradient. For each synthetic case, the flow model simulation is executed using the ATS XML scripts and the included Python script (generate_data_set.py) to convert ATS output to COMSOL-ready input. COMSOL Multiphysics template (.mph can be opened with the commercial software COMSOL and requires a license) is executed using the ATS output data to simulate the potential field. It also includes the Synthetic_model_plot.ipynb (can be opened using any code editor) to visualize the SP result and generate manuscript figures. The data subfolder contains mesh files to run both the ATS (.exo and .stl files can be viewed using Paraview; .h5 files can be opened using HDFView software and h5py Python package) and COMSOL models. Field_Application subfolder contains two subfolders: ES_MDA_inversion and Final_Model. ES_MDA_inversion contains the Python script (.py can be opened using any code editor) and SP observation data used to run the Ensemble Smoother with Multiple Data Assimilation (ES-MDA) inversion sequence to get the optimal model parameters. The Final_model subfolder contains the ATS XML input scripts, data files, output data for the two SP sites. The same workflow steps outlined for the Synthetic subfolder apply here. It also contains the Jupyter notebook (Plot_final_calib.ipynb) to visualize the results of the modeled SP, stream-groundwater exchange and moisture content. 3) Discharge Includes the electrical conductivity (EC) time series (provided as CSV files) from salt slug injections. It also includes the Jupyter notebook (Discharge_process.ipynyb) used to estimate discharge. All discharge measurements collated into rating_curve_processed.csv 4) EM Contains the CSV file of the EM data from the DUALEM-42, including spatial coordinates (x, y, z), apparent conductivity, and in-phase measurements at 2 m coil separations for horizontal coplanar (HCP) and perpendicular (PRP) geometries. 5) ERT Contains raw resistivity data (provided as CSV files), spatial location of each of the electrodes (provided as CSV files), and files used for the resistivity inversion (.resipy can be opened with the open-source ResIPy software). 6) GPR Includes GPR field datasets collected at 100 MHz and 250 MHz antenna frequencies, along with the processing/interpretation project file (GPR_process.gpz can be viewed using EKKO_Project 6, a commercial software by Sensors & Software that requires a license). 7) Slug_test Includes the slug test data at all the groundwater wells provided as CSV files, as well as the Jupyter notebook (Slug_test.ipynb) for calculating hydraulic conductivity. 8) SP Contains the SP data collected in field at the two SP sites (one in the perennial reach and the other in the intermittent reach), provided as DAT files. 9) Well_data Contains two subfolders: 1) Raw, which provides unprocessed pressure, electrical conductivity and temperature timeseries downloaded from the loggers in all the groundwater and stilling wells, and 2) Processed, which contains sorted, QA/QC timeseries data for each well. The data archive also contains data_process.ipynb, a Jupyter notebook used for field data analysis and generating figures (plotting well, SP, climate, and discharge data, as well as calculating head gradient at sites with nested groundwater wells). It also includes DTW.ipynb, a Jupyter notebook containing the code for the dynamic time warping (DTW) with sliding window to evaluate SP signal synchronicity.

ATS↗