Search NASA⌕ Search

SEARCH · Search NASA

Results for “proxy data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Data to Accompany: PM2.5 is insufficient to explain personal PAH exposure

Fine particulate matter (PM2.5) air quality index (AQI) data from outdoor stationary monitors and Hazard Mapping System (HMS) smoke density data from satellites are often used as proxies for personal chemical exposure. Silicone wristbands can quantify more individualized exposure data than stationary air monitors or smoke satellites. However, it is not understood how these proxy measurements compare to chemical data measured from wristbands. We hypothesized that predictive models for personal chemical exposure would be significantly improved by expanding beyond stationary PM2.5 AQI data or satellite HMS data to also include environmental and behavioral information. In Eugene, Oregon, participants wore daily wristbands, carried a phone that recorded locations, and answered daily questionnaires for a seven-day period in multiple seasons. We gathered publicly available daily PM2.5 AQI data and HMS data. We analyzed wristbands for 94 organic chemicals, including 53 polycyclic aromatic hydrocarbons (PAHs). Wristband chemical detections and concentrations, behavioral variables (e.g., time spent indoors), and environmental conditions (e.g., PM2.5 AQI) significantly differed between seasons. Machine learning models were fit to predict personal chemical exposure using PM2.5 AQI only, HMS only, and a multivariate feature set including PM2.5 AQI, HMS, and other environmental and behavioral information. On average, the multivariate models increased predictive accuracy by approximately 70% compared to either the AQI model or the HMS model for all chemicals modeled. This study provides evidence that PM2.5 AQI data alone or HMS data alone is insufficient to explain personal chemical exposures. Our results identify additional key predictors of personal chemical exposure.

Bramer, Lisa M↗

Clumped isotope constraints on changes in latest Pleistocene hydroclimate in the northwestern Great Basin: Lake Surprise, California

Abstract During the Last Glacial Maximum (LGM) and subsequent deglaciation, the Great Basin in the southwestern United States was covered by numerous extensive closed-basin lakes, in stark contrast with the predominately arid climate observed today. This transition from lakes in the Late Pleistocene to modern aridity implies large changes in the regional water balance. Whether these changes were driven by increased precipitation rates due to changes in atmospheric dynamics, decreased evaporation rates resulting from temperature depression and summer insolation changes, or some combination of the two remains uncertain. The factors contributing to these large-scale changes in hydroclimate are critical to resolve, given that this region is poised to undergo future anthropogenic-forced climate changes with large uncertainties in model simulations for the 21st century. Furthermore, there are ambiguous constraints on the magnitude and even the sign of changes in key hydroclimate variables between the Last Glacial Maximum and the present day in both proxy reconstructions and climate model analyses of the region. Here we report thermodynamically derived estimates of changes in temperature, precipitation, and evaporation rates, as well as the isotopic composition of lake water, using clumped isotope data from an ancient lake in the northwestern Great Basin, Lake Surprise (California). Compared to modern climate, mean annual air temperature at Lake Surprise was 4.7 °C lower during the Last Glacial Maximum, with decreased evaporation rates and similar precipitation rates to modern. During the mid-deglacial period, the growth of Lake Surprise implied that the lake hydrologic budget briefly departed from steady state. Our reconstructions indicate that this growth took place rapidly, while the subsequent lake regression took place over several thousand years. Using models for precipitation and evaporation constrained from clumped isotope results, we determine that the disappearance of Lake Surprise coincided with a moderate increase in lake temperature, along with increasing evaporation rates outpacing increasing precipitation rates. Concomitant analysis of proxy data and climate model simulations for the Last Glacial Maximum are used to provide a robust means to understand past climate change, and by extension, predict how current hydroclimates may respond to expected future climate forcings. We suggest that an expansion of this analysis to more basins across a larger spatial scale could provide valuable insight into proposed climate forcings, and aid in climate model process depiction. Ultimately, our analysis highlights the importance of temperature-driven evaporation as a mechanism for lake growth and retreat in this region.

Geology↗

Validation of Deterministic Broadband Ground Motion and Variability from Dynamic Rupture Simulations of Buried Thrust Earthquakes

According to the article, we numerically model broadband ground motion (up to 5–7.5 Hz⁠) from blind‐thrust scenario earthquakes matching the fault geometry of the 1994 Mw 6.7 Northridge earthquake. Several realizations are modeled (by varying the hypocenter location in the dynamic rupture simulation) in a 1D‐layered velocity profile. In addition, we include Q(f )⁠, nonlinear effects from Drucker–Prager plasticity, and superimpose small‐scale medium complexity in both a 1D‐layered and 3D velocity model within the subsequent wave propagation. We investigate characteristics of the ground motion and its variability up to 50 km from the fault by comparing them with ground‐motion prediction equations (GMPEs), simple proxy metrics, as well as strong ground motion records from the Northridge event. We find that median ground motion closely follows the trend predicted by GMPEs and that the intraevent standard deviation, although varying with hypocenter location, lies near that of GMPE models. Plasticity affects ground‐motion amplitudes in regions near the source, reducing intraevent variability above ∼0.5 Hz⁠. Heterogeneity in the velocity structure on both the regional and small scales is needed for the simulated data to match two proxy metrics: the period‐to‐period correlation of spectral acceleration (SA) and the ratio of maximum‐to‐median SA. Although small‐scale heterogeneity has a negligible effect on median SA for this style of rupture, it serves to significantly increase the cumulative absolute velocity, better agreeing with observations. When compared with strong‐motion data, we find that long‐wavelength velocity structure within our deterministic simulations reduces bias at both short and long periods. Finally, synthetic ground motion at both footwall and hanging‐wall sites has no clear dependence on the distance to rupture (at both short and long periods); directivity is likely overpowering any hanging‐wall effect.

Geochemistry & Geophysics↗

Towards self-consistent integrated modeling of the tokamak pedestal, scrape-off layer, and divertor using SOLPS-ITER and EPED

A predictive, self-consistent integrated model of the tokamak edge plasma and neutral system has been developed and validated against experimental data from DIII-D, spanning from the divertor target and scrape-off layer to the top of the pedestal. The model uses the SOLPS-ITER fluid boundary plasma and neutral code to constrain the EPED prediction of the pedestal height and width by taking the separatrix temperature and density calculated from SOLPS as inputs to EPED. An empirical proxy function based on data from a subset of these discharges is then used to infer the ratio of density at the pedestal top to that at the separatrix based on the electron temperature at the divertor target. This allows the density at the top of the pedestal to be provided to EPED as well, so that knowledge of this quantity is no longer required a priori, while SOLPS radial transport coefficients are needed instead. The gas puff rate provided to SOLPS is then a primary model input for this forward model coupling (along with radial transport coefficients, which are kept fixed through each scan in this study). Comparisons with measurements from DIII-D density scans through a range of target conditions find significant pedestal pressure degradation as the density is increased towards detachment in three different divertor configurations, consistent with the experimental data in these ballooning-limited pedestal regimes.

core-edge integration↗

PM 2.5 Is Insufficient to Explain Personal PAH Exposure

To understand how chemical exposure can impact health, researchers need tools that capture the complexities of personal chemical exposure. In practice, fine particulate matter (PM 2.5 ) air quality index (AQI) data from outdoor stationary monitors and Hazard Mapping System (HMS) smoke density data from satellites are often used as proxies for personal chemical exposure, but do not capture total chemical exposure. Silicone wristbands can quantify more individualized exposure data than stationary air monitors or smoke satellites. However, it is not understood how these proxy measurements compare to chemical data measured from wristbands. In this study, participants wore daily wristbands, carried a phone that recorded locations, and answered daily questionnaires for a 7-day period in multiple seasons. We gathered publicly available daily PM 2.5 AQI data and HMS data. We analyzed wristbands for 94 organic chemicals, including 53 polycyclic aromatic hydrocarbons. Wristband chemical detections and concentrations, behavioral variables (e.g., time spent indoors), and environmental conditions (e.g., PM 2.5 AQI) significantly differed between seasons. Machine learning models were fit to predict personal chemical exposure using PM 2.5 AQI only, HMS only, and a multivariate feature set including PM 2.5 AQI, HMS, and other environmental and behavioral information. On average, the multivariate models increased predictive accuracy by approximately 70% compared to either the AQI model or the HMS model for all chemicals modeled. This study provides evidence that PM 2.5 AQI data alone or HMS data alone is insufficient to explain personal chemical exposures. Our results identify additional key predictors of personal chemical exposure.

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

Model Evaluation and Intercomparison of Marine Warm Low Cloud Fractions With Neural Network Ensembles

Abstract Low cloud fractions (LCFs) and meteorological factors (MFs) over an oceanic region containing multiple cloud regimes are examined for three data sets: one Energy Exascale Earth System Model (E3SM) simulation with the default 72‐layer vertical grid (E3SM72), another one with 8‐times vertical resolution via the Framework for Improvement by Vertical Enhancement (E3SM 8), and one with MFs from ERA5 reanalysis and LCFs from the CERES SSF product (ERA5‐SSF). Neural networks (NNs) are trained to capture the relationship between MFs and LCF and to select the best‐performing MF subsets for predicting LCF. NN ensembles are used to (a) confirm the performance of selected MF subsets, (b) to serve as proxy models for each data set to predict LCFs for MFs from all data sets, and (c) to classify MFs into those in shared and uniquely occupied MF subspaces. Overall, E3SM72 and E3SM 8 have large fractions of MFs in shared MF subspace, but less so near the Californian and Peruvian stratocumulus decks. E3SM 8 and ERA5 have small fractions of MFs in shared MF subspace but greater than E3SM72 and ERA5, especially in the Southeast Pacific. The differences in LCFs between three pairs of data sets are decomposed into those associated with the differences in the LCF‐MF relationship and those involving different MFs. Given the same MFs, LCFs produced by E3SM 8 are greater than those produced by E3SM72 but are still different from those in ERA5‐SSF. In general, the shift in MFs dominates the difference in the LCFs.

54 ENVIRONMENTAL SCIENCES↗

Proxy-Based Bayesian Inversion Of Poroelastic Simulations To Interpret Strain Tensor Data Measured During Well Testing

The long runtimes of 3D poroelastic numerical simulators makes it impractical to interpret deformation datasets using many inversion schemes. Recent advances in instrumentation have made it possible to measure the strain tensor during well testing, but the lack of robust inversion methods is limiting the ability to interpret these data. We have developed an inversion workflow that reduces the number of computations required to complete a Bayesian inversion using DREAMzs. The workflow trains a KNN model using output from the poroelastic simulator, and then uses the KNN model as a proxy for the simulator during inversion. The workflow also includes a strategy for ensuring the results from the proxy model converge to the results from the simulator, ensuring the accuracy of the final results. An idealized example configured to represent a well test in a deep aquifer is used to verify that the workflow correctly identifies parameters and characterizes noise. Field data measured using strainmeters during an injection test at an oil reservoir in Oklahoma are used to evaluate performance with a real dataset. The workflow identified 265 history matching solutions out of 1240 total simulation runs (21% acceptance ratio), and the results are used to characterize posterior parameter distribution and evaluate the prediction uncertainty. This approach makes it feasible to invert strain data measured during well testing and this has the potential to improve the characterization of aquifers and reservoirs.

Roudini, Soheil↗

Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with i<24.5 and analyze it in four redshift bins covering 0.15≲z≲1.5. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales k max = 1Mpc –1 , including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a ~3σ detection of lensing magnification in the HSC data. Our results are stable to variations in σ 8 and Ω c and we find constraints that agree well with measurements from Planck and low-redshift probes. Lastly, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift.

79 ASTRONOMY AND ASTROPHYSICS↗

Tomographic Galaxy Clustering with the Subaru Hyper Suprime-Cam First Year Public Data Release

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with $i<24.5$ and analyze it in four redshift bins covering $0.15\lesssim z \lesssim1.5$. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales $k_{\rm max}=1\,{\rm Mpc}^{-1}$, including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a $\sim3\sigma$ detection of lensing magnification in the HSC data. Our results are stable to variations in $\sigma_8$ and $\Omega_c$ and we find constraints that agree well with measurements from Planck and low-redshift probes. Finally, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift. [abridged]

79 ASTRONOMY AND ASTROPHYSICS↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

Recent Developments in Hydrogeologic Applications for Strain Tensor Analyses

Changes in fluid pressure deform porous media and this effect occurs in a variety of hydrogeologic processes, from the change in storage during pumping or injection to fluctuations in water levels caused by barometric pressure. We have developed instruments for measuring small strains in porous media, and we have used the resulting strain data to evaluate well testing, hydraulic fracturing, manual loading at the ground surface, and ambient hydrologic processes, like rainfall and evaporation. A particularly important application is the use of strain tensor data measured at shallow depths to analyze well tests or hydraulic fractures conducted at much greater depths. An early demonstration of this technique was conducted at the North Avant Field north of Tulsa, Oklahoma, where Pennsylvanian sandstone creates a confined aquifer and oil reservoir at a depth of 530m. We have showed that the strains caused by injecting into the aquifer could be measured at a depth of 30m and used to evaluate the properties of the aquifer. We recently expanded the array of strainmeters at the North Avant Field by deploying three more instruments at shallow depth (30m) along with a deep instrument at 520m depth in the winter, 2021. The deep instrument is deployed in shale caprock slightly above the aquifer. To our knowledge, the deep strainmeter at the North Avant Field is the deepest strainmeter ever deployed and this required refining methods originally developed for shallow deployments. The instrument was lowered to depth on oil field tubing and cemented in place using techniques and materials developed for use in oil wells. Optical fiber used to communicate with the instrument was cemented in the annulus on the outside of tubing. This is significant because the techniques we used could readily be extended to greater depth, suggesting that strainmeters can be deployed over a wide range of depths for monitoring critical subsurface processes. For example, it suggests that strainmeters could be deployed through the caprock to monitor for leaks from underlying CO2 storage reservoirs. The strainmeter array at the North Avant Field has been used to characterize deformation during a series of injection tests in the spring and summer, 2021. All the new strainmeters respond to pumping, and the strainmeters we installed earlier also responded. To our knowledge, this is the first application of well testing in a deep aquifer that was monitored by an array of strainmeters—our earlier work used strainmeters at a single location. We are currently analyzing the strain data using an analytical solution, a proxy-based Bayesian inversion algorithm, and other methods. Strainmeter data has also been used to characterize periodic pumping tests by us and Riley Blais. A periodically varying pumping rate causes both hydraulic head and strain signals that vary with the same period as the pumping. The peaks and troughs of the head in monitoring wells lag behind the peaks and troughs of the head in the pumping well, and this lag time increases with distance from the pumping well. The lag time of the pressure and the distance to the monitoring well can be used in a simple analysis to estimate the hydraulic diffusivity of the aquifer. The lag time determined from strain data can be used to estimate aquifer properties using the same analysis that works for the pressure only for strain data measured at particular locations. That is because the strain field in a confining unit advances upward, laterally and then downward even though the pressure in the underlying aquifer only advances laterally, according to our recent simulations. We have field data showing that a small periodic signal superimposed on an injection rate at the North Avant Field will create a periodic strain signal at shallow strainmeters. The field data and the recent simulations suggest that including a periodic component to injection or pumping and then monitoring the resulting strain signal could be a way to monitor the subsurface.

Murdoch, Larry↗

What can surface wind observations tell us about interannual variation in wind energy output?

The past decade of wind power growth was supported by capacity factor improvements and associated cost reductions. But are higher capacity factors a technology success story or, as suggested by recent research, has the influence of technology been overstated by ignoring positive surface wind speed trends? The answer could influence estimates of wind energy's cost and even future deployment rates. We find that US surface wind speed observations imply a 2.6% improvement in capacity factors from 2010 to 2019. Yet newer vintages of wind plants have recorded capacity factors that are ~25% larger than plants built close to 2010. It follows that technological factors and improved site quality, not higher wind speeds, drove most of the improvement in capacity factors. Additionally, we match hundreds of meteorological stations to nearby (< 25 km) wind plants and compare annual estimated generation, based on a function of surface wind speed observations, to annual recorded generation. Researchers rely on this publicly available surface data because measurements co-located with wind plants are generally considered proprietary. Our analysis addresses a research gap: interannual variation in observed surface wind speeds is rarely compared to observed data at wind plant locations and turbine heights. We find that despite its common use for this purpose, generation estimates based on publicly available surface observational data provide a poor proxy for interannual variability in recorded wind generation. These findings suggest that caution is generally needed when researchers use surface wind speed measurements to investigate long-term wind energy trends.

17 WIND ENERGY↗

Seawater pH reconstruction using boron isotopes in multiple planktonic foraminifera species with different depth habitats and their potential to constrain pH and <i>p</i>CO<sub>2</sub> gradients

Boron isotope systematics of planktonic foraminifera from core-top sediments and culture experiments have been studied to investigate the sensitivity ofδ11B of calcite tests to seawater pH. However, our knowledge of the relationship between δ11B and pH remains incomplete for many taxa. Thus, to expand the potential scope of application of this proxy, we report δ11B data for seven different species of planktonic foraminifera from sediment core tops. We utilize a method for the measurement of small samples of foraminifera and calculate the δ11B-calcite sensitivity to pH for Globigerinoides ruber, Trilobus sacculifer (sacc or without sacc), Orbulina universa, Pulleniatina obliquiloculata, Neogloboquadrina dutertrei, Globorotalia menardii, and Globorotalia tumida, including for unstudied core tops and species. These taxa have diverse ecological preferences and are from sites that span a range of oceanographic regimes, including some that are in regions of air–sea equilibrium and others that are out of equilibrium with the atmosphere. The sensitivity of δ11Bcarbonate to δ11Bborate (e.g., Δδ11Bcarbonate/Δδ11Bborate) in core tops is consistent with previous studies for T. sacculifer and G. ruber and close to unity for N. dutertrei, O. universa, and combined deep-dwelling species. Deep-dwelling species closely follow the core-top calibration fo rO. universa, which is attributed to respiration-driven microenvironments likely caused by light limitation and/or symbiont–host interactions. Our data support the premise that utilizing boron isotope measurements of multiple species within a sediment core can be utilized to constrain vertical profiles of pH andpCO2 at sites spanning different oceanic regimes, thereby constraining changes in vertical pH gradients and yielding insights into the past behavior of the oceanic carbon pumps.

54 ENVIRONMENTAL SCIENCES↗

Drought index using micrometeorological data from Embrapa weather station at Adolpho Ducke Reserve in Manaus, Brazil

This dataset includes daily resolution time series data including precipitation, minimum and maximum daily air temperature, and air relative humidity downloaded from the Embrapa InfoClima portal (https://www.cnpaf.embrapa.br/infoclima/), with data for the Adolpho Ducke Reserve climatological station in Manaus, Brazil, for the period of January 1, 1980 to December 31, 2016. Using this precipitation record, a Standardized Precipitation Index (SPI) was calculated and added to the dataset, using daily resolution for 180 day intervals and with 20 years for calibration (1980-1999) and adopting a gamma distribution. These data were applied as a proxy for analyzes of precipitation and SPI for the Manaus ZF2 Research station, located approximately 50 Km North of the Adolpho Ducke Reserve. Data are included in a .csv file, and the text file Drought-Indices-Embrapa-Ducke_met_spi_headers.txt provides descriptions of the data file headers.

54 ENVIRONMENTAL SCIENCES↗

Object Proxy Patterns for Accelerating Distributed Applications

Workflow and serverless frameworks have empowered new approaches to distributed application design by abstracting compute resources. However, their typically limited or one-size-fits-all support for advanced data flow patterns leaves optimization to the application programmer—optimization that becomes more difficult as data become larger. The transparent object proxy, which provides wide-area references that can resolve to data regardless of location, has been demonstrated as an effective low-level building block in such situations. Here we propose three high-level proxy-based programming patterns—distributed futures, streaming, and ownership—that make the power of the proxy pattern usable for more complex and dynamic distributed program structures. We motivate these patterns via careful review of application requirements and describe implementations of each pattern. As a result, we evaluate our implementations through a suite of benchmarks and by applying them in three meaningful scientific applications, in which we demonstrate substantial improvements in runtime, throughput, and memory usage.

Distributed Computing↗

From Edge to HPC: Investigating Cross-Facility Data Streaming Architectures

In this paper, we investigate three cross-facility data streaming architectures, Direct Streaming (DTS), Proxied Streaming (PRS), and Managed Service Streaming (MSS). We examine their architectural variations in data flow paths and deployment feasibility, and detail their implementation using the Data Streaming to HPC (DS2HPC) architectural framework and the SciStream memory-to-memory streaming toolkit on the production-grade Advanced Computing Ecosystem (ACE) infrastructure at Oak Ridge Leadership Computing Facility (OLCF). We present a workflow-specific evaluation of these architectures using three synthetic workloads derived from the streaming characteristics of scientific workflows. Through simulated experiments, we measure streaming throughput, round-trip time, and overhead under work sharing, work sharing with feedback, and broadcast and gather messaging patterns commonly found in AI-HPC communication motifs. Our study shows that DTS offers a minimal-hop path, resulting in higher throughput and lower latency, whereas MSS provides greater deployment feasibility and scalability across multiple users but incurs significant overhead. PRS lies in between, offering a scalable architecture whose performance matches DTS in most cases.

George, Anjus [ORNL] (ORCID:0000000179737061)↗

Hardware assisted fine-grained data movement

A processor includes a task scheduling unit and a compute unit coupled to the task scheduling unit. The task scheduling unit performs a task dependency assessment of a task dependency graph and task data requirements that correspond to each task of the plurality of tasks. Based on the task dependency assessment, the task scheduling unit schedules a first task of the plurality of tasks and a second proxy object of a plurality of proxy objects specified by the task data requirements such that a memory transfer of the second proxy object of the plurality of proxy objects occurs while the first task is being executed.

Hassaan, Muhammad Amber↗

Hardware assisted fine-grained data movement

A processor includes a task scheduling unit and a compute unit coupled to the task scheduling unit. The task scheduling unit performs a task dependency assessment of a task dependency graph and task data requirements that correspond to each task of the plurality of tasks. Based on the task dependency assessment, the task scheduling unit schedules a first task of the plurality of tasks and a second proxy object of a plurality of proxy objects specified by the task data requirements such that a memory transfer of the second proxy object of the plurality of proxy objects occurs while the first task is being executed.

Hassaan, Muhammad Amber↗