Search NASA⌕ Search

SEARCH · Search NASA

Results for “covariance selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Pursuing Dark Energy with Large Galaxy Redshift Surveys: Baryon Acoustic Oscillations and Beyond (Final Technical Report)

We have developed and applied methods of large-scale structure from galaxy redshift surveys to the study of dark energy. This program supported my group's development of the baryon acoustic method and our participation in the Dark Energy Spectroscopic Instrument (DESI) survey. In addition to my leadership role in the DESI collaboration, my group at Harvard focused on several topics addressing key needs of the DESI science program. 1) We continued our design, validation, and documentation of DESI target selection of the luminous red galaxy and emission-line galaxy samples. 2) We applied simulations from our novel and extremely fast N-body code to make DESI catalogs. With these, we will search for possible systematic shifts in the acoustic scale due to clustering bias with an unprecedented volume of simulations. 3) We extended our method for the fast construction of covariance matrices for correlation functions. 4) We developed new large-scale structure methods, including density-field reconstruction and three-point function analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Divergent controls of soil organic carbon between observations and process-based models

Abstract The storage and cycling of soil organic carbon (SOC) are governed by multiple co-varying factors, including climate, plant productivity, edaphic properties, and disturbance history. Yet, it remains unclear which of these factors are the dominant predictors of observed SOC stocks, globally and within biomes, and how the role of these predictors varies between observations and process-based models. Here we use global observations and an ensemble of soil biogeochemical models to quantify the emergent importance of key state factors – namely, mean annual temperature, net primary productivity, and soil mineralogy – in explaining biome- to global-scale variation in SOC stocks. We use a machine-learning approach to disentangle the role of covariates and elucidate individual relationships with SOC, without imposing expected relationships a priori . While we observe qualitatively similar relationships between SOC and covariates in observations and models, the magnitude and degree of non-linearity vary substantially among the models and observations. Models appear to overemphasize the importance of temperature and primary productivity (especially in forests and herbaceous biomes, respectively), while observations suggest a greater relative importance of soil minerals. This mismatch is also evident globally. However, we observe agreement between observations and model outputs in select individual biomes – namely, temperate deciduous forests and grasslands, which both show stronger relationships of SOC stocks with temperature and productivity, respectively. This approach highlights biomes with the largest uncertainty and mismatch with observations for targeted model improvements. Understanding the role of dominant SOC controls, and the discrepancies between models and observations, globally and across biomes, is essential for improving and validating process representations in soil and ecosystem models for projections under novel future conditions.

58 GEOSCIENCES↗
DOE OSTI2024

Maximum a posteriori Ly α estimator (MAPLE): band power and covariance estimation of the 3D Ly α forest power spectrum

We present a novel maximum a posteriori estimator to jointly estimate band powers and the covariance of the three-dimensional power spectrum (P3D) of Ly $\alpha$ forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Ly $\alpha$ surveys that are sparsely sampled transverse to and densely sampled along the line of sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the current Dark Energy Spectroscopic Instrument; (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e. offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Climate Forcing of Bioenergy Feedstocks: Insights From Carbon and Energy Flux Measurements

Bioenergy from biofuels has the potential to slow growing atmospheric carbon dioxide concentrations by reducing fossil fuel use. However, growing bioenergy feedstocks is a land-intensive process. In the United States, the recent expansion of maize bioethanol has presented some environmental costs, prompting the development of several alternative bioenergy feedstocks. These feedstocks, selected in part for traits associated with ecosystem services, may provide opportunities for environmental benefits beyond fossil fuel displacement. We hypothesized that these bioenergy ecosystems will provide direct climatic cooling through their influence on carbon and radiative energy fluxes (i.e., through albedo). To test this hypothesis, we investigated the potential cooling effect of five current or potential bioenergy feedstocks using multi-year records from eddy covariance towers. Perennial feedstocks were carbon sinks, with an annual mean net ecosystem carbon balance (NECB) of –2.7 ± 2.1 Mg C ha –1 for miscanthus, –0.8 ± 1.1 Mg C ha –1 for switchgrass, and –1.4 ± 0.7 Mg C ha –1 for prairie. In contrast, annual rotations were generally carbon sources, with an annual mean NECB of 2.6 ± 2.4 Mg C ha –1 for maize-soy and 3.2 ± 2.1 Mg C ha –1 for sorghum-soy. Using maize-soy as a baseline, conversion to alternative feedstocks increased albedo, inducing further cooling. This effect was strongest for miscanthus, with –3.5 ± 2.0 W m –2 of radiative forcing, and weakest for sorghum, with –1.4 ± 1.4 W m –2 . When feedstock effects on carbon and albedo were compared using carbon equivalents, carbon fluxes were the stronger ecosystem effect, underscoring the role of perennial species as effective carbon sinks. This work highlights the impact of feedstock choice on ecosystem processes as an element of bioenergy land conversion strategies.

09 BIOMASS FUELS↗
DOE OSTI2021

Autotuning PolyBench benchmarks with LLVM Clang/Polly loop optimization pragmas using Bayesian optimization

Here, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and evaluate their effectiveness. We select six of the most complex PolyBench benchmarks and apply the newly developed LLVM Clang/Polly loop optimization pragmas to the benchmarks to optimize them. We then use the autotuning framework to optimize the pragma parameters to improve their performance. The experimental results show that our autotuning approach outperforms the other compiling methods to provide the smallest execution time for the benchmarks syr2k, 3mm, heat-3d, lu, and covariance with two large datasets in 200 code evaluations for effectively searching the parameter spaces with up to 170,368 different configurations. We find that the Floyd-Warshall benchmark did not benefit from autotuning. To cope with this issue, we provide some compiler option solutions to improve the performance. Then we present loop autotuning without a user's knowledge using a simple mctree autotuning framework to further improve the performance of the Floyd-Warshall benchmark. We also extend the ytopt autotuning framework to tune a deep learning application.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Oak Ridge National Laboratory NCSP Analytical Methods Subtask 3, AMPX Development and Maintenance, and NCSP Nuclear Data Subtask 6, SAMMY Modernization

The modernization of SAMMY continued with consolidation of access to covariance information for adjusted parameters and data in SAMMY. This consolidation allowed for removal of many scratch files. In addition, work was initiated to make the 0K cross section calculation more modular and less dependent on SAMMY global parameters. An initial application programming interface (API) was added to expose cross sections (including resolution broadening) generated by SAMMY to external fitting routines. The processing for thermal moderators in AMPX was updated for selected moderators for which the generated grid was not fine enough. Updated libraries were generated for SCALE. In addition, work continued to fully support new Evaluated Nuclear Data File (ENDF) formats, including the Generalized Nuclear Database Structure (GNDS) in AMPX.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Updraft dynamics and microphysics: on the added value of the cumulus thermal reference frame in simulations of aerosol–deep convection interactions

One fundamental question about atmospheric moist convection processes that remains debated is whether, or under which conditions, a relevant variability in background aerosol concentrations may have a significant dynamical impact on convective clouds and their associated precipitation. Furthermore, current climate models must parameterize both the microphysical and the cumulus convection processes, but this is usually implemented separately, whereas in nature there is a strong coupling between them. As a first step to improve our understanding of these two problems, we investigate how aerosol concentrations modify key properties of updrafts in eight large-eddy-permitting regional simulations of a case study of scattered convection over Houston, Texas, in which convection is explicitly simulated and microphysical processes are parameterized. Dynamical and liquid-phase microphysical responses are investigated using the following two different reference frames: static cloudy updraft grid cells versus tracked cumulus thermals. In both frameworks, we observe the expected microphysical responses to higher aerosol concentrations, such as higher cloud number concentrations and lower rain number concentrations. In terms of the dynamical responses, both frameworks indicate weak impacts of varying aerosol concentrations relative to the noise between simulations over the observationally derived range of aerosol variability for this case study. On the other hand, results suggest that thermals are more selective than cloudy updraft grid cells in terms of sampling the most active convective air masses. For instance, vertical velocity from thermals is significantly higher at upper levels than when sampled from cloudy updraft grid points, and several microphysical variables have higher average values in the cumulus thermal framework than in the cloudy updraft framework. In addition, the thermal analysis is seen to add rich quantitative information about the rates and covariability of microphysical processes spatially and throughout tracked thermal lifecycles, which can serve as a stronger foundation for improving subgrid-scale parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Reproducibility of protein x-ray diffuse scattering and potential utility for modeling atomic displacement parameters

Protein structure and dynamics can be probed using x-ray crystallography. Whereas the Bragg peaks are only sensitive to the average unit-cell electron density, the signal between the Bragg peaks—diffuse scattering—is sensitive to spatial correlations in electron-density variations. Although diffuse scattering contains valuable information about protein dynamics, the diffuse signal is more difficult to isolate from the background compared to the Bragg signal, and the reproducibility of diffuse signal is not yet well understood. We present a systematic study of the reproducibility of diffuse scattering from isocyanide hydratase in three different protein forms. Both replicate diffuse datasets and datasets obtained from different mutants were similar in pairwise comparisons (Pearson correlation coefficient ≥0.8). The data were processed in a manner inspired by previously published methods using custom software with modular design, enabling us to perform an analysis of various data processing choices to determine how to obtain the highest quality data as assessed using unbiased measures of symmetry and reproducibility. The diffuse data were then used to characterize atomic mobility using a liquid-like motions (LLM) model. This characterization was able to discriminate between distinct anisotropic atomic displacement parameter (ADP) models arising from different anisotropic scaling choices that agreed comparably with the Bragg data. Our results emphasize the importance of data reproducibility as a model-free measure of diffuse data quality, illustrate the ability of LLM analysis of diffuse scattering to select among alternative ADP models, and offer insights into the design of successful diffuse scattering experiments.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Reviving the carbon sink: The influence of moderate wind disturbance in a secondary temperate mixed forest

Global forests are increasingly exposed to climate-driven perturbations, which may in turn alter their climate mitigation potential. As tropical cyclones expand poleward due to climate warming, wind disturbances in temperate forests have become increasingly frequent. The consequences of moderate wind disturbances remain poorly understood, hindering efforts to quantify their role in the global carbon cycle. Here, we used 16 years of continuous eddy covariance and biometric measurements to investigate the impacts of moderate wind disturbances on the structure and carbon sink dynamics of a temperate forest in Northeast China. Following Typhoon Maysak in 2020, the mortality of large trees (particularly the aging pioneer species) increased ninefold, whereas that of small trees decreased by nearly half. Both stand basal area and leaf area index were reduced between 2019 and 2023, with aging pioneer tree species being more vulnerable than mid-to-late species to wind disturbances. Shifts in species composition altered the environmental sensitivity of forest carbon sink function. Unexpectedly, wind disturbances reversed the declining trends in net ecosystem production and ecosystem carbon use efficiency of this secondary forest. A novel composite structural indicator—the standardized leaf area index (the maximum leaf area supported by per basal area of the stand)—provided robust predictions (R 2 > 0.4) of carbon sink dynamics throughout the study period. The selective removal of less efficient pioneer trees accelerated succession and reversed the aging-related decline in forest carbon sink strength and carbon use efficiency. In conclusion, these findings highlight the potential role of moderate wind disturbances in enhancing forest carbon sink function and offer a framework for understanding, assessing, and predicting forest carbon dynamics under increasing disturbance frequencies driven by climate change.

Carbon sink↗
DOE OSTI2023

Causal interaction in high frequency turbulence at the biosphere–atmosphere interface: Structural behavior

High-frequency (e.g., 10 Hz) eddy covariance measurements are typically used to estimate fluxes at the land–atmosphere interface at timescales of 15–60 min. These multivariate data contain information about the interdependency at high frequency between the interacting variables such as wind, humidity, temperature, and CO 2⁠ . We use data at 10 Hz from an eddy covariance instrument located at 25 m above agricultural land in the Midwestern US, which offers an opportunity to move beyond the traditional spectral analyses to explore causal dependency among variables. In this study, we quantify the structure of inter-dependencies of interacting variables at high frequency represented by a directed acyclic graph (DAG). We compare DAGs to investigate changes in structural differences in causal interactions. We then apply a distance-based classification and -means clustering approach to identify the evolution of the causal structure represented by a DAG. Our method selects an unbiased number of clusters of similar structures and characterizes the similarities and differences between them. We explore a range of dynamic behavior using data from a clear sky day and during a solar eclipse in 2017. Our results show well-defined clusters of similar causal dependencies as the system evolves. Furthermore, our approach provides a methodological framework to understand how causal dependence in turbulence manifests in high-frequency data when represented through a DAG.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Semi-inclusive deep-inelastic scattering on a polarized spin-1 target. II. Deuteron and spectator nucleon tagging

We develop the theoretical framework for semi-inclusive deep-inelastic scattering on a polarized spin-1 target and apply it to scattering on the polarized deuteron with spectator nucleon tagging. In Part I (previous article), we present the general form of the semi-inclusive cross section and polarization observables for the spin-1 target. In Part II (this article), we consider deep-inelastic scattering on the polarized deuteron with spectator nucleon tagging as a special case of target fragmentation. Methods of light-front quantization are employed to separate nuclear and hadronic structure in the high-energy process and achieve a composite description. The light-front wave function of the polarized deuteron is obtained from a rotationally covariant three-dimensional wave function in the center-of-mass frame of the proton-neutron system. The tagged structure functions are computed in the impulse approximation. The momentum and spin distribution of the active nucleon are controlled by the deuteron polarization and the detected spectator momentum (𝐷/𝑆 wave ratio). The cross section and spin asymmetries are evaluated for general deuteron polarization (vector and tensor, longitudinal and transverse) as functions of the spectator momentum. Tensor-polarized spin asymmetries of order unity are achieved for spectator momenta of approximately 300 MeV, which select configurations with a large 𝐷 wave. Sum rules for the tagged spin structure functions are derived. The results can be used for simulations of spectator tagging in future polarized fixed-target experiments (Jefferson Lab) or at the Electron-Ion Collider.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Modeling stochastic fluctuations in relativistic kinetic theory

Using the information current, we develop a Lorentz-covariant framework for modeling equilibrium fluctuations in relativistic kinetic theory in the grand-canonical ensemble. The resulting stochastic theory is proven to be causal and covariantly stable, and its predictions do not depend on the choice of spacetime foliation used to define the grand-canonical probabilities. As expected, in a box containing N > 5 particles, Boltzmann’s molecular chaos postulate is broken with (almost exact) probability N -1/2 , leading to a breakdown of the Boltzmann equation in small systems. Here, we also verify that, in ultrarelativistic gases, transient hydrodynamics already accounts for at least 80% of the equilibrium fluctuations of the stress-energy tensor at a given time. Finally, we compute the correlators at nonequal times for two selected collision kernels: that of a chemically active diluted solution, and that of ultrarelativistic scalar particles self-interacting via a quartic potential. For the former, we compute the density-density correlators analytically in real space, and dehydrodynamization of the stochastic theory is proven to occur whenever the mean free path diverges at high energy.

Astronomy & Astrophysics↗
DOE OSTI2025

Observations and modeling reveal that heatwaves reduce photosynthesis, plant carbon reserves, and net carbon uptake

Heatwaves threaten ecosystem carbon balances, yet the mechanisms driving short-term carbon flux responses remain poorly understood. Here, integrating high-frequency eddy covariance (EC) data from 140 global flux tower sites (872 site-years) with detailed process-based modeling, we examine ecosystem responses during and immediately after heatwaves. We show that heatwaves caused a −40% (range [−29%, −128%]) reduction in net ecosystem productivity (NEP) compared to pre-heatwave values, with this reduction persisting over the following two weeks (−38% range [+3%, −154%]). We attributed NEP decreases to photosynthesis decreases more than to ecosystem respiration (RE) increases. Forest sites had greater NEP decreases during heatwaves than non-forest sites, but remained carbon sinks afterwards, indicating resilience. Our modeling analysis of extreme heatwaves at selected EC sites shows that decreased photosynthesis, increased maintenance respiration, and decreased plant non-structural carbon reserves during heatwaves drive carbon cycle changes that persist for weeks. Consistent with phenocam observations, we modeled a reduction in leaf area index caused by reduced non-structural carbon reserves, leading to early leaf senescence and longer-term impacts. Ongoing increases in heatwaves are therefore likely to reduce NEP across a range of ecosystems, exacerbating carbon cycle feedback.

carbon cycle↗
DOE OSTI2022

General tensor structure for electron scattering in terms of invariant responses

The general structure of semi-inclusive polarized electron scattering from polarized spin-1/2 targets is developed for use at all energy scales, from modest-energy nuclear physics applications to use in very high energy particle physics. The leptonic and hadronic tensors that enter in the formalism are constructed in a general covariant way in terms of kinematic factors that are frame dependent but model independent and invariant response functions which contain all of the model-dependent dynamics. In the process of developing the general problem the relationships to the conventional responses expressed in terms of the helicity components of the exchanged virtual photon are presented. For semi-inclusive electron scattering with polarized electrons and polarized spin-1/2 targets one finds that 18 invariant response functions are required, each depending on four Lorentz scalar invariants. Additionally it is shown how the semi-inclusive cross sections are related via integrations over the momentum of the selected coincidence particle and sums over open channels.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Redshift evolution and covariances for joint lensing and clustering studies with DESI Y1

ABSTRACT Galaxy–galaxy lensing (GGL) and clustering measurements from the Dark Energy Spectroscopic Instrument Year 1 (DESI Y1) data set promise to yield unprecedented combined-probe tests of cosmology and the galaxy–halo connection. In such analyses, it is essential to identify and characterize all relevant statistical and systematic errors. We forecast the covariances of DESI Y1 GGL + clustering measurements and the systematic bias due to redshift evolution in the lens samples. Focusing on the projected clustering and GGL correlations, we compute a Gaussian analytical covariance, using a suite of N-body and lognormal simulations to characterize the effect of the survey footprint. Using the DESI one percent survey data, we measure the evolution of galaxy bias parameters for the DESI luminous red galaxy (LRG) and bright galaxy survey (BGS) samples. We find mild evolution in the LRGs in $0.4 < z < 0.8$, subdominant to the expected statistical errors. For BGS, we find less evolution for brighter absolute magnitude cuts, at the cost of reduced sample size. We find that for a redshift bin width $\Delta z = 0.1$, evolution effects on DESI Y1 GGL is negligible across all scales, all fiducial selection cuts, all fiducial redshift bins. Galaxy clustering is more sensitive to evolution due to the bias squared scaling. Nevertheless the redshift evolution effect is insignificant for clustering above the 1-halo scale of $0.1h^{-1}$ Mpc. For studies that wish to reliably access smaller scales, additional treatment of redshift evolution is likely needed. This study serves as a reference for GGL and clustering studies using the DESI Y1 sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

HighDimMixedModels.jl: Robust high-dimensional mixed-effects models across omics data

High-dimensional mixed-effects models are an increasingly important form of regression in which the number of covariates rivals or exceeds the number of samples, which are collected in groups or clusters. The penalized likelihood approach to fitting these models relies on a coordinate descent algorithm that lacks guarantees of convergence to a global optimum. Here, we empirically study the behavior of this algorithm on simulated and real examples of three types of data that are common in modern biology: transcriptome, genome-wide association, and microbiome data. Our simulations provide new insights into the algorithm’s behavior in these settings, and, comparing the performance of two popular penalties, we demonstrate that the smoothly clipped absolute deviation (SCAD) penalty consistently outperforms the least absolute shrinkage and selection operator (LASSO) penalty in terms of both variable selection and estimation accuracy across omics data. To empower researchers in biology and other fields to fit models with the SCAD penalty, we implement the algorithm in a Julia package, HighDimMixedModels.jl .

Gorstein, Evan↗
DOE OSTI2024

Ensemble variational Fokker-Planck methods for data assimilation

Particle flow filters solve Bayesian inference problems by smoothly transforming a set of particles into samples from the posterior distribution. Particles move in state space under the flow of an McKean-Vlasov-Itˆo process. This work introduces the Variational Fokker-Planck (VFP) framework for data assimilation, a general approach that includes previously known particle flow filters as special cases. The McKean-Vlasov-Itˆo process that transforms particles is defined via an optimal drift that depends on the selected diffusion term. It is established that the underlying probability density - sampled by the ensemble of particles - converges to the Bayesian posterior probability density. For a finite number of particles the optimal drift contains a regularization term that nudges particles toward becoming independent random variables. Based on this analysis, we derive computationally-feasible approximate regularization approaches that penalize the mutual information between pairs of particles, and avoid particle collapse. Moreover, the diffusion plays a role akin to a particle rejuvenation approach that aims to alleviate particle collapse. The VFP framework is very flexible. Different assumptions on prior and intermediate probability distributions can be used to implement the optimal drift, and localization and covariance shrinkage can be applied to alleviate the curse of dimensionality. A robust implicit-explicit method is discussed for the efficient integration of stiff McKean- Vlasov-Itˆo processes. Here, the effectiveness of the VFP framework is demonstrated on three progressively more challenging test problems, namely the Lorenz ’63, Lorenz ’96 and the quasi-geostrophic equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Price equation captures the role of drug interactions and collateral effects in the evolution of multidrug resistance

Bacterial adaptation to antibiotic combinations depends on the joint inhibitory effects of the two drugs (drug interaction [DI]) and how resistance to one drug impacts resistance to the other (collateral effects [CE]). Here we model these evolutionary dynamics on two-dimensional phenotype spaces that leverage scaling relations between the drug-response surfaces of drug-sensitive (ancestral) and drug-resistant (mutant) populations. We show that evolved resistance to the component drugs – and in turn, the adaptation of growth rate – is governed by a Price equation whose covariance terms encode geometric features of both the two-drug-response surface (DI) in ancestral cells and the correlations between resistance levels to those drugs (CE). Within this framework, mean evolutionary trajectories reduce to a type of weighted gradient dynamics, with the drug interaction dictating the shape of the underlying landscape and the collateral effects constraining the motion on those landscapes. We also demonstrate how constraints on available mutational pathways can be incorporated into the framework, adding a third key driver of evolution. Our results clarify the complex relationship between drug interactions and collateral effects in multidrug environments and illustrate how specific dosage combinations can shift the weighting of these two effects, leading to different and temporally explicit selective outcomes.

Gjini, Erida↗