SEARCH · Search NASA

Results for “covariance selection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRS2012

The Atacama Cosmology Telescope: Data Characterization and Map Making

We present a description of the data reduction and mapmaking pipeline used for the 2008 observing season of the Atacama Cosmology Telescope (ACT). The data presented here at 148 GHz represent 12% or the 90 TB collected by ACT from 2007 to 2010. In 2008 we observed for 136 days, producing a total of 142h of data (11 TB for the 148 GHz band only), with a daily average of 10.5 h of observation. From these, 108.5 h were devoted to 850 sq deg stripe (11.2 h by 9 deg.1) centered on a declination of -52 deg.7, while 175 h were devoted to a 280 square deg stripe (4.5 h by 4 deg.8) centered at the celestial equator. We discuss sources of statistical and systematic noise, calibration, telescope pointing and data selection. Out of 1260 survey hours and 1024 detectors per array, 816 h and 593 effective detectors remain after data selection for this frequency band, yielding a 38 % survey efficiency. The total sensitivity in 2008, determined from the noise level between 5 Hz and 20 Hz in the time-ordered data stream (TOD), is 32 muK square root of s in CMB units. Atmospheric brightness fluctuations constitute the main contaminant in the data and dominate the detector and noise covariance at low frequencies in the TOD. The maps were made by solving the lease squares problem using the Preconditioned Conjugate Gradient method, incorporating the details of the detector and noise correlations. Cross-correlation with WMAP sky maps as well as analysis from simulations reveal the our maps are unbiased at l > 300. This paper accompanies the public release of the 148 GHz southern stripe maps from 2008. The techniques described here will be applied to future maps and data releases.

Duenner, Rolando↗

NASA NTRS1980

The influence of orbit selection on the accuracy of the Stanford Relativity gyroscope experiment

This paper discusses an error analysis for the Stanford Relativity experiment, designed to measure the precession of a gyroscope's spin-axis predicted by general relativity. Measurements will be made of the spin-axis orientations of 4 superconducting spherical gyroscopes carried by an earth-satellite. Two relativistic precessions are predicted: a 'geodetic' precession associated with the satellite's orbital motion and a 'motional' precession due to the earth's rotation. Using a Kalman filter covariance analysis with a realistic error model we have computed the error in determining the relativistic precession rates. Studies show that a slightly off-polar orbit is better than a polar orbit for determining the 'motional' drift.

Vassar, R.↗

DOE OSTI2026

Using AI to Reproduce Neutrino Cross Section Analysis - Prototyping the Neutrino Discovery Platform

The Neutrino Discovery Platform (NDP) aims to accelerate DUNE-era science by making the neutrino program's existing datasets analyzable through fast, reproducible, and auditable workflows. We report a working version of two of its layers, data curation and agentic orchestration, built and tested end to end on MINERvA open data. The guiding lesson throughout is that a cross section is a measurement, and not just a plotted shape, only if it carries a defensible systematic-uncertainty budget, a trustworthy unfolding, and a reproducible record. Using a single medium-energy playlist pair from the MINERvA open-data release (about $2.05\times10^{17}$ protons on target of data), we first reproduced the shapes of two published charged-current inclusive $\nu_\mu$ measurements through a complete extraction ladder: selection, background subtraction, D'Agostini unfolding, efficiency correction, and flux normalization. These shape-level reproductions ran and tracked the published results, but they lacked the systematic-uncertainty machinery that defines a MINERvA cross section. To supply it, we vendored and built the MINERvA Analysis Toolkit and developed a many-universe systematic-uncertainty tool that produces a portable covariance artifact, a parallel event-loop runner, and a per-run auditability harness. Validated against a published covariance release, the toolchain reproduces the released statistical, flux, and muon-energy-scale terms and shows that they account for roughly 63\% of the total variance, with the remainder unreleased. Using this same infrastructure, we then performed a measurement of our own design, the hadronic recoil-energy distribution of low-energy ($E_\nu<2.5$~GeV) charged-current inclusive events, and found data/simulation shape agreement of $\chi^2/\mathrm{ndf}=1.26$. Together these results show that the platform supports original physics and not only reproductions.

Breaux, Auto [Tulane U. (main)]↗

DOE OSTI2026

Toward the Neutrino Discovery Platform: An Auditable, Uncertainty-Bearing Toolchain for MINERvA Open-Data Cross-Section Analysis

Breaux, Auto [Tulane U. (main)]↗

DOE OSTI2019

The Correlation of Mesoscale Humidity Anomalies With Mesoscale Organization of Marine Stratocumulus From Observations Over the ARM Eastern North Atlantic Site

The structure of mesoscale cellular organization in marine cloud-topped boundary layers is found to be well characterized by using a novel compositing approach based on mesoscale variations in the column water vapor path (WVP). The approach is applied to ground-based observations from the Atmospheric Radiation Measurement (ARM) Eastern North Atlantic site. Based on a set of satellite and ground-based observational criteria, 381 hr of closed-cell and 227 hr of open-cell cases were selected from late 2015 to early 2018. Strong correlations are found between mesoscale-filtered cloud properties and WVP for both closed-cell and open-cell regimes. In the moist atmospheric columns, the clouds are thicker with higher tops and lower bases, and stronger precipitation compared to that in the dry columns. Overall, cloud properties of open and closed cells covary similarly with mesoscale moisture perturbations, except that the correlation of liquid water path with WVP is much weaker for open cells. The relations of subcloud properties with WVP are also examined. In the moist columns, surface equivalent potential temperature and relative humidity are higher than in the dry columns. A marginally negative correlation between mesoscale-filtered subcloud turbulence eddy dissipation rate and WVP is found for closed cells. These results are consistent with the conceptual model of closed cellular mesoscale circulations of Zhou and Bretherton (2019).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Unveiling the spatial distribution of molecular coherences at conical intersections by covariance X-ray diffraction signals

Significance Monitoring the real-space motion of the electrons directly involved in ultrafast molecular dynamics is a challenging goal, hindered by the strong contributions of the remaining inactive electrons. Molecular quantum coherences can provide a direct window into elementary electronic dynamics, but they could not be separately imaged so far. Here, we demonstrate a time- and frequency-resolved X-ray diffraction technique, which can employ existing stochastic X-ray pulses to separately image the coherence contributions. The technique can selectively follow the relevant electrons involved in the ultrafast dynamics and identify the confined molecular regions covered by their motion. It enables readily feasible measurements and can be straightforwardly extended to full three-dimensional imaging via X-ray and electron diffraction.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2022

Pursuing Dark Energy with Large Galaxy Redshift Surveys: Baryon Acoustic Oscillations and Beyond (Final Technical Report)

We have developed and applied methods of large-scale structure from galaxy redshift surveys to the study of dark energy. This program supported my group's development of the baryon acoustic method and our participation in the Dark Energy Spectroscopic Instrument (DESI) survey. In addition to my leadership role in the DESI collaboration, my group at Harvard focused on several topics addressing key needs of the DESI science program. 1) We continued our design, validation, and documentation of DESI target selection of the luminous red galaxy and emission-line galaxy samples. 2) We applied simulations from our novel and extremely fast N-body code to make DESI catalogs. With these, we will search for possible systematic shifts in the acoustic scale due to clustering bias with an unprecedented volume of simulations. 3) We extended our method for the fast construction of covariance matrices for correlation functions. 4) We developed new large-scale structure methods, including density-field reconstruction and three-point function analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2009

Improving Regional Forecast by Assimilating Atmospheric InfraRed Sounder (AIRS) Profiles into WRF Model

In data sparse regions, remotely-sensed observations can be used to improve analyses and produce improved forecasts. One such source comes from the Atmospheric InfraRed Sounder (AIRS), which together with the Advanced Microwave Sounding Unit (AMSU), represents one of the most advanced space-based atmospheric sounding systems. The purpose of this paper is to describe a procedure to optimally assimilate high resolution AIRS profile data into a regional configuration of the Advanced Research WRF (ARW) version 2.2 using WRF-Var. The paper focuses on development of background error covariances for the regional domain and background type, and an optimal methodology for ingesting AIRS temperature and moisture profiles as separate overland and overwater retrievals with different error characteristics. The AIRS thermodynamic profiles are derived from the version 5.0 Earth Observing System (EOS) science team retrieval algorithm and contain information about the quality of each temperature layer. The quality indicators were used to select the highest quality temperature and moisture data for each profile location and pressure level. The analyses were then used to conduct a month-long series of regional forecasts over the continental U.S. The long-term impacts of AIRS profiles on forecast were assessed against verifying NAM analyses and stage IV precipitation data.

Chou, Shih-Hung↗

DOE OSTI2021

Divergent controls of soil organic carbon between observations and process-based models

Abstract The storage and cycling of soil organic carbon (SOC) are governed by multiple co-varying factors, including climate, plant productivity, edaphic properties, and disturbance history. Yet, it remains unclear which of these factors are the dominant predictors of observed SOC stocks, globally and within biomes, and how the role of these predictors varies between observations and process-based models. Here we use global observations and an ensemble of soil biogeochemical models to quantify the emergent importance of key state factors – namely, mean annual temperature, net primary productivity, and soil mineralogy – in explaining biome- to global-scale variation in SOC stocks. We use a machine-learning approach to disentangle the role of covariates and elucidate individual relationships with SOC, without imposing expected relationships a priori . While we observe qualitatively similar relationships between SOC and covariates in observations and models, the magnitude and degree of non-linearity vary substantially among the models and observations. Models appear to overemphasize the importance of temperature and primary productivity (especially in forests and herbaceous biomes, respectively), while observations suggest a greater relative importance of soil minerals. This mismatch is also evident globally. However, we observe agreement between observations and model outputs in select individual biomes – namely, temperate deciduous forests and grasslands, which both show stronger relationships of SOC stocks with temperature and productivity, respectively. This approach highlights biomes with the largest uncertainty and mismatch with observations for targeted model improvements. Understanding the role of dominant SOC controls, and the discrepancies between models and observations, globally and across biomes, is essential for improving and validating process representations in soil and ecosystem models for projections under novel future conditions.

58 GEOSCIENCES↗

NASA NTRS1991

Quantitative knowledge acquisition for expert systems

A common problem in the design of expert systems is the definition of rules from data obtained in system operation or simulation. While it is relatively easy to collect data and to log the comments of human operators engaged in experiments, generalizing such information to a set of rules has not previously been a direct task. A statistical method is presented for generating rule bases from numerical data, motivated by an example based on aircraft navigation with multiple sensors. The specific objective is to design an expert system that selects a satisfactory suite of measurements from a dissimilar, redundant set, given an arbitrary navigation geometry and possible sensor failures. The systematic development is described of a Navigation Sensor Management (NSM) Expert System from Kalman Filter convariance data. The method invokes two statistical techniques: Analysis of Variance (ANOVA) and the ID3 Algorithm. The ANOVA technique indicates whether variations of problem parameters give statistically different covariance results, and the ID3 algorithms identifies the relationships between the problem parameters using probabilistic knowledge extracted from a simulation example set. Both are detailed.

Belkin, Brenda L.↗

NASA NTRS1971

Design of optimal probing signals for vector parameter estimation.

In the design of optimal inputs or probing signals for parameter estimation, it is more natural to consider functions of the Fisher information matrix as the criterion of optimality instead of some function of the error covariance matrix. The input which maximizes the Fisher information measure for efficient estimation of a scalar parameter also provides the minimum error variance. The information is thus a logical choice for the optimality criterion in scalar problems. No such obvious choice is apparent for vector parameter estimation. A number of performance measures are examined and compared in the present study, and a useful criterion is selected. The design of an optimal probing signal using this criterion is shown to be equivalent to an optimal control problem in which certain equality constraints must be satisfied. This problem may be solved by conventional techniques of deterministic or stochastic optimal control.

Nahi, N. E.↗

NASA NTRSDate not supplied

Nearest-Neighbor Machine Learning Feature Selection for Interpretation of Microbial Molecular Signatures from Isotope Ratio Mass Spectrometry Data

Mass spectrometry (MS) promises to be a powerful tool for potential biosignature detection during astrobiological missions on ocean worlds in our solar system. Accurate and generalizable machine learning methods could enhance science return on investment by predicting seawater chemistry and classifying isotopic biosignatures, either as a signature consistent with microbial life (biotic) or as a novelty (unclassified/unique). However, machine learning models are likely to be complex and involve interactions between MS features, making biosignatures difficult to interpret. Feature selection methods provide biological and chemical context that help interpret the mechanisms of machine learning models, but these methods also need the ability to detect complex interactions. Previously, we developed a machine learning feature selection algorithm called nearest-neighbor projected distance regression (NPDR) that has the ability to identify important model features that involve complex interactions and automatically reduce correlation and the dimensionality in a high-dimensional variable space. The standard distance metrics used in NPDR – Manhattan and Euclidean – assume the multivariate data are isotropic, which is often violated in real data due to differences in the covariance between variables. Thus, we extend NPDR to include a random forest distance, and other anisotropic distance metrics, for computing nearest neighbors. We also augment the isotope-ratio MS data with time-series features from the raw MS signal to improve biotic classification. We test NPDR on our novel experimental ocean world seawater analog MS data. We measure isotope fractionations of volatile CO 2 that could be measured in exospheres or plumes. Samples include baseline abiotic conditions using a range of possible seawater chemistry consistent with Europa and Enceladus, and biotic samples that include microbes in these seawaters. We use penalized NPDR with random forest proximity to identify interpretable microbial molecular signatures. We compare features with random forest importance, and we train a classifier that discriminates between biotic and abiotic samples with high accuracy. These ML-trained ocean-world analog MS data could be used to assist in identifying biosignatures during future missions.

geochemistry↗

DOE OSTI2024

Maximum a posteriori Ly α estimator (MAPLE): band power and covariance estimation of the 3D Ly α forest power spectrum

We present a novel maximum a posteriori estimator to jointly estimate band powers and the covariance of the three-dimensional power spectrum (P3D) of Ly $\alpha$ forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Ly $\alpha$ surveys that are sparsely sampled transverse to and densely sampled along the line of sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the current Dark Energy Spectroscopic Instrument; (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e. offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Climate Forcing of Bioenergy Feedstocks: Insights From Carbon and Energy Flux Measurements

Bioenergy from biofuels has the potential to slow growing atmospheric carbon dioxide concentrations by reducing fossil fuel use. However, growing bioenergy feedstocks is a land-intensive process. In the United States, the recent expansion of maize bioethanol has presented some environmental costs, prompting the development of several alternative bioenergy feedstocks. These feedstocks, selected in part for traits associated with ecosystem services, may provide opportunities for environmental benefits beyond fossil fuel displacement. We hypothesized that these bioenergy ecosystems will provide direct climatic cooling through their influence on carbon and radiative energy fluxes (i.e., through albedo). To test this hypothesis, we investigated the potential cooling effect of five current or potential bioenergy feedstocks using multi-year records from eddy covariance towers. Perennial feedstocks were carbon sinks, with an annual mean net ecosystem carbon balance (NECB) of –2.7 ± 2.1 Mg C ha –1 for miscanthus, –0.8 ± 1.1 Mg C ha –1 for switchgrass, and –1.4 ± 0.7 Mg C ha –1 for prairie. In contrast, annual rotations were generally carbon sources, with an annual mean NECB of 2.6 ± 2.4 Mg C ha –1 for maize-soy and 3.2 ± 2.1 Mg C ha –1 for sorghum-soy. Using maize-soy as a baseline, conversion to alternative feedstocks increased albedo, inducing further cooling. This effect was strongest for miscanthus, with –3.5 ± 2.0 W m –2 of radiative forcing, and weakest for sorghum, with –1.4 ± 1.4 W m –2 . When feedstock effects on carbon and albedo were compared using carbon equivalents, carbon fluxes were the stronger ecosystem effect, underscoring the role of perennial species as effective carbon sinks. This work highlights the impact of feedstock choice on ecosystem processes as an element of bioenergy land conversion strategies.

09 BIOMASS FUELS↗

DOE OSTI2021

Autotuning PolyBench benchmarks with LLVM Clang/Polly loop optimization pragmas using Bayesian optimization

Here, we develop a ytopt autotuning framework that leverages Bayesian optimization to explore the parameter space search and compare four different supervised learning methods within Bayesian optimization and evaluate their effectiveness. We select six of the most complex PolyBench benchmarks and apply the newly developed LLVM Clang/Polly loop optimization pragmas to the benchmarks to optimize them. We then use the autotuning framework to optimize the pragma parameters to improve their performance. The experimental results show that our autotuning approach outperforms the other compiling methods to provide the smallest execution time for the benchmarks syr2k, 3mm, heat-3d, lu, and covariance with two large datasets in 200 code evaluations for effectively searching the parameter spaces with up to 170,368 different configurations. We find that the Floyd-Warshall benchmark did not benefit from autotuning. To cope with this issue, we provide some compiler option solutions to improve the performance. Then we present loop autotuning without a user's knowledge using a simple mctree autotuning framework to further improve the performance of the Floyd-Warshall benchmark. We also extend the ytopt autotuning framework to tune a deep learning application.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRSDate not supplied

A Convex Optimization Approach to Improving Suboptimal Hyperparameters of Sliced Normal Distributions

Sliced Normal (SN) distributions are a generalization of Gaussian distributions where the quadratic argument of the exponential is replaced with a sum of squares polynomial. SNs may be used to represent the distribution of a diverse set of random variables including multi-modal, non-symmetric, and skewed distributions. Unfortunately, the likelihood function of a SN includes a normalization constant and the inclusion of this normalization constant makes the likelihood a non-convex function of the hyperparameters which define the SN. In previous work, suboptimal fitting of the hyperparameters was performed by transforming the given data into a higher dimensional monomial basis and selecting the optimal hyperparameters of a Gaussian fit in this space. However, this approach did not account for the effect of lifting on the normalization constant. Indeed, it was observed that as the number of monomials is increased the likelihood of the Sliced Normal can decrease. In this paper, we increase the likelihood of Sliced Normals found using the previous method by developing a convex formulation which scales the covariance matrix of the Gaussian fit such that the likelihood of the Sliced Normal is maximized. The result is significant improvements of the log likelihood of fitted SN distributions, including a significant increase, especially for problems with 500+ monomials.

Convex optimization approach to improving suboptim↗

NASA NTRS1993

Short Arc Orbit Determination for Altimeter Calibration and Validation on TOPEX/Poseidon

TOPEX/Poseidon (T/P) is a joint mission of US NASA and French CNES design launched August 10, 1992. It carries two radar altimeters which alternately share a common antenna. There are two project designated verification sites, a NASA site off the coast at Pt. Conception, CA, and a CNES site near Lampedusa Island in the Mediterranean Sea. Altimeter calibration and validation for T/P is performed over these highly instrumented sites by comparing the spacecraft's altimeter radar range to computed range based on in situ measurements which include the estimated orbit position. This paper presents selected results of orbit determination over each of these sites to support altimeter verification. A short arc orbit determination technique is used to estimate a locally accurate position determination of T/P from less than one revolution of satellite laser ranging (SLR) data. This technique is relatively insensitive to gravitational and nongravitational force modeling errors and is therefore essentially geometrical. The quality of these short arc orbits is demonstrated by covariance analysis and by comparison to orbits determined from longer arcs of data and other tracking data types, such as DORIS and Global Positioning System Demonstration Receiver (GPSDR) data.

radar↗

DOE OSTI2021

Oak Ridge National Laboratory NCSP Analytical Methods Subtask 3, AMPX Development and Maintenance, and NCSP Nuclear Data Subtask 6, SAMMY Modernization

The modernization of SAMMY continued with consolidation of access to covariance information for adjusted parameters and data in SAMMY. This consolidation allowed for removal of many scratch files. In addition, work was initiated to make the 0K cross section calculation more modular and less dependent on SAMMY global parameters. An initial application programming interface (API) was added to expose cross sections (including resolution broadening) generated by SAMMY to external fitting routines. The processing for thermal moderators in AMPX was updated for selected moderators for which the generated grid was not fine enough. Updated libraries were generated for SCALE. In addition, work continued to fully support new Evaluated Nuclear Data File (ENDF) formats, including the Generalized Nuclear Database Structure (GNDS) in AMPX.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗