Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Data-driven Feature Analysis in Control Design for Series-Compensated Transmission Systems

One challenge in power-system control designs is the gap between numerical model-based analysis and complex real-world power systems. With increased data and measurements being collected from power systems, data-driven analysis (e.g., machine learning) may provide an alternative approach to reveal hidden information through learning from the real system data, and provide insights for better control scheme design during the utility planning process. Data-driven feature analysis was performed to evaluate the relationships between series compensation, power generation, and path flows in a real transmission system, as well as temporal patterns. The main data-driven analysis methods, including statistical cross-correlation, multinomial logistical regression, and classification and regression trees, were integrated for feature selection and developing predictive models of series compensation. Analysis results demonstrated the effectiveness of the proposed methodology in feature analysis and the potential to help improve power-system control scheme design.

42 ENGINEERING↗
DOE OSTI2021

Anatomy of Continuous Mars SEIS and Pressure Data from Unsupervised Learning

The seismic noise recorded by the Interior Exploration using Seismic Investigations, Geodesy, and Heat Transport (InSight) seismometer (Seismic Experiment for Interior Structure [SEIS]) has a strong daily quasi-periodicity and numerous transient microevents, associated mostly with an active Martian environment with wind bursts, pressure drops, in addition to thermally induced lander and instrument cracks. That noise is far from the Earth’s microseismic noise. Quantifying the importance of nonstochasticity and identifying these microevents is mandatory for improving continuous data quality and noise analysis techniques, including autocorrelation. Cataloging these events has so far been made with specific algorithms and operator’s visual inspection. We investigate here the continuous data with an unsupervised deep-learning approach built on a deep scattering network. This leads to the successful detection and clustering of these microevents as well as better determination of daily cycles associated with changes in the intensity and color of the background noise. We first provide a description of our approach, and then present the learned clusters followed by a study of their origin and associated physical phenomena. We show that the clustering is robust over several Martian days, showing distinct types of glitches that repeat at a rate of several tens per sol with stable time differences. We show that the clustering and detection efficiency for pressure drops and glitches is comparable to or better than manual or targeted detection techniques proposed to date, noticeably with an unsupervised approach. Finally, here we discuss the origin of other clusters found, especially glitch sequences with stable time offsets that might generate artifacts in autocorrelation analyses. We conclude with presenting the potential of unsupervised learning for long-term space mission operations, in particular, for geophysical and environmental observatories.

58 GEOSCIENCES↗
DOE OSTI2021

Linear systematics mitigation in galaxy clustering in the Dark Energy Survey Year 1 Data

ABSTRACT We implement a linear model for mitigating the effect of observing conditions and other sources of contamination in galaxy clustering analyses. Our treatment improves upon the fiducial systematics treatment of the Dark Energy Survey (DES) Year 1 (Y1) cosmology analysis in four crucial ways. Specifically, our treatment (1) does not require decisions as to which observable systematics are significant and which are not, allowing for the possibility of multiple maps adding coherently to give rise to significant bias even if no single map leads to a significant bias by itself, (2) characterizes both the statistical and systematic uncertainty in our mitigation procedure, allowing us to propagate said uncertainties into the reported cosmological constraints, (3) explicitly exploits the full spatial structure of the galaxy density field to differentiate between cosmology-sourced and systematics-sourced fluctuations within the galaxy density field, and (4) is fully automated, and can therefore be trivially applied to any data set. The updated correlation function for the DES Y1 redMaGiC catalogue minimally impacts the cosmological posteriors from that analysis. Encouragingly, our analysis does improve the goodness-of-fit statistic of the DES Y1 3 × 2pt data set (Δχ2 = −6.5 with no additional parameters). This improvement is due in nearly equal parts to both the change in the correlation function and the added statistical and systematic uncertainties associated with our method. We expect the difference in mitigation techniques to become more important in future work as the size of cosmological data sets grows.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Total Moisture Analysis of Salts by Dissolution

This report discusses recent efforts within TA-48 in developing a robust, defensible, and straightforward procedure for determining the moisture content of alkali and alkaline metal halide salts utilizing a total dissolution Karl-Fischer titration method. Utilizing statistical analysis of blank and dissolved salt samples, we determine a (3 sigma) detection limit of 67 micrograms H 2 O/g salt, and a (10 sigma) quantification limit of 160 micrograms H 2 O/g salt. Several salts are analyzed, and suggestions for future efforts are given.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS2018

Improved Pyrotechnic Shock Scaling Method Based on Shock Response Spectrum and Statistical Energy Analysis

It has been more than forty years since the pyrotechnic shock scaling method was introduced. The scaling method estimates the attenuation of the Shock Response Spectrum (SRS) based on the distance from the source, structural configurations, types of structural joints and interfaces, and intervening structure [1]. The method has been successfully used in the spacecraft community countless times and still is frequently used to develop pyrotechnic shock requirements at various levels of assembly of a spacecraft. However, since the method was derived empirically from a limited set of shock test data [2], the aerospace community has been looking for an alternative approach. In this paper, a computational scaling method based on Statistical Energy Analysis (SEA) is re-visited. SEA is traditionally used as a method for investigating the diffusion of acoustic and vibratory energies of a system at steady-state [3]. Previously, an approach using the SRS as an acceleration constraint condition to the SEA model was introduced to estimate the attenuation from a shock source [4,5]. In the current investigation, additional examples are provided to further validate the approach. In addition, responses in the time domain are produced by the Local Modal Phase Reconstruction (LMPR) approach which was recently introduced to the community [6].

Fernandez, Juan P.↗
NASA NTRS2021

Truncated ARQ Statistical Link Analysis for Dynamic Links

The future deep space links are migrating towards higher frequency bands such as Ka band and optical. These links are susceptible to non Gaussian and non linear effects such as atmospheric turbulence, scintillation, antenna mis-pointing, jitter, etc. These dynamic links thus will experience various degrees of fading loss, and some of these link disruptions cannot be effectively mitigated by forward error correction coding and/or interleaving. One effective way to ensure reliable communication is by using Automatic Repeat Request (ARQ) protocol, where the receiver acknowledges to the transmitter whether or not a data unit is successfully received. If a data unit is not successfully received (such as after a pre-set time-out), the transmitter would then re-transmit the lost data unit to the receiver. In a previous paper, we derived a statistical link analysis method of finding the optimal operating Signal-to-Noise Ratio (SNR) and estimating the latency of an ARQ scheme. In a more recent paper, we demonstrated the above method using the SNR distribution constructed from the Ka-band (32 GHz) flight data. To simplify the discussion, we considered the academic approach that the ARQ scheme allows for an infinite number of retransmissions. In this paper, we consider the more practical case of a truncated ARQ scheme, where there is a limit on the number of retransmissions. We derive the error probability, the optimal SNR setting, and the latency statistics of the correctly received frames of the truncated ARQ schemes. We first discuss the truncated ARQ link analysis principles using the Gaussian assumption for SNR distribution with a large variance. Next, we demonstrate the statistical truncated ARQ link analysis using the SNR distribution constructed from the Ka-band flight data. The results in this paper can be applied in the design of reliable communication systems such as the Consultative Committee for Space Data System (CCSDS) File Transfer Protocol (CFTP) and the Delay Tolerant Network (DTN).

Morabito, David↗
DOE OSTI2020

Windowing artefacts likely account for recent claimed detection of oscillating cosmic scale factor

ABSTRACT Using the Pantheon data set of Type Ia supernovae, a recent publication (R20 in this work) reports a 2σ detection of oscillations in the expansion history of the Universe. The study conducted by R20 is wholly worthwhile. However, we demonstrate that there is a $\gt 10{{\ \rm per\ cent}}$ chance of statistical fluctuations in the Pantheon data producing a false oscillatory signal larger than the oscillatory signal that R20 report. Their results are a less than 2σ detection. Applying the R20 methodology to simulated Pantheon data, we determine that these oscillations could arise due to analysis artefacts. The uneven spacing of Type Ia supernovae in redshift space and the complicated analysis method of R20 impose a structured throughput function. When analysed with the R20 prescription, about $11{{\ \rm per\ cent}}$ of artificial ΛCDM data sets produce a stronger oscillatory signal than the actual Pantheon data. Our results underscore the importance of understanding the false ‘signals’ that can be introduced by complicated data analyses.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Median statistics estimate of the galactic rotational velocity

We compile a complete collection of 18 recent (from 2000 to 2017) measurements of Θ 0 , the rotational velocity of the Milky Way at R 0 (the radial distance of the Sun from the Galactic center). These measurements use tracers that are believed to more accurately reflect the systematic rotation of the Milky Way. Unlike other recent compilations of Θ 0 , our collection includes only independent measurements. We find that these 18 measurements are distributed in a mildly non-Gaussian fashion and a median statistics estimate indicates Θ 0 = 220 ± 10 kms –1 (2σ error) as the most reliable summary, at R 0 = 8.0 ± 0.3 kpc (2σ error).

(cosmology:) cosmological parameters↗
NASA NTRS2016

Improved Test Planning and Analysis Through the Use of Advanced Statistical Methods

The goal of this work is, through computational simulations, to provide statistically-based evidence to convince the testing community that a distributed testing approach is superior to a clustered testing approach for most situations. For clustered testing, numerous, repeated test points are acquired at a limited number of test conditions. For distributed testing, only one or a few test points are requested at many different conditions. The statistical techniques of Analysis of Variance (ANOVA), Design of Experiments (DOE) and Response Surface Methods (RSM) are applied to enable distributed test planning, data analysis and test augmentation. The D-Optimal class of DOE is used to plan an optimally efficient single- and multi-factor test. The resulting simulated test data are analyzed via ANOVA and a parametric model is constructed using RSM. Finally, ANOVA can be used to plan a second round of testing to augment the existing data set with new data points. The use of these techniques is demonstrated through several illustrative examples. To date, many thousands of comparisons have been performed and the results strongly support the conclusion that the distributed testing approach outperforms the clustered testing approach.

Green, Lawrence L.↗
DOE OSTI2020

Comparison of unfolding methods using RooFitUnfold

In this study we describe RooFitUnfold, an extension of the RooFit statistical software package to treat unfolding problems, and which includes most of the unfolding methods that commonly used in particle physics. The package provides a common interface to these algorithms as well as common uniform methods to evaluate their performance in terms of bias, variance and coverage. In this paper we exploit this common interface of RooFitUnfold to compare the performance of unfolding with the Richardson–Lucy, Iterative Dynamically Stabilized, Tikhonov, Gaussian Process, bin-by-bin and inversion methods on several example problems.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Ensemble photometric redshifts

Upcoming imaging surveys, such as LSST, will provide an unprecedented view of the Universe, but with limited resolution along the line-of-sight. Common ways to increase resolution in the third dimension, and reduce misclassifications, include observing a wider wavelength range and/or combining the broad-band imaging with higher spectral resolution data. The challenge with these approaches is matching the depth of these ancillary data with the original imaging survey. However, while a full 3D map is required for some science, there are many situations where only the statistical distribution of objects (dN/dz) in the line-of-sight direction is needed. In such situations, there is no need to measure the fluxes of individual objects in all of the surveys. Rather a stacking procedure can be used to perform an `ensemble photo-z'. We show how a shallow, higher spectral resolution survey can be used to measure dN/dz for stacks of galaxies which coincide in a deeper, lower resolution survey. The galaxies in the deeper survey do not even need to appear individually in the shallow survey. We give a toy model example to illustrate tradeoffs and considerations for applying this method. This approach will allow deep imaging surveys to leverage the high resolution of spectroscopic and narrow/medium band surveys underway, even when the latter do not have the same reach to high redshift.

galaxies:distances and redshifts↗
DOE OSTI2023

Decoding the age–chemical structure of the Milky Way disc: an application of copulas and elicitable maps

In the Milky Way, the distribution of stars in the [α/Fe] versus [Fe/H] and [Fe/H] versus age planes holds essential information about the history of star formation, accretion, and dynamical evolution of the Galactic disc. We investigate these planes by applying novel statistical methods called copulas and elicitable maps to the ages and abundances of red giants in the Apache Point Observatory Galactic Evolution Experiment survey. We find that the high- and low-α disc stars have a clean separation in copula space and use this to provide an automated separation of the α sequences using a purely statistical approach. This separation reveals that the high-α disc ends at the same [α/Fe] and age at high [Fe/H] as the low-[Fe/H] start of the low-α disc, thus supporting a sequential formation scenario for the high- and low-α discs. We then combine copulas with elicitable maps to precisely obtain the correlation between stellar age τ and metallicity [Fe/H] conditional on Galactocentric radius R and height z in the range 0 < R < 20 kpc and |z| < 2 kpc. The resulting trends in the age–metallicity correlation with radius, height, and [α/Fe] demonstrate a ≈0 correlation wherever kinematically cold orbits dominate, while the naively expected negative correlation is present where kinematically hot orbits dominate. This is consistent with the effects of spiral-driven radial migration, which must be strong enough to completely flatten the age–metallicity structure of the low-α disc.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Review of rotating wing dynamic stall: Experiments and flow control

Dynamic stall has been a technical challenge and a fluid dynamical subject of interest for more than fifty years; but in the last decade significant advances have been made in the understanding, prediction, modeling, and control of dynamic stall on rotors. This paper provides a summary of the state of the art of dynamic stall experiments and future directions in the understanding of dynamic stall on rotors. Experimental data sets are discussed, as well the direction of future research for control of dynamic stall. Coordinated testing between airfoils and rotating blades, as well as close integration between computational and experimental studies were found to be productive approaches. Advanced analysis methods, including statistical methods, modal representations, and artificial intelligence methods have led to significant advances in the understanding of dynamic stall. Investigations of dynamic stall control devices have allowed many useful targeted investigations of the transition to separated flow, but have not yet resulted in a commercially implemented device.

42 ENGINEERING↗
DOE OSTI2023

Clustering of red sequence galaxies in the fourth data release of the Kilo-Degree Survey

We present a sample of luminous red sequence galaxies as the basis for a study of the large-scale structure in the fourth data release of the Kilo-Degree Survey. The selected galaxies are defined by a red sequence template, in the form of a data-driven model of the colour-magnitude relation conditioned on redshift. In this work, the red sequence template was built using the broad-band optical+near infrared photometry of KiDS-VIKING and the overlapping spectroscopic data sets. The selection process involved estimating the red sequence redshifts, assessing the purity of the sample and estimating the underlying redshift distributions of redshift bins. After performing the selection, we mitigated the impact of survey properties on the observed number density of galaxies by assigning photometric weights to the galaxies. We measured the angular two-point correlation function of the red galaxies in four redshift bins and constrain the large-scale bias of our red sequence sample assuming a fixed ΛCDM cosmology. We find consistent linear biases for two luminosity-threshold samples (‘dense’ and ‘luminous’). We find that our constraints are well characterised by the passive evolution model.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Photometric redshift-aided classification using ensemble learning

We present SHEEP, a new machine learning approach to the classic problem of astronomical source classification, which combines the outputs from the XGBoost, LightGBM, and CatBoost learning algorithms to create stronger classifiers. A novel step in our pipeline is that prior to performing the classification, SHEEP first estimates photometric redshifts, which are then placed into the data set as an additional feature for classification model training; this results in significant improvements in the subsequent classification performance. SHEEP contains two distinct classification methodologies: (i) Multi-class and (ii) one versus all with correction by a meta-learner. We demonstrate the performance of SHEEP for the classification of stars, galaxies, and quasars using a data set composed of SDSS and WISE photometry of 3.5 million astronomical sources. The resulting F1 -scores are as follows: 0.992 for galaxies; 0.967 for quasars; and 0.985 for stars. In terms of the F1-scores for the three classes, SHEEP is found to outperform a recent RandomForest-based classification approach using an essentially identical data set. Our methodology also facilitates model and data set explainability via feature importances; it also allows the selection of sources whose uncertain classifications may make them interesting sources for follow-up observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

VarIabiLity seLection of AstrophysIcal sources iN PTF (VILLAIN): I. Structure function fits to 71 million objects

Light-curve variability is well-suited to characterizing objects in surveys with high cadence and a long baseline. This is especially relevant in view of the large datasets to be produced by the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). We aim to determine variability parameters for objects in the Palomar Transient Factory (PTF) and explore differences between quasars (QSOs), stars, and galaxies. We relate variability and colour information in preparation for future surveys. We fit joint likelihoods to structure functions (SFs) of 71 million PTF light curves with a Markov chain Monte Carlo method. For each object, we assume a power-law SF and extract two parameters: the amplitude on timescales of one year, A, and a power-law index, γ. With these parameters and colours in the optical (Pan-STARRS1) and mid-infrared (WISE), we identify regions of parameter space dominated by different types of spectroscopically confirmed objects from SDSS. Candidate QSOs, stars, and galaxies are selected to show their parameter distributions. QSOs show high-amplitude variations in the R band, and the highest γ values. Galaxies have a broader range of amplitudes and their variability shows relatively little dependency on timescale. With variability and colours, we achieve a photometric selection purity of 99.3% for QSOs. Even though hard cuts in monochromatic variability alone are not as effective as seven-band magnitude cuts, variability is useful in characterizing object subclasses. Through variability, we also find QSOs that were erroneously classified as stars in the SDSS. We discuss perspectives and computational solutions in view of the upcoming LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

CIRCLEZ : Reliable photometric redshifts for active galactic nuclei computed solely using photometry from Legacy Survey Imaging for DESI

Photometric redshifts for galaxies hosting an accreting supermassive black hole in their center, known as active galactic nuclei (AGNs), are notoriously challenging. At present, they are most optimally computed via spectral energy distribution (SED) fittings, assuming that deep photometry for many wavelengths is available. However, for AGNs detected from all-sky surveys, the photometry is limited and provided by a range of instruments and studies. This makes the task of homogenizing the data challenging, presenting a dramatic drawback for the millions of AGNs that wide surveys such as SRG/eROSITA are poised to detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGNs using only one dataset that covers a large area: the tenth data release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures over the footprint of the eROSITA-DE survey, which avoids issues related to the cross-calibration of surveys. We present the results from CIRCLEZ, a machine-learning algorithm based on a fully connected neural network. CIRCLEZ is built on a training sample of 14 000 X-ray-detected AGNs and utilizes multi-aperture photometry, mapping the light distribution of the sources. The accuracy (σNMAD) and the fraction of outliers (η) reached in a test sample of 2913 AGNs are equal to 0.067 and 11.6%, respectively. The results are comparable to (or even better than) what was previously obtained for the same field, but with much less effort in this instance. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching a comparable accuracy as in eFEDS when limiting the magnitude of the counterparts to the depth of LS10. The method can be applied to fainter samples of AGNs using deeper optical data from future surveys (for example, LSST, Euclid), granting LS10-like information on the light distribution beyond the morphological type. Along with this paper, we have released an updated version of the photometric redshifts (including errors and probability distribution functions) for eROSITA/eFEDS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Counterpart identification and classification for eRASS1 and characterisation of the active galactic nuclei content

Context. Accurately accounting for the Active Galactic Nucleus (AGN) phase in galaxy evolution requires a large, clean AGN sample. This is now possible with SRG/eROSITA, which completed its first all-sky X-ray survey (eRASS1) on June 12, 2020. The public Data Release 1 (DR1, Jan 31, 2024) includes 930,203 sources from the western Galactic hemisphere. Aims. The data enable the selection of a large AGN sample and the discovery of rare sources. However, scientific return depends on accurate characterisation of the X-ray emitters, requiring high-quality multi-wavelength data. This paper presents the identification and classification of optical and infrared counterparts to eRASS1 sources. Methods. Counterparts to eRASS1 X-ray point sources were identified using Gaia DR3, CatWISE2020, and Legacy Survey DR10 (LS10) with the Bayesian NWAY algorithm and trained priors. Sources were classified as Galactic or extragalactic via a machine-learning model combining optical/IR and X-ray properties, trained on a reference sample. For extragalactic LS10 sources, photometric redshifts were computed using CIRCLEZ. Results. Within the LS10 footprint, all 656,614 eROSITA/DR1 sources have at least one possible optical counterpart; ∼570 000 are extragalactic and likely AGN. Half are new detections compared to AllWISE, Gaia, and Quaia AGN catalogues. Gaia and CatWISE2020 counterparts are less reliable, due to the survey’s shallowness and the limited amount of features available to assess the probability of being an X-ray emitter. In the Galactic plane, where the overdensity of stellar sources also increases the chance of associations, using conservative reliability cuts, we identified approximately 18 000 Gaia and 55 000 CatWISE2020 extragalactic sources. Conclusions. We have released three high-quality counterpart catalogues – plus the training and validation sets – as a benchmark for the field. These datasets have many applications, but in particular, they empower researchers to build AGN samples tailored for completeness and purity, accelerating the hunt for the Universe’s most energetic engines.

X-rays: general↗