Search NASASearch

SEARCH · Search NASA

Results for “robust statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Robust statistical methods for automated outlier detection

The computational challenge of automating outlier, or blunder point, detection in radio metric data requires the use of nonstandard statistical methods because the outliers have a deleterious effect on standard least squares methods. The particular nonstandard methods most applicable to the task are the robust statistical techniques that have undergone intense development since the 1960s. These new methods are by design more resistant to the effects of outliers than standard methods. Because the topic may be unfamiliar, a brief introduction to the philosophy and methods of robust statistics is presented. Then the application of these methods to the automated outlier detection problem is detailed for some specific examples encountered in practice.

Jee, J. R.

Coherent Uncertainty Analysis of Aerosol Measurements from Multiple Satellite Sensors

Aerosol retrievals from multiple spaceborne sensors, including MODIS (on Terra and Aqua), MISR, OMI, POLDER, CALIOP, and SeaWiFS altogether, a total of 11 different aerosol products were comparatively analyzed using data collocated with ground-based aerosol observations from the Aerosol Robotic Network (AERONET) stations within the Multi-sensor Aerosol Products Sampling System (MAPSS, http://giovanni.gsfc.nasa.gov/mapss/ and http://giovanni.gsfc.nasa.gov/aerostat/). The analysis was performed by comparing quality-screened satellite aerosol optical depth or thickness (AOD or AOT) retrievals during 2006-2010 to available collocated AERONET measurements globally, regionally, and seasonally, and deriving a number of statistical measures of accuracy. We used a robust statistical approach to detect and remove possible outliers in the collocated data that can bias the results of the analysis. Overall, the proportion of outliers in each of the quality-screened AOD products was within 12%. Squared correlation coefficient (R2) values of the satellite AOD retrievals relative to AERONET exceeded 0.6, with R2 for most of the products exceeding 0.7 over land and 0.8 over ocean. Root mean square error (RMSE) values for most of the AOD products were within 0.15 over land and 0.09 over ocean. We have been able to generate global maps showing regions where the different products present advantages over the others, as well as the relative performance of each product over different landcover types. It was observed that while MODIS, MISR, and SeaWiFS provide accurate retrievals over most of the landcover types, multi-angle capabilities make MISR the only sensor to retrieve reliable AOD over barren and snow / ice surfaces. Likewise, active sensing enables CALIOP to retrieve aerosol properties over bright-surface shrublands more accurately than the other sensors, while POLDER, which is the only one of the sensors capable of measuring polarized aerosols, outperforms other sensors in certain smoke-dominated regions, including broadleaf evergreens in Brazil and South-East Asia.

remote sensing

Statistical Perspectives on Stratospheric Transport

Long-lived tropospheric source gases, such as nitrous oxide, enter the stratosphere through the tropical tropopause, are transported throughout the stratosphere by the Brewer-Dobson circulation, and are photochemically destroyed in the upper stratosphere. These chemical constituents, or "tracers" can be used to track mixing and transport by the stratospheric winds. Much of our understanding about the stratospheric circulation is based on large scale gradients and other spatial features in tracer fields constructed from satellite measurements. The point of view presented in this paper is different, but complementary, in that transport is described in terms of tracer probability distribution functions (PDFs). The PDF is computed from the measurements, and is proportional to the area occupied by tracer values in a given range. The flavor of this paper is tutorial, and the ideas are illustrated with several examples of transport-related phenomena, annotated with remarks that summarize the main point or suggest new directions. One example shows how the multimodal shape of the PDF gives information about the different branches of the circulation. Another example shows how the statistics of fluctuations from the most probable tracer value give insight into mixing between different regions of the atmosphere. Also included is an analysis of the time-dependence of the PDF during the onset and decline of the winter circulation, and a study of how "bursts" in the circulation are reflected in transient periods of rapid evolution of the PDF. The dependence of the statistics on location and time are also shown to be important for practical problems related to statistical robustness and satellite sampling. The examples illustrate how physically-based statistical analysis can shed some light on aspects of stratospheric transport that may not be obvious or quantifiable with other types of analyses. An important motivation for the work presented here is the need for synthesis of the large and growing database of observations of the atmosphere and the vast quantities of output generated by atmospheric models.

Sparling, L. C.

Statistical Analysis of CFD Solutions from the Drag Prediction Workshop

A simple, graphical framework is presented for robust statistical evaluation of results obtained from N-Version testing of a series of RANS CFD codes. The solutions were obtained by a variety of code developers and users for the June 2001 Drag Prediction Workshop sponsored by the AIAA Applied Aerodynamics Technical Committee. The aerodynamic configuration used for the computational tests is the DLR-F4 wing-body combination previously tested in several European wind tunnels and for which a previous N-Version test had been conducted. The statistical framework is used to evaluate code results for (1) a single cruise design point, (2) drag polars and (3) drag rise. The paper concludes with a discussion of the meaning of the results, especially with respect to predictability, Validation, and reporting of solutions.

Hemsch, Michael J.

Validating Coherence Measurements Using Aligned and Unaligned Coherence Functions

This paper describes a novel approach based on the use of coherence functions and statistical theory for sensor validation in a harsh environment. By the use of aligned and unaligned coherence functions and statistical theory one can test for sensor degradation, total sensor failure or changes in the signal. This advanced diagnostic approach and the novel data processing methodology discussed provides a single number that conveys this information. This number as calculated with standard statistical procedures for comparing the means of two distributions is compared with results obtained using Yuen's robust statistical method to create confidence intervals. Examination of experimental data from Kulite pressure transducers mounted in a Pratt & Whitney PW4098 combustor using spectrum analysis methods on aligned and unaligned time histories has verified the effectiveness of the proposed method. All the procedures produce good results which demonstrates how robust the technique is.

Miles, Jeffrey Hilton

Real-Time Kennedy Space Center and Cape Canaveral Air Force Station High-Resolution Model Implementation and Verification

Customer: NASA's Launch Services Program (LSP), Ground Systems Development and Operations (GSDO), and Space Launch System (SLS) programs. NASA's LSP, GSDO, SLS and other programs at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) use the daily and weekly weather forecasts issued by the 45th Weather Squadron (45 WS) as decision tools for their day-to-day and launch operations on the Eastern Range (ER). For example, to determine if they need to limit activities such as vehicle transport to the launch pad, protect people, structures or exposed launch vehicles given a threat of severe weather, or reschedule other critical operations. The 45 WS uses numerical weather prediction models as a guide for these weather forecasts, particularly the Air Force Weather Agency (AFWA) 1.67 kilometer Weather Research and Forecasting (WRF) model. Considering the 45 WS forecasters' and Launch Weather Officers' (LWO) extensive use of the AFWA model, the 45 WS proposed a task at the September 2013 Applied Meteorology Unit (AMU) Tasking Meeting requesting the AMU verify this model. Due to the lack of archived model data available from AFWA, verification is not yet possible. Instead, the AMU proposed to implement and verify the performance of an ER version of the AMU high-resolution WRF Environmental Modeling System (EMS) model (Watson 2013) in real-time. The tasking group agreed to this proposal; therefore the AMU implemented the WRF-EMS model on the second of two NASA AMU modeling clusters. The model was set up with a triple-nested grid configuration over KSC/CCAFS based on previous AMU work (Watson 2013). The outer domain (D01) has 12-kilometer grid spacing, the middle domain (D02) has 4-kilometer grid spacing, and the inner domain (D03) has 1.33-kilometer grid spacing. The model runs a 12-hour forecast every hour, D01 and D02 domain outputs are available once an hour and D03 is every 15 minutes during the forecast period. The AMU assessed the WRF-EMS 1.33-kilometer domain model performance for the 2014 warm season (May-September). Verification statistics were computed using the Model Evaluation Tools, which compared the model forecasts to observations. The mean error values were close to 0 and the root mean square error values were less than 1.8 for mean sea-level pressure (millibars), temperature (degrees Kelvin), dewpoint temperature (degrees Kelvin), and wind speed (per millisecond), all very small differences between the forecast and observations considering the normal magnitudes of the parameters. The precipitation forecast verification results showed consistent under-forecasting of the precipitation object size. This could be an artifact of calculating the statistics for each hour rather than for the entire 12-hour period. The AMU will continue to generate verification statistics for the 1.33-kilometer WRF-EMS domain as data become available in future cool and warm seasons. More data will produce more robust statistics and reveal a more accurate assessment of model performance. Once the formal task was complete, the AMU conducted additional work to better understand the wind direction results. The results were stratified diurnally and by wind speed to determine what effects the stratifications would have on the model wind direction verification statistics. The results are summarized in the addendum at the end of this report. In addition to verifying the model's performance, the AMU also made the output available in the Advanced Weather Interactive Processing System II (AWIPS II). This allows the 45 WS and AMU staff to customize the model output display on the AMU and Range Weather Operations AWIPS II client computers and conduct real-time subjective analyses. In the future, the AMU will implement an updated version of the WRF-EMS model that incorporates local data assimilation. This model will also run in real-time and be made available in AWIPS II.

Numerical Weather Prediction

Overview and Statistical Analysis of Boundary Layer Clouds and Precipitation Over the Western North Atlantic Ocean

Due to their fast evolution and large natural variability in macro- and microphysical properties, the accurate representation of boundary layer clouds in current climate models remains a challenge. One of the regions with large intermodel spread in the Coupled Model Intercomparison Project Phase 6 ensemble is the western North Atlantic Ocean. Here, statistically representative in situ measurements can help to develop and constrain the parameterization of clouds in global models. To this end, we performed comprehensive measurements of boundary layer clouds, aerosol, trace gases, and radiation in the western North Atlantic Ocean during the NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) mission. In total, 174 research flights with 574 flight hours for cloud and precipitation measurements were performed with the HU-25 Falcon during three winter (February–March 2020, January–April 2021, and November 2021–March 2022) and three summer seasons (August–September 2020, May–June 2021, and May–June 2022). Here we present a statistical evaluation of 16 140 individual cloud events probed by the fast cloud droplet probe and the two-dimensional stereo cloud probe during 155 research flights in a representative and repetitive flight strategy allowing for robust statistical data analyses. We show that the vertical profiles of distributions of the liquid water content and the cloud droplet effective diameter (ED) increase with altitude in the marine boundary layer. Due to higher updraft speeds, higher cloud droplet number concentrations (N liquid ) were measured in winter compared to summer despite lower cloud condensation nucleus abundance. Flight cloud cover derived from statistical analysis of in situ data is reduced in summer and shows large variability. This seasonal contrast in cloud coverage is consistent with a dominance of a synoptic pattern in winter that favors conditions for the formation of stratiform clouds at the western edge of cyclones (post-cyclonic). In contrast, a dominant summer anticyclone is concomitant with the occurrence of shallow cumulus clouds and lower cloud coverage. The evaluation of boundary layer clouds and precipitation in the N liquid ED phase space sheds light on liquid, mixed-phase, and ice cloud properties and helps to categorize the cloud data. Ice and liquid precipitation, often masked in cloud statistics by a high abundance of liquid clouds, is often observed throughout the cloud. The ACTIVATE in situ cloud measurements provide a wealth of cloud information useful for assessing airborne and satellite remote-sensing products, for global climate and weather model evaluations, and for dedicated process studies that address precipitation and aerosol–cloud interactions.

Aerosol

The Salience of Nonlinearities in the Boreal Winter Response to ENSO: North Pacific and North America

The prominence of nonlinearities in the response to El Niño as compared to La Niña, to moderate El Niño events as compared to extreme El Ninño events, and to different flavors of El Niño events, are analyzed using the NASA Goddard Earth Observing System Chemistry-Climate Model. In the Central North Pacific region where the sea level pressure response to El Niño-Southern Oscillation (ENSO) peaks, nonlinearities are relatively muted. In contrast, changes to the east of this region (i.e. the far-Northeastern Pacific) and to the north of this region (over Alaska) in response to different ENSO phases are more clearly nonlinear, and become statistically robust after more than 15 events are considered. The relative prominence of these nonlinearities is related to the zonal wavenumber of the tropical precipitation response. Associated with these nonlinearities over the far-Northeastern Pacific are nonlinearities in precipitation over Western United States and surface temperature over Northwest North America and Midwestern United States. In all regions at least 15 events of each type are necessary before nonlinearities can be identified as statistically significant at the 95% confidence level due to the presence of internal atmospheric variability. As there have only been a similar number of ENSO events to the total needed for significance since 1920, it is not surprising that it has been difficult to establish statistically significant nonlinearities using observational data.

Nonlinearities

Robust Matching of Wavelet Features for Sub-Pixel Registration of Landsat Data

For many Earth and Space Science applications, automatic geo-registration at sub-pixel accuracy has become a necessity. In this work, we are focusing on building an operational system, which will provide a sub-pixel accuracy registration of Landsat-5 and Landsat-7 data. The input to our registration method consists of scenes that have been geometrically and radiometrically corrected. Such pre-processed scenes are then geo-registered relative to a database of Landsat chips. The method assumes a transformation composed of a rotation and a translation, and utilizes rotation- and translation-invariant wavelets to extract image features that are matched using statistically robust feature matching and a generalized Hausdorff distance metric. The registration process is described and results on four Landsat input scenes of the Washington, D.C. area are presented.

LeMoigne, Jacqueline

The Statistical Mechanics of Ideal MHD Turbulence

Turbulence is a universal, nonlinear phenomenon found in all energetic fluid and plasma motion. In particular. understanding magneto hydrodynamic (MHD) turbulence and incorporating its effects in the computation and prediction of the flow of ionized gases in space, for example, are great challenges that must be met if such computations and predictions are to be meaningful. Although a general solution to the "problem of turbulence" does not exist in closed form, numerical integrations allow us to explore the phase space of solutions for both ideal and dissipative flows. For homogeneous, incompressible turbulence, Fourier methods are appropriate, and phase space is defined by the Fourier coefficients of the physical fields. In the case of ideal MHD flows, a fairly robust statistical mechanics has been developed, in which the symmetry and ergodic properties of phase space is understood. A discussion of these properties will illuminate our principal discovery: Coherent structure and randomness co-exist in ideal MHD turbulence. For dissipative flows, as opposed to ideal flows, progress beyond the dimensional analysis of Kolmogorov has been difficult. Here, some possible future directions that draw on the ideal results will also be discussed. Our conclusion will be that while ideal turbulence is now well understood, real turbulence still presents great challenges.

Shebalin, John V.

Structural Certification of Human-Rated Inflatable Space Structures

This paper details the results of an initial study to develop a certification plan for human-rated inflatable space structures, including guidelines for qualification testing. Habitable softgoods inflatables are multi-layered shell structures that use high-strength webbing, cordage and broadcloth fabric to carry the skin loads of a variety of volumetric shapes and structural architectures. The primary objectives of this study are to define the key parameters that affect these structures and propose a statistically robust approach to defining safety and knockdown factors based on test and analysis. Current NASA standards for habitable inflatable space structures use a factor of safety of 4, which was inherited from airship design criteria. An updated approach to defining a design factor, taking into account material strength variability, load variability in the article, number of test samples, and damage and degradation effects is specified. Accurate analytical modeling of these structures is hindered by the difficulty of obtaining accurate and consistent material data due to load-history- dependent, nonlinear load versus strain behavior. A building block approach to certification is detailed that uses stochastic modeling and statistical test design and analysis to address the unique challenges these high-strength softgoods structures present. Human-rated inflatable modules are a transformative capability for launching much larger habitable volumes into space than is possible with rigid shell structures. This research aims to provide the framework for certifying these structures for future human space exploration missions.

Jones, Thomas C.

Three Years of Airborne Observations During NASA Activate: A Statistical Summary of Chemical, Optical, and Microphysical Aerosol Properties Over the Western North Atlantic Ocean

Airborne observations are critical to understanding Earth’s climate system and surface-level air quality by providing both spatial and vertical information that is not possible through ground measurement networks or satellite observations. Airborne platforms allow assessments of long-range transport, vertical redistribution, boundary-layer dynamics, and cloud-aerosol-interactions that are critical to model evaluation and satellite validation. Still, the high cost and effort of aircraft operations can limit measurement campaigns to short, focused time periods. Multiple deployments are often necessary for seasonal comparisons, and results can be limited if target phenomenon are infrequent. Subsequent analyses typically focus on case studies, especially if deployment conditions are climatologically anomalous. The NASA ACTIVATE (Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment) mission was designed to overcome these limitations by operating semi-continuously over multiple months during multiple seasons. Flight plans were intentionally simple, repetitive, and systematic to provide a statistically robust dataset that could be utilized similarly to a ground-network. Here, we present an overview of three years (2020-2022) of aerosol measurements from the NASA HU-25 Falcon aircraft supporting the ACTIVATE mission. Data from 179 flights were considered, the majority of which were based at NASA Langley Research Center and flown locally over the Wester North Atlantic Ocean just east of Hampton, VA, USA. Airmass characteristics tended to transition from continental outflow near the coast to mostly marine over the open ocean. Seasonal, diurnal, spatial, and vertical trends in aerosol microphysical, optical, and chemical properties are discussed in the context of synoptic scale meteorology. Statistical benefits of the ACTIVATE sampling strategy are discussed with regard to future model evaluation.

Luke D Ziemba

Architecture and Dynamics of Kepler's Multi-Transiting Planet Systems.III. Comprehensive Investigation Using All Four Years of Kepler Mission Data

We study the orbital architectures of planetary systems orbiting within ∼1 AU of their stars by analyzing the ensemble of Kepler systems having two or more planet candidates. We use data from the entire Kepler mission, and in many cases we apply improved analysis techniques (e.g., replacing histograms by top-hat Kernel Density Estimators that avoid the loss of information resulting from choosing a particular phase for the bin boundaries) to extend and enhance the studies of Lissauer et al. (2011, ApJS 197, 8) and Fabrycky et al. (2014, ApJ 790, 146).These data show ~ 1700 transiting planet candidates in > 600 multiple-planet systems, far more than were available for our previous two studies. The increased numbers and better information about planetary radii and the properties of stellar hosts made possible by Gaia DR2 allow more statistically-robust analyses of the entire ensemble of Kepler multis as well as independent analyses of subsets of the population. We are thus able to contrast the dynamical configurations of small and large planets, short-period and longer-period planets, and planets orbiting various types of host stars. We reinforce our previous findings that most pairs of planets within the same system are neither in nor near low-order mean motion resonances and that there is a substantial excess of planets having period ratios slightly larger than those of first-order mean-motion resonances. However, neglecting three systems whose planets are locked in 3- body resonances and summing over all first-order mean motion resonances, the deficit of planet pairs with period ratios just narrow of resonance is as large as the excess of planets wide of resonance (within statistical uncertainties), suggesting that overall there is no overall excess of planet pairs in the vicinity of resonance. Other aspects of our study, including estimates of the typical relative inclinations of planetary orbits and their variations as functions of orbital period, planet sizes and stellar properties, are in progress, with results expected to be available for presentation by the time of the conference.

Lissauer, Jack

Acoustic space occupancy: Combining ecoacoustics and lidar to model biodiversity variation and detection bias across heterogeneous landscapes

There is global interest in quantifying changing biodiversity in human-modified landscapes. Ecoacoustics may offer a promising pathway for supporting multi-taxa monitoring, but its scalability has been hampered by the sonic complexity of biodiverse ecosystems and the imperfect detectability of animal-generated sounds. The acoustic signature of a habitat, or soundscape, contains information about multiple taxa and may circumvent species identification, but robust statistical technology for characterizing community-level attributes is lacking. Here, we present the Acoustic Space Occupancy Model, a flexible hierarchical framework designed to account for detection artifacts from acoustic surveys in order to model biologically relevant variation in acoustic space use among community assemblages. We illustrate its utility in a biologically and structurally diverse Amazon frontier forest landscape, a valuable test case for modeling biodiversity variation and acoustic attenuation from vegetation density. We use complementary airborne lidar data to capture aspects of 3D forest structure hypothesized to influence community composition and acoustic signal detection. Our novel analytic framework permitted us to model both the assembly and detectability of soundscapes using lidar-derived estimates of forest structure. Our empirical predictions were consistent with physical models of frequency-dependent attenuation, and we estimated that the probability of observing animal activity in the frequency channel most vulnerable to acoustic attenuation varied by over 60%, depending on vegetation density. There were also large differences in the biotic use of acoustic space predicted for intact and degraded forest habitats, with notable differences in the soundscape channels predominantly occupied by insects. This study advances the utility of ecoacoustics by providing a robust modeling framework for addressing detection bias from remote audio surveys while preserving the rich dimensionality of soundscape data, which may be critical for inferring biological patterns pertinent to multiple taxonomic groups in the tropics. Our methodology paves the way for greater integration of remotely sensed observations with high-throughput biodiversity data to help bring routine, multi-taxa monitoring to scale in dynamic and diverse landscapes.

Airborne lidar

Assessment of Low Cycle Fatigue Behavior of Powder Metallurgy Alloy U720

The fatigue lives of modem powder metallurgy disk alloys are influenced by variabilities in alloy microstructure and mechanical properties. These properties can vary as functions of variables the different steps of materials/component processing: powder atomization, consolidation, extrusion, forging, heat treating, and machining. It is important to understand the relationship between the statistical variations in life and these variables, as well as the change in life distribution due to changes in fatigue loading conditions. The objective of this study was to investigate these relationships in a nickel-base disk superalloy, U720, produced using powder metallurgy processing. Multiple strain-controlled fatigue tests were performed at 538 C (1000 F) at limited sets of test conditions. Analyses were performed to: (1) assess variations of microstructure, mechanical properties, and LCF failure initiation sites as functions of disk processing and loading conditions; and (2) compare mean and minimum fatigue life predictions using different approaches for modeling the data from assorted test conditions. Significant variations in life were observed as functions of the disk processing variables evaluated. However, the lives of all specimens could still be combined and modeled together. The failure initiation sites for tests performed at a strain ratio R(sub epsilon) = epsilon(sub min)/epsilon(sub max) of 0 were different from those in tests at a strain ratio of -1. An approach could still be applied to account for the differences in mean and maximum stresses and strains. This allowed the data in tests of various conditions to be combined for more robust statistical estimates of mean and minimum lives.

Gabb, Tomothy P.