Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

PNNL-Predictive-Phenomics/ProteoMeter

ProteoMeter is a Python package that assists in the statistical analysis of global proteomics, protein post-translation modification (PTM), and limited proteolysis (LiP) data. It contains batch correction, normalization, and statistical testing methods, as well as functions that "roll up" peptide-level data to the single-site level. It has a robust user configuration system, allowing it to flexibly integrate different types of experiment designs. For basic usage, a simple configuration file provides the essential functionality. Advanced users have access to the entire statistical pipeline for fine-tuning analyses. Processed data is easily exported to many common spreadsheet and data-frame formats.

Rozum, Jordan [Pacific Northwest National Lab]↗
DOE OSTI2021

Morning boundary layer conditions for shallow to deep convective cloud evolution during the dry season in the central Amazon

Observations of the boundary layer (BL) processes are analyzed statistically for dry seasons of 2 years and in detail, as case studies, for 4 shallow convective days (ShCu) and 4 shallow-to-deep convective days (ShDeep) using a suite of ground-based measurements from the Observation and Modeling of the Green Ocean Amazon (GoAmazon 2014/5) Experiment. The BL stages in ShDeep days, from the nighttime to the cloudy mixing layer stage, are then described in comparison with ShCu days. Atmospheric thermodynamics and dynamics, environmental profiles, and surface turbulent fluxes were employed to compare these two distinct situations for each stage of the BL evolution. Particular attention is given to the morning transition stage, in which the BL changes from stable to unstable conditions in the early morning hours. Results show that the decrease in time duration of the morning transition on ShDeep days is associated with high humidity and well-established vertical wind shear patterns. Higher humidity since nighttime not only contributes to lowering the cloud base during the rapid growth of the BL but also contributes to the balance between radiative cooling and turbulent mixing during nighttime, resulting in higher sensible heat flux in the early morning. The sensible heat flux promotes rapid growth of the well-mixed layer, thus favoring the deeper BL starting from around 08:00 LST (UTC-4 h). Under these conditions, the time duration of morning transition is used to promote convection, having an important effect on the convective BL strength and leading to the formation of shallow cumulus clouds and their subsequent evolution into deep convective clouds. Statistical analysis was used to validate the conceptual model obtained from the case studies. Despite the case-to-case variability, the statistical analyses of the processes in the BL show that the described processes are very representative of cloud evolution during the dry season.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1980

Assessment of chamber pressure oscillations in the Shuttle SRB

Combustion stability evaluations of the Shuttle solid propellant booster motor are reviewed. Measurement of the amplitude and frequency of low level chamber pressure oscillations which have been detected in motor firings, are discussed and a statistical analysis of the data is presented. Oscillatory data from three recent motor firings are shown and the results are compared with statistical predictions which are based on earlier motor firings.

Mathes, H. B.↗
NASA NTRS1983

First-ranked galaxies in groups

A statistical analysis of five group catalogs shows that the B(0) magnitudes of first-ranked group members are consistent with a statistical model in which the luminosities of all group members are drawn from the same distribution. As in the Hickson compact groups, indications are that first-ranked group members are only rarely the products of distinctive evolutionary processes. Distance-dependent selection effects can introduce spurious correlations among group parameters which may appear to support environment-dependent evolution of the first-ranked group members.

Geller, M. J.↗
NASA NTRS1985

Changes in muscle protein composition induced by disuse atrophy - Analysis by two-dimensional electrophoresis

Using 320 g rats, a two-dimensional electrophoretic analysis of muscle proteins in the soleus and EDL muscles from hindlimbs maintained load-free for 10 days is performed. Statistical analysis of the two-dimensional patterns of control and suspended groups reveals more protein alteration in the soleus muscle, with 25 protein differences, than the EDL muscle, with 9 protein differences, as a result of atrophy. Most of the soleus differences reside in minor components. It is suggested that the EDL may also show alteration in its two-dimensional protein map, even though no significant atrophy occurred in muscle wet weight. It is cautioned that strict interpretation of data must take into account possible endocrine perturbations.

Ellis, S.↗
NASA NTRS1988

Spatial and temporal variability of VAS radiance measurements by structure and correlation analysis

The statistical structure function analysis presently applied to VISSR Atmospheric Sounder (VAS) measurements has been extended to include time, and yields structure plots in either two spatial dimensions or one spatial dimension and time that indicate three-dimensional measurement variability. The analyses that include time as a coordinate also yield an indication of the mean speed and direction of the analyzed data. Results for three-hourly VAS data indicate that sampling at a high, approximately 1-hour, frequency is required in order to correctly monitor VAS measurements' temporal variability in a way equivalent to high spatial resolution.

Hillger, Donald W.↗
NASA NTRS1987

Characterization of fault recovery through fault injection on FTMP

The development of fault-injection procedures and statistical analysis techniques to characterize the fault recovery of fault-tolerant systems is described. Pin-level fault-injection was conducted on a fault-tolerant microprocessor computer in order to generate data to assess the utility of current fault-injection sampling methods. The validity of common reliability-modeling assumptions concerning the statistical distribution of recovery times is investigated. A multiple comparison analysis for detecting behavior variations, and a distribution fitting for determining the best fit for the data were conducted. It is observed that the detection behavior is not homogeneous across all data sets, and that none of the factors under experimental control can account for the observed groupings of behavior. It is determined that no single distribution fits all the data sets, and that stratified random sampling and statistically robust parameter-estimation techniques are required to characterize fault detection time.

Finelli, George B.↗
NASA NTRS1986

Interpreting forest and grassland biome productivity utilizing nested scales of image resolution and biogeographical analysis

Several hardware, software, and data collection problems encountered were conquered. The Geographic Information System (GIS) data from other systems were converted to ERDAS format for incorporation with the image data. Statistical analysis of the relationship between spectral values and productivity is being pursued. Several project sites, including Jackson, Pope, Boulder, Smokies, and Huntington Forest are evolving as the most intensively studied areas, primarily due to availability of data and time. Progress with data acquisition and quality checking, more details on experimental sites, and brief summarizations of research results and future plans are discussed. Material on personnel, collaborators, facilities, site background, and meetings and publications of the investigators are included.

Iverson, L. R.↗
NASA NTRS1976

Data analysis report on ATS-F COMSAT millimeter wave propagation experiment, part 1

The 13/18 GHz COMSAT Propagation Experiment (CPE) was performed to measure attenuation caused by hydrometeors along slant paths from transmitting terminals on the ground to the ATS-6 satellite. The effectiveness of site diversity in overcoming this impairment was also studied. Problems encountered in assembling a valid data base of rain induced attenuation data for statistical analysis are considered. The procedures used to obtain the various statistics are then outlined. The graphs and tables of statistical data for the 15 dual frequency (13 and 18 GHz) site diversity locations are discussed. Cumulative rain rate statistics for the Fayetteville and Boston sites based on point rainfall data collected are presented along with extrapolations of the attenuation and point rainfall data.

Hyde, G.↗
NASA NTRS1971

Thermal scale modeling

Complex system study data indicate that factors associated with multilayer insulation pose major problem in scale modeling, that numerical analysis aids correction for known compromises of scaling criteria, and that probable errors in scale modeling experiments fall within range predicted by statistical analysis.

Mac Gregor, R. K.↗
NASA NTRS1974

Statistical separability of spectral classes of blighted corn

A study was conducted to determine the statistical separability of multispectral measurements from corn having varying levels of southern corn leaf blight severity. Multispectral scanner data in twelve spectral channels in the wavelength range 0.4 to 11.7 microns were analyzed for ten selected flightlines of the 1971 Corn Blight Watch Experiment. A total of 168 corn fields having 18,804 sample points were analyzed. The blight rating information for these fields was available from ground observations. Maximum average transformed divergence between spectral classes of all possible pairs of blight levels, maximized over a subset of channels, was computed in each of one, two, three, and four spectral channels for each of ten flightlines. From the statistical analysis of the values of average transformed divergence, it was concluded that the greater the difference between the blight levels, the more statistically separable they are.

Kumar, R.↗
NASA NTRS2008

Modern Era Retrospective Restrospective-Analysis for Research and Applications (MERRA) Data and Services at the GES DISC

The Modern Era Retrospective-analysis for Research and Applications (MERRA) dataset is a NASA satellite era, 30 year (1979 - present), reanalysis using the Goddard Earth Observing System Data Assimilation System, Version 5 (GEOS-5). The project, run out of NASA's Global Modeling and Assimilation Office at Goddard Space Flight Center, provides the science and application communities with a state-of-the-art global analysis with emphasis on improved estimates of the hydrological cycle over a broad range of weather and climate time scales. MERRA products are generated as a long-term synthesis that places the NASA EOS suite of observations in a climate context. The MERRA analysis is performed at a horizontal resolution of 2/3 longitude x 1/2 latitude (540x361 global gridpoints) with observational analyses every 6 hours. The MERRA output data will include 3 dimensional state fields for every 6 hourly analysis cycle on 42 pressure levels (or 72 terrain following model coordinate levels) from the surface through the stratosphere. Several data products are specifically designed to support chemistry and stratosphere transport modeling. The 2 dimensional surface and atmospheric diagnostics (numbering 259) are being stored on the native grid at 1 hourly intervals. These include radiation and vertical integrals of the atmosphere for water and energy budget studies and also surface diagnostics where the diurnal cycle is important. The one hourly surface and near surface data product will also facilitate research on the integrated analysis of Earth system observations in the land, ocean and cryosphere. The MERRA products are archived and distributed by the Goddard Earth Sciences Data and Information Services Center (GES DISC) through its Modeling DISC Web (MDISC) portal. Multiple data access methods and services are available for MERRA data through MDISC: (1) Mirador offers a quick, comprehensive search of MERRA and all GES DISC archived data holdings, allowing searches on keywords, location names or latitude/longitude box, and date/time, with responses within a few seconds. (2) Giovanni is a GES DISC developed Web application that provides data visualization and analysis online. Giovanni features popular visualizations such as latitude-longitude maps, animations, cross sections, profiles, time series, etc. and some basic statistical analysis functions such as scatter plots and correlation coefficient maps. Users are able to download results in several different formats, including Google Earth. (3) On-the-fly parameter subsetting of data within a spatial/temporal window is provided through a simple select and click Web page. (4) MERRA data are also available via OPeNDAP, GrADS Data Server (GDS) and can be converted to netCDF on the fly.

Berrick, Stephen W.↗
NASA NTRS1985

Plasma and magnetospheric research

Progress is reported in the development of programs for statistical analysis of boundary and structure type files based on surveys of Dynamics Explorere data. Programs being used for handling data on plasma boundaries in the inner magnetosphere, the structure of the plasmasphere, and the heavy ion torus may be useful for determining statistics on the warm plasma cloak and the auroral ion fountain. Data analysis and modeling; spacecraft sheath effects; and laboratory plasma flow studies are discussed.

Comfort, R. H.↗
NASA NTRS2015

Wear-Out Sensitivity Analysis Project Abstract

During the course of the Summer 2015 internship session, I worked in the Reliability and Maintainability group of the ISS Safety and Mission Assurance department. My project was a statistical analysis of how sensitive ORU's (Orbital Replacement Units) are to a reliability parameter called the wear-out characteristic. The intended goal of this was to determine a worst case scenario of how many spares would be needed if multiple systems started exhibiting wear-out characteristics simultaneously. The goal was also to determine which parts would be most likely to do so. In order to do this, my duties were to take historical data of operational times and failure times of these ORU's and use them to build predictive models of failure using probability distribution functions, mainly the Weibull distribution. Then, I ran Monte Carlo Simulations to see how an entire population of these components would perform. From here, my final duty was to vary the wear-out characteristic from the intrinsic value, to extremely high wear-out values and determine how much the probability of sufficiency of the population would shift. This was done for around 30 different ORU populations on board the ISS.

Harris, Adam↗
DOE OSTI2021

Dynamics of filaments during the edge-localized mode crash on NSTX

Edge localized modes (ELMs) are routinely observed in H-mode plasma regimes of the National Spherical Torus Experiment (NSTX). Due to the explosive nature of the instability, only diagnostics with high temporal and spatial resolution could provide a detailed insight into the dynamics associated with the ELMs. Gas-puff imaging at NSTX provides 2D measurements of the magnetic field aligned fluctuations (e.g., ELM filaments) in the scrape-off layer and at the plasma edge with 2.5 μs temporal and 10 mm optical resolution. A novel analysis technique was developed to estimate the frame-by-frame velocities and the spatial parameters of the dominant structures associated with the ELMs. The analysis was applied to single ELM events to characterize the ELM crash dynamics and then extended to a database of 159 ELM events. Statistical analysis was performed in order to find the characterizing dynamics of the ELM crash. The results show that on average, an ELM crash consists of a filament with a circular cross section, which is propelled outward with a characterizing peak radial velocity of ~3.3 km/s. The radial velocity was found to be linearly dependent on the distance of the filament from the separatrix, which has never been seen before. The ELM filament is characterized by propagation in the ion-diamagnetic direction poloidally with a peak velocity of 11.4 km/s. The ELM crash lasts for approximately 100 μs until the radial propulsion settles back to the pre-ELM level. Furthermore, the experimental findings were compared with analytical theory. Two possible mechanisms were identified for explaining the observations: the curvature interchange model and the current–filament interaction model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1971

Digital tape unit test facility software

Two computer programs are described which are used for the collection and analysis of data from the digital tape unit test facility (DTUTF). The data are the recorded results of skew tests made on magnetic digital tapes which are used on computers as input/output media. The results of each tape test are keypunched onto an 80 column computer card. The format of the card is checked and the card image is stored on a master summary tape via the DTUTF card checking and tape updating system. The master summary tape containing the results of all the tape tests is then used for analysis as input to the DTUTF histogram generating system which produces a histogram of skew vs. date for selected data, followed by some statistical analysis of the data.

Jackson, J. T.↗