SEARCH · Search NASA

Results for “Statistical Algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

NASA NTRS2010

Exploring a Physically Based Tool for Lightning Cessation: A Preliminary Study

The University of Alabama in Huntsville (UA Huntsville) and NASA's Marshall Space Flight Center are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. The project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UA Huntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. A summary of preliminary results will be presented.

Schultz, Elise V.↗

NASA NTRS2010

Exploring a Physically Based Tool for Lightning Cessation: Preliminary Results

The University of Alabama in Huntsville (UAHuntsville) and NASA s Marshall Space Flight Center are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. The project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. A summary of preliminary results will be presented.

Schultz, Elsie V.↗

NASA NTRS2011

Exploring the Use of Radar for Physically-Based Nowcasting of Lightning Cessation

NASA's Marshall Space Flight Center and the University of Alabama in Huntsville (UAHuntsville) are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. This project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically-based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms driven primarily by trending in the actual total lightning flash rate, we believe that dual polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and ice-microphysics. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can propagation phase-based ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the NASA-MSFC North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. Thus far our case study results suggest that the negative differential phase shift signature weakens and disappears after the analyzed storms ceased lightning production (i.e., after the last lightning flash occurred). This is a key observation because it suggests that while strong electric fields may still have been present, the lightning cessation signature was encompassed in the period of the polarimetric negative phase shift signature. To the extent this behavior is repeatable in other cases, even if only in a substantial fraction of those cases, the analysis suggests that differential propagation phase may prove to be a useful parameter for future lightning cessation algorithms. Indeed, a preliminary analysis of 15+ cases has shown additional indications of the weakening and disappearance of this ice alignment signature with lightning cessation. A summary of these case-study results is presented.

Schultz, Elise V.↗

NASA NTRS2011

Exploring the Use of Radar for a Physically Based Lightning Cessation Nowcasting Tool

NASA s Marshall Space Flight Center (MSFC) and the University of Alabama in Huntsville (UAHuntsville) are collaborating with the 45th Weather Squadron (45WS) at Cape Canaveral Air Force Station (CCAFS) to enable improved nowcasting of lightning cessation. This project centers on use of dual-polarimetric radar capabilities, and in particular, the new C-band dual-polarimetric weather radar acquired by the 45WS. Special emphasis is placed on the development of a physically based operational algorithm to predict lightning cessation. While previous studies have developed statistically based lightning cessation algorithms, we believe that dual-polarimetric radar variables offer the possibility to improve existing algorithms through the inclusion of physically meaningful trends reflecting interactions between in-cloud electric fields and hydrometeors. Specifically, decades of polarimetric radar research using propagation differential phase has demonstrated the presence of distinct phase and ice crystal alignment signatures in the presence of strong electric fields associated with lightning. One question yet to be addressed is: To what extent can these ice-crystal alignment signatures be used to nowcast the cessation of lightning activity in a given storm? Accordingly, data from the UAHuntsville Advanced Radar for Meteorological and Operational Research (ARMOR) along with the NASA-MSFC North Alabama Lightning Mapping Array are used in this study to investigate the radar signatures present before and after lightning cessation. Thus far, our case study results suggest that the negative differential phase shift signature weakens and disappears after the analyzed storms ceased lightning production (i.e., after the last lightning flash occurred). This is a key observation because it suggests that while strong electric fields may still have been present, the lightning cessation signature encompassed the period of the polarimetric negative phase shift signature. To the extent this behavior is repeatable in other cases, even if only in a substantial fraction of those cases, the case analyses suggests that differential propagation phase may prove to be a useful parameter for future lightning cessation algorithms. Indeed, analysis of 15+ cases has shown additional indications of the weakening and disappearance of this ice alignment signature with lightning cessation. A summary of results will be presented.

Schultz, Elise V.↗

NASA NTRS2014

Algorithm for Detection of Ground and Canopy Cover in Micropulse Photon-Counting Lidar Altimeter Data in Preparation for the ICESat-2 Mission

NASA's Ice, Cloud and Land Elevation Satellite-II (ICESat-2) mission is a decadal survey mission (2016 launch). The mission objectives are to measure land ice elevation, sea ice freeboard, and changes in these variables, as well as to collect measurements over vegetation to facilitate canopy height determination. Two innovative components will characterize the ICESat-2 lidar: 1) collection of elevation data by a multibeam system and 2) application of micropulse lidar (photon-counting) technology. A photon-counting altimeter yields clouds of discrete points, resulting from returns of individual photons, and hence new data analysis techniques are required for elevation determination and association of the returned points to reflectors of interest. The objective of this paper is to derive an algorithm that allows detection of ground under dense canopy and identification of ground and canopy levels in simulated ICESat-2 data, based on airborne observations with a Sigma Space micropulse lidar. The mathematical algorithm uses spatial statistical and discrete mathematical concepts, including radial basis functions, density measures, geometrical anisotropy, eigenvectors, and geostatistical classification parameters and hyperparameters. Validation shows that ground and canopy elevation, and hence canopy height, can be expected to be observable with high accuracy by ICESat-2 for all expected beam energies considered for instrument design (93.01%-99.57% correctly selected points for a beam with expected return of 0.93 mean signals per shot (msp), and 72.85%-98.68% for 0.48 msp). The algorithm derived here is generally applicable for elevation determination from photoncounting lidar altimeter data collected over forested areas, land ice, sea ice, and land surfaces, as well as for cloud detection.

Algorithms↗

DOE OSTI2025

An evaluation of multi-fidelity methods for quantifying uncertainty in projections of ice-sheet mass change

Abstract. This study investigated the computational benefits of using multi-fidelity statistical estimation (MFSE) algorithms to quantify uncertainty in the mass change of Humboldt Glacier, Greenland, between 2007 and 2100 using a single climate change scenario. The goal of this study was to determine whether MFSE can use multiple models of varying cost and accuracy to reduce the computational cost of estimating the mean and variance of the projected mass change of a glacier. The problem size and complexity were chosen to reflect the challenges posed by future continental-scale studies while still facilitating a computationally feasible investigation of MFSE methods. When quantifying uncertainty introduced by a high-dimensional parameterization of the basal friction field, MFSE was able to reduce the mean-squared error in the estimates of the statistics by well over an order of magnitude when compared to a single-fidelity approach that only used the highest-fidelity model. This significant reduction in computational cost was achieved despite the low-fidelity models used being incapable of capturing the local features of the ice-flow fields predicted by the high-fidelity model. The MFSE algorithms were able to effectively leverage the high correlation between each model's predictions of mass change, which all responded similarly to perturbations in the model inputs. Consequently, our results suggest that MFSE could be highly useful for reducing the cost of computing continental-scale probabilistic projections of sea-level rise due to ice-sheet mass change.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2010

Automated Conflict Resolution, Arrival Management and Weather Avoidance for ATM

The paper describes a unified solution to three types of separation assurance problems that occur in en-route airspace: separation conflicts, arrival sequencing, and weather-cell avoidance. Algorithms for solving these problems play a key role in the design of future air traffic management systems such as NextGen. Because these problems can arise simultaneously in any combination, it is necessary to develop integrated algorithms for solving them. A unified and comprehensive solution to these problems provides the foundation for a future air traffic management system that requires a high level of automation in separation assurance. The paper describes the three algorithms developed for solving each problem and then shows how they are used sequentially to solve any combination of these problems. The first algorithm resolves loss-of-separation conflicts and is an evolution of an algorithm described in an earlier paper. The new version generates multiple resolutions for each conflict and then selects the one giving the least delay. Two new algorithms, one for sequencing and merging of arrival traffic, referred to as the Arrival Manager, and the other for weather-cell avoidance are the major focus of the paper. Because these three problems constitute a substantial fraction of the workload of en-route controllers, integrated algorithms to solve them is a basic requirement for automated separation assurance. The paper also reviews the Advanced Airspace Concept, a proposed design for a ground-based system that postulates redundant systems for separation assurance in order to achieve both high levels of safety and airspace capacity. It is proposed that automated separation assurance be introduced operationally in several steps, each step reducing controller workload further while increasing airspace capacity. A fast time simulation was used to determine performance statistics of the algorithm at up to 3 times current traffic levels.

Erzberger, H.↗

NASA NTRS2015

A High Performance Computing Approach to Tree Cover Delineation in 1-m NAIP Imagery Using a Probabilistic Learning Framework

Tree cover delineation is a useful instrument in deriving Above Ground Biomass (AGB) density estimates from Very High Resolution (VHR) airborne imagery data. Numerous algorithms have been designed to address this problem, but most of them do not scale to these datasets, which are of the order of terabytes. In this paper, we present a semi-automated probabilistic framework for the segmentation and classification of 1-m National Agriculture Imagery Program (NAIP) for tree-cover delineation for the whole of Continental United States, using a High Performance Computing Architecture. Classification is performed using a multi-layer Feedforward Backpropagation Neural Network and segmentation is performed using a Statistical Region Merging algorithm. The results from the classification and segmentation algorithms are then consolidated into a structured prediction framework using a discriminative undirected probabilistic graphical model based on Conditional Random Field, which helps in capturing the higher order contextual dependencies between neighboring pixels. Once the final probability maps are generated, the framework is updated and re-trained by relabeling misclassified image patches. This leads to a significant improvement in the true positive rates and reduction in false positive rates. The tree cover maps were generated for the whole state of California, spanning a total of 11,095 NAIP tiles covering a total geographical area of 163,696 sq. miles. The framework produced true positive rates of around 88% for fragmented forests and 74% for urban tree cover areas, with false positive rates lower than 2% for both landscapes. Comparative studies with the National Land Cover Data (NLCD) algorithm and the LiDAR canopy height model (CHM) showed the effectiveness of our framework for generating accurate high-resolution tree-cover maps.

Segments↗

DOE OSTI2024

Bayesian optimization algorithms for accelerator physics

Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques toward solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design. Published by the American Physical Society 2024

43 PARTICLE ACCELERATORS↗

NASA NTRS2011

Estimation of Smoothing Error in SBUV Profile and Total Ozone Retrieval

Data from the Nimbus-4, Nimbus-7 Solar Backscatter Ultra Violet (SBUV) and seven of the NOAA series of SBUV/2 instruments spanning 41 years are being reprocessed using V8.6 algorithm. The data are scheduled to be released by the end of August 2011. An important focus of the new algorithm is to estimate various sources of errors in the SBUV profiles and total ozone retrievals. We discuss here the smoothing errors that describe the components of the profile variability that the SBUV observing system can not measure. The SBUV(/2) instruments have a vertical resolution of 5 km in the middle stratosphere, decreasing to 8 to 10 km below the ozone peak and above 0.5 hPa. To estimate the smoothing effect of the SBUV algorithm, the actual statistics of the fine vertical structure of ozone profiles must be known. The covariance matrix of the ensemble of measured ozone profiles with the high vertical resolution would be a formal representation of the actual ozone variability. We merged the MLS (version 3) and sonde ozone profiles to calculate the covariance matrix, which in general case, for single profile retrieval, might be a function of the latitude and month. Using the averaging kernels of the SBUV(/2) measurements and calculated total covariance matrix one can estimate the smoothing errors for the SBUV ozone profiles. A method to estimate the smoothing effect of the SBUV algorithm is described and the covariance matrixes and averaging kernels are provided along with the SBUV(/2) ozone profiles. The magnitude of the smoothing error varies with altitude, latitude, season and solar zenith angle. The analysis of the smoothing errors, based on the SBUV(/2) monthly zonal mean time series, shows that the largest smoothing errors were detected in the troposphere and might be as large as 15-20% and rapidly decrease with the altitude. In the stratosphere above 40 hPa the smoothing errors are less than 5% and between 10 and 1 hPa the smoothing errors are on the order of 1%. We validate our estimated smoothing errors by comparing the SBUV ozone profiles with other ozone profiling sensors.

Kramarova, N. A.↗

NASA NTRS2016

Automated Storm Tracking and the Lightning Jump Algorithm Using GOES-R Geostationary Lightning Mapper (GLM) Proxy Data

This study develops a fully automated lightning jump system encompassing objective storm tracking, Geostationary Lightning Mapper proxy data, and the lightning jump algorithm (LJA), which are important elements in the transition of the LJA concept from a research to an operational based algorithm. Storm cluster tracking is based on a product created from the combination of a radar parameter (vertically integrated liquid, VIL), and lightning information (flash rate density). Evaluations showed that the spatial scale of tracked features or storm clusters had a large impact on the lightning jump system performance, where increasing spatial scale size resulted in decreased dynamic range of the system's performance. This framework will also serve as a means to refine the LJA itself to enhance its operational applicability. Parameters within the system are isolated and the system's performance is evaluated with adjustments to parameter sensitivity. The system's performance is evaluated using the probability of detection (POD) and false alarm ratio (FAR) statistics. Of the algorithm parameters tested, sigma-level (metric of lightning jump strength) and flash rate threshold influenced the system's performance the most. Finally, verification methodologies are investigated. It is discovered that minor changes in verification methodology can dramatically impact the evaluation of the lightning jump system.

lightning jump↗

DOE OSTI2024

Automated Approach to Accurate, Precise, and Fast Detector Simulation and Reconstruction

Detector simulation and reconstruction are a significant computational bottleneck in particle physics. Here, we develop particle-flow neural-assisted simulations (parnassus) to address this challenge. Our deep learning model takes as input a point cloud (particles impinging on a detector) and produces a point cloud (reconstructed particles). By combining detector simulations and reconstruction into one step, we aim to minimize resource utilization and enable fast surrogate models suitable for application both inside and outside large collaborations. We demonstrate this approach using a publicly available dataset of jets passed through the full simulation and reconstruction pipeline of the Compact Muon Solenoid (CMS) experiment. We show that parnassus accurately mimics the CMS particle flow algorithm on the (statistically) same events it was trained on and can generalize to jet momentum and type outside of the training distribution.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1978

Linear stochastic control using the UDU matrix factorization

The classical LQG stochastic control law is reformulated using the matrix factorization S equals UDU super T. This method yields a statistical guidance analysis algorithm that is numerically superior to the classical solution yet requires negligible additional computation and storage. Moreover, experience with U-D algorithms has shown them to be adaptable and easy to implement on a variety of problems.

Thornton, C. L.↗

NASA NTRS1980

Analysis of SETI data collected in the parasitic mode

A system for performing SETI observations continuously as part of non-SETI observations at a radio observatory is presented, and the analysis of results obtained by the parasitic system is discussed. The system, designated SERENDIP, is a real-time microprocessor-controlled spectrum analyzer with algorithms for performing statistical operations and recording those spectra with characteristics presumed to be typical of intelligent rather than astrophysical origin. Programs also exist for the post-acquisition analysis of signal autocorrelation, power spectra, time behavior and positional coordinates, and for a generalized cluster analysis to detect clusters of signal detections. In a recent run of 35 days, the SERENDIP system detected 4000 narrowband spectra exceeding a preset threshold, of which 98% were determined to be of instrumental origin. The remaining class of detections is also believed to be instrumental, although not as well organized as the first signals, and means are currently being sought for eliminating them.

Bowyer, S.↗

NASA NTRS1983

Remote Sensing techniques used to characterize soil erosion in southwestern Sao Paulo state

Within randomly sampled squares of a 1 km x 1 km grid, rill/gullies frequency, land cover/land use type and shape of the slopes were extracted from aerial photographs of the Ribeirao Anhumas drainage basin. Mean slope gradient, stream frequency and slope length were calculated on topographic maps. Ground truth data on fine sand/coarse sand ratio and vegetation cover densities were obtained. The MSS-LANDSAT-2 data (CCTs) were analyzed using single-cell, cluster synthesis and slicer algorithms. Graphical and statistical analyses of the data indicate that different slope gradients and land cover/land use types are the most significant factors related to the soil erosion process. The digital analysis of MSS data allowed the association among gray level classes and vegetation cover classes, which defined seven classes. These gray level classes and slope gradient classes were used to rank erosion risk.

Parada, N. D. J.↗

NASA NTRS1991

Algorithm Reveals Sinusoidal Component Of Noisy Signal

Algorithm performs simple statistical analysis of noisy signal to yield preliminary indication of whether or not signal contains sinusoidal component. Suitable for preprocessing or preliminary analysis of vibrations, fluctuations in pressure, and other signals that include large random components. Implemented on personal computer by easy-to-use program.

Kwok, Lloyd C.↗

NASA NTRS2000

Qualitative Discovery in Medical Databases

Implication rules have been used in uncertainty reasoning systems to confirm and draw hypotheses or conclusions. However a major bottleneck in developing such systems lies in the elicitation of these rules. This paper empirically examines the performance of evidential inferencing with implication networks generated using a rule induction tool called KAT. KAT utilizes an algorithm for the statistical analysis of empirical case data, and hence reduces the knowledge engineering efforts and biases in subjective implication certainty assignment. The paper describes several experiments in which real-world diagnostic problems were investigated; namely, medical diagnostics. In particular, it attempts to show that: (1) with a limited number of case samples, KAT is capable of inducing implication networks useful for making evidential inferences based on partial observations, and (2) observation driven by a network entropy optimization mechanism is effective in reducing the uncertainty of predicted events.

Maluf, David A.↗

NASA NTRS1998

Random Dopant Induced Threshold Voltage Lowering and Fluctuations in Sub-0.1 (micron)meter MOSFET's: A 3-D 'Atomistic' Simulation Study

A three-dimensional (3-D) "atomistic" simulation study of random dopant induced threshold voltage lowering and fluctuations in sub-0.1 microns MOSFET's is presented. For the first time a systematic analysis of random dopant effects down to an individual dopant level was carried out in 3-D on a scale sufficient to provide quantitative statistical predictions. Efficient algorithms based on a single multigrid solution of the Poisson equation followed by the solution of a simplified current continuity equation are used in the simulations. The effects of various MOSFET design parameters, including the channel length and width, oxide thickness and channel doping, on the threshold voltage lowering and fluctuations are studied using typical samples of 200 atomistically different MOSFET's. The atomistic results for the threshold voltage fluctuations were compared with two analytical models based on dopant number fluctuations. Although the analytical models predict the general trends in the threshold voltage fluctuations, they fail to describe quantitatively the magnitude of the fluctuations. The distribution of the atomistically calculated threshold voltage and its correlation with the number of dopants in the channel of the MOSFET's was analyzed based on a sample of 2500 microscopically different devices. The detailed analysis shows that the threshold voltage fluctuations are determined not only by the fluctuation in the dopant number, but also in the dopant position.

Asenov, Asen↗