Search NASA⌕ Search

SEARCH · Search NASA

Results for “randomized algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Coreset Clustering on Small Quantum Computers

Many quantum algorithms for machine learning require access to classical data in superposition. However, for many natural data sets and algorithms, the overhead required to load the data set in superposition can erase any potential quantum speedup over classical algorithms. Recent work by Harrow introduces a new paradigm in hybrid quantum-classical computing to address this issue, relying on coresets to minimize the data loading overhead of quantum algorithms. We investigated using this paradigm to perform k-means clustering on near-term quantum computers, by casting it as a QAOA optimization instance over a small coreset. We used numerical simulations to compare the performance of this approach to classical k-means clustering. We were able to find data sets with which coresets work well relative to random sampling and where QAOA could potentially outperform standard k-means on a coreset. However, finding data sets where both coresets and QAOA work well—which is necessary for a quantum advantage over k-means on the entire data set—appears to be challenging.

42 ENGINEERING↗

Optimal Prediction of Clocks from Finite Data

This talk is about optimal linear prediction of processes with stationary dth increments, which serve as a class of models for random clock disturbances. The predictor is obtained by orthogonal projection on the affine space of estimators whose errors are invariant to additive polynomials of degree < d. The projection conditions give a system of linear equations thatcan be solved straightforwardly for the regression coefficients. If the data are equally spaced, then the predictor can be obtained by an extension of Levinson's algorithm.

stationary increments↗

Far-field thermal imaging below diffraction limit

Non-uniform self-heating and temperature hotspots are major concerns compromising the performance and reliability of submicron electronic and optoelectronic devices. At deep submicron scales where effects such as contact-related artifacts and diffraction limits accurate measurements of temperature hotspots, non-contact thermal characterization can be extremely valuable. In this work, we use a Bayesian optimization framework with generalized Gaussian Markov random field (GGMRF) prior model to obtain accurate full-field temperature distribution of self-heated metal interconnects from their thermoreflectance thermal images (TRI) with spatial resolution 2.5 times below Rayleigh limit for 530nm illumination. Finite element simulations along with TRI experimental data were used to characterize the point spread function of the optical imaging system. In addition, unlike iterative reconstruction algorithms that use ad hoc regularization parameters in their prior models to obtain the best quality image, we used numerical experiments and finite element modeling to estimate the regularization parameter for solving a real experimental inverse problem.

42 ENGINEERING↗

A Systematic Error Correction Method for TOVS Radiances

Treatment of systematic errors is crucial for the successful use of satellite data in a data assimilation system. Systematic errors in TOVS radiance measurements and radiative transfer calculations can be as large or larger than random instrument errors. The usual assumption in data assimilation is that observational errors are unbiased. If biases are not effectively removed prior to assimilation, the impact of satellite data will be lessened and can even be detrimental. Treatment of systematic errors is important for short-term forecast skill as well as the creation of climate data sets. A systematic error correction algorithm has been developed as part of a 1D radiance assimilation. This scheme corrects for spectroscopic errors, errors in the instrument response function, and other biases in the forward radiance calculation for TOVS. Such algorithms are often referred to as tuning of the radiances. The scheme is able to account for the complex, air-mass dependent biases that are seen in the differences between TOVS radiance observations and forward model calculations. We will show results of systematic error correction applied to the NOAA 15 Advanced TOVS as well as its predecessors. We will also discuss the ramifications of inter-instrument bias with a focus on stratospheric measurements.

Joiner, Joanna↗

A Comparison of Techniques for Scheduling Fleets of Earth-Observing Satellites

Earth observing satellite (EOS) scheduling is a complex real-world domain representative of a broad class of over-subscription scheduling problems. Over-subscription problems are those where requests for a facility exceed its capacity. These problems arise in a wide variety of NASA and terrestrial domains and are .XI important class of scheduling problems because such facilities often represent large capital investments. We have run experiments comparing multiple variants of the genetic algorithm, hill climbing, simulated annealing, squeaky wheel optimization and iterated sampling on two variants of a realistically-sized model of the EOS scheduling problem. These are implemented as permutation-based methods; methods that search in the space of priority orderings of observation requests and evaluate each permutation by using it to drive a greedy scheduler. Simulated annealing performs best and random mutation operators outperform our squeaky (more intelligent) operator. Furthermore, taking smaller steps towards the end of the search improves performance.

Globus, Al↗

Far-Field Lorenz-Mie Scattering in an Absorbing Host Medium: Theoretical Formalism and FORTRAN Program

In this paper we make practical use of the recently developed first-principles approach to electromagnetic scattering by particles immersed in an unbounded absorbing host medium. Specifically, we introduce an actual computational tool for the calculation of pertinent far-field optical observables in the context of the classical Lorenzâ€"Mie theory. The paper summarizes the relevant theoretical formalism, explains various aspects of the corresponding numerical algorithm, specifies the input and output parameters of a FORTRAN program available at https://www.giss.nasa.gov/staff/mmishchenko/Lorenz-Mie.html, and tabulates benchmark results useful for testing purposes. This public-domain FORTRAN program enables one to solve the following two important problems: (i) simulate theoretically the reading of a remote well-collimated radiometer measuring electromagnetic scattering by an individual spherical particle or a small random group of spherical particles; and (ii) compute the single-scattering parameters that enter the vector radiative transfer equation derived directly from the Maxwell equations.

Far-field electromagnetic scattering; Absorbing ho↗

Online Learning and Pricing for Network Revenue Management with Reusable Resources

We consider a price-based network revenue management problem with multiple products and multiple reusable resources. Each randomly arriving customer requests a product (service) that needs to occupy a sequence of reusable resources (servers). We adopt an incomplete information setting where the firm does not know the price-demand function for each product and the goal is to dynamically set prices of all products to maximize the total expected revenue of serving customers. We propose novel batched bandit learning algorithms for finding near-optimal pricing policies, and show that they admit a near-optimal cumulative regret bound of $O(J\sqrt{XT})$, where J, X, and T, are the numbers of products, candidate prices, and service periods, respectively. As part of our regret analysis, we develop the first finite-time mixing time analysis of an open network queueing system (i.e., the celebrated Jackson Network), which could be of independent interest. Our numerical studies show that the proposed approaches perform consistently well.

42 ENGINEERING↗

Enhanced Co-Expression Extrapolation (COXEN) Gene Selection Method for Building Anti-Cancer Drug Response Prediction Models

The co-expression extrapolation (COXEN) method has been successfully used in multiple studies to select genes for predicting the response of tumor cells to a specific drug treatment. Here, we enhance the COXEN method to select genes that are predictive of the efficacies of multiple drugs for building general drug response prediction models that are not specific to a particular drug. The enhanced COXEN method first ranks the genes according to their prediction power for each individual drug and then takes a union of top predictive genes of all the drugs, among which the algorithm further selects genes whose co-expression patterns are well preserved between cancer cases for building prediction models. We apply the proposed method on benchmark in vitro drug screening datasets and compare the performance of prediction models built based on the genes selected by the enhanced COXEN method to that of models built on genes selected by the original COXEN method and randomly picked genes. Models built with the enhanced COXEN method always present a statistically significantly improved prediction performance (adjusted p-value ≤ 0.05). Our results demonstrate the enhanced COXEN method can dramatically increase the power of gene expression data for predicting drug response.

60 APPLIED LIFE SCIENCES↗

Measuring the topology of large-scale structure in the universe

An algorithm for quantitatively measuring the topology of large-scale structure has now been applied to a large number of observational data sets. The present paper summarizes and provides an overview of some of these observational results. On scales significantly larger than the correlation length, larger than about 1200 km/s, the cluster and galaxy data are fully consistent with a sponge-like random phase topology. At a smoothing length of about 600 km/s, however, the observed genus curves show a small shift in the direction of a meatball topology. Cold dark matter (CDM) models show similar shifts at these scales but not generally as large as those seen in the data. Bubble models, with voids completely surrounded on all sides by wall of galaxies, show shifts in the opposite direction. The CDM model is overall the most successful in explaining the data.

Gott, J. Richard, III↗

Accurate Magnetometer/Gyroscope Attitudes Using a Filter with Correlated Sensor Noise

Magnetometers and gyroscopes have been shown to provide very accurate attitudes for a variety of spacecraft. These results have been obtained, however, using a batch-least-squares algorithm and long periods of data. For use in onboard applications, attitudes are best determined using sequential estimators such as the Kalman filter. When a filter is used to determine attitudes using magnetometer and gyroscope data for input, the resulting accuracy is limited by both the sensor accuracies and errors inherent in the Earth magnetic field model. The Kalman filter accounts for the random component by modeling the magnetometer and gyroscope errors as white noise processes. However, even when these tuning parameters are physically realistic, the rate biases (included in the state vector) have been found to show systematic oscillations. These are attributed to the field model errors. If the gyroscope noise is sufficiently small, the tuned filter 'memory' will be long compared to the orbital period. In this case, the variations in the rate bias induced by field model errors are substantially reduced. Mistuning the filter to have a short memory time leads to strongly oscillating rate biases and increased attitude errors. To reduce the effect of the magnetic field model errors, these errors are estimated within the filter and used to correct the reference model. An exponentially-correlated noise model is used to represent the filter estimate of the systematic error. Results from several test cases using in-flight data from the Compton Gamma Ray Observatory are presented. These tests emphasize magnetometer errors, but the method is generally applicable to any sensor subject to a combination of random and systematic noise.

Sedlak, J.↗

Verification of the Solar Dynamics Observatory High Gain Antenna Pointing Algorithm Using Flight Data

The Solar Dynamics Observatory (SDO), launched in 2010, is a NASA-designed spacecraft built to study the Sun. SDO has tight pointing requirements and instruments that are sensitive to spacecraft jitter. Two High Gain Antennas (HGAs) are used to continuously send science data to a dedicated ground station. Preflight analysis showed that jitter resulting from motion of the HGAs was a cause for concern. Three jitter mitigation techniques were developed and implemented to overcome effects of jitter from different sources. These mitigation techniques include: the random step delay, stagger stepping, and the No Step Request (NSR). During the commissioning phase of the mission, a jitter test was performed onboard the spacecraft, in which various sources of jitter were examined to determine their level of effect on the instruments. During the HGA portion of the test, the jitter amplitudes from the single step of a gimbal were examined, as well as the amplitudes due to the execution of various gimbal rates. The jitter levels were compared with the gimbal jitter allocations for each instrument. The decision was made to consider implementing two of the jitter mitigating techniques on board the spacecraft: stagger stepping and the NSR. Flight data with and without jitter mitigation enabled was examined, and it is shown in this paper that HGA tracking is not negatively impacted with the addition of the jitter mitigation techniques. Additionally, the individual gimbal steps were examined, and it was confirmed that the stagger stepping and NSRs worked as designed. An Image Quality Test was performed to determine the amount of cumulative jitter from the reaction wheels, HGAs, and instruments during various combinations of typical operations. The HGA-induced jitter on the instruments is well within the jitter requirement when the stagger step and NSR mitigation options are enabled.

Bourkland, Kristin L.↗

Neural Network (NN) Retrievals of Stratocumulus Cloud Properties Using Multiangle Polarimetric Observations During ORACLES

The ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) campaign is taking place in the SouthEast Atlantic during the Austral Spring for three consecutive years from 20162018. The study area encompasses one of the Earths three semipermanent subtropical Stratocumulus (Sc) cloud decks,and experiences very large aerosol optical depths, mainly biomass burning, originating from Africa. Over time, cloud optical depth (COD), lifetime and cloud microphysics (number concentration, effective radii Reff and precipitation) are expected to be influenced by indirect aerosol effects. These changes play a key role in the energetic balance of the region, and are part of the core investigation objectives of the ORACLES campaign, which acquires measurements of clean and polluted scenes of above cloud aerosols (ACA). Simultaneous retrievals of aerosol and cloud optical properties are being developed (e.g. MODIS, OMI), butstill challenging, especially for passive, single viewing angle instruments. By comparison, multiangle polarimetric instruments like RSP (Research Scanning Polarimeter) show promise for detection and quantification of ACA, however, there are no operational retrieval algorithms available yet. Here we describe anew algorithm to retrieve cloud and aerosol optical properties from observations by RSP flown on the ER2and P3 during the 2016 ORACLES campaign. The algorithm is based on training a NN, and is intended to retrieve aerosol and cloud properties simultaneously. However, the first step was to establish the retrievalscheme for low level Sc cloud optical properties. The NN training was based on simulated RSP total and polarized radiances for a range of COD, Reff, and effective variances, spanning 7 wavelength bands and 152 viewing zenith angles. Random and correlated noise were added to the simulations to achieve a morerealistic representation of the signals. Before introducing the input variables to the network, the signals are projected on a principle component plane that retains the maximal signal information but minimizes the noise contribution. We will discuss parameter choices for the network and present preliminary results of cloudretrievals from ORACLES, compared with standard RSP low-levelcloud retrieval method that has been validated against in situ observations.

Cloud-aerosol↗

Development of High-Resolution Soil Hydraulic Parameters with Use of Earth Observations for Enhancing Root Zone Soil Moisture Product

Regional quantification of energy and water balance fluxes depends inevitably on the estimation of surface and rootzone soil moisture. The simulation of soil moisture depends on the soil retention characteristics, which are difficult to estimate at a regional scale. Thus, the present study proposes a new method to estimate high-resolution Soil Hydraulic Parameters (SHPs) which in turn help to provide high-resolution (spatial and temporal) rootzone soil moisture (RZSM) products. The study is divided into three phases—(I) involves the estimation of finer surface soil moisture (1 km) from the coarse resolution satellite soil moisture. The algorithm utilizes MODIS 1 km Land Surface Temperature (LST) and 1 km Normalized difference vegetation Index (NDVI) for downscaling 25 km C-band derived soil moisture from AMSR-2 to 1 km surface soil moisture product. At one of the test sites, soil moisture is continuously monitored at 5, 20, and 50 cm depth, while at 44 test sites data were collected randomly for validation. The temporal and spatial correlation for the downscaled product was 70% and 83%, respectively. (II) In the second phase, downscaled soil moisture product is utilized to inversely estimate the SHPs for the van Genuchten model (1980) at 1 km resolution. The numerical experiments were conducted to understand the impact of homogeneous SHPs as compared to the three-layered parameterization of the soil profile. It was seen that the SHPs estimated using the downscaled soil moisture (I-d experiment) performed with similar efficiency as compared to SHPs estimated from the in-situ soil moisture data (I-b experiment) in simulating the soil moisture. The normalized root mean square error (nRMSE) for the two treatments was 0.37 and 0.34, respectively. It was also noted that nRMSE for the treatment with the utilization of default SHPs (I-a) and AMSR-2 soil moisture (I-c) were found to be 0.50 and 0.43, respectively. (III) Finally, the derived SHPs were used to simulate both surface soil moisture and RZSM. The final product, RZSM which is the daily 1 km product also showed a nearly 80% correlation at the test site. The estimated SHPs are seen to improve the mean NSE from 0.10 (I-a experiment) to 0.50 (I-d experiment) for the surface soil moisture simulation. The mean nRMSE for the same was found to improve from 0.50 to 0.31.

soil moisture downscaling↗

Advanced Characterisation of Aerosol Size Properties from Measurements of Spectral Optical Depth Using the GRASP Algorithm

This study evaluates the potential of using aerosol optical depth (τ (sub a)) measurements to characterise the microphysical and optical properties of atmospheric aerosols. With this aim, we used the recently developed GRASP (Generalized Retrieval of Aerosol and Surface Properties) code for numerical testing of six different aerosol models with different aerosol loads. The direct numerical simulations (self-consistency tests) indicate that the GRASP-AOD retrieval provides modal aerosol optical depths (fine and coarse) to within 0.01 of the input values. The retrieval of the fine-mode radius, width and volume concentration are stable and precise if the real part of the refractive index is known. The coarse-mode properties are less accurate, but they are significantly improved when additional a priori information is available. The tests with random simulated errors show that the uncertainty in the bimodal log-normal size distribution parameters increases as the aerosol load decreases. Similarly, the reduction in the spectral range diminishes the stability of the retrieved parameters. In addition to these numerical studies, we used optical depth observations at eight AERONET locations to validate our results with the standard AERONET inversion products. We found that bimodal log-normal size distributions serve as useful input assumptions, especially when the measurements have inadequate spectral coverage and/or limited accuracy, such as moon photometry. Comparisons of the mode median radii between GRASP-AOD and AERONET indicate average differences of 0.013µm for the fine mode and typical values of 0.2–0.3µm for the coarse mode. The dominant mode (i.e. fine or coarse) indicates a 10 % difference in mode radii between the GRASP-AOD and AERONET inversions, and the average of the difference in volume concentration is around 17 % for both modes. The retrieved values of the fine-mode τ(sub a)(500) using GRASP-AOD are generally between those values obtained by the standard AERONET inversion and the values obtained by the AERONET spectral deconvolution algorithm (SDA), with differences typically lower than 0.02 between GRASP-AOD and both algorithms. Finally, we present some examples of application of GRASP-AOD inversion using moon photometry and the airborne PLASMA sun photometer during the ChArMEx summer 2013 campaign in the western Mediterranean.

Torres, Benjamin↗

Parallel membership queries on very large scientific data sets using bitmap indexes

© 2019 John Wiley & Sons, Ltd. Many scientific applications produce very large amounts of data as advances in hardware fuel computing and experimental facilities. Managing and analyzing massive quantities of scientific data is challenging as data are often stored in specific formatted files, such as HDF5 and NetCDF, which do not offer appropriate search capabilities. In this research, we investigated a special class of search capability, called membership query, to identify whether queried elements of a set are members of an attribute. Attributes that naturally have classification values appear frequently in scientific domains such as category and object type as well as in daily life such as zip code and occupation. Because classification attribute values are discrete and require random data access, performing a membership query on a large scientific data set creates challenges. We applied bitmap indexing and parallelization to membership queries to overcome these challenges. Bitmap indexing provides high performance not only for low cardinality attributes but also for high cardinality attributes, such as floating-point variables, electric charge, or momentum in a particle physics data set, due to compression algorithms such as Word-Aligned Hybrid. We conducted experiments, in a highly parallelized environment, on data obtained from a particle accelerator model and a synthetic data set.

Yildiz, Beytullah↗

Fast yaw optimization for wind plant wake steering using Boolean yaw angles

Abstract. In wind plants, turbines can be yawed into the wind to steer their wakes away from downstream turbines and achieve an overall increase in plant power. Mathematical optimization is typically used to determine the best yaw angles at which to operate the turbines in a plant. In this paper, we present a new heuristic to rapidly determine the yaw angles in a wind plant. In this method, we define the turbine yaw angles as Boolean – either yawed at a predefined angle or nonyawed – as opposed to the typical methods of defining yaw angles as continuous or with fine discretizations. We then optimize which turbines should be yawed with an algorithm that sweeps through the turbines from the most upstream to the most downstream. We demonstrate that our new Boolean optimization method can find turbine yaw angles that perform well compared to a traditionally used gradient-based optimizer for which the yaw angles are defined as continuous. There is less than 0.6 % difference in the optimized power between the two optimization methods for randomly placed turbine layouts and less than a 0.6 % difference in the optimal annual energy production between the two optimization methods for a real wind farm. Additionally, we show that our new method is much more computationally efficient than the traditional method. For plants with nonzero optimal yaw angles, our new method is generally able to solve for the turbine yaw angles 50–150 times faster, and in some extreme cases up to 500 times faster, than the traditional method.

17 WIND ENERGY↗

Study of advanced system for position location and navigation

Concepts are investigated for improving location precision and system capacity relative to current satellite based data collection and location systems. The TRILOC concept provides either or both improvements in location and system capacity by utilizing three measurements acquired during a single transmission from a platform for location purposes. The location algorithm is developed, and range differences are measured onboard the satellite. An error analysis then relates platform location errors to the precision with which the measurements are made. The second concept is to increase system capacity by means of directive antennas onboard the satellite for reducing interference and/or reducing platform power. The potential advantages and disadvantages of both sweeping and fixed directive antennas for random access systems are evaluated.

Source record↗

Visualization and 3D Mesh Generation for ASSEMBLERS Range of Motion

In an effort to create a base and foundation for ASSEMBLERS with an informed layout, data representing the range of motion of varying heights of Stewart platforms were analyzed. 3D shapes were generated first to be approximately representative of these data in the form of rotationally symmetric shells, making use of 2D alpha shapes to create a border that did not account for asymmetry inherent in the true range of motion. Further work was performed to generate mesh files more fully representative of reach, creating 3D alpha shapes based directly on point clouds generated from uniformly random platform positions. These shapes were initially not representative of the entire range of motion of a platform stack due to the low likelihood of the most extreme positions being added to a given point cloud but were more representative of the asymmetry inherent in the possible positions of a Stewart platform as they no longer relied on a single 2D contour. The same algorithm for generating 3D alpha shapes was then applied to point clouds designed to represent extreme positions, generating larger smooth shells with six clear planes of symmetry. All shells were converted to STLs to aid in further modeling of range of motion for base layouts and in visualizing reachable area for varying stack heights, successfully creating closed shells representative of typical and extreme positions for platform stacks of varying heights.

Jonah DeGuire Vanke↗