Search NASA⌕ Search

SEARCH · Search NASA

Results for “sampling algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
NASA NTRS2018

Shifting Data Collection from a Fixed to an Adaptive Sampling Paradigm

For domains where data are difficult to obtain due to human or resource limitations, an emphasis is needed to efficiently explore the dimensions of information spaces to acquire any given response of interest. Many disciplines are still making the transition from brute force, dense, full factorial exploration of their information spaces to a more efficient design of experiments approach; the latter being in use successfully for many decades in agricultural and automotive applications. Although this transition is still incomplete, groundwork must be laid for incorporating the next generation of algorithms to adaptively explore the information space in response to data collected, as well as any resulting empirical models (i.e., metamodels). The methodology in the present work was to compare metamodel quality using a fixed sampling technique compared to an adaptive sampling technique based on metamodel variance. In order to quantify metamodeling errors, a delta method was used to provide quantitative model variance estimates. The present methodology was applied to a design space with an air-breathing engine performance response. It was shown that competitive metamodel quality with lower associated error could be achieved for an adaptive sampling technique for the same level of effort as a fixed, a priori sampling technique.

Axdahl, Erik L.↗
NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

reinforcement learning↗
NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗
NASA NTRSDate not supplied

Discovery and Analysis of Rare High-Impact Failure Modes using Adversarial RL-Informed Sampling

Adaptive learning agents have tremendous potential to handle critical tasks currently performed by humans. Unfortunately, due to their complexity, it can be difficult to verify that these learning agents do not have critical failure modes. Standard verification and validation methods often do not apply directly to learning agents and Monte Carlo methods have difficulty covering even a small fraction of the state space, especially in multiagent systems or over long time horizons. To overcome this difficulty, we demonstrate an adaptive stress-testing method based on reinforcement learning of correlations that raise the probability of failure. This approach has three key properties: (1) it is able to find rare failure modes with far greater sample efficiency than Monte Carlo methods, (2) it can estimate the true probability of a failure mode despite the inherent bias in the learning method, and (3) it is capable of learning and resampling compact representations of multimodal failure spaces. These properties are important in practice as we need to find disparate failure modes while accounting for their actual relevance. This is a significant advantage over traditional adaptive stress testing methods that give abstract likelihoods of particular failure instances, but cannot estimate the probability of a broader failure mode. We test our algorithm on a simple problem from the aviation domain where an autonomous aircraft lands in gusty wind conditions. The results suggest that we can find failure modes with far fewer samples than the Monte Carlo approach and simultaneously estimate the probability of failure.

Validation↗
NASA NTRS2014

Carbon Monitoring System Flux Estimation and Attribution: Impact of ACOS-GOSAT X(CO2) Sampling on the Inference of Terrestrial Biospheric Sources and Sinks

Using an Observing System Simulation Experiment (OSSE), we investigate the impact of JAXA Greenhouse gases Observing SATellite 'IBUKI' (GOSAT) sampling on the estimation of terrestrial biospheric flux with the NASA Carbon Monitoring System Flux (CMS-Flux) estimation and attribution strategy. The simulated observations in the OSSE use the actual column carbon dioxide (X(CO2)) b2.9 retrieval sensitivity and quality control for the year 2010 processed through the Atmospheric CO2 Observations from Space algorithm. CMS-Flux is a variational inversion system that uses the GEOS-Chem forward and adjoint model forced by a suite of observationally constrained fluxes from ocean, land and anthropogenic models. We investigate the impact of GOSAT sampling on flux estimation in two aspects: 1) random error uncertainty reduction and 2) the global and regional bias in posterior flux resulted from the spatiotemporally biased GOSAT sampling. Based on Monte Carlo calculations, we find that global average flux uncertainty reduction ranges from 25% in September to 60% in July. When aggregated to the 11 land regions designated by the phase 3 of the Atmospheric Tracer Transport Model Intercomparison Project, the annual mean uncertainty reduction ranges from 10% over North American boreal to 38% over South American temperate, which is driven by observational coverage and the magnitude of prior flux uncertainty. The uncertainty reduction over the South American tropical region is 30%, even with sparse observation coverage. We show that this reduction results from the large prior flux uncertainty and the impact of non-local observations. Given the assumed prior error statistics, the degree of freedom for signal is approx.1132 for 1-yr of the 74 055 GOSAT X(CO2) observations, which indicates that GOSAT provides approx.1132 independent pieces of information about surface fluxes. We quantify the impact of GOSAT's spatiotemporally sampling on the posterior flux, and find that a 0.7 gigatons of carbon bias in the global annual posterior flux resulted from the seasonally and diurnally biased sampling when using a diagonal prior flux error covariance.

biased sampling↗
NASA NTRS1994

Echo mapping of active galactic nuclei broad-line regions: Fundamental algorithms

We formulate and test a series of algorithms for echo mapping the emission-line regions near active galactic nuclei from measurements of correlated variability in their line and continuum light curves. The linear regularization method (LRM) employs a direct inversion of evenly spaced light-curve data, with a regularization parameter that can be used to control the trade-off between noise and resolution. Matrix formulas express the formal solution as well as its variance and covariance in terms of uncertainties in the measurements. Unlike the maximum-entropy method (MEM), LRM applies to kernels with both positive and negative values, but the results are somewhat limited by ringing effects. A positivity constraint proves effective in controlling the ringing. MEM combines regularization and positivity in a natural way, but similar results are also found using positivity constraints with nonentropic regularization functions. Direct inversions of unevenly sampled light curves require interpolating the noisy data. In this case better results are found by solving for both the continuum light curve and kernel function in a simultaneous fit to the data. Our conclusion is that while echo mapping currently gives ambiguous results, the algorithms are not the limiting factor. Progress depends on efforts to increase the accuracy and completeness of sampling of the observed light curves.

Vio, Roberto↗
NASA NTRS2020

An Algorithm for Hyperspectral Remote Sensing of Aerosols: 3. Application to the GEO-TASO Data in KORUS-AQ Field Campaign

This paper describes the third part of a series of investigations to develop algorithms for simultaneous retrieval of aerosol parameters and surface spectral reflectance from the data measured by GEOstationary Trace gas and Aerosol Sensor Optimization (GEO-TASO) instrument. Since the algorithm is designed for future hyperspectral and geostationary satellite sensors, such as Tropospheric Emissions: Monitoring of Pollution (TEMPO), it is applied to GEO-TASO data measured over the same area by different flights as part of the Korea-United Stated Air Quality Study (KORUS-AQ) field campaign in 2016. While GEO-TAOS has a spectral sampling interval of ~0.28 nm in the visible, its data is thinned through a band selection approach with consideration of atmospheric transmittance and different surface types, which yields 20 common spectral bands to be used by the algorithm. The algorithm starts with 4 common principal components (PCs) for surface spectral reflectance extracted from various spectral libraries, and the constraints of surface reflectance parameters and aerosol scattering models respectively from k- means clustering analysis of the Rayleigh-corrected GEO-TASO spectra and AERONET data. The algorithm then proceeds iteratively with an optimal estimation approach to update PCs and retrieve aerosol optical depth (AOD) until the best match between simulated and GEOS-TASO measured spectra is achieved. The spectral AODs are compared between those retrieved from GEO-TASO (x) and 7 AERONETS (y) in 440, 550, 550, 675 nm, respectively. The comparison reveals that iterative updates of surface spectral PCs (and so surface reflectance) yield significant enhancement in AOD retrievals, improving the mean linear fitting equations from y = 0.735x + 0.088 (without update of PCs) to y = 1.055x+ 0.01, and the Pearson correlation coefficient (𝑅𝑅2) from 0.54 to 0.76, respectively. Move case studies are need to further evaluate the algorithm for its application to TEMPO that carries a enhanced version of GEO-TASO instrument.

Tropospheric Emissions: Monitoring of Pollution (T↗
DOE OSTI2025

Using active learning to improve quasar identification for the DESI spectra processing pipeline

The Dark Energy Spectroscopic Instrument (DESI) survey uses an automatic spectral classification pipeline to classify spectra. QuasarNET is a convolutional neural network used as part of this pipeline originally trained using data from the Baryon Oscillation Spectroscopic Survey (BOSS). In this paper we implement an active learning algorithm to optimally select spectra to use for training a new version of the QuasarNET weights file using only DESI data, with the goal of improving classification accuracy. This active learning algorithm includes a novel outlier rejection step using a Self-Organizing Map to ensure we label spectra representative of the larger quasar sample observed in DESI. We perform two iterations of the active learning pipeline, assembling a final dataset of 5600 labeled spectra, a small subset of the approximately 1.3 million quasar targets in DESI's Data Release 1. When splitting the spectra into training and validation subsets we achieve similar performance to the previously trained weights file in completeness and purity calculated on the validation dataset but do so with less than one tenth of the amount of training data. The new weights also more consistently classify objects in the same way when used on unlabeled data compared to the old weights file. In the process of improving QuasarNET's classification accuracy we discovered a systemic error in QuasarNET's redshift estimation and used our findings to improve our understanding of QuasarNET's redshifts.

Machine learning↗
DOE OSTI2024

Iterative Stress Reconstruction Algorithm to Estimate Three-Dimensional Residual Stress Fields in Manufactured Components

Residual stress (RS) significantly impacts the mechanical performance of components. Measurement of RS often provides incomplete data in terms of components of stress and spatial density. Employing such fields in finite element simulations results in significant modification of the field to achieve equilibrium and compatibility among strains. To overcome this, an iterative stress reconstruction algorithm (ISRA) is developed to estimate 3D RS fields that satisfy equilibrium, are stress component-wise complete, and represent the characterized data sampled. An Al 7075-T651 plate and an additively manufactured (AM) A36 steel wall are considered for RS reconstruction using measurement data from the literature. A maximum variation of ~2.5 MPa in the Al plate, and ~10 MPa in the steel wall are observed between the reconstructed and measured stresses. Furthermore, unknown stress components emerge and reach significant magnitudes (upto ~2.3 MPa in the Al plate and ~45 MPa in the AM wall) during ISRA. Indeed, it is found that minor errors in measurement or data processing are eliminated through the physical requirements during ISRA. Employing a reconstructed RS field is hence not just more accurate given its compatibility, but it additionally corrects for minor errors in measurement. Furthermore, it is found that spatially dense measurement data result in convergence with fewer iterations. Finally, although ISRA yields a nonunique solution dependent on boundary conditions, measurement errors, fitting errors, and mesh density, it accommodates for uncertainties and inaccuracies in measurement, as opposed to failing to reach a physically realistic converged solution.

42 ENGINEERING↗
DOE OSTI2024

Simple strategy for the simulation of axially symmetric large-area metasurfaces

Metalenses are composed of nanostructures for focusing light and have been widely explored in many exciting applications. However, their expanding dimensions pose simulation challenges. We propose a method to simulate metalenses in a timely manner using vectorial wave and ray tracing models. We sample the metalens’s radial phase gradient and locally approximate the phase profile by a linear phase response. Each sampling point is modeled as a binary blazed grating, employing the chosen nanostructure, to build a transfer function set. The metalens transmission or reflection is then obtained by applying the corresponding transfer function to the incoming field on the regions surrounding each sampling point. Fourier optics is used to calculate the scattered fields under arbitrary illumination for the vectorial wave method, and a Monte Carlo algorithm is used in the ray tracing formalism. We validated our method against finite-difference time domain simulations at 632 nm, and we were able to simulate metalenses larger than 3000 wavelengths in diameter on a personal computer.

Martins, Augusto (ORCID:0000000295546481)↗
DOE OSTI2025

Reliable Determination of Pulses and Pulse-Shape Instability in Ultrashort Laser Pulse Trains Using Polarization-Gating and Transient-Grating Frequency-Resolved Optical Gating Using the RANA Approach

Devices that measure the presence of instability in the pulse shapes in trains of ultrashort laser pulses do not exist, so this task necessarily falls to pulse-measurement devices, like Frequency-Resolved Optical Gating (FROG) and its variations, which have proven to be a highly reliable class of techniques for measuring stable trains of ultrashort laser pulses. Fortunately, multi-shot versions of FROG have also been shown to sensitively distinguish trains of stable from those of unstable pulse shapes by displaying readily visible systematic discrepancies between the measured and retrieved traces in the presence of unstable pulse trains. However, the effects of pulse-shape instability and algorithm stagnation can be indistinguishable, so a never-stagnating algorithm—even when instability is present—is required and is generally important. In previous work, we demonstrated that our recently introduced Retrieved-Amplitude N-grid Algorithmic (RANA) approach produces highly reliable (100%) pulse-retrieval in the second-harmonic-generation (SHG) version of FROG for thousands of sample trains of pulses with stable pulse shapes. Further, it does so even for trains of unstable pulse shapes and thus both reliably distinguishes between the two cases and provides a rough measure of the degree of instability as well as a reasonable estimate of most typical pulse parameters. Here, we perform the analogous study for the polarization-gating (PG) and transient-grating (TG) versions of FROG, which are often used for higher-energy pulse trains. We conclude that PG and TG FROG, coupled with the RANA approach, also provide reliable indicators of pulse-shape instability. In addition, for PG and TG FROG, the RANA approach provides an even better estimate of a typical pulse in an unstable pulse train than SHG FROG does, even in cases of significant pulse-shape instability.

47 OTHER INSTRUMENTATION↗
NASA NTRS1972

A study of pilot modeling in multi-controller tasks

A modeling approach, which utilizes a matrix of transfer functions to describe the human pilot in multiple input, multiple output control situations, is studied. The approach used was to extend a well established scalar Wiener-Hopf minimization technique to the matrix case and then study, via a series of experiments, the data requirements when only finite record lengths are available. One of these experiments was a two-controller roll tracking experiment designed to force the pilot to use rudder in order to coordinate and reduce the effects of aileron yaw. One model was computed for the case where the signals used to generate the spectral matrix are error and bank angle while another model was computed for the case where error and yaw angle are the inputs. Several anomalies were observed to be present in the experimental data. These are defined by the descriptive terms roll up, break up, and roll down. Due to these algorithm induced anomalies, the frequency band over which reliable estimates of power spectra can be achieved is considerably less than predicted by the sampling theorem.

Whitbeck, R. F.↗
NASA NTRS1983

A viscous shock-layer flowfield analysis by an explicit-implicit method

An implicit analogue of a widely used explicit method to external axisymmetric laminar flows with strong entropy gradients is extended. The details of the "numerics" of the implicit part are provided in a body oriented coordinate system with a moving outer (shock) boundary during the transient part of the solutions. The limiting values of the Courant number are obtained when the shock boundary is treated explicitly. The solution algorithm outlined includes the treatment of the source term associated with the equations in weak conservation form. From the results obtained for two sample problems, it becomes clear that accuracy of predictions is, indeed, very good at higher values of the Courant number. There is a significant saving in overall computing time, depending on the Courant number used and the flow Reynolds number. These properties combined with the simplicity of programming the implicit analog may appeal to researchers for using it in the analysis of 3-D flow problems.

Gupta, R. M.↗
NASA NTRS1983

Viscous shock-layer flowfield analysis by an explicit-implicit method

The present work extends the recently reported implicit analogue of MacCormack's earlier widely-used explicit method to external axisymmetric laminar flows with strong entropy gradients. The details of the 'numerics' of the implicit part are provided in a body-oriented coordinate system with a moving outer (shock) boundary during the transient part of the solutions. The limiting values of the Courant number are obtained when the shock boundary is treated explicitly. The solution algorithm outlined includes the treatment of the source term associated with the equations in weak conservation form. From the results obtained for two sample problems, it becomes clear that accuracy of predictions is, indeed, very good at higher values of the Courant number. There is a significant saving in overall computing time, depending on the Courant number used and the flow Reynolds number. These properties combined with the simplicity of programming the implicit analogue may appeal to researchers for using it in the analysis of three-dimensional flow problems.

Gupta, R. N.↗
NASA NTRS1991

Particle image velocimetry for the surface tension driven convection experiment using a particle displacement tracking technique

The Surface Tension Driven Convection Experiment (STDCE) is a Space Transportation System flight experiment to study both transient and steady thermocapillary fluid flows aboard the USML-1 Spacelab mission planned for 1992. One of the components of data collected during the experiment is a video record of the flow field. This qualitative data is then quantified using an all electronic, two-dimensional particle image velocimetry technique called particle displacement tracking (PDT) which uses a simple space domain particle tracking algorithm. The PDT system is successful in producing velocity vector fields from the raw video data. Application of the PDT technique to a sample data set yielded 1606 vectors in 30 seconds of processing time. A bottom viewing optical arrangement is used to image the illuminated plane, which causes keystone distortion in the final recorded image. A coordinate transformation was incorporated into the system software to correct this viewing angle distortion. PDT processing produced 1.8 percent false identifications, due to random particle locations. A highly successful routine for removing the false identifications was also incorporated, reducing the number of false identifications to 0.2 percent.

Wernet, Mark P.↗
NASA NTRS1991

Particle image velocimetry for the Surface Tension Driven Convection Experiment using a particle displacement tracking technique

The Surface Tension Driven Convection Experiment (STDCE) is a Space Transportation System flight experiment to study both transient and steady thermocapillary fluid flows aboard the USML-1 Spacelab mission planned for 1992. One of the components of data collected during the experiment is a video record of the flow field. This qualitative data is then quantified using an all electronic, two-dimensional particle image velocimetry technique called particle displacement tracking (PDT) which uses a simple space domain particle tracking algorithm. The PDT system is successful in producing velocity vector fields from the raw video data. Application of the PDT technique to a sample data set yielded 1606 vectors in 30 seconds of processing time. A bottom viewing optical arrangement is used to image the illuminated plane, which causes keystone distortion in the final recorded image. A coordinate transformation was incorporated into the system software to correct this viewing angle distortion. PDT processing produced 1.8 percent false identifications, due to random particle locations. A highly successful routine for removing the false identifications was also incorporated, reducing the number of false identifications to 0.2 percent.

Wernet, Mark P.↗
NASA NTRS2000

Laboratory and Field Measurements of Raindrop Oscillations

This study presents new measurements of raindrop oscillations in laboratory and field conditions. A 2-D video disdrometer is used to detect the shape of oscillating raindrops. The studies that were conducted to examine the oscillatory behavior of drops reveal that there is a lack of observations of the large drop oscillations. Yet, these drops have significant importance on radar rain estimation. Therefore, the new laboratory study is particularly designed to expand our knowledge on oscillatory behavior of large raindrops. The preliminary laboratory tests indicate that the drops are less oblate than the equilibrium shapes. Regarding the field studies, a large sample of raindrops was collected in several tropical field campaigns. The raindrops are mostly distorted and canted due to the environmental wind. An algorithm that determines the drop orientation and canting angle is added to the current system. This would reveal one of the most comprehensive data set on the oscillating behavior of raindrops in natural rain. The role of the oscillating raindrops on polarimetric parameters and subsequent rain estimation will be added to the discussion.

Tokay, A.↗