Search NASA⌕ Search

SEARCH · Search NASA

Results for “Selection Bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Sampling Landsat classifications for crop area estimation

An investigation was conducted to evaluate the effect of several sampling alternatives on the accuracy of crop area estimates made from classification of Landsat Multispectral Scanner (MSS) data. The specific objective was to assess the precision and the bias associated with alternative sampling schemes involving different numbers of several sampling unit sizes. The estimates achieved using the 5 by 6 nm segments were found to have the least precision of any sampling scheme tested. The estimates become more precise as the segment size decreases and more segments are taken. The precision of the 5 by 6 nm segments was significantly less than that of the pixel samples. None of the sampling schemes was significantly biased on the average, and none of the average estimates differed significantly from the population parameter. The maximum absolute deviation, however, was directly related to sampling unit size and should be considered in selection of a sampling unit.

Hixson, M. M.↗

Method of measuring field funneling and range straggling in semiconductor charge-collecting junctions

Electric-field funneling length is measured while irradiating a semiconductor charge-collecting junction with electron-hole-pair generating charged particles at a first junction bias voltage. The bias voltage is then reduced to a second level in order to reduce the depth of the depletion region such that the total charge can no longer be collected by drift and measured in the energy band previously displayed in the multichannel analyzer. This is representative of the maximum electric field funneling length which may be calculated by measuring the difference at the second bias voltage level of the depletion width and the ion penetration range. The bias voltage is further lowered to a third level at which the particles are collected over a spread of energy levels while at least some of the particles are still collected at the selected energy level. From this the different depths of penetration of the particles are determined while additional effects due to diffusion are minimized.

Zoutendyk, J. A.↗

Method of measuring field funneling and range straggling in semiconductor charge-collecting junctions

Electric-field funneling length is measured while irradiating a semiconductor charge-collecting junction with electron-hole-pair generating charged particles at a first junction bias voltage. The bias voltage is then reduced to a second level in order to reduce the depth of the depletion region such that the total charge can no longer be collected by drift and measured in the energy band previously displayed in the multichannel analyzer. This is representative of the maximum electric field funnelling length which may be calculated by measuring the difference at the second bias voltage level of the depletion width and the ion penetration range. The bias voltage is further lowered to a third level at which the particles are collected over a spread of energy levels while at least some of the particles are still collected at the selected energy level. From this the different depths of penetration of the particles are determined while additional effects due to diffusion are minimized.

Zoutendyk, John A.↗

Generating high precision ionospheric ground-truth measurements

A method, apparatus and article of manufacture provide ionospheric ground-truth measurements for use in a wide-area augmentation system (WAAS). Ionospheric pseudorange/code and carrier phase data as primary observables is received by a WAAS receiver. A polynomial fit is performed on the phase data that is examined to identify any cycle slips in the phase data. The phase data is then leveled. Satellite and receiver biases are obtained and applied to the leveled phase data to obtain unbiased phase-leveled ionospheric measurements that are used in a WAAS system. In addition, one of several measurements may be selected and data is output that provides information on the quality of the measurements that are used to determine corrective messages as part of the WAAS system.

Komjathy, Attila↗

Regional Replay: A Unique Reanalysis-Based Tool for Addressing Model Error

Understanding and correcting errors in general circulation and climate models has long been part intuition and part trial and error. Efforts to diagnose the errors and provide some guidance to developers have been of some value, though such efforts, with few exceptions, have been more successful in identifying and documenting the errors in the model simulations rather than the model deficiencies that produced them. Modern atmospheric reanalyses such as MERRA-2 provide much-improved estimates of our climate system at hourly to interannual and longer time scales and have become an important tool for assessing model performance. Here we use MERRA-2 to address biases in the NASA/GMAO GEOS model by employing a "regional replay" approach developed in the GMAO. The regional replay approach constrains the model to remain close to the reanalysis over arbitrary regions and selected model variables, thus allowing us to examine how model error generated over one area is spatially translated across the globe. Several examples are given including an assessment of the global impact of errors produced over the Tibet region.

Tibet Region↗

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗

Planet Occurrence Rate Correlated to Stellar Dynamical History: Evidence from Kepler and Gaia

The dynamical history of stars influences the formation and evolution of planets significantly. To explore the influence of dynamical history on the planet formation and evolution using observations, we assume stars that experienced significantly different dynamical histories tend to have different relative velocities. Utilizing the accurate Gaia–Kepler Stellar Properties Catalog, we select single main-sequence stars and divide these stars into three groups according to their relative velocities, i.e., high-V, medium-V, and low-V stars. After considering the known biases from Kepler data and adopting prior and posterior correction to minimize the influence of stellar properties on planet occurrence rate, we find that high-V stars have a lower occurrence rate of super-Earths and sub-Neptunes (1–4 R {sub ⊕}, P < 100 days) and a higher occurrence rate of sub-Earth (0.5–1 R {sub ⊕}, P < 30 days) than low-V stars. Additionally, high-V stars have a lower occurrence rate of hot Jupiter-sized planets (4–20 R {sub ⊕}, P < 10 days) and a slightly higher occurrence rate of warm or cold Jupiter-sized planets (4–20 R {sub ⊕}, 10 < P < 400 days). After investigating multiplicity and eccentricity, we find that high-V planet hosts prefer a higher fraction of multiplanet systems and lower average eccentricity, which are consistent with the eccentricity–multiplicity dichotomy of Kepler planetary systems. All of these statistical results favor the scenario that high-V stars with large relative velocity may experience fewer gravitational events, while low-V stars may be influenced by stellar clustering significantly.

79 ASTRONOMY AND ASTROPHYSICS↗

System design of a rudder coordination system

The application of the parameter optimization computer program to the design of a rudder coordination system for the F-8 airplane is summarized. The flight condition was Mach 0.56 at 20,000 feet altitude. The system configuration selected consisted of signal paths that fed yaw rate and aileron signals to the rudder. The two signal paths were summed and then modified by a high pass filter to eliminate any steady state bias signal. The input axis of the yaw gyro was perpendicular to the aircraft zero lift line and the trim angle of attack was 7.75 degrees. The parameter optimization was used to design the complete system first, and then a root locus analysis of the individual component effects was made. The results are presented.

Whitaker, H. P.↗

Topic Modeling of NASA Space System Problem Reports: Research in Practice

Problem reports at NASA are similar to bug reports: they capture defects found during test, post-launch operational anomalies, and document the investigation and corrective action of the issue. These artifacts are a rich source of lessons learned for NASA, but are expensive to analyze since problem reports are comprised primarily of natural language text. We apply topic modeling to a corpus of NASA problem reports to extract trends in testing and operational failures. We collected 16,669 problem reports from six NASA space flight missions and applied Latent Dirichlet Allocation topic modeling to the document corpus. We analyze the most popular topics within and across missions, and how popular topics changed over the lifetime of a mission. We find that hardware material and flight software issues are common during the integration and testing phase, while ground station software and equipment issues are more common during the operations phase. We identify a number of challenges in topic modeling for trend analysis: 1) that the process of selecting the topic modeling parameters lacks definitive guidance, 2) defining semantically-meaningful topic labels requires nontrivial effort and domain expertise, 3) topic models derived from the combined corpus of the six missions were biased toward the larger missions, and 4) topics must be semantically distinct as well as cohesive to be useful. Nonetheless,topic modeling can identify problem themes within missions and across mission lifetimes, providing useful feedback to engineers and project managers.

Data Mining↗

Uncovering hidden bias in neutron diffraction residual strain measurements

When calculating residual strain via neutron or X-ray diffraction, uncertainties propagated from the peak fit are often inadequate to describe the true scatter of measurements about a singular strain state, such as one that should describe a macroscopic continuum. Because diffraction is inherently a selective process, orientation-dependent scatter arises from the sub-sampling of strong microstructure and strain gradients. This paper investigates the appropriateness of propagated uncertainties with reference to their original intention, i.e. noise about a mean value. Thirty-six unique orientations of strain measurements are taken at multiple locations within an additive friction-stir deposition component with fine-scale gradients (∼200 µm) of plastic strain, texture and residual elastic strain. Multiple strain and stress calculation pathways are compared: direct substitution of three measurements into Hooke's law, direct inversion of any six unique orientations into the strain state tensor and thirty-six measurement least-squares estimation. For the last two cases, the appropriateness of the uncertainty interval is statistically evaluated on the basis of a physical constraint: common agreement under the strain transformation law. For this sample, the direct inversion of six measurements retains a conservative estimate of the uncertainty. However, propagated uncertainties in the least-squares solution greatly underestimate the true experimental scatter. A simple pathway to estimate appropriate uncertainty intervals is suggested. These results demonstrate that the interpretation of uncertainty in residual strain is strongly dependent on intrinsic sample-dependent effects, and that oversampling orientations and statistical analysis can give more accurate results with realistic uncertainties.

36 MATERIALS SCIENCE↗

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

Control system estimation and design for aerospace vehicles

The selection of an estimator which is unbiased when applied to structural parameter estimation is discussed. The mathematical relationships for structural parameter estimation are defined. It is shown that a conventional weighted least squares (CWLS) estimate is biased when applied to structural parameter estimation. Two approaches to bias removal are suggested: (1) change the CWLS estimator or (2) change the objective function. The advantages of each approach are analyzed.

Stefani, R. T.↗

The GEOS-3 orbit determination investigation

The nature and improvement in satellite orbit determination when precise altimetric height data are used in combination with conventional tracking data was determined. A digital orbit determination program was developed that could singly or jointly use laser ranging, C-band ranging, Doppler range difference, and altimetric height data. Two intervals were selected and used in a preliminary evaluation of the altimeter data. With the data available, it was possible to determine the semimajor axis and eccentricity to within several kilometers, in addition to determining an altimeter height bias. When used jointly with a limited amount of either C-band or laser range data, it was shown that altimeter data can improve the orbit solution.

Pisacane, V. L.↗

Adaptive momentum management for large space structures

Momentum management is discussed for a Large Space Structure (LSS) with the structure selected configuration being the Initial Orbital Configuration (IOC) of the dual keel space station. The external forces considered were gravity gradient and aerodynamic torques. The goal of the momentum management scheme developed is to remove the bias components of the external torques and center the cyclic components of the stored angular momentum. The scheme investigated is adaptive to uncertainties of the inertia tensor and requires only approximate knowledge of principle moments of inertia. Computational requirements are minimal and should present no implementation problem in a flight type computer and the method proposed is shown to be effective in the presence of attitude control bandwidths as low as .01 radian/sec.

Hahn, E.↗

Adaptive momentum management for the dual keel Space Station

The report discusses momentum management for a large space structure with the structure selected configuration being the Initial Orbital Configuration of the dual-keel Space Station. The external torques considered were gravity gradient and aerodynamic torques. The goal of the momentum management scheme developed is to remove the bias components of the external torques and center the cyclic components of the stored angular momentum. The scheme investigated is adaptive to uncertainties of the inertia tensor and requires only approximate knowledge of principal moments of inertia. Computational requirements are minimal and should present no implementation problem in a flight-type computer. The method proposed is shown to be effective in the presence of attitude control bandwidths as low as 0.01 radian/sec.

Hopkins, M.↗

Climate and Lightning: An updated TRMM-LIS Analysis

The TRMM Lightning Imaging Sensor (LIS) has sampled global tropical and sub-tropical lightning flash densities for approximately 11 years. These data were originally processed and results presented by the authors in the 3rd AMS MALD Conference held in 2007 using both pre and post TRMM-boost lightning data. These data were normalized for the orbit boost by scaling the pre-boost data by a fixed constant based on the different swath areas for the pre and post-boost years (post-boost after 2001). Inevitably, one must question this simple approach to accounting for the orbit boost when sampling such a noisy quantity. Hence we are in the process of reprocessing the entire 11-year TRMM LIS dataset to reduce the orbit swath of the post-boost era to that of the pre-boost in order to eliminate sampling bias in the dataset. Study of the diurnal/seasonal/annual sampling suggests that those biases are already minimal and should not contribute to error in examination of annual trends. We will present new analysis of the 11-year annual trends in total lightning flash density for all latitudinal belts and select regions/regimes of the tropics as related to conventional climate signals and precipitation contents in the same period. The results should enable us to address, in some fashion, the sensitivity of the lightning flash density to subtle changes in climate.

Petersen, Walter A.↗