Search NASA⌕ Search

SEARCH · Search NASA

Results for “performance data errors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Methodology for the Assessment of 3D Conduction Effects in an Aerothermal Wind Tunnel Test

This slide presentation reviews a method for the assessment of three-dimensional conduction effects during test in a Aerothermal Wind Tunnel. The test objectives were to duplicate and extend tests that were performed during the 1960's on thermal conduction on proturberance on a flat plate. Slides review the 1D versus 3D conduction data reduction error, the analysis process, CFD-based analysis, loose coupling method that simulates a wind tunnel test run, verification of the CFD solution, Grid convergence, Mach number trend, size trends, and a Sumary of the CFD conduction analysis. Other slides show comparisons to pretest CFD at Mach 1.5 and 2.16 and the geometries of the models and grids.

Oliver, Anthony Brandon↗

CEDAR-GEM Challenge for Systematic Assessment of Ionosphere/Thermosphere Models in Predicting TEC During the 2006 December Storm Event

In order to assess current modeling capability of reproducing storm impacts on total electron content (TEC), we considered quantities such as TEC, TEC changes compared to quiet time values, and the maximum value of the TEC and TEC changes during a storm. We compared the quantities obtained from ionospheric models against ground-based GPS TEC measurements during the 2006 AGU storm event (14-15 December 2006) in the selected eight longitude sectors. We used 15 simulations obtained from eight ionospheric models, including empirical, physics-based, coupled ionosphere-thermosphere, and data assimilation models. To quantitatively evaluate performance of the models in TEC prediction during the storm, we calculated skill scores such as RMS error, Normalized RMS error (NRMSE), ratio of the modeled to observed maximum increase (Yield), and the difference between the modeled peak time and observed peak time. Furthermore, to investigate latitudinal dependence of the performance of the models, the skill scores were calculated for five latitude regions. Our study shows that RMSE of TEC and TEC changes of the model simulations range from about 3 TECU (total electron content unit, 1 TECU = 1016 el m2) (in high latitudes) to about 13 TECU (in low latitudes), which is larger than latitudinal average GPS TEC error of about 2 TECU. Most model simulations predict TEC better than TEC changes in terms of NRMSE and the difference in peak time, while the opposite holds true in terms of Yield. Model performance strongly depends on the quantities considered, the type of metrics used, and the latitude considered.

Shim, J. S.↗

Observing System Simulation Experiments Investigating Atmospheric Motion Vectors and Radiances from a Constellation of 4-5 μm Infrared Sounders

A set of Observing System Simulation Experiments (OSSEs) was performed to investigate the utility of a constellation of passive infrared spectrometers, strategically designed with the aim of deriving the three-dimensional retrievals of the horizontal wind via atmospheric motion vectors (AMVs) from instruments with the spectral resolution of an infrared sounder. The instrument and constellation designs were performed in the context of the Midwave Infrared Sounding of Temperature and humidity in a Constellation for Winds, or MISTiC Winds. The Global Modeling and Assimilation Office OSSE system, which includes a full suite of operational meteorological observations, served as the control. To illustrate the potential impact of this observing strategy, two experiments were performed by adding the new simulated observations to the control. First, perfect (error-free) simulated AMVs and radiances were assimilated. Second, the data were made imperfect by adding realistic modeled errors to the AMVs and radiances that were assimilated. The experimentation showed beneficial impacts on both the mass and wind fields, as based on analysis verification, forecast verification, and the assessment of the observations using the Forecast Sensitivity to Observation Impact (FSOI) metric. In all variables and metrics, the impacts of the imperfect observations were smaller than those of the perfect observations, though much of the positive benefit was retained. The FSOI metric illustrated two key points. First, the largest impacts were seen in the middle troposphere AMVs, which is a targeted capability of the constellation strategy. Second, the addition of modeled errors showed that the assimilation system was unable to fully exploit the 4.3 μm carbon dioxide absorption radiances.

Will McCarty↗

Lessons Learned from Large-Scale Aerospace Structural Testing

Large-scale testing of aerospace structures is frequently the final step in a development project to validate the structural performance, and that typically involves a large cost and time investment. In order to ensure that the testing provides the required data, avoiding errors that can result in an unsuccessful test and failure to meet objectives is critical. Presented herein are five lessons learned to provide insight to those conducting tests in order to help them avoid known pitfalls that may result in an unsuccessful test. Five subject large-scale tests are described, and include two composite wing tests, a composite hybrid-wing body center section test, a full-scale 27.5-ft diameter metallic barrel test, and an 8-ft diameter metallic barrel test. Problems identified during the testing and mitigation approaches to solve the problems are presented, then the lessons learned are summarized.

Lessons Learned↗

Lessons Learned from Large-Scale Aerospace Structural Testing

Large-scale testing of aerospace structures is frequently the final step in a development project to validate the structural performance, and that typically involves a large cost and time investment. In order to ensure that the testing provides the required data, avoiding errors that can result in an unsuccessful test and failure to meet objectives is critical. Presented herein are five lessons learned to provide insight to those conducting tests in order to help them avoid known pitfalls that may result in an unsuccessful test. Five subject large-scale tests are described, and include two composite wing tests, a composite hybrid-wing body center section test, a full-scale 27.5-ft diameter metallic barrel test, and an 8-ft diameter metallic barrel test. Problems identified during the testing and mitigation approaches to solve the problems are presented, then the lessons learned are summarized.

Lessons Learned↗

A Model for Space Shuttle Orbiter Tire Side Forces Based on NASA Landing Systems Research Aircraft Test Results

Forces generated by the Space Shuttle orbiter tire under varying vertical load, slip angle, speed, and surface conditions were measured using the Landing System Research Aircraft (LSRA). Resulting data were used to calculate a mathematical model for predicting tire forces in orbiter simulations. Tire side and drag forces experienced by an orbiter tire are cataloged as a function of vertical load and slip angle. The mathematical model is compared to existing tire force models for the Space Shuttle orbiter. This report describes the LSRA and a typical test sequence. Testing methods, data reduction, and error analysis are presented. The LSRA testing was conducted on concrete and lakebed runways at the Edwards Air Force Flight Test Center and on concrete runways at the Kennedy Space Center (KSC). Wet runway tire force tests were performed on test strips made at the KSC using different surfacing techniques. Data were corrected for ply steer forces and conicity.

Carter, John F.↗

Active Mirror Predictive and Requirements Verification Software (AMP-ReVS)

This software is designed to predict large active mirror performance at various stages in the fabrication lifecycle of the mirror. It was developed for 1-meter class powered mirrors for astronomical purposes, but is extensible to other geometries. The package accepts finite element model (FEM) inputs and laboratory measured data for large optical-quality mirrors with active figure control. It computes phenomenological contributions to the surface figure error using several built-in optimization techniques. These phenomena include stresses induced in the mirror by the manufacturing process and the support structure, the test procedure, high spatial frequency errors introduced by the polishing process, and other process-dependent deleterious effects due to light-weighting of the mirror. Then, depending on the maturity of the mirror, it either predicts the best surface figure error that the mirror will attain, or it verifies that the requirements for the error sources have been met once the best surface figure error has been measured. The unique feature of this software is that it ties together physical phenomenology with wavefront sensing and control techniques and various optimization methods including convex optimization, Kalman filtering, and quadratic programming to both generate predictive models and to do requirements verification. This software combines three distinct disciplines: wavefront control, predictive models based on FEM, and requirements verification using measured data in a robust, reusable code that is applicable to any large optics for ground and space telescopes. The software also includes state-of-the-art wavefront control algorithms that allow closed-loop performance to be computed. It allows for quantitative trade studies to be performed for optical systems engineering, including computing the best surface figure error under various testing and operating conditions. After the mirror manufacturing process and testing have been completed, the software package can be used to verify that the underlying requirements have been met.

Basinger, Scott A.↗

Airborne navigation system performance during RNAV/MLS transition

Aircraft position error sensitivity to sensor errors and flight path geometry is analyzed during RNAV/MLS transition using a digital computer simulation. The avionics sensitivity data provides information necessary to establish requirements for additional guidance law design and to establish airspace requirements for maneuvering to null out any residual RNAV errors upon MLS transition. The data base is also beneficial as planning information for subsequent flight testing. The parameters varied during the generation of the data base include flight profile, error source content and magnitude, ground facility location, runway/flight path orientation and navigation mode. The avionics, autopilots and aircraft dynamics correspond to the existing NASA Terminal Configured Vehicle. Significant transients were observed during MLS transition, primarily in the vertical channel. These transients have a significant impact on airspace requirements and operational procedures in the RNAV/MLS environment.

Heine, W.↗

Enabling Robust Exoplanet Atmospheric Retrievals with Gaussian Processes

Atmospheric retrievals are essential tools for interpreting exoplanet transmission and eclipse spectra, enabling quantitative constraints on the chemical composition, aerosol properties, and thermal structure of planetary atmospheres. The James Webb Space Telescope (JWST) offers unprecedented spectral precision, resolution, and wavelength coverage, unlocking transformative insights into the formation, evolution, climate, and potential habitability of planetary systems. However, this opportunity is accompanied by challenges: modeling assumptions and unaccounted-for noise or signal sources can bias retrieval outcomes and their interpretation. To address these limitations, we introduce a Gaussian process (GP)-aided atmospheric retrieval framework that flexibly accounts for unmodeled features and correlated noise in exoplanet spectra. We validate this method on synthetic JWST observations, and show that GP-aided retrievals reduce bias in inferred abundances and better capture model–data mismatches than traditional approaches. We also introduce the concept of mean squared error to quantify the trade-off between bias and variance, arguing that this metric more accurately reflects retrieval performance than bias alone. We then reanalyze the NIRISS/SOSS JWST transmission spectrum of WASP-96 b, finding that GP-aided retrievals yield broader constraints on CO 2 and H 2 O, possibly alleviating tension between previous retrieval results and equilibrium predictions. Our GP framework provides precise and accurate constraints while highlighting regions where models fail to explain the data. As JWST matures and future facilities come online, a deeper understanding of the limitations of both data and models will be essential, and GP-enabled retrievals like the one presented here offer a principled path forward.

Rotman, Yoav [Arizona State Univ., Tempe, AZ (Unit↗

US-EUSST SSA Data Exchange for Improved Orbital Safety

Data sharing and exchange among different Space Situational Awareness (SSA) data collectors/providers is frequently discussed as a mechanism to improve the accuracy and precision of orbital safety products. Indeed, at the conceptual level this claim is quite sensible: objects with more tracking, and thus presumably better distribution of that tracking about their orbit, should produce updates with smaller epoch errors and more realistic covariances at epoch, which should then translate into better performance in prediction and thus improved close approach calculations. However, this thesis has not been verified with any large study involving two different data providers, through which the amount of realized improvement can be quantified and, perhaps more importantly, the logistics of effecting observation data sharing in a regularized way can be established and circulated to assist others. To create rubrics for helpful data sharing for conjunction assessment applications, and to collect empirical data on the improvements achieved through sharing of measurement data, the US Office of Space Commerce and the European Union Space Surveillance and Tracking (EUSST) Support Framework have embarked on a joint experiment to collect and exchange satellite metric observations on selected satellites of interest over an experimental period. Each entity will perform orbit determination with their own observations, the other entity’s observations, and with both observation data sets combined. The product results will be compared with each other, showing differences attributable both to the three different data groups and to the two entities’ different approaches to orbit determination. The exemplar satellites include both objects that have external precision reference ephemerides and those that do not, allowing the experiment to exercise both precision-comparison and assimilative-comparison techniques. The present reporting will give preliminary results and a set of lessons learned for data sharing; a second presentation later in 2023 will provide a full accounting of the experiment’s results. The hope is that, through this work, a pathway can be established for the expeditious and fruitful sharing among collection entities, both commercial and governmental.

space situational awareness↗

The undetected error probability for shortened hamming codes

Hamming or shortened Hamming codes are widely used for error detection in data communications. For example, the CCITT (International Telegraph and Telephone Consultative Committee) recommendation X.25 for packet-switched data networks adopts a distance-4 cyclic Hamming code with 16 parity-check bits for error detection. The natural length of this code is n = 2(15)-1 = 32,767. In practice the length of a data packet is no more than a few thousand bits which is much shorter than the natural length of the code. Consequently, a shortened version of thecode is used. Often the length of a data packet varies, say from a few hundred bits to a few thousand bits, hence the code must be shortened by various degrees. Shortening affects the performance of the code. The error-detection performance of shortened Hamming codes, particularly the codes obtained from the distance-4 Hamming codes adopted by CCITT recommendation X.25, is investigated. A method for computing the probability of an undetected error is presented.

Costello, D. J., Jr.↗

Performance Of Digital Data-Transition-Tracking Loop

Report presents theoretical study of performance of all-digital data-transition-tracking loop (DTTL). Equations derived to analyze effects of few samples per symbol period and of noncommensurate sampling and symbol rates. Noise and frequency response taken into account. Effects upon variance of phase error and on mean time to lose lock quantified through computer simulations. Because of phase ambiguity, digital DTTL performs poorly when number of samples per symbol period is small.

Hinedi, Sami M.↗

Mission Simulation of Space Lidar Measurements for Seasonal and Regional CO2 Variations

Results of mission simulation studies are presented for a laser-based atmospheric [82 sounder. The simulations are based on real-time carbon cycle process modeling and data analysis. The mission concept corresponds to the Active Sensing of [82 over Nights, Days, and Seasons (ASCENDS) recommended by the US National Academy of Sciences Decadal Survey of Earth Science and Applications from Space. One prerequisite for meaningful quantitative sensor evaluation is realistic CO2 process modeling across a wide range of scales, i.e., does the model have representative spatial and temporal gradients? Examples of model comparison with data will be shown. Another requirement is a relatively complete description of the atmospheric and surface state, which we have obtained from meteorological data assimilation and satellite measurements from MODIS and [ALIPS0. We use radiative transfer model calculations, an instrument model with representative errors ' and a simple retrieval approach to complete the cycle from "nature" run to "pseudo-data" CO2, Several mission and instrument configuration options are examined/ and the sensitivity to key design variables is shown. We use the simulation framework to demonstrate that within reasonable technological assumptions for the system performance, relatively high measurement precision can be obtained, but errors depend strongly on environmental conditions as well as instrument specifications. Examples are also shown of how the resulting pseudo - measurements might be used to address key carbon cycle science questions.

Kawa, Stephan↗

An L-Band Brightness Temperature Disaggregation Method Using S-Band Radiometer Data for the Water Cycle Observation Mission (WCOM)

The Water Cycle Observation Mission (WCOM) will build upon previous L and C band passive microwave soil moisture satellite missions. WCOM will consist of a passive microwave synthetic aperture radiometer operating at L, S, and C bands. The WCOM requirements for passive soil moisture are to estimate soil moisture in the top 5 cm of soil layer with an error less than 0.04 cu m/cu m, at 15 km resolution and with a 3-day revisit. A new set of algorithms for these multi-frequency platforms will need to be developed for estimating the data products at the desired resolution. To accomplish this, a brightness temperature (TB) downscaling methodology is developed that uses passive S-band TB (30 km) to downscale L-band TB (50 km) and to estimate soil moisture at a 30 km resolution, based on the linear relationships between the passive signals of L-band and S-band. To test this downscaling method, analysis was performed using PALS data from the Soil Moisture Experiments in 2002 (SMEX02). For this study, 4 km L-band observations were downscaled to 800 m. The root mean square errors (RMSE) between the downscaled TBL at 800m with the observed TBL at 800m are 2.63 K and 1.60 K for H and V polarizations respectively. The results also showed that it was possible to use these disaggregated TB to estimate soil moisture to meet the mission requirement of 0.04 cu m/cu m. These results showed that we can obtain higher resolution soil moisture from L band passive TB with a high accuracy (<0.04 cu m/cu m) by using S-band information.

Disaggregation↗

Commercialization of a Non-Intrusive Optical (NIO) Technology to Measure Heliostat Optical Errors in Utility-Scale Concentrating Solar Power Plants: Final TCF Report

The drone-based Non-Intrusive Optical (NIO) Technology has been developed at NREL to allow for efficient and automated optical characterization of heliostats in Concentrating Solar Power (CSP) plants. For this project, the technology will be developed into a commercial tool package, including software and user-interface (UI), operations manual, and training and support services. The project team will partner with Tietronix to perform market assessment and stakeholder engagement, develop the tool package and business model, and perform data collection and analysis to demonstrate and refine the capabilities for use at a commercial plant. The team will collaborate with a commercial plant to conduct the data collection operations and provide optical error deliverables. The goal of the project is to advance the commercialization of the technology to a stage where a beta version can be demonstrated at additional commercial plants and developed into a licensable product.

14 SOLAR ENERGY↗

Comparison of Kalman filter and optimal smoother estimates of spacecraft attitude

Given a valid system model and adequate observability, a Kalman filter will converge toward the true system state with error statistics given by the estimated error covariance matrix. The errors generally do not continue to decrease. Rather, a balance is reached between the gain of information from new measurements and the loss of information during propagation. The errors can be further reduced, however, by a second pass through the data with an optimal smoother. This algorithm obtains the optimally weighted average of forward and backward propagating Kalman filters. It roughly halves the error covariance by including future as well as past measurements in each estimate. This paper investigates whether such benefits actually accrue in the application of an optimal smoother to spacecraft attitude determination. Tests are performed both with actual spacecraft data from the Extreme Ultraviolet Explorer (EUVE) and with simulated data for which the true state vector and noise statistics are exactly known.

Sedlak, J.↗

Associations between errors and contributing factors in aircraft maintenance

In recent years cognitive error models have provided insights into the unsafe acts that lead to many accidents in safety-critical environments. Most models of accident causation are based on the notion that human errors occur in the context of contributing factors. However, there is a lack of published information on possible links between specific errors and contributing factors. A total of 619 safety occurrences involving aircraft maintenance were reported using a self-completed questionnaire. Of these occurrences, 96% were related to the actions of maintenance personnel. The types of errors that were involved, and the contributing factors associated with those actions, were determined. Each type of error was associated with a particular set of contributing factors and with specific occurrence outcomes. Among the associations were links between memory lapses and fatigue and between rule violations and time pressure. Potential applications of this research include assisting with the design of accident prevention strategies, the estimation of human error probabilities, and the monitoring of organizational safety performance.

Professional Competence↗

Effect of contrast on human speed perception

This study is part of an ongoing collaborative research effort between the Life Science and Human Factors Divisions at NASA ARC to measure the accuracy of human motion perception in order to predict potential errors in human perception/performance and to facilitate the design of display systems that minimize the effects of such deficits. The study describes how contrast manipulations can produce significant errors in human speed perception. Specifically, when two simultaneously presented parallel gratings are moving at the same speed within stationary windows, the lower-contrast grating appears to move more slowly. This contrast-induced misperception of relative speed is evident across a wide range of contrasts (2.5-50 percent) and does not appear to saturate (e.g., a 50 percent contrast grating appears slower than a 70 percent contrast grating moving at the same speed). The misperception is large: a 70 percent contrast grating must, on average, be slowed by 35 percent to match a 10 percent contrast grating moving at 2 deg/sec (N = 6). Furthermore, it is largely independent of the absolute contrast level and is a quasilinear function of log contrast ratio. A preliminary parametric study shows that, although spatial frequency has little effect, the relative orientation of the two gratings is important. Finally, the effect depends on the temporal presentation of the stimuli: the effects of contrast on perceived speed appears lessened when the stimuli to be matched are presented sequentially. These data constrain both physiological models of visual cortex and models of human performance. We conclude that viewing conditions that effect contrast, such as fog, may cause significant errors in speed judgments.

Stone, Leland S.↗