Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Results of the NASA Prediction Uncertainty Reduction Tech Challenge

In January 2021 the Advanced Air Vehicles Program approved a new Tech Challenge (TC) to be run out of the Commercial Supersonic Technology (CST) Project. The objective of the TC was to bring uncertainties in the empirical noise modeling for civilian supersonic aircraft into the same range as that of conventional aircraft. The TC goal statement was to “Produce data and demonstrate tools that reduce the uncertainty in predicting Landing & Takeoff Noise levels of supersonic-relevant designs by 5 EPNdB and are ready for use in studies to inform FAA rule-making.” To make the required improvements in noise prediction methods for supersonic aircraft, NASA decided to validate and use high-fidelity numerical simulations to acquire the needed noise data on supersonic propulsion configurations. High-fidelity component designs were developed, such as a two-stage propulsor behind a supersonic inlet designed by General Electric Aviation and variable area exhaust systems using input from recent contracts with GE and Rolls Royce. A noise database was generated as a function of geometric and flow parameters, providing corrections to the empirical noise models and added new input variables to describe the complexities created by the supersonic-specific design features. Statistically, the new models were able to predict the acoustic impact of supersonic-specific features, the reduction in uncertainty being reduced from the baseline 7.8 EPNdB at the beginning of the TC to 2.0 EPNdB at the end.

noise prediction↗

Update on Prediction Uncertainty Reduction (PUR) Tech Challenge

NASA has taken on a Technical Challenge to reduce the uncertainty in prediction of noise from near-term commercial supersonic aircraft. To date, an assessment has been done to baseline this effort, quantifying how much more uncertainty exists when the system-level prediction methods are applied to supersonic aircraft as compared to conventional aircraft. And an assessment has been made for the uncertainty in the physics-based simulations for jets. These will be briefly demonstrated.

supersonic↗

The Impact of Trajectory Prediction Uncertainty on Air Traffic Controller Performance and Acceptability

A Human-In-The-Loop air traffic control simulation investigated the impact of uncertainties in trajectory predictions on NextGen Trajectory-Based Operations concepts, seeking to understand when the automation would become unacceptable to controllers or when performance targets could no longer be met. Retired air traffic controllers staffed two en route transition sectors, delivering arrival traffic to the northwest corner-post of Atlanta approach control under time-based metering operations. Using trajectory-based decision-support tools, the participants worked the traffic under varying levels of wind forecast error and aircraft performance model error, impacting the ground automations ability to make accurate predictions. Results suggest that the controllers were able to maintain high levels of performance, despite even the highest levels of trajectory prediction errors.

trajectory prediction uncertainty↗

Aircraft System Noise Prediction Uncertainty Quantification for a Hybrid Wing Body Subsonic Transport Concept

Aircraft system level noise prediction for advanced, unconventional concepts has undergone significant improvement over the past two decades. The prediction modeling uncertainty must be quantified so that potential benefits of unconventional configurations, which are outside of the range of empirical models, can be reliably assessed. This paper builds on previous work in an effort to improve estimates of element prediction uncertainties where the prediction methodology has been improved, or new experimental validation data are available, to provide an estimate of the system level uncertainty in the prediction process. In general, the uncertainty of the prediction will be strongly dependent on the aircraft configuration as well as which technologies are integrated. While the quantitative uncertainty values contained here are specific to the hybrid wing body design presented, the underlying process is the same regardless of configuration. A refined process for determining the uncertainty for each element of the noise prediction is detailed in this paper. The system level uncertainty in the prediction of the aircraft noise is determined at the three certification points, using a Monte Carlo method. Comparisons with previous work show a reduction of 1 EPNdB in the 95%coverage interval of the cumulative noise level. The largest impediment for continued reduction in uncertainty for the hybrid wing body concept is the need for improved modeling and validation experiments for fan noise, propulsion airframe aeroacoustic effects, and the Krueger flap, which comprise the bulk of the uncertainty in the cumulative certification noise level.

June, Jason C.↗

Controller Strategies for Automation Tool Use under Varying Levels of Trajectory Prediction Uncertainty

A human-in-the-loop simulation was conducted to examine the effects of varying levels of trajectory prediction uncertainty on air traffic controller workload and performance, as well as how strategies and the use of decision support tools change in response. This paper focuses on the strategies employed by two controllers from separate teams who worked in parallel but independently under identical conditions (airspace, arrival traffic, tools) with the goal of ensuring schedule conformance and safe separation for a dense arrival flow in en route airspace. Despite differences in strategy and methods, both controllers achieved high levels of schedule conformance and safe separation. Overall, results show that trajectory uncertainties introduced by wind and aircraft performance prediction errors do not affect the controllers' ability to manage traffic. Controller strategies were fairly robust to changes in error, though strategies were affected by the amount of delay to absorb (scheduled time of arrival minus estimated time of arrival). Using the results and observations, this paper proposes an ability to dynamically customize the display of information including delay time based on observed error to better accommodate different strategies and objectives.

Strategy↗

Assessment of Laminar, Convective Aeroheating Prediction Uncertainties for Mars Entry Vehicles

An assessment of computational uncertainties is presented for numerical methods used by NASA to predict laminar, convective aeroheating environments for Mars entry vehicles. A survey was conducted of existing experimental heat-transfer and shock-shape data for high enthalpy, reacting-gas CO2 flows and five relevant test series were selected for comparison to predictions. Solutions were generated at the experimental test conditions using NASA state-of-the-art computational tools and compared to these data. The comparisons were evaluated to establish predictive uncertainties as a function of total enthalpy and to provide guidance for future experimental testing requirements to help lower these uncertainties.

Hollis, Brian R.↗

Assessment of Laminar, Convective Aeroheating Prediction Uncertainties for Mars-Entry Vehicles

An assessment of computational uncertainties is presented for numerical methods used by NASA to predict laminar, convective aeroheating environments for Mars-entry vehicles. A survey was conducted of existing experimental heat transfer and shock-shape data for high-enthalpy reacting-gas CO2 flows, and five relevant test series were selected for comparison with predictions. Solutions were generated at the experimental test conditions using NASA state-of-the-art computational tools and compared with these data. The comparisons were evaluated to establish predictive uncertainties as a function of total enthalpy and to provide guidance for future experimental testing requirements to help lower these uncertainties.

Hollis, Brian R.↗

An Efficient Deterministic Approach to Model-based Prediction Uncertainty Estimation

Prognostics deals with the prediction of the end of life (EOL) of a system. EOL is a random variable, due to the presence of process noise and uncertainty in the future inputs to the system. Prognostics algorithm must account for this inherent uncertainty. In addition, these algorithms never know exactly the state of the system at the desired time of prediction, or the exact model describing the future evolution of the system, accumulating additional uncertainty into the predicted EOL. Prediction algorithms that do not account for these sources of uncertainty are misrepresenting the EOL and can lead to poor decisions based on their results. In this paper, we explore the impact of uncertainty in the prediction problem. We develop a general model-based prediction algorithm that incorporates these sources of uncertainty, and propose a novel approach to efficiently handle uncertainty in the future input trajectories of a system by using the unscented transformation. Using this approach, we are not only able to reduce the computational load but also estimate the bounds of uncertainty in a deterministic manner, which can be useful to consider during decision-making. Using a lithium-ion battery as a case study, we perform several simulation-based experiments to explore these issues, and validate the overall approach using experimental data from a battery testbed.

Daigle, Matthew J.↗

Toward Comprehensive Uncertainty Predictions for Remote Imaging Spectroscopy

Remote imaging spectroscopy’s role in Earth science will grow in the coming decade as a series of globe-spanning spectroscopy missions launch from NASA, ESA, and other agencies. The nature of remote imaging spectroscopy will change, advancing from short regional studies to address global multi-year questions. The diversity of data will also grow with exposure to a wider range of biomes and atmospheric conditions. To execute these new investigations we must reconcile diverse observing conditions to derive consistent global maps. To this end, rig- orous uncertainty quantification and propagation enables an optimal synthesis of data accounting for observing conditions and data quality. Understanding data uncertainties is also important for principled hypothesis testing, information content assessment, and informed decision making by end users. We survey prior efforts in uncer- tainty quantification for imaging spectroscopy, and describe methods for validating the accuracy of uncertainty predictions. We conclude with a discussion of remaining challenges and promising avenues for future research.

Susiluoto, Jouni↗

Advanced Methods for Determining Prediction Uncertainty in Model-Based Prognostics with Application to Planetary Rovers

Prognostics is centered on predicting the time of and time until adverse events in components, subsystems, and systems. It typically involves both a state estimation phase, in which the current health state of a system is identified, and a prediction phase, in which the state is projected forward in time. Since prognostics is mainly a prediction problem, prognostic approaches cannot avoid uncertainty, which arises due to several sources. Prognostics algorithms must both characterize this uncertainty and incorporate it into the predictions so that informed decisions can be made about the system. In this paper, we describe three methods to solve these problems, including Monte Carlo-, unscented transform-, and first-order reliability-based methods. Using a planetary rover as a case study, we demonstrate and compare the different methods in simulation for battery end-of-discharge prediction.

prognosis↗

Urban Air Mobility Noise: Current Practice, Gaps, and Recommendations

AN Air Mobility (UAM) is an opportunity for aviation to improve transportation systems across the world. Representative UAM vehicle attributes include electrical vertical takeoff and landing (eVTOL) vehicles that can accommodate up to 6 passengers (or equivalent cargo), are possibly autonomous, perform missions of up to 100 nautical miles at altitudes up to 3000 ft. above ground level, have flight speeds up to 200 knots, and weigh between 800 and 8000 pounds. Along with the many anticipated benefits, there will be noise issues that need to be addressed. In 2018, NASA formed an Urban Air Mobility Noise Working Group (UNWG) to assemble noise experts from industry, universities and government agencies to identify, discuss, and address UAM noise issues. This oral presentation summarizes technology gaps and goals associated with four areas of interest: Tools & Technologies, Ground & Flight Testing, Human Response & Metrics, and Regulation & Policy, and is drawn from a draft white paper [1] by the same title. Tools & Technologies include noise prediction tools and noise reduction technologies that have been developed for conventional rotorcraft and fixed-wing vehicles that may be applicable or need to be modified for UAM. Prediction tools need to be able to account for variable speed rotors and other temporal variation effects that impact community noise. A reprioritization of noise sources needs to be done since UAM vehicles include multiple rotors/propellers, often in proximity to one another and/or the airframe, with dynamic transition, and new noise sources such as electric motors or hybrid-electric propulsion. Scattering and propagation methods need to be developed that include the vehicle components and surfaces near a receiver such as buildings and vertiports. Validation databases are needed to quantify prediction uncertainties. Prediction tools used to evaluate community noise will need source models appropriate for a wide range of UAM vehicles. Existing noise reduction technologies need to be evaluated and new noise reduction technologies should be developed in anticipation of future noise requirements. Although the prediction and treatment of interior cabin noise is a secondary goal, it is recognized that new tools and methods may be needed due to the uniqueness of the vehicle design and the presence of both acoustic and structure-borne loads. Ground & Flight Testing has been a critical part of validating noise reduction technologies and verifying that an air vehicle is ready for certification. UAM vehicles introduce new challenges for test procedures such as different source noise directivity, unsteady sources due to maneuvers, and a variety of takeoff and approach trajectories. The operating environment will be more complex than current aircraft with the introduction of vertiports in populated areas with “urban canyons” making reflections an important part of noise prediction and annoyance. It is expected that new test procedures and measurement methods will be necessary. Consideration will need to be given for both piloted and autonomous operations. Human Response & Metrics may be very different for UAM noise compared to current experience with airport noise. Current metrics used to certify rotorcraft and fixed-wing aircraft may not be as useful for evaluating UAM noise. Operations at lower altitudes may influence annoyance. Psychoacoustic and community testing will be needed to quantify annoyance and assess appropriate metrics. In addition to conventional noise level metrics, considerations such as audibility and temporal variation of the sound may be required. Differences between indoor or outdoor exposure will have an impact with dependence on urban and residential flight paths. Aircraft noise is currently regulated at a national level and typically involves partnerships with the industry to establish regulations. Regulators realize that current policies and procedures may not be appropriate for some of the emerging air vehicles and new procedures may be needed to address UAM noise. Development of new policies and procedures are needed so that local communities do not hastily attempt to establish their own restrictions that will both limit growth of the market and create an inconsistent and confusing regulatory environment. To expedite this development, it is crucial early measurement data are shared through partnership arrangements to support both noise certification and noise modeling/noise assessment. At the same time, an effective engagement strategy should be developed to address local community noise issues associated with UAM vehicles and flight operations as they arise.

urban air mobility↗

Uncertainties in Predicting Rice Yield by Current Crop Models Under a Wide Range of Climatic Conditions

Predicting rice (Oryza sativa) productivity under future climates is important for global food security. Ecophysiological crop models in combination with climate model outputs are commonly used in yield prediction, but uncertainties associated with crop models remain largely unquantified. We evaluated 13 rice models against multi-year experimental yield data at four sites with diverse climatic conditions in Asia and examined whether different modeling approaches on major physiological processes attribute to the uncertainties of prediction to field measured yields and to the uncertainties of sensitivity to changes in temperature and CO2 concentration [CO2]. We also examined whether a use of an ensemble of crop models can reduce the uncertainties. Individual models did not consistently reproduce both experimental and regional yields well, and uncertainty was larger at the warmest and coolest sites. The variation in yield projections was larger among crop models than variation resulting from 16 global climate model-based scenarios. However, the mean of predictions of all crop models reproduced experimental data, with an uncertainty of less than 10 percent of measured yields. Using an ensemble of eight models calibrated only for phenology or five models calibrated in detail resulted in the uncertainty equivalent to that of the measured yield in well-controlled agronomic field experiments. Sensitivity analysis indicates the necessity to improve the accuracy in predicting both biomass and harvest index in response to increasing [CO2] and temperature.

crop-model ensembles↗

Study of Uncertainties of Predicting Space Shuttle Thermal Environment

Quantitative estimates of the uncertainty in predicting aerodynamic heating rates for a fully reusable space shuttle system are developed and the impact of these uncertainties on Thermal Protection System (TPS) weight are discussed. The study approach consisted of statistical evaluations of the scatter of heating data on shuttle configurations about state-of-the-art heating prediction methods to define the uncertainty in these heating predictions. The uncertainties were then applied as heating rate increments to the nominal predicted heating rate to define the uncertainty in TPS weight. Separate evaluations were made for the booster and orbiter, for trajectories which included boost through reentry and touchdown. For purposes of analysis, the vehicle configuration is divided into areas in which a given prediction method is expected to apply, and separate uncertainty factors and corresponding uncertainty in TPS weight derived for each area.

Fehrman, A. L.↗

Investigating Uncertainty in Predicting Carbon Dynamics in North American Biomes: Putting Support-Effect Bias in Perspective

A fundamental strategy in NASA's Earth Observing System's (EOS) monitoring of vegetation and its contribution to the global carbon cycle is to rely on deterministic, process-based ecosystem models to make predictions of carbon flux over large regions. These models are parameterized (that is, the input variables are derived) using remotely sensed images such as those from the Moderate Resolution Imaging Spectroradiometer (MODIS), ground measurements and interpolated maps. Since early applications of these models, investigators have noted that results depend partly on the spatial support of the input variables. In general, the larger the support of the input data, the greater the chance that the effects of important components of the ecosystem will be averaged out. A review of previous work shows that using large supports can cause either positive or negative bias in carbon flux predictions. To put the magnitude and direction of these biases in perspective, we must quantify the range of uncertainty on our best measurements of carbon-related variables made on equivalent areas. In other words, support-effect bias should be placed in the context of prediction uncertainty from other sources. If the range of uncertainty at the smallest support is less than the support-effect bias, more research emphasis should probably be placed on support sizes that are intermediate between those of field measurements and MODIS. If the uncertainty range at the smallest support is larger than the support-effect bias, the accuracy of MODIS-based predictions will be difficult to quantify and more emphasis should be placed on field-scale characterization and sampling. This talk will describe methods to address these issues using a field measurement campaign in North America and "upscaling" using geostatistical estimation and simulation.

Dungan, Jennifer L.↗

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗