Search NASA⌕ Search

SEARCH · Search NASA

Results for “value analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Lubricant jet flow phenomena in spur and helical gears with modified center distances and/or addendums for out-of-mesh conditions

Out-of-mesh jet lubrication of gears was examined. The pinion impingement cycle was described briefly. An analysis was developed for the lubricant jet flow in the out-of-mesh condition. The analysis provides for the inclusion of modified center distances and modified addendums. Equations were generated for the limit values of variables necessary to remove the severe limitations to facilitate computer analysis. A computer program was designed using these limit formulas to prevent negative impingement (missing) on the pinion.

Akin, L. S.↗

Lubricant jet flow phenomena in spur and helical gears with modified center distances and/or addendums - For out-of-mesh conditions

Out-of-mesh jet lubrication of gears was examined. The pinion impingement cycle was described briefly. An analysis was developed for the lubricant jet flow in the out-of-mesh condition. The analysis provides for the inclusion of modified center distances and modified addendum. Equations were generated for the limit values of variables necessary to remove the severe limitations to facilitate computer analysis. A computer program was designed using these limit formulas to prevent negative impingement (missing) on the pinion.

Akin, L. S.↗

Comparison of Extreme Value Distributions for Electrostatic Discharge Magnitudes in Spacecraft Charging Tests

Electrostatic Discharge (ESD) induced by the accumulation of charge in the space environment is known to cause spacecraft anomalies and failures. While it is critical to estimate the worst-case expected ESD, sensitive radar instruments can be impacted by high rates of occurrence of very small ESD. To estimate the correct extreme behavior, it is important to select the correct extreme value distribution for extrapolation of test results limited in time and sensitivity. Quantile-quantile (Q-Q) analysis is used to compare electron beam-induced ESD test data to several statistical distributions used in the published literature. The best-fit distribution is shown to vary from between tests on different materials; however, it is clear that power law distributions are not good approximations for low amplitude events. Q-Q analysis is a convenient graphical method for evaluating multiple theoretical extreme-value distributions simultaneously.

Kim, Wousik↗

Systematic Errors in Simulated L-Band Brightness Temperature in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission has been providing L-band (1.4 GHz) brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF), the SMAP Level-4 Soil Moisture (L4_SM) product provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications. The EnKF-based L4_SM analysis assumes unbiased forecast errors. Consequently, the seasonally varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations. The L4_SM system is thus designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (possibly wrong) climatology. In this paper, we examine the Tb observation-minus-forecast (O-F) residuals from the L4_SM Version 7 product (computed after rescaling the Tb observations to the mean seasonal cycle of the simulated Tb). The long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. The model forecast Tb, however, still exhibits undesirable systematic errors relative to the (rescaled) Tb observations. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to improve the L4_SM algorithm.

Rolf Reichle↗

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Uncertainty quantification (UQ) is a rapidly growing and evolving discipline, especially within the aerospace community. Performing analysis with UQ can provide decision makers with a wealth of information about a candidate design. However, the value of UQ is fully realized when the information gained during UQ analysis is leveraged in a feedback loop of a design optimization process, often referred to as design under uncertainty. Although design under uncertainty can be a powerful risk mitigation technique, there are a number of roadblocks that prevent its implementation. Two primary factors are computational costs and added complexity of the analysis. High fidelity simulations on the order tens of uncertain variables quickly become computationally infeasible. Also, implementing UQ into an existing multidisciplinary design and optimization (MDO) process often requires extensive knowledge of the UQ methods and careful treatment of the problem formulation. The objective of this work is to address these two primary roadblocks and enable practitioners to efficiently perform design under uncertainty with limited knowledge of the UQ discipline. Methods outlined in this paper demonstrate MDO incorporating UQ into the design process, leveraging an analytic derivative tool chain through the entire optimization. The proposed approach leverages machine learning techniques to generate a differentiable confidence interval output from polynomial chaos models. This technique, coupled with the incorporation of analytical derivatives through the Polynomial Chaos Expansion (PCE) process, eliminates the need to estimate derivatives which are usually obtained from finite difference, complex step, or similar methods. Developing a differentiable confidence interval allows mixed uncertainty problems (both epistemic and aleatory) to be modeled. Without such modeling, these problems cannot accurately predict objective functions containing statistical quantities such as mean and variance. The addition of analytic derivatives to a polynomial chaos-based UQ method decreases the computational costs of performing design under uncertainty by orders of magnitude in comparison with methods such as complex step. The method and codes developed are modular in nature and are a drop-in solution for design under uncertainty within existing MDO problems. A low-fidelity analytical multidisciplinary optimization under uncertainty for a wing design in OpenMDAO is detailed in this paper. This demonstration case will include both objective functions and constraints which are influenced by uncertain parameters.

Ben D Phillips↗

End-To-End Uncertainty Quantification with Analytical Derivatives for Design Under Uncertainty

Uncertainty quantification (UQ) is a rapidly growing and evolving discipline, especially within the aerospace community. Performing analysis with UQ can provide decision makers with a wealth of information about a candidate design. However, the value of UQ is fully realized when the information gained during UQ analysis is leveraged in a feedback loop of a design optimization process, often referred to as design under uncertainty. Although design under uncertainty can be a powerful risk mitigation technique, there are a number of roadblocks that prevent its implementation. Two primary factors are computational costs and added complexity of the analysis. High fidelity simulations on the order tens of uncertain variables quickly become computationally infeasible. Also, implementing UQ into an existing multidisciplinary design and optimization (MDO) process often requires extensive knowledge of the UQ methods and careful treatment of the problem formulation. The objective of this work is to address these two primary roadblocks and enable practitioners to efficiently perform design under uncertainty with limited knowledge of the UQ discipline. Methods outlined in this paper demonstrate MDO incorporating UQ into the design process, leveraging an analytic derivative tool chain through the entire optimization. The proposed approach leverages machine learning techniques to generate a differentiable confidence interval output from polynomial chaos models. This technique, coupled with the incorporation of analytical derivatives through the Polynomial Chaos Expansion (PCE) process, eliminates the need to estimate derivatives which are usually obtained from finite difference, complex step, or similar methods. Developing a differentiable confidence interval allows mixed uncertainty problems (both epistemic and aleatory) to be modeled. Without such modeling, these problems cannot accurately predict objective functions containing statistical quantities such as mean and variance. The addition of analytic derivatives to a polynomial chaos-based UQ method decreases the computational costs of performing design under uncertainty by orders of magnitude in comparison with methods such as complex step. The method and codes developed are modular in nature and are a drop-in solution for design under uncertainty within existing MDO problems. A low-fidelity analytical multidisciplinary optimization under uncertainty for a wing design in OpenMDAO is detailed in this paper. This demonstration case will include both objective functions and constraints which are influenced by uncertain parameters.

Ben Phillips↗

Analysis of remote sensing data for evaluation of vegetation resources

Research has centered around: (1) completion of a study on the use of remote sensing techniques as an aid to multiple use management; (2) determination of the information transfer at various image resolution levels for wildland areas; and (3) determination of the value of small scale multiband, multidate photography for the analysis of vegetation resources. In addition, a substantial effort was made to upgrade the automatic image classification and spectral signature acquisition capabilities of the laboratory. It was found that: (1) Remote sensing techniques should be useful in multiple use management to provide a first-cut analysis of an area. (2) Imagery with 400-500 feet ground resolvable distance (GRD), such as that expected from ERTS-1, should allow discriminations to be made between woody vegetation, grassland, and water bodies with approximately 80% accuracy. (3) Barley and wheat acreages in Maricopa County, Arizona could be estimated with acceptable accuracies using small scale multiband, multidate photography. Sampling errors for acreages of wheat, barley, small grains (wheat and barley combined), and all cropland were 13%, 11%, 8% and 3% respectively.

Source record↗

Assessment of OMI Near-UV Aerosol Optical Depth over Land

This is the first comprehensive assessment of the aerosol optical depth (AOD) product retrieved from the near-UV observations by the Ozone Monitoring Instrument (OMI) onboard the Aura satellite. The OMI-retrieved AOD by the ultraviolet (UV) aerosol algorithm (OMAERUV version 1.4.2) was evaluated using collocated Aerosol Robotic Network (AERONET) level 2.0 direct Sun AOD measurements over 8 years (2005-2012). A time series analysis of collocated satellite and ground-based AOD observations over 8 years shows no discernible drift in OMI's calibration. A rigorous validation analysis over 4 years (2005-2008) was carried out at 44 globally distributed AERONET land sites. The chosen locations are representative of major aerosol types such as smoke from biomass burning or wildfires, desert mineral dust, and urban/industrial pollutants. Correlation coefficient (p) values of 0.75 or better were obtained at 50 percent of the sites with about 33 percent of the sites in the analysis reporting regression line slope values larger than 0.70 but always less than unity. The combined AERONET-OMAERUV analysis of the 44 sites yielded a p of 0.81, slope of 0.79, Y intercept of 0.10, and 65 percent OMAERUV AOD falling within the expected uncertainty range (largest of 30 percent or 0.1) at 440 nanometers. The most accurate OMAERUV retrievals are reported over northern Africa locations where the predominant aerosol type is desert dust and cloud presence is less frequent. Reliable retrievals were documented at many sites characterized by urban-type aerosols with low to moderate AOD values, concentrated in the boundary layer. These results confirm that the near-ultraviolet observations are sensitive to the entire aerosol column. A simultaneous comparison of OMAERUV, Moderate Resolution Imaging Spectroradiometer (MODIS) Deep Blue, and Multiangle Imaging Spectroradiometer (MISR) AOD retrievals to AERONET measurements was also carried out to evaluate the OMAERUV accuracy in relation to those of the standard aerosol satellite products. The outcome of the comparison indicates that OMAERUV, MODIS Deep Blue, and MISR retrieval accuracies in arid and semiarid environments are statistically comparable.

aerosol optical depth↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncer- tainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncertainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems: Preprint

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncertainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

Prediction of coefficients of thermal expansion for unidirectional composites

Several analyses for predicting the longitudinal, alpha(1), and transverse, alpha(2), coefficients of thermal expansion of unidirectional composites were compared with each other, and with experimental data on different graphite fiber reinforced resin, metal, and ceramic matrix composites. Analytical and numerical analyses that accurately accounted for Poisson restraining effects in the transverse direction were in consistently better agreement with experimental data for alpha(2), than the less rigorous analyses. All of the analyses predicted similar values of alpha(1), and were in good agreement with the experimental data. A sensitivity analysis was conducted to determine the relative influence of constituent properties on the predicted values of alpha(1), and alpha(2). As would be expected, the prediction of alpha(1) was most sensitive to longitudinal fiber properties and the prediction of alpha(2) was most sensitive to matrix properties.

Bowles, David E.↗

Applications of Automation Methods for Nonlinear Fracture Test Analysis

Using automated and standardized computer tools to calculate the pertinent test result values has several advantages such as: 1. allowing high-fidelity solutions to complex nonlinear phenomena that would be impractical to express in written equation form, 2. eliminating errors associated with the interpretation and programing of analysis procedures from the text of test standards, 3. lessening the need for expertise in the areas of solid mechanics, fracture mechanics, numerical methods, and/or finite element modeling, to achieve sound results, 4. and providing one computer tool and/or one set of solutions for all users for a more "standardized" answer. In summary, this approach allows a non-expert with rudimentary training to get the best practical solution based on the latest understanding with minimum difficulty.Other existing ASTM standards that cover complicated phenomena use standard computer programs: 1. ASTM C1340/C1340M-10- Standard Practice for Estimation of Heat Gain or Loss Through Ceilings Under Attics Containing Radiant Barriers by Use of a Computer Program 2. ASTM F 2815 - Standard Practice for Chemical Permeation through Protective Clothing Materials: Testing Data Analysis by Use of a Computer Program 3. ASTM E2807 - Standard Specification for 3D Imaging Data Exchange, Version 1.0 The verification, validation, and round-robin processes required of a computer tool closely parallel the methods that are used to ensure the solution validity for equations included in test standard. The use of automated analysis tools allows the creation and practical implementation of advanced fracture mechanics test standards that capture the physics of a nonlinear fracture mechanics problem without adding undue burden or expense to the user. The presented approach forms a bridge between the equation-based fracture testing standards of today and the next generation of standards solving complex problems through analysis automation.

Allen, Phillip A.↗

NASA Human Spaceflight Scenarios - Do All Our Models Still Say No?

Historically, NASA human spaceflight planning has included healthy doses of life cycle cost analysis. Planners put projects and their cost estimates in a budget context. Estimated costs became expected budgets. Regardless, real budgets rarely matched expectations. So plans would come and go as NASA canceled projects. New projects would arise and the cycle would begin again. Repeatedly, NASA schedule and performance ambitions come up against costs growing at double-digit rates while budgets barely rise a couple of percent a year. Significant skepticism greets proposed NASA programs at birth, as cost estimates for new projects are traditionally very high, and worse, far off the mark for those carried forward. In this environment the current "capability driven framework" for NASA human spaceflight evolved, where long term life cycle cost analysis are even viewed as possibly counter-productive. Here, a space exploration project, for example the Space Launch System, focuses on immediate goals. A life cycle is that of a project, not a program, and for only that span of time to a near term milestone like a first test launch. Unfortunately, attempting to avoid some pitfalls in long-term life cycle cost analysis breeds others. Government audits have noted that limiting the scope of cost analysis "does not provide the transparency necessary to assess long-term affordability" making it difficult to understand if NASA "is progressing in a cost-effective and affordable manner." Even in this short-term framework, NASA realizes the importance of long-term considerations, that it must "maximize the efficiency and sustainability of the Exploration Systems development programs", that this is "critical to free resources for re-investment...such as other required deep space exploration capabilities." Assuming the value of long-term life cycle cost analysis, where due diligence meets reconnaissance, and accepting past shortcomings, the work here approaches life cycle cost analysis for human spaceflight differently. 1) If costs have traditionally been so high that adding them up is discouraging, are there any new facts on the ground offering paths to significantly lower costs? 2) If NASA's spaceflight budget and process is an over-arching constraint, with its planning limitations favoring short-term outlooks, is there a way to step outside the budget box? 3) If life cycle answers have historically been too uncertain to be useful, is there a process where stakeholders gain valuable insights merely from emphasizing a common understanding around questions? We analyze the potential life cycle cost of assorted NASA human spaceflight architectures - an architecture as a sum of individual systems, working together. With the prior questions of high costs, limited budgets and uncertainties in mind, public private partnerships are central in these architectures. The cost data for current commercial public private partnerships is encouraging, as are cost estimates for future partnership approaches beyond low Earth orbit. Private capital, directly or indirectly, an ingredient of public private partnerships, may be a significant factor in finding a path around the limits of the NASA spaceflight budget. Also, understanding and reviewing the pros, cons and uncertainties of assorted architectures can assist in developing a common understanding around key questions as important if not more so than the numbers and answers. Lastly, a scenario planning technique is briefly explored that can mature a common understanding about the agencies situation at hand and how diverse stakeholders can go forward together. Scenario planning, rather than focusing on answers, places emphasis on stakeholders developing a common understanding about the future. Putting aside costs, this is especially true of questions about sustainability and growth, results, benefits and expectations. While efficiency exercises or analysis look to reduce resources in one place to apply them elsewhere, moving around slices in a pie, scenario planning can get at the heart of the matter, growing the pie, transforming it, and making the pieces relevant. Especially important is the question of sustainability for different scenarios in the broad sense of the word - not just the narrow ability to survive or continue, but also the ability to adapt, prosper and grow.

space systems life cycle costs↗

Sensitivity of the ACCP Value Framework Science Benefit Score

NASA’s priorities for Earth Science are informed by the 2017-2027 Decadal Survey for Earth Science and Applications from Space of the National Academies of Sciences, Engineering and Medicine. In that document, five Designated Observables are identified as priorities for implementation: Aerosols, Cloud-Convection-Precipitation, Surface Biology, Mass Change, and Surface Deformation Change. In 2019, NASA initiated four multi-year studies to formulate, assess, and recommend potential Observing System concepts that are responsive to the recommendations of the Earth Science Decadal Survey. The Aerosols, Clouds, Convection, and Precipitation (ACCP) study investigates opportunities for synergistic science resulting from implementations that combine both Aerosols science objectives and Clouds, Convection, and Precipitation science objectives. For the ACCP study, a Value Framework was designed to introduce structure, transparency, and traceability in the mission down-select decision process. This paper presents a sensitivity analysis that was conducted to characterize the behavior of the science benefit score of the ACCP Value Framework. it includes derivations of the sensitivity analysis equations, numerical analyses of the behavior of the combined benefit score, and the conclusions drawn from the results of the work that was conducted. The results of this analysis were key to ensuring that the aggregated science benefit scores would enable the team to differentiate and contrast across concepts.

John McLaughlan↗

Knowledge-based decision support for Space Station assembly sequence planning

A complete Personal Analysis Assistant (PAA) for Space Station Freedom (SSF) assembly sequence planning consists of three software components: the system infrastructure, intra-flight value added, and inter-flight value added. The system infrastructure is the substrate on which software elements providing inter-flight and intra-flight value-added functionality are built. It provides the capability for building representations of assembly sequence plans and specification of constraints and analysis options. Intra-flight value-added provides functionality that will, given the manifest for each flight, define cargo elements, place them in the National Space Transportation System (NSTS) cargo bay, compute performance measure values, and identify violated constraints. Inter-flight value-added provides functionality that will, given major milestone dates and capability requirements, determine the number and dates of required flights and develop a manifest for each flight. The current project is Phase 1 of a projected two phase program and delivers the system infrastructure. Intra- and inter-flight value-added were to be developed in Phase 2, which has not been funded. Based on experience derived from hundreds of projects conducted over the past seven years, ISX developed an Intelligent Systems Engineering (ISE) methodology that combines the methods of systems engineering and knowledge engineering to meet the special systems development requirements posed by intelligent systems, systems that blend artificial intelligence and other advanced technologies with more conventional computing technologies. The ISE methodology defines a phased program process that begins with an application assessment designed to provide a preliminary determination of the relative technical risks and payoffs associated with a potential application, and then moves through requirements analysis, system design, and development.

Source record↗

BeyondPlanck: XII. Cosmological parameter constraints with end-to-end error propagation

We present cosmological parameter constraints estimated using the Bayesian BEYONDPLANCK analysis framework. This method supports seamless end-to-end error propagation from raw time-ordered data onto final cosmological parameters. As a first demonstration of the method, we analyzed time-ordered Planck LFI observations, combined with selected external data (WMAP 33–61 GHz, Planck HFI DR4 353 and 857 GHz, and Haslam 408 MHz) in the form of pixelized maps that are used to break critical astrophysical degeneracies. Overall, all the results are generally in good agreement with previously reported values from Planck 2018 and WMAP, with the largest relative difference for any parameter amounting about 1σ when considering only temperature multipoles between 30 ≤ ℓ ≤ 600. In cases where there are differences, we note that the BEYONDPLANCK results are generally slightly closer to the high-ℓ HFI-dominated Planck 2018 results than previous analyses, suggesting slightly less tension between low and high multipoles. Using low-ℓ polarization information from LFI and WMAP, we find a best-fit value of τ = 0.066 ± 0.013, which is higher than the low value of τ = 0.052 ± 0.008 derived from Planck 2018 and slightly lower than the value of 0.069 ± 0.011 derived from the joint analysis of official LFI and WMAP products. Most importantly, however, we find that the uncertainty derived in the BEYONDPLANCK processing is about 30 % greater than when analyzing the official products, after taking into account the different sky coverage. We argue that this uncertainty is due to a marginalization over a more complete model of instrumental and astrophysical parameters, which results in more reliable and more rigorously defined uncertainties. We find that about 2000 Monte Carlo samples are required to achieve a robust convergence for a low-resolution cosmic microwave background (CMB) covariance matrix with 225 independent modes, and producing these samples takes about eight weeks on a modest computing cluster with 256 cores.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantifying model-structure- and parameter-driven uncertainties in spring wheat phenology prediction with Bayesian analysis

Recent international efforts have brought renewed emphasis on the comparison of different agricultural systems models. Thus far, analysis of model-ensemble simulated results has not clearly differentiated between ensemble prediction uncertainties due to model structural differences per se and those due to parameter value uncertainties. Additionally, despite increasing use of Bayesian parameter estimation approaches with field-scale crop models, inadequate attention has been given to the full posterior distributions for estimated parameters. The objectives of this study were to quantify the impact of parameter value uncertainty on prediction uncertainty for modeling spring wheat phenology using Bayesian analysis and to assess the relative contributions of model-structure-driven and parameter-value-driven uncertainty to overall prediction uncertainty. This study used a random walk Metropolis algorithm to estimate parameters for 30 spring wheat genotypes using nine phenology models based on multi-location trial data for days to heading and days to maturity. Across all cases, parameter-driven uncertainty accounted for between 19 and 52% of predictive uncertainty, while model-structure-driven uncertainty accounted for between 12 and 64%. Here, this study demonstrated the importance of quantifying both model-structure- and parameter-value-driven uncertainty when assessing overall prediction uncertainty in modeling spring wheat phenology. More generally, Bayesian parameter estimation provided a useful framework for quantifying and analyzing sources of prediction uncertainty.

60 APPLIED LIFE SCIENCES↗