Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Reconciling and Improving Formulations for Thermodynamics and Conservation Principles in Earth System Models (ESMs)

Abstract This paper provides a comprehensive derivation of the total energy equations for the atmospheric components of Earth System Models (ESMs). The assumptions and approximations made in this derivation are motivated and discussed. In particular, it is emphasized that closing the energy budget is conceptually challenging and hard to achieve in practice without resorting to ad hoc fixers. As a concrete example, the energy budget terms are diagnosed in a realistic climate simulation using a global atmosphere model. The largest total energy errors in this example are spurious dynamical core energy dissipation, thermodynamic inconsistencies (e.g., coupling parameterizations with the host model) and missing processes/terms associated with falling precipitation and evaporation (e.g., enthalpy flux between components). The latter two errors are not, in general, reduced by increasing horizontal resolution. They are due to incomplete thermodynamic and dynamic formulations. Future research directions are proposed to reconcile and improve thermodynamics formulations and conservation principles.

54 ENVIRONMENTAL SCIENCES↗

Numerical study of error propagation in Monte Carlo depletion simulations

Improving computer technology and the desire to more accurately model the heterogeneity of the nuclear reactor environment have made the use of Monte Carlo depletion codes more attractive in recent years, and feasible (if not practical) even for 3-D depletion simulation. However, in this case statistical uncertainty is combined with error propagating through the calculation from previous steps. In an effort to understand this error propagation, a numerical study was undertaken to model and track individual fuel pins in four 17 x 17 PWR fuel assemblies. By changing the code's initial random number seed, the data produced by a series of 19 replica runs was used to investigate the true and apparent variance in k{sub eff}, pin powers, and number densities of several isotopes. While this study does not intend to develop a predictive model for error propagation, it is hoped that its results can help to identify some common regularities in the behavior of uncertainty in several key parameters. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A comparison of two Stokes ice sheet models applied to the Marine Ice Sheet Model Intercomparison Project for plan view models (MISMIP3d)

Here, we present a comparison of the numerics and simulation results for two "full" Stokes ice sheet models, FELIX-S (Leng et al. 2012) and Elmer/Ice. The models are applied to the Marine Ice Sheet Model Intercomparison Project for plan view models (MISMIP3d). For the diagnostic experiment (P75D) the two models give similar results (< 2 % difference with respect to along-flow velocities) when using identical geometries and computational meshes, which we interpret as an indication of inherent consistencies and similarities between the two models. For the standard (Stnd), P75S, and P75R prognostic experiments, we find that FELIX-S (Elmer/Ice) grounding lines are relatively more retreated (advanced), results that are consistent with minor differences observed in the diagnostic experiment results and that we show to be due to different choices in the implementation of basal boundary conditions in the two models. While we are not able to argue for the relative favorability of either implementation, we do show that these differences decrease with increasing horizontal (i.e., both along- and across-flow) grid resolution and that grounding-line positions for FELIX-S and Elmer/Ice converge to within the estimated truncation error for Elmer/Ice. Stokes model solutions are often treated as an accuracy metric in model intercomparison experiments, but computational cost may not always allow for the use of model resolution within the regime of asymptotic convergence. In this case, we propose that an alternative estimate for the uncertainty in the grounding-line position is the span of grounding-line positions predicted by multiple Stokes models.

54 ENVIRONMENTAL SCIENCES↗

Integrated parameter and process learning for hydrologic and biogeochemical modules in Earth System Models

Focus area: Primary focal area #2; secondary focal area #3: Learning about parameters and processes of land surface hydrologic and biogeochemical models in Earth System models by integrating machine learning, physics, and big data. Science challenges: How do we maximally leverage big-data observations to improve hydrobiogeochemical process description and parameterization so that such modules more realistically capture hydrologic and vegetation responses and feedbacks under the future climate? For example, how can we leverage physics, limited observations of vegetation and streamflow to better estimate evapotranspiration, and, relatedly, net primary productivity, especially for drought areas? Vegetation plays a critical role in regional and global water cycles; however, existing vegetation models have failed to predict vegetation response to droughts (McDowell & Xu, 2017) , arctic greening (Keenan & Riley, 2018) , and critical transitions between forest and savanna (Hirota et al., 2011) . These studies suggest that when we build process-based models (PBM) parameterized from regional and global plant traits, we tend to poorly describe plant adaptation and local-scale competition processes. The models and their associated parameters assigned for different regions in the world are not capturing essential heterogeneity in vegetation responses at finer spatial scales. Many parameters of the land surface models control hydrology and vegetation dynamics at the same time. The heterogeneity in vegetation response is a function of (i) plant type, (ii) plant size, (iii) competition and succession, (iv) environmental controls, and (v) local variations due to the unique ecological community that are very difficult to describe (e.g., the size of gaps resulting from fire that facilitated the coexistence of pioneering species). In the demographic models, only factors (i) and (iv) were captured, and plant types were generally described only by leaf phenology and climate zones. With current demographic models, we generally consider more traits to define plant types (i) and calibrate these traits to consider factors (ii), (iii) and (iv); however, it is substantially challenging to scale to regional and global simulations due to trait variations across space (Ali et al., 2016). Moreover, it has been noted that hillslope processes, including ridge-to-valley flow and sunny vs. shady slopes are primary organizers of water, energy, and vegetation (Clark et al., 2015; Fan et al., 2019) . Although gradual improvements in the hydrologic model component in earth system models may reduce this error (at a remarkably slow pace), the long-term, gradual impact of hydrology on plant traits are not well captured. Recent work showed that the hydrologic controls exerted by groundwater and lateral flow are primary regulators of rooting depth (Fan et al., 2017) . Such hydrologic controls have seldom been reflected in vegetation model parameterizations.

54 ENVIRONMENTAL SCIENCES↗

SU-F-T-548: An Extraction Method for Correction of Detector Volume Effect in Small Field Profile Measurement

Purpose: To investigate the appropriateness of Gaussian detector response function in SRS profile measurement. Methods: In-air profile data for a 6MV beam were collected by using ionization chambers and radiochromic film. Two ionization chambers (FC65-G(IBA) and PinPoint(PTWTW31009)) were used to scan the beam profile. Film was used to measure the beam penumbra. A half-blocked beam was acquired with stepping size of 0.2mm and gradient of the measured profile represents the detector response function. The field widths of 2cm and 3cm were measured at SAD. Two detector response functions were evaluated, i.e. a traditional single Gaussian and a three-Gaussian symmetric function. Two corresponding models were used to fit measured data. One was error functions with one shaping parameter. The other model was a symmetrical superposition of three sets of error functions with fixed separation and two different shaping parameters. In both fitting, resultant Gaussian kernels and corresponding σs could be calculated analytically. SNR of the fitted curves were obtained and compared. Results: Our measured data indicated that the ionization chambers had a three-peak response function. From the first modeling, SNR for FC65-G were 36.0dB and 38.3dB for 2cm and 3cm field respectively. The corresponding SNR for the PinPoint were 43.6dB and 42.5dB. From the second modeling, SNR for FC65-G were 42.5dB and 47.4dB for 2cm and 3cm field respectively. The corresponding SNR for the PinPoint were 44.0dB and 44.5 dB. Three-gaussian model had an observable improvement for FC65-G chamber. Film measured penumbra was 3–5 times smaller than that of ionization-chambers. Conclusion: Superposition of three Gaussian kernels resembles the detector response due to central electrode and chamber wall and results in a better fitting to the measurement data than a single Gaussian kernel. Our study indicated that the Three-Gaussian model was more suitable for the detector with sigma comparable to penumbra width.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine Learning-Based Process Control for Injection Molding of Recycled Polypropylene

The increased interest in artificial intelligence in manufacturing has driven the adoption of machine learning to optimize processes and improve efficiency. A key challenge in injection molding is the variability of recycled materials, which affects part quality and processing stability. This study presents a novel closed-loop process control approach for injection molding, leveraging machine learning to adaptively predict processing inputs and quality outcomes. The methodology was tested on five blends of recycled polypropylene (rPP), using artificial neural networks (ANNs), linear regression, and polynomial regression to model the relationships between material properties and process parameters. The dataset was split 80/20 into training and testing sets. The ANN model was implemented using TensorFlow and Keras, with six hidden layers of 32 neurons per layer, ReLU activation, and an Adam optimizer. Empirical tuning and early stopping were used to optimize performance and prevent overfitting. Predictions were evaluated based on mean absolute error (MAE), mean squared error (MSE), and percentage error. The results showed that yield stress, ultimate elongation, and part weight were accurately predicted within a 5% error for linear and polynomial regression models and within a 10% error for the ANN. However, modulus predictions were less reliable, with errors of ~11% for ANN and linear regression and ~40% for polynomial regression, reflecting the inherent variability of this property in rPP blends. Predictions of processing inputs had errors ranging from 3% to 25%, depending on the model and response variable. No single modeling approach was consistently superior across all responses, highlighting the complexity of the relationship between material properties, process parameters, and quality metrics. Overall, the work demonstrates that closed-loop process control, powered by machine learning, can effectively predict key quality parameters in injection molding of recycled materials. The proposed approach can improve process stability and material utilization, facilitating increased adoption of sustainable materials.

Krantz, Joshua↗

The Factory and the Beehive. III. PTFEB132.707+19.810, A Low-mass Eclipsing Binary in Praesepe Observed by PTF and K2

Theoretical models of stars constitute the fundamental bedrock upon which much of astrophysics is built, but large swaths of model parameter space remain uncalibrated by observations. The best calibrators are eclipsing binaries in clusters, allowing measurement of masses, radii, luminosities, and temperatures for stars of known metallicity and age. We present the discovery and detailed characterization of PTFEB132.707+19.810, a P = 6.0 day eclipsing binary in the Praesepe cluster (τ ∼ 600–800 Myr; [Fe/H] = 0.14 ± 0.04). The system contains two late-type stars (SpT{sub P} = M3.5 ± 0.2; SpT{sub S} = M4.3 ± 0.7) with precise masses (M{sub p}=0.3953±0.0020 M {sub ⊙}; M{sub s}=0.2098 ±0.0014 M {sub ⊙}) and radii (R{sub p}=0.363±0.008 R {sub ⊙}; R{sub s}=0.272±0.012 R {sub ⊙}). Neither star meets the predictions of stellar evolutionary models. The primary has the expected radius but is cooler and less luminous, while the secondary has the expected luminosity but is cooler and substantially larger (by 20%). The system is not tidally locked or circularized. Exploiting a fortuitous 4:5 commensurability between P {sub orb} and P{sub rot,prim}, we demonstrate that fitting errors from the unknown spot configuration only change the inferred radii by ≲1%–2%. We also analyze subsets of data to test the robustness of radius measurements; the radius sum is more robust to systematic errors and preferable for model comparisons. We also test plausible changes in limb darkening and find corresponding uncertainties of ∼1%. Finally, we validate our pipeline using extant data for GU Boo, finding that our independent results match previous radii to within the mutual uncertainties (2%–3%). We therefore suggest that the substantial discrepancies are astrophysical; since they are larger than those for old field stars, they may be tied to the intermediate age of PTFEB132.707+19.810.

79 ASTRONOMY AND ASTROPHYSICS↗

Automatic tuning of the Community Atmospheric Model (CAM5) by using short-term hindcasts with an improved downhill simplex optimization method

Traditional trial-and-error tuning of uncertain parameters in global atmospheric general circulation models (GCMs) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well-calibrated model, based on a predefined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automatic tuning can be a viable supplement to process-oriented model evaluations and improvement.

54 ENVIRONMENTAL SCIENCES↗

Automatic tuning of the Community Atmospheric Model CAM5.3 by using short-term hindcasts with an improved downhill simplex optimization method

Traditional trial-and-error tuning of uncertain parameters in global atmospheric General Circulation Models (GCM) is time consuming and subjective. This study explores the feasibility of automatic optimization of GCM parameters for fast physics by using short-term hindcasts. An automatic workflow is described and applied to the Community Atmospheric Model (CAM5) to optimize several parameters in its cloud and convective parameterizations. We show that the auto-optimization leads to 10 % reduction of the overall bias in CAM5, which is already a well calibrated model, based on a pre-defined metric that includes precipitation, temperature, humidity, and longwave/shortwave cloud forcing. The computational cost of the entire optimization procedure is about equivalent to about a single 12-year atmospheric model simulation. The tuning reduces the large underestimation in the CAM5 longwave cloud forcing by decreasing the threshold relative humidity and the sedimentation velocity of ice crystals in the cloud schemes; it reduces the overestimation of precipitation by increasing the adjustment time in the convection scheme. The physical processes behind the tuned model performance for each targeted field are discussed. Limitations of the automatic tuning are described, including the slight deterioration in some targeted fields that reflect the structural errors of the model. It is pointed out that automatic tuning can be a viable supplement to process-oriented model evaluations and improvement.

54 ENVIRONMENTAL SCIENCES↗

Taylor flow in intermediate diameter channels: Simulation and hydrodynamic models

The two-phase Taylor flow pattern has been studied extensively. However, limited information is available for flows in intermediate diameter channels (5 ≲ Bo ≲ 40, or 6mm ≲ D ≲ 27mm for ambient gas–water flows), as found in air-lift and bubble pumps. Previous investigations have primarily evaluated Taylor flow models in terms of overall pressure drop, which incorporates hydrostatic and multiple hydrodynamic components. Thus, individual sub-models and sources of error could not be directly assessed. Here in this investigation, volume-of-fluid (VOF) based Taylor flow simulations are performed over a wide range of laminar and turbulent conditions in the intermediate Bond number regime (5 < Bo < 20, 250 < N f < 1000, and 20 < Re j < 8100). Results are applied to individually evaluate hydrodynamic sub-models for bubble-region frictional pressure drop gradient (∇p f,b ), slug frictional pressure drop gradient (∇p f,s ), and flow transition pressure loss (Δp trans ). Based on these results, recommendations are provided for selection of hydrodynamic sub-models. These hydrodynamic closure models are integrated with kinematic flow models to yield a complete intermediate Bond number Taylor flow formulation for which all submodels were independently validated. The resulting model achieves improved accuracy for predicting experimental liquid flow rates compared with previous Taylor flow models (81% of cases within 50% of measured flows rates).

42 ENGINEERING↗

SU-E-T-628: Predicted Risk of Post-Irradiation Cerebral Necrosis in Pediatric Brain Cancer Patients: A Treatment Planning Comparison of Proton Vs. Photon Therapy

Purpose: Post-irradiation cerebral necrosis (PICN) is a severe late effect that can Result from brain cancers treatment using radiation therapy. The purpose of this study was to compare the treatment plans and predicted risk of PICN after volumetric modulated arc therapy (VMAT) to the risk after passively scattered proton therapy (PSPT) and intensity modulated proton therapy (IMPT) in a cohort of pediatric patients. Methods: Thirteen pediatric patients with varying age and sex were selected for this study. A clinical treatment volume (CTV) was constructed for 8 glioma patients and 5 ependymoma patients. Prescribed dose was 54 Gy over 30 fractions to the planning volume. Dosimetric endpoints were compared between VMAT and proton plans. The normal tissue complication probability (NTCP) following VMAT and proton therapy planning was also calculated using PICN as the biological endpoint. Sensitivity tests were performed to determine if predicted risk of PICN was sensitive to positional errors, proton range errors and selection of risk models. Results: Both PSPT and IMPT plans resulted in a significant increase in the maximum dose and reduction in the total brain volume irradiated to low doses compared with the VMAT plans. The average ratios of NTCP between PSPT and VMAT were 0.56 and 0.38 for glioma and ependymoma patients respectively and the average ratios of NTCP between IMPT and VMAT were 0.67 and 0.68 for glioma and ependymoma plans respectively. Sensitivity test revealed that predicted ratios of risk were insensitive to range and positional errors but varied with risk model selection. Conclusion: Both PSPT and IMPT plans resulted in a decrease in the predictive risk of necrosis for the pediatric plans studied in this work. Sensitivity analysis upheld the qualitative findings of the risk models used in this study, however more accurate models that take into account dose and volume are needed.

61 RADIATION PROTECTION AND DOSIMETRY↗

Extracting Grain Orientations from EBSD Patterns of Polycrystalline Materials Using Convolutional Neural Networks

Abstract We present a deep learning approach to the indexing of electron backscatter diffraction (EBSD) patterns. We design and implement a deep convolutional neural network architecture to predict crystal orientation from the EBSD patterns. We design a differentiable approximation to the disorientation function between the predicted crystal orientation and the ground truth; the deep learning model optimizes for the mean disorientation error between the predicted crystal orientation and the ground truth using stochastic gradient descent. The deep learning model is trained using 374,852 EBSD patterns of polycrystalline nickel from simulation and evaluated using 1,000 experimental EBSD patterns of polycrystalline nickel. The deep learning model results in a mean disorientation error of 0.548° compared to 0.652° using dictionary based indexing.

Materials Science↗

Power Flow Models of Grid-Forming Inverters in Unbalanced Distribution Grids

Load unbalance in electric distribution systems is unavoidable. Unbalanced load currents will lead to negative sequence (NS) voltages that may damage electric equipment. Unbalanced power flow analysis is a common tool to detect and mitigate NS voltage issues and requires accurate models of grid components. While traditional source models are available, grid-forming (GFM) inverter models are not well developed. GFM inverters implement various control strategies, which affect their power flow models. Here, in this paper, a novel GFM inverter model considering control effects is proposed. We show that for some control methods, unbalanced system loading will lead to unbalanced terminal voltages of the GFM inverters, which are modeled through an equivalent negative sequence impedance. The proposed models are initially validated using a simple test circuit. Then, they are applied in the power flow analysis on the IEEE 13-bus and 34-bus systems to demonstrate the accuracy improvement over the state-of-the-art. Using time-domain simulations as benchmarks, we show that the proposed models reduce the calculation error of negative sequence voltages by at least 25% in unbalanced distribution systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Empirical validation and comparison of methodologies to simulate micro and macro-encapsulated PCMs in the building envelope

Thermal Energy Storage (TES) has the potential to shift peak electricity demand. Passive TES is usually implemented in building envelope as micro and macro encapsulated phase change materials (PCM) to shift electric energy demand and therefore requires careful heat transfer analysis. Whole building energy modelling with simplified heat transfer analysis has become extremely important for designers, architects, engineers, and researchers to predict energy performance of buildings. It is important to validate PCM modelling algorithms used in building energy programs to quantify their error and prove their capacity to model different PCM encapsulation types. This study uses data from a microencapsulated PCM and two macroencapsulated PCMs (Bio based PCM and hydrate salts) tested in full-scale using the Advanced Multiscale Building Energy Research (AMBER) Lab located at the Colorado School of Mines and is used to validate a numerical algorithm written in MATLAB language. To approximate the heat transfer through a wall assembly with macroencapsulated PCM pouches, several modelling techniques that can reduce 3D heat transfer characteristics to 1D are explored in this research. A parallel path heat transfer modelling approach is found to give the closest agreement with the experimental data for the pouched PCMs in building envelope applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Time-dependent SOLPS-ITER simulations of the tokamak plasma boundary for model predictive control using SINDy *

Abstract Time-dependent SOLPS-ITER simulations have been used to identify reduced models with the sparse identification of nonlinear dynamics (SINDy) method and develop model-predictive control of the boundary plasma state using main ion gas puff actuation. A series of gas actuation sequences are input into SOLPS-ITER to produce a dynamic response in upstream and divertor plasma quantities. The SINDy method is applied to identify reduced linear and nonlinear models for the electron density at the outboard midplane n e , s e p O M P and the electron temperature at the outer divertor T e , s e p d i v . Note that T e , s e p d i v is not necessarily the peak value of T e along the divertor. The identified reduced models are interpretable by construction (i.e. not black box), and have the form of coupled ordinary differential equations. Despite significant noise in T e , s e p d i v , the reduced models can be used to predict the response over a range of actuation levels to a maximum deviation of 0.5% in n e , s e p O M P and 5%–10% in T e , s e p d i v for the cases considered. Model retraining using time history data triggered by a preset error threshold is also demonstrated. A model predictive control strategy for nonlinear models is developed and used to perform feedback control of a SOLPS-ITER simulation to produce a setpoint trajectory in n e , s e p O M P using the integrated plasma simulator framework. The developed techniques are general and can be applied to time-dependent data from other boundary simulations or experimental data. Ongoing work is extending the approach to model identification and control for divertor detachment, which will present transient nonlinear behavior from impurity seeding, including realistic latency and synthetic diagnostic signals derived from the full SOLPS-ITER output.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Improving seasonal precipitation forecasts in the Western United States through statistical downscaling

Abstract Seasonal precipitation forecasts in the western United States are critical resources for water resource management, especially during winter. While current seasonal forecasting systems provide monthly precipitation forecasts operationally, their coarse resolution limits their effectiveness in capturing the localized precipitation patterns and snowpack conditions essential for water resource managers in the mountainous regions. Here, analog statistical downscaling is demonstrated as an effective approach to enhance the spatial resolution of operational seasonal forecasts provided by the North American Multi-Model Ensemble. Downscaling was performed by building an analog ‘library’, in which corresponding model forecasts and observed values during the training period were stored. In the testing period, unseen model forecasts referenced the closest historical forecast from the analog library and applied the corresponding observational value for each point. This analysis indicates that downscaled products can capture localized features more accurately than the original coarse resolution forecasts, reducing forecast error across the western United States. Moreover, downscaling individual ensemble members—rather than downscaling the ensemble mean—further reduces forecasting error for their multi-model ensemble mean products. The greatest error reductions in the downscaled product, measured by root mean squared error (RMSE), were observed at low to mid-elevations (500–2000 meters), with 50%–70% improvement relative to the original forecasts. In the higher elevations (2000 meters and above), changes in RMSE relative to the original forecast were limited to 10%–30% improvements. The improvement is more substantial for forecast systems with 10 ensemble members compared to that with 4 members, but this relationship does not hold for the system with 24 ensemble members. These findings show that analog statistical downscaling can effectively address the spatial limitations of seasonal precipitation forecasts with minimal computational cost, providing a valuable framework for enhancing coarse resolution forecasting products while providing insights into the timing of ensemble mean calculations during the downscaling process.

Vernon, B. (ORCID:0009000891670689)↗

Collaborative Project: The problem of bias in defining uncertainty in computationally enabled strategies for data-driven climate model development

The objective of the project is to develop strategies for better representing scientific sensibilities within statistical measures of model skill that then can be used within a Bayesian statistical framework for data-driven climate model development and improved measures of model scientific uncertainty. One of the thorny issues in model evaluation is quantifying the effect of biases on climate projections. While any bias is not desirable, only those biases that affect feedbacks affect scatter in climate projections. The effort at the University of Texas is to analyze previously calculated ensembles of CAM3.1 with perturbed parameters to discover how biases affect projections of global warming. The hypothesis is that compensating errors in the control model can be identified by their effect on a combination of processes and that developing metrics that are sensitive to dependencies among state variables would provide a way to select version of climate models that may reduce scatter in climate projections. Gabriel Huerta was responsible for leading the effort to develop statistical methods for evaluating these field dependencies. The UT effort will incorporate these developments into MECS, which is a set of python scripts being developed at the University of Texas for managing the workflow associated with data-driven climate model development over HPC resources. We regularly consult with Peter Gleckler (LLNL), Mark Taylor (SNL), and Rich Neale (NCAR) to provide additional insight into issues concerning CAM5 model development and multi-model evaluation of the AR5 archive. This grant was originally assigned to Indiana University where both the PI (Huerta) and the Postdoc (Nosedal) worked on the project from March 1, 2012-March 31, 2013.

97 MATHEMATICS AND COMPUTING↗

Collaborative Project: The problem of bias in defining uncertainty in computationally enabled strategies for data-driven climate model development. Final Technical Report.

The objective of the project is to develop strategies for better representing scientific sensibilities within statistical measures of model skill that then can be used within a Bayesian statistical framework for data-driven climate model development and improved measures of model scientific uncertainty. One of the thorny issues in model evaluation is quantifying the effect of biases on climate projections. While any bias is not desirable, only those biases that affect feedbacks affect scatter in climate projections. The effort at the University of Texas is to analyze previously calculated ensembles of CAM3.1 with perturbed parameters to discover how biases affect projections of global warming. The hypothesis is that compensating errors in the control model can be identified by their effect on a combination of processes and that developing metrics that are sensitive to dependencies among state variables would provide a way to select version of climate models that may reduce scatter in climate projections. Gabriel Huerta at the University of New Mexico is responsible for developing statistical methods for evaluating these field dependencies. The UT effort will incorporate these developments into MECS, which is a set of python scripts being developed at the University of Texas for managing the workflow associated with data-driven climate model development over HPC resources. This report reflects the main activities at the University of New Mexico where the PI (Huerta) and the Postdocs (Nosedal, Hattab and Karki) worked on the project.

58 GEOSCIENCES↗