Search NASA⌕ Search

SEARCH · Search NASA

Results for “prediction.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Evaluation of New Additions to OLI Software in Predicting Mercuric and Mercurous Species in Liquid Waste Operations

Speciation of mercury during the pretreatment steps of tank waste processing is critical to successful mercury removal prior to vitrification during Liquid Waste Operations (LWO) at SRS. OLI software has been used to predict mercury speciation and activity throughout LWO. The OLI software operates based on a thermodynamic framework called the Mixed Solvent Electrolyte (MSE) framework. The MSE framework allows prediction in theoretically infinitely dilute to concentrated mixtures (e.g., purely solute solutions). Before modification to the MSE framework databanks, certain critical mercury species were missing in the MSE databank, and some thermodynamic data needed to be updated for the OLI software to accurately predict mercury chemical species in SRS waste tanks. To better reflect streams across LWO, new mercury species were integrated into the MSE database. To evaluate the changes to the OLI MSE framework per the Technical Task Request (TTR) and the Task Technical and Quality Assurance Plan (TTQAP), waste stream compositions from Tanks 38, 43, and Tank 50 decontaminated salt solution (DSS) were used as model inputs. Models were developed and executed using both the old and new databases. Compositional analyses from caustic Tank 50 DSS and caustic Tanks 38 and 43 were used as the input streams. These streams represent the most comprehensive chemical data sets where both mercury and tank constituents were measured together. Results for Tank 50 DSS predict HgO as the predominant species in both databases. Both methyl and dimethyl Hg species are present when the new database is ‘on’ and are not predicted with the new database turned ‘off’. The new database predicts a greater amount of HgO and a greater fraction of it in the solid phase. Pourbaix diagrams (potential vs. pH) generated for each Tank 50 DSS were identical regardless of which database was used. Elemental Hg and HgO were predicted in the water stable region under basic conditions. Tanks 38 and 43 follow similar trends as the Tank 50 DSS models. Unlike Tanks 38 and 50 DSS, the Tank 43 Pourbaix plot shows a region of stability for an aqueous HgOHCO3 - species between approximately pH 7-11. In all streams, when MeHg+ is included in the inputs, the new database predicts aqueous MeHgOH as the dominant species. If elemental or dimethyl mercury is in the waste stream, the new database model predicts they are unchanged and remain in those states and quantities. Additionally, the total mercury values are reported for both the measured input data and the OLI output data for all considered tanks. The summary indicates that the percentage error between the measured and calculated values is less than 1% in all cases The reconciliations and generation of the Pourbaix diagrams for Tank 50 DSS took approximately ten times longer with the new database ‘on’. In addition, over the course of that time, models with the new database ‘on’ were more likely to crash or display an error. Some modest performance improvements were noted when modeling with an i7 processor versus an i5. An example error is found in Appendix A. Furthermore, Appendix B provides V&V for two chemical systems analyzed with the OLI software, results were satisfactory. It is recommended to utilize the new databases (i.e., HCO.ddb and SR-Hg.ddb) in future Savannah River Mission Completion applications of OLI to represent pseudo steady-state. Furthermore, the integration and utilization of the new databases (i.e., HCO.ddb and SR-Hg.ddb) in modeling applications (e.g., Aspen) is also recommended.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Potential Predictability of the Monsoon Subclimate Systems

While El Nino/Southern Oscillation (ENSO) phenomenon can be predicted with some success using coupled oceanic-atmospheric models, the skill of predicting the tropical monsoons is low regardless of the methods applied. The low skill of monsoon prediction may be either because the monsoons are not defined appropriately or because they are not influenced significantly by boundary forcing. The latter characterizes the importance of internal dynamics in monsoon variability and leads to many eminent chaotic features of the monsoons. In this study, we analyze results from nine AMIP-type ensemble experiments with the NASA/GEOS-2 general circulation model to assess the potential predictability of the tropical climate system. We will focus on the variability and predictability of tropical monsoon rainfall on seasonal-to-interannual time scales. It is known that the tropical climate is more predictable than its extratropical counterpart. However, predictability is different from one climate subsystem to another within the tropics. It is important to understand the differences among these subsystems in order to increase our skill of seasonal-to-interannual prediction. We assess potential predictability by comparing the magnitude of internal and forced variances as defined by Harzallah and Sadourny (1995). The internal variance measures the spread among the various ensemble members. The forced part of rainfall variance is determined by the magnitude of the ensemble mean rainfall anomaly and by the degree of consistency of the results from the various experiments.

Yang, Song↗

Tiltrotor Aeroacoustic Code (TRAC) Prediction Assessment and Initial Comparisons With TRAM Test Data

A prediction sensitivity assessment to inputs and blade modeling is presented for the TiltRotor Aeroacoustic Code (TRAC). For this study, the non-CFD prediction system option in TRAC is used. Here, the comprehensive rotorcraft code, CAMRAD.Mod 1, coupled with the high-resolution sectional loads code HIRES, predicts unsteady blade loads to be used in the noise prediction code WOPWOP. The sensitivity of the predicted blade motions, blade airloads, wake geometry, and acoustics is examined with respect to rotor rpm, blade twist and chord, and to blade dynamic modeling. To accomplish this assessment. an interim input-deck for the TRAM test model and an input-deck for a reference test model are utilized in both rigid and elastic modes. Both of these test models are regarded as near scale models of the V-22 proprotor (tiltrotor). With basic TRAC sensitivities established, initial TRAC predictions are compared to results of an extensive test of an isolated model proprotor. The test was that of the TiltRotor Aeroacoustic Model (TRAM) conducted in the Duits-Nederlandse Windtunnel (DNW). Predictions are compared to measured noise for the proprotor operating over an extensive range of conditions. The variation of predictions demonstrates the great care that must be taken in defining the blade motion. However, even with this variability, the predictions using the different blade modeling successfully capture (bracket) the levels and trends of the noise for conditions ranging from descent to ascent.

Burley, Casey L.↗

Tiltrotor Aeroacoustic Code (TRAC) Prediction Assessment and Initial Comparisons with Tram Test Data

A prediction sensitivity assessment to inputs and blade modeling is presented for the TiltRotor Aeroacoustic Code (TRAC). For this study, the non-CFD prediction system option in TRAC is used. Here, the comprehensive rotorcraft code, CAMRAD.Mod1, coupled with the high-resolution sectional loads code HIRES, predicts unsteady blade loads to be used in the noise prediction code WOPWOP. The sensitivity of the predicted blade motions, blade airloads, wake geometry, and acoustics is examined with respect to rotor rpm, blade twist and chord, and to blade dynamic modeling. To accomplish this assessment, an interim input-deck for the TRAM test model and an input-deck for a reference test model are utilized in both rigid and elastic modes. Both of these test models are regarded as near scale models of the V-22 proprotor (tiltrotor). With basic TRAC sensitivities established, initial TRAC predictions are compared to results of an extensive test of an isolated model proprotor. The test was that of the TiltRotor Aeroacoustic Model (TRAM) conducted in the Duits-Nederlandse Windtunnel (DNW). Predictions are compared to measured noise for the proprotor operating over an extensive range of conditions. The variation of predictions demonstrates the great care that must be taken in defining the blade motion. However, even with this variability, the predictions using the different blade modeling successfully capture (bracket) the levels and trends of the noise for conditions ranging from descent to ascent.

Burley, Casey L.↗

Estimation of Separation Buffers for Wind-Prediction Error in an Airborne Separation Assistance System

Wind prediction errors are known to affect the performance of automated air traffic management tools that rely on aircraft trajectory predictions. In particular, automated separation assurance tools, planned as part of the NextGen concept of operations, must be designed to account and compensate for the impact of wind prediction errors and other system uncertainties. In this paper we describe a high fidelity batch simulation study designed to estimate the separation distance required to compensate for the effects of wind-prediction errors throughout increasing traffic density on an airborne separation assistance system. These experimental runs are part of the Safety Performance of Airborne Separation experiment suite that examines the safety implications of prediction errors and system uncertainties on airborne separation assurance systems. In this experiment, wind-prediction errors were varied between zero and forty knots while traffic density was increased several times current traffic levels. In order to accurately measure the full unmitigated impact of wind-prediction errors, no uncertainty buffers were added to the separation minima. The goal of the study was to measure the impact of wind-prediction errors in order to estimate the additional separation buffers necessary to preserve separation and to provide a baseline for future analyses. Buffer estimations from this study will be used and verified in upcoming safety evaluation experiments under similar simulation conditions. Results suggest that the strategic airborne separation functions exercised in this experiment can sustain wind prediction errors up to 40kts at current day air traffic density with no additional separation distance buffer and at eight times the current day with no more than a 60% increase in separation distance buffer.

Consiglio, Maria C.↗

Prediction of Landing Gear Noise Reduction and Comparison to Measurements

Noise continues to be an ongoing problem for existing aircraft in flight and is projected to be a concern for next generation designs. During landing, when the engines are operating at reduced power, the noise from the airframe, of which landing gear noise is an important part, is equal to the engine noise. There are several methods of predicting landing gear noise, but none have been applied to predict the change in noise due to a change in landing gear design. The current effort uses the Landing Gear Model and Acoustic Prediction (LGMAP) code, developed at The Pennsylvania State University to predict the noise from landing gear. These predictions include the influence of noise reduction concepts on the landing gear noise. LGMAP is compared to wind tunnel experiments of a 6.3%-scale Boeing 777 main gear performed in the Quiet Flow Facility (QFF) at NASA Langley. The geometries tested in the QFF include the landing gear with and without a toboggan fairing and the door. It is shown that LGMAP is able to predict the noise directives and spectra from the model-scale test for the baseline configuration as accurately as current gear prediction methods. However, LGMAP is also able to predict the difference in noise caused by the toboggan fairing and by removing the landing gear door. LGMAP is also compared to far-field ground-based flush-mounted microphone measurements from the 2005 Quiet Technology Demonstrator 2 (QTD 2) flight test. These comparisons include a Boeing 777-300ER with and without a toboggan fairing that demonstrate that LGMAP can be applied to full-scale flyover measurements. LGMAP predictions of the noise generated by the nose gear on the main gear measurements are also shown.

Lopes, Leonard V.↗

Jet Noise Diagnostics Supporting Statistical Noise Prediction Methods

The primary focus of my presentation is the development of the jet noise prediction code JeNo with most examples coming from the experimental work that drove the theoretical development and validation. JeNo is a statistical jet noise prediction code, based upon the Lilley acoustic analogy. Our approach uses time-average 2-D or 3-D mean and turbulent statistics of the flow as input. The output is source distributions and spectral directivity. NASA has been investing in development of statistical jet noise prediction tools because these seem to fit the middle ground that allows enough flexibility and fidelity for jet noise source diagnostics while having reasonable computational requirements. These tools rely on Reynolds-averaged Navier-Stokes (RANS) computational fluid dynamics (CFD) solutions as input for computing far-field spectral directivity using an acoustic analogy. There are many ways acoustic analogies can be created, each with a series of assumptions and models, many often taken unknowingly. And the resulting prediction can be easily reverse-engineered by altering the models contained within. However, only an approach which is mathematically sound, with assumptions validated and modeled quantities checked against direct measurement will give consistently correct answers. Many quantities are modeled in acoustic analogies precisely because they have been impossible to measure or calculate, making this requirement a difficult task. The NASA team has spent considerable effort identifying all the assumptions and models used to take the Navier-Stokes equations to the point of a statistical calculation via an acoustic analogy very similar to that proposed by Lilley. Assumptions have been identified and experiments have been developed to test these assumptions. In some cases this has resulted in assumptions being changed. Beginning with the CFD used as input to the acoustic analogy, models for turbulence closure used in RANS CFD codes have been explored and compared against measurements of mean and rms velocity statistics over a range of jet speeds and temperatures. Models for flow parameters used in the acoustic analogy, most notably the space-time correlations of velocity, have been compared against direct measurements, and modified to better fit the observed data. These measurements have been extremely challenging for hot, high speed jets, and represent a sizeable investment in instrumentation development. As an intermediate check that the analysis is predicting the physics intended, phased arrays have been employed to measure source distributions for a wide range of jet cases. And finally, careful far-field spectral directivity measurements have been taken for final validation of the prediction code. Examples of each of these experimental efforts will be presented. The main result of these efforts is a noise prediction code, named JeNo, which is in middevelopment. JeNo is able to consistently predict spectral directivity, including aft angle directivity, for subsonic cold jets of most geometries. Current development on JeNo is focused on extending its capability to hot jets, requiring inclusion of a previously neglected second source associated with thermal fluctuations. A secondary result of the intensive experimentation is the archiving of various flow statistics applicable to other acoustic analogies and to development of time-resolved prediction methods. These will be of lasting value as we look ahead at future challenges to the aeroacoustic experimentalist.

Bridges, James E.↗

Solar Cycle Predictions

Solar cycle predictions are needed to plan long-term space missions; just like weather predictions are needed to plan the launch. Fleets of satellites circle the Earth collecting many types of science data, protecting astronauts, and relaying information. All of these satellites are sensitive at some level to solar cycle effects. Predictions of drag on LEO spacecraft are one of the most important. Launching a satellite with less propellant can mean a higher orbit, but unanticipated solar activity and increased drag can make that a Pyrrhic victory as you consume the reduced propellant load more rapidly. Energetic events at the Sun can produce crippling radiation storms that endanger all assets in space. Solar cycle predictions also anticipate the shortwave emissions that cause degradation of solar panels. Testing solar dynamo theories by quantitative predictions of what will happen in 5-20 years is the next arena for solar cycle predictions. A summary and analysis of 75 predictions of the amplitude of the upcoming Solar Cycle 24 is presented. The current state of solar cycle predictions and some anticipations how those predictions could be made more accurate in the future will be discussed.

Pesnell, William Dean↗

Casper-1, Part 6: Uncertainty Quantification, Factor Effects, and Outlier Analysis for an On-Board Airplane Trajectory Prediction Function

This report presents data analysis results for a simulation-based approach named CASPEr (Characterization of Airplane State Prediction Error) to characterize the performance of onboard energy state and automation mode prediction functions for terminal area arrival and approach phases of flight over a wide range of conditions. In particular, the results include quantification of energy state (i.e., altitude and airspeed) prediction performance, models for prediction performance as a function of initial energy state (i.e., initial altitude, airspeed, and weight) and weather factors, and analysis of outlier prediction performance. Wind speed, wind direction, and wind gradient were found to be major factors in energy state prediction performance. Initial energy and gust intensity were also significant factors in airspeed prediction performance. Furthermore, the results suggest that errors in automation mode prediction may be a major contributor to outlier prediction performance.

Torres-Pomales, Wilfredo↗

Predictability of the early summer surface air temperature over Western South Asia

Variability of the Surface Air Temperature (SAT) over the Western South Asia (WSA) region leads to frequent heatwaves during the early summer (May-June) season. The present study uses the European Centre for Medium-Range Weather Forecast’s fifth-generation seasonal prediction system, SEAS5, from 1981 to 2022 based on April initial conditions (1-month lead) to assess the SAT predictability during early summer season. The goal is to evaluate the SEAS5’s ability to predict the El Niño-Southern Oscillation (ENSO) related interannual variability and predictability of the SAT over WSA, which is mediated through upper-level (200-hPa) geopotential height anomalies. This teleconnection leads to anomalously warm surface conditions over the region during the negative ENSO phase, as observed in the reanalysis and SEAS5. We evaluate SEAS5 prediction skill against two observations and three reanalyses datasets. The SEAS5 SAT prediction skill is higher with high spatial resolution observations and reanalysis datasets compared to the ones with low-resolution. Overall, SEAS5 shows reasonable skill in predicting SAT and its variability over the WSA region. Moreover, the predictability of SAT during La Niña is comparable to El Niño years over the WSA region.

54 ENVIRONMENTAL SCIENCES↗

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗

Comparative Analysis of TCR and TCR-pMHC Complex Structure Prediction Tools

The rapid development of computational approaches for predicting the structures of T cell receptors (TCRs) and TCR-peptide-major histocompatibility (TCR-pMHC) complexes, accelerated by AI breakthroughs such as AlphaFold, has made it feasible to calculate these structures with increasing accuracy. Although these tools show great potential, their relative accuracy and limitations remain unclear due to the lack of standardized benchmarks. Here, we systematically evaluate seven tools for predicting isolated TCR structures together with six tools for predicting TCR-pMHC complex structures. The methods include homology-based approaches, general prediction tools using AlphaFold, TCR-specific tools derived from AlphaFold2, and the newly developed tFold-TCR model. The evaluation uses a post-training data set comprising 40 αβ TCRs and 27 TCR-pMHC complexes (21 Class I and 6 Class II). Model accuracy is assessed at global, local, and interface levels using a variety of metrics. We find that each tool offers distinct advantages in various aspects of its predictions. AlphaFold2, AlphaFold3, and tFold-TCR excel in overall accuracy of TCR structure prediction, and TCRmodel2 and AlphaFold2 perform well in overall accuracy of TCR-pMHC structure prediction. However, TCR-specific tools derived from AlphaFold2 show lower accuracy in the framework region than both homology-based methods and general-purpose tools such as AlphaFold, and challenges remain for all in modeling CDR3 loops, docking orientations, TCR-peptide interfaces, and Class II MHC-peptide interfaces. Furthermore, these findings will guide researchers in selecting appropriate tools, emphasize the importance of using multiple evaluation metrics to assess model performance, and offer suggestions for improving TCR and TCR-pMHC structure prediction tools.

Chemical structure↗

Improving FermiI Orbit Determination and Prediction in an Uncertain Atmospheric Drag Environment

Orbit determination and prediction of the Fermi Gamma-ray Space Telescope trajectory is strongly impacted by the unpredictability and variability of atmospheric density and the spacecrafts ballistic coefficient. Operationally, Global Positioning System point solutions are processed with an extended Kalman filter for orbit determination, and predictions are generated for conjunction assessment with secondary objects. When these predictions are compared to Joint Space Operations Center radar-based solutions, the close approach distance between the two predictions can greatly differ ahead of the conjunction. This work explores strategies for improving prediction accuracy and helps to explain the prediction disparities. Namely, a tuning analysis is performed to determine atmospheric drag modeling and filter parameters that can improve orbit determination as well as prediction accuracy. A 45 improvement in three-day prediction accuracy is realized by tuning the ballistic coefficient and atmospheric density stochastic models, measurement frequency, and other modeling and filter parameters.

orbit prediction↗

Improving Fermi Orbit Determination and Prediction in an Uncertain Atmospheric Drag Environment

Orbit determination and prediction of the Fermi Gamma-ray Space Telescope trajectory is strongly impacted by the unpredictability and variability of atmospheric density and the spacecraft's ballistic coefficient. Operationally, Global Positioning System point solutions are processed with an extended Kalman filter for orbit determination, and predictions are generated for conjunction assessment with secondary objects. When these predictions are compared to Joint Space Operations Center radar-based solutions, the close approach distance between the two predictions can greatly differ ahead of the conjunction. This work explores strategies for improving prediction accuracy and helps to explain the prediction disparities. Namely, a tuning analysis is performed to determine atmospheric drag modeling and filter parameters that can improve orbit determination as well as prediction accuracy. A 45% improvement in three-day prediction accuracy is realized by tuning the ballistic coefficient and atmospheric density stochastic models, measurement frequency, and other modeling and filter parameters.

orbit prediction↗

Taxi-Out Time Prediction for Departures at Charlotte Airport Using Machine Learning Techniques

Predicting the taxi-out times of departures accurately is important for improving airport efficiency and takeoff time predictability. In this paper, we attempt to apply machine learning techniques to actual traffic data at Charlotte Douglas International Airport for taxi-out time prediction. To find the key factors affecting aircraft taxi times, surface surveillance data is first analyzed. From this data analysis, several variables, including terminal concourse, spot, runway, departure fix and weight class, are selected for taxi time prediction. Then, various machine learning methods such as linear regression, support vector machines, k-nearest neighbors, random forest, and neural networks model are applied to actual flight data. Different traffic flow and weather conditions at Charlotte airport are also taken into account for more accurate prediction. The taxi-out time prediction results show that linear regression and random forest techniques can provide the most accurate prediction in terms of root-mean-square errors. We also discuss the operational complexity and uncertainties that make it difficult to predict the taxi times accurately.

Safe and efficient surface operations↗

Pragmatic Stress Prediction on Additively Manufactured Coupons

Prediction of residual stresses from process parameters for additively manufactured large metal parts is computationally expensive. NASA is currently developing meter-scale parts with direct energy deposition. Practically, the predictive computational methods need to efficiently scale-up to meter-scale parts. Coupled thermal-mechanical multi-physics simulations have been developed with the pragmatic method using ABAQUS, COMSOL Multiphysics, ALE3D software. The residual stresses are a result of the manufacturing process which creates thermal cycling of the build layers. The pragmatic method uses lumped thermal layers for stress predictions to reduce computational costs. The stress predictions as well as deformations of the different codes are compared with each other and with ANSYS Additive using identical material models, boundary and initial conditions. The codes were used to simulate three different geometries: a thin wall, hollow cylinder and twin-cantilever part. The coupon parts were then manufactured with Inconel-625. The residual stresses in these parts were measured using X-ray diffraction as well as neutron beam diffraction at NIST. The stress measurements for the two technologies are compared. The pragmatic stress prediction method enabled predictions of the multi-centimeter scale parts using desktop computer workstations in only a few hours for each coupon. The results of the simulated stress predictions compared favorably with the measured stresses even though thermally lumped layers were employed. Finally, a two-meter scale nozzle was simulated using ANSYS Additive. The simulations were used to examine the build orientation trade-space with respect to resulting geometric deformation. The predicted deformations were compared to measurements of an actual subscale part manufactured with direct energy deposition.

Additive Manufacturing↗

Evaluation of the Accuracy of the Load Prediction Equations of Low-Load Balance Calibration Data

Accuracy and reliability of the load prediction equations of a low-load calibration data set of a force balance were investigated. First, independent load prediction equations were generated from the data of a full-load and low-load machine calibration. Then, the low-load data set was processed as a set of precision check loads for the load prediction equations that were obtained from the full-load and low-load calibrations. Finally, the load prediction equations of the two calibrations were applied to four manual check load data sets that were recorded between 2009 and 2022. The residuals of the predicted calibration and check loads were compared in all cases. No systematic improvement of the load prediction accuracy was observed when the load prediction equations of the low-load calibration were applied to the check load data sets. Therefore, it is recommended to apply a full-load calibration to a six-component balance even if the balance is not used across its entire design envelope. This approach has the advantage that the resulting load prediction equations are less likely to be applied outside of the calibration load ranges. In addition, it is expected that the numerical estimates of the bridge sensitivities are more reliable assuming that the uncertainties of the applied loads and measured outputs of the calibration data are more or less constant across the load range of the balance.

strain-gage balance↗

An Ensemble Investigation of the Causes for Regional Air-Quality Model Critical Load Exceedances Prediction Variability in European and North American Domains Using Diagnostics From Phase 4 of the Air Quality Model Evaluation International Initiative

We summarize tentative findings from multi air quality model ensembles for the years 2009 and 2010 in Europe (EU), and 2010 and 2016 in North America (NA), under AQMEII-4. The model predictions of sulphur and nitrogen deposition were used to estimate exceedances of critical loads for acidification and eutrophication, to show the extent to which the ensemble members agree in the magnitude and the trend of ecologically meaningful impacts. Model exceedance variability was analyzed using AQMEII-4 diagnostics. Evaluation against concentration and wet deposition observations, coupled with these diagnostics, identified specific process representations as the causes for variability between model predictions and for reduced model performance. All models predicted reductions in ecosystem acidification impacts in North America between the years 2010 and 2016, in accord with SO2 emissions reduction legislation which started in 2010 (SO2 SIP) However, all models in EU and NA domains had net negative biases for wet deposition of sulphur and nitrogen relative to observations. The wet S deposition average mean bias for the NA ensemble was -0.17 eq ha-1 d-1, and for the EU ensemble -1.15 eq ha-1 d-1. The NA daily wet deposition average mean bias for NH4+ was -0.37 eq ha-1d-1; EU -1.19 eq ha-1 d-1. The daily NA wet NO3- deposition average mean bias was -0.24 eq ha-1d-1; EU -0.69 eq ha-1 d-1. The members of the ensemble diverged (factor of 10) in their North American predictions for Ndep and consequently their eutrophication exceedances. The models with the highest eutrophication predictions also predicted the highest levels of gas-phase ammonia dry deposition (standard deviation of ammonia dry deposition flux across ensemble members was larger than the ensemble average). These models also had negative biases of predicted ammonia concentrations; average mean biases of -0.63 (satellite NH3) and -0.85 ppbv (surface NH3) compared to ensemble averages of -0.30 and -0.34 ppbv. Diagnostics showed that these differences resulted from the manner in which bidirectional ammonia fluxes were parameterized within these models. The second largest source of NA eutrophication prediction variability were models with positive biases in particulate ammonium and nitrate concentrations, and higher particle nitrogen deposition levels ( particle ammonium concentration bias +0.35 ug m-3; ensemble bias +0.15 ug m-3). We believe two factors may have led to these latter overestimates: higher levels of fine mode particle nitrate formation compared to other models (due to the use of an inorganic heterogeneous chemistry algorithm which did not take base cation chemistry into account), and updates to particle dry deposition velocities carried out in the absence of concurrent updates to wet scavenging algorithms. The relative importance of dry gas, dry particulate, and wet deposition towards total sulphur and nitrogen deposition totals differed between EU and North American domains, though all models had negative biases in wet deposition as noted above. Parallel and subsequent work suggests that multiphase hydrometeor scavenging may improve model wet deposition performance. An increased research focus is recommended for four model processes: multiphase hydrometeor scavenging, ammonia bidirectional fluxes, base cation chemistry and emissions, and particle dry deposition.

regional air-quality model↗