SEARCH · Search NASA

Results for “human performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Evaluating the impact of anatomical and physiological variability on human equivalent doses using PBPK models

Abstract Addressing human anatomical and physiological variability is a crucial component of human health risk assessment of chemicals. Experts have recommended probabilistic chemical risk assessment paradigms in which distributional adjustment factors are used to account for various sources of uncertainty and variability, including variability in the pharmacokinetic behavior of a given substance in different humans. In practice, convenient assumptions about the distribution forms of adjustment factors and human equivalent doses (HEDs) are often used. Parameters such as tissue volumes and blood flows are likewise often assumed to be lognormally or normally distributed without evaluating empirical data for consistency with these forms. In this work, we performed dosimetric extrapolations using physiologically based pharmacokinetic (PBPK) models for dichloromethane (DCM) and chloroform that incorporate uncertainty and variability to determine if the HEDs associated with such extrapolations are approximately lognormal and how they depend on the underlying distribution shapes chosen to represent model parameters. We accounted for uncertainty and variability in PBPK model parameters by randomly drawing their values from a variety of distribution types. We then performed reverse dosimetry to calculate HEDs based on animal points of departure for each set of sampled parameters. Corresponding samples of HEDs were tested to determine the impact of input parameter distributions on their central tendencies, extreme percentiles, and degree of conformance to lognormality. This work demonstrates that the measurable attributes of human variability should be considered more carefully and that generalized assumptions about parameter distribution shapes may lead to inaccurate estimates of extreme percentiles of HEDs.

Toxicology↗

DOE OSTI2021

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Integrating Predictions for Improving Defect Classification Accuracy in NDT-based Assessment of Concrete - 20229

There is an increasing need to create predictive models for defect classification in concrete using the output of non-destructive testing (NDT) techniques. Recent advancement of machine-learning algorithms has offered several techniques for developing classification models for different types of data sets. However, the performance of these algorithms is very uncertain, mainly when applied to small and noisy datasets. For example, when human access is limited (e.g., nuclear facility), robot-based NDT is preferred. But compared to manual tests with humans present on site, the data sets are small, and more noise can exist. Therefore, it is imperative to develop new approaches to ensure a consistently high classification accuracy for inadequate data sets. This study explores the classification performance on NDT dataset using classifiers from different machine-learning algorithms, namely k-Nearest Neighbor (kNN), Decision Tree, Naive Bayes, Logistic Regression, and Support Vector Machine (SVM). The authors further integrated the predictions from these classifiers using proposed methods. The integration strategy combines the output of the classifiers based on two different measures, accuracy, and performance (ACC and PERF), using equations such as sum, average, and square-root-of-sums-of-squares (SRSS). Our results reveal varying classification accuracies across individual classifiers with different misclassifications across the test data set. The integration strategy provided significant improvement in the classification accuracy compared to the individual classifiers. Furthermore, the results indicate minimal variation across the integration methods as compared to the variation across the individual classifiers. To conclude, prediction integration offers a unique approach for combining the output of multiple classifiers to create redundancies with the potential of achieving high classification performance and improved reliability in predictive models for defect detection in concrete. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

BioADAPT-MRC: adversarial learning-based domain adaptation improves biomedical machine reading comprehension task

ABSTRACT Motivation Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model’s performance. Results We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets—BioASQ-7b, BioASQ-8b and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability and implementation BioADAPT-MRC is freely available as an open-source project at https://github.com/mmahbub/BioADAPT-MRC. Supplementary information Supplementary data are available at Bioinformatics online.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Identifying human failure events (HFEs) for external hazard probabilistic risk assessment

In recent years, several advancements in nuclear power plant (NPP) probabilistic risk assessment (PRA) have been driven by increased understanding of external hazards, plant response, and uncertainties. However, major sources of uncertainty associated with external hazard PRA remain. One important source is how risk-significant human actions that are carried out to enable plant response and recovery from natural hazards cause the close coupling of physical impacts on plants and overall plant risk during these hazard events. This makes human reliability and human-plant interactions important elements to consider in resolving PRA gaps in external hazards. One of the challenges in considering human response in external hazard probabilistic risk assessment (XHPRA) is that most existing human reliability analysis (HRA) models were not developed for assessing actions outside the control room (termed ex-control room actions) and hazard response. To support this new scope, HRA models will need to be developed or modified to support identification of human activities, causal factors, and uncertainties inherent in external hazard response, thereby providing insights regarding event timing and physical event conditions as they relate to human performance. In this study, there are two main objectives: (1) evaluate the applicability of an existing cognitive-based HRA method, Phoenix, to ex-control room actions, and (2) identify sources of uncertainty to be characterized or reduced in order to make this method suitable for XHPRA. The first step of such work is performed by assessing the suitability of existing HRA methods to support identifying human failure events (HFEs) for human response to flooding hazards. These HFEs are human actions or inactions that are involved in human responses to flooding hazards and could contribute to the loss of a critical function for the plant in the scenario being examined. Here, in this work, decomposition analyses using the cognitive-based Phoenix HRA model are used to identify HFEs. The Phoenix method was found to be suitable for analyzing ex-control room actions as well as identifying specific HFEs and underlying crew failure modes (CFMs). However, the method's suitability for use in ex-control room actions would benefit from expanding the available CFMs to accommodate a larger variety of physical and communication tasks.

42 ENGINEERING↗

DOE OSTI2026

The Value of Forecasters‐in‐the‐Loop in Real‐Time Flood Forecasting in the Age of Machine Learning

Machine learning (ML) applications in hydrological forecasting are increasingly prevalent and show great potential. However, many previous studies have only evaluated performance through reanalysis or retrospective simulations compared to simplified baselines. This study provides the first assessment of ML performance against actual operational forecasting systems operated by the California Nevada River Forecast Center (CNRFC), which combines the Community Hydrologic Prediction System (CHPS) with forecasters-in-the-loop. Results demonstrate that forecasters-in-the-loop systems consistently outperform ML models in both general forecasts and flood alerting across lead times up to 96 hr, even when ML models use observed forcings, while CNRFC operational process relies on biased weather forecasts. Our analysis reveals that forecaster expertise maintains forecast reliability despite inaccurate precipitation inputs, with human-guided systems showing superior performance degradation characteristics at extended lead times. These findings highlight the irreplaceable value of human expertise in operational forecasting and caution against overstating current ML capabilities in real-world applications.

Tran, Vinh Ngoc [Univ. of Michigan, Ann Arbor, MI ↗

DOE OSTI2025

Preliminary Evaluation of Joint Electricity-Hydrogen Concept of Operations

An initial thermal power dispatch (TPD) concept of operations was evaluated that couples a nuclear power plant to a nearby hydrogen production plant. GSE Systems’ generic pressurized water reactor full-scope simulator was modified with a TPD model comprised of a thermal power extraction and delivery system. A prototype human-system interface (HSI) was developed to interact with the TPD model and allow participants to execute the basic operating scenarios for normal operations. Four retired operators performed the evaluation, and due to COVID-19 travel restrictions, the original in-person experimental design was restructured to support a remote participator evaluation using a web meeting platform. Data from operator feedback, observations from the research team, and quantitative survey responses revealed that the initial TPD concept of operations is feasible. The operators were comfortable with the engineered system and HSI and could manage it without adverse impacts to reactor power, plant safety, or equipment. Findings are discussed in terms of both the TPD system design and HSI performance.

human factors↗

DOE OSTI2020

Development of a Conditioned System-Level Groundwater Model to Evaluate Long-Term Groundwater Impacts within a Performance Assessment - 20115

A preliminary performance assessment (PA) of single-shell tank Waste Management Area (WMA) A-AX located at the U.S. Department of Energy (DOE)'s Hanford Site in southeastern Washington is being conducted to satisfy the requirements of DOE Order 435.1 [1] as it relates to closure of the single-shell radioactive waste tanks in the WMA A-AX tank farms. A PA assesses the fate, transport, and impacts of radionuclides within a low-level radioactive waste disposal facility in its assumed closure configuration and the subsequent potential doses to humans over a 1,000-year compliance period and a 10,000-year performance evaluation period. The WMA A-AX preliminary PA evaluation is structured around the complementary use of process-level and system-level models to calculate the facility performance against established DOE Order 435.1 [1] performance objectives. Process-level models are those that represent a detailed phenomenological representation of processes of concern in the PA. Process models typically only represent one or a few of the components of the PA, such as groundwater flow and transport, and must be integrated with other modeling elements to perform PA calculations. System-level models are those that are abstracted from the process models, retaining the essential features of the process model, while allowing integration of all aspects of the PA in a single modeling framework. System-level models are often characterized by coarser numerical discretization, lower dimensionality, or other similar simplifications compared to the process-level model. Traditionally, a three-dimensional (3-D) process-level model is utilized primarily to evaluate the long-term impact on groundwater and the potential doses to individuals who consume contaminated groundwater. System-level models are also utilized to evaluate the groundwater pathway in PAs. These models typically have reduced dimensionality (1-D) and are conditioned utilizing flow fields (Darcy fluxes) and moisture content distributions that are abstracted from the process level models. The abstraction approach assures that the flow field in both models is consistent for a specific set of input parameters for flow, differing only in the discretization and dimensionality of the two models. The preliminary WMA A-AX PA incorporates a detailed representation of the geological system and hydraulic properties within the 3-D model STOMP{sup C} numerical code so that the effects of relevant features and processes on water flow and radionuclide transport in the subsurface can be evaluated. The complementary system-level model is developed utilizing the GoldSim{sup C} code to implement a simplified, 1-D equivalent model to represent the groundwater pathway. Contaminant transport through the vadose zone and unconfined aquifer for Tc-99 and I-129 were evaluated in each of the models. Adjustments to the saturated portion of the GoldSim{sup C} 1-D model were required to mimic the dispersion effect captured with the 3-D STOMP{sup C} model. Once this conditioning was conducted, highly similar results for the transport of Tc-99 and I-129 were achieved at the point of calculation, located 100 m downgradient from the WMA A-AX fenceline. These radionuclides represent elements that are regarded as primary dose drivers in the PA groundwater pathway analysis. The high degree of conformance between the two models suggests that the use of the equivalent 1-D system model is suitable for evaluating the full suite of radionuclides that will be released from the tank sources within WMA A-AX over the 1,000-year compliance period and over the 10,000-year evaluation period. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2022

A Bayesian Approach for Quantifying Data Scarcity when Modeling Human Behavior via Inverse Reinforcement Learning

Computational models that formalize complex human behaviors enable study and understanding of such behaviors. However, collecting behavior data required to estimate the parameters of such models is often tedious and resource intensive. Thus, estimating dataset size as part of data collection planning (also known as Sample Size Determination) is important to reduce the time and effort of behavior data collection while maintaining an accurate estimate of model parameters. In this paper, we present a sample size determination method based on Uncertainty Quantification (UQ) for a specific Inverse Reinforcement Learning (IRL) model of human behavior, in two cases: 1) pre-hoc experiment design—conducted in the planning stage before any data is collected, to guide the estimation of how many samples to collect; and 2) post-hoc dataset analysis—performed after data is collected, to decide if the existing dataset has sufficient samples and whether more data is needed. Here, we validate our approach in experiments with a realistic model of behaviors of people with Multiple Sclerosis (MS) and illustrate how to pick a reasonable sample size target. Our work enables model designers to perform a deeper, principled investigation of effects of dataset size on IRL.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

Visual Style Elements in Human–System Interface Design for Nuclear Power Operations: Does Style Affect Performance and Preference?

As the world increasingly adopts renewable and sustainable energy systems, transitionary solutions include nuclear power, which currently provides 20% of the United States’ electricity and is the largest single source of carbon-free electricity generation. Advanced reactors are a critical component of a carbon-free mixed energy portfolio that require careful design of first-of-a-kind control rooms. The application of Human Factors Engineering (HFE) is essential for scientific and iterative testing of novel human–system interface (HSI) concepts to ensure effective, efficient, and safe plant operations. Microworlds are simulators that use simplified physics models and control systems to distill nuclear power operations into essential functions. HFE scientists used the Rancor Microworld Simulator to obtain preference and performance metrics for novel and traditional static HSI design styles. Participants comprised advanced reactor company employees and nuclear industry consultants. A mixture of quantitative and qualitative data was captured. There was a preference for the basic graphical style that included high contrast and traditional color scheme elements. No single HSI design outperformed the others, and the participants did not perform better using their preferred HSI style. We report this experiment is the first in a series of HFE testing for HSIs in advanced reactor control room development. Clear user preferences emerged for elements within static displays. The cutting-edge neumorphic style was the least preferred. Future directions include tests of dynamic displays. HFE is used in evaluating and designing HSI devices that will improve the efficiency and safety of advanced nuclear power operations.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

DuctGPT: A Generative Transformer for Forward Screening of Ductile Refractory Multi-Principal Element Alloys

Designing ductile materials for extreme environments such as fusion reactors requires a deep understanding of the complex interplay between electronic structure, mechanical stability, and wide compositional space. Here, in this work, we introduce DuctGPT, a physics-informed, GPT-powered machine learning platform that enables rapid and accurate prediction of ductility across a wide range of refractory multi-principal element alloys (MPEAs). Trained on both experimental and high-fidelity computational data, DuctGPT integrates descriptors such as density of states at the Fermi level, elastic constants, and valence electron concentration to capture the fundamental mechanisms governing ductile versus brittle behavior. Using this framework, we screen over 1000 compositions in of body-centered cubic (BCC) MPEAs, including two new alloy classes, i.e., NbTa-rich (NbTa $>$ 50 at.%) NbTa-Ti-V and W-rich ($>$ 50 at.%) W-Ti-V MPEAs, to rapidly identify promising alloy compositions with enhanced ductility. Validation against experimental data confirms the model's ability to predict ductility with high fidelity and low uncertainty. By leveraging conversational AI and robust physical modeling, DuctGPT provides a blueprint for the next generation of alloy design assistants, enabling human-AI collaboration in the accelerated discovery of ductile, high-performance materials for fusion, aerospace, and advanced manufacturing.

AI/ML↗

DOE OSTI2020

Evolving theories of change: Rethinking of the effects of office lighting on occupants

This paper proposes an overall theory of change that relates lighting in offices to a holistic view of human responses that contribute to the well-being of office workers. The theoretical model considers how variations in the four fundamental lighting attributes affect visual performance, visual environment, and non-image forming responses. It moves beyond these lighting to address how external factors that are may mediate the effects on the desired lighting related outcomes, which in turn determine the final impact on occupants. The model builds on prior conceptual models of lighting effects and informs design and research planning for office lighting. Ultimately, properly supported task performance can increase occupant motivation but by itself may not achieve the holistic desired impact. Lighting attributes that support a pleasant visual environment and appropriate non-image forming responses can more fully contribute to an occupant’s mood and overall well-being.

Collier, Jessica M.↗

DOE OSTI2026

A multimodal large language model for materials science

Understanding and predicting the properties of inorganic materials is crucial for accelerating advancements in materials science and driving applications in energy, electronics and beyond. Integrating material structure data with language-based information through multimodal large language models (LLMs) offers great potential to support these efforts by enhancing human–artificial intelligence interaction. However, a key challenge lies in integrating atomic structures at full resolution into LLMs. In this work, we introduce MatterChat, a versatile structure-aware multimodal LLM that unifies material structural data and textual inputs into a single cohesive model. MatterChat uses a bridging module to effectively align a pretrained universal machine learning interatomic potential with a pretrained LLM, reducing training costs and enhancing flexibility. Our results demonstrate that MatterChat greatly improves performance in material property prediction and human–artificial intelligence interaction, surpassing general-purpose LLMs such as GPT-4. We also demonstrate its usefulness in applications such as more advanced scientific reasoning and step-by-step material synthesis.

Tang, Yingheng [Lawrence Berkeley National Laborat↗

DOE OSTI2023

Genome-scale metabolic reconstruction of 7,302 human microorganisms for personalized medicine

The human microbiome influences the efficacy and safety of a wide variety of commonly prescribed drugs. Designing precision medicine approaches that incorporate microbial metabolism would require strain- and molecule-resolved, scalable computational modeling. Here, we extend our previous resource of genome-scale metabolic reconstructions of human gut microorganisms with a greatly expanded version. AGORA2 (assembly of gut organisms through reconstruction and analysis, version 2) accounts for 7,302 strains, includes strain-resolved drug degradation and biotransformation capabilities for 98 drugs, and was extensively curated based on comparative genomics and literature searches. The microbial reconstructions performed very well against three independently assembled experimental datasets with an accuracy of 0.72 to 0.84, surpassing other reconstruction resources and predicted known microbial drug transformations with an accuracy of 0.81. We demonstrate that AGORA2 enables personalized, strain-resolved modeling by predicting the drug conversion potential of the gut microbiomes from 616 patients with colorectal cancer and controls, which greatly varied between individuals and correlated with age, sex, body mass index and disease stages. AGORA2 serves as a knowledge base for the human microbiome and paves the way to personalized, predictive analysis of host–microbiome metabolic interactions.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Deep transfer learning for star cluster classification: I. application to the PHANGS– HST survey

ABSTRACT We present the results of a proof-of-concept experiment that demonstrates that deep learning can successfully be used for production-scale classification of compact star clusters detected in Hubble Space Telescope(HST) ultraviolet-optical imaging of nearby spiral galaxies ($D\lesssim 20\, \textrm{Mpc}$) in the Physics at High Angular Resolution in Nearby GalaxieS (PHANGS)–HST survey. Given the relatively small nature of existing, human-labelled star cluster samples, we transfer the knowledge of state-of-the-art neural network models for real-object recognition to classify star clusters candidates into four morphological classes. We perform a series of experiments to determine the dependence of classification performance on neural network architecture (ResNet18 and VGG19-BN), training data sets curated by either a single expert or three astronomers, and the size of the images used for training. We find that the overall classification accuracies are not significantly affected by these choices. The networks are used to classify star cluster candidates in the PHANGS–HST galaxy NGC 1559, which was not included in the training samples. The resulting prediction accuracies are 70 per cent, 40 per cent, 40–50 per cent, and 50–70 per cent for class 1, 2, 3 star clusters, and class 4 non-clusters, respectively. This performance is competitive with consistency achieved in previously published human and automated quantitative classification of star cluster candidate samples (70–80 per cent, 40–50 per cent, 40–50 per cent, and 60–70 per cent). The methods introduced herein lay the foundations to automate classification for star clusters at scale, and exhibit the need to prepare a standardized data set of human-labelled star cluster classifications, agreed upon by a full range of experts in the field, to further improve the performance of the networks introduced in this study.

Wei, Wei↗

DOE OSTI2022

Report on PTT Imaging of Defects in AM Metallic Materials-Part 2

36 MATERIALS SCIENCE↗

DOE OSTI2022

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Prediction of protein assemblies, the next frontier: The CASP14-CAPRI experiment

Here we present the results for CAPRI Round 50, the fourth joint CASP-CAPRI protein assembly prediction challenge. The Round comprised a total of twelve targets, including six dimers, three trimers, and three higher-order oligomers. Four of these were easy targets, for which good structural templates were available either for the full assembly, or for the main interfaces (of the higher-order oligomers). Eight were difficult targets for which only distantly related templates were found for the individual subunits. Twenty-five CAPRI groups including eight automatic servers submitted ~1250 models per target. Twenty groups including six servers participated in the CAPRI scoring challenge submitted ~190 models per target. The accuracy of the predicted models was evaluated using the classical CAPRI criteria. The prediction performance was measured by a weighted scoring scheme that takes into account the number of models of acceptable quality or higher submitted by each group as part of their five top-ranking models. Compared to the previous CASP-CAPRI challenge, top performing groups submitted such models for a larger fraction (70–75%) of the targets in this Round, but fewer of these models were of high accuracy. Scorer groups achieved stronger performance with more groups submitting correct models for 70–80% of the targets or achieving high accuracy predictions. Servers performed less well in general, except for the MDOCKPP and LZERD servers, who performed on par with human groups. In addition to these results, major advances in methodology are discussed, providing an informative overview of where the prediction of protein assemblies currently stands.

protein complexes↗