Performance of computational methods for the evaluation of pericentriolar material 1 missense variants in CAGI-5

Alexander Miguel Monzon, Marco Carraro, Luigi Chiricosta, Francesco Reggiani, James Han, Kivilcim Ozturk, Yanran Wang, Maximilian Miller, Yana Bromberg, Emidio Capriotti, Castrense Savojardo, Giulia Babbi, Pier L. Martelli, Rita Casadio, Panagiotis Katsonis, Olivier Lichtarge, Hannah Carter, Maria Kousi, Elias Nicholas Katsanis, Gaia AndreolettiJohn Moult, Steven E. Brenner, Carlo Ferrari, Emanuela Leonardi, Silvio C.E. Tosatto*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Scopus citations


The CAGI-5 pericentriolar material 1 (PCM1) challenge aimed to predict the effect of 38 transgenic human missense mutations in the PCM1 protein implicated in schizophrenia. Participants were provided with 16 benign variants (negative controls), 10 hypomorphic, and 12 loss of function variants. Six groups participated and were asked to predict the probability of effect and standard deviation associated to each mutation. Here, we present the challenge assessment. Prediction performance was evaluated using different measures to conclude in a final ranking which highlights the strengths and weaknesses of each group. The results show a great variety of predictions where some methods performed significantly better than others. Benign variants played an important role as negative controls, highlighting predictors biased to identify disease phenotypes. The best predictor, Bromberg lab, used a neural-network-based method able to discriminate between neutral and non-neutral single nucleotide polymorphisms. The CAGI-5 PCM1 challenge allowed us to evaluate the state of the art techniques for interpreting the effect of novel variants for a difficult target protein.

Original languageEnglish (US)
Pages (from-to)1474-1485
Number of pages12
JournalHuman mutation
Issue number9
StatePublished - Sep 1 2019


  • bioinformatics tools
  • community challenge
  • critical assessment
  • effect prediction
  • missense mutations
  • variant interpretation

ASJC Scopus subject areas

  • Genetics
  • Genetics(clinical)

Fingerprint Dive into the research topics of 'Performance of computational methods for the evaluation of pericentriolar material 1 missense variants in CAGI-5'. Together they form a unique fingerprint.

Cite this