Hi Harald,
I work specifically with Carbonylation PTMs which requires to make searches for many modifications at the time.
With regards what you mention about the room to make mistakes, I have observed this to be true for PSMs to very noisy spectra and big proposed "peptides" (sometimes just random m/z noise values selected for "fragmentation". Which is why I wanted to include Myrimatch since it includes an itensity score in its algorithm (at least this is what I understood from a quick check on Chambers paper).
Nevertheless, I have been using other search engines (X!Tandem, MS-GF+, MSAmanda) through SearchGUI (aware of going against the suggestions) using the same number of modifications. Through spectral validation, specific reporter ions, modification specific neutral losses, and cross-correlation of results obtained with PEAKS I am confident that it has performed well for good MSMS. However, I can't comment on the statistical validation results. I only use spectra I have checked for my results.
I think this might be a debatable idea and don't have a strong lenience to any side, but premises of search engines like ionbot, PEAKs or other OMS argue that considering more PTMs or, in the lack of its identity, mass shifts at the same time would give a more confident match. Reducing the number of false negatives and false positives (although as you mention this can be the opposite for badly curated MSMS spectra). Any further comments on this or suggested reading?
With regards to Myrimatch then I should just understand that is a search engine limitation on the number of PTMs considered per search?
Sincerely,
JC