Runs per language document collection or mixed?

[Samy Ateia]

Hi, 

should the runs be submitted per document collection or should all 3 document collections be mixed in the result sets.

So for the Ad Hoc task should we submit 3 run files ( 1 Chinese, 1 Persian and 1 Russian) or 1 run file where docids in each result set of 1000 docs per topic are mixed from the 3 collections? 

Given that the reranking runs are per language document collection and the dev qrels are also per language document collection i suspect that we should submit 1 run per language document collection so 3 in total for one run. Just want to make sure that this is correct.

Best

Samy