Hi Ashok,
some suggestions that may or may not solve your problem:
- Are you using BEAST v. 2.1.3 and BEAGLE? I've seen similar problems with this version, and I think I remember that using either BEAST v.2.2 or running it without BEAGLE solved the issue. But the developers surely know better whether or not this could be the reason.
- Even if jModelTest recommends the GTR+G+I model, many people in the field think this model is problematic as the estimates for the proportion of invariable sites and the alpha parameter of the gamma distribution influence each other and are difficult to estimate separately. Generally, GTR+G should work just as well if not better, and should lead to faster convergence.
- For the protein-coding mitochondrial markers, it may make more sense to split each marker according to codon position, and build three mitochondrial partitions: 1) all first codon positions combined, 2) all second codon positions combined, 3) all third codon positions combined. The reason is that substitution rates differ more strongly between codon positions than between markers, at least when compared within the mitochondrial genome.
- I guess I would always run a less parameter-rich model first just to test how fast and reliably BEAST converges. Using HKY instead of GTR would reduce the number of parameters of your analysis enormously.
Cheers,
Michael