I was wondering if you could help me solve another "basic" question. So after running the pipeline for SNPs calling I also performed the populations test (this off course after using the correction module, rxstacks, and re running the modules cstacks, sstacks).
This were the parameters I used:
# m=5 n=9 r=0.5
/home/carol/RADseq/tools/stacks-1.39/populations -b 1 -P ./ -M /home/carol/RADseq/Pilot2_NexSeq/Demultiplexed_data/Trimmed/Stylo-alignments/stacks/rstacks/stylo_popmap_n9 -e pstI -k -r 0.5 -p 2 -m 5 -t 30 --fstats -f p_value --bootstrap --bootstrap_reps 1000 --verbose -s --vcf --vcf_haplotypes --genepop --structure --plink --fasta --fasta_strict --genomic
The summary results among my two populations was:
#324 loci retained. Removing 33 additional loci for which all variant sites were filtered... retained 291 loci.
#overall Fst=0.021047
#Pooled populations 'maq' and 'far' contained: 0 incompatible loci; 0 nucleotides covered by more than one RAD locus.
I further checked the table for the AMOVA Fst values and all those other inter-population statistics finding out that for some loci I have a high differentiation Fst=1 while for others differentiation was non-existent or very low Fst=0
I was then curious on how the overall Fst had been calculated. I found in one of the stacks group questions that you stated that it is the average of the Fst values that I get in the batch_1.fst_pop1-pop2.tsv. However, when I tried to corroborate that myself and I get a different value for the average AMOVA Fst (0.161577502), Fst (0.100752859) and the overall Fst calculated by the program (0.021047) (Files are attached). Could you help me figure out how is this overall Fst is being calculated?
Also, could you provide me the equation used to calculate the AMOVA Fst. I tried to go to the reference you give in the stacks manual (Genetic Data Analysis II, chapter 5) but the book is locked, so unless I buy it I cannot see how this AMOVA Fst is calculated.
Thanks in advance,