Dear Joe,
The other genes that you get from the amigo website are actually genes linked to children of the GO term GO:0060537. You can get these genes back in biomart by using the "go_parent_term" filter, this will return all the genes linked to GO:0060537 as well as the genes linked to the children terms.
gene.data <- getBM(attributes=c('hgnc_symbol', 'ensembl_gene_id', 'go_id'), filters = 'go_parent_term', values ="GO:0060537", mart = mart)
> gene.data[0:10,]
hgnc_symbol ensembl_gene_id go_id
1 FOXL2 ENSG00000183770 GO:0002074
2 PITX2 ENSG00000164093 GO:0002074
3 CACNA1S ENSG00000081248 GO:0002074
4 TBX3 ENSG00000135111 GO:0003167
5 NKX2-5 ENSG00000183072 GO:0003168
6 RYR2 ENSG00000198626 GO:0003220
7 NKX2-5 ENSG00000183072 GO:0003221
8 ZFPM2 ENSG00000169946 GO:0003221
9 DLL4 ENSG00000128917 GO:0003222
10 FOXH1 ENSG00000160973 GO:0003222
Hope this helps,
Thomas