Are you actually crawling same URL?
You received this message because you are subscribed to the Google Groups "pyspider-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pyspider-user...@googlegroups.com.
To post to this group, send email to pyspide...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pyspider-users/CAH-drozOLtnA9nhpqSyj%2BscTP7YHi6CnJ15wR-2QmZnpLR1Pdw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.