akhter wahab
unread,Feb 7, 2012, 3:38:22 PM2/7/12Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to scrapy-users
i have an issue using scrapy
yield Request(a_url[0],
meta={'item': aitem}, dont_filter=True,
callback=self.redeem_url, errback=self.error_page)
def redeem_url(self, response):
item = response.request.meta['item']
item['Click_to_Redeem_URL'] = response.url
yield item
aitem is populated before doing a_url[0] request some times i get
302,404,301 status from Request so what i want is if i can't get 200
response from a_url[0] request item should yield i didn't found any
way because when i got 302 scrapy retry on this request and not go to
error_page errback, and if in 404 it goes to error_page what would be
the way to yield item over there because what i know in errback i
can't get response object but a failure object that not contains item
in meta
thanks in advance