Hi,
i would like for each page (in pagination) crawled, to retrieve/get the value of page.
so if we are on page 1, i want to retrieve "1", if i'm on page 2, i want to get "2"
here is a simple example of my code:
def parse_start_url(self, response):
return {"page number" : response.url.xxx}
where xxx should return the value of url argument/parameter.
However i do not know how to do that in scrapy :(
my url should look like that:
maybe there could be more parameters, so i can not search for string "p=" as i do not know how many digit the page number will be.
how can i do that ? Is there a way to get the parameter value ?
i search and i found something about getattr(response.url, the_missing_param) but i was not able to find more help or documentation about it.
thx a lot