Restore the spidering queue and history from a previous session

15 views
Skip to first unread message

RME

unread,
Oct 11, 2017, 4:40:34 PM10/11/17
to Spidr
I tried adding an array of URI's with the option :history

Spidr.site('http://www.whatever.com', :history => history) do |spider|

What am I doing wrong?

postmodern

unread,
Oct 11, 2017, 4:46:05 PM10/11/17
to sp...@googlegroups.com
Are you trying to provide a previous history to prevent those URIs from
being re-spidered? Or are you wanting to enqueue those URIs for
spidering? To do the later, pass the array of URIs via the `:queue`
option.
> -- 
>
> --- 
> You received this message because you are subscribed to the Google
> Groups "Spidr" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to spidr+un...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
signature.asc

RME

unread,
Oct 11, 2017, 5:31:47 PM10/11/17
to Spidr
If possible, trying to prevent re-visits between runs. Appreciate the help.
Reply all
Reply to author
Forward
0 new messages