how to download multi URLS using fanficfare cli, is it possable?

577 views
Skip to first unread message

Majid HUSSAIN

unread,
Jul 19, 2016, 10:17:51 AM7/19/16
to fanfic-d...@googlegroups.com
good afternoon,
as the subject questions is this indeed a possability?
if so what magic must I perform in auder for this to work?
if not could this feature be added?
thanks for reading! :)
Majid Hussain

--
kind regards,
Majid Hussain

Jim Miller

unread,
Jul 19, 2016, 11:03:42 AM7/19/16
to fanfic-d...@googlegroups.com
On 7/19/2016 9:17 AM, Majid HUSSAIN wrote:
> as the subject questions is this indeed a possability?
> if so what magic must I perform in auder for this to work?

Put the story URLs in a file and use:

fanficfare -i <file> or --infile=<file>

> $ fanficfare -h
> Usage: fanficfare [options] storyurl
>
> Options:
> -h, --help show this help message and exit
> -f FORMAT, --format=FORMAT
> write story as FORMAT, epub(default), mobi, text or
> html
> -c CONFIG, --config=CONFIG
> read config from specified file(s) in addition to
> ~/.fanficfare/defaults.ini,
> ~/.fanficfare/personal.ini, ./defaults.ini, and
> ./personal.ini
> -b START, --begin=START
> Begin with Chapter START
> -e END, --end=END End with Chapter END
> -o NAME=VALUE, --option=NAME=VALUE
> set an option NAME=VALUE
> -m, --meta-only Retrieve metadata and stop. Or, if --update-epub,
> update metadata title page only.
> -u, --update-epub Update an existing epub with new chapters, give epub
> filename instead of storyurl.
> --unnew Remove (new) chapter marks left by mark_new_chapters
> setting.
> --update-cover Update cover in an existing epub, otherwise existing
> cover (if any) is used on update. Only valid with
> --update-epub.
> --force Force overwrite of an existing epub, download and
> overwrite all chapters.
> -i INFILE, --infile=INFILE
> Give a filename to read for URLs (and/or existing EPUB
> files with -u for updates).
> -l, --list Get list of valid story URLs from page given.
> -n, --normalize-list Get list of valid story URLs from page given, but
> normalized to standard forms.
> -s, --sites-list Get list of valid story URLs examples.
> -d, --debug Show debug output while downloading.

Tara Li

unread,
Jul 19, 2016, 11:06:26 AM7/19/16
to fanfic-d...@googlegroups.com
However, please do not use huge long lists of URLs!  You'll get yourself blocked from the websites!

If you're pulling from multiple sites, you might alternate sites you pull - first FF.net, then Ficwad, then TTH, then SIYE, then back to FF.net - that way it eases the load on each particular site.


--
Project Home: https://github.com/JimmXinu/FanFicFare/wiki
--- You received this message because you are subscribed to the Google Groups "FanFicFare -- Downloader for FanFiction" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fanfic-downloa...@googlegroups.com.
Visit this group at https://groups.google.com/group/fanfic-downloader.
To view this discussion on the web visit https://groups.google.com/d/msgid/fanfic-downloader/e11751f5-8131-ebd2-7e37-dc7643f141db%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

Jim Miller

unread,
Jul 19, 2016, 11:08:57 AM7/19/16
to fanfic-d...@googlegroups.com
On 7/19/2016 10:06 AM, Tara Li wrote:
> However, please do not use huge long lists of URLs! You'll get yourself
> blocked from the websites!

Yes! Thanks Tara Li, I should have mentioned that.

From https://github.com/JimmXinu/FanFicFare/wiki/FAQs :

> Checking for updates on dozens (or hundreds or thousands) of stories at once causes excessive traffic on the source site. fanfiction.net in particular has been known to block people's IP address if they generate too much traffic.
>
> Instead, I highly recommend that you 'follow' stories and use the sites' email notifications to inform you about updates and then update those specific stories.


Tara Li

unread,
Jul 19, 2016, 11:14:40 AM7/19/16
to fanfic-d...@googlegroups.com
At some point, I really need to write a PROCMAIL recipe that will watch my mailspool and pull updates automatically when the notice comes in.

--
Project Home: https://github.com/JimmXinu/FanFicFare/wiki
--- You received this message because you are subscribed to the Google Groups "FanFicFare -- Downloader for FanFiction" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fanfic-downloa...@googlegroups.com.
Visit this group at https://groups.google.com/group/fanfic-downloader.
Reply all
Reply to author
Forward
0 new messages