New Version of FanFictionDownloader Calibre Plugin

426 views
Skip to first unread message

Jim Miller

unread,
Dec 22, 2011, 8:26:29 PM12/22/11
to fanfic-d...@googlegroups.com

1.0.01 version containing a very cool feature previously only available
to CLI users--the ability to update an existing EPUB to add new chapters
without having to download the whole thing again.

Some instructions on setting it up and using it are posted at:
http://code.google.com/p/fanficdownloader/wiki/FanFictionDownloaderCalibrePlugin

We welcome your comments on it in our User Group at:
http://groups.google.com/group/fanfic-downloader

--
Jim Miller
Retie...@gmail.com

stephanie

unread,
Dec 22, 2011, 10:35:50 PM12/22/11
to Fanfiction Downloader
I have tried this new version for Calibre and love it!! It makes
getting fanfiction so much easier and calibre downloads right to my e-
reader, very excited about this, thanks for developing it.

On Dec 22, 7:26 pm, Jim Miller <retiefj...@gmail.com> wrote:
> 1.0.01 version containing a very cool feature previously only available
> to CLI users--the ability to update an existing EPUB to add new chapters
> without having to download the whole thing again.
>
> Some instructions on setting it up and using it are posted at:http://code.google.com/p/fanficdownloader/wiki/FanFictionDownloaderCa...
>
> We welcome your comments on it in our User Group at:http://groups.google.com/group/fanfic-downloader
>
> --
> Jim Miller
> RetiefJ...@gmail.com

iat...@ya.ru

unread,
Dec 22, 2011, 11:42:36 PM12/22/11
to Fanfiction Downloader
Brilliant! I was about to suggest this option, and here you are! Which
resulted in 100+ chapter work being compiled in the matter of seconds.
Thank you, thank you very much.

But, may be, would it be possible to add just a simple merging of two
stories option as well?

Ida


On 22 дек, 20:26, Jim Miller <retiefj...@gmail.com> wrote:
> 1.0.01 version containing a very cool feature previously only available
> to CLI users--the ability to update an existing EPUB to add new chapters
> without having to download the whole thing again.
>
> Some instructions on setting it up and using it are posted at:http://code.google.com/p/fanficdownloader/wiki/FanFictionDownloaderCa...
>
> We welcome your comments on it in our User Group at:http://groups.google.com/group/fanfic-downloader
>
> --
> Jim Miller
> RetiefJ...@gmail.com

Jim Miller

unread,
Dec 22, 2011, 11:49:37 PM12/22/11
to fanfic-d...@googlegroups.com
On 12/22/2011 10:42 PM, iat...@ya.ru wrote:
> Brilliant! I was about to suggest this option, and here you are! Which
> resulted in 100+ chapter work being compiled in the matter of seconds.
> Thank you, thank you very much.

I'm glad you like it. :-) The epub update is a favorite of mine that
I've been using in command-line for a long time.

> But, may be, would it be possible to add just a simple merging of two
> stories option as well?

Interesting you should ask that... ;-) The 'epub update' feature is
actually implemented using a more general epub merging program I put
together a while back.

Merging epubs is coming, but I'm considering making it a separate plugin
for people who don't care about fanfic.

Jim

--
Jim Miller
Retie...@gmail.com

iat...@ya.ru

unread,
Dec 23, 2011, 2:18:12 AM12/23/11
to Fanfiction Downloader
Ara, I think I found a bug in this version. Now the option "Add new"
if the story exists doesn't seem to be working properly.

Ida.

iat...@ya.ru

unread,
Dec 23, 2011, 3:57:52 AM12/23/11
to Fanfiction Downloader
And another bug, I suppose. When you click the button and the window
pops up, it inserts whatever is copied in the URL window. Only it is
what was copied prior to opening Calibre, and has fairly little
relation to the current buffer.
Ida

Roman Kirillov

unread,
Dec 23, 2011, 3:58:34 AM12/23/11
to fanfic-d...@googlegroups.com
I think it's a feature. I'd leave it as is to be perfectly honest - quite like it.

R
--
Roman "sgzmd" Kirillov
http://www.sigizmund.com

iat...@ya.ru

unread,
Dec 23, 2011, 12:47:21 PM12/23/11
to Fanfiction Downloader
It is bloody confusing, though. It is once thing when there is but
some random text. But when it is a link for a different story that you
are trying to download stored in the original buffer, and you see the
link with proper domain name, and think it is the right one...

On 23 дек, 03:58, Roman Kirillov <m...@romankirillov.info> wrote:
> I think it's a feature. I'd leave it as is to be perfectly honest - quite
> like it.
>
> R
>

Roman Kirillov

unread,
Dec 23, 2011, 1:20:39 PM12/23/11
to fanfic-d...@googlegroups.com

Well, now when you say it like that... I have no strong opinion on that, really, and since its Jim's pet project its up to him.

Ken Lidster

unread,
Dec 23, 2011, 3:40:31 PM12/23/11
to fanfic-d...@googlegroups.com

I like it too, and consider it a feature. My procedure to convert a story has always been to bring it up in the browser, copy the URL to the paste buffer, bring FanFictionDownloader up in another tab/window, paste, and then convert (then download the result, close the tab/window, and ADD it to Calibre). With this addon I simply replace everything after ‘copy the URL’ with ‘Click on FanFictionDownloader’ and ‘Click on Download’. Much simpler and straight-forward.

Tara Li

unread,
Dec 23, 2011, 3:46:09 PM12/23/11
to fanfic-d...@googlegroups.com

Now, if we could get a bokmarklet to trigger the Calibre plug-in, and maybe something with the tags so it will update the book in Calibre instead of having to accept the duplicate and then delete the old.

Jim Miller

unread,
Dec 23, 2011, 11:00:55 PM12/23/11
to fanfic-d...@googlegroups.com
On 12/23/2011 1:18 AM, iat...@ya.ru wrote:
> Ara, I think I found a bug in this version. Now the option "Add new"
> if the story exists doesn't seem to be working properly.

Yep, looks like 'Add New' isn't working.

But you don't need to set that to 'Add new' if you're adding a truly new
story--only if you already have one with the same title/author and want
to create a new one.

I'll get it fixed, but I'm away for Christmas, might not be promptly.

Jim Miller

unread,
Dec 23, 2011, 11:11:35 PM12/23/11
to fanfic-d...@googlegroups.com

iatheia,

Yes, the clipboard copy is a deliberate feature.

In 1.0.0, it just took whatever was in the clipboard. In 1.0.1, if
there are no books selected, it splits the clipboard by whitespace and
discards anything that's not a valid story URL.

IMO, that makes it very handy. But I can see where other people might
disagree. I'll add some options to disable/prioritize taking URLs from
clipboard/selected books.

I've only been working on the plugin a week--it's not going to be
perfect yet. But I appreciate the feedback and suggestions; they'll
help make it better.

Jim

On 12/23/2011 12:20 PM, Roman Kirillov wrote:
> Well, now when you say it like that... I have no strong opinion on that,
> really, and since its Jim's pet project its up to him.
>

> On Dec 23, 2011 5:47 PM, "iat...@ya.ru <mailto:iat...@ya.ru>"


> <iat...@ya.ru <mailto:iat...@ya.ru>> wrote:
>
> It is bloody confusing, though. It is once thing when there is but
> some random text. But when it is a link for a different story that you
> are trying to download stored in the original buffer, and you see the
> link with proper domain name, and think it is the right one...
>
> On 23 дек, 03:58, Roman Kirillov <m...@romankirillov.info

> <mailto:m...@romankirillov.info>> wrote:
> > I think it's a feature. I'd leave it as is to be perfectly honest
> - quite
> > like it.
> >
> > R
> >

> > On 23 December 2011 08:57, iath...@ya.ru <mailto:iath...@ya.ru>


> <iath...@ya.ru <mailto:iath...@ya.ru>> wrote:
> >
> > > And another bug, I suppose. When you click the button and the
> window
> > > pops up, it inserts whatever is copied in the URL window. Only
> it is
> > > what was copied prior to opening Calibre, and has fairly little
> > > relation to the current buffer.
> > > Ida
> >
> > --
> > Roman "sgzmd" Kirillovhttp://www.sigizmund.com

> <http://www.sigizmund.com>
>


--
Jim Miller
Retie...@gmail.com

Jim Miller

unread,
Dec 23, 2011, 11:17:11 PM12/23/11
to fanfic-d...@googlegroups.com
On 12/23/2011 2:46 PM, Tara Li wrote:
> Now, if we could get a bokmarklet to trigger the Calibre plug-in, and
> maybe something with the tags so it will update the book in Calibre
> instead of having to accept the duplicate and then delete the old.

??? If you select Overwrite or Update EPUB and have 'Update Calibre
Metadata' checked, it should be doing that for you.

As for a browser bookmarklet, I would love that too, if anyone knows
how. :-)

Roman Kirillov

unread,
Dec 24, 2011, 3:41:06 AM12/24/11
to fanfic-d...@googlegroups.com
Realistically that would be possible if only calibre itself could provide URL handling capabilities - which it doesn't (I'm speaking in terms of e.g. Spotify able to handle links like 'spotify:whatever' and register itself as a handler for links of this type).

Tara Li

unread,
Dec 24, 2011, 11:02:07 AM12/24/11
to fanfic-d...@googlegroups.com

Just asking - but would it realistically be functionality that a plug-in could add, or do we need to file a ticket for the mainline?  If we could get this working, it would reduce the load on the appengine version.

Roman Kirillov

unread,
Dec 24, 2011, 11:26:59 AM12/24/11
to fanfic-d...@googlegroups.com
This is a sound idea - I need to think about how we can add custom protocol handler, at least to chrome.

Roman

Roman Kirillov

unread,
Dec 24, 2011, 11:33:54 AM12/24/11
to fanfic-d...@googlegroups.com
Jim,

Do you think it's possible to define some command line argument to start calibre which will launch fic download automatically? If it is indeed so, we can (theoretically) build a plugin using FireBreath (http://www.firebreath.org) which will do that. Theoretically speaking.

R

Jim Miller

unread,
Dec 24, 2011, 12:31:06 PM12/24/11
to fanfic-d...@googlegroups.com
On 12/24/2011 10:33 AM, Roman Kirillov wrote:
> Do you think it's possible to define some command line argument to start
> calibre which will launch fic download automatically? If it is indeed
> so, we can (theoretically) build a plugin using FireBreath
> (http://www.firebreath.org) which will do that. Theoretically speaking.

Maybe. Calibre has command-line utilities to manipulate the library,
and I have a demo of calling the prefs-config part of the plugin from
command-line for testing purposes.

It may be possible to stitch something together to launch the plugin
from CLI with calibre-debug and give it a ref to the Library to update,
but I don't know that it would be easy to setup--it might require a
visible .py file.

iat...@ya.ru

unread,
Dec 24, 2011, 1:55:58 PM12/24/11
to Fanfiction Downloader
Another way to go around this that I can think of is to use some sort
of browser plugin to just write the urls to the text file, and then
Calibre would be able to read that file when the Downloader is called.

Ida
> RetiefJ...@gmail.com

Roman Kirillov

unread,
Dec 24, 2011, 2:24:13 PM12/24/11
to fanfic-d...@googlegroups.com

File system is usually not accessible for plugins. But so is launching apps.

Bill Suetholz

unread,
Dec 24, 2011, 5:39:29 PM12/24/11
to Fanfiction Downloader
Another idea would be to hook into the rss feed capabilities in Calibre. Presently that does only the latest chapter.
--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

Ken Lidster

unread,
Dec 25, 2011, 5:35:06 PM12/25/11
to fanfic-d...@googlegroups.com

I don’t know if this has been brought up before, but I thought I’d throw it out there anyway.

 

Since the plugin already supports updating an existing Calibre entry, how about automating that overall operation somewhat? If you stored the access URL in a new Calibre tag (say, ‘Source’) you could add an ‘Update’ option to FanFictionDownloader button that would use that tag to automatically perform the update.

 

I don’t know about others, but I keep a number of my favorite WIP stories loaded in Calibre. A couple of good examples are Tenhawk’s wonderful “Alexander Harris and the Shadow Council” and “SCAU-DC Stranger in a Strange Verse”, two very long, very good, and very WIP stories (1 or 2 years each, I think). It would be neat to simply select one or more of those and just click on a FanFictionDownloader / Update button.

 

Regardless, love the plugin. Thanks!

 

Ken

Jim Miller

unread,
Dec 25, 2011, 5:45:41 PM12/25/11
to fanfic-d...@googlegroups.com

Ken,

With 1.0.1, it already does something very similar.

More recent versions of calibre have stored the URL, from epub at least,
as an identifier. If you have book(s) selected when you hit the plugin
in button, it looks there first, followed by in the epub itself to get
the URL(s) and pre-pops the url list box.

Assuming the title/authors match, those stories will then be updated
when you hit 'download'.

Effectively, I believe this is the same thing you're asking for.

I intend to improve the update feature at some point. Right now, it
will pull the URL(s) from existing book(s), but updates existing by the
title/author matching--if the title's been changed, for example, it will
create a new book instead.

Jim

On 12/25/2011 4:35 PM, Ken Lidster wrote:
> Since the plugin already supports updating an existing Calibre entry,
> how about automating that overall operation somewhat? If you stored the
> access URL in a new Calibre tag (say, ‘Source’) you could add an
> ‘Update’ option to FanFictionDownloader button that would use that tag
> to automatically perform the update.
>
> I don’t know about others, but I keep a number of my favorite WIP
> stories loaded in Calibre. A couple of good examples are Tenhawk’s
> wonderful “Alexander Harris and the Shadow Council” and “SCAU-DC
> Stranger in a Strange Verse”, two very long, very good, and very WIP
> stories (1 or 2 years each, I think). It would be neat to simply select
> one or more of those and just click on a FanFictionDownloader / Update
> button.


--
Jim Miller
Retie...@gmail.com

Ken Lidster

unread,
Dec 25, 2011, 6:23:32 PM12/25/11
to fanfic-d...@googlegroups.com
Neat. I'll give it a try later today and let you know how it goes. Thanks, again!

Ken

Reply all
Reply to author
Forward
0 new messages