Storiesonline.net memory leak

[benjamin...@gmail.com]

Hello everyone,

For a few versions, both the calibre plugin and the website refuse to download epubs from storiesonline.net.

With the plugin, I have a memory leak. The memory consumption raises in a linear fashion until my RAM is saturated and Linux kills the program. (I'm running ArchLinux).

On the website, I have to wait for about 30 secs then I get a laconic

"Error: Server Error

The server encountered an error and could not complete your request.

Please try again in 30 seconds.".

I obviously have tried several URLs on this website without success but here is an example : http://storiesonline.net/s/50036:52621

I have 12go of ram and an Haswell i7. I could be wrong but I don't think that the problem comes from my hardware.

I also have successfully downloaded stories from other websites supported by the plugin.

Is this a bug or a misconfiguration from my part?

Thank you in advance for your help,

ben569.

[benjamin...@gmail.com]

By the way, my system is up to date as I have FanFicFare 2.34 and calibre 2.60.

[Jim Miller]

I am able to successfully download the example story given using the
calibre plugin and CLI. (The web service has other restrictions--I
don't recommend it unless you can't use the plugin or CLI).

The calibre background job downloading it grows to >100M, but all of
that memory is freed when the download finishes. I am testing on
Windows 8, however. 100M seems excessive for a 551k word story, but we
are talking about an interpreted language process. And 100M shouldn't
be an issue by today's standards--my browser process regularly runs +1G.

Do you know how much memory is used by the process before it fails for you?

Jim

[benjamin...@gmail.com]

Well, I killed the program when it was using 9 Gio of RAM looking for metadata. Most computers don't even have that much RAM.

Just so you know, I have a free account on the website.

I don't know how to run the program in the CLI but calibre's crash is already a problem, IMHO.

[benjamin...@gmail.com]

To be clear, by "I have a free account on the website", I meant that my storiesonline account is not premium.

[benjamin...@gmail.com]

Also, I don't know if the problem exists on Windows (be it 7, 8 or 10) as I am running Linux.

[Jim Miller]

I think 12G is pretty typical for a computer these days, but I agree,
the program shouldn't need 9G.

Are you crashing the background job, or the main calibre(GUI) process?

Have you changed your appearance settings on Storiesonline.net?
Attached is what settings are default (or were, at least) and are the
settings FFF is expecting.

Jim

On 6/28/2016 5:03 AM, benjamin...@gmail.com wrote:
> Well, I killed the program when it was using *9 Gio* of RAM looking for
> metadata. Most computers don't even *have* that much RAM.

[Benjamin Poncet]

Changing the theme from modern to classic did the trick...

I'm bumping my head right now.

I'm checking if it was the gui process or the background job that I was crashing.

Thank you foryour help.

--
Project Home: https://github.com/JimmXinu/FanFicFare/wiki
--- You received this message because you are subscribed to a topic in the Google Groups "FanFicFare -- Downloader for FanFiction" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fanfic-downloader/S82YD0LPOHU/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fanfic-downloa...@googlegroups.com.
Visit this group at https://groups.google.com/group/fanfic-downloader.
To view this discussion on the web visit https://groups.google.com/d/msgid/fanfic-downloader/f4fc4a3a-a939-2861-3597-0d684b8e9b90%40gmail.com.

For more options, visit https://groups.google.com/d/optout.

[Benjamin]

Here's a screencap of the XFCE task manager. It would seem that the GUI process is the one that leaks.

Le mar. 28 juin 2016 à 17:05, Jim Miller <retie...@gmail.com> a écrit :

I think 12G is pretty typical for a computer these days, but I agree, the program shouldn't need 9G. Are you crashing the background job, or the main calibre(GUI) process? Have you changed your appearance settings on Storiesonline.net? Attached is what settings are default (or were, at least) and are the settings FFF is expecting. Jim On 6/28/2016 5:03 AM, benjamin...@gmail.com wrote:

Well, I killed the program when it was using *9 Gio* of RAM looking for metadata. Most computers don't even *have* that much RAM. Just so you know, I have a free account on the website. I don't know how to run the program in the CLI but calibre's crash is already a problem, IMHO. Le mardi 28 juin 2016 01:26:52 UTC+2, Jimm a écrit : I am able to successfully download the example story given using the calibre plugin and CLI. (The web service has other restrictions--I don't recommend it unless you can't use the plugin or CLI). The calibre background job downloading it grows to >100M, but all of that memory is freed when the download finishes. I am testing on Windows 8, however. 100M seems excessive for a 551k word story, but we are talking about an interpreted language process. And 100M shouldn't be an issue by today's standards--my browser process regularly runs +1G. Do you know how much memory is used by the process before it fails for you?

--

[Jim Miller]

I assume the screencap is when it's failing with alternate website
settings. I expect it's caused by an infinite loop rather than a memory
leak as such.

As long as it works with default website settings, I consider it good
enough. FFF supports over 100 different sites, supporting multiple
different skins/settings for each site would be more work than it's worth.

Jim

On 6/28/2016 11:23 AM, Benjamin wrote:

> Changing the theme from modern to classic did the trick...

[Benjamin]

Yes it was with the wrong settings.

Maybe it would be a good idea to warn people that they better care about the skin settings of the website they want to download from.

What about a window at every installation / download from a new site / update ? Pick whatever you wish. Or not.

Thank you for your help, anyway.

--

Project Home: https://github.com/JimmXinu/FanFicFare/wiki --- You received this message because you are subscribed to a topic in the Google Groups "FanFicFare -- Downloader for FanFiction" group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/fanfic-downloader/S82YD0LPOHU/unsubscribe. To unsubscribe from this group and all its topics, send an email to fanfic-downloa...@googlegroups.com. Visit this group at https://groups.google.com/group/fanfic-downloader. To view this discussion on the web visit https://groups.google.com/d/msgid/fanfic-downloader/1244a204-85ed-44b1-9455-b6bd767df09e%40gmail.com. For more options, visit https://groups.google.com/d/optout.