ffn chapter errors

233 views
Skip to first unread message

Ben Smith

unread,
Jul 25, 2021, 5:33:23 PM7/25/21
to FanFicFare -- Downloader for FanFiction
I gave up on ffn a few months ago, is this a new problem? It's not obviously a cloudflare problem. 

the debug log.

FFF: DEBUG: 2021-07-25 17:30:23,477: adapter_fanfictionnet.py(370): Getting chapter text from: http://www.fanfiction.net/s/4
FFF: DEBUG: 2021-07-25 17:30:23,477: fetcher.py(234): 
========== MISS (GET) BasicCache
FFF: DEBUG: 2021-07-25 17:30:23,478: fetcher.py(461): 
---------- REQ (GET) RequestsFetcher
FFF: DEBUG: 2021-07-25 17:30:23,798: fetcher.py(467): response code:404
FFF: INFO: 2021-07-25 17:30:23,819: base_adapter.py(260): continue_on_chapter_error: (http://www.fanfiction.net/s/4) HTTP Error in FFF '404 Client Error: Not Found for url: https://www.fanfiction.net/s/4Little-Helper'(404) URL:'http://www.fanfiction.net/s/4Little-Helper'
FFF: DEBUG: 2021-07-25 17:30:23,826: base_adapter.py(261): Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 468, in request
    resp.raise_for_status() # raises RequestsHTTPError if error code.
  File "/usr/local/lib/python3.8/dist-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://www.fanfiction.net/s/4Little-Helper

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/adapters/base_adapter.py", line 240, in getStory
    data = self.getChapterTextNum(url,index)
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/adapters/base_adapter.py", line 419, in getChapterTextNum
    return self.getChapterText(url)
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/adapters/adapter_fanfictionnet.py", line 374, in getChapterText
    data = self.get_request(url+self.urltitle)
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/requestable.py", line 114, in get_request
    return self.get_request_redirected(url,
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/requestable.py", line 106, in get_request_redirected
    (data,rurl) = self.configuration.get_fetcher().get_request_redirected(
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 390, in get_request_redirected
    fetchresp = self.do_request('GET',
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 240, in fetcher_do_request
    fetchresp = chainfn(
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 136, in fetcher_do_request
    fetchresp = chainfn(
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 363, in do_request
    fetchresp = self.request(method,url,
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 531, in request
    return super(CloudScraperFetcher,self).request(method,url,headers,parameters)
  File "/usr/local/lib/python3.8/dist-packages/fanficfare/fetcher.py", line 479, in request
    raise exceptions.HTTPErrorFFF(
fanficfare.exceptions.HTTPErrorFFF: HTTP Error in FFF '404 Client Error: Not Found for url: https://www.fanfiction.net/s/4Little-Helper'(404) URL:'http://www.fanfiction.net/s/4Little-Helper'

FFF: INFO: 2021-07-25 17:30:23,833: writer_epub.py(360): Saving EPUB Version 2.0
FFF: DEBUG: 2021-07-25 17:30:23,992: cli.py(63): Successfully wrote '/home/ben/Desktop/Ben's Stuff/Fanfiction/Little Helper - 4.epub'
===================
!!!! 1 chapters errored downloading fanfiction.net/s/4 !!!!
===================
 

Jim Miller

unread,
Jul 25, 2021, 6:08:48 PM7/25/21
to fanfic-d...@googlegroups.com

FFF is expecting a full URL with chapter:

https://www.fanfiction.net/s/4/1/

Not sure when that changed, but 99% of the time it's going to be fine.
I'll look into it eventually.

If you're going to be trying to download all of ffnet again, please use
some other tool to do it. We're already having enough trouble with
ffnet downloads.

Serana Zentha

unread,
Oct 21, 2021, 10:03:32 PM10/21/21
to FanFicFare -- Downloader for FanFiction
I would like to send you a personal email regarding something off topic, is there a way I could do that? (Referring to the person who started the thread) would be much appreciated.

Ben Smith

unread,
Oct 21, 2021, 10:04:55 PM10/21/21
to fanfic-d...@googlegroups.com
Sure!

--
Project Home: https://github.com/JimmXinu/FanFicFare/wiki
---
You received this message because you are subscribed to a topic in the Google Groups "FanFicFare -- Downloader for FanFiction" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fanfic-downloader/VohntQ8uCY4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fanfic-downloa...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fanfic-downloader/6fc8c846-8fde-4f55-9de8-e787f03da3a9n%40googlegroups.com.

Marq FJA

unread,
Oct 25, 2021, 9:12:05 PM10/25/21
to FanFicFare -- Downloader for FanFiction
I've been using the browser cache option without incident ever since FF.net apparently permanently raised the site's Cloudflare security level, but today I've run into an error when I tried to download several stories from it.


Error message: "Browser Cache Failed to Load with error '[WinError 2] The system cannot find the file specified: 'C:\\Users\\marq_\\AppData\\Local\\Google\\Chrome\\User Data\\Profile 3\\Cache\\data_203"

Having tracked down the above folder (don't know why it duplicated the backslashes), I found that there's no file by that name... but I did find files titled "data_0", "data_1",  "data_2", and  "data_3". Hopefully this information proves helpful.

Jim Miller

unread,
Oct 25, 2021, 9:24:34 PM10/25/21
to fanfic-d...@googlegroups.com

FFF couldn't find the file in the cache, and you've confirmed that it
isn't there. That suggests that the cache index points to file(s) which
aren't there.

I don't know of anything FFF can do about that. I would clear the
browser cache and try again.

Unfortunately, we've had users with cache issues that I have not be able
to replicate or correct.

Marq FJA

unread,
Oct 25, 2021, 9:27:20 PM10/25/21
to FanFicFare -- Downloader for FanFiction
Would clearing out just "cached images and files" do it? I'd rather not lose all the cookies that I have active across many sites, especially logins.

Jim Miller

unread,
Oct 25, 2021, 9:34:54 PM10/25/21
to fanfic-d...@googlegroups.com

It should, yes.

Marq FJA

unread,
Oct 25, 2021, 9:39:38 PM10/25/21
to FanFicFare -- Downloader for FanFiction
Tried it. Didn't work, but now the error says "Browser Cache Failed to Load with error ''Uninitialized Address'".

Jim Miller

unread,
Oct 25, 2021, 10:36:43 PM10/25/21
to fanfic-d...@googlegroups.com

That error suggests there's nothing in the cache.

Did you load all the chapters in the browser again? When you've cleared
the cache, you have to view the pages again.

Marq FJA

unread,
Oct 26, 2021, 12:01:47 AM10/26/21
to FanFicFare -- Downloader for FanFiction
Yes, I did. And the story had been uploaded for 13 hours before I made my first attempt, FYI. Usually it just takes waiting for 1-2 hours to pass since upload for the browser cache method to properly work with FFF.

hik...@gmail.com

unread,
Oct 26, 2021, 8:39:51 AM10/26/21
to FanFicFare -- Downloader for FanFiction
Hi am trying to update fanfic story here is error I am getting not sure what doing wrong

Download 1 FanFiction Book(s)
FFF: INFO: 2021-10-26 08:32:57,414: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:1
FFF: INFO: 2021-10-26 08:32:57,426: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.6.0
FFF: INFO: 2021-10-26 08:32:57,426: calibre_plugins.fanficfare_plugin.jobs(69): Launch background process for site www.fanfiction.net:
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker
FFF: INFO: 2021-10-26 08:36:56,986: calibre_plugins.fanficfare_plugin.jobs(130):

================================================================================ site:(www.fanfiction.net)
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2q  20 Nov 2018) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
FFF: INFO: 2021-10-26 08:33:05,194: calibre_plugins.fanficfare_plugin.jobs(211):

-------------------------------------------------------------------------------- https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker
FFF: DEBUG: 2021-10-26 08:33:05,397: configurable.py(1067): 1configuration.get_browser_cache:None
FFF: DEBUG: 2021-10-26 08:33:05,407: configurable.py(1005): use_cloudscraper:true
FFF: DEBUG: 2021-10-26 08:33:05,410: configurable.py(1023): use_browser_cache:true
FFF: DEBUG: 2021-10-26 08:33:05,414: configurable.py(1025): browser_cache_path:C:\Users\kolbyg\AppData\Local\Mozilla\Firefox\Profiles\26rn9ggz.default\cache2
FFF: DEBUG: 2021-10-26 08:33:05,697: firefoxcache2.py(50): Using FirefoxCache2
FFF: DEBUG: 2021-10-26 08:33:05,700: configurable.py(1037): use_basic_cache:true
FFF: DEBUG: 2021-10-26 08:33:05,703: configurable.py(1071): 2configuration.get_browser_cache:<fanficfare.browsercache.BrowserCache object at 0x04376DF0>
FFF: DEBUG: 2021-10-26 08:33:05,706: adapter_fanfictionnet.py(112): URL: https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker
FFF: DEBUG: 2021-10-26 08:33:05,743: fetcher.py(234):
========== MISS (GET) BasicCache
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker
FFF: DEBUG: 2021-10-26 08:33:05,743: basebrowsercache.py(119): do_map_cache_keys()
FFF: DEBUG: 2021-10-26 08:33:05,743: firefoxcache2.py(85): using listdir
FFF: DEBUG: 2021-10-26 08:36:55,403: firefoxcache2.py(89): Read 9450 entries
FFF: DEBUG: 2021-10-26 08:36:55,404: basebrowsercache.py(122): Cached 241 entries
FFF: DEBUG: 2021-10-26 08:36:55,405: basebrowsercache.py(55): do_cprofile time:229.661999941
FFF: DEBUG: 2021-10-26 08:36:55,407: fetcher.py(273):
========== HIT (GET) BrowserCache
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(50): Encoding:utf8
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(71): code failed:utf8
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(72): 'utf8' codec can't decode byte 0xf3 in position 5: invalid continuation byte
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(50): Encoding:Windows-1252
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(71): code failed:Windows-1252
FFF: DEBUG: 2021-10-26 08:36:55,411: requestable.py(72): 'charmap' codec can't decode byte 0x8f in position 129: character maps to <undefined>
FFF: DEBUG: 2021-10-26 08:36:55,414: requestable.py(50): Encoding:iso-8859-1
FFF: INFO: 2021-10-26 08:36:56,535: calibre_plugins.fanficfare_plugin.jobs(439): Exception: {u'uniqueurl': u'https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker[None-None]', u'publisher': u'www.fanfiction.net', u'calibre_id': 8, u'listorder': 0, u'username': 'NoneGiven', u'series': u'', u'good': False, u'comment': u"'NoneType' object has no attribute '__getitem__'", u'added': False, u'comments': u'', u'collision': u'Update EPUB if New Chapters', u'site': 'www.fanfiction.net', u'begin': None, u'outfile': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_8xdqax\\fanficfare_l1tcoz\\bgmeta-yo3aat.epub', u'icon': u'dialog_error.png', u'status': u'Error', u'calibre_columns': {}, u'epub_for_update': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_8xdqax\\fanficfare_l1tcoz\\old-8-aephgc.epub', u'pubdate': None, u'is_adult': False, u'author_sort': u'Metalbrony823', u'end': None, u'author': [u'Metalbrony823'], u'url': u'https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker', u'password': '', u'showerror': True, u'title': u'Loona the Caretaker'}:'NoneType' object has no attribute '__getitem__'

Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.jobs", line 260, in do_download_for_worker
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 308, in getStoryMetadataOnly
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\adapter_fanfictionnet.py", line 130, in doExtractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'

FFF: INFO: 2021-10-26 08:36:56,987: calibre_plugins.fanficfare_plugin.jobs(142):
Download Results:
Error https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker 'NoneType' object has no attribute '__getitem__'

FFF: INFO: 2021-10-26 08:36:56,989: calibre_plugins.fanficfare_plugin.jobs(166):
Error
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker

Jim Miller

unread,
Oct 26, 2021, 11:00:35 AM10/26/21
to fanfic-d...@googlegroups.com

hik...@gmail.com: It looks like the cached file isn't encoded properly
or something. I suggest clearing your browser cache and retrying.

The cache errors we've been seeing suggest that our implementations of
cache reading may be flawed or incomplete.

We support 3 different cache types, 2 for chrome and 1 for firefox.
Marq FJA's problem appears to be with the Chrome blockfile cache type,
while hik...@gmail.com is using firefox.

Unfortunately, without having the errors happen to me, it verges on
impossible for me to figure these out.

If you consistently have problems reading browser cache, you might try
using FFDL to cache instead:

https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature#fanfictiondownloader

Or try one of the proxy solutions:

Flaresolverr:
https://github.com/JimmXinu/FanFicFare/issues/703#issuecomment-921160702
Note, use Flaresolverr v1.2.9, not v2.0
https://github.com/FlareSolverr/FlareSolverr/releases/tag/v1.2.9

nsapa_proxy:
https://github.com/nsapa/fanfictionnet_ff_proxy


On 10/26/2021 7:39 AM, hik...@gmail.com wrote:
> Hi am trying to update fanfic story here is error I am getting not sure
> what doing wrong


hik...@gmail.com

unread,
Oct 26, 2021, 11:23:40 AM10/26/21
to FanFicFare -- Downloader for FanFiction
after clearing the cache and deleting the fanfic  now I'm getting this error

Status
Title
Author
Comment
URL
Error
Unknown
Unknown
[Errno 22] Invalid argument
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker

hik...@gmail.com

unread,
Oct 26, 2021, 11:38:16 AM10/26/21
to FanFicFare -- Downloader for FanFiction
every fanfiction.net story is doing the same thing i even clicked on each chapter and if story has cover art same issue

hik...@gmail.com

unread,
Oct 26, 2021, 11:40:18 AM10/26/21
to FanFicFare -- Downloader for FanFiction
I think its because they just updated the cloudfare today but not sure.

Jim Miller

unread,
Oct 26, 2021, 11:55:50 AM10/26/21
to fanfic-d...@googlegroups.com

With nothing to work with but "[Errno 22] Invalid argument", all I can
do is google "Errno 22". What comes up is invalid characters in file
name when opening a file.

That suggests either you entered the cache path setting wrong, or the
cache itself has 'bad' characters in file names internally?

That's all I can tell you without at least a debug log.

On 10/26/2021 10:40 AM, hik...@gmail.com wrote:
> after clearing the cache and deleting the fanfic  now I'm getting this error
> [Errno 22] Invalid argument

hik...@gmail.com

unread,
Oct 26, 2021, 12:07:16 PM10/26/21
to FanFicFare -- Downloader for FanFiction
I am trying to download the fanfic and it says none of the urls can be downloaded

Status
Title
Author
Comment
URL
Error
Unknown
Unknown
[Errno 22] Invalid argument
https://www.fanfiction.net/s/13801872/1/Loona-the-Caretaker


hik...@gmail.com

unread,
Oct 26, 2021, 12:10:19 PM10/26/21
to FanFicFare -- Downloader for FanFiction
here is what i have the personal.ini set as

## windows:

#Firefox

browser_cache_path:C:\Users\kolbyg\AppData\Local\Mozilla\Firefox\Profiles\26rn9ggz.default\cache2

browser_cache_age_limit:-1

[www.fanfiction.net]


## browser cache will only be used if use_browser_cache:true and ONLY

## for fanfiction.net right now. Requires a browser_cache_path set in

## [defaults].

use_browser_cache:true


## use_browser_cache_only:true prevents FFF from falling through to

## request from the server when a page isn't in the browser cache.

## You can turn this on to be sure you're only using the browser

## cache.

#use_browser_cache_only:false


## Pre-existing ffnet INI settings you might want to think about

## changing with use_browser_cache:


## If you want covers to work correctly with use_browser_cache, you'll

## need to click the cover image at least once for each story. Or

## turn cover off.

never_make_cover:true


## If you want skip_author_cover to work correctly with

## use_browser_cache, you'll need to click the author page at least

## once for each story. Or turn skip_author_cover off.

##

## From defaults.ini:

## April 2015, ffnet changed their story and user pictures urls to be

## the same. Now the only way to know if the story image is really

## the author image is to go get the author image and check.

skip_author_cover:false


## If you turned this on before, you probably want it off while using

## browser cache.

##

## From defaults.ini:

## ffnet used to have a tendency to send out update notices in email

## before all their servers were showing the update on the first

## chapter. It generates another server request and doesn't seem to

## be needed lately, so now default it to off.

check_next_chapter:false

hik...@gmail.com

unread,
Oct 26, 2021, 2:58:43 PM10/26/21
to FanFicFare -- Downloader for FanFiction
I'm still having trouble. I tried using FanficDownloader with this but no luck.

Jim Miller

unread,
Oct 26, 2021, 4:55:43 PM10/26/21
to fanfic-d...@googlegroups.com

You've posted 4 times since I said:

> That's all I can tell you without at least a debug log.

There are also reports from other users that ffnet may have raised
cloudflare to a higher level--I'm seeing it in browser, too.

So it may not be something that can be fixed.

night stitcher

unread,
Oct 26, 2021, 11:17:44 PM10/26/21
to FanFicFare -- Downloader for FanFiction
This is what I'm getting now (using FlareSolver 1.2.9). This just started last night and seems to apply to only some of the fics on the site. The one below (and a few others) gave this type of error message, while one I tried right after went through just fine. I could try going back to using FFD if this persists, which suggests an enhancement request:

Currently to switch among cache methods you have to manually edit the personal.ini each time you need to switch. I keep the unused lines commented out so it's not too hard to make the switch, but it would be even easier if there were options available on the download from URLs and/or Update Fic and/or Customize FanFicFare dialogs to pick from whatever options were currently listed in a user's personal.ini. I imagine that some different syntax would be needed in the ini to list some of the settings as available to set at runtime or via config.

Status

Title

Author

Comment

URL

Error

A P&P Christmas Carol

sysa22

HTTP Error in FFF '500 Server Error: Internal Server Error for url: http://localhost:8191/v1'(500)

https://www.fanfiction.net/s/13946832/1/A-P-P-Christmas-Carol

hik...@gmail.com

unread,
Nov 2, 2021, 5:32:59 PM11/2/21
to FanFicFare -- Downloader for FanFiction
I just tried updating my fanfic using browser cache and here is the log entry since it failed to update

Download 1 FanFiction Book(s)
FFF: INFO: 2021-11-02 17:26:25,694: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:1
FFF: INFO: 2021-11-02 17:26:25,706: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.6.8
FFF: INFO: 2021-11-02 17:26:25,707: calibre_plugins.fanficfare_plugin.jobs(69): Launch background process for site www.fanfiction.net:
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: INFO: 2021-11-02 17:30:05,269: calibre_plugins.fanficfare_plugin.jobs(130):

================================================================================ site:(www.fanfiction.net)
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2q  20 Nov 2018) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
FFF: INFO: 2021-11-02 17:26:33,523: calibre_plugins.fanficfare_plugin.jobs(211):

-------------------------------------------------------------------------------- https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: DEBUG: 2021-11-02 17:26:33,729: configurable.py(1070): 1configuration.get_browser_cache:None
FFF: DEBUG: 2021-11-02 17:26:33,736: configurable.py(1008): use_cloudscraper:true
FFF: DEBUG: 2021-11-02 17:26:33,740: configurable.py(1026): use_browser_cache:true
FFF: DEBUG: 2021-11-02 17:26:33,744: configurable.py(1028): browser_cache_path:C:\Users\kolbyg\AppData\Local\Mozilla\Firefox\Profiles\26rn9ggz.default\cache2
FFF: DEBUG: 2021-11-02 17:26:33,993: firefoxcache2.py(50): Using FirefoxCache2
FFF: DEBUG: 2021-11-02 17:26:33,996: configurable.py(1040): use_basic_cache:true
FFF: DEBUG: 2021-11-02 17:26:34,000: configurable.py(1074): 2configuration.get_browser_cache:<fanficfare.browsercache.BrowserCache object at 0x043FE630>
FFF: DEBUG: 2021-11-02 17:26:34,002: adapter_fanfictionnet.py(112): URL: https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: DEBUG: 2021-11-02 17:26:34,006: fetcher.py(234):
========== MISS (GET) BasicCache
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: DEBUG: 2021-11-02 17:26:34,006: basebrowsercache.py(119): do_map_cache_keys()
FFF: DEBUG: 2021-11-02 17:26:34,006: firefoxcache2.py(85): using listdir
FFF: DEBUG: 2021-11-02 17:30:04,016: firefoxcache2.py(89): Read 11085 entries
FFF: DEBUG: 2021-11-02 17:30:04,017: basebrowsercache.py(122): Cached 233 entries
FFF: DEBUG: 2021-11-02 17:30:04,017: basebrowsercache.py(55): do_cprofile time:210.010999918
FFF: DEBUG: 2021-11-02 17:30:04,022: fetcher.py(273):
========== HIT (GET) BrowserCache
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: DEBUG: 2021-11-02 17:30:04,023: requestable.py(50): Encoding:utf8
FFF: DEBUG: 2021-11-02 17:30:04,025: requestable.py(71): code failed:utf8
FFF: DEBUG: 2021-11-02 17:30:04,025: requestable.py(72): 'utf8' codec can't decode byte 0xe4 in position 4: invalid continuation byte
FFF: DEBUG: 2021-11-02 17:30:04,026: requestable.py(50): Encoding:Windows-1252
FFF: DEBUG: 2021-11-02 17:30:04,026: requestable.py(71): code failed:Windows-1252
FFF: DEBUG: 2021-11-02 17:30:04,026: requestable.py(72): 'charmap' codec can't decode byte 0x90 in position 79: character maps to <undefined>
FFF: DEBUG: 2021-11-02 17:30:04,026: requestable.py(50): Encoding:iso-8859-1
FFF: INFO: 2021-11-02 17:30:05,026: calibre_plugins.fanficfare_plugin.jobs(439): Exception: {u'series': u'', u'password': '', u'title': u'Helluva Boss: The New Employee', u'showerror': True, u'collision': u'Update EPUB if New Chapters', u'status': u'Error', u'publisher': u'www.fanfiction.net', u'begin': None, u'is_adult': False, u'outfile': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_c_yrms\\fanficfare_ega1hy\\bgmeta-ratgfq.epub', u'uniqueurl': u'https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee[None-None]', u'calibre_columns': {}, u'good': False, u'listorder': 0, u'pubdate': None, u'epub_for_update': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_c_yrms\\fanficfare_ega1hy\\old-97-rw9csa.epub', u'username': 'NoneGiven', u'icon': u'dialog_error.png', u'url': u'https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee', u'author_sort': u'sweets, Pinkie pie', u'end': None, u'author': [u'Pinkie pie sweets'], u'calibre_id': 97, u'site': 'www.fanfiction.net', u'comments': u'', u'comment': u"'NoneType' object has no attribute '__getitem__'", u'added': False}:'NoneType' object has no attribute '__getitem__'

Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.jobs", line 260, in do_download_for_worker
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\base_adapter.py", line 308, in getStoryMetadataOnly
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\adapters\adapter_fanfictionnet.py", line 130, in doExtractChapterUrlsAndMetadata
TypeError: 'NoneType' object has no attribute '__getitem__'

FFF: INFO: 2021-11-02 17:30:05,270: calibre_plugins.fanficfare_plugin.jobs(142):
Download Results:
Error https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee 'NoneType' object has no attribute '__getitem__'

FFF: INFO: 2021-11-02 17:30:05,272: calibre_plugins.fanficfare_plugin.jobs(166):
Error
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee

night stitcher

unread,
Nov 3, 2021, 2:46:56 AM11/3/21
to FanFicFare -- Downloader for FanFiction
What I've been doing lately is using FFD. From time to time, it will hang, and if you close enough windows you'll see a Captcha demand in a mini-popup (or popunder) window. I deal with that, and the FFD download proceeds. Once FFD finishes, everything needed is in the cache and I can proceed to download with FFF.

hik...@gmail.com

unread,
Nov 3, 2021, 10:41:16 AM11/3/21
to FanFicFare -- Downloader for FanFiction

I cant install FFD on my pc so I can't use that workaround.

hik...@gmail.com

unread,
Nov 3, 2021, 10:54:03 AM11/3/21
to FanFicFare -- Downloader for FanFiction
I tried clearingf my browser Download 1 FanFiction Book(s)
FFF: INFO: 2021-11-03 10:47:53,717: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:1
FFF: INFO: 2021-11-03 10:47:53,733: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.6.8
FFF: INFO: 2021-11-03 10:47:53,733: calibre_plugins.fanficfare_plugin.jobs(69): Launch background process for site www.fanfiction.net:
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: INFO: 2021-11-03 10:48:22,520: calibre_plugins.fanficfare_plugin.jobs(130):

================================================================================ site:(www.fanfiction.net)
DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2q  20 Nov 2018) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.
FFF: INFO: 2021-11-03 10:48:18,803: calibre_plugins.fanficfare_plugin.jobs(211):

-------------------------------------------------------------------------------- https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee
FFF: DEBUG: 2021-11-03 10:48:19,838: configurable.py(1070): 1configuration.get_browser_cache:None
FFF: DEBUG: 2021-11-03 10:48:19,848: configurable.py(1008): use_cloudscraper:true
FFF: DEBUG: 2021-11-03 10:48:20,003: configurable.py(1026): use_browser_cache:true
FFF: DEBUG: 2021-11-03 10:48:20,010: configurable.py(1028): browser_cache_path:C:\Users\kolbyg\AppData\Local\Mozilla\Firefox\Profiles\26rn9ggz.default\cache2
FFF: WARNING: 2021-11-03 10:48:20,713: configurable.py(1037): Failed to setup BrowserCache([Errno 22] Invalid argument)
FFF: INFO: 2021-11-03 10:48:20,713: calibre_plugins.fanficfare_plugin.jobs(439): Exception: {u'status': u'Error', u'end': None, u'author': [u'Pinkie pie sweets'], u'epub_for_update': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_6cm4yx\\fanficfare_ewqhnj\\old-97-bfno5d.epub', u'title': u'Helluva Boss: The New Employee', u'uniqueurl': u'https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee[None-None]', u'is_adult': False, u'calibre_id': 97, u'collision': u'Update EPUB if New Chapters', u'listorder': 0, u'comments': u'', u'outfile': u'C:\\Users\\kolbyg\\AppData\\Local\\Temp\\calibre_6cm4yx\\fanficfare_ewqhnj\\bgmeta-cuuml4.epub', u'begin': None, u'good': False, u'pubdate': None, u'comment': u'[Errno 22] Invalid argument', u'url': u'https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee', u'username': 'NoneGiven', u'calibre_columns': {}, u'series': u'', u'password': '', u'site': 'www.fanfiction.net', u'publisher': u'www.fanfiction.net', u'added': False, u'showerror': True, u'author_sort': u'sweets, Pinkie pie', u'icon': u'dialog_error.png'}:[Errno 22] Invalid argument

Traceback (most recent call last):
  File "calibre_plugins.fanficfare_plugin.jobs", line 246, in do_download_for_worker
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\configurable.py", line 1073, in get_browser_cache
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\configurable.py", line 1034, in get_fetcher
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\browsercache\__init__.py", line 20, in __init__
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\browsercache\basebrowsercache.py", line 98, in new_browser_cache
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\browsercache\firefoxcache2.py", line 62, in is_cache_dir
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\browsercache\firefoxcache2.py", line 133, in _validate_entry_file
  File "C:\Users\kolbyg\AppData\Roaming\calibre\plugins\FanFicFare.zip\fanficfare\browsercache\firefoxcache2.py", line 154, in _read_entry_headers
IOError: [Errno 22] Invalid argument

FFF: INFO: 2021-11-03 10:48:22,522: calibre_plugins.fanficfare_plugin.jobs(142):
Download Results:
Error https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee [Errno 22] Invalid argument

FFF: INFO: 2021-11-03 10:48:22,522: calibre_plugins.fanficfare_plugin.jobs(166):
Error
https://www.fanfiction.net/s/13930526/1/Helluva-Boss-The-New-Employee

cache and enable use browser cache only and here is error I got

Marq FJA

unread,
Nov 4, 2021, 4:53:28 PM11/4/21
to FanFicFare -- Downloader for FanFiction
I don't know if it's the new update to this plugin, if FF.net had de-escalated its Cloudflare security level or if the problem was on my end and had somehow ceased to be without me being aware of it, but the WebToEpub method is working again.

night stitcher

unread,
Nov 4, 2021, 9:56:48 PM11/4/21
to FanFicFare -- Downloader for FanFiction
My guess is they de-escalated. I've been using FFD lately, and the past couple of nights my downloads haven't been interrupted to solve captchas. Maybe I'll try switching flaresolvrr back in to see that happens. I'm a bit unclear whether I should be updating flaresolvrr from 1.29 to 2 and update the plugin. I think the plugin update announcement said FFF will now work with flaresolvrr 2.whatever, but some images may not come in? Most of the fics I download don't have images, but you never know - many have covers, which are nice, but not essential. I'm not sure what the benefit of updating flaresolvrr would be. Maybe there's a post somewhere that clarifies?
Reply all
Reply to author
Forward
0 new messages