missing chapters on fanfiction.net

[hik...@gmail.com]

When I'm downloading fanfics from fanfiction I get all chapters except one missing. But when I update fanfics there are no missing chapters. Why is this happening.

[Pablo M]

Is the missing chapter the lasted? If so that's normal and has been happening for ever randomly. I don't know what causes it and can only guess that it may be that changes take some time to propagate across ffnet's servers.

[hik...@gmail.com]

The first chapter downloads rest are missing but updating there are no missing chapters it downloads the latest chapter.

[Jim Miller]

With only that level of detail, there isn't even anything for me to
investigate.

Please try this again with FFF (or Calibre) in debug mode and post the
debug log, or a link to the log.

[hik...@gmail.com]

I am using an older version of Calibre for windows vista so can't update.

Download 1 FanFiction Book(s)

FFF: INFO: 2021-09-14 10:31:33,723: calibre_plugins.fanficfare_plugin.jobs(49): CPUs:1

FFF: INFO: 2021-09-14 10:31:33,763: calibre_plugins.fanficfare_plugin.jobs(52): FanFicFare v4.5.0

FFF: INFO: 2021-09-14 10:31:33,766: calibre_plugins.fanficfare_plugin.jobs(69): Launch background process for site www.fanfiction.net:

https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:37:41,108: calibre_plugins.fanficfare_plugin.jobs(130):

================================================================================ site:(www.fanfiction.net)

DEPRECATION: The OpenSSL being used by this python install (OpenSSL 1.0.2q 20 Nov 2018) does not meet the minimum supported version (>= OpenSSL 1.1.1) in order to support TLS 1.3 required by Cloudflare, You may encounter an unexpected Captcha or cloudflare 1020 blocks.

FFF: INFO: 2021-09-14 10:31:56,760: calibre_plugins.fanficfare_plugin.jobs(211):

-------------------------------------------------------------------------------- https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:31:57,315: configurable.py(994): use_cloudscraper:true

FFF: DEBUG: 2021-09-14 10:31:57,319: configurable.py(1012): use_browser_cache:

FFF: DEBUG: 2021-09-14 10:31:57,322: configurable.py(1026): use_basic_cache:true

FFF: DEBUG: 2021-09-14 10:31:57,334: adapter_fanfictionnet.py(112): URL: https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:31:57,336: fetcher.py(234):

========== HIT (GET) BasicCache

https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:31:57,339: requestable.py(50): Encoding:utf8

FFF: DEBUG: 2021-09-14 10:32:00,869: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/u/9538723/TheDragonSaver

FFF: DEBUG: 2021-09-14 10:32:00,874: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/u/9538723/TheDragonSaver

FFF: DEBUG: 2021-09-14 10:32:00,875: fetcher.py(496): initializing cloudscraper

FFF: WARNING: 2021-09-14 10:32:33,805: adapter_fanfictionnet.py(343): Caught exception in skip_author_cover: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround..

FFF: INFO: 2021-09-14 10:32:35,134: calibre_plugins.fanficfare_plugin.jobs(311): write to C:\Users\kolby\AppData\Local\Temp\calibre_ihpnul\fanficfare_bu1db_\Saving the Disney Universe-TheDragonSaver-qd9gei.txt

FFF: INFO: 2021-09-14 10:32:35,144: base_writer.py(183): Save directly to file: C:\Users\kolby\AppData\Local\Temp\calibre_ihpnul\fanficfare_bu1db_\Saving the Disney Universe-TheDragonSaver-qd9gei.txt

FFF: DEBUG: 2021-09-14 10:32:35,161: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/1/

FFF: DEBUG: 2021-09-14 10:32:35,164: fetcher.py(234):

========== HIT (GET) BasicCache

https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:32:35,167: requestable.py(50): Encoding:utf8

FFF: DEBUG: 2021-09-14 10:32:39,122: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/2/

FFF: DEBUG: 2021-09-14 10:32:39,127: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/2/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:32:39,130: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/2/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:33:09,033: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/2/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:33:09,035: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:33:09,042: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/3/

FFF: DEBUG: 2021-09-14 10:33:09,046: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/3/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:33:09,048: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/3/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:33:39,043: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/3/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:33:39,043: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:33:39,052: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/4/

FFF: DEBUG: 2021-09-14 10:33:39,059: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/4/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:33:39,062: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/4/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:34:09,072: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/4/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:34:09,072: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:34:09,082: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/5/

FFF: DEBUG: 2021-09-14 10:34:09,084: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/5/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:34:09,088: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/5/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:34:39,410: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/5/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:34:39,410: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:34:39,418: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/6/

FFF: DEBUG: 2021-09-14 10:34:39,421: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/6/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:34:39,424: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/6/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:35:09,282: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/6/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:35:09,282: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:35:09,292: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/7/

FFF: DEBUG: 2021-09-14 10:35:09,295: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/7/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:35:09,296: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/7/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:35:39,332: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/7/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:35:39,334: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:35:39,345: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/8/

FFF: DEBUG: 2021-09-14 10:35:39,351: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/8/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:35:39,354: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/8/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:36:09,118: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/8/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:36:09,119: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:36:09,128: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/9/

FFF: DEBUG: 2021-09-14 10:36:09,131: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/9/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:36:09,132: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/9/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:36:38,799: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/9/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:36:38,799: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:36:38,809: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/10/

FFF: DEBUG: 2021-09-14 10:36:38,812: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/10/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:36:38,813: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/10/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:37:08,585: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/10/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:37:08,586: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:37:08,595: adapter_fanfictionnet.py(370): Getting chapter text from: https://www.fanfiction.net/s/13914753/11/

FFF: DEBUG: 2021-09-14 10:37:08,598: fetcher.py(234):

========== MISS (GET) BasicCache

https://www.fanfiction.net/s/13914753/11/Saving-the-Disney-Universe

FFF: DEBUG: 2021-09-14 10:37:08,599: fetcher.py(461):

---------- REQ (GET) RequestsFetcher

https://www.fanfiction.net/s/13914753/11/Saving-the-Disney-Universe

FFF: INFO: 2021-09-14 10:37:38,447: base_adapter.py(260): continue_on_chapter_error: (https://www.fanfiction.net/s/13914753/11/) cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: DEBUG: 2021-09-14 10:37:38,447: base_adapter.py(261): Traceback (most recent call last):

FailedToDownload: cloudscraper reports: (Detected a Cloudflare version 2 challenge, This feature is not available....)

See https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature for a possible workaround.

FFF: INFO: 2021-09-14 10:37:41,109: calibre_plugins.fanficfare_plugin.jobs(142):

Download Results:

Add https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe Download txt completed, 10 failed chapters, 11 total chapters.

FFF: INFO: 2021-09-14 10:37:41,109: calibre_plugins.fanficfare_plugin.jobs(166):

Add

https://www.fanfiction.net/s/13914753/1/Saving-the-Disney-Universe

[Jim Miller]

Looking at the log, you are not using the browser cache feature.

You're getting farther than most to get even the first page. Most users
are getting blocked by Cloudflare for all pages, all the time.

If you are are able to then run an update and get the missing chapters
directly, count yourself lucky--I don't know of any other user doing
even that well.

See:
https://github.com/JimmXinu/FanFicFare/issues/703
https://github.com/JimmXinu/FanFicFare/wiki/BrowserCacheFeature

[hik...@gmail.com]

which update do i use update always or update if newer

[Jim Miller]

On 9/14/2021 1:26 PM, hik...@gmail.com wrote:
> which update do i use update always or update if newer

??? You tell me.

Okay, I now believe I misinterpreted what you initially said:

> When I'm downloading fanfics from fanfiction I get all chapters except one missing. But when I update fanfics there are no missing chapters. Why is this happening.

I thought you meant as long as you were *updating*, you were able to
download many chapters.

Now, I assume you really meant the update worked when there was only
*one* new chapter because, for whatever reason, ffnet lets you get one
request through. Which is more than anybody else is getting.

[hik...@gmail.com]

Used update always and it grabbed the missing chapters.