Most attempts to access AO3 (with fanficfare 4.60.0) end with this
rather large error:
mitmanek:~ $ fanficfare -u "$(els of\ the\ Swan)"
Updating /home/matej/Knihy/fanfiction/femHarry/Harry Potter and the Body of the Swan-ao3_84939711.epub, URL:
https://archiveofourown.org/works/84939711
Traceback (most recent call last):
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/fetcher_requests.py", line 128, in request
resp.raise_for_status() # raises RequestsHTTPError if error code.
~~~~~~~~~~~~~~~~~~~~~^^
File "/home/matej/.local/lib/python3.13/site-packages/requests/models.py", line 1024, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 525 Server Error: <none> for url:
https://archiveofourown.org/works/84939711/navigate?view_adult=true
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/fanficfare", line 6, in <module>
sys.exit(main())
~~~~^^
File "/usr/lib/python3.13/site-packages/fanficfare/cli.py", line 347, in main
dispatch(options, urls, passed_defaultsini, passed_personalini, warn, fail)
~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/site-packages/fanficfare/cli.py", line 323, in dispatch
do_download(url,
~~~~~~~~~~~^^^^^
options,
^^^^^^^^
...<2 lines>...
warn,
^^^^^
fail)
^^^^^
File "/usr/lib/python3.13/site-packages/fanficfare/fff_profile.py", line 43, in profiled_func
return func(*args, **kwargs)
File "/usr/lib/python3.13/site-packages/fanficfare/cli.py", line 444, in do_download
adapter.getStoryMetadataOnly()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/site-packages/fanficfare/adapters/base_adapter.py", line 378, in getStoryMetadataOnly
self.doExtractChapterUrlsAndMetadata(get_cover=get_cover)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/site-packages/fanficfare/adapters/base_adapter.py", line 488, in doExtractChapterUrlsAndMetadata
return self.extractChapterUrlsAndMetadata()
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/site-packages/fanficfare/adapters/base_otw_adapter.py", line 200, in extractChapterUrlsAndMetadata
data = self.get_request(url)
File "/usr/lib/python3.13/site-packages/fanficfare/requestable.py", line 127, in get_request
return self.get_request_redirected(self.mod_url_request(url),
~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
referer=referer,
^^^^^^^^^^^^^^^^
usecache=usecache)[0]
^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/site-packages/fanficfare/requestable.py", line 117, in get_request_redirected
(data,rurl) = self.configuration.get_fetcher().get_request_redirected(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
self.mod_url_request(url),
^^^^^^^^^^^^^^^^^^^^^^^^^^
referer=referer,
^^^^^^^^^^^^^^^^
usecache=usecache)[:2]
^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/base_fetcher.py", line 139, in get_request_redirected
fetchresp = self.do_request('GET',
self.condition_url(url),
referer=referer,
usecache=usecache,
image=image)
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/decorators.py", line 71, in fetcher_do_request
fetchresp = chainfn(
method,
...<3 lines>...
usecache=usecache,
image=image)
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/cache_basic.py", line 123, in fetcher_do_request
fetchresp = chainfn(
method,
...<3 lines>...
usecache=usecache,
image=image)
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/decorators.py", line 107, in fetcher_do_request
fetchresp = chainfn(
method,
...<3 lines>...
usecache=usecache,
image=image)
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/base_fetcher.py", line 109, in do_request
fetchresp = self.request(method,url,
headers=headers,
parameters=parameters)
File "/usr/lib/python3.13/site-packages/fanficfare/fetchers/fetcher_requests.py", line 149, in request
raise exceptions.HTTPErrorFFF(
...<4 lines>...
)
fanficfare.exceptions.HTTPErrorFFF: HTTP Error in FFF '525 Server Error: <none> for url:
https://archiveofourown.org/works/84939711/navigate?view_adult=true'(525)
mitmanek:~ $
I wonder what's the problem. When we are doing basically the same what
a regular Internet Browser does, why `fanficfare` fails and my Firefox
doesn’t? If we are doing something different, what is different, and
what is missing?
Thank you for any thoughts on this,
Matěj
--
http://matej.ceplovi.cz/blog/, @mc...@en.osm.town
GPG Finger: 3C76 A027 CA45 AD70 98B5 BC1D 7920 5802 880B C9D8
Economics is the only discipline where two people can win a Nobel
Prize for saying exactly the opposite thing!
-- Eamonn Butler of Adam Smith Institute
on Nobel Prize awards for year 2001