Wattpad scraping

354 views
Skip to first unread message

de3sw2aq1

unread,
Dec 15, 2013, 6:10:03 AM12/15/13
to fanfic-d...@googlegroups.com
I implemented scaping of Wattpad and if anyone wishes to integrate it into fanfictiondownloader, they are welcome to:

It does use two different undocumented API calls, but it works great. No idea how stable the internal API is though. This completely avoids messy javascript issues though. It's just simple JSON.

I couldn't figure out whether you were interested in Wattpad from the supported sites list, due to copyright/ToS. Feel free to ignore this if so.

-- 
de3sw2aq1

botmtl

unread,
May 22, 2017, 4:03:06 AM5/22/17
to FanFicFare -- Downloader for FanFiction
4 years later, it's done!  I would not have done it without you doing such an excellent job at documenting the undocumented wattpad api calls. It was my first python script aside from hello world, and my impression about the language has stayed the same... I hate it.  fanficfare 2.12.0 has the new adapter if you want to try it out.

de3sw2aq1

unread,
Jun 1, 2017, 8:13:46 PM6/1/17
to FanFicFare -- Downloader for FanFiction
Awesome!

I've been doing a pretty poor job of maintaining wattpad-ebook-scraper. I never did get Unicode working right in my project, I assume this leverages FanFicFare and has no problems with it? After I test this I'll probably direct people to use the FanFicFare adapter from now on.

-- 
de3sw2aq1

Cherry Blossom

unread,
Jun 24, 2017, 2:51:45 AM6/24/17
to FanFicFare -- Downloader for FanFiction
Would it be possible to use wattpad user/pass to get privatized chapters?

botmtl

unread,
Jun 30, 2017, 12:24:29 AM6/30/17
to FanFicFare -- Downloader for FanFiction
I did not even know suck a thing existed.  Pull-request is welcomed as I don't have any information on privatized chapters.

botmtl

unread,
Jun 30, 2017, 12:26:11 AM6/30/17
to FanFicFare -- Downloader for FanFiction
I didn't have issues with unicode.  FFF uses python2.  Maybe wattpad fixed encoding problems at source?
Reply all
Reply to author
Forward
0 new messages