My take on the sites on the Supported Sites list on github. (plus some not on there)
59 views
Skip to first unread message
Gwydion Comyn
Dec 16, 2016, 4:32:14 AM12/16/16
to FanFicFare -- Downloader for FanFiction
On Thursday, December 15, 2016 at 8:22:55 AM UTC-7, Jimm wrote:
There's also a list here:
https://github.com/JimmXinu/FanFicFare/wiki/SupportedSites#sites-under-consideration
-------
Ok... I looked through this list, and here are some of my observations....
I'm going to go by sections from the Supported Sites page, and give notes about each site listed.
I'm going to skip the supported sites, and the removed sites, for obvious reasons.
*Sites under consideration
www.asianfanfics.com
It's doable, but will take some work.
www.fanfic-fr.net
It looks doable. I visited the site using google translation, because, unfortunately, I don't read French. That would make it very hard to do.
rockfic.com
Is doable... the site requires a login to get to the stories, and it has alot of metadata... it would take some work, but it can be done.
sebklaine.net
An efiction site.... already created, but not submitted yet.
firefly.populli.org
An archive site. Already created, but not submitted yet.
*Possible, but more difficult than usual
www.thecircuitarchive.com
Doable. Looks to be like the firefly.populli.org site, so can be done.
www.seventh-dimension.org
No Longer available on the web. I get a 404 error for this site.
www.ateamfanfic.org/
Given the story url, there is basically no way to get any metadata for it. The only link I saw on the story pages was back to the story, a link to send a comment
and to "home". I'd deem this one unsupportable.
www.academyofbards.org/
This looks like a website of html pages. There is no story system, very inconsistent metadata.
www.shahrazad.net/%7Esgnovels/
No Longer available on the web. I get a 404 error for this site.
www.xenafiction.net/
This site is very confusing... some stories have a story system view, some don't. Some have a link to the author's page, some only have a link to the index page...
Very hard to parse the information we want for FFF
spanderfiles.com
Very little metadata. We can get Title, author, category, summary and chapter text... there is no date information that I can find either viewable, or in the html.
www.wolverineandrogue.com/fic/
www.wolverineandrogue.com/wrfa/
On the Supported Sites page, these are listed backwards... the /fic/ site is the old one, and the /wrfa/ site is the one that is supported...
Given that, and if we can get passed the fact that they have the same Domain Name, the /fic/ site has very minimal metadata available... Rating, Genre, Archived Date.
The Summary and any notes that the author puts on the story are not blocked into html tags for easy retrieval, so would be problematic...
chromeandgunmetal.com/chrome
This site is much like the Firefly's Glow Archive (fireflypopulli.org), so it is possible, but there is no date information available to visitors.
Some metadata available, Title, author, pairings, rating, category, summary. that is all.
www.sofurry.com/
It's doable... The metadata that I can see are Title, author, Posting date, series (and number), tags, and summary.
There is a link to download an epub of the story.
trickyraven.ning.com
No Longer available on the web. I get a 404 error for this site.
avia.silverbloom.net/mirror
No Longer available on the web. I get a 404 error for this site.
bigclosetr.us/topshelf
This looks like a forum site for stories. There is metadata that can be gotten, so it is doable.
It's a 1 page/1 story type site... there are no specific links to other chapters of the same story that I can see that can be systematically retreived.
wolfpub.org
They have their own download system. It looks like it might be possible, depending on the permissions required.
www.bdsmlibrary.com/
Already suupported
www.t-s-s-a.com/
This is a website of text files.
*Insufficient interest/updates
mvsfiction.com
Very small selection of stories (8), and hasn't been updated in a few years (the In Progress shows an updated in 2014, but you can't get to it.)
This looks like it is a 1 author site, where he is the only one that posts, but others can read them.
fanficauthors.net
Already created, but not submitted.
priscellie.com
Is now a wordpress Blogstyle site. I couldn't find any stories to download.
labyrinth.retrogression.org
redirects to www.13hours.org/fanfiction/ called Underground, a Labyrinth Fanfiction Archive, it has 190 stories, Last updated in October, 2016.
Looks to be a modified eFiction site, so it is doable.
shriftweb.org/leviathan
Another site like firefly.populli.org, so it is doable.
hugosnebula.com/sgxover
No longer a story site. I couldn't find any stories to download.
ericnorthman.net/fanfic
Only 452 stories (down from the 487 that is listed on the page). Another modified eFiction site, so is doable.
bigblock.westwingstories.com
per the website:
The archive was last updated in May 2005, and will not be updated again. The National Library is taking over this site as of August 21, 2005. All completed stories will be added to The National Library. New submissions will be added to The National Library. See the Submit Story page for full guidelines on adding a story to the TNL site and search engine.
and The National Library is already suupported.
and as to the stories that are already there, it seems to be a website of html pages. No story system to be seen.
adifferentforest.net
This looks like a blog site, and the fanfiction section requires a login, which I didn't want to do right now.
ficsite.com
already supported
www.digital-quill.org/
According to the website, "Digital Quill is offline for the foreseeable future."
fanfiction.lucifael.com
already supported
snarry.net
an efiction site, and it looks like the story system works, but the stories are not reachable.
hermione.magical-worlds.us
No Longer available on the web (404 error)
*Sites not supported
LiveJournal
I have looked at this, but as was stated on the page, it's very inconsistent and there are other programs that handle it already.
*Other Sites Not Likely to be Supported
gayauthors.org
Since the site admins requested we remove support, I'm not going to look at it.
www.dwiggie.com
It looks like there are 2 different types of stories here... one is an archive, which has very minimal metadata, and a forum type site, where new chapters are posted.
The forum site also has minimum metadata (title, author and posted date), and I would only be able to download the chapter that is requested from the url.
I can't see a way to systematially retrieve the other chapters of the story (if there are any).
www.shifti.org/
As was stated on the page, it is a wiki site, so 1 story/1 page. I can be done if enough people want it,
www.nifty.org/
A website of text files.
inkstain.inkquill.net
Moved to archiveofourown at archiveofourown.org/collections/InkStainedFingers. The stories are no longer available at this url.
triptpolers.houseoftucker.com
As was said, it's a website of html documents. There is a way to put the multiple chapters together, but there is almost no metadata.
www.ellenceleste.com/MissionImp/index.html
No longer available on the web (404 error)
www.ralst.com/
as stated, no metadata, and 1 page/1 story.
forums.naughty-seduction.net
as stated, a forum site with no metadata. it _might_ be possible to get all posts by the original author, but I'm not sure I want to work o it at this time.
www.peephut.org/fics.html
A One author site that you can't tell when was last updated. No metadata to retrieve, either.
www.witchfics.org
No Longer available
wattpad.com
Javascript. *blegh*
www.obscurusbooks.org
can't get to it... redirections all over the place.
www.asstr.org/~Kristen/
a website of text files. No metadata to be collected
dracobigbang.accio.nu
Looks to be an archive of livejournal posted stories...
perusingtheshelves.com
As stated, forum site....
www.852prospect.org/archive/
ignoring, since it's already moved.
www.masterapprentice.org/html/archive.html
ignoring, since it's already moved.
fluky.gossamer.org
website of html/text files. No story system.
ephemeralfic.org
as stated. web site of text files, not html. Archive of a mail list.
theheartofcamelot.com
redirects to whimsicalwanderings.net/, which is already supported.
*Sites not listed on the Supported Sites page:
www.faramirfiction.com
can be done. It was requested in the google groups, so I may work on it. Last updated In November, 2016
www.ultimatehpfanfiction.com
it's possible. It is a archive for other sites. There is no timestamps for the stories, so there is no way to tell when it was published or updated.
unknowableroom.org
News last updated in April, 2012. Stories last updated September, 2015. The metadata is very hard to parse, since it is all within 1 tag.
www.nickandgreg.net/desert_archive/index.php
Stories Last updated October, 2015. Metadata is available. Can be done if enough people want it, or I'm bored enough.
Well... that's my take on the sites on the list. When I next get bored, I'll look through here, and decide which one I want to do, if I want a project.
GComyn
There's also a list here:
https://github.com/JimmXinu/FanFicFare/wiki/SupportedSites#sites-under-consideration
-------
Ok... I looked through this list, and here are some of my observations....
I'm going to go by sections from the Supported Sites page, and give notes about each site listed.
I'm going to skip the supported sites, and the removed sites, for obvious reasons.
*Sites under consideration
www.asianfanfics.com
It's doable, but will take some work.
www.fanfic-fr.net
It looks doable. I visited the site using google translation, because, unfortunately, I don't read French. That would make it very hard to do.
rockfic.com
Is doable... the site requires a login to get to the stories, and it has alot of metadata... it would take some work, but it can be done.
sebklaine.net
An efiction site.... already created, but not submitted yet.
firefly.populli.org
An archive site. Already created, but not submitted yet.
*Possible, but more difficult than usual
www.thecircuitarchive.com
Doable. Looks to be like the firefly.populli.org site, so can be done.
www.seventh-dimension.org
No Longer available on the web. I get a 404 error for this site.
www.ateamfanfic.org/
Given the story url, there is basically no way to get any metadata for it. The only link I saw on the story pages was back to the story, a link to send a comment
and to "home". I'd deem this one unsupportable.
www.academyofbards.org/
This looks like a website of html pages. There is no story system, very inconsistent metadata.
www.shahrazad.net/%7Esgnovels/
No Longer available on the web. I get a 404 error for this site.
www.xenafiction.net/
This site is very confusing... some stories have a story system view, some don't. Some have a link to the author's page, some only have a link to the index page...
Very hard to parse the information we want for FFF
spanderfiles.com
Very little metadata. We can get Title, author, category, summary and chapter text... there is no date information that I can find either viewable, or in the html.
www.wolverineandrogue.com/fic/
www.wolverineandrogue.com/wrfa/
On the Supported Sites page, these are listed backwards... the /fic/ site is the old one, and the /wrfa/ site is the one that is supported...
Given that, and if we can get passed the fact that they have the same Domain Name, the /fic/ site has very minimal metadata available... Rating, Genre, Archived Date.
The Summary and any notes that the author puts on the story are not blocked into html tags for easy retrieval, so would be problematic...
chromeandgunmetal.com/chrome
This site is much like the Firefly's Glow Archive (fireflypopulli.org), so it is possible, but there is no date information available to visitors.
Some metadata available, Title, author, pairings, rating, category, summary. that is all.
www.sofurry.com/
It's doable... The metadata that I can see are Title, author, Posting date, series (and number), tags, and summary.
There is a link to download an epub of the story.
trickyraven.ning.com
No Longer available on the web. I get a 404 error for this site.
avia.silverbloom.net/mirror
No Longer available on the web. I get a 404 error for this site.
bigclosetr.us/topshelf
This looks like a forum site for stories. There is metadata that can be gotten, so it is doable.
It's a 1 page/1 story type site... there are no specific links to other chapters of the same story that I can see that can be systematically retreived.
wolfpub.org
They have their own download system. It looks like it might be possible, depending on the permissions required.
www.bdsmlibrary.com/
Already suupported
www.t-s-s-a.com/
This is a website of text files.
*Insufficient interest/updates
mvsfiction.com
Very small selection of stories (8), and hasn't been updated in a few years (the In Progress shows an updated in 2014, but you can't get to it.)
This looks like it is a 1 author site, where he is the only one that posts, but others can read them.
fanficauthors.net
Already created, but not submitted.
priscellie.com
Is now a wordpress Blogstyle site. I couldn't find any stories to download.
labyrinth.retrogression.org
redirects to www.13hours.org/fanfiction/ called Underground, a Labyrinth Fanfiction Archive, it has 190 stories, Last updated in October, 2016.
Looks to be a modified eFiction site, so it is doable.
shriftweb.org/leviathan
Another site like firefly.populli.org, so it is doable.
hugosnebula.com/sgxover
No longer a story site. I couldn't find any stories to download.
ericnorthman.net/fanfic
Only 452 stories (down from the 487 that is listed on the page). Another modified eFiction site, so is doable.
bigblock.westwingstories.com
per the website:
The archive was last updated in May 2005, and will not be updated again. The National Library is taking over this site as of August 21, 2005. All completed stories will be added to The National Library. New submissions will be added to The National Library. See the Submit Story page for full guidelines on adding a story to the TNL site and search engine.
and The National Library is already suupported.
and as to the stories that are already there, it seems to be a website of html pages. No story system to be seen.
adifferentforest.net
This looks like a blog site, and the fanfiction section requires a login, which I didn't want to do right now.
ficsite.com
already supported
www.digital-quill.org/
According to the website, "Digital Quill is offline for the foreseeable future."
fanfiction.lucifael.com
already supported
snarry.net
an efiction site, and it looks like the story system works, but the stories are not reachable.
hermione.magical-worlds.us
No Longer available on the web (404 error)
*Sites not supported
LiveJournal
I have looked at this, but as was stated on the page, it's very inconsistent and there are other programs that handle it already.
*Other Sites Not Likely to be Supported
gayauthors.org
Since the site admins requested we remove support, I'm not going to look at it.
www.dwiggie.com
It looks like there are 2 different types of stories here... one is an archive, which has very minimal metadata, and a forum type site, where new chapters are posted.
The forum site also has minimum metadata (title, author and posted date), and I would only be able to download the chapter that is requested from the url.
I can't see a way to systematially retrieve the other chapters of the story (if there are any).
www.shifti.org/
As was stated on the page, it is a wiki site, so 1 story/1 page. I can be done if enough people want it,
www.nifty.org/
A website of text files.
inkstain.inkquill.net
Moved to archiveofourown at archiveofourown.org/collections/InkStainedFingers. The stories are no longer available at this url.
triptpolers.houseoftucker.com
As was said, it's a website of html documents. There is a way to put the multiple chapters together, but there is almost no metadata.
www.ellenceleste.com/MissionImp/index.html
No longer available on the web (404 error)
www.ralst.com/
as stated, no metadata, and 1 page/1 story.
forums.naughty-seduction.net
as stated, a forum site with no metadata. it _might_ be possible to get all posts by the original author, but I'm not sure I want to work o it at this time.
www.peephut.org/fics.html
A One author site that you can't tell when was last updated. No metadata to retrieve, either.
www.witchfics.org
No Longer available
wattpad.com
Javascript. *blegh*
www.obscurusbooks.org
can't get to it... redirections all over the place.
www.asstr.org/~Kristen/
a website of text files. No metadata to be collected
dracobigbang.accio.nu
Looks to be an archive of livejournal posted stories...
perusingtheshelves.com
As stated, forum site....
www.852prospect.org/archive/
ignoring, since it's already moved.
www.masterapprentice.org/html/archive.html
ignoring, since it's already moved.
fluky.gossamer.org
website of html/text files. No story system.
ephemeralfic.org
as stated. web site of text files, not html. Archive of a mail list.
theheartofcamelot.com
redirects to whimsicalwanderings.net/, which is already supported.
*Sites not listed on the Supported Sites page:
www.faramirfiction.com
can be done. It was requested in the google groups, so I may work on it. Last updated In November, 2016
www.ultimatehpfanfiction.com
it's possible. It is a archive for other sites. There is no timestamps for the stories, so there is no way to tell when it was published or updated.
unknowableroom.org
News last updated in April, 2012. Stories last updated September, 2015. The metadata is very hard to parse, since it is all within 1 tag.
www.nickandgreg.net/desert_archive/index.php
Stories Last updated October, 2015. Metadata is available. Can be done if enough people want it, or I'm bored enough.
Well... that's my take on the sites on the list. When I next get bored, I'll look through here, and decide which one I want to do, if I want a project.
GComyn
Jim Miller
Dec 16, 2016, 11:21:15 AM12/16/16
to fanfic-d...@googlegroups.com
On 12/16/2016 3:32 AM, Gwydion Comyn wrote:
> Ok... I looked through this list, and here are some of my observations....
Thanks for reviewing, I've updated the wiki to remove the defunct sites.
> Ok... I looked through this list, and here are some of my observations....
> *Sites not listed on the Supported Sites page:*
I've added these to the 'Sites under consideration' list.
> Well... that's my take on the sites on the list. When I next get bored,
> I'll look through here, and decide which one I want to do, if I want a
> project.
Gwydion Comyn
Dec 16, 2016, 2:30:06 PM12/16/16
to FanFicFare -- Downloader for FanFiction
no problem... *sigh*... I've had a slight set back with my new job, so I've got time right now.
GComyn
GComyn
Reply all
Reply to author
Forward
0 new messages