We lost all 2600 links to the Fibonacci Quarterly

[Neil Sloane]

Taylor and Francis have taken over (or bought?) the journal and seem to have turned off free access to all the back issues.  We have about 2600 links, and they are all broken.

I have written to my contacts at the journal, to try to find out what is going on.

[Austin Cook]

Hello, im not sure if it would be helpful for this particular case but, a discussion has recently kicked up in a thread I've started here: https://groups.google.com/g/seqfan/c/yacsTzjbcKU/m/5yfDJsyCBgAJ
In which I have been writing a bit of code to do a large scale scrape of the common crawl warc dumps and web archive pages, to recover some of the missing seqfan historical data,  I took a quick look after reading this and it appears that the fq websites have similarly been captured in the common crawl WARCs if it is helpful, I can collect and process the data, it wouldn't be much hassle, though I'd need the broken links or something similar to filter for in the data as the scale is very large, let me know if I can be of help, thanks

Austin

[Antti Karttunen]

On Fri, Jan 3, 2025 at 1:04 PM Neil Sloane <njas...@gmail.com> wrote:

Taylor and Francis have taken over (or bought?) the journal and seem to have turned off free access to all the back issues.  We have about 2600 links, and they are all broken.

Now, _that_ I would call real predatory science journalism!

Antti

 

I have written to my contacts at the journal, to try to find out what is going on.

--
You received this message because you are subscribed to the Google Groups "SeqFan" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seqfan+un...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/seqfan/254d5edc-828f-4ba4-98fd-2211d8f58383n%40googlegroups.com.

[Arthur O'Dwyer]

On Fri, Jan 3, 2025 at 8:55 AM Antti Karttunen <antti.k...@gmail.com> wrote:

On Fri, Jan 3, 2025 at 1:04 PM Neil Sloane <njas...@gmail.com> wrote:

Taylor and Francis have taken over (or bought?) the journal and seem to have turned off free access to all the back issues.  We have about 2600 links, and they are all broken.

Now, _that_ I would call real predatory science journalism!

FWIW, I have grepped oeisdata for URLs containing `fq.math.ca` and downloaded the relevant resources from the Wayback Machine. I got 542 PDF files and 17 HTML files.

The total disk space (as reported by `du -sh`) is about 502 MB. I'm not saying OEIS wants to mirror those papers from a legal point of view, but it would be very easy to do so from a technological point of view. If you (dear reader) want copies of the papers, as a 498MB zip file, and can't figure out how to get them yourself, email me and we can probably figure out a way to get them to you.

(However, I also observe that 14 of the HTML files are just landing pages for the FQ issue number in question — not direct links to the actual article being cited. The other 3 are landing pages for entire books. The 14 of them, at least, should probably be updated to point directly to the article being cited.)

–Arthur

[Simon Plouffe]

Hello,

 I could collect these issues from different sources,
https://plouffe.fr/Fibonacci%20Quartely/

all the pdf have been OCRized,

Best regards,
 Simon plouffe
 

--
You received this message because you are subscribed to the Google Groups "SeqFan" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seqfan+un...@googlegroups.com.

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CADvuK0KkZtLymwG2eQAiosSb%3DEP6bfiH1N4PY96WwABcaJj7dg%40mail.gmail.com.

[Neil Sloane]

Arthur,  Simon,  That is fantastic !  Wow! 

 I will be talking to Russ Cox tonight about how we should proceed.

The simplest solution of course would be to get the Fibonacci Association to unlock their archive.

Best regards

Neil 

Neil J. A. Sloane, Chairman, OEIS Foundation.

Also Visiting Scientist, Math. Dept., Rutgers University, 

Email: njas...@gmail.com

To view this discussion visit https://groups.google.com/d/msgid/seqfan/671673d2-df3d-40e1-900d-e3e909c1b599%40gmail.com.

[Simon Plouffe]

Hello,

 I have now 665 files on that directory and
all have been OCRized too.

Best regards,
 Simon plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CAAOnSgSYcGGnchxbPeF%3DTuqPBoYNdKNn%2By6bNL8m%3DoG4Ky7eZw%40mail.gmail.com.

[Austin Cook]

hello, if anyone would like some code to automate parsing the web or internet archive that they would find productive, please let me know and ill share, otherwise if there are further documents requiring OCR that will otherwise be inaccessible, that too is a place where im happy to be of help

Austin Cook Alignment Lab AI|CEO Transparency Utility Accessibility ∑ AlignmentLab.ai ☏: +1-936-777-0513

To view this discussion visit https://groups.google.com/d/msgid/seqfan/6b68e7e0-cc5b-4b28-8c41-e5be94315747%40gmail.com.

[Simon Plouffe]

Hello,

 Here is a list of all (?) issues : http://ftp.math.utah.edu/pub/tex/bib/fibquart.html
I tried a robot on it and unfortunately most of the pdf are <403> restricted access so far.

There are 4305 files, I could not access, too bad. !

Best regards,
 Simon plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CA%2Beuv9DtiR4X-9e-Go6HSyJjM5Y_S1-HGFXq-4Sig9yBR4ec0w%40mail.gmail.com.

[Jean-Paul Allouche]

Dear all

May be I am missing something: I wen to

https://web.archive.org/web/20190506090856/https://www.fq.math.ca/list-of-issues.html

and I made a random search by clicking on papers in issues between 2963 and 2012; I have always obtained the pdf's.

This was not the case for my trials on subsequent years.

best

jean-paul

To view this discussion visit https://groups.google.com/d/msgid/seqfan/21f6b481-8a99-429b-941d-8a28fd3952a7%40gmail.com.

[Simon Plouffe]

I think that the copy on archive.org has the same limitations,
https://web.archive.org/web/20171202013529/http://www.fq.math.ca/55-3.html
here you see some of the files but : the error 403 occurs.

Best regards,
 Simon plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CAFhWSWuTs34O%3DVCYPAzLnX%3DN1sBvQB4uVzR5KiCG7t2wEXsUxg%40mail.gmail.com.

[Jean-Paul Allouche]

Yep  That's why I wrote that my trials went up to 2012, not further.

best

jp

To view this discussion visit https://groups.google.com/d/msgid/seqfan/96528f85-d82d-4ecd-bde0-5354c14522b8%40gmail.com.

[Jean-Paul Allouche]

Futher this link

https://web.archive.org/web/20240923005753/https://www.fq.math.ca/list-of-issues.html

works up to 2018 if I am not mistaken,

which is not too bad

best wishes

jean-paul

To view this discussion visit https://groups.google.com/d/msgid/seqfan/96528f85-d82d-4ecd-bde0-5354c14522b8%40gmail.com.

[Simon Plouffe]

Hello,

 I am using a robot program to dig all of the pdf from the archive.org
site, so far, 1040 files, continuing ...

Simon Plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CAFhWSWtuoXuhmr94XwF85dXBUriCWOdLp73qvEme09EPX6RwSw%40mail.gmail.com.

[Russ Cox]

Hello all,

Like with the old Seqfan posts, I think our best strategy is to rely on archive.org, with the added benefit that the pages on FQ's web site are more likely to be indexed than random seqfan posts. I have applied a global edit to the OEIS to rewrite FQ links to archive.org lookups for those pages. Neil and I will also contact FQ directly and ask them if there is some way the old content can be unlocked.

Best,

Russ

[Arthur O'Dwyer]

On Sun, Jan 5, 2025 at 7:53 PM Russ Cox <r...@swtch.com> wrote:

Hello all,

Like with the old Seqfan posts, I think our best strategy is to rely on archive.org, with the added benefit that the pages on FQ's web site are more likely to be indexed than random seqfan posts. I have applied a global edit to the OEIS to rewrite FQ links to archive.org lookups for those pages. Neil and I will also contact FQ directly and ask them if there is some way the old content can be unlocked.

My suggestion (maybe too oblique, sorry) was that oeis.org could just host copies of the relevant papers.

In fact this could be a general principle (modulo OEIS's appetite for legal issues) — that when a reference to a paper is added to a sequence, you could just host a copy of that paper directly on oeis.org, augmented with a hyperlink to the original, bit-rot-prone online source. That way, no link would ever rot or need updating, and no published paper's content would ever be allowed to change out from under OEIS.

That is, there was never any question of whether to link to "random seqfan posts." The question was whether to take the ~half a gigabyte of papers previously published in "Fibonacci Quarterly" and mirror them via oeis.org. (The alternative is to link to a third-party preservation service, like archive.org or archive.is, but then oeis.org remains at the mercy of that service's availability. And archive.org is very much under attack these days: you should have a backup plan for when it goes down for good.)

Relevant reading: https://gwern.net/archiving

(but I admit I preach this gospel without practicing it myself; I don't even own my own domain to begin with)

–Arthur

[Austin Cook]

to add on to Arthurs post above

    you can link to a direct get of the paper from common crawl now that they allow direct indexing of byte offsets in their warcs,  i can provide code to do this but im unsure of the database enough to know if it would be useful, alternately the historical indexing of the pages with paper links in tact can be compiled  from the reconstructed crawls  and probably hosted 

here
without too much effort, or a modified copy which simply contains the associated paper grabbed from the time it was linked

Austin Cook Alignment Lab AI|CEO Transparency Utility Accessibility ∑ AlignmentLab.ai ☏: +1-936-777-0513

--

You received this message because you are subscribed to the Google Groups "SeqFan" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seqfan+un...@googlegroups.com.

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CADvuK0KUe4N6qcNiZVefaMK4zGLYfO2boEH7-qqc1NbmEctnMg%40mail.gmail.com.

[Simon Plouffe]

I used a robot program on the archive.org files,

 I collected 5073 pdf, I think I have them all.
Well, it is not perfectly organized, some of the files have
a number which corresponds to volume number and others are
just with names with a lot of repetitions. So I kept all
of the original names and sequentially renamed everything
using : Sequencenumber + name.pdf

It is all here : https://plouffe.fr/Fibonacci%20Quartely/
and here of the archive.org files :
https://plouffe.fr/Fibonacci%20Quartely/FROMarchive.org/pdf/

have fun and
best regards,
 Simon plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CA%2Beuv9AgfGm9oAuhipGpmV2SiakG%3Dxk6H1FgVA88TkbYG7e1NA%40mail.gmail.com.

[Jean-Paul Allouche]

excellent!

best

jp

To view this discussion visit https://groups.google.com/d/msgid/seqfan/5869e68a-bd27-4356-88ea-c79f27a7c00a%40gmail.com.

[Jon Awbrey]

i don't know if it will help but i recently came across
a firefox extension for the wayback machine which has
been really helpful in finding old archive links and
creating new ones. here's a link that may access it:

https://addons.mozilla.org/en-US/firefox/user/12373129/?utm_source=firefox-browser&utm_medium=firefox-browser&utm_content=addons-manager-user-profile-link

unless of course the publisher has somehow disabled archiving ...

i think there's extensions for most other popular browsers.

jon

[Lucas Brown]

It also exists for Chrome, Edge, and Safari:

https://chromewebstore.google.com/detail/wayback-machine/fpnmgdkabkmnadcjpehmlllkndpkmiak

https://microsoftedge.microsoft.com/addons/detail/wayback-machine/kjmickeoogghaimmomagaghnogelpcpn

https://apps.apple.com/us/app/wayback-machine/id1472432422?mt=12

https://addons.mozilla.org/en-US/firefox/addon/wayback-machine_new/

--
You received this message because you are subscribed to the Google Groups "SeqFan" group.
To unsubscribe from this group and stop receiving emails from it, send an email to seqfan+un...@googlegroups.com.

To view this discussion visit https://groups.google.com/d/msgid/seqfan/e54ecf03-09f2-43f2-b0c4-c543dca10839%40att.net.

[Simon Plouffe]

Hello,

 the FB are all here : https://plouffe.fr/Fibonacci%20Quartely/
and look at the <pdf> directory for the other issues. 

 Best Regards, 
 simon plouffe

To view this discussion visit https://groups.google.com/d/msgid/seqfan/CALSFKfgqqFFo0re0qKRbPfzgs4vJRPEknwUDL3XnuGXArY5L5Q%40mail.gmail.com.