Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Gopher mirroring tool

30 views
Skip to first unread message

andres

unread,
Jul 18, 2022, 7:17:21 AM7/18/22
to
Hello all. Does anyone know some Gopher mirroring tool a
la "wget --mirror" does on HTTP(S)? I already tried
pavuk, but it misses some relative links.
I tried to mirror the whole archive from
gopher://mozz.us/1/funnybone, but it didn't
neither download the issues nor the yearly
items linked as Gopher directories.

Dennis Boone

unread,
Jul 18, 2022, 12:21:35 PM7/18/22
to
The gopher protocol is simple enough you could probably build one
without too much effort. The perl modules LWP::Protocol::gopher and/or
URI::gopher might do a fair amount of the work. Python doesn't seem to
have much in the way of useful libraries to help.

De

dcb

unread,
Jul 24, 2022, 1:06:58 PM7/24/22
to
I wrote a Python library called Pituophis
(https://github.com/dotcomboom/Pituophis) some time ago that would help
here.
Recursively parsing each 1-type menu, fetching all the 0-type items and
saving them shouldn't be too bad. I can write a small script for it if you'd
like.

Also this is my first newspost, sorry if I made a mistake..

dcb


dcb

unread,
Jul 24, 2022, 3:44:02 PM7/24/22
to
dcb wrote:
> Recursively parsing each 1-type menu, fetching all the 0-type items and
> saving them shouldn't be too bad. I can write a small script for it if
> you'd like.

I wrote a script:
https://gist.github.com/dotcomboom/1c216ea08da60d0f1c0810a33963b216

Should be able to put the starting menu url in the list and it'll download
it recursively.

dcb


Szczezuja.space

unread,
Apr 7, 2023, 2:55:23 PM4/7/23
to
I'm testing https://sr.ht/~lioploum/offpunk/ and its cache folder for
the similar usecase. I'd like to create personal "Internet Archive" for
several Gopherholes and publish it.

--
.-=-. Szczezuja; on the small-net:
( S\ \ gemini://szczezuja.space/ - gemlog & tinylog
`--' / gopher://sdf.org:70/0/users/szczezuja/ - phlog

Ben Collver

unread,
Apr 8, 2023, 10:38:58 AM4/8/23
to
On 2022-07-18, andres <and...@disroot.org> wrote:
> Hello all. Does anyone know some Gopher mirroring tool a
> la "wget --mirror" does on HTTP(S)?

I wrote a gopher mirroring tool in Tcl.

I have only used it on Linux.

https://wiki.tcl-lang.org/page/gopher%2Dget
0 new messages