Every week there is somebody on this newsgroup asking for
veronica/archie for the WWW. These people are usually referred
to several of the excellent hand-maintained index databases on
the Web. But an automatic indexer would be nice...
ALIWEB is an experiment in automatic 'distributed' indexing:
a WWW server advertises its contents in a local file, which is
automatically retrieved and processed proactively by a single
site. The combined database of these indices can of course be
searched from the Web.
This is a first step to distributed indexing in the web, and by no
means a final solution. But it is simple, has relatively low overhead,
and may serve well for some time, and I'd urge WWW server maintainers
to consider joining in this experiment. When beter schemes come along
it should be easy to use/convert this data.
It's all done via the Web, for all details see
I look forward to people's comments...
X-400: C=GB; A= ; P=Nexor; O=Nexor; S=koster; I=M
X-500: c=GB@o=NEXOR Ltd@cn=Martijn Koster