I use Prolog for big data solutions. LOD Laundromat (
http://lodlaundromat.org/) is programmed in SWI-Prolog, using the RocksDB and HDT backends. I'm now building a SPARQL query engine that can handle 100B+ triples, based on ClioPatria.
> do pengines let you make a cluster into 1 huge database?
I have no experience with building a Pengine cluster. I would be interested in it though! There are not very many Prolog programmers working on big data problems today... so it may never happen.
> like apache spark?
No, not like that at all. The Spark community is huge and very focused on performance and scalability. In the Prolog community I have not seen such a focus yet.
---
Cheers,
Wouter.