Hey all
We are investigating using the NATS streamer server.
We will be connecting the streaming server to a Postgres for source event logging. From my understanding, this will basically tell the streaming server to store all the events there.
We will also be using Google's Protobuf for the data.
To deal with PII (Personal Identifiable Data) & GDPR, from my understanding, there are two ways:
1) Encrypt the subject data (or even part of the data) and use the "lost key" strategy. Meaning, the data is encrypted, but in order to "delete" the data, you are actually deleting the key, keeping the data "forever encrypted".
2) Add the "max_age" on a subject. Meaning, all events of a certain subject, will be automatically deleted from the Postgres by the NATS streaming server after a specific duration (for example, 30 days).
The absolute ideal situation would be if we could delete certain parts of the event that is only PII and just long term store the other in Postgres, but seeing NATS streaming server stores the events binary (i think), I am going to assume this is totally impossible?
I am just curious if anyone here knows of a third option that we have maybe not thought about? Regarding deleting specific part
Any idea, or feedback is highly appreciated!
Thanks!
// Christoffer