[RFC] proposal for new on-disk format

[A.M.]

Hi List,

I put together a document detailing the pitfalls of the current on-disk
database format along with with a proposal to remedy them.

On-disk formats can be a contentious and tricky issue, so I would like
to ensure everyone has a chance to raise any concerns before I implement
anything.

Take a look at the document here:

https://github.com/agentm/project-m36/blob/disk_format_proposal/docs/filesystem-persistence.markdown

And please comment at the pull request:

https://github.com/agentm/project-m36/pull/166

Or feel free to ask any clarifying questions.

I plan on keeping the pull request open until at least November 1 when I
will be looking for a consensus-based implementation plan.

I really want to get this right and the plan is quite ambitious, so I
need your help. If I missing anything obvious, I really want to hear
from you!

Cheers,
M