Idea: data deduplication into nodes

28 views
Skip to first unread message

Matt Wilkie

unread,
Aug 8, 2019, 4:47:31 PM8/8/19
to leo-editor
I ran into something today that may be a bug, clones forgetting they are clones (ref), which got me thinking about how to re-make clones without starting over, which got me thinking about file system deduplication, which prompted the thought: what if Leo could scan a corpus of text and automatically make clones of all matching blocks larger than X? (where X is num characters, lines, paragraphs, files or any other chunking mechanism).

Edward K. Ream

unread,
Aug 8, 2019, 5:50:22 PM8/8/19
to leo-editor
On Thu, Aug 8, 2019 at 3:47 PM Matt Wilkie <map...@gmail.com> wrote:
I ran into something today that may be a bug, clones forgetting they are clones (ref), which got me thinking about how to re-make clones without starting over, which got me thinking about file system deduplication, which prompted the thought: what if Leo could scan a corpus of text and automatically make clones of all matching blocks larger than X? (where X is num characters, lines, paragraphs, files or any other chunking mechanism).

Interesting thought.  It would never have occurred to me ;-)

Edward
Reply all
Reply to author
Forward
0 new messages