Check duplicates from the datastore

[Livia Barazzetti]

Hi all,

I am thinking to take advantage of sumatra database to check for duplicate files (files with the same hash but different path). 

What I tried is:

project = load_project()
models = project.record_store._get_models()
datakeymanager = models.DataKey.objects.using(project.record_store._db_label)
query=datakeymanager.filter(path__contains=PATH, digest__contains = DIGEST)

Am I moving in the correct direction? Or is something similar already available? 

Thanks

Livia 

[thomas...@boostheat.com]

Hello,
I think you search duplicate in DataKey right ?

Datastore holds where data are stored.
DataKey is the actual data used for a record.

What I use to select DataKey is something similar to :

records = Record.objects.filter(label__in=records_to_process, project__id=project)
for record in records:
      QuerySet = DataKey.objects.filter(input_to_records=record, path__contains=PATH, digest__contains = DIGEST)

This might be faster by selecting it directly :
      QuerySet = DataKey.objects.filter(path__contains=PATH, digest__contains = DIGEST)

I didnot test it.
Thomas