Hashing code

[Daniel Haley]

Hi All,

I've uploaded the hashing script to gitlab, here:
https://gitlab.com/atomprobe.tc/hashing

Due to limitations about multiple identities, the Oxford hash lists are
available here, comprising ~22000 experiments. The update process took a
little longer than previously thought, due to the need to do a bulk
network transfer to run the hashing code for the first time.

https://github.com/oxfordAPT/hashlist

You can use these lists to identify and verify any data from Oxford,
including checking for corruption and verifying the integrity of the data.

The scripts at the first URL can be used to generate your own hash
lists, and maintain them automatically.

In the future we could readily envisage as system where all you have to
do is provide a hash code, or experiment number, and the dataset will be
securely retrieved locally if available, free from corruption, and
without the need for user interaction.


Thanks,

Daniel

[Anna Ceguerra]

Nice work! Thanks for sharing both the successes and the challenges. I hope I will be able to see a "cheat sheet" of some sort that describes how to hash a lab's data collection, if they're never done it before.

Regards,
Anna.

On 9/6/20, 11:53 pm, "atompr...@googlegroups.com on behalf of Daniel Haley" <atompr...@googlegroups.com on behalf of daniel...@materials.ox.ac.uk> wrote:

Hi All,

I've uploaded the hashing script to gitlab, here:

https://protect-au.mimecast.com/s/1yYgCgZ0N1ig8kmrhNolg7?domain=gitlab.com

Due to limitations about multiple identities, the Oxford hash lists are
available here, comprising ~22000 experiments. The update process took a
little longer than previously thought, due to the need to do a bulk
network transfer to run the hashing code for the first time.

https://protect-au.mimecast.com/s/9CM3CjZ1N7i6g932HRSUU_?domain=github.com

You can use these lists to identify and verify any data from Oxford,
including checking for corruption and verifying the integrity of the data.

The scripts at the first URL can be used to generate your own hash
lists, and maintain them automatically.

In the future we could readily envisage as system where all you have to
do is provide a hash code, or experiment number, and the dataset will be
securely retrieved locally if available, free from corruption, and
without the need for user interaction.


Thanks,

Daniel

--
You received this message because you are subscribed to the Google Groups "AtomProbe TC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to atomprobe-tc...@googlegroups.com.
To view this discussion on the web, visit https://protect-au.mimecast.com/s/CBSuCk81N9tLgNr7cQzVZt?domain=groups.google.com.