Use csvdeddupe for a CSV almost "clean"
53 views
Skip to first unread message
Andrea Borruso
Apr 1, 2018, 7:23:02 AM4/1/18
to open source deduplication
Hi,
I have a 3000 records CSV file. It's almost clean, it has only nearby 5 rows that are duplicate.
For this kind of file it will impossible to train csvdedupe and collect 10 negative and especially 10 positive cases.
How to use csvdeddupe for almost "clean" CVS file? Is it not possible, because it's not the use case?
Thank you
I have a 3000 records CSV file. It's almost clean, it has only nearby 5 rows that are duplicate.
For this kind of file it will impossible to train csvdedupe and collect 10 negative and especially 10 positive cases.
How to use csvdeddupe for almost "clean" CVS file? Is it not possible, because it's not the use case?
Thank you
Reply all
Reply to author
Forward
0 new messages