Can someone help de-dupe 40million email addresses?

116 views
Skip to first unread message

Evan Frey

unread,
Sep 18, 2014, 4:49:25 PM9/18/14
to open-source-...@googlegroups.com
Have a large database of email addresses that I need help to de-dupe. Will pay. Can someone assist?

Thanks,
Evan

Tom Morris

unread,
Sep 18, 2014, 5:05:27 PM9/18/14
to open-source-...@googlegroups.com
If it's just email addresses and no other fields, you don't need this dedupe software.  You can just use:

sort -u emails.text > unique-emails.txt

Are you requirements more complex than that?

Tom

--

---
You received this message because you are subscribed to the Google Groups "open source deduplication" group.
To unsubscribe from this group and stop receiving emails from it, send an email to open-source-dedupl...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages