 |
 |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 3/21/2014 2:34 PM, Andrew Gordon wrote: > Ken, > > A group in Chicago has been working for a few years now on a > deduplication toolkit that might do what you are looking for, they > also have a couple versions that works with an excel file or .csv > file. > > https://github.com/datamade/dedupe > https://github.com/datamade/dedupe-web > https://github.com/datamade/csvdedupe > > I have not worked with them extensively, but I have heard others > find these very useful for entity recognition and resolution. +1 Attended this very interesting talk on just that http://pyvideo.org/video/973/big-data-de-duping ./fxk - -- QOTD: "A child of 5 could understand this! Fetch me a child of 5." -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQEcBAEBAgAGBQJTLIj9AAoJEOptrq/fXk6Mjl4H/jMa3b+ekRYNnnvLBdMXUr/C p+0tAu3SI5GkfbWe1JGLU6cPcM0Ret22RxKg+QslADZ00aGj2RM8sh+4fV0neFXB /sA7wHh/8thtFW1njKpaLQZg5f+px6zB8ch9wdp4yf7L0pPb1612fxGRHMjH5u51 vFUAF3r6wM3JIYjAEPKhzq5511soASisV0IWMEyAoRYNyjKbOyan/gN97G/oYxXp MvwxFAwiOPgwL83Set0kMqztCA2aW76uFwwgvWkhGIcywBR7w7Adl1/MTM9oLBtd lyeimBXWKvqvArai9txMcC4mOLkZq03FAWypVhe+VOBm4xmmDhowr3YeaaJWl3k= =Kv3q -----END PGP SIGNATURE-----