Data Cleaning and duplicate removal Service

If you have a large volume of data which needs analysing and cleaning then we can use Elasticsearch’s powerful analytical tools to help to clean it up.

  • removal of duplicate records


Use cases:

A direct marketing company obtains company addresses from a number of different sources, and as a consequence comanies are often duplicated in the database with slightly different names and addresses.

Smart factory was able to detect duplicates in the data with 98% success rate, reducing costs and bad image caused by duplicate deliveries.