How to find a nearest duplicate in database?

Question

Example, in a database
book name author name
--------------------------------------------------
learning java someone
learning java 2 someone

In this example learning java and learning java 2 are almost nearer i want to find these type of duplicates with spelling mistakes also.

Is there any way to find these type of duplicates in Mysql or Oracle databases.

Answer 1

Fetch All Them To an Array and work on Array

Answer 2

You will need to do a match on words. Set a minimum count of say word count -1 or 2 to indicate a possible duplicate. Also consider the word position. A position equal is a match. A position of plus 1 is also a match.

You will have to decide on the rules.

learning java /match1 pos 1, match 2, pos 2, no match/match
learning java 2/
learning vb/match 1, pos 1, no match/no match

Answer 3

Not an easy job.. :(

hope SOUNDEX( ) function will work for you... Try ur luck

or you can also use DIFFERENCE function