Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote126 views1 answer
Split dict into chunks python
Python
0 vote173 views1 answer
Pandas mean and sum
Python
0 vote183 views2 answers
Python bytes to dict
Python
0 vote196 views1 answer
How to console log in django heroku
Python Django
3 votes156 views1 answer
How to check for a particular word in a text file using python
Python
7 votes172 views3 answers
Pandas empty dataframe with column names
Python
0 vote171 views1 answer
Python download complete web page
Python
24 votes189 views6 answers
How to save a pickle file
Python
0 vote152 views1 answer
Pyqt button hover color
Python
0 vote164 views2 answers
How to add space in python
Python