Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote315 views1 answer
B12 vegetables only
Python
0 vote350 views1 answer
How to create superuser in django heroku
Python Django
0 vote302 views1 answer
Python pip past
Python
2 votes291 views1 answer
Private variables python
Python
0 vote315 views1 answer
How to apply tanH on pd dataframe
Python
1 vote299 views1 answer
Grouping products for sales
Python
1 vote294 views2 answers
How to add sum of range in python
Python
29 votes263 views2 answers
Lambda en python
Python
0 vote275 views1 answer
Pandas read csv skip rows
Python
0 vote293 views1 answer
Python remove punctuation from a string
Python