Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

4 votes319 views2 answers
How to take two integers as input in python
Python
1 vote292 views2 answers
Count elements in columns pandas
Python
0 vote296 views1 answer
Pandas array of dataframes
Python
10 votes296 views3 answers
Check python 32 or 64
Python
5 votes338 views3 answers
Python if not
Python
1 vote297 views1 answer
How to install panda3d
Python
1 vote365 views1 answer
Django return only part of string
Python
0 vote337 views1 answer
Django Signup urls.py
Python Django
2 votes315 views3 answers
Python poetry
Python
3 votes286 views1 answer
Month from datetime pandas
Python