Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

32 votes282 views6 answers
Pandas count unique values in column
Python
0 vote266 views1 answer
Micropython string to int
Python
0 vote296 views1 answer
Python flask how to remove last character from string
Python Flask
0 vote278 views1 answer
How to create a scoreboard for the top 5 players in python
Python
0 vote290 views1 answer
Pandas add prefix to column names
Python
0 vote294 views1 answer
Separate path python
Python
0 vote286 views1 answer
Python turtle get mouse position
Python
0 vote285 views1 answer
Python added dictionary together
Python
8 votes268 views3 answers
Calculate euclidian distance python
Python
1 vote263 views2 answers
Numpy one hot
Python