Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote320 views1 answer
Flask session auto logout in 5 mins
Python
0 vote301 views1 answer
Python get_loc not returning number
Python
4 votes282 views2 answers
Django composite primary key
Python
0 vote326 views1 answer
Flask files not updating
Python Flask
0 vote272 views1 answer
Numpy offset
Python
0 vote270 views1 answer
Right-left staircase python
Python
0 vote276 views1 answer
Matlab .* operator in python
Python
1 vote287 views1 answer
Python enum
Python
57 votes383 views6 answers
How to make a class in python
Python
0 vote306 views1 answer
Instabot python
Python