Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

18 votes202 views4 answers
Python compiler and shell online
Python
10 votes189 views2 answers
English to japanese
Python
0 vote209 views1 answer
Split into list into even chunks
Python
1 vote215 views1 answer
Flask send client to another web page
Python
18 votes182 views2 answers
Python write to json with indent
Python
0 vote195 views1 answer
Numpy bitwise_or multiple images
Python
24 votes182 views1 answer
How to replace na values in python
Python
0 vote153 views1 answer
Pyqt5 book
Python
1 vote196 views1 answer
Get wav file in dir
Python
0 vote199 views1 answer
Distribute a local Python collection to form an RDD
Python