Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

11 votes219 views3 answers
Logistic regression algorithm in python
Python
1 vote267 views1 answer
Numpy series reset index
Python
0 vote247 views1 answer
Exclude last value of an array python
Python
0 vote216 views1 answer
Self.find_by_id
Python
0 vote213 views1 answer
Pyqt button hover color
Python
9 votes265 views2 answers
Get resolution of image python
Python
0 vote260 views2 answers
Flask upload file to s3
Python Flask
0 vote247 views2 answers
Import specific version of package python
Python
-1 vote253 views3 answers
Play Video in Google Colab
Python
0 vote228 views1 answer
Django-filter field name greater than
Python