Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote322 views1 answer
Pandas join two series on index
Python
0 vote331 views1 answer
How to get the current url path in django template
Python
0 vote325 views1 answer
Python ignore exception
Python
5 votes329 views3 answers
Correlation matrix python
Python
1 vote273 views1 answer
Polynomial in python
Python
2 votes325 views1 answer
Python cv2 screen capture
Python
21 votes337 views2 answers
How to update python
Python
0 vote277 views1 answer
Opencv find image in image
Python
4 votes312 views2 answers
How to make a screen in pygame
Python
0 vote310 views1 answer
Pandas dataframe mask all entries which include a string
Python