Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

3 votes211 views2 answers
Get columns containing string
Python
2 votes208 views1 answer
Self.app = Tk()
Python
44 votes199 views2 answers
Cm to foot
Python
0 vote192 views1 answer
Pandas df trim columns if too much missing data
Python
28 votes195 views2 answers
Python print without new lines
Python
2 votes196 views2 answers
Pypi
Python
291 votes239 views10 answers
Remove element from list python
Python
1 vote207 views2 answers
Python get first occurrence in list
Python
7 votes213 views1 answer
Local image embed discord py
Python
0 vote219 views1 answer
12000000/12
Python