Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote338 views1 answer
Django model different schema
Python
30 votes454 views3 answers
Django create superuser from script
Python Django
0 vote312 views1 answer
Serializing nested objects drf,django restframework nested object serialization
Python
0 vote312 views1 answer
Python Command '['latexmk', '--pdf', '--interaction=nonstopmode', % returned non-zero exit status 2.
Python
24 votes354 views6 answers
How to save a pickle file
Python
2 votes336 views1 answer
Python bin()
Python
2 votes319 views1 answer
Click js selenium python
Python
0 vote321 views1 answer
Transverse tensor in pytorch
Python
1 vote325 views1 answer
How to check if its later than python
Python
1 vote328 views1 answer
Issue Pandas TypeError: no numeric data to plot
Python