Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote307 views1 answer
Jupyter consumes 100 disk
Python
8 votes334 views3 answers
Python split range into n groups
Python
0 vote339 views1 answer
Split a string into N equal parts.
Python
0 vote328 views1 answer
How to write to a netcdf file using xarray
Python
2 votes312 views2 answers
Python primera letra mayuscula
Python
60 votes336 views6 answers
Python current date
Python
59 votes310 views6 answers
How to clear console python
Python
0 vote297 views1 answer
Seconds to time python
Python
0 vote305 views1 answer
Iniciar servidor en Django
Python
2 votes314 views2 answers
How to take input in python3 separated by space
Python