Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

2 votes354 views4 answers
Difference between 2 dataframes
Python
0 vote377 views1 answer
How to run django server outside world
Python Django
0 vote367 views1 answer
Get all methods of an instance
Python
137 votes337 views6 answers
Python file reading
Python
0 vote356 views1 answer
Make value of two tables unique django
Python Django
0 vote316 views1 answer
Check check writability of the file
Python
2 votes339 views2 answers
Python do nothing
Python
115 votes326 views3 answers
Write txt python
Python
1 vote345 views1 answer
ValueError: Failed to convert a NumPy array to a Tensor (Unsupported object type float).
Python
0 vote393 views2 answers
Elavon converge api python tutorial
Python