Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote124 views1 answer
Xaxis matplotlib
Python
7 votes112 views5 answers
Install discord python
Python
0 vote118 views2 answers
How to count how many cameras you have with python
Python
1 vote119 views1 answer
Torch save state dict
Python
0 vote109 views1 answer
Possessive in python
Python
2 votes114 views1 answer
How to downgrade a package python
Python
1 vote122 views1 answer
Django login redirect
Python
0 vote116 views1 answer
Pandas df to mongodb
Python
3 votes141 views1 answer
Access the value in settings django
Python Django
8 votes111 views2 answers
How to print all combinations of a string in python
Python