Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

9 votes221 views2 answers
Pygame play sound
Python
11 votes241 views3 answers
Elmo
Python
1 vote209 views1 answer
How to multiply in django template
Python
10 votes213 views3 answers
How to round a number down in python
Python
0 vote224 views1 answer
Dataflair python
Python
0 vote205 views1 answer
Sentence transformers
Python
0 vote248 views1 answer
Remove exponent pandas plot
Python
26 votes196 views6 answers
If then else python
Python
4 votes216 views2 answers
Tkinter draw squaer
Python
0 vote229 views1 answer
Python save .mat
Python