Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

1 vote292 views1 answer
Removing odd index character of a given string in python
Python
43 votes290 views6 answers
Df change column names
Python
1 vote291 views1 answer
Pandas convert multiple columns to categorical
Python
9 votes281 views6 answers
What is enumerate in python
Python
8 votes278 views2 answers
How to launch an application using python
Python
0 vote280 views1 answer
Python-Generating numbers according to a corellation matrix
Python
0 vote287 views2 answers
Graph 3d python
Python
21 votes264 views3 answers
How to copy all requirements to requirements.txt
Python
12 votes285 views5 answers
Merge two dataframes based on column
Python
14 votes267 views4 answers
Pandas get index of max value in column
Python