Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

5 votes225 views2 answers
Install pandas in python mac
Python
1 vote260 views1 answer
Require http method django view
Python Django
0 vote251 views1 answer
Python script to convert dicom to niftii
Python
0 vote241 views1 answer
All possibilities of 0 and 1
Python
3 votes212 views1 answer
Flask secret key generator
Python
0 vote240 views1 answer
Get all functions from a module as string list python
Python
115 votes306 views6 answers
Python user input
Python
11 votes267 views3 answers
Dataframe delete row
Python
0 vote233 views1 answer
Could not find a version that satisfies the requirement psycopg2>=2.8 (from pgcli) (from versions: 2.7.5, 2.7.6, 2.7.6.1, 2.7.7)
Python
0 vote225 views1 answer
Uninstalling/removing a package is very easy with pip:
Python