Deduplication jaccard python

s1 = "what's the flight time from Berlin to Helsinki?"
s2 = "how long does it take to fly from Berlin to Helsinki?"

shingles1 = set([s1[max(0, i-4):i] for i in range(4, len(s1) + 1)])
shingles2 = set([s2[max(0, i-4):i] for i in range(4, len(s2) + 1)])

len(shingles1 & shingles2) / len(shingles1 | shingles2)

Source: mattilyra.github.io

Similar codes

0 vote252 views1 answer
Python - Comment Parse String to List
Python
0 vote289 views2 answers
How to write a python script to find the value of x at a given y value
Python
1 vote303 views1 answer
Fill python list with input
Python
0 vote260 views1 answer
Tokyo timezone python
Python
0 vote285 views1 answer
Theta hat symbol python code
Python
0 vote259 views1 answer
Mode with group by in python
Python
28 votes245 views1 answer
'utf-8' codec can't decode byte 0x85 in position 715: invalid start byte
Python
0 vote288 views1 answer
Python read vcf file line by line
Python
2 votes247 views3 answers
Can't find model 'en_core_web_sm'. It doesn't seem to be a shortcut link, a Python package or a valid path to a data directory.
Python
1 vote276 views1 answer
Tf get devices
Python