/Python/Python nltk detecting clauses in sentences

Python nltk detecting clauses in sentences

import spacy
import deplacy
en = spacy.load('en_core_web_sm')

text = "This all encompassing experience wore off for a moment and in that moment, my awareness came gasping to the surface of the hallucination and I was able to consider momentarily that I had killed myself by taking an outrageous dose of an online drug and this was the most pathetic death experience of all time."

doc = en(text)
#deplacy.render(doc)

seen = set() # keep track of covered words

chunks = []
for sent in doc.sents:
    heads = [cc for cc in sent.root.children if cc.dep_ == 'conj']

    for head in heads:
        words = [ww for ww in head.subtree]
        for word in words:
            seen.add(word)
        chunk = (' '.join([ww.text for ww in words]))
        chunks.append( (head.i, chunk) )

    unseen = [ww for ww in sent if ww not in seen]
    chunk = ' '.join([ww.text for ww in unseen])
    chunks.append( (sent.root.i, chunk) )

chunks = sorted(chunks, key=lambda x: x[0])

for ii, chunk in chunks:
    print(chunk)

Source: stackoverflow.com

Similar codes

0 vote323 views1 answer
Fibonacci in list python
Python
1 vote320 views1 answer
Python hide input
Python
1 vote313 views1 answer
Count how many times a value shows in python list
Python
8 votes320 views4 answers
Pygame change icon
Python
0 vote320 views1 answer
Pandas series remove element by index
Python
82 votes305 views5 answers
Python requirements.txt
Python
11 votes345 views3 answers
Combine dataframes with two matching columns
Python
11 votes338 views6 answers
Python Dictionaries
Python
1 vote320 views2 answers
Writer.writerow in python
Python
1 vote342 views1 answer
Find first date python
Python