/Python/Python nltk detecting clauses in sentences

Python nltk detecting clauses in sentences

import spacy
import deplacy
en = spacy.load('en_core_web_sm')

text = "This all encompassing experience wore off for a moment and in that moment, my awareness came gasping to the surface of the hallucination and I was able to consider momentarily that I had killed myself by taking an outrageous dose of an online drug and this was the most pathetic death experience of all time."

doc = en(text)
#deplacy.render(doc)

seen = set() # keep track of covered words

chunks = []
for sent in doc.sents:
    heads = [cc for cc in sent.root.children if cc.dep_ == 'conj']

    for head in heads:
        words = [ww for ww in head.subtree]
        for word in words:
            seen.add(word)
        chunk = (' '.join([ww.text for ww in words]))
        chunks.append( (head.i, chunk) )

    unseen = [ww for ww in sent if ww not in seen]
    chunk = ' '.join([ww.text for ww in unseen])
    chunks.append( (sent.root.i, chunk) )

chunks = sorted(chunks, key=lambda x: x[0])

for ii, chunk in chunks:
    print(chunk)

Source: stackoverflow.com

Similar codes

21 votes187 views6 answers
Python list directories only
Python
2 votes169 views2 answers
Python threading return value
Python
3 votes209 views1 answer
Import py to exe
Python
12 votes215 views6 answers
Progress bar in python
Python
11 votes234 views6 answers
Pandas join dataframe
Python
29 votes210 views6 answers
Python empty dataframe
Python
1 vote207 views1 answer
Pytho list items to int
Python
0 vote173 views1 answer
How to get function help in jupyter notebook
Python
8 votes209 views3 answers
How to import flask
Python
13 votes194 views3 answers
Python http server command line
Python