/Python/Python nltk detecting clauses in sentences

Python nltk detecting clauses in sentences

import spacy
import deplacy
en = spacy.load('en_core_web_sm')

text = "This all encompassing experience wore off for a moment and in that moment, my awareness came gasping to the surface of the hallucination and I was able to consider momentarily that I had killed myself by taking an outrageous dose of an online drug and this was the most pathetic death experience of all time."

doc = en(text)
#deplacy.render(doc)

seen = set() # keep track of covered words

chunks = []
for sent in doc.sents:
    heads = [cc for cc in sent.root.children if cc.dep_ == 'conj']

    for head in heads:
        words = [ww for ww in head.subtree]
        for word in words:
            seen.add(word)
        chunk = (' '.join([ww.text for ww in words]))
        chunks.append( (head.i, chunk) )

    unseen = [ww for ww in sent if ww not in seen]
    chunk = ' '.join([ww.text for ww in unseen])
    chunks.append( (sent.root.i, chunk) )

chunks = sorted(chunks, key=lambda x: x[0])

for ii, chunk in chunks:
    print(chunk)

Source: stackoverflow.com

Similar codes

0 vote312 views1 answer
Pandas use map lambda to fillna python
Python
0 vote326 views2 answers
ImportError: cannot import name 'run_evaluation' from 'rasa_nlu.evaluate' (c:\users\gwinivac\.conda\envs\chatboty\lib\site-packages\rasa_nlu\evaluate.py)
Python
37 votes302 views3 answers
Python print to terminal with color
Python
61 votes350 views6 answers
Python pause
Python
1 vote301 views1 answer
How to only print final iteration of a for loop pyhton
Python
4 votes313 views1 answer
Python pygame screen example
Python
0 vote365 views2 answers
Destory image in pygame
Python
0 vote402 views1 answer
Check even or odd in single line
Python
13 votes315 views2 answers
Python programming online editor
Python
18 votes320 views2 answers
Absolute value python
Python