首页 文章

使用gensim的短语获取三元组时出错

提问于
浏览
0

我想提取给定句子的所有bigrams和trigrams .

from gensim.models import Phrases
documents = ["the mayor of new york was there", "Human Computer Interaction is a great and new subject", "machine learning can be useful sometimes","new york mayor was present", "I love machine learning because it is a new subject area", "human computer interaction helps people to get user friendly applications"]

sentence_stream = [doc.split(" ") for doc in documents]
bigram = Phrases(sentence_stream, min_count=1, threshold=2, delimiter=b' ')
trigram = Phrases(bigram(sentence_stream, min_count=1, threshold=2, delimiter=b' '))

for sent in sentence_stream:
    #print(sent)
    bigrams_ = bigram[sent]
    trigrams_ = trigram[bigrams_]

    print(bigrams_)
    print(trigrams_)

该代码适用于bigrams并捕获“纽约”和“机器学习”广告 .

但是,当我尝试插入三元组时,我收到以下错误 .

TypeError: 'Phrases' object is not callable

请告诉我,如何更正我的代码 .

我正在关注gensim的example documentation .

1 回答

  • 0

    根据docs,您可以这样做:

    from gensim.models import Phrases
    from gensim.models.phrases import Phraser 
    
    phrases = Phrases(sentence_stream)
    bigram = Phraser(phrases)
    trigram = Phrases(bigram[sentence_stream])
    

    bigram ,作为 Phrases 对象,无法再次调用,因为您正在这样做 .

相关问题