nltk分詞

1.安裝nltk

2.運行以下

>>>import nltk
>>> nltk.download('punkt')

3.代碼：

import nltk
sentence= """At eight o'clock on Thursday morning
... Arthur didn't feel very good."""
tokens = nltk.word_tokenize(sentence)
print(tokens)

4.結果