Compute the perplexity of a trained word2vec model with data.
Usage
perplexity(x, targets, data, layer = c("words", "documents"))Arguments
- x
a trained
textmodel_wordvectorobject.- data
a quanteda::tokens or quanteda::dfm; the probabilities of words are tested against occurrences of words in it.