Reversible transform of tokenized texts to numericalized ids

Numericalize(
  vocab = NULL,
  min_freq = 3,
  max_vocab = 60000,
  special_toks = NULL,
  pad_tok = NULL
)

Arguments

vocab

vocab

min_freq

min_freq

max_vocab

max_vocab

special_toks

special_toks

pad_tok

pad_tok

Value

None