R/blurr_hugging_face.R
HF_TokenCategorize.Rd
Reversible transform of a list of category string to `vocab` id
HF_TokenCategorize(vocab = NULL, ignore_token = NULL, ignore_token_id = NULL)
vocabulary
ignore token
ignore token id
None