tokenizationΒΆ

Classes

RecconEmotionEntailmentTokenizer

Constructs a Reccon Emotion Entailment tokenizer, derived from the RoBERTa tokenizer, using byte-level Byte-Pair-Encoding.