tokenization
============

.. automodule:: sgnlp.models.ufd.tokenization

   
   
   

   
   
   

   
   
   .. rubric:: Classes

   .. autosummary::
      :toctree:
      :template: custom-class-template.rst
      :nosignatures:
   
      UFDTokenizer