sgnlp.models.csgec.utils.download_tokenizer_files

download_tokenizer_files(base_url: str, local_path: str) → None[source]

Download all required files for tokenizer from online storage.

Parameters

  • base_url (str) – Base url of storage location.

  • local_path (str) – path ot the folder on the local machine.