sgnlp.models.sentic_gcn.utils.download_tokenizer_files

download_tokenizer_files(base_url: str, save_folder: Union[str, pathlib.Path], files: List[str] = ['special_tokens_map.json', 'tokenizer_config.json', 'vocab.pkl'])None[source]

Helper method to download files from online storage.

Parameters
  • base_url (str) – Url string to storage folder.

  • save_folder (Union[str, pathlib.Path]) – Local folder to save downloaded files. Folder will be created if it does not exists.