sgnlp.models.ufd.utils.generate_train_val_dataset

generate_train_val_dataset(cfg: sgnlp.models.ufd.data_class.UFDArguments) → Tuple[Dict[str, float]]

Helper function to generate train and validation datasets.

Load dataset object from cache if available, else call the dataset embeddings creation methods.

Parameters

cfg (UFDArguments) – UFDArguments config load from configuration file

Returns

return the generated train and validation dictionaries.

Return type

Tuple(Dict[str, float])