sgnlp
Quickstart
Advanced Tutorial
API Reference
models
csgec
emotion_entailment
lsr
rst_pointer
rumour_detection_twitter
config
modeling
modules
tokenization
train
utils
sentic_gcn
span_extraction
ufd
utils
sgnlp
»
sgnlp
»
models
»
rumour_detection_twitter
»
utils
»
sgnlp.models.rumour_detection_twitter.utils.load_transform_dataset
View page source
sgnlp.models.rumour_detection_twitter.utils.load_transform_dataset
¶
load_transform_dataset
(
data_path
,
batch_size
,
tokenizer
,
split
,
max_tokens
,
max_posts
,
post_padding_idx
,
time_padding_idx
)
[source]
¶
data_path
Path to the data json file
batch_size
int
Batch size
tokenizer
RumourDetectionTokenizer
Tokenizer object for tweets