transformer_rankers.datasets.dataset

Functions

collate_T2T_batch(batch)

Data collator for generation tasks.

Classes

AbstractDataloader(train_df, val_df, …)	Abstract class for the DataLoaders.
QueryDocumentDataLoader(train_df, val_df, …)
QueryDocumentDataset(data, tokenizer, …[, …])	Dataset for pointwise learning with <Query,Document> pairs.
QueryPosDocNegDocDataLoader(train_df, …)
QueryPosDocNegDocDataset(data, tokenizer, …)	Dataset for pairwise learning with <Query,PosDoc,NegDoc> triplets.
WeaklySupervisedQueryDocumentDataLoader(…)
WeaklySupervisedQueryDocumentDataset(data, …)	Dataset for pointwise learning with <Query,Document> pairs with Weak Supervision.