transformer_rankers.datasets.preprocess_sqr

Functions

transform_linkso_to_duplicates_dfs(path)

Transforms linkso files to train, test and valid pandas DF [“Q1”, “Q2”] containing only duplicated questions.

transform_quora_question_pairs_to_duplicates_dfs(path)

Transforms quora question pairs train.csv to train, test and valid pandas DF [“Q1”, “Q2”] containing only duplicated questions.