transformer_rankers.datasets.preprocess_sqr.transform_quora_question_pairs_to_duplicates_dfs

transformer_rankers.datasets.preprocess_sqr.transform_quora_question_pairs_to_duplicates_dfs(path)[source]

Transforms quora question pairs train.csv to train, test and valid pandas DF [“Q1”, “Q2”] containing only duplicated questions.

Parameters

path – str with the path for the csv file.

Returns: (train, valid, test) pandas DataFrames