Transformer-Rankers
Tutorials
Quick-start
Setup
Example
Documentation
transformer_rankers
transformer_rankers.datasets
transformer_rankers.datasets.dataset
transformer_rankers.datasets.dataset.collate_T2T_batch
transformer_rankers.datasets.dataset.AbstractDataloader
transformer_rankers.datasets.dataset.QueryDocumentDataLoader
transformer_rankers.datasets.dataset.QueryDocumentDataset
transformer_rankers.datasets.dataset.QueryPosDocNegDocDataLoader
transformer_rankers.datasets.dataset.QueryPosDocNegDocDataset
transformer_rankers.datasets.dataset.WeaklySupervisedQueryDocumentDataLoader
transformer_rankers.datasets.dataset.WeaklySupervisedQueryDocumentDataset
transformer_rankers.datasets.downloader
transformer_rankers.datasets.downloader.download_file_from_google_drive
transformer_rankers.datasets.downloader.get_confirm_token
transformer_rankers.datasets.downloader.save_response_content
transformer_rankers.datasets.downloader.DataDownloader
transformer_rankers.datasets.preprocess_crr
transformer_rankers.datasets.preprocess_crr.read_crr_tsv_as_df
transformer_rankers.datasets.preprocess_crr.transform_dstc8_to_tsv
transformer_rankers.datasets.preprocess_pr
transformer_rankers.datasets.preprocess_pr.transform_trec2020pr_to_dfs
transformer_rankers.datasets.preprocess_sqr
transformer_rankers.datasets.preprocess_sqr.transform_linkso_to_duplicates_dfs
transformer_rankers.datasets.preprocess_sqr.transform_quora_question_pairs_to_duplicates_dfs
transformer_rankers.datasets.processors
transformer_rankers.datasets.processors.clariq_processor
transformer_rankers.datasets.processors.linkso_processor
transformer_rankers.datasets.processors.mantis_processor
transformer_rankers.datasets.processors.msdialog_processor
transformer_rankers.datasets.processors.qqp_processor
transformer_rankers.datasets.processors.trec2020pr_processor
transformer_rankers.datasets.processors.ubuntu_dstc8_processor
transformer_rankers.eval
transformer_rankers.eval.evaluation
transformer_rankers.eval.evaluation.evaluate_models
transformer_rankers.eval.evaluation.recall_at_with_k_candidates
transformer_rankers.eval.results_analyses_tools
transformer_rankers.eval.results_analyses_tools.evaluate
transformer_rankers.eval.results_analyses_tools.evaluate_and_aggregate
transformer_rankers.examples
transformer_rankers.examples.aggregate_sacred_result_logs
transformer_rankers.examples.aggregate_sacred_result_logs.main
transformer_rankers.examples.analyze_ws
transformer_rankers.examples.analyze_ws.main
transformer_rankers.examples.analyze_ws.run_experiment
transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr
transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr.main
transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr.run_experiment
transformer_rankers.examples.download_task_data
transformer_rankers.examples.download_task_data.main
transformer_rankers.examples.minimal_example
transformer_rankers.examples.minimal_example.main
transformer_rankers.examples.negative_sampling
transformer_rankers.examples.negative_sampling.main
transformer_rankers.examples.pairwise_bert_ranker
transformer_rankers.examples.pairwise_bert_ranker.main
transformer_rankers.examples.pairwise_bert_ranker.run_experiment
transformer_rankers.examples.pointwise_bert_ranker
transformer_rankers.examples.pointwise_bert_ranker.main
transformer_rankers.examples.pointwise_bert_ranker.run_experiment
transformer_rankers.examples.t5_ranker
transformer_rankers.examples.t5_ranker.main
transformer_rankers.examples.t5_ranker.run_experiment
transformer_rankers.models
transformer_rankers.models.losses
transformer_rankers.models.losses.label_smoothing
transformer_rankers.models.losses.label_smoothing.LabelSmoothingCrossEntropy
transformer_rankers.models.losses.label_smoothing.WeaklySupervisedLabelSmoothingCrossEntropy
transformer_rankers.models.pairwise_bert
transformer_rankers.models.pairwise_bert.BertForPairwiseLearning
transformer_rankers.models.pointwise_bert
transformer_rankers.models.pointwise_bert.BertForPointwiseLearning
transformer_rankers.negative_samplers
transformer_rankers.negative_samplers.negative_sampling
transformer_rankers.negative_samplers.negative_sampling.BM25NegativeSamplerPyserini
transformer_rankers.negative_samplers.negative_sampling.RandomNegativeSampler
transformer_rankers.negative_samplers.negative_sampling.SentenceBERTNegativeSampler
transformer_rankers.scripts
transformer_rankers.scripts.select_ns_examples
transformer_rankers.scripts.select_ns_examples.main
transformer_rankers.scripts.train_sentenceBERT_crr
transformer_rankers.scripts.train_sentenceBERT_crr.main
transformer_rankers.scripts.train_sentenceBERT_crr.CRRBenchmarkDataReader
transformer_rankers.scripts.train_sentenceBERT_crr.CRRDataReader
transformer_rankers.trainers
transformer_rankers.trainers.transformer_trainer
transformer_rankers.trainers.transformer_trainer.TransformerTrainer
transformer_rankers.utils
transformer_rankers.utils.utils
transformer_rankers.utils.utils.acumulate_l1_by_l2
transformer_rankers.utils.utils.acumulate_list
transformer_rankers.utils.utils.acumulate_list_multiple_relevant
transformer_rankers.utils.utils.from_df_to_list_without_nans
Transformer-Rankers
»
transformer_rankers
»
transformer_rankers.eval
»
transformer_rankers.eval.results_analyses_tools
»
transformer_rankers.eval.results_analyses_tools.evaluate
transformer_rankers.eval.results_analyses_tools.evaluate
¶
transformer_rankers.eval.results_analyses_tools.
evaluate
(
preds
,
labels
)
[source]
¶