Transformer-Rankers

Tutorials

  • Quick-start
    • Setup
    • Example

Documentation

  • transformer_rankers
    • transformer_rankers.datasets
      • transformer_rankers.datasets.dataset
        • transformer_rankers.datasets.dataset.collate_T2T_batch
        • transformer_rankers.datasets.dataset.AbstractDataloader
        • transformer_rankers.datasets.dataset.QueryDocumentDataLoader
        • transformer_rankers.datasets.dataset.QueryDocumentDataset
        • transformer_rankers.datasets.dataset.QueryPosDocNegDocDataLoader
        • transformer_rankers.datasets.dataset.QueryPosDocNegDocDataset
        • transformer_rankers.datasets.dataset.WeaklySupervisedQueryDocumentDataLoader
        • transformer_rankers.datasets.dataset.WeaklySupervisedQueryDocumentDataset
      • transformer_rankers.datasets.downloader
        • transformer_rankers.datasets.downloader.download_file_from_google_drive
        • transformer_rankers.datasets.downloader.get_confirm_token
        • transformer_rankers.datasets.downloader.save_response_content
        • transformer_rankers.datasets.downloader.DataDownloader
      • transformer_rankers.datasets.preprocess_crr
        • transformer_rankers.datasets.preprocess_crr.read_crr_tsv_as_df
        • transformer_rankers.datasets.preprocess_crr.transform_dstc8_to_tsv
      • transformer_rankers.datasets.preprocess_pr
        • transformer_rankers.datasets.preprocess_pr.transform_trec2020pr_to_dfs
      • transformer_rankers.datasets.preprocess_sqr
        • transformer_rankers.datasets.preprocess_sqr.transform_linkso_to_duplicates_dfs
        • transformer_rankers.datasets.preprocess_sqr.transform_quora_question_pairs_to_duplicates_dfs
      • transformer_rankers.datasets.processors
        • transformer_rankers.datasets.processors.clariq_processor
        • transformer_rankers.datasets.processors.linkso_processor
        • transformer_rankers.datasets.processors.mantis_processor
        • transformer_rankers.datasets.processors.msdialog_processor
        • transformer_rankers.datasets.processors.qqp_processor
        • transformer_rankers.datasets.processors.trec2020pr_processor
        • transformer_rankers.datasets.processors.ubuntu_dstc8_processor
    • transformer_rankers.eval
      • transformer_rankers.eval.evaluation
        • transformer_rankers.eval.evaluation.evaluate_models
        • transformer_rankers.eval.evaluation.recall_at_with_k_candidates
      • transformer_rankers.eval.results_analyses_tools
        • transformer_rankers.eval.results_analyses_tools.evaluate
        • transformer_rankers.eval.results_analyses_tools.evaluate_and_aggregate
    • transformer_rankers.examples
      • transformer_rankers.examples.aggregate_sacred_result_logs
        • transformer_rankers.examples.aggregate_sacred_result_logs.main
      • transformer_rankers.examples.analyze_ws
        • transformer_rankers.examples.analyze_ws.main
        • transformer_rankers.examples.analyze_ws.run_experiment
      • transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr
        • transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr.main
        • transformer_rankers.examples.bert_ranker_cross_task_cross_ns_for_crr.run_experiment
      • transformer_rankers.examples.download_task_data
        • transformer_rankers.examples.download_task_data.main
      • transformer_rankers.examples.minimal_example
        • transformer_rankers.examples.minimal_example.main
      • transformer_rankers.examples.negative_sampling
        • transformer_rankers.examples.negative_sampling.main
      • transformer_rankers.examples.pairwise_bert_ranker
        • transformer_rankers.examples.pairwise_bert_ranker.main
        • transformer_rankers.examples.pairwise_bert_ranker.run_experiment
      • transformer_rankers.examples.pointwise_bert_ranker
        • transformer_rankers.examples.pointwise_bert_ranker.main
        • transformer_rankers.examples.pointwise_bert_ranker.run_experiment
      • transformer_rankers.examples.t5_ranker
        • transformer_rankers.examples.t5_ranker.main
        • transformer_rankers.examples.t5_ranker.run_experiment
    • transformer_rankers.models
      • transformer_rankers.models.losses
        • transformer_rankers.models.losses.label_smoothing
          • transformer_rankers.models.losses.label_smoothing.LabelSmoothingCrossEntropy
          • transformer_rankers.models.losses.label_smoothing.WeaklySupervisedLabelSmoothingCrossEntropy
      • transformer_rankers.models.pairwise_bert
        • transformer_rankers.models.pairwise_bert.BertForPairwiseLearning
      • transformer_rankers.models.pointwise_bert
        • transformer_rankers.models.pointwise_bert.BertForPointwiseLearning
    • transformer_rankers.negative_samplers
      • transformer_rankers.negative_samplers.negative_sampling
        • transformer_rankers.negative_samplers.negative_sampling.BM25NegativeSamplerPyserini
        • transformer_rankers.negative_samplers.negative_sampling.RandomNegativeSampler
        • transformer_rankers.negative_samplers.negative_sampling.SentenceBERTNegativeSampler
    • transformer_rankers.scripts
      • transformer_rankers.scripts.select_ns_examples
        • transformer_rankers.scripts.select_ns_examples.main
      • transformer_rankers.scripts.train_sentenceBERT_crr
        • transformer_rankers.scripts.train_sentenceBERT_crr.main
        • transformer_rankers.scripts.train_sentenceBERT_crr.CRRBenchmarkDataReader
        • transformer_rankers.scripts.train_sentenceBERT_crr.CRRDataReader
    • transformer_rankers.trainers
      • transformer_rankers.trainers.transformer_trainer
        • transformer_rankers.trainers.transformer_trainer.TransformerTrainer
    • transformer_rankers.utils
      • transformer_rankers.utils.utils
        • transformer_rankers.utils.utils.acumulate_l1_by_l2
        • transformer_rankers.utils.utils.acumulate_list
        • transformer_rankers.utils.utils.acumulate_list_multiple_relevant
        • transformer_rankers.utils.utils.from_df_to_list_without_nans
Transformer-Rankers
  • »
  • transformer_rankers »
  • transformer_rankers.eval

transformer_rankers.evalΒΆ

Modules

transformer_rankers.eval.evaluation

transformer_rankers.eval.results_analyses_tools

Next Previous

© Copyright 2020, Gustavo Penha

Built with Sphinx using a theme provided by Read the Docs.