Contrastive_Learning_Papers

A list of papers in contrastive learning.

Computer Vision

Year	Title	Venue	Code
2021	Detco: Unsupervised contrastive learning for object detection	arxiv	Code
2021	SEED: Self-supervised Distillation For Visual Representation	ICLR	Code
2021	PROTOTYPICAL CONTRASTIVE LEARNING OF UNSUPERVISED REPRESENTATIONS	ICLR	Code
2021	Training GANs with Stronger Augmentations via Contrastive Discriminator	ICLR	Code
2021	VIEWMAKER NETWORKS: LEARNING VIEWS FOR UNSUPERVISED REPRESENTATION LEARNING	ICLR	Code
2021	Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning	ICLR	Code
2021	Active Contrastive Learning of Audio-Visual Video Representations	ICLR	Code
2021	Conditional Negative Sampling for Contrastive Learning of Visual Representations	ICLR	Code
2021	Learning a Few-shot Embedding Model with Contrastive Learning	AAAI	Code
2021	Contrastive Learning with Stronger Augmentations	IEEE	Code
2021	Dual Contrastive Learning for Unsupervised Image-to-Image Translation	NTIRE	Code
2021	With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations	DeepMind	code
2021	How Well Do Self-Supervised Models Transfer?	CVPR	Code
2021	Self-supervised Pretraining of Visual Features in the Wild	arxiv	Code
2021	VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples	CVPR	Code
2021	Temporal Contrastive Graph Learning for Video Action Recognition and Retrieval	arxiv	code
2021	Social NCE: Contrastive Learning of Socially-aware Motion Representations	arxiv	Code
2021	Spatiotemporal Contrastive Video Representation Learning	CVPR	Code
2021	What Should Not Be Contrastive in Contrastive Learning	ICLR	code
2020	A Simple Framework for Contrastive Learning of Visual Representations	ICML	Code
2020	Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning	arxiv	Code
2020	CASTing Your Model:Learning to Localize Improves Self-Supervised Representations	arxiv	code
2020	Exploring Simple Siamese Representation Learning	arxiv	code
2020	Hard Negative Mixing for Contrastive Learning	NeurIPS	code
2020	Representation Learning via Invariant Causal Mechanisms	arxiv	code
2020	Are all negatives created equal in contrastive instance discrimination?	arxiv	code
2020	Bootstrap your own latent: A new approach to self-supervised Learning	arxiv	Code
2020	Augmented Skeleton Based Contrastive Action Learning with Momentum LSTM for Unsupervised Action Recognition	Information Sciences	Code
2020	Deep Robust Clustering by Contrastive Learning	arxiv	code
2020	Contrastive Learning for Unpaired Image-to-Image Translation	ECCV	Code
2020	Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases	arxiv	code
2020	Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework	ACMMM	Code
2020	Unsupervised Learning of Visual Features by Contrasting Cluster Assignments	NeurIPS	Code
2020	Contrastive Learning with Adversarial Examples	NeurIPS	code
2020	ContraGAN: Contrastive Learning for Conditional Image Generation	NeurIPS	Code
2020	Prototypical Contrastive Learning of Unsupervised Representations	arxiv	Code
2020	CLOCS: Contrastive Learning of Cardiac Signals	arxiv	code
2020	On Mutual Information in Contrastive Learning for Visual Representations	arxiv	code
2020	What makes for good views for contrastive learning	ECCV	Code
2020	CURL: Contrastive Unsupervised Representations for Reinforcement Learning	arxiv	Code
2020	Supervised Contrastive Learning	arxiv	Code
2020	Clustering based Contrastive Learning for Improving Face Representations	IEEE	code
2020	Improved Baselines with Momentum Contrastive Learning	arxiv	Code
2020	Self-labelling via simultaneous clustering and representation learning	ICLR	Code
2020	Momentum Contrast for Unsupervised Visual Representation Learning	CVPR	Code
2020	Self-Supervised Learning of Pretext-Invariant Representations	CVPR/IEEE	code
2020	Data-Efficient Image Recognition with Contrastive Predictive Coding	arxiv	Code
2020	Contrastive Multiview Coding	arxiv	Code
2019	Transferable Contrastive Network for Generalized Zero-Shot Learning	ICCV	Code
2019	Selfie: Self-supervised Pretraining for Image Embedding	arxiv	Code
2019	Local Aggregation for Unsupervised Learning of Visual Embeddings	arxiv	Code
2019	Learning Representations by Maximizing Mutual Information Across Views	arxiv	Code
2019	Unsupervised Embedding Learning via Invariant and Spreading Instance Feature	CVPR	Code
2019	Invariant Information Clustering for Unsupervised Image Classification and Segmentation	ICCV	Code
2019	Learning deep representations by mutual information estimation and maximization	ICLR	Code
2019	Representation Learning with Contrastive Predictive Coding	arxiv	Code
2018	Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination	CVPR	Code
2018	Time-Contrastive Networks: Self-Supervised Learning from Video	arxiv	Code
2017	Multi-task Self-Supervised Visual Learning	ICCV	code
2016	Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles	ECCV	Code
2015	Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks	arxiv	Code
2010	Noise-contrastive estimation: A new estimation principle for unnormalized statistical models	AISTATS	code

Natural Language Processing

Year	Title	Venue	Code
2021	Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning	EMNLP	Code
2021	CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding	ACL	Code
2021	Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning	ICLR	Code
2021	Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval	ICLR	Code
2021	Contrastive Learning with Adversarial Perturbations for Conditional Text Generation	ICLR	Code
2021	Prototypical Contrastive Learning of Unsupervised Representations	ICLR	Code
2021	Contrastive Learning with Hard Negative Samples	ICLR	Code
2021	FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders	ICLR	Code
2021	Self-Supervised Contrastive Learning for Efficient User Satisfaction Prediction in Conversational Agents	NAACL	Code
2021	SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency	NAACL	Code
2021	Supporting Clustering with Contrastive Learning	NAACL	Code
2021	Understanding Hard Negatives in Noise Contrastive Estimation	NAACL	Code
2021	Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis	NAACL	Code
2021	Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach	NAACL	Code
2021	COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining	arxiv	Code
2021	SimCSE: Simple Contrastive Learning of Sentence Embeddings	EMNLP	Code
2021	A Simple and Effective Self-Supervised Contrastive Learning Framework for Aspect Detection	AAAI	Code
2020	ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators	ICLR	Code
2020	DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations	arxiv	Code
2020	Pretraining with Contrastive Sentence Objectives Improves Discourse Performance of Language Models	ACL	Code
2020	CLEAR: Contrastive Learning for Sentence Representation	arxiv	code
2020	CERT: Contrastive Self-supervised Learning for Language Understanding	arxiv	code
2019	A Theoretical Analysis of Contrastive Unsupervised Representation Learning	arxiv	code
2019	Representation Learning with Contrastive Predictive Coding	arxiv	Code

Graph

Year	Title	Venue	Code
2021	An Empirical Study of Graph Contrastive Learning	arxiv	code
2021	Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning	KDD	code
2021	Enhanced Graph Learning for Collaborative Filtering via Mutual Information Maximization	SIGIR	code
2021	Self-supervised Graph Learning for Recommendation	SIGIR	code
2021	Graph Contrastive Learning with Adaptive Augmentation	TheWeb	code
2020	Contrastive Self-supervised Learning for Graph Classification	arxiv	code
2020	Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learning	ICDM	code
2020	GraphCL: Contrastive Self-Supervised Learning of Graph Representations	Neurips	code
2020	Deep Graph Contrastive Representation Learning	arxiv	Code
2020	Graph Contrastive Learning with Augmentations	NeurIPS	Code
2020	Gcc: Graph contrastive coding for graph neural network pre-training	KDD	Code
2019	Deep Graph Infomax	ICLR	Code

Recommender System

Year	Title	Venue	Code
2022	Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation	WSDM	code
2021	Contrastive Self-supervised Sequential Recommendation with Robust Augmentation	arxiv	code
2021	Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems	SIGIR	Code
2021	Self-supervised Graph Learning for Recommendation	SIGIR	Code
2021	Contrastive Pre-training for Sequential Recommendation	arxiv	Code
2021	Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation	WWW	Code
2021	SELFCF: A Simple Framework for Self-supervised Collaborative Filtering	arxiv	Code
2020	Self-supervised Learning for Large-scale Item Recommendations	arxiv	code
2020	S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization	CIKM	code

Survey

Year	Title	Venue	Code
2022	Self-Supervised Learning for Recommender Systems: A Survey	arxiv	code
2021	Graph Self-Supervised Learning: A Survey	arxiv	code
2021	Self-supervised on Graphs: Contrastive, Generative,or Predictive	arxiv	code
2021	Self-supervised Learning: Generative or Contrastive	arxiv	code
2021	Self-Supervised Learning of Graph Neural Networks: A Unified Review	arxiv	code
2021	A survey on contrastive self-supervised learning	MDPI	code

Others

Year	Title	Venue	Code
2021	Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning	AAAI	code

Future Plan

Welcome to join us to expand this repo. In the future, we hope to make this list into finer categorizations. We know that in the computer vision and natural language processing area, there are already a lot of sub-areas are researching the contrastive learning. Therefore, it is important to create some sub-category to include those papers. Feel free to contact us if you are interested: [email protected]