SimCLR Explained!

SimCLR is able to achieve the same (~76.5% top-1 ImageNet accuracy) as a ResNet-50 trained with Supervised Learning. SimCLR has also set a new high for Semi-Supervised Learning on 1% and 10% of the data, and it performs as well as Transfer Learning from models pre-trained on ImageNet classification! This paper explains the details of the algorithm such as the composition of data augmentations, separate projection from representation to contrastive loss, and the role of scaling up in unsupervised learning! Links: SimCLR: https://ift.tt/31TZZTM CPC: https://ift.tt/2SUqOTJ ImageBERT: https://ift.tt/398zzAe Google AI Blog: Revisiting the unreasonable effectiveness of data: https://ift.tt/2sDB59U Thanks for watching! Please Subscribe!