ImageGPT (Generative Pre-training from Pixels)

This video will explore the exciting new 6.8 Billion parameter ImageGPT model! The researchers show that better and larger generative models learn better representations for tasks like ImageNet classification! Thanks for watching! Please Subscribe! Paper Links: ImageGPT (Blog Post): https://ift.tt/2Yap1hh ImageGPT (Paper): https://ift.tt/2YKKAEf A Survey of Long-term Context in Transformers: https://ift.tt/38TWkam Google TPUs: https://ift.tt/2VGAtgw The Illustrated Transformer: https://ift.tt/2NLJXmf PixelCNN: https://ift.tt/30QFzMW PixelCNN (Paper): https://ift.tt/2esyBUw Contrastive Predictive Coding: https://ift.tt/2SUqOTJ Big BiGAN: https://ift.tt/2LKu9D8 BERT: https://ift.tt/2pMXn84 Rethinking Pre-training and Self-Training: https://ift.tt/2ULTfFp