Transfer learning and Transformer models (ML Tech Talks)

In this session of Machine Learning Tech Talks, Software Engineer from Google Research, Iulia Turc, will walk us through the recent history of natural language processing, including the current state of the art architecture, the Transformer. 0:00 - Intro 1:07 - Encoding text 8:21 - Language modeling & transformers 29:46 - Transfer learning & BERT 43:55 - Conclusion Catch more ML Tech Talks → http://goo.gle/ml-tech-talks Subscribe to TensorFlow → https://goo.gle/TensorFlow