Pattern-Exploiting Training for NLP!

This video explains Pattern-Exploiting Training (PET), a new technique to leverage pre-trained language models to label data for downstream tasks such as Text Classification or Natural Language Inference. This is done by introducing "patterns" or templates that guide the language model to label the review or pair of sentences. This also include a "verbalizer" that maps from the language model's vocabulary into downstream task labels! This tutorial also uses HuggingFace's NLP viewer and Renato Violin's Next Word Prediction Demo that I highly recommend checking out! Thank you for watching! Please Subscribe! Links: Paper (Pattern-Exploiting Training): https://ift.tt/2X7MuPK HuggingFace NLP Viewer: https://ift.tt/2ZRJXL4 Next-Word-Prediction: https://ift.tt/3gjQUue PragmaticML blog summary of PET: https://ift.tt/3dCn2Y8 Self-Training with Noisy Student: https://ift.tt/2Q8GfYV FixMatch: https://ift.tt/2upcQ3A