Deep Learning Chatbot R&D

Me toying around with the scored outputs of 20-something models, trying to figure out how to find the best answers. Neural Networks from Scratch: https://nnfs.io Chat response samples: https://ift.tt/2Jq1Bwj Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq

Agent57: Outperforming the Atari Human Benchmark

DeepMind's Agent57 is the first RL agent to outperform humans in all 57 Atari benchmark games. It extends previous algorithms like Never Give Up and R2D2 by meta-learning the exploration-exploitation tradeoff controls. https://ift.tt/39xTXKX https://ift.tt/3aIfim0 Abstract: Atari games have been a long-standing benchmark in the reinforcement learning (RL) community for the past decade. This benchmark was proposed to test general competency of RL algorithms. Previous work has achieved good average performance by doing outstandingly well on many games of the set, but very poorly in several of the most challenging games. We propose Agent57, the first deep RL agent that outperforms the standard human benchmark on all 57 Atari games. To achieve this result, we train a neural network which parameterizes a family of policies ranging from very exploratory to purely exploitative. We propose an adaptive mechanism to choose which policy to prioritize throughout the training process. Additionally, we utilize a novel parameterization of the architecture that allows for more consistent and stable learning. Authors: Adrià Puigdomènech Badia, Bilal Piot, Steven Kapturowski, Pablo Sprechmann, Alex Vitvitskyi, Daniel Guo, Charles Blundell Links: YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher BitChute: https://ift.tt/38iX6OV Minds: https://ift.tt/37igBpB

Is Visualizing Light Waves Possible? ☀️

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf Their blog post is available here: https://ift.tt/2uLfOzJ 📝 The paper "Progressive Transient Photon Beams" is available here: https://ift.tt/2V3IkX1 📝 The paper "Femto-Photography: Capturing and Visualizing the Propagation of Light" is available here: https://ift.tt/33WLOyu My light transport course is available here: https://ift.tt/2rdtvDu The paper with the image of the shown caustics is available here: https://ift.tt/2kEcw8R  🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

TensorFlow Lite for Microcontrollers (TF Dev Summit '20)

TensorFlow Lite for Microcontrollers or TFLite Micro is designed to run machine learning models on microcontrollers and other embedded devices. The key advantages are low energy consumption, small size, network connectivity is not required, privacy by running inference on-device and a large scale impact as billions of microcontrollers are embedded within hardware every year. In this video, we demostrate running a tiny ~250KB binary image classification model which detects if a person is present in the image captured by the SparkFunEdge microcontroller (https://goo.gle/3auscnH). If the microcontroller detects a person, the green LED lights up; otherwise the orange LED lights up. Every time it runs an inference, the blue LED toggles. Speakers: Meghna Natraj - Software Engineer Pete Warden - Staff Software Engineer Jason Mayes - Senior Developer Advocate Here are some resources to get started: Website → https://goo.gle/2yiYyUl Github → https://goo.gle/2UsBkDW Examples (generate a sine wave, person detection, simple audio recognition, magic wand) → https://goo.gle/3dGu3rq Advanced resources: TinyML Book → https://goo.gle/2JqBZPI Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Enterprise (TF Dev Summit '20)

TensorFlow Enterprise delivers enterprise-grade support, performance, and managed services for your AI workloads. TensorFlow Enterprise is the only offering brought to you by the creators of TensorFlow. In this video you will learn how easy is to get started with TensorFlow Enterprise in Google Cloud. Speakers: Gonzalo Gasca Meza - Developer Programs Engineer Jason Mayes - Senior Developer Advocate Resources: Getting started with TensorFlow Enterprise → https://goo.gle/2Usvhit TensorFlow Enterprise Overview → https://goo.gle/2UIW0qc Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Fairness Indicators for TensorFlow (TF Dev Summit '20)

Within this TensorFlow Dev Summit demo we will explore two case studies using Fairness Indicators. The first notebook demonstrates an easy way to create and optimize constrained problems using the TFCO library. This method can be useful in improving models when we find that they’re not performing equally well across different slices of our data, which we can identify using Fairness Indicators. Second, we will use Fairness Indivatores with the larger TensorFlow Ecosystem to show how Machine Learning Metadata (MLMD) and the lineage tracking ability can be useful for fairness while working in TensorFlow Extended (TFX). Speakers: Thomas Greenspan - Software Engineer Sean O'Keefe - Software Engineer Jason Mayes - Senior Developer Advocate Resources: Fairness Indicators Lineage Case Study → https://goo.gle/3avg3in Fairness Indicators and TF Constrained Optimization Case Study → https://goo.gle/3bxAgnR TensorFlow Constrained Optimization → https://goo.gle/2WUp5RV FAT* Understanding the Context and Consequences of Pre-trial Detention → https://goo.gle/2ydC0Eh Partnership on AI: Report on Algorithmic Risk Assessment Tools in the U.S. Criminal Justice System → https://goo.gle/2JnnBIf Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Profiler demo (TF Dev Summit '20)

Learn about TensorFlow Profiler: TensorFlow's performance profiler which provides a wide range of tools across GPU/TPU/CPU for understanding overall performance, analyzing input pipelines, viewing traces, and a lot more. Speakers: Jiho Choi - Software Engineer Ewa Matejska - Technical Program Manager Resources: Colab tutorial → https://goo.gle/39HlRox In-depth guide → https://goo.gle/2Qs7RHU TF Dev Summit talk → https://goo.gle/3dxg07D GitHub repo → https://goo.gle/33NXm79 Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow.js (TF Dev Summit '20)

TensorFlow.js allows you to use machine learning anywhere that JavaScript can run - which is pretty much everywhere! Check out our latest easy to use machine learning models we launched this year: 1. FaceMesh which can detect 486 points on a human face in real time enabling AR or whatever creative idea you may have. 2. HandPose - which can track 21 unique points of a human hand enabling you to recognize a gesture for example 3. Mobile BERT - cutting edge natural language processing model can now be used in the browser to answer questions about any piece of text you pass it. Speakers: Jason Mayes - Senior Developer Advocate Ewa Matejska - Technical Program Manager Resources: Learn more about Face Mesh and Hand Pose here → https://goo.gle/2WTCwSc Learn more about Mobile Bert here → https://goo.gle/3atbSnh To get started with TensorFlow.js check out our website (https://goo.gle/2XLhMe0), or find us on Glitch (https://goo.gle/2WUuhp4) and CodePen (https://goo.gle/2JoH0bE) to fork ready to run examples! Tag us with anything you create for a chance to be featured at future events using #MadeWithTFJS on social media. FaceMesh Model → https://goo.gle/2xAuR0s HandPose Model → https://goo.gle/2QUubtP BERT Q&A Model → https://goo.gle/2JqBrt7 Learn more about TF.js → https://goo.gle/2XLhMe0 Use #MadeWithTFJS on social to show us what you make! Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Extended (TF Dev Summit '20)

TensorFlow Extended (TFX) is an end-to-end platform for deploying production ML pipelines. This videos shows how you can combine the power of TFX and native Keras API in Tensorflow to make your modeling easier. Speakers: Zhitao Li - Software Engineer Ewa Matejska - Technical Program Manager Homepage → https://goo.gle/2YymOcC Github → https://goo.gle/337fW9J Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorBoard (TF Dev Summit '20)

Learn about TensorBoard: TensorFlow's visualization toolkit, and how to share your research with the world through TensorBoard.dev. Speakers: Gal Oshri - Product Manager Ewa Matejska - Technical Program Manager Resources: Getting started with TensorBoard → https://goo.gle/2WTvCg0 Easily host, track, and share with TensorBoard.dev → https://goo.gle/2qwvFAv Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Lite: Reference app gallery (TF Dev Summit '20)

TFLite developed more than 10 example apps that show not only how to use the model, but also the E2E code the developer will need to write. This video demonstrates three of the latest ones, MobileBert Q&A, Pose Estimation, and Style transfer. Speakers: Lu Wang - Software Engineer Ewa Matejska - Technical Program Manager Resources: TFLite example apps → https://goo.gle/3byxWNf Pretrained TFLite models on TFHub → https://goo.gle/2Uvr3a9 Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Axial Attention & MetNet: A Neural Weather Model for Precipitation Forecasting

MetNet is a predictive neural network model for weather prediction. It uses axial attention to capture long-range dependencies. Axial attention decomposes attention layers over images into row-attention and column-attention in order to save memory and computation. https://ift.tt/2ybtXIp https://ift.tt/36be9RR Abstract: Weather forecasting is a long standing scientific challenge with direct social and economic impact. The task is suitable for deep neural networks due to vast amounts of continuously collected data and a rich spatial and temporal structure that presents long range dependencies. We introduce MetNet, a neural network that forecasts precipitation up to 8 hours into the future at the high spatial resolution of 1 km2 and at the temporal resolution of 2 minutes with a latency in the order of seconds. MetNet takes as input radar and satellite data and forecast lead time and produces a probabilistic precipitation map. The architecture uses axial self-attention to aggregate the global context from a large input patch corresponding to a million square kilometers. We evaluate the performance of MetNet at various precipitation thresholds and find that MetNet outperforms Numerical Weather Prediction at forecasts of up to 7 to 8 hours on the scale of the continental United States. Authors: Casper Kaae Sønderby, Lasse Espeholt, Jonathan Heek, Mostafa Dehghani, Avital Oliver,Tim Salimans, Shreya Agrawal, Jason Hickey, Nal Kalchbrenner Links: YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher BitChute: https://ift.tt/38iX6OV Minds: https://ift.tt/37igBpB

Stay Home, & Let's Make A Game Together (PART III)

I don't know about you, but im bored. Let's get together & make a game together! :D JABRILS DOCUMENTARY: https://www.youtube.com/watch?v=kSKpxobfvEc SUBSCRIBE FOR MORE: http://jabrils.com/yt WISHLIST MY VIDEO GAME: https://ift.tt/33NgHFz SUPPORT ON PATREON: https://ift.tt/2pZACkg JOIN DISCORD: https://ift.tt/2QkDa9O Please follow me on social networks: twitter: https://twitter.com/jabrils_ instagram: https://ift.tt/2QNVYvI REMEMBER TO ALWAYS FEED YOUR CURIOSITY

Everybody Can Make DeepFakes Now!

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf Their blog post is available here: https://ift.tt/2u2vEG4 📝 The paper "First Order Motion Model for Image Animation" and its source code are available here: https://ift.tt/35psoRV Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m #DeepFakes

Stay Home, & Let's Make A Game Together (PART II)

I don't know about you, but im bored. Let's get together & make a game together! :D SUBSCRIBE FOR MORE: http://jabrils.com/yt WISHLIST MY VIDEO GAME: https://ift.tt/33NgHFz SUPPORT ON PATREON: https://ift.tt/2pZACkg JOIN DISCORD: https://ift.tt/2QkDa9O Please follow me on social networks: twitter: https://twitter.com/jabrils_ instagram: https://ift.tt/2QNVYvI REMEMBER TO ALWAYS FEED YOUR CURIOSITY

Meta Pseudo Labels

This video explains Meta Pseudo Labels! This is a really interesting algorithm for dynamically adapting the ground truth targets (y) while training a classification network. This is done by training a teacher network via gradient through a gradient to label images such that the classifier performs well on a held-out validation set. Thanks for watching! Please Subscribe! Paper Links: Meta Pseudo Labels: https://ift.tt/2JkDP4U UDA: https://ift.tt/37B0FPb Generative Teaching Networks: https://ift.tt/2w8Yd64 When Does Label Smoothing Help? https://ift.tt/2JuThuN Self-Training with Noisy Student: https://ift.tt/2warw7S FixMatch: https://ift.tt/3bU1Bll RandAugment: https://ift.tt/2QRHZ8l Thanks for watching, please subscribe!

Stay Home, & Let's Make A Game Together

I don't know about you, but im bored. Let's get together & make a game together! :D SUBSCRIBE FOR MORE: http://jabrils.com/yt WISHLIST MY VIDEO GAME: https://ift.tt/33NgHFz SUPPORT ON PATREON: https://ift.tt/2pZACkg JOIN DISCORD: https://ift.tt/2QkDa9O Please follow me on social networks: twitter: https://twitter.com/jabrils_ instagram: https://ift.tt/2QNVYvI REMEMBER TO ALWAYS FEED YOUR CURIOSITY

GAN Compression

This video explains the paper "GAN Compression: Efficient Architectures for Interactive Conditional GANs"! This technique adapts Knowledge Distillation for the GAN framework by copying intermediate features from the teacher to student generator, transferring the pre-trained teacher discriminator, and structuring image-to-image translation problems in the "paired" setting by using the teacher generator image as the ground truth image. This paper also explores the use of One-Shot Neural Architecture Search to find an efficient architecture for the student generator network! Thanks for watching, Please Subscribe! Paper Links: GAN Compression: https://ift.tt/2QLxjIg GAN Compression Video Demo from Authors: https://www.youtube.com/watch?v=31AhcLqWc68&list=PL80kAHvQbh-r5R8UmXhQK1ndqRvPNw_ex&index=3&t=0s Pix2Pix: https://ift.tt/2kPCvgx CycleGAN: https://ift.tt/2opD3rk GauGAN: https://ift.tt/2CsbLsZ AVID: https://ift.tt/2xoCvLo DermGAN: https://ift.tt/2vwCAMt SimGAN: https://ift.tt/2ohC3bJ MobileNets: https://ift.tt/2o1bEiR One-Shot Neural Architecture Search: https://ift.tt/2JgmmdK Intro Music: "Runs" from Unminus Thanks for watching! Please Subscribe!

Can Self-Driving Cars Learn Depth Perception? 🚘

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf The showcased instrumentation post is available here: https://ift.tt/3dqc0G9 📝 The paper "Unsupervised Learning of Depth and Ego-Motion from Video" is available here: https://ift.tt/2qebod5  🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

coronavirus

A rant about toilet paper and lockdowns. Links: YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher BitChute: https://ift.tt/38iX6OV Minds: https://ift.tt/37igBpB

Online Education - How I Make My Videos

Just a short overview of tools I use to make my videos. OneNote - https://www.onenote.com iSpring Free Cam - https://ift.tt/3adfVUD Shotcut - https://shotcut.org Slack - https://slack.com RocketChat - https://rocket.chat Zoom - https://zoom.us Jitsi - https://jitsi.org GDocs - https://ift.tt/2bRl0Uq Piazza - https://piazza.com CMT - https://ift.tt/397SHhb Links: YouTube: https://www.youtube.com/c/yannickilcher Twitter: https://twitter.com/ykilcher BitChute: https://ift.tt/38iX6OV Minds: https://ift.tt/37igBpB

Google’s Chatbot: Almost Perfect

❤️ Check out Lambda here and sign up for their GPU Cloud: https://ift.tt/35NkCT7 📝 The paper "Towards a Human-like Open-Domain Chatbot" is available here: https://ift.tt/2Gs7FTx ❤️ Watch these videos in early access on our Patreon page or join us here on YouTube: - https://ift.tt/2icTBUb - https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg/join 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

First hour with a Kaggle Challenge

Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq

Scaling Tensorflow data processing with tf.data (TF Dev Summit '20)

As model training becomes more distributed in nature, tf.data has evolved to be more distribution aware and performant. This talk presents tf.data tools for scaling TensorFlow data processing. In particular: tf.data service that allows your tf.data pipeline to run on a cluster of machines, and tf.data.snapshot that materializes the results to disk for reuses across multiple invocations. Speaker: Rohan Jain - Staff Software Engineer Resources: GitHub Distributed tf.data service → https://goo.gle/2VrYDi2 tf.data: Build TensorFlow input pipelines → https://goo.gle/2VTnnjk Better performance with the tf.data API → https://goo.gle/38wyKAy GitHub tf.data snapshot → https://goo.gle/2v42Ai8 Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Enhanced POET: Open-Ended Reinforcement Learning

This video will explain details behind the new Enhanced POET algorithm from Uber AI Labs! This is a really exciting algorithm for the co-evolution of agents and the environments they learn in! Extensions in this paper make the framework applicable to more general Machine Learning problems after being originally proven on Bipedal Walking agents. A very interesting finding from this study is that agents cannot be optimized from scratch to solve the complex environments that arise out of this co-evolution! Thanks for watching! Please Subscribe! Paper Links: Enhanced POET: https://ift.tt/2J4X81K Original POET: https://ift.tt/2xUnFwp Generative Teaching Networks: https://ift.tt/2w8Yd64 Learning to Continually Learn: https://ift.tt/2VG7dKi Thanks for watching! Please Subscribe!

TensorFlow Hub: Making model discovery easy (TF Dev Summit '20)

TF Hub is the main repository for ML models. This talk looks into all the new features and how you can use Hub in your model discovery journey. Speaker: Sandeep Gupta - Product Manager Resources: TensorFlow Hub → https://goo.gle/32XwUY9 GitHub → https://goo.gle/3cGLdFc Neural style transfer → https://goo.gle/2VPlqEE Text classification with TensorFlow Hub → https://goo.gle/2VQZHMp Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Performance profiling in TF 2 (TF Dev Summit '20)

This talk presents a profiler that Google internally uses to investigate TF performance on platforms including GPU, TPU, and CPU. Speaker: Qiumin Xu - Software Engineer Resource: TensorBoard Profile → https://goo.gle/39HlRox Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Jacquard: Embedding ML seamlessly into everyday objects (TF Dev Summit '20)

Jacquard is an ML-powered ambient computing platform that takes ordinary, familiar objects and enhances them with new digital abilities and experiences, while remaining true to their original purpose. We'll describe how we have trained and deployed resource-constrained machine learning models that get embedded seamlessly into everyday garments and accessories; like your favorite jacket, backpack, or a pair of shoes that you love to wear. Speaker: Nicholas Gillian - Lead Machine Learning Engineer, ATAP Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Research with TensorFlow (TF Dev Summit '20)

In this talk we'll go over some interesting features of TF which are useful when doing research. Speaker: Alexandre Passos - Software Engineer Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Deep Video Object Tracking - Xavier Giro - UPC Barcelona 2020

Lecture in the Master in Computer Vision Barcelona 2020. It reviews the state of the art in video object tracking using deep learning techniques.

TFRT: A new TensorFlow runtime (TF Dev Summit '20)

TFRT is a new runtime for TensorFlow. Leveraging MLIR, it aims to provide a unified, extensible infrastructure layer with best-in-class performance across a wide variety of domain specific hardware. This approach provides efficient use of the multithreaded host CPUs, supports fully asynchronous programming models, and is focused on low-level efficiency. Speaker: Mingsheng Hong - Senior Staff Software Engineer Resource: Join the group → https://goo.gle/3av1pak Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

MLIR: Accelerating TF with compilers (TF Dev Summit '20)

This talk will describe MLIR - machine learning compiler infrastructure for TensorFlow and explain how it helps TensorFlow to scale faster to meet the needs of rapidly evolving machine learning software and hardware. Speaker: Jacques Pienaar - Software Engineer Links: MLIR project site (documentation, tutorial, links to source code, discussion forums) → https://goo.gle/3aKHfcC TensorFlow MLIR SIG → https://goo.gle/2OfQZBU Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel! → https://goo.gle/TensorFlow

Making the most of Colab (TF Dev Summit '20)

Learn tips and tricks from the Colab team. This talk describes how TensorFlow users make the most of Colab, and peeks behind the curtain to see how Colab works. Speaker: Timothy Novikoff - Product Manager Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow.js: ML for the web and beyond (TF Dev Summit '20)

TensorFlow.js is a platform for training and deploying machine learning models in browsers, or anywhere Javascript can run, such as mobile devices, WeChat mini app platform, and Raspberry Pi. It provides several back ends, including a CPU, GPU, Node, and WASM back end. It also provides a collection of pretrained models, including the two newest additions: MobileBERT and FaceMesh. Speaker: Na Li - Software Engineer Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Semantic Pyramid for Image Generation

This video explores a new GAN model for generating images by conditioning them on features from pre-trained image classifiers! This is really interesting for visualizing what is contained in pre-trained image classifiers as well as controllable image editing. The authors also show that this can be used for semantic image composition such as copying a tree and pasting it into a snow landscape or image relabeling by changing the embedded logit from the pre-trained classifier to produce an image of a new class while retaining as much of the original image as possible. Thanks for watching! Please Subscribe! Paper Links: Semantic Pyramid for Image Generation: https://ift.tt/396KOsF Corresponding Github Page: https://ift.tt/2IZbAbw Neural Style Transfer: https://ift.tt/2kNfxFU Zoom In: An Introduction to Circuits: https://ift.tt/39EOZgn EfficientDet: https://ift.tt/2xQJ7m7 Generative Teaching Networks: https://ift.tt/2w8Yd64 DermGAN: https://ift.tt/2vwCAMt Classification Accuracy Score for Conditional Generative Models: https://ift.tt/2U1fmaU GauGAN: https://ift.tt/2CsbLsZ SinGAN: https://ift.tt/2WnPSG5 StyleGAN2 Distillation: https://ift.tt/2IDaKRK Semi-Supervised StyleGAN for Disentanglement Learning: https://ift.tt/3b5VfxN Thanks for watching! Please Subscribe!

Who is the Sentdex Audience?

Neural Networks from Scratch: https://nnfs.io Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq

This Neural Network Regenerates…Kind Of!

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf The shown blog post is available here: https://ift.tt/2okfRiO 📝 The paper "Growing Neural Cellular Automata" is available here: https://ift.tt/2ShegXn Game of Life source: https://copy.sh/life/  🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

TF 2.x on Kaggle (TF Dev Summit '20)

Recently, Kaggle introduced TPU support through its competition platform. This talk touches on how Kaggler competitors transitioned from GPU to TPU use, first in Colab, and then in Kaggle notebooks. Speaker: Julia Elliott - Head of Competitions Program Management, Kaggle Phil Culliton - Developer Advocate Resources: Flower Classification with TPUs → https://goo.gle/2TnXLs6 Kaggle Notebooks → https://goo.gle/2whkjTi A Simple TF 2.1 notebook → https://goo.gle/39xk2ub Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Differentiable convex optimization layers (TF Dev Summit '20)

Convex optimization problems are used to solve many problems in the real world. Until now, it has been difficult to use them in TensorFlow pipelines. This talk presents cvxpylayers, a package that makes it easy to embed convex optimization problems into TensorFlow, letting you tune them using gradient descent. Speaker: Akshay Agrawal - Strategic Partner Development Manager Resource: GitHub → https://goo.gle/3aAn2X4 Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Scaling TensorFlow 2 models to multi-worker GPUs (TF Dev Summit '20)

This talk showcases multiple performance improvements in TensorFlow 2.2 to accelerate and scale users' ML training workload to multi-worker multi-GPUs. We walk through the optimizations using a BERT fine-tuning task in TF model garden, written using a custom training loop. Speaker: Zongwei Zhou - Software Engineer Resources: XLA: Optimizing Complier for ML → https://goo.gle/3adIDUR GitHub Bert → https://goo.gle/2xhNQgm Mixed precision → https://goo.gle/2PRAEoE GitHub models official → https://goo.gle/3cEZRwj Distributed training with TensorFlow → https://goo.gle/39wMWdY Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Enterprise: Productionizing TensorFlow with Google Cloud (TF Dev Summit '20)

The hardest part of ML adoption in enterprise is Productization. As we have seen in recent discussions around "ML Ops", there are many gaps between Data Scientists' PoC Notebook and a production ML system manageable by an Ops team. This talk shows us how TensorFlow Enterprise solves these problems with Google Cloud for productionizing your TensorFlow code for mission-critical business operation. Speaker: Makoto Uchida - Software Engineer Resource: TensorFlow Enterprise → https://goo.gle/389JNiS Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Facial Recognition on Video with Python

Neural Networks from Scratch: https://nnfs.io Face Recognition package tutorial (part 1): https://ift.tt/2Isf9qw Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq #python #facialrecognition #tutorial

This Neural Network Learned The Style of Famous Illustrators

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf The shown blog post is available here: https://ift.tt/2QgzovF 📝 The paper "GANILLA: Generative Adversarial Networks for Image to Illustration Translation" is available here: https://ift.tt/3bARwJM 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Thumbnail background image credit: https://ift.tt/2vYZCfo Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

TensorFlow Lite: ML for mobile and IoT devices (TF Dev Summit '20)

Learn about how to deploy ML to mobile phones and embedded devices. Now deployed on billions of devices in production - it's the world's best cross-platform ML framework for mobile and microcontrollers. Tune in for our new exciting announcements. Speakers: Tim Davis - Product Manager T.J. Alumbaugh - Software Engineer Resource: TensorFlow Lite → https://goo.gle/2Wk5MPM Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel→ https://goo.gle/TensorFlow

Responsible AI with TensorFlow (TF Dev Summit '20)

Introducing a framework to think about ML, fairness and privacy. This talk will propose a fairness-aware ML workflow, illustrate how TensorFlow tools such as Fairness Indicators can be used to detect and mitigate bias, and will then transition to a specific case-study regarding privacy that will walk participants through a couple of infrastructure pieces that can help train a model in a privacy preserving manner. Speakers: Catherina Xu - Associate Product Manager Miguel Guevara - Product Manager Resources: TensorFlow Federated → https://goo.gle/2PtAp2f GitHub TF Federated → https://goo.gle/2wYBWb5 GitHub TF Privacy → https://goo.gle/2I7XpRg Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

AlphaGo - The Movie | Full Documentary

With more board configurations than there are atoms in the universe, the ancient Chinese game of Go has long been considered a grand challenge for artificial intelligence. On March 9, 2016, the worlds of Go and artificial intelligence collided in South Korea for an extraordinary best-of-five-game competition, coined The DeepMind Challenge Match. Hundreds of millions of people around the world watched as a legendary Go master took on an unproven AI challenger for the first time in history. Directed by Greg Kohs with an original score by Academy Award nominee, Hauschka, AlphaGo chronicles a journey from the halls of Oxford, through the backstreets of Bordeaux, past the coding terminals of DeepMind in London, and ultimately, to the seven-day tournament in Seoul. As the drama unfolds, more questions emerge: What can artificial intelligence reveal about a 3000-year-old game? What can it teach us about humanity?

120GB of VRAM

Boxx: https://boxx.com Neural Networks from Scratch: https://nnfs.io Cloud vs Local GPUs: https://www.youtube.com/watch?v=62keA5pdykM Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq

Collaborative ML with TensorBoard.dev (TF Dev Summit '20)

Sharing experiment results is an important part of the ML process. This talk shows how TensorBoard.dev can enable collaborative ML by making it easy to share experiment results in your paper, blog post, social media, and more. Speaker: Gal Oshri - Product Manager Resource: TensorBoard.dev → https://goo.gle/3abZV4M Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Learning to read with TensorFlow and Keras (TF Dev Summit '20)

Natural Language Processing (NLP) has hit an inflection point, and this talk shows you how TensorFlow and Keras make it easy to preprocess, train, and hypertune text models. Speaker: Paige Bailey - Product Manager Resources: The Goldilocks Principle → https://goo.gle/2PPUmBi GitHub Keras Preprocessing Layers → https://goo.gle/2uWFqKm GitHub Keras Preprocessing API → https://goo.gle/38ohwoU Understanding Encoder-Decoder Sequence to Sequence Model → https://goo.gle/2IsPtde Keras Tuner documentation → https://goo.gle/2InBK7J Hyperparameter tuning with Keras Tuner → https://goo.gle/2VPtMvR TensorFlow Text → https://goo.gle/2TueZVV GitHub Bert → https://goo.gle/2xhNQgm TensorFlow Hub breakdown → https://goo.gle/2wAwbQy Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Quantum: A software platform for hybrid quantum-classical ML (TF Dev Summit '20)

We introduce TensorFlow Quantum, an open-source library for the rapid prototyping of novel hybrid quantum-classical ML algorithms. This library will extend the scope of current ML under TensorFlow and provides the necessary toolbox for bringing quantum computing and machine learning research communities together to control and model quantum data. Speaker: Masoud Mohseni - Research Scientist Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

Getting involved in the TF community (TF Dev Summit '20)

Learn how you can be a part of the growing TensorFlow ecosystem and become a contributor through code, documentation, education, or community leadership. Speaker: Joana Carrasqueira - Developer Relations Program Manager Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow and ML from the trenches: The Innovation Experience Center at JPL (TF Dev Summit '20)

Chris Mattmann will explain how JPL’s Innovation Experience Center in the Office of the Chief Information Officer supports advanced analytics, AI and Machine Learning using TensorFlow for Smarter Rovers, a Smarter Campus, and beyond! Speaker: Chris Mattmann - NASA Resource: Machine Learning with TensorFlow, Second Edition book → https://goo.gle/39x8Q0C Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Dev Summit 2020 Livestream

Mark your calendar for #TFDevSummit happening on March 11 and join TensorFlow users from all over the world. The content focuses on TensorFlow updates for researchers, production scaling, improvements across platforms, and #PoweredbyTF use cases by the community. #AskTensorFlow Links: Learn more about building on TensorFlow → https://goo.gle/TF Check out the event website for more details → https://goo.gle/TFDS20Info Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to TensorFlow → https://goo.gle/TensorFlow

TFX: Production ML with TensorFlow in 2020 (TF Dev Summit '20)

Learn how the Google production ML platform, TFX, is changing in 2020. Speakers: Tris Warkentin - Senior Product Manager Zhitao Li - Software Engineer Marcel Rummens - Product Owner at Airbus Group Resources: TensorFlow Extended → https://goo.gle/2xmDHik GitHub TFX → https://goo.gle/337fW9J Join the TFX group → https://goo.gle/2OGjw78 Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

TensorFlow Dev Summit 2020 Keynote

Join the TensorFlow team as they kick-off the 2020 TensorFlow Dev Summit. The keynote will feature new product updates for the TensorFlow ecosystem. Speakers: Megan Kacholia - VP, Engineering Manasi Joshi - Engineering Director Kemal El Moujahid - Director, Product Management Resources: Start a TFUG  → https://goo.gle/38NCpKx Join a Special Interest Group → https://goo.gle/39TRcVn Apply for Google Summer of Code → https://goo.gle/2TK1e5M Compete on Kaggle → https://goo.gle/3cP2yM7 Responsible AI Dev Post Challenge → https://goo.gle/2Q6vyoO Machine Learning Crash Course → https://goo.gle/338YH8d Take a specialization course → https://goo.gle/2IDifYL Submit a proposal for an ML course → https://goo.gle/38NCNIZ Get certified  → https://goo.gle/39MVNZe Watch all TensorFlow Dev Summit 2020 sessions → https://goo.gle/TFDS20 Subscribe to the TensorFlow YouTube channel → https://goo.gle/TensorFlow

AutoML-Zero

This video explores AutoML-Zero, an evolutionary search for machine learning programs. These programs are initially empty with Setup, Predict, and Learn functions that can access scalar, vector, and matrix memory addresses. Through fitness evaluation and mutation, these programs evolve to use gradient descent, dropout-like operations, and ReLU activation functions! Thanks for watching, Please Subscribe! Paper Links: AutoML-Zero: https://ift.tt/2Q4IQCl Github Repo AutoML-Zero: https://ift.tt/2Iyj0Cq The Evolved Transformer: https://ift.tt/2IAdYFw Hierarchical Representations for Efficient Architecture Search: https://ift.tt/2AA2JIh Exploring Randomly Wired Neural Networks for Image Recognition: https://ift.tt/2v9Xi4y

Deformable Simulations…Running In Real Time!

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf The shown blog post is available here: https://ift.tt/339uzcB 📝 The paper "A Scalable Galerkin Multigrid Method for Real-time Simulation of Deformable Objects" is available here: https://ift.tt/2xrvp93 ❤️ Watch these videos in early access on our Patreon page or join us here on YouTube: - https://ift.tt/2icTBUb - https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg/join 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

ELECTRA: Pre-Training Text Encoders as Discriminators Rather than Generators

This video explains the new Replaced Token Detection pre-training objective introduced in ELECTRA. ELECTRA is much more compute efficient due to defining the loss on the entire input sequence and avoiding the introduction of the [MASK] token into the self-supervised learning task. ELECTRA-small is trained on 1 GPU for 4 days and outperforms GPT trained with 30x more compute. ELECTRA is on par with RoBERTa and XLNet with 1/4 of the compute and surpasses those models with the same level of compute! Thanks for watching! Please Subscribe! Paper Link: ELECTRA: https://ift.tt/2oXvoFQ BERT: https://ift.tt/2CCYvU9

Facial Recognition with Python and the face_recognition library

Welcome to a tutorial for implementing the face recognition package for Python. The purpose of this package is to make facial recognition (identifying a face) fairly simple. Kite autocomplete engine for Python: kite.com Text-based tutorial and sample code: https://ift.tt/2Isf9qw Channel membership: https://www.youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: https://ift.tt/2AZiVqD Support the content: https://ift.tt/2qsKFOO Twitter: https://twitter.com/sentdex Instagram: https://ift.tt/2J4Oa4h Facebook: https://ift.tt/1OI3cwB Twitch: https://ift.tt/2pcWGaq #facialrecognition #python #tutorial

Coronavirus Competition Results (Remdesivir)

I’m pleased to announce the results of our open-source Coronavirus Drug Discovery Competition! In just 2 weeks, hundreds of developers from around the world signed up to join the fight against the novel coronavirus, using publicly available datasets and algorithms to come up with relevant solutions. The top 3 submissions, winning $3500 in prizes, stood out from the rest in terms of their algorithmic and reporting quality. In this episode, I’m going to announce each of their backgrounds, as well as dive into the various machine learning techniques they used to predict a suitable treatment for Coronavirus. The top submission identified a compound called Remdesivir as the the most promising treatment for COVID-2019, due to its high scoring inhibitory potential when docked against the Coronavirus main Protease. Remdesivir was recently shown to be effective in treating the first US patient infected with COVID-2019, but is currently undergoing clinical trials to gain FDA approval. These findings help confirm it’s potential as an effective COVID-2019 treatment. I’ll explain more in the vid, Enjoy! Winning Submissions Announcement blog-post: https://ift.tt/2PUJ92w Matt O’Connor (1st place): https://ift.tt/38Bcoxz Thomas MacDougall (2nd Place): https://ift.tt/3aEQjjs Tinka Vidovic (3rd Place): https://ift.tt/2VXgGNd Subscribe for more educational videos! It means a lot to me. TWITTER: https://bit.ly/2OHYLbB WEBSITE: https://bit.ly/2OoVPQF INSTAGRAM: https://bit.ly/312pLUb FACEBOOK: https://bit.ly/2OqOhx1 Original Coronavirus Competition Video: https://www.youtube.com/watch?v=1LJgkovowgA Are you a total beginner to machine learning? Watch this: https://www.youtube.com/watch?v=Cr6VqTRO1v0 Learn Python: https://www.youtube.com/watch?v=T5pRlIbr6gg Signup for my newsletter for exciting updates in the field of AI: https://goo.gl/FZzJ5w Credits: Coronavirus Drug Discovery competitors Github open-source community Scientific American Image assets are from across the Web Hit the Join button above to sign up to become a member of my channel for access to exclusive live streams! And please support me on Patreon: https://ift.tt/2cMCk13

Transferring Real Honey Into A Simulation 🍯

❤️ Check out Linode here and get $20 free credit on your account: https://ift.tt/2LaDQJb 📝 The paper "Video-Guided Real-to-Virtual Parameter Transfer for Viscous Fluids" is available here: https://ift.tt/2PTSvLZ ❤️ Watch these videos in early access on our Patreon page or join us here on YouTube: - https://ift.tt/2icTBUb - https://www.youtube.com/channel/UCbfYPyITQ-7l4upoX8nvctg/join 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Meet and discuss your ideas with other Fellow Scholars on the Two Minute Papers Discord: https://ift.tt/2TnVBd3 Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m

Train Large, Then Compress

This video explains a new study on the best way to use a limited compute budget when training Natural Language Processing tasks. They show that Large models reach a lower error faster than smaller models and stopping training early with large models achieves better performance than longer training with smaller models. These larger models come with an inference bottleneck, it takes longer to make predictions and costs more to store these weights. The authors alleviate the inference bottleneck by showing that these larger models are robust to compression techniques like quantization and pruning! Thanks for watching, Please Subscribe! Paper Links: Train Large, Then Compress: https://ift.tt/3awfC74 BAIR Blog Post: https://ift.tt/2ImJYNl What is Gradient Accumulation in Deep Learning? https://ift.tt/30M4f7o Transfer Learning in NLP: https://ift.tt/2VPiWpR SST: https://ift.tt/2t56jGq MNLI: https://ift.tt/2PW2HUe The Lottery Ticket Hypothesis: https://ift.tt/2PTd4pv GPT: https://ift.tt/2HeACni

Can Neural Image Generators Be Detected?

❤️ Check out Weights & Biases here and sign up for a free demo here: https://ift.tt/2YuG7Yf Their instrumentation of this paper: https://ift.tt/39jebIZ 📝 The paper "CNN-generated images are surprisingly easy to spot...for now" is available here: https://ift.tt/32DPXGW Our Discord server is now available here and you are all invited! https://ift.tt/2IfLukp 🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Alex Haro, Alex Paden, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Benji Rabhan, Brian Gilman, Bryan Learn, Daniel Hasegan, Dan Kennedy, Dennis Abts, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, James Watt, Javier Bustamante, Kaiesh Vohra, Kasia Hayden, Kjartan Olason, Levente Szabo, Lorin Atzberger, Lukas Biewald, Marcin Dukaczewski, Marten Rauschenberg, Maurits van Mastrigt, Michael Albrecht, Michael Jensen, Nader Shakerin, Owen Campbell-Moore, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Taras Bobrovytsky, Thomas Krcmar, Torsten Reil, Tybie Fitzhugh. https://ift.tt/2icTBUb Károly Zsolnai-Fehér's links: Instagram: https://ift.tt/2KBCNkT Twitter: https://twitter.com/karoly_zsolnai Web: https://ift.tt/1NwkG9m #DeepFake #DeepFakes

DeepMind: The Podcast | Episode 8: Demis Hassabis - The interview

How can AI advance science? Listen to Demis Hassabis, our Co-Founder and CEO, unlock 🗝 the inspiration, foundations, and ambitions of DeepMind. “When you’re scrambling around in the dark in the unknown of science, any signpost is really valuable, and the brain is the only existence proof we have in the universe that intelligence is possible”. – Demis Hassabis, Co-Founder and CEO #neuroscience #inspiration #artificialintelligence #scientificdiscovery #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 7: Towards the future

What do we mean by intelligence? Join our Vice President of Research on a tour of DeepMind HQ and find out what it takes to solve intelligence 🕵️‍♀️. “A big part is trying to constrain the problem space, like writing down and specifying what we want to do, making sure it is a challenging problem, and having good metrics to quantify our solution”. – Koray Kavukcuoglu, Director of Research #algorithms #datasets #safety #solvingintelligence #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 6: AI for everyone

How can we reduce bias in AI? Ensure safe practices? Uphold ethics? 🤔Hear about the problems and solutions our Ethics & Society team are working on. …see more “Ethics and responsibility mean something very different now because technology is in everybody’s hands”. – Lila Ibrahim, Chief Operating Officer #ethics #safety #criminaljustice #PartnershiponAI #reducingbias #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 5: Out of the lab

Where is AI in the real world 🌍? Meet the people making AI systems to diagnose eye disease, advance scientific discovery, and reduce energy use. “The results are jaw-dropping, the algorithm is on par with world-leading experts at Moorfields in triaging OCT scans”. – Pearse Keane, Consultant Ophthalmologist at Moorfields Eye Hospital #AlphaFold #realworldimpact #eyedisease #savingenergy #deeplearning #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 4: AI, Robot

How can we ensure our AI is safe? Find out about training AI systems and robots to behave as we intend and why common sense 💡is so important. “We want our systems to do something good for us, something we actually wanted, not just what we said we wanted”. – Jan Leike, Research Scientist #robotics #feedback #safety #embodiedAI #physicalintelligence #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 3: Life is like a game

What is an intelligent agent? Our researcher scientists explain collaboration, decision-making, and rich environments in the world of games 🎮 “StarCraft is one of the most complicated games we’ve ever tackled, it’s challenging our understanding, and our algorithms”. – Oriol Vinyals, Research Scientist #AlphaStar #collaboration #decisions #gaming #neuralnetworks #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Episode 2: Go to Zero

How can a system learn 📚from itself? Lead researchers and chess masters tell the story of AlphaZero, the first AI to master chess, shogi, and Go. “Creativity takes us out of our expected patterns of behaviour. In that sense, the program was truly creative”. – David Silver, Lead Researcher #AlphaGo #AlphaZero #worldchampion #creativity #artificialintelligence #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

DeepMind: The Podcast | Ep. 1: AI and neuroscience - The virtuous circle

Can AI model the brain 🧠? Hear from our neuroscience team about using memory, imagination, and rewards to build artificial general intelligence. “We get this virtuous cycle between neuroscience, cognitive science, and AI because we are trying to study the same thing, which is intelligence”. – Jess Hamrick, Research Scientist #memory #imagination #rewards #artificialgeneralintelligence #DMpodcast _ _ Search “DeepMind: The Podcast” and subscribe on your favourite podcast app. Apple Podcasts: https://lnkd.in/g9dCMH3 Google Podcasts: https://lnkd.in/g69PYK3 Pocket Casts: https://pca.st/30m1

Training a model to recognize sentiment in text (NLP Zero to Hero, part 3)

Welcome to Zero to Hero for Natural Language Processing using TensorFlow! If you’re not an expert on AI or ML, don’t worry -- we’re taking the concepts of NLP and teaching them from first principles with our host Laurence Moroney (@lmoroney). In the last couple of episodes you saw how to tokenize text into numeric values and how to use tools in TensorFlow to regularize and pad that text. Now that we’ve gotten the preprocessing out of the way, we can next look at how to build a classifier to recognize sentiment in text. Links: Colab → https://goo.gle/tfw-sarcembed GitHub → https://goo.gle/2PH90ea Coding TensorFlow → https://goo.gle/2Y43cN4 Subscribe to the TensorFlow channel → https://goo.gle/TensorFlow

AI Weekly Update - March 2nd 2020 (#18)

Thanks for Watching! Please Subscribe! Text-To-Text Transfer Transformer: https://ift.tt/2SV4VF9 A Primer into BERTology: https://ift.tt/2SV4VF9 BERT Can See Out of the Box: https://ift.tt/3ar15K1 Training Question Answering Models from Synthetic Data: https://ift.tt/2VB8nX9 Learning to retrieve reasoning paths from the Wikipedia graph: https://ift.tt/32pAB8N Learning to Continually Learn: https://ift.tt/2VG7dKi Inverse RL: https://ift.tt/32ICLAx Open Images V6: https://ift.tt/39eqRRz Street View Panoramas for Language Grounding: https://ift.tt/2SYlgJj Batch Norm biases Deep ResNets towards Shallow Paths: https://ift.tt/3cpoixI Transformers are Graph Neural Networks; https://ift.tt/38b7lDO The Illustrated Self-Supervised Learning: https://ift.tt/2VmRa3C Freeze Discriminator: https://ift.tt/2HUe7mU FastMRI advances with Adversarial Training: https://ift.tt/3910luv Facebook 2D to 3D photos: https://ift.tt/32ANrB3 DairAI NLP Newsletter: https://ift.tt/2IdI55n

The Hardest Kaggle Challenge

There's a new $20,000 challenge on Kaggle that uses a dataset titled "The Abstraction and Reasoning Corpus". The aim of this episode is to get you up to speed as fast as possible so that you can participate. This challenge is hosted by Francois Chollet, the creator of the popular deep learning library Keras, and there are still 3 months to go. The goal is to create an algorithm that can learn the relationship between input-output pairs of colored tiles. Sounds simple at first, but upon closer inspection, creating an algorithm that's able to do so given such a small dataset requires genuine AI innovation. Deep Learning won't work because it requires big datasets and expensive compute, so even though this challenge is difficult, it's also the most accessible! We'll be learning about the dataset, related paper, and the various techniques that Kagglers have already attempted. Then, we'll learn about Neural Program Synthesis and future directions that could ultimately solve this problem. Enjoy! Subscribe for more educational videos! It means a lot to me. TWITTER: https://bit.ly/2OHYLbB WEBSITE: https://bit.ly/2OoVPQF INSTAGRAM: https://bit.ly/312pLUb FACEBOOK: https://bit.ly/2OqOhx1 Kaggle Challenge: https://ift.tt/2SqHIKK ARC Dataset: https://ift.tt/2oSNQ2o Convolutional Network Kernel: https://ift.tt/32HnqAh Cellular Automata Kernel: https://ift.tt/2HAcYAN Genetic Algorithm Kernel: https://ift.tt/2VnWCDD Really great paper on Neural Program Synthesis: https://ift.tt/2G0hiq9 Intro to Convolutional Networks: https://www.youtube.com/watch?v=FTr3n7uBIuE Intro to Genetic Algorithms: https://www.youtube.com/watch?v=9zfeTw-uFCw Intro to Cellular Automata: https://www.youtube.com/watch?v=DKGodqDs9sA Simple PointerNet example: https://ift.tt/3ap05pM Hit the Join button above to sign up to become a member of my channel for access to exclusive live streams! Signup for my newsletter for exciting updates in the field of AI: https://goo.gl/FZzJ5w Credits: Kaggle & Kagglers Francois Chollet Google Image Search for the image assets And please support me on Patreon: https://ift.tt/2cMCk13

BERT Can See Out of the Box

The video explores an interesting paper seeing how easily (w.r.t fine-tuning effort) pre-trained visual embeddings can be combined with text captions for visual question generation in the BERT model. This video explores the approach the authors take for this, applications of vision-language models, and question generation. Thanks for watching! Please Subscribe! Paper Links: BERT Can See Out of the Box: https://ift.tt/3ar15K1 BERT: https://ift.tt/2pMXn84 ImageBERT: https://ift.tt/398zzAe Training QA Models from Synthetic Data: https://ift.tt/2VB8nX9 AI2 BREAK: https://ift.tt/2PG7cSD Google Street View Panoramas for Language Grounding Tasks: https://ift.tt/2SYlgJj Google Open Images V6 with Localized Narratives: https://ift.tt/2SYlgJj Salesforce Learning Reasoning Paths: https://ift.tt/32pAB8N Thanks for Watching! Please Subscribe!