Mini Batches in Graph Neural Network

In this pytorch tutorial, we looked into performing mini-batch training in graph convolutional networks (GCN). We also saw how to use ClusterData and ClusterLoader from pytorch geometric to do mini-batch training in graph neural networks (GNN). ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 🔗 jupyter notebook I built in this video: https://github.com/mashaan14/YouTube-channel/blob/main/notebooks/2024_04_29_GNN_mini_batch.ipynb ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ https://www.youtube.com/playlist?list=PL8Q742wf_oLXBo9hk3NepUMmnIvfYEJy2 ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ - my website ➡️ https://mashaan14.github.io/mashaan/ - my github ➡️ https://github.com/mashaan14 - my linkedin ➡️ https://linkedin.com/in/mashaan ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 📹 Video edit: Adobe Premiere Rush 🎧 Audio enhancement: Adobe Podcast ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ Chapters: 00:00 start 00:11 what is a mini-batch? 02:26 why do we need a mini-batch? 05:07 what is a good size for a mini-batch? 06:15 why is it difficult to do a mini-batch in GNN? 09:42 introducing Cluster-GCN 11:31 diagonal block adjacency 12:33 going back to Cluster-GCN 16:48 introducing Metis 18:10 why not spectral clustering? 18:51 start of the code 19:09 install pytorch-geometric dependencies 20:58 full-batch training 21:35 mini-batch training 24:22 why the fast convergance with mini-batch? ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #GNN #GCN #pytorchgeometric #GNNs #Cluster-GCN #graphneuralnetwork #ai #deeplearning #machinelearning #python #neuralnetworks #artificialintelligence #pytorch #imageclassification #GPU #TPU #tutorial