Resource of free step by step video how to guides to get you started with machine learning.
Tuesday, August 17, 2021
How to make TensorFlow models run faster on GPUs
XLA compilation on GPU can greatly boost the performance of your models (~1.2x-35x performance improvements recorded). Learn how to use @tf.function(jit_compile=True) in TensorFlow to control what exact scopes are being compiled, and how to debug the performance of the resulting program. We'll cover writing compiled models, debugging them, and exploring the performance characteristics and optimizations the XLA compiler performs, and we'll do a detailed case study on XLA usage for Google’s GPU MLPerf submission. We'll also cover how automatic kernel fusion by XLA reduces memory bandwidth requirements and improves the performance of your models. You should have basic familiarity with TensorFlow and GPU computing in general. Subscribe to TensorFlow → https://goo.gle/TensorFlow product: TensorFlow - General; re_ty: Publish;
Labels:
Video
Published by Free artificial intelligence and machine learning video tutorial resource
Related video tutorials
Subscribe to:
Post Comments (Atom)
Most watched
-
Quick answer: Qwen 3 32B needs about 22.7 GB of VRAM at Q4_K_M with a 4k-token context — a used 24 GB card like the RTX 3090 is the minimu...
-
Using GPUs in TensorFlow, TensorBoard in notebooks, finding new datasets, & more! (#AskTensorFlow) [Collection] In a special live ep...
-
Inside TensorFlow: Summaries and TensorBoard [Collection] Take an inside look into the TensorFlow team’s own internal training sessions-...
-
Quick answer: For an 8B model at Q4, local electricity costs roughly $0.05 per million output tokens — against about $0.53 per million ble...
-
Quick answer: For machine-learning work, buy an external SSD over a spinning hard drive, pick USB 3.2 Gen 2 (10 Gbps) or faster, and size f...
-
Quick answer: DeepSeek V4 Flash is a Mixture-of-Experts model: all 284 billion parameters must be stored, so combined RAM plus VRAM — not ...
-
Quick answer: Yes, for most budget builders: a used RTX 3090 is still the cheapest route to 24 GB of VRAM with full CUDA support. Capacity...
-
Hey everyone This is Ujjwal kapil B.tech 2nd year Ai and Ml In this video we covered one of the most important question "COLLEGE KAB O...
-
Quick answer: The cheapest path to serious local-AI VRAM is not one new flagship card — it is two used ones. A single RTX 5090 costs $1,999...
-
Quick answer: FLUX.1 dev needs about 10 GB of VRAM at Q4/NF4 quantization for 1024×1024 image generation, so a 12 GB GPU such as the GeFor...
No comments:
Post a Comment