Скачать с ютуб Quantization vs Pruning vs Distillation: Optimizing NNs for Inference в хорошем качестве

Quantization vs Pruning vs Distillation: Optimizing NNs for Inference

Try Voice Writer - speak your thoughts and let AI handle the grammar: https://voicewriter.io Four techniques to optimize the speed of your model's inference process: 0:38 - Quantization 5:59 - Pruning 9:48 - Knowledge Distillation 13:00 - Engineering Optimizations References: LLM Inference Optimization blog post: https://lilianweng.github.io/posts/20... How to deploy your deep learning project on a budget: https://luckytoilet.wordpress.com/202... Efficient deep learning survey paper: https://arxiv.org/abs/2106.08962 SparseDNN: https://arxiv.org/abs/2101.07948