Скачать с ютуб AI Server Thread Inference CPU Speed Impact - Threadripper vs EPYC в хорошем качестве

AI Server Thread Inference CPU Speed Impact - Threadripper vs EPYC

How does the speed of your CPU impact the Tokens per second you can generate? I ran test and have the answers! Your GPU AI Server has a few pieces of the rig that can make a sizable difference on your performance, is your CPU one of them? Tested on 3090 and 4090 systems and parts below. Parts Featured EPYC 7F52 https://geni.us/EPYC_7F52_UpvU EPYC 7702 https://geni.us/EPYC_7702_UpvU Threadripper Pro 5955wx https://geni.us/ThreadripperPRO_5955wx ASRock wrx80 Creator Mobo https://geni.us/ASRock_wrx80_creator AI Home Server Quad 3090 Build    • INSANE Ollama AI Home Server - Quad 3...   AI Playlist    • AI Rigs, Testing, Reviews, Use Cases ...   QUAD 3090 AI SERVER BUILD GPU Rack Frame https://geni.us/GPU_Rack_Frame RTX 3090 24GB GPU (x4) https://geni.us/GPU3090 Gigabyte MZ32-AR0 Motherboard https://geni.us/mz32-ar0_motherboard Kritical Thermal GPU Pads https://geni.us/Kritical-Thermal-Pads 256GB (8x32GB) DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable AMD EPYC 7702p https://geni.us/EPYC_7702p iCUE H170i ELITE CAPELLIX https://geni.us/iCUE_H170i_Capellix (sTRX4 fits SP3 and retention kit comes with the CAPELLIX) ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU 4i SFF-8654 to 4i SFF-8654 (x4) https://geni.us/SFF8654_to_SFF8654 HDD Rack Screws for Fans https://geni.us/HDD_RackScrews Chapters 0:00 CPU for AI Server 3:11 3090 Qwen 2.5 32b q4 TR 6:15 3090 Llama 3.1 8b fp16 TR 7:38 3090 Llama 3.2 3b fp16 TR 9:05 4090 Qwen 2.5 32b q4 TR 11:07 4090 Llama 3.1 8b fp16 TR 12:37 4090 Llama 3.2 3b fp16 TR 14:42 CPU Thread Speed AI Impact 17:04 AI PC CPU Balance Be sure to 👍✅Subscribe✅👍 for more content like this! Join this channel    / @digitalspaceport   Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching! Digital Spaceport Website 🌐 https://digitalspaceport.com 🛒Shop (Channel members get a 3% or 5% discount) Check out https://Shop.DigitalSpaceport.com for great deals on hardware and merch. ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. ***** Be sure to 👍✅Subscribe✅👍 for more content like this! Join this channel    / @digitalspaceport   Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching! Digital Spaceport Website 🌐 https://digitalspaceport.com 🛒Shop (Channel members get a 3% or 5% discount) Check out https://Shop.DigitalSpaceport.com for great deals on hardware and merch. ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. *****