Скачать с ютуб Ollama AI Home Server ULTIMATE Setup Guide в хорошем качестве

Ollama AI Home Server ULTIMATE Setup Guide

I'm learning and sharing my Home Server Ai quest in realtime. This video is a step-by-step, how to guide focusing on installing a complete self-hosted Ollama on WebUI powerhouse. I also show you how to install docker and nvidia container toolkit as well as downloading and running some tests on the 8b and 70b meta llama 3.1 new hotness. These models are great! This Homelab mega Ai server is built to help me in understanding and deploying the most cutting edge self hosted LLM Ai tools. We start by installing ubuntu and docker with Nvidia Container Toolkit. Then we setup WebUI and Ollama. Next I show you how to download your first models and load them into the client. Finally I showcase some of the speed of llama3.1 70b model. This tutorial builds off our quad 3090 GPU rig we built in the last video. Open WebUI powered Ollama running LLAMA 3.1 70b in Docker on Ubuntu 22.04 Written piece and GPU Rack Modification Instructions https://digitalspaceport.com/ollama-g... Ai Server Build GPU Rack Frame https://geni.us/GPU_Rack_Frame Gigabyte MZ32-AR0 Motherboard https://geni.us/mz32-ar0_motherboard RTX 3090 24GB GPU (x4) https://geni.us/GPU3090 256GB DDR4 2400 RAM https://geni.us/256GB_DDR4_RAM PCIe4 Risers (x4) https://geni.us/PCIe4_Riser_Cable AMD EPYC 7702p https://geni.us/EPYC_7702p iCUE H170i ELITE CAPELLIX https://geni.us/iCUE_H170i_Capellix ELITE Retention Kit https://geni.us/ELITE_RetentionKit ARCTIC MX4 Thermal Paste https://geni.us/Arctic_ThermalPaste CORSAIR HX1500i PSU https://geni.us/Corsair_HX1500iPSU 4i SFF-8654 to 4i SFF-8654 (x4) https://geni.us/SFF8654_to_SFF8654 HDD Rack Screws for Fans https://geni.us/HDD_RackScrews Be sure to 👍✅Subscribe✅👍 for more content like this! Join this channel    / @digitalspaceport   Chapters 0:00 Ollama Server Setup Guide 0:30 Quad GPU Ai Rig Updates 1:40 Setup Ubuntu 22.04 Desktop for Nvidia 10:05 Installing Docker Nvidia Toolkit 11:33 Open WebUI and Ollama Setup 14:24 How To install LLAMA 3.1 70b 18:52 LLAMA 3.1 405b 20:59 LLAMA 3.1 8b 22:48 LLAMA 3.1 Stats 24:32 The Ultimate Ollama Setup Guide for Noobs Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching! Digital Spaceport Website 🌐 https://digitalspaceport.com 🛒Shop (Channel members get a 3% or 5% discount) Check out https://Shop.DigitalSpaceport.com for great deals on hardware and merch. ***** As an Amazon Associate I earn from qualifying purchases. When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network. Other Merchant Affiliate Partners for this site include, but are not limited to, Newegg and Best Buy. I earn a commission if you click on links and make a purchase from the merchant. *****