Скачать с ютуб Rustem Feyzkhanov - Leverage ML Inference for Generative AI Models on AWS в хорошем качестве

Rustem Feyzkhanov - Leverage ML Inference for Generative AI Models on AWS

LLM is becoming essential for many companies - either as a core product, an internal tool, or as a service for improving operations. One challenge when deploying the LLM to production is navigating through different hardware, service, and orchestration options. This presentation is focused on providing a comprehensive understanding of different LLM deployment options in AWS Cloud. We will explore different ways of deploying pretrained models to the AWS cloud from SageMaker Real-time inference to Elastic Container Service and AWS Lambda. We will also cover different ways of deploying ML infrastructure - from SageMaker JumpStart and SageMaker SDK to AWS Copilot and AWS SAM and options like Amazon Bedrock. There will be a live demo that shows how the deployment process would look like for the generative AI model using SageMaker JumpStart, ECS/Fargate + AWS Copilot and for AWS Lambda. LinkedIn -   / ryfeus   Slides - https://drive.google.com/file/d/1nMo6... 📌 Don’t forget to subscribe for more expert insights and updates from AWS Community Day! #GenerativeAI #MLInference #AWS #SageMaker #CloudComputing #TechDemo #RustemFeyzkhanov