Скачать с ютуб Flyte: Cloud Native Machine Learning & Data Processing Platform | Lyft в хорошем качестве

Flyte: Cloud Native Machine Learning & Data Processing Platform | Lyft

ABOUT THE TALK (https://www.datacouncil.ai/talks/flyt...) Flyte is the backbone for large-scale Machine Learning and Data Processing (ETL) pipelines at Lyft. It is used across business critical applications ranging from ETA, Pricing, Mapping, Autonomous, etc. At its core is an open source workflow engine that executes 15M+ containers per month as part of thousands of workflows. The talk will focus on:- Architecture of Flyte and its specification language to orchestrate compute and manage data flow across disparate systems like Spark, Flink, Tensorflow, Hive, etc.- Data Provenance and Lineage in Flyte- How to leverage Flyte in various parts of the machine learning pipelinesThe talk will conclude with a demo of a machine learning pipeline built using the open source version of Flyte. ABOUT THE SPEAKER Haytham Abuelfutuh is an Engineering Manager in the Lyft ML Organization leading the Flyte team. During his tenure at Lyft, Haytham has helped build Flyte from the ground up, built and shipped Kubernetes operators and investigated and optimized Flyte system performance on k8s. Before Lyft, Haytham has gained his expertise in building Cloud and Massive Distributed Systems through his 3-year tenure in Google using Borg & Flume and 7-year tenure in Microsoft Office 365 and Azure Storage. ABOUT DATA COUNCIL: Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups. FOLLOW DATA COUNCIL: Twitter:   / datacouncilai   LinkedIn:   / datacouncil-ai   Facebook:   / datacouncilai   Eventbrite: https://www.eventbrite.com/o/data-cou...