August 23-34, 2022 - Virtual
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for Open Source Summit Latin America 2022 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in Eastern Daylight Time (UTC -4). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."
Back To Schedule
Wednesday, August 24 • 1:15pm - 1:55pm
Deploying ML at Scale with Kubernetes and TFX - Rishit Dagli, Narayana Junior College; Incoming University of Toronto [Presented in English]

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
There has been increasing popularity in the area of ML however deploying ML models at scale and being able to efficiently and consistently manage: serving model, infrastructure management, model versions, canary deployments, batch predictions, model metadata, monitoring data drifts, model routing, and A/B testing is a difficult task. I may say doing these steps correctly is more difficult than training a model for which a lot of literature is available. Enter Kubernetes and TensorFlow Extended. This talk will start off by giving some more clarity about the ML deployment steps as well as introduce TensorFlow Extended, an open-source tool that integrates quite well with Kubernetes and makes the deployment process consistent and easy. I also plan to talk about two more ideas in this talk: using Istio for model routing and A/B testing as well as showing the audience how they could best use their offloading pre-processing to server with Kubernetes. This would be followed by a demo.

avatar for Rishit Dagli

Rishit Dagli

Student, Narayana Junior College; Incoming University of Toronto
I am a high school student from Mumbai, India. I love working with Machine Learning, especially Computer Vision and Kubernetes but you will also find me working with Android. I am an active contributor to multiple open-source projects like TensorFlow, KubeFlow, and Kubernetes. I also... Read More →

Wednesday August 24, 2022 1:15pm - 1:55pm EDT
  Open AI & Data Forum