Robert Nishihara - Scaling Multimodal Data and Reinforcement Learning with Ray

Robert Nishihara is one of the creators of Ray, the world’s leading open source AI compute engine. He is one of the co-founders of Anyscale, which is the company behind Ray. He did his PhD in machine learning and distributed systems in the computer science department at UC Berkeley. Before that, he majored in math at Harvard.

RSVP

Scaling Multimodal Data and Reinforcement Learning with Ray

AI workloads are growing in complexity and require increasing scale of both data and compute, as well as significant heterogeneity across models, data types, and hardware accelerators. As a result, the software stack for running compute-intensive AI workloads is fragmented and rapidly evolving. However, within the fragmented landscape, common patterns are beginning to emerge.

This talk describes a popular software stack combining Kubernetes, Ray, PyTorch, and vLLM designed to support a variety of emerging AI workloads including multimodal data processing and reinforcement learning. It describes the role of each of these frameworks and how they operate together.

A