Engineering Manager, Ray Data

The posting, as Anyscale wrote it

About Anyscale

At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date.

About the role

Anyscale is looking for an engineering leader to manage the open source Ray Data team. Ray Data https://docs.ray.io/en/latest/data/data.html is the Python-native data processing engine for AI workloads on Ray. It handles multimodal and structured data and powers batch inference, data loading for distributed training, and large-scale preprocessing. The team owns the open source library end to end, including:

• The streaming execution engine, including scheduling, backpressure, and resource management across CPUs and GPUs
• Batch inference for LLMs and multimodal models, including integrations with inference engines such as vLLM
• Data loading for production training workloads with Ray Train and popular ML frameworks
• Connectors for data sources and formats such as Parquet, Iceberg, Delta Lake, Lance, and cloud object storage
• Performance, stability, and fault tolerance at large scale

This is a first-line engineering management role where you'll lead a team of engineers, stay involved in technical design and code, and own the team's roadmap within the open source project. Ray Data has a large and active community, so you'll also work closely with external contributors to review designs, guide technical direction, and support the project's continued growth and success. The team plays an important role in the broader Ray ecosystem and contributes directly to Anyscale's success.

WHAT YOU'LL DO

• Set the technical direction and roadmap for open source Ray Data, balancing community needs, customer needs, and Anyscale's product goals
• Drive execution of the team's key projects, from d

[…]
Hands-on experience with Ray, Spark, Flink, Beam or similar engines

• Experience with Apache Arrow, columnar formats, or table formats such as Iceberg and Delta Lake
• Experience with GPU workloads, LLM or multimodal batch inference, or data loading for large-scale model training
• Experience operating data or ML infrastructure in production

COMPENSATION

We believe in transparent pay practices. The anticipated base salary range for this role is $267,000 - $375,000. Final salary depends on experience, relevant skills, qualifications, and market considerations. In addition to base pay, eligible employees receive equity awards and enjoy a comprehensive benefits package designed to support their health, well-being, and financial future.

WHY ANYSCALE

• We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms
• Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise
• We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date
• Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments
• Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)
• We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing