Senior Site Reliability Engineer

About Anyscale: At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI https://thenewstack.io/how-ray-a-distributed-ai-framework-helps-power-chatgpt/, Uber https://www.uber.com/blog/horovod-ray/, Spotify https://engineering.atspotify.com/2023/02/unleashing-ml-innovation-at-spotify-with-ray/, Instacart https://www.youtube.com/watch?v=3t26ucTy0Rs&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=23&pp=iAQB, Cruise https://www.youtube.com/watch?v=gj0BqvfX_wI&list=PLzTswPQNepXmLUiL4F_1VHrPcCz1OeILw&index=46&pp=iAQB, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition https://www.wsj.com/articles/ai-startup-anyscale-adds-99-million-to-andressen-horowitz-led-funding-round-11661254200 with $250+ million raised to date. About the role: As a Senior Site Reliability Engineer, you will lead the architectural strategy and operational excellence for Anyscale’s global production systems. You will move beyond day-to-day maintenance to design autonomous, self-healing infrastructure that aligns with our rapid scaling goals. You will be a key driver in establishing a culture of reliability, ensuring that every engineering team at Anyscale can deploy with confidence and high visibility. As part of this role, you will: - Architect and develop a unified perspective on how cloud components are utilized across the company, taking into account diverse needs and requirements. - Ensure that deployment methodologies align with the company's reliability goals. - Design and implement systems that promote understanding of production environments, facilitating quick identification of issues through robust observability infrastructure for metrics, logging, and tracing. - Create monitoring and alerting systems at different levels, enabling teams to easily contribute and enhance the overall monitoring capabilities. - Establish testing infrastructure to support the team in writing and executing tests effectively. - Define and champion organization-wide Service Level Objectives (SLOs) and Error Budgets, ensuring they are integrated into the product development lifecycle. - Implement best practices and on-call systems, ensuring efficient incident management and up-leveling the incident management system at Anyscale. - Coordinate the creation and deployment of cloud-based services, including tracking deployments and establishing effective communication channels for issue resolution. We'd love to hear from you if have: - At least 5 years of relevant work experience in a Site Reliability or DevOps role, with a proven track record in high-growth environments. - Deep experience managing large-scale distributed systems and microservices architectures in multi-cloud environments (AWS, GCP, or Azure). - Advanced proficiency in at least one programming language (e.g., Python, Go) and extensive experience with IaC tools like Terraform. - Hands-on experience architecting and troubleshooting production-grade Kubernetes clusters. - Demonstrated ability to mentor junior engineers, lead complex technical projects, and influence engineering culture without direct authority. - Strong ability to leverage data from logging and tracing infrastructure to identify long-term architectural trends and bottlenecks.   Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1Kt2S6_k_SjxaEdGowH4rngVdg2ApAQV3/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1K3Nz72xgsU2hngnVUEu53wEeZjbAMbnZ/view?usp=sharing