Software Engineer - Ruby AI
full-time
mid
Posted 5 days ago
About this role
About the Team
We're the Ruby AI team, building Rubrik's AI-powered assistant for Rubrik Security Cloud. Customers use Ruby to troubleshoot issues, run diagnostics, and perform operations through natural language, powered by a multi-agent architecture. The system ships to thousands of enterprise customers in production and is central to Rubrik's AI strategy.
About the Role
You'll design and build AI agents that help customers manage and protect their data through conversation instead of complex UIs. You'll work primarily in Python and Go, covering the full agent lifecycle: behavior design, tool integration, evaluation, and production observability. This is a hybrid role based in Palo Alto with deep ownership in a fast-moving product area.
What Makes This Role Unique
This isn't a demo or an internal tool. Ruby ships to thousands of enterprise customers who depend on it daily. You'll own production agents working at the intersection of large language models, enterprise security, and product design with a small team where your contributions are directly visible to company leadership.
The Impact You'll Have
Build AI agents that resolve real customer problems (vSphere troubleshooting, cluster diagnostics, log analysis), reducing resolution time from hours to minutes.
Design tool integrations that let agents safely query data, retrieve logs, and perform operations while honoring RBAC and security boundaries.
Build retrieval pipelines and multi-model orchestration to deliver reliable, cost-effective agent responses across LLM providers.
Develop evaluation frameworks that measure agent quality and catch regressions before changes reach production.
Instrument agents with observability tooling and turn monitoring data into continuous quality improvements.
What You'll Need
BS in Computer Science or equivalent field of study.
3+ years of professional software engineering experience.
Strong proficiency in Python with experience building production services.
Experience in at least one additional programming language (such as Go, Java, or C++).
Experience building AI-powered applications or working with AI/ML technologies.
Experience building and consuming APIs (GraphQL, gRPC, or REST) with solid engineering fundamentals in design, testing, and debugging.
Clear written and verbal communication skills, comfortable navigating ambiguity in a cross-team environment.
Preferred Qualifications
Experience with agent frameworks (LangChain, LlamaIndex, or similar) or RAG and vector search pipelines.
Experience with cloud platforms and containerized deployments (Docker, Kubernetes).
Familiarity with frontend technologies (React, TypeScript) for contributing to user-facing components.
Why Join Us?
AI agents are reshaping how customers interact with security platforms. You'll be building that future with a team small enough that your code ships to production weekly and your ideas shape the product roadmap directly.
About the Company
Rubrik is the leader in data security, helping the world's largest organizations protect, observe, and recover their data across enterprise, cloud, and SaaS environments. We believe in giving engineers responsibility, not tasks, and we're looking for people who are excited by ambiguity and driven to produce extraordinary results
The minimum and maximum base salaries for this role are posted below; additionally, the role is eligible for bonus potential, equity and benefits. The range displayed reflects the minimum and maximum target for new hire salaries for the role based on U.S. location. Within the range, the salary offered will be determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
US Pay Range
$152,400 — $228,700 USD
Join Us in Securing and Accelerating the World's AI Transformation
Rubrik (RBRK), the Security and AI Operations Company, leads at the intersection of data protection, cyber resilience, and enterprise AI acceleration. Rubrik Security Cloud delivers complete cyber resilience by securing, monitoring, and recovering data, identities, and workloads across clouds. Rubrik Agent Cloud accelerates trusted AI agent deployments at scale by monitoring and auditing agentic actions, enforcing real-time guardrails, fine-tuning for accuracy and undoing agentic mistakes.
Linkedin | X (formerly Twitter) | Instagram | Rubrik.com
Inclusion @ Rubrik
At Rubrik, we are dedicated to fostering a culture where people from all backgrounds are valued, feel they belong, and believe they can succeed. Our commitment to inclusion is at the heart of our mission to secure the world’s data.
Our goal is to hire and promote the best talent, regardless of background. We continually review our hiring practices to ensure fairness and strive to create an environment where every employee has equal access to opportunities for growth and excellence.
Similar Jobs
Related searches:
On-site Jobs
Mid-Level Jobs
On-site Mid-Level Jobs
Mid-Level NLP & Language AIMid-Level AI Agents & RAGMid-Level Generative AIMid-Level Machine LearningMid-Level AI InfrastructureMid-Level Backend & Systems
AI Jobs in Palo Alto
NLP & Language AI in Palo AltoAI Agents & RAG in Palo AltoGenerative AI in Palo AltoMachine Learning in Palo AltoAI Infrastructure in Palo AltoBackend & Systems in Palo Alto
ragfine-tuningapi-designllmagentscloud
Get jobs like this delivered weekly
Free AI jobs newsletter. No spam.