Engineering Manager, ChatGPT Search Infrastructure

About the Team The ChatGPT Search Infrastructure team builds the foundational systems that power search experiences across ChatGPT. We develop the infrastructure that connects models with search systems and other sources of real-time information, enabling ChatGPT to deliver timely, relevant, and trustworthy answers to users around the world. Our work sits at the intersection of product engineering, AI, and large-scale infrastructure. We build shared platforms and abstractions that enable product teams to independently develop, evaluate, and launch new search-powered experiences. These platforms provide the guardrails, testing capabilities, observability, and rollout controls needed to prevent reliability, scalability, quality, and latency regressions while supporting rapid product iteration. The team partners closely with: - Post-Training on model launches, experimentation, and prompt optimization - Search product verticals on new user experiences - Inference on GPU efficiencies - Indexing and Retrieval on the systems that identify and deliver relevant information - Capacity/Fleet team to ensure optimal regionalized provisioning of GPUs and CPUs About the Role We are looking for an Engineering Manager to lead the team responsible for ChatGPT’s Search Infrastructure. You will set the technical and organizational direction for the systems that bring search capabilities into ChatGPT. You will guide architectural decisions across search orchestration, model and prompt integration, serving infrastructure, experimentation, observability, evaluation, and product integrations. You will balance immediate launch and product needs with the long-term reliability, scalability, latency, and maintainability of the platform. A central responsibility of this role is creating leverage for Search product verticals. You will lead the development of extensible platforms that allow those teams to independently build, test, and launch features without requiring ongoing involvement from the core infrastructure team. These platforms must include strong interfaces and automated guardrails that enable fast iteration while protecting the reliability, scalability, latency, and quality of ChatGPT Search. This role requires technical depth across the full Search stack and the ability to understand and influence systems owned by partner teams. You will be expected to develop a coherent technical direction across model behavior, inference, search orchestration, indexing, retrieval, experimentation, and infrastructure—even when execution spans multiple organizational boundaries. You will lead multiple complex workstreams, empower experienced engineers to own major technical areas, and partner with product, research, Post-Training, Search Quality, Inference, Indexing, Retrieval, and infrastructure teams to translate emerging model and search capabilities into reliable experiences operating at global scale. In this role, you will: - Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure, spanning search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations. - Lead and develop a team of experienced engineers, create meaningful ownership opportunities, and foster an inclusive, high-trust culture with clear accountability and high standards. - Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization, translating model improvements into production-ready product experiences. - Build reusable platforms that enable Search product vertical teams to independently implement, test, and launch features, with automated guardrails that protect reliability, scalability, quality, and latency. - Partner with Inference, Indexing, and Retrieval teams to evolve the end-to-end Search architecture, adapt serving optimizations, and improve product outcomes across the stack. - Define and uphold service objectives of at least 99.9% availability, sub-second latency where required by the user experience, and the scalability needed to support ChatGPT’s continued growth. - Establish strong engineering practices across system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention. - Independently lead multiple complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams in ambiguous and rapidly changing environments. You might thrive in this role if you: - Have experience managing senior engineers and leading teams responsible for complex, high-scale infrastructure, online serving, or distributed systems. - Bring significant technical depth in backend infrastructure, platform engineering, APIs, low-latency serving, experimentation platforms, or AI-powered product development. - Understand ho