Software Engineer- AI

About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.  At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in. Available Location: Bengaluru, India About the Team: As customer zero, we evangelize our products to drive maximum business value while serving as the "glue" that aligns cross-functional stakeholders with our technical ecosystem. We operate with an automation-first mindset , purposefully outgrowing yesterday’s processes to create the headspace needed to solve tomorrow’s problems. On this team, you won't just maintain the status quo—you'll foster the collaboration and innovation necessary to ensure our products and people work better together.   Enablement : We evangelize and elevate awareness around our product offerings and opportunities to leverage our own product for business value capabilities Be the glue : Like the many products we have, it only works if it all works well together.  Finding common ground to enhanced cross-functional collaboration and alignment with business stakeholders will strengthen customer and product common ground. Automation First mindset:   We can only truly do our best work when we have the space to reimagine how we solve tomorrow's problems today.  It's okay that what worked well yesterday may not be what we need for tomorrow.   About this Role: We are seeking a highly experienced LLM Developer to join our team. In this role, you will lead the development of our internal AI initiatives, starting with taking ownership of the Cloudflare IT support chatbot. You will be responsible for designing and executing new AI use cases that directly improve employee experience and productivity across the organization. You will leverage Cloudflare’s own ecosystem, including AI Gateway, to build scalable, production-ready AI applications. Responsibilities: Take ownership of the development and maintenance of the internally built Cloudflare IT support chatbot, ensuring high availability and continuous improvement of response quality. Identify, design, and build new AI-driven use cases and tools to enhance employee productivity and streamline internal workflows. Develop and deploy AI applications at scale, ensuring reliability, performance, and security. Integrate and optimize AI applications using Cloudflare’s AI Gateway to manage and monitor model usage effectively. Partner closely with internal teams to understand their pain points and translate them into technical AI solutions. Stay up-to-date with the latest advancements in LLMs and Generative AI to continuously innovate our internal toolset. Requirements: 5+ years of experience in software development, with a strong focus on AI, Machine Learning, or Agentic applications. Proven experience in the development and deployment of AI applications at scale in a production environment with focus on strong authorization and data privacy. Familiarity with Cloudflare AI Gateway and experience managing API traffic for LLMs. Strong proficiency in TypeScript and experience with relevant AI/ML libraries and frameworks (e.g., PyTorch, TensorFlow, LangChain). Experience with observability and configuration management, Infrastructure as Code (Terraform), and CI/CD pipelines (GitLab/GitHub), Grafana, OTEL, K8s etc. Experience and expertise in Agile methodology. Excellent interpersonal and communication skills in written and spoken English. Prior experience working on enterprise engineering teams or building internal developer tools is a plus. Fraud Alert:   Do not fall