Infrastructure Operations Engineer

Lightning AI · New York, NY · $160k - $200k
full-time lead Posted 6 days ago

About this role

Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with less friction. Through our merger with Voltage Park, a neocloud and AI Factory, Lightning AI combines developer-first software with cost-efficient, large-scale compute. Teams get the tools they need for experimentation, training, and production inference, with security, observability, and control built in. We serve solo researchers, startups, and large enterprises. Lightning AI operates globally with offices in New York City, San Francisco, Seattle, and London, and is backed by Coatue, Index Ventures, Bain Capital Ventures, and Firstminute.   *]:pointer-events-auto [content-visibility:auto] supports-[content-visibility:auto]:[contain-intrinsic-size:auto_100lvh] R6Vx5W_threadScrollVars scroll-mb-[calc(var(--scroll-root-safe-area-inset-bottom,0px)+var(--thread-response-height))] scroll-mt-[calc(var(--header-height)+min(200px,max(70px,20svh)))]" data-turn-id="request-WEB:6da214d3-9e35-4d43-89b6-34d5a76ffba7-1" data-turn-id-container="request-WEB:6da214d3-9e35-4d43-89b6-34d5a76ffba7-1" data-testid="conversation-turn-4" data-scroll-anchor="false" data-turn="assistant"> What We're Looking For Lightning AI is seeking an experienced  Infrastructure Operations Engineers to help scale and operate our next-generation AI infrastructure platform. Our InfraOps team sits at the center of reliability, automation, and operational scale for GPU infrastructure. This team owns break/fix operations, incident response, customer provisioning, observability, and the automation systems that keep complex infrastructure running efficiently. In this role, you’ll work hands-on with large-scale GPU environments, Linux systems, bare metal infrastructure, provisioning workflows, and platform reliability. You’ll partner closely with Infrastructure Engineering, Network Operations, and Software Platform teams to troubleshoot issues, improve operational efficiency, and build automation that reduces manual toil over time. We’re flexible on location for this team. This role can work hybrid out of one of our US-based hubs (Seattle, NYC, or SF) or fully remote within the U.S., with occasional company and team offsites. We are not able to provide visa sponsorship for this position at this time.   What You'll Do At the direction of the Manager of Infrastructure Operations, design, build, and roll out new platforms and patterns to minimize incidents and enable customer facing and internal features. Deploy updates and improvements to support both Voltage Park’s internal and end customer use cases. Collaborate with colleagues in Infrastructure Engineering, Network Operations, Customer Success and Software and Platform Development Teams. Participate in the on-call rotation which is evenly distributed across all team members in a primary / secondary pattern where you are primary then move to a secondary position.   What You Will Need Required Qualifications 8+ years working with Linux as a server / hosting platform, extra points for Ubuntu experience. 5+ years experience with AWS. 2+ years experience with Kubernetes and strong container fundamentals. 2+ years experience with Terraform and Ansible 2+ years with network attached storage management (via NFS, ceph, or other protocols). Extra points for experience with VAST storage systems. Experience with monitoring systems (Prometheus, ELK stack). Familiarity with the gitops workflow. Software development experience using Python, Go, bash, or other languages for the purposes of automation & connecting systems & APIs together. Deep networking fundamentals, extra points for experience with datacenter level networks, 400Gb ethernet, and Infiniband. Experience building and delivering complex systems. Effective at navigating tradeoffs between design, risk, cost, and outcomes. Comfortable with navigating ambiguity. Strong written and oral communication. Nice-to-Haves Experience with bare metal hardware troubleshooting and provisioning, extra points for working with Dell hardware. Experience with GPU servers, both in bare metal form or under virtualization. Deep experience with network switches, routers, and firewalls, particularly SONiC switches, Palo Alto firewalls and Juniper Networks as vendors. Experience with VAST storage systems   Compensation   We are committed to offering competitive compensation that reflects the value each team member brings to our mission. Final offers are based on factors such as experience, skills, geographic location, and role expectations. In addition to base salary, our total rewards package for eligible roles includes a discretionary bonus, a meaningful equity component, and comprehensive benefits. The anticipated annual base salary range for this role is: $160,000 —

Similar Jobs

Related searches:

Hybrid Jobs Lead Jobs Hybrid Lead Jobs Lead AI InfrastructureLead Machine Learning AI Jobs in New York AI Infrastructure in New YorkMachine Learning in New York gpupytorchinfrastructure

Get jobs like this delivered weekly

Free AI jobs newsletter. No spam.