AI Infrastructure in New York Jobs

193 ai infrastructure in new york roles at 78 companies · Avg salary $233k (115 with data)

MLOps, GPU engineering, distributed training, and AI platform jobs

infrastructurecloudgpudistributed-systemsmlopskubernetesinference

Engineering Manager, Agents New

Decagon · New York, NY · $200k - $400k
agents distributed-systems healthcare llm
On-site full-time senior 1 day ago

Generative AI Engineer

Dataiku · New York, NY · $160k - $240k
code-generation payments cloud embeddings llm rag generative-ai agents
On-site full-time senior 3 days ago

Software Engineer - Airflow Infrastructure

Astronomer · New York, NY · $150k - $165k
distributed-systems data-pipeline cloud infrastructure
Hybrid full-time mid 1 week ago

Senior Value Engineer, Consumer Packaged Goods (CPG)

Celonis · New York, NY · $131k - $154k
fine-tuning pytorch cloud agents llm generative-ai
Hybrid full-time senior 1 week ago

Staff Software Engineer, Search

ZocDoc · New York, NY · $211k - $285k
agents data-pipeline cloud healthcare mlops distributed-systems llm embeddings
Hybrid full-time lead 1 week ago

AI Infrastructure Engineer

Jump Trading · New York, NY · $200k - $250k
distributed-systems llm agents infrastructure
On-site full-time senior 1 week ago

Staff Software Engineer - AI Research Infrastructure

Databricks · New York, NY · $199k - $270k
distributed-systems llm data-pipeline agents search infrastructure research
On-site full-time lead 1 week ago

Staff Software Engineer, Full Stack - New Verticals

Harvey AI · New York, NY · $260k - $310k
agents cloud data-pipeline fullstack
Hybrid full-time lead 2 weeks ago

Senior Product Manager, Inference

Lightning AI · New York, NY · $160k - $275k
gpu fine-tuning mlops llm pytorch inference
Hybrid full-time senior 2 weeks ago

Infrastructure Engineer (Observability)

Lightning AI · New York, NY · $180k - $200k
distributed-systems data-pipeline pytorch infrastructure
Hybrid full-time senior 3 weeks ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Staff AI Engineer

Pendo · New York, NY · $250k - $280k
rag mlops diffusion-models alignment generative-ai data-pipeline agents llm
On-site full-time lead 3 weeks ago

Sr. AI Engineer

Pendo · New York, NY · $209k - $235k
llm fine-tuning alignment rag diffusion-models data-pipeline mlops generative-ai
On-site full-time senior 3 weeks ago

Research Engineer, Agents

Decagon · New York, NY · $200k - $400k
search distributed-systems agents research
On-site full-time lead 3 weeks ago

Enterprise Regional Director, Northeast

Glean · New York, NY · $295k - $384k
cloud llm search agents
On-site full-time lead 3 weeks ago

Staff Software Engineer - AI Research Infrastructure

Databricks · New York, NY · $190k - $270k
data-pipeline distributed-systems llm agents search research infrastructure
On-site full-time lead 4 weeks ago

Staff Software Engineer - Agent Quality

Databricks · New York, NY · $190k - $270k
llm search distributed-systems agents data-pipeline
On-site full-time lead 4 weeks ago

AI Engineering Lead

Turing · New York, NY · $220k - $300k
llm cloud agents fine-tuning generative-ai rag
Hybrid full-time lead 4 weeks ago

Forward-Deployed Data Scientist II

Braze · New York, NY · $109k - $183k
reinforcement-learning mlops data-pipeline tensorflow agents data-science
On-site full-time senior 4 weeks ago

Staff Software Engineer, Core Infrastructure

Harvey AI · New York, NY · $201k - $264k
cloud agents distributed-systems infrastructure
On-site full-time lead 1 month ago

Staff Software Engineer, AI Platform

Harvey AI · New York, NY · $231k - $340k
agents distributed-systems generative-ai platform
Remote full-time lead 1 month ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Weekly AI Jobs Digest

Top new roles from 78+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Free keyed access · Pro $49/mo →

Related searches:

All AI Jobs in New York All AI Infrastructure Jobs Remote AI Infrastructure Senior AI Infrastructure Lead AI Infrastructure