AI Infrastructure in New York Jobs

106 ai infrastructure in new york roles at 43 companies · Avg salary $235k (55 with data)

MLOps, GPU engineering, distributed training, and AI platform jobs

infrastructurecloudgpudistributed-systemsmlopskubernetesinference

Hiring from

Datadog Hebbia OpenAI Modal Adaptive ML Mistral AI Reflection AI Scale AI Anthropic PathAI
agents 1530 autonomous-vehicles 410 cloud 927 computer-vision 412 data-pipeline 709 deep-learning 494 distributed-systems 956 fine-tuning 525 generative-ai 1296 healthcare 609 infrastructure 359 llm 1753 machine-learning 397 mlops 382 payments 760 pytorch 695 reinforcement-learning 371 research 503 robotics 599 search 536

Senior Software Engineer, Applied AI

CoreWeave · New York, NY · $165k - $242k
code-generation distributed-systems api-design llm
Hybrid full-time senior 6 days ago

Sr. Manager, Engineering - AI Gateway (LLM Inference)

Databricks · New York, NY · $228k - $314k
llm generative-ai data-pipeline mlops inference
On-site full-time senior 1 week ago

Product Marketing - Agent Infrastructure

LangChain · New York, NY · $210k - $235k
cloud agents llm infrastructure
On-site full-time lead 2 weeks ago

Engineering Manager

Hebbia · New York, NY · $200k - $300k
agents llm data-pipeline distributed-systems
On-site full-time senior 2 weeks ago

Member of Technical Staff, Software Engineer

Fireworks AI · New York, NY · $175k - $220k
mlops cloud pytorch gpu agents payments fine-tuning distributed-systems
On-site full-time lead 2 weeks ago

Research Engineer, Evaluations

AssemblyAI · New York, NY · $210k - $260k
data-pipeline llm cloud speech search research evaluation
Remote full-time senior 2 weeks ago

Integrations Engineer

Hebbia · New York, NY · $160k - $265k
agents search data-pipeline distributed-systems cloud llm
On-site full-time junior 3 weeks ago

Staff Backend Software Engineer

Databricks · New York, NY · $190k - $261k
mlops agents pytorch cloud llm data-pipeline distributed-systems backend
On-site full-time lead 3 weeks ago

Software Engineer, AI Platform

Harvey AI · New York, NY · $220k - $300k
agents generative-ai distributed-systems platform
On-site full-time lead 1 month ago

Senior Applied AI Engineer - Energy Industry

Celonis · New York, NY · $131k - $154k
cloud fine-tuning agents generative-ai pytorch llm
Hybrid full-time senior 1 month ago

Senior Applied AI Engineer - Life Sciences

Celonis · New York, NY · $131k - $154k
cloud fine-tuning agents llm generative-ai pytorch
Hybrid full-time senior 1 month ago

Senior Product Manager – AI Remediation

Datadog · New York, NY · $187k - $240k
llm distributed-systems cloud healthcare
Hybrid full-time senior 1 month ago

Senior Applied AI Engineer-(Healthcare Distribution)

Celonis · New York, NY · $131k - $154k
agents healthcare cloud llm pytorch fine-tuning generative-ai
Hybrid full-time senior 1 month ago

Data Science Engineer, Capacity & Efficiency

Anthropic · New York, NY · $275k - $370k
payments alignment cloud data-science
Hybrid full-time senior 1 month ago

Staff Software Engineer, Core Infrastructure

Harvey AI · New York, NY · $201k - $264k
cloud distributed-systems agents infrastructure
Remote full-time lead 2 months ago

Associate Director, MLOps Engineering

PathAI · New York, NY · $181k - $278k
distributed-systems healthcare pytorch mlops cloud generative-ai code-generation machine-learning
Remote full-time lead 4 months ago

Senior AI Engineer - APM Experiences

Datadog · New York, NY · $187k - $240k
nlp agents healthcare llm distributed-systems microservices
On-site full-time senior 4 months ago

Staff AI Platform Engineer

AlphaSense · New York, NY · $203k - $304k
microservices agents distributed-systems embeddings payments llm rag platform
On-site full-time lead 6 months ago

Research Engineer / Research Scientist, Tokens

Anthropic · New York, NY · $350k - $500k
reinforcement-learning search data-pipeline distributed-systems pytorch alignment research
Hybrid full-time principal 6 months ago

Platform Hardware Security

Anthropic · New York, NY · $405k - $485k
alignment cloud distributed-systems security
Hybrid full-time lead 6 months ago

Weekly AI Jobs Digest

Top new roles from 43+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Agentic API

Build with our API. Let your agents post jobs and apply automatically.

# Search jobs
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

# Register for API access
curl -X POST https://aidevboard.com/api/v1/register/company \
  -d '{"name":"Acme AI","email":"hire@acme.ai"}'

AI Infrastructure in New York Jobs — FAQ

How many ai infrastructure in new york jobs are available?
There are currently 106 ai infrastructure in new york jobs on AI Dev Jobs from 43 companies. The average salary is $235k based on 55 listings with published compensation.
What ai infrastructure skills are in demand in New York?
AI Infrastructure roles in New York commonly require experience with infrastructure, cloud, gpu, distributed-systems, mlops, kubernetes, inference. Browse current listings for specific requirements and salary ranges.
What is the average salary for ai infrastructure in new york jobs?
Based on 55 job listings with salary data, the average ai infrastructure in new york salary is $235k per year.

Related searches:

All AI Jobs in New York All AI Infrastructure Jobs Remote AI Infrastructure Senior AI Infrastructure Lead AI Infrastructure

AI Jobs in New York — FAQ

How many AI jobs are in New York?
There are currently 106 AI developer jobs in New York from 43 companies. The average salary is $235k based on 55 listings with published compensation.
What is the average AI developer salary in New York?
Based on 55 job listings with salary data, the average AI developer salary in New York is $235k per year.
Which companies hire AI developers in New York?
43 companies are currently hiring AI developers in New York. Browse the full list on AI Dev Jobs to see open roles, salary ranges, and required skills.