Backend & Systems in New York Jobs

135 backend & systems in new york roles at 63 companies · Avg salary $243k (74 with data)

Backend engineering, distributed systems, and API development at AI companies

Engineering Manager, Agents New

Decagon · New York, NY · $200k - $400k
agents distributed-systems healthcare llm
On-site full-time senior 1 day ago

Software Engineer - Airflow Infrastructure

Astronomer · New York, NY · $150k - $165k
distributed-systems data-pipeline cloud infrastructure
Hybrid full-time mid 1 week ago

Senior Platform Product Manager - AI SDLC Trusted Throughput

Datadog · New York, NY · $192k - $240k
agents security healthcare rust
Hybrid full-time senior 1 week ago

Senior Agent Architect

Parloa · New York, NY · $113k - $129k
api-design agents llm generative-ai nlp
Remote full-time senior 1 week ago

Staff Software Engineer, Search

ZocDoc · New York, NY · $211k - $285k
agents data-pipeline cloud healthcare mlops distributed-systems llm embeddings
Hybrid full-time lead 1 week ago

AI Infrastructure Engineer

Jump Trading · New York, NY · $200k - $250k
distributed-systems llm agents infrastructure
On-site full-time senior 1 week ago

Integration Engineer

Harvey AI · New York, NY · $133k - $200k
agents payments api-design data-pipeline
Remote full-time mid 1 week ago

Staff Software Engineer - AI Research Infrastructure

Databricks · New York, NY · $199k - $270k
distributed-systems llm data-pipeline agents search infrastructure research
On-site full-time lead 1 week ago

Software Engineer, Safeguards Labs

Anthropic · New York, NY · $320k - $485k
agents search llm alignment data-pipeline rust
Hybrid full-time senior 2 weeks ago

Infrastructure Engineer (Observability)

Lightning AI · New York, NY · $180k - $200k
distributed-systems data-pipeline pytorch infrastructure
Hybrid full-time senior 3 weeks ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Research Engineer, Agents

Decagon · New York, NY · $200k - $400k
search distributed-systems agents research
On-site full-time lead 3 weeks ago

Staff Software Engineer, Backend

Harvey AI · New York, NY · $231k - $340k
llm generative-ai agents backend
Remote full-time lead 3 weeks ago

Senior Software Engineer, Backend

Harvey AI · New York, NY · $193k - $290k
agents generative-ai llm backend
Remote full-time senior 3 weeks ago

Staff Software Engineer - AI Research Infrastructure

Databricks · New York, NY · $190k - $270k
data-pipeline distributed-systems llm agents search research infrastructure
On-site full-time lead 4 weeks ago

Staff Software Engineer - Agent Quality

Databricks · New York, NY · $190k - $270k
llm search distributed-systems agents data-pipeline
On-site full-time lead 4 weeks ago

Staff Software Engineer, Core Infrastructure

Harvey AI · New York, NY · $201k - $264k
cloud agents distributed-systems infrastructure
On-site full-time lead 1 month ago

Staff Software Engineer, AI Platform

Harvey AI · New York, NY · $231k - $340k
agents distributed-systems generative-ai platform
Remote full-time lead 1 month ago

Machine Learning Engineer

PhysicsX · New York, NY · $150k - $190k
tensorflow deep-learning api-design healthcare distributed-systems data-pipeline mlops machine-learning
Hybrid full-time junior 1 month ago

Senior Forward Deployed Software Engineer

PhysicsX · New York, NY · $150k - $250k
cloud healthcare api-design microservices
Hybrid full-time senior 1 month ago

Senior Software Engineer, Machine Learning

Point72 · New York, NY · $175k - $250k
deep-learning cloud data-pipeline mlops llm api-design machine-learning
On-site full-time senior 1 month ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Weekly AI Jobs Digest

Top new roles from 63+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Free keyed access · Pro $49/mo →

Related searches:

All AI Jobs in New York All Backend & Systems Jobs Remote Backend & Systems Senior Backend & Systems Lead Backend & Systems