Backend & Systems in New York Jobs

125 backend & systems in new york roles at 59 companies · Avg salary $246k (67 with data)

Backend engineering, distributed systems, and API development at AI companies

backendgopythonrustmicroservicesapi-designdistributed-systems

Infrastructure Engineer (Observability)

Lightning AI · New York, NY · $180k - $200k
pytorch distributed-systems data-pipeline infrastructure
Hybrid full-time senior 1 week ago

Research Engineer, Agents

Decagon · New York, NY · $200k - $400k
search distributed-systems agents research
On-site full-time lead 1 week ago

Staff Software Engineer, Backend

Harvey AI · New York, NY · $231k - $340k
llm generative-ai agents backend
Remote full-time lead 1 week ago

Senior Software Engineer, Backend

Harvey AI · New York, NY · $193k - $290k
agents generative-ai llm backend
Remote full-time senior 1 week ago

Staff Software Engineer - AI Research Infrastructure

Databricks · New York, NY · $190k - $270k
data-pipeline distributed-systems agents search llm research infrastructure
On-site full-time lead 1 week ago

Staff Software Engineer, Core Infrastructure

Harvey AI · New York, NY · $201k - $264k
agents distributed-systems cloud infrastructure
On-site full-time lead 2 weeks ago

Staff Software Engineer, AI Platform

Harvey AI · New York, NY · $231k - $340k
agents distributed-systems generative-ai platform
Remote full-time lead 2 weeks ago

Machine Learning Engineer

PhysicsX · New York, NY · $150k - $190k
tensorflow mlops data-pipeline healthcare deep-learning distributed-systems api-design machine-learning
Hybrid full-time junior 2 weeks ago

Software Engineer - Airflow Infrastructure

Astronomer · New York, NY · $150k - $165k
distributed-systems cloud data-pipeline infrastructure
Hybrid full-time mid 2 weeks ago

Senior Forward Deployed Software Engineer

PhysicsX · New York, NY · $150k - $250k
cloud healthcare microservices api-design
Hybrid full-time senior 3 weeks ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Senior Software Engineer, Applied AI

CoreWeave · New York, NY · $165k - $242k
llm distributed-systems api-design code-generation
Hybrid full-time senior 1 month ago

Senior Software Engineer, Machine Learning

Point72 · New York, NY · $175k - $250k
cloud data-pipeline mlops deep-learning llm api-design machine-learning
On-site full-time senior 1 month ago

Engineering Manager

Hebbia · New York, NY · $200k - $300k
agents distributed-systems llm data-pipeline
On-site full-time senior 1 month ago

Integrations Engineer

Hebbia · New York, NY · $160k - $265k
agents search data-pipeline distributed-systems cloud llm
On-site full-time junior 1 month ago

Staff Backend Software Engineer

Databricks · New York, NY · $190k - $261k
distributed-systems agents pytorch cloud data-pipeline llm mlops backend
On-site full-time lead 1 month ago

Senior Software Engineer, AI Platform

Harvey AI · New York, NY · $220k - $300k
generative-ai agents distributed-systems platform
On-site full-time senior 2 months ago

Machine Learning Engineer

Virtu Financial · New York, NY · $200k - $300k
search pytorch data-pipeline distributed-systems gpu machine-learning
On-site full-time senior 2 months ago

Senior Backend Engineer

Raylu AI · New York, NY · $100k - $200k
llm distributed-systems agents backend
On-site full-time senior 2 months ago

Staff Software Engineer, Marketplace

ZocDoc · New York, NY · $180k - $265k
llm microservices search healthcare
Hybrid full-time lead 2 months ago

Technical Director, Media & Entertainment AI Infrastructure

Nebius · New York, NY · $295k - $365k
computer-graphics generative-ai mlops gpu distributed-systems cloud data-pipeline infrastructure
Remote full-time lead 3 months ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Weekly AI Jobs Digest

Top new roles from 59+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Free keyed access · Pro $49/mo →

Related searches:

All AI Jobs in New York All Backend & Systems Jobs Remote Backend & Systems Senior Backend & Systems Lead Backend & Systems