Inference Jobs

77 jobs from companies building with AI · Avg salary $276k (33 with data)

ML inference engineering roles focused on model serving, latency optimization, quantization, and efficient deployment. Inference engineers make models fast and cost-effective in production.

Senior Product Manager, Inference

Lightning AI · New York, NY · $160k - $275k
gpu pytorch mlops fine-tuning llm inference
Hybrid full-time senior 1 week ago

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Anthropic · San Francisco, CA · $320k - $485k
llm distributed-systems alignment infrastructure inference
Hybrid full-time lead 1 week ago

Staff Software Engineer, Inference

CoreWeave · Sunnyvale, CA · $188k - $275k
distributed-systems gpu llm inference
Hybrid full-time lead 1 week ago

Software Engineer, Inference Platform

FluidStack · San Francisco, CA · $165k - $350k
gpu llm pytorch distributed-systems jax inference
On-site full-time senior 1 month ago

Senior AI Inference Engineer - Model Optimization & Deployment

Zoox · Foster City, CA · $242k - $290k
gpu generative-ai llm inference
On-site full-time senior 1 month ago

Sr. Manager, Engineering - AI Gateway (LLM Inference)

Databricks · New York, NY · $228k - $314k
llm data-pipeline generative-ai mlops inference
On-site full-time senior 1 month ago

Staff Software Engineer, Cloud Inference Safeguards

Anthropic · San Francisco, CA · $405k - $485k
alignment agents data-pipeline inference rust
Hybrid full-time lead 1 month ago

Engineering Manager, Cloud Inference AWS

Anthropic · San Francisco, CA · $405k - $485k
llm alignment cloud infrastructure inference
Hybrid full-time lead 2 months ago

Member of Technical Staff, Inference & RL Systems

Magic · San Francisco, CA · $225k - $550k
distributed-systems code-generation pre-training inference
On-site full-time lead 2 months ago

Senior Applied Economist, Causal Inference & Forecasting

Navan · San Francisco, CA · $121k - $270k
payments data-pipeline cloud inference
On-site full-time senior 3 months ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Senior Applied Economist, Causal Inference & Forecasting

Navan · New York, NY · $121k - $270k
data-pipeline payments cloud inference
On-site full-time senior 3 months ago

Staff + Sr. Software Engineer, Cloud Inference

Anthropic · San Francisco, CA · $320k - $485k
alignment payments llm distributed-systems infrastructure inference
Hybrid full-time lead 3 months ago

Senior Software Engineer I, Inference

CoreWeave · Sunnyvale, CA · $139k - $204k
distributed-systems gpu llm inference
Hybrid full-time senior 3 months ago

Member of Technical Staff, Inference

Inferact · San Francisco, CA · $200k - $400k
diffusion-models llm pytorch agents reinforcement-learning mlops inference research
Hybrid full-time lead 3 months ago

Senior Software Engineer, Inference Platform

MongoDB · Palo Alto, CA · $126k - $248k
llm rag embeddings search distributed-systems mlops inference
Hybrid full-time senior 4 months ago

Software Engineer, Bulk/Interactive Inference

Waymo · Mountain View, CA · $170k - $216k
distributed-systems llm autonomous-vehicles mlops inference
On-site full-time junior 5 months ago

Research Engineer, Infrastructure, Inference

Thinking Machines · San Francisco, CA · $350k - $475k
llm gpu pytorch search deep-learning inference infrastructure research
On-site full-time principal 5 months ago

Software Engineer, Inference AI/ML

CoreWeave · Sunnyvale, CA · $92k - $135k
gpu llm microservices pytorch tensorflow mlops inference
Hybrid full-time mid 6 months ago

Staff + Sr. Software Engineer, Inference

Anthropic · San Francisco, CA · $300k - $485k
llm cloud alignment distributed-systems inference infrastructure
Hybrid full-time lead 7 months ago

Staff Software Engineer - GenAI inference

Databricks · San Francisco, CA · $190k - $232k
cloud gpu llm data-pipeline distributed-systems generative-ai mlops inference
On-site full-time lead 7 months ago
Hiring AI developers? Start with a job post. Claiming the profile comes after. Post a job →

Weekly AI Jobs Digest

Top new roles from 37+ companies. Curated, not scraped. One email, every Monday.

No spam. Unsubscribe anytime.

Hiring AI engineers?

Post the role first. Your company profile and analytics connect from the employer flow.

Post a Job See Pricing

Agentic API & MCP Server

Wire AI Dev Jobs into your agent at build time — MCP server live, REST API public for discovery, free API keys for recurring search.

# Add as MCP server
claude mcp add --transport http aidevjobs https://aidevboard.com/mcp

# Or hit the REST API
curl https://aidevboard.com/api/v1/jobs?tags=llm,pytorch

13 tools via com.aidevboard/jobs · Free keyed access · Pro $49/mo →