Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.
This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work across request routing, fleet orchestration, load balancing, and deployment pipelines. The work spans diverse AI accelerators, cloud platforms, and emerging model architectures.
Key Responsibilities:

Design distributed systems serving Claude to millions worldwide
Develop real-time resilient systems for changing events
Build routing, load balancing, and traffic management systems
Autoscale and orchestrate production and research workloads
Operate production-grade model deployment pipelines
Requirements:

Significant software engineering experience with distributed systems
Experience with high-performance large-scale distributed systems
Experience deploying machine learning systems at scale
Proficiency in Python or Rust
Bachelor’s degree or equivalent education, training, or experience
Apply distributed systems, routing, and infrastructure expertise to advance Anthropic’s reliable, high-performance Claude inference platform.

#J-18808-Ljbffr

Senior Distributed Systems Software Engineer