Backend Software Engineer

What You’ll Be Doing Inference & Orchestration Design, build, and scale core orchestration layers, service boundaries, and inference pipelines serving production AI features across mobile and desktop apps. Tame Non-Deterministic AI Build high-reliability , long-running workflows that handle multi-step reasoning, external tool interaction, and persistent context despite non-deterministic model behavior. Performance Optimization Drive low latency and high throughput across inference, caching, batching, and streaming strategies. Production Excellence Own end-to-end operational quality, including monitoring, logging, alerting, and rapid incident response for high-traffic API endpoints. What We’re Looking For Solid Backend Fundamentals Proven track record building and operating high-throughput, low-latency production services. AI/LLM Familiarity Practical experience with AI inference patterns, including LLMs, embeddings, and multimodal systems, and integrating providers such as OpenAI, Anthropic, or open-source models. Distributed Systems Mastery Comfortable debugging distributed backend architectures under heavy load. Product-Minded Execution Strong bias toward shipping quickly, learning from production metrics, and taking full ownership of systems. Tech Stack Languages: Python, Node.js AI/ML: PyTorch, OpenAI / Anthropic APIs, Open-Source LLMs Data: SQL and NoSQL databases Infra & Ops: Kubernetes, Docker, modern cloud architecture