What you'll do

Design and integrate LLM-based solutions, focusing on RAG implementations and optimal architecture patterns
Lead rapid experimentation and prototyping of AI features, conducting proof of concepts to validate solutions
Drive cost optimization for AI implementations through efficient architecture design
Work closely with product, engineering, and customer experience teams to develop AI solutions
Build and optimize prompt engineering workflows to enhance user experiences
Implement robust error handling and monitoring for AI systems
Guide technical discussions around AI architecture decisions
Mentor team members and champion innovation in AI development

Required skills

5+ years of backend engineering experience with TypeScript/Node.js or Python
Experience with LLM integrations (OpenAI, Anthropic, Azure OpenAI) and familiarity with orchestration frameworks like LangChain or LlamaIndex
Experience/familiarity with real-time event-driven and streaming systems
Working knowledge of prompt engineering, RAG, and vector databases
Experience with API design and microservices architecture
Track record of rapid prototyping and experimentation
Strong cross-functional collaboration and communication skills

About you

You thrive in a fast-paced environment with evolving requirements
You balance quick experimentation with production-ready code
You're skilled at navigating ambiguity and driving projects to completion
You collaborate effectively with diverse stakeholders
You make thoughtful architectural decisions, balancing innovation with constraints
You focus on business impact and user experience
You enjoy mentoring others and fostering engineering excellence

Nice to have

Experience with conversational AI and voice agent development
Knowledge of autonomous agent architectures and workflows
Background in data pipeline design and ETL processes
Experience building low-latency, real-time AI systems
Familiarity with AI agent orchestration frameworks
Understanding of multi-agent systems and communication patterns
Knowledge of AI system cost optimization

Compensation

The ranges displayed reflect the target for new hire salaries, and within each range, individual pay is determined by your skills and experience, as well as relevant education. Your recruiter can share more and answer questions about the specific salary range during the hiring process.

Salary is just one component of OpenPhone’s total compensation package. Your total rewards package will include equity, extensive medical coverage, a monthly lifestyle stipend, and a flexible PTO policy.

OpenPhone

Senior Backend Engineer, AI & Productivity

Canada - Remotefull-time$196,000 - $218,000 CAD