Replit is seeking a highly skilled and motivated Backend Engineer with a passion for AI to join the team. As a Backend Engineer - AI, you will play a key role in developing and maintaining the AI infrastructure that powers our platform. You'll work closely with a talented cross-functional team of engineers and researchers to build innovative AI features that will enhance the overall user experience.

You will…:

• Design, develop, and maintain the backend systems that support AI features on the Replit platform.
• Collaborate with AI researchers and engineers to integrate AI models and algorithms into our platform.
• Optimize and scale Large Language Model serving infrastructure to ensure the platform can handle increasing user demands.
• Implement monitoring and logging solutions to proactively identify and address performance issues.
• Work closely with cross-functional teams, including front-end engineers, product managers, and data scientists, to deliver high-quality AI features.
• Create and maintain technical documentation to ensure knowledge sharing and onboarding of new team members.

Required skills and experience:

• Proven experience (3+ years) as a Backend Engineer with a focus on AI or Machine Learning projects.
• Strong proficiency in Python and Go
• Experience with AI frameworks and libraries
• Knowledge of MLOps (and LLMOps) best practices
• Knowledge of distributed computing, cloud platforms (e.g., AWS, GCP, Azure), and containerization (e.g., Docker, Kubernetes).
• Strong problem-solving and troubleshooting skills.

Bonus Points: 

• Experience working at a DevTools company or product