We’re building the world’s most ubiquitous programming environment. We focus on inspiring creativity and generating value for creators through community, and we design simple yet scalable infrastructure primitives for the next generation of creators. We want to blur the line between learning and making– a place where you can hang out, tinker with ideas, learn new concepts, and launch a business all in the same day.

Replit is seeking a highly skilled and motivated Backend Engineer with a passion for AI to join the team. As a Backend Engineer - AI, you will play a key role in developing and maintaining the AI infrastructure that powers our platform. You'll work closely with a talented cross-functional team of engineers and researchers to build innovative AI features that will enhance the overall user experience.

You will…:

• Design, develop, and maintain the backend systems that support AI features on the Replit platform.
• Collaborate with AI researchers and engineers to integrate AI models and algorithms into our platform.
• Optimize and scale Large Language Model serving infrastructure to ensure the platform can handle increasing user demands.
• Implement monitoring and logging solutions to proactively identify and address performance issues.
• Work closely with cross-functional teams, including front-end engineers, product managers, and data scientists, to deliver high-quality AI features.
• Create and maintain technical documentation to ensure knowledge sharing and onboarding of new team members.

Required skills and experience:

• Proven experience (3+ years) as a Backend Engineer with a focus on AI or Machine Learning projects.
• Strong proficiency in Python and Go
• Experience with AI frameworks and libraries
• Knowledge of MLOps (and LLMOps) best practices
• Knowledge of distributed computing, cloud platforms (e.g., AWS, GCP, Azure), and containerization (e.g., Docker, Kubernetes).
• Strong problem-solving and troubleshooting skills.

Bonus Points: 

• Experience working at a DevTools company or product