Shape the future of AI with Outlier as an Evaluation Engineer. Collaborate closely with leading organizations to enhance AI agents through human feedback and innovative design.
Outlier is seeking an AI Evaluation Engineer with over two years of experience in backend engineering and AI automation. The ideal candidate should have a robust understanding of software development, including modular services and complex system integration. Engage directly in crafting proactive and multi-step AI agents while ensuring high-quality performance through rigorous testing and feedback.
Key Responsibilities:
• Build and maintain production-grade software for AI systems
• Provide technical feedback on agent behaviors and workflows
• Coordinate multi-turn system interactions effectively
• Implement integrations with live tools and APIs
• Ensure system optimization and data management
Requirements:
• 2+ years in backend engineering or AI automation
• Proficiency in Python, ...