Drive cutting-edge AI product features as a Senior Software Engineer. Integrate LLMs and ML services into user workflows while ensuring safety and measurable outcomes in a remote environment.
This role requires designing APIs, integrating LLM/NLP technologies, and developing evaluation frameworks. You’ll focus on optimizing cost and latency while collaborating closely with research and product teams for rapid iteration. Candidates must possess strong problem-solving skills and a commitment to quality.
Key Responsibilities:
• Design APIs incorporating LLM/NLP and retrieval features
• Build evaluation frameworks to ensure feature quality
• Optimize cost and latency with prompt tuning
• Instrument features for A/B testing and analysis
• Collaborate with cross-functional teams for iteration
Requirements:
• 5+ years software engineering experience
• 2+ years applied ML/LLMs preferred
• Proficient in Python and one backend stack
• Experience with cloud-bas...