Lead Engineer, AI Quality

Key responsibilities: Build and own evaluation infrastructure, including CI/CD pipelines and datasets for AI agents Diagnose quality breakdowns in AI systems and prototype solutions or identify priorities for improvement Lead the AI Quality engineering team, setting technical direction and managing day-to-day priorities while remaining hands-on in coding

Required qualifications: 7+ years of experience in building and shipping production software, particularly with LLM-powered agents Proficiency in Ruby on Rails and familiarity with Python for data evaluation tasks Experience in developing evaluation or observability infrastructure for ML/AI systems Knowledge of designing datasets, annotation workflows, or labeling pipelines for ML/AI evaluation Ability to thrive in a fast-paced, dynamic environment with a strong alignment to company values