Research Scientist

Location: Seattle, WA (Remote)

Duration: 12 months contract with possible of extension

Minimum Qualifications: 4+ years of experience in an applied research setting, or similar. Proven experience developing benchmarks and metrics to evaluate AI models, preferably with a focus on code generation or natural language processing (NLP).Familiarity with software engineering principles (unit tests, CI/CD, version control etc.).Strong programming skills in 1 or more programming languages (including Python).2 years or more of experience with machine learning and data science algorithms and tools (e.g., PyTorch).Ability to produce meaningful visualizations and reports, and effectively present results to different audiences and across multiple media formats. Ability to work independently as well as collaboratively with minimal direction. Organized, highly attentive to detail, and manages time well. Experience working in industry.

Preferred Qualifications: Advanced degree (MS/PhD) in data analytics, statistics, or any engineering or computer science field. Experience with large language models (LLMs) and knowledge of state-of-the-art code generation techniques. Publication(s) in the fields of artificial intelligence, machine learning or data science. Familiarity with code generation-specific benchmarks and metrics. Ability to modify or fine-tune pre-trained models for specialized tasks. Familiarity with code scanning tools.