Skip to main content

Tech Lead Manager- MLRE, ML Systems

L6

scale aiBrooklyn, NYyesterday
Overview: In this role you build and optimize Scale’s distributed training and inference framework, powering researchers, ML engineers, and data scientists. You’ll collaborate with ML and research teams to accelerate development and enable next‑gen model training and data curation. You will explore state‑of‑the‑art technologies to improve our ML system at scale, contributing to reliable AI workflows from training to evaluation. This is a chance to shape foundational infrastructure for cutting‑edge language models. Compensation / Benefits Health, dental and vision coverage Retirement benefits Learning and development stipend Generous PTO Commuter stipend (additional benefits)
Responsibilities: Build, profile and optimize the training and inference framework Collaborate with ML and research teams to accelerate R&D and enable next‑gen models and data curation Research and integrate state-of-the-art technologies to optimize the ML system Contribute to development of post-training and evaluation pipelines for LLMs
Key requirements: Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills with CUDA, PyTorch, transformers, flash attention (and related tools) Strong written and verbal communication skills in cross-functional environments Passion for system optimization cross-functional collaboration clear communication problem solving CUDA PyTorch transformers
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

LeadL6

Location

Brooklyn, NY

Occupation

Computer Systems Engineers/Architects

Industry

Software Publishers

Posted

yesterday

To get sharper similar jobs, create your profile using the link below.

Create profile