Tech Lead Manager- MLRE, ML Systems
scale aiBrooklyn, NY
Tech Lead Manager- MLRE, ML Systems
L6
scale aiBrooklyn, NYyesterday
Occupations
Computer Systems Engineers/ArchitectsComputer and Information Systems ManagersComputer and Information Research ScientistsOverview:
In this role you build and optimize Scale’s distributed training and inference framework, powering researchers, ML engineers, and data scientists. You’ll collaborate with ML and research teams to accelerate development and enable next‑gen model training and data curation. You will explore state‑of‑the‑art technologies to improve our ML system at scale, contributing to reliable AI workflows from training to evaluation. This is a chance to shape foundational infrastructure for cutting‑edge language models. Compensation / Benefits Health, dental and vision coverage Retirement benefits Learning and development stipend Generous PTO Commuter stipend (additional benefits)
Responsibilities:
Build, profile and optimize the training and inference framework Collaborate with ML and research teams to accelerate R&D and enable next‑gen models and data curation Research and integrate state-of-the-art technologies to optimize the ML system Contribute to development of post-training and evaluation pipelines for LLMs
Key requirements:
Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills with CUDA, PyTorch, transformers, flash attention (and related tools) Strong written and verbal communication skills in cross-functional environments Passion for system optimization cross-functional collaboration clear communication problem solving CUDA PyTorch transformers
Apply now (opens in a new tab)
Level
LeadL6
Location
Brooklyn, NY
Occupation
Computer Systems Engineers/Architects
Industry
Software Publishers
Posted
yesterday
To get sharper similar jobs, create your profile using the link below.