Senior ML Engineer - AI Inference & Optimization
nebius groupPalo Alto, CA
Senior ML Engineer - AI Inference & Optimization
L6
nebius groupPalo Alto, CAtoday
Occupations
Software DevelopersComputer Systems Engineers/ArchitectsComputer and Information Research ScientistsNebius is seeking a Senior Machine Learning Engineer on the Applied AI team to own model and endpoint optimization from artifacts to production. You will optimize latency, throughput, memory, and cost per token while preserving quality; collaborate with kernel and platform engineers on serving problems and benchmarking.
You will evaluate optimizations across engines like vLLM, TensorRT-LLM, Triton, and NVIDIA Dynamo, implement quantization workflows, and design scalable multi-node inference with
Apply now (opens in a new tab)
Level
LeadL6
Location
Palo Alto, CA
Occupation
Software Developers
Industry
Custom Computer Programming Services
Posted
today
To get sharper similar jobs, create your profile using the link below.