Skip to main content

Senior ML Engineer - AI Inference & Optimization

L6

nebius groupPalo Alto, CAtoday
Nebius is seeking a Senior Machine Learning Engineer on the Applied AI team to own model and endpoint optimization from artifacts to production. You will optimize latency, throughput, memory, and cost per token while preserving quality; collaborate with kernel and platform engineers on serving problems and benchmarking. You will evaluate optimizations across engines like vLLM, TensorRT-LLM, Triton, and NVIDIA Dynamo, implement quantization workflows, and design scalable multi-node inference with
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

LeadL6

Location

Palo Alto, CA

Occupation

Software Developers

Industry

Custom Computer Programming Services

Posted

today

To get sharper similar jobs, create your profile using the link below.

Create profile