Software Development Engineer, ML Systems, Annapurna Labs
amazonBrooklyn, NY
Software Development Engineer, ML Systems, Annapurna Labs
L6
amazonBrooklyn, NYtoday
Overview:
Join a fast-evolving team at the forefront of GenAI with AWS Neuron, applying AI-to-AI to accelerate Neuron adoption. You will build agents, tools, and models that simplify migrating workloads to AWS ML silicon, collaborating with internal and external partners. Your work will directly impact the efficiency, performance, and cost of ML workloads on Trainium/Inferentia. This role offers a chance to shape the GenAI strategy within a startup-like environment in NYC. Compensation / Benefits sign-on payments and RSUs health insurance 401(k) matching paid time off parential leave
Responsibilities:
Collaborate with Neuron software teams, AI services, partners, and customers to drive high-impact initiatives. Research and prototype implementations to optimize customer experiences with Neuron. Improve porting and optimization of ML workloads on Neuron. Design, implement, test, deploy, and maintain software to improve performance, durability, cost, and security. Build highly available, reliable products and potentially contribute IP via patents Create metrics, automation, and root-cause analysis to drive software improvements Engage in design discussions, code reviews, and cross-functional communication Work cross-functionally with compiler, hardware, and ML engineers to push forward solutions
Key requirements:
3+ years of non-internship software development 2+ years in design or architecture of scalable systems Experience programming in at least one software language CS core knowledge: OO design, data structures, performance analysis in 2+ languages Experience in ML compilers, production coding agents, GenAI model architecture, model training, neural network optimization, or applied math collaborative mindset strong problem-solving ability ability to work in cross-functional, startup-like environment ML compilers production coding agents GenAI model architecture
Apply now (opens in a new tab)
Level
LeadL6
Location
Brooklyn, NY
Occupation
Software Developers
Industry
Custom Computer Programming Services
Posted
today
To get sharper similar jobs, create your profile using the link below.