A

Senior ML Software Engineer, Data Plane

Amazon

Tel Aviv, Israel, Israel Full-time June 03, 2026
Apply Now

Vacancy Description

Description
The MLIL DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

Key job responsibilities
- Develop and optimize compute kernels for a custom ML acceler...

Ready to Apply?

अभी आवेदन करें

Submit your application for Senior ML Software Engineer, Data Plane at Amazon

Apply for this Position