Vacancy Description
Shape the future of AI at Baseten as a Software Engineer focused on Model APIs. Drive the development of advanced inference capabilities and optimize performance for hosted APIs.
Join Baseten's Model Performance team to ensure reliability, speed, and cost-efficiency of AI models. This role requires expertise in distributed systems, backend services, and model serving. You will play an integral part in enhancing developer interactions with cutting-edge AI through a collaborative and high-impact environment.
Key Responsibilities:
• Design and operate Model APIs with advanced inference capabilities
• Profile and optimize TensorRT-LLM kernels for performance
• Implement performance improvements across various runtimes
• Build benchmarking frameworks measuring model performance
• Collaborate closely with teams to improve developer experiences
Requirements:
• 3+ years of experience in distributed systems or large-scale APIs
• Proven ownership of low-latency back...
Join Baseten's Model Performance team to ensure reliability, speed, and cost-efficiency of AI models. This role requires expertise in distributed systems, backend services, and model serving. You will play an integral part in enhancing developer interactions with cutting-edge AI through a collaborative and high-impact environment.
Key Responsibilities:
• Design and operate Model APIs with advanced inference capabilities
• Profile and optimize TensorRT-LLM kernels for performance
• Implement performance improvements across various runtimes
• Build benchmarking frameworks measuring model performance
• Collaborate closely with teams to improve developer experiences
Requirements:
• 3+ years of experience in distributed systems or large-scale APIs
• Proven ownership of low-latency back...
Ready to Apply?
अभी आवेदन करें
Submit your application for Model API Software Engineer at Baseten at Baseten
Apply for this Position