AI QA Engineer

Passionate about testing the future of AI?

At Aktios , we are looking for a skilled AI QA Engineer to join our dynamic team. You will be responsible for ensuring the quality and reliability of AI/ML-powered systems, including LLM-based applications, multi-agent architectures, and data pipelines on AWS/Azure. The role involves designing and implementing comprehensive testing strategies, building automated test frameworks, and validating AI system outputs in a highly collaborative Scrum Agile environment.

Responsibilities

• Design, develop, and maintain automated test frameworks and test suites for LLM-powered applications and multi-agent systems (e.g., built with LangChain/LangGraph, CrewAI, PyTorch, or similar frameworks).
• Develop and execute evaluation strategies for RAG (Retrieval-Augmented Generation) pipelines, validating document ingestion, chunking quality, embedding accuracy, and retrieval relevance.
• Test and valid...