Senior Machine Learning Engineer I (Finance)

The Senior Machine Learning Engineer I sits in the Finance Transformation team in IT at CP Axtra, building and operating AI/LLM-powered features that automate and augment finance processes across Makro and Lotus's. The role requires strong engineering fundamentals, hands-on experience deploying AI features into production, and the ability to work with Finance and cross-functional teams. It does not focus on developing custom ML models, but deep technical proficiency and system-level thinking are essential.

Responsibilities:

AI and LLM Evaluation

•Evaluate large language models and AI services for accuracy, reliability, safety, latency, and business suitability on finance use cases.

•Design structured evaluation frameworks, test cases, and benchmarking methodologies.

•Conduct prompt testing, retrieval validation, and failure-mode analysis.

•Implement quality guardrails, safety filters, and monitoring for LLM applications han...