Senior Machine Learning Engineer - LLMOps

Job Summary

Responsible for leading the transition of our Generative AI initiatives from experimental proofs-of-concept to resilient, enterprise-scale production systems. This role is pivotal in establishing the architectural standards and operational rigor required to maintain high-performing, secure, and cost-effective LLM applications within our cloud and on-premise environment.

How will you contribute?

1. LLM Experimentation & Evaluation Frameworks
   • Architect and maintain systematic environments for prompt versioning, hyperparameter tuning, and model comparison.
   • Establish automated evaluation pipelines utilizing metrics such as faithfulness, relevancy, and toxicity to benchmark model iterations.
   • Implement “Human-in-the-loop” (HITL) workflows to validate automated metrics against domain‑specific banking requirements.
2. Architectural Oversight & Integration
   • Define and govern the end-to-...