Vacancy Description
We are sharing a specialised part-time consulting opportunity for experienced machine learning researchers with hands-on expertise in foundation model pre-training, large-scale data pipelines, language model post-training, and empirical LLM research.
This role focuses on well-scoped, open-ended research problems involving the end-to-end training and improvement of transformer-based language models. Selected researchers will train models from scratch, fine-tune open-weight systems, build pre-training corpora and post-training pipelines, diagnose training failures, and investigate methods for improving performance under limited data and compute budgets.
Key Responsibilities
Foundation Model Pre-Training
- Train transformer-based language models from scratch across full end-to-end workflows
- Design experiments involving model size, token allocation, training duration, and compute budgets
- In...