Senior AI Scientist

What You Will Work On 

• Design and train large‑scale transformer and hybrid foundation models 

• Own model architecture choices across text, multimodal, and emerging paradigms 

• Diagnose and resolve training instabilities at scale 

• Navigate scaling tradeoffs across data and compute 

• Define the technical direction for next‑generation models 

Core Responsibilities 

Deep Learning & Transformer Foundations 

• Apply strong fundamentals in deep learning and representation learning 

• Design and modify transformer architectures, including: 

Attention variants 

• RoPE, ALiBi 

• Grouped Query Attention (GQA) 

• Mixture‑of‑Experts (MoE) 

• Build models from first principles, not just adapt pre‑existing codebases 

Optimisation Dynamics & Training Stability 

• Own optimiser and scheduler choices, including: 

• AdamW 

• Lion 

• Adafactor 

• Learning‑rate and warmup schedulers 

• Understand and debug: 

• Optimiser instability 

• Gradient pathologies 

Scaling Laws & Compute Tradeoffs 

• Apply and validate scaling laws 

• Navigate Chinchilla‑style compute vs data tradeoffs 

• Make informed decisions about model size, dataset size, and training duration 

Loss Functions & Alignment 

• Design and experiment with loss functions including: 

• Next‑token prediction 

• Contrastive objectives 

• RLHF, DPO, GRPO 

• Understand how loss design impacts convergence, generalization, and alignment 

Distributed Foundation Model Training 

• Design and execute large‑scale training using: 

• FSDP 

• ZeRO‑3 

• Tensor parallelism 

• Pipeline parallelism 

• Apply: 

• Mixed precision (bf16, fp8) 

• Gradient checkpointing 

• Partner closely with ML systems teams​

• What we offer 

  We offer a generous compensation and benefits package (in addition to the base salary), including: 

• Salary range $123,500.00 - $197,600.00 USD  It is not typical for offers to be made at or near the top of the range. The actual salary will be determined based on experience and other job-related factors. 

• Annual bonus opportunity 

• Insurance coverage (medical, dental, vision, life, and disability) 

• Paid time off 

• Paid holidays 

• Company contribution to the RRSP (Registered Retirement Savings Plan) 

• Equity awards for certain positions and levels 

• Remote and/or hybrid work available depending on the position   All compensation and benefits are subject to the terms and conditions of the underlying plans or programs, as applicable, and may be amended, terminated, or replaced from time to time.