Research Engineer - LLM Training & Alignment Systems
Huawei Technologies Canada · Kingston, Ontario, Canada · Onsite
Weak hiring record · median 197 days open
All reasons
- Open 155 days
- 88% of this employer's openings are over 60 days old
In its favour
- Still listed on the employer's own board
- Publishes a salary range
Huawei Canada has an immediate 12-month contract opening for a Research Engineer.
About the team
The Centre for Software Excellence Lab conducts pioneering research in software engineering, focusing on next-generation technologies. This team integrates industry best practices with cutting-edge academic research to address lifecycle software engineering challenges, including foundation model applications, software performance engineering, hyper-cluster programming, next-gen mobile OS, and cloud-native computing. This lab uniquely allows researchers to apply innovations directly to products affecting billions of customers while promoting open-source contributions, publications, conference participation, and collaborations to create a broader impact.
About the job
- Research, prototype, and build core infrastructure, tooling, and platforms to support the full lifecycle of large foundation model development, including data curation, model training, alignment, and evaluation, with a strong focus on scalability, efficiency, and research impact.
- Design and implement systems and workflows for SFT data curation, deduplication, and synthetic data generation, enabling high-quality training signals for large language models. Develop and optimize distributed training and alignment pipelines, including supervised fine-tuning, reward modelling, and reinforcement learning–based preference optimization (e.g., PPO, GRPO), across heterogeneous hardware platforms.
- Build and evaluate LLM evaluation and benchmarking frameworks to assess model quality, alignment, robustness, and regression across training iterations. Collaborate closely with systems, hardware, and research teams to integrate novel algorithms and software frameworks into in-house platforms, addressing challenges such as performance modelling, resource allocation, scheduling, fault tolerance, and communication efficiency.
- Work with leading industry and academic experts worldwide, contribute to impactful research publications, and drive innovation through prototype systems and patentable inventions that advance large-scale model training and serving.
The total target annual compensation (based on 2,080 hours per year) ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.
About the ideal candidate
- Hands-on experience with large language model training and alignment, including supervised fine-tuning (SFT), reward modeling, preference learning, and reinforcement learning–based optimization (e.g., PPO, GRPO), with a solid understanding of stability, scalability, and efficiency trade-offs .
- Strong background in large-scale distributed training systems, with experience optimizing performance, resource utilization, and reliability across multi-node, multi-device, and heterogeneous hardware environments (e.g., GPU, NPU). Experience building SFT data pipelines, including semantic deduplication and synthetic data generation, with a clear understanding of how data quality and distribution affect model behavior and alignment.
- Experience designing or applying LLM evaluation and benchmarking frameworks, including automated evaluation, preference-based assessment, and regression analysis to measure model quality, alignment, and robustness.
- Proficiency in Python, C/C++, or Go, with the ability to translate research ideas into scalable, reproducible prototype systems, and to communicate technical insights effectively across research and engineering teams.
Additional Information
Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.
All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.
More jobs at Huawei Technologies Canada
All 172- Intern Researcher- Computer VisionHuawei Technologies Canada · Markham, Ontario, Canada · USD 58,000–104,000/yr3d ago
- Senior AI System Engineer - LLM Training SystemHuawei Technologies Canada · Vancouver, British Columbia, Canada · USD 127,000–225,000/yr3d ago
- Intern Researcher- AI AgentsHuawei Technologies Canada · Markham, Ontario, Canada · USD 58,000–104,000/yr8d ago
- Hardware & Embedded Systems Engineer - AI-Edge DevicesHuawei Technologies Canada · Markham, Ontario, Canada · USD 106,000–156,000/yr10d ago
- Researcher - AI Agents & Knowledge GraphsHuawei Technologies Canada · Ottawa, Ontario, Canada · USD 90,000–140,000/yr14d ago
Similar roles
- SaaS EngineerRedwood Software · Ontario, Canadatoday
- Systems Administrator / Operations Support SpecialistUpstaff · Toronto, Ontario, Canadatoday
- Lead Field Service TechnicianHoneywell · Hamilton, ON, Canada · USD 70,000–87,000/yrtoday
- Director, Oracle ERP Product ManagementTru Cooperative Bank · Langley, BC, Canada · Penticton, BC, Canada · Duncan, BC, Canada +2 · USD 120,000–153,800today
- Distinguished Engineer, Core DevOpsGitLab · Remote, Canada · Remote, United Kingdom · Remote, United States · USD 250,000–349,000/yrtoday
- Site Reliability Engineer, Infrastructure Platforms — AMER (Intermediate to Senior Staff)GitLab · Remote · Canada · US · USD 126,400–314,400/yrtoday