Job opportunity
Senior Ascend NPU Systems Engineer
Huawei Canada
Advance Ascend NPU performance at Huawei Canada through kernel development and distributed training optimization for foundation models.
As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters.
Key Responsibilities:
Design and tune FlashAttention and GEMM operators using AscendC
Optimize MindSpeed pre-training and reinforcement learning post-training pipelines
Tune hybrid parallelism and rollout actor pipelining
Implement FP8, MXFP8, and mixed-precision training schemes
Profile Ascend hardware using msprof and PyTorch Profiler
Requirements:
Bachelor’s, Master’s, or PhD in a related technical discipline
Three or more years in HPC or distributed model systems
Experience with AscendC, CANN, or CUDA C/C++
Proficiency in modern Python and PyTorch custom extensions
Experience with AI hardware profiling and debugging tools
Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
#J-18808-Ljbffr
Apply on source site As a Senior System Engineer, you will develop compute operators and scale pre-training and post-training workloads. The work spans AscendC, Triton, TileLang, MindSpeed, Megatron, and PyTorch FSDP. You will improve performance across Ascend NPU clusters.
Key Responsibilities:
Design and tune FlashAttention and GEMM operators using AscendC
Optimize MindSpeed pre-training and reinforcement learning post-training pipelines
Tune hybrid parallelism and rollout actor pipelining
Implement FP8, MXFP8, and mixed-precision training schemes
Profile Ascend hardware using msprof and PyTorch Profiler
Requirements:
Bachelor’s, Master’s, or PhD in a related technical discipline
Three or more years in HPC or distributed model systems
Experience with AscendC, CANN, or CUDA C/C++
Proficiency in modern Python and PyTorch custom extensions
Experience with AI hardware profiling and debugging tools
Apply AscendC, distributed systems, and performance analysis expertise to foundation model acceleration at Huawei Canada.
#J-18808-Ljbffr