Huawei Canada has an immediate Co-op opening for an Engineer.
About the team:
The Intelligent Cloud Infrastructure Lab aims to innovate technologies, algorithms, systems, and platforms for next-generation cloud infrastructure. The lab addresses scalability, performance, and resource utilization challenges in existing cloud services while preparing for future challenges with appropriate technologies and architectures. Additionally, the lab aims to understand industry dynamics and technology trends to create a robust ecosystem.
About the job:
Understand AI System and Infrastructure technology landscape, and identify scalability/performance issues or challenges of current LLM/multi-modal LLM systems
Initiate and charter innovation projects to build or re-architect AI infrastructure platform, and plan milestones accordingly
Provide/contribute a scalable and high-performance architecture design or re-design for the infrastructure system that is optimized for AI training and inferencing, which includes but not limited to cluster management and scheduling, LLM model deployment, elastic LLM as well as AI container cold/warm start-up optimization, and so on.
Collaborate with internal and external teams to deliver the project or project features that improve our overall system scalability and performance.
The target annual compensation (based on 2080 hours per year) ranges from $58,000 to $104,000 depending on education, experience and demonstrated expertise.
About the ideal candidate:
Bachelors, Master/PhD degree in Computer Science, Computer Engineering
Experience in building large scale and high-performance distributed system
Experience in Nvidia TensorRT and/or Triton servers. Experience in container virtualization technologies
Knowledge & experience in distributed system design & development, including serverless technologies
Work experience in one or more of the following technologies: vLLM, Ray, SGLang, Kubernetes, TensorRT-LLM, Pytorch framework, Cuda libraries, GPU technologies
Work experience in one or more of the following programming languages: C/C++, Go, Java, Rust, python, C#
Have excellent interpersonal and communication skills to collaborate with multiple teams and build strong partnerships effectively
Demonstrated success working on software engineering problems that span multiple products
Job details are sourced from the employer's original posting.
Open job postingAbout the company
Huawei Technologies provides innovative and customized network solutions for telecom carriers around the world. Huawei holds leading positions in the global market in switching, next generation network (NGN), integrated access network, DSLAM, and intelligent network. Specializing in the areas of fixed network, mobile network, optical network, data communications, and value-added services, we strive to enable the best communication with our deep understanding of customers' needs. Huawei is dedicated to delivering long term value and potential growth to our customers. Established in 1988 and headquartered in Shenzhen, China, Huawei has already won trust from over 300 telecom carriers around the world. Our products and solutions serve over 90 countries, as well as 22 of the world's top 50 operators. Huawei’s cloud computing products provide the reliability, agility, and price-performance needed for delivering cutting-edge applications and services quickly, safely, and securely to large scale of industry verticals. Our cloud deploys various popular technologies like Docker, Kubernetes, Mesos, Openstack, SDN/NFV, Hadoop, Spark, and many more. Huawei Public Cloud now mainly launched in China (and will spread to the other parts of the world) and Private cloud is deployed in several customer locations. Huawei has 400+ Worlwide Data Centers including several public/private cloud setups.