AI System Optimization Engineer
- Malaysia
- Tetap
- Sepenuh masa
- Responsible for developing large model operators, optimizing parallel strategies, and improving performance for both inference and training.
- Build an industry-leading high-performance large model compilation system through the design and performance optimization of self-developed NPU software and hardware systems.
- Collaborate closely with the chip department for joint hardware-software optimization.
- Conduct research and introduction of cutting-edge technologies for large models.
- Possesses a Masters or Bachelors degree in Computer Science, Electronics, Automation, Software, or related fields; proficient in C/C++ or Python, with strong knowledge of algorithms and data structures.
- Skilled in high-performance computing optimization techniques for self-developed NPUs/GPUs, with a deep understanding of computer architecture.
- Familiar with distributed parallel computing optimization, memory access optimization, and low-bit computation.
- Familiar with the basic principles of deep learning algorithms, neural network architecture, and operator computation methods; knowledgeable in at least one deep learning training framework, such as PyTorch, TensorFlow, or MindSpore.
- Familiar with compilation frameworks such as TVM, MLIR, XLA, LLVM; experience in operator acceleration and optimization is a plus.
- Familiar with mainstream LLM (Large Language Model) architectures; experience with acceleration and optimization of LLM models and tools like TensorRT-LLM, ORCA, VLLM is preferred; capable of resolving complex problems encountered during the optimization process.
- A culture that values authenticity and diversity of thoughts and backgrounds;
- An inclusive and respectable environment with open workspaces and exciting start-up spirit;
- Fast-growing company with the chance to network with industrial pioneers and enthusiasts;
- Ability to contribute directly and make an impact on the future of the digital asset industry;
- Involvement in new projects, developing processes/systems;
- Personal accountability, autonomy, fast growth, and learning opportunities;
- Attractive welfare benefits and developmental opportunities such as training and mentoring.