Kernel Engineer
Kernel Engineer
modularai
Modular is seeking an AI Kernel Engineer to join their team focused on revolutionizing AI infrastructure. The role involves building high-performance kernels for CPUs, GPUs, and emerging hardware architectures to enhance AI model deployment and performance. Candidates can work remotely or from the office in Los Altos, CA, with relocation assistance available.
Qualification
- Strong experience in kernel development for CPUs and GPUs.
- Proficiency in performance optimization techniques for machine learning models.
- Familiarity with AI frameworks and model deployment processes.
- Experience with memory management and resource optimization.
- Ability to work collaboratively in a team focused on AI infrastructure.
Responsibility
- Design and optimize high-performance ML numeric and data manipulation kernels/operators.
- Accelerate model latency and maximize throughput.
- Minimize communication overhead and optimize resource utilization.
- Streamline memory usage through reduced activation volumes.
- Enhance data pre- and post-processing pipelines.
- Deliver measurable end-to-end performance gains across the model ecosystem.
