Backend Engineer, Multi-cloud Kubernetes platform
Backend Engineer, Multi-cloud Kubernetes platform
modularai
Modular is seeking a Backend Engineer for their Cloud Inference team to develop a multi-cloud, multi-tenant platform for AI inference services. The role focuses on building scalable, fault-tolerant systems that enhance operational excellence in AI deployments. Candidates can work remotely or from the Los Altos, CA office, with a hybrid model for early-career professionals.
Qualification
- Experience in backend engineering and distributed systems development.
- Strong understanding of AI inference and machine learning concepts.
- Proficiency in building scalable cloud-based applications.
- Familiarity with Kubernetes and cloud service providers.
- Ability to work in a hybrid or remote environment.
Responsibility
- Build the multi-cloud, multi-tenant platform powering Modular’s inference services.
- Develop fault-tolerant, low toil services utilizing various hardware platforms and cloud providers.
- Enhance operational excellence with observability, multi-cloud deployments, and cold-start optimizations.
- Create helm charts and Kubernetes operators for deployment management.
- Collaborate with cross-functional teams to improve AI inference systems.
