
Sr. Manager, Engineering - Model Serving

Sr. Manager, Engineering - Model Serving

Sr. Manager, Engineering - Model Serving
Databricks
Databricks is seeking a Senior Engineering Manager for their Model Serving product, which focuses on deploying and managing AI/ML models. The role involves leading a high-performing engineering team, defining product roadmaps, and ensuring the product meets performance and reliability goals.
Qualification
- 5+ years of experience in technical leadership roles.
- Strong background in AI/ML model deployment and management.
- Experience with performance optimization for CPU and GPU inference.
- Proven track record of delivering scalable and reliable software products.
- Ability to collaborate across multiple teams and stakeholders.
Responsibility
- Lead, mentor, and grow a high-performing engineering team responsible for Model Serving product and infrastructure.
- Define and own the product and technical roadmap for Model Serving.
- Collaborate with product, research, platform, and infrastructure teams for end-to-end delivery.
- Ensure Model Serving meets SLAs, SLOs, and performance goals.
- Drive architectural decisions around latency, throughput, and cost optimization.
- Advocate for customer needs through direct engagement.
- Promote best practices in code quality, testing, and operational readiness.
- Foster a culture of excellence and continuous improvement.




