Staff Software Engineer - Database Engine Internals
Staff Software Engineer - Database Engine Internals
Staff Software Engineer - Database Engine Internals
Databricks
Databricks is seeking a Staff Software Engineer specializing in Database Engine Internals to contribute to the development of a next-generation query engine and structured storage system. The role focuses on enhancing data lifecycle management through innovative architectural patterns like Lakehouse, aiming to improve performance and reliability in data processing and analytics.
Qualification
- Passion for database systems, storage systems, distributed systems, language design, or performance optimization.
- Experience in working towards a multi-year vision with incremental deliverables.
- Motivated by delivering customer value and impact.
- 8+ years of experience in a related system is preferred.
- Optional: PhD in databases or distributed systems.
Responsibility
- Design and implement next-generation query compilation and optimization systems.
- Develop distributed query execution and scheduling mechanisms.
- Create a vectorized execution engine for improved performance.
- Enhance data security measures within the database systems.
- Manage resource allocation and transaction coordination effectively.
- Design efficient storage structures including encodings and indexes.
- Implement automatic physical data optimization techniques.
