Senior Software Engineer - Database Engine Internals
Senior Software Engineer - Database Engine Internals
Senior Software Engineer - Database Engine Internals
Databricks
Databricks is seeking a Senior Software Engineer to work on the next generation of database engine internals, focusing on query compilation, optimization, and distributed systems. The role involves designing and implementing systems that enhance performance and reliability in data processing, contributing to the company's mission of simplifying the data lifecycle.
Qualification
- Passion for database systems, storage systems, distributed systems, language design, or performance optimization
- Experience working towards a multi-year vision with incremental deliverables
- Motivated by delivering customer value and impact
- 5+ years of experience in a related system (preferred)
- Optional: PhD in databases or distributed systems
Responsibility
- Design and implement next generation query engine and structured storage systems
- Work on query compilation and optimization
- Develop distributed query execution and scheduling mechanisms
- Create a vectorized execution engine
- Ensure data security and resource management
- Coordinate transactions and optimize physical data storage
- Implement efficient storage structures including encodings and indexes
