Senior Software Engineer - Distributed Data Systems
Senior Software Engineer - Distributed Data Systems
Senior Software Engineer - Distributed Data Systems
Databricks
Databricks is seeking a Senior Software Engineer for their Runtime team to develop next-generation distributed data storage and processing systems. The role focuses on enhancing performance and expressiveness for diverse workloads, including ETL and data science, while working on projects like Apache Spark, Delta Lake, and Delta Pipelines.
Qualification
- BS or higher in Computer Science or related field
- Experience with distributed systems
- Strong programming skills in languages such as Java or Scala
- Familiarity with cloud storage solutions like AWS S3 or Azure Blob Store
- Understanding of data engineering and machine learning concepts
Responsibility
- Build distributed data storage and processing systems
- Enhance performance of SQL query engines
- Support diverse workloads including ETL and data science
- Develop reliable services for cloud storage backends
- Create higher-level abstractions for data pipelines
