Sr Backline Engineer (Apache Spark™)
Sr Backline Engineer (Apache Spark™)
Sr Backline Engineer (Apache Spark™)
Databricks
The Sr Backline Engineer at Databricks will play a crucial role in ensuring customer success with the Databricks Data Intelligence platform by resolving technical escalations related to Apache Spark™. This position involves deep code-level analysis, providing best practices, and collaborating with engineering teams to enhance customer support and troubleshooting processes.
Qualification
- 8+ years of industry experience developing, testing, and sustaining Python or Java or Scala-based applications.
- Comfortable with compiling, building and navigating the Apache Spark source code.
- Comfortable with identifying and applying patches/bug fixes to the Apache Spark source code.
- Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
- Hands-on experience with SQL-based database systems.
Responsibility
- Troubleshoot, resolve and suggest deep code-level analysis of Spark to address complex customer issues related to Apache Spark™ core internals, Spark SQL, Structured Streaming and Databricks Delta.
- Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers.
- Help the support team with detailed troubleshooting guides and runbooks.
- Contribute to automation and tooling programs to make daily troubleshooting efficient.
- Work with the Spark Engineering Team and spread awareness of upcoming features and releases.
- Identify Spark bugs and suggest possible workarounds.
- Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests.
- Participate in weekend and weekday on call rotation.
