Staff Backline Engineer (Spark)
Staff Backline Engineer (Spark)
Staff Backline Engineer (Spark)
Databricks
Databricks is seeking a Staff Backline Engineer to support customers using the Databricks Data Intelligence platform. The role involves resolving technical escalations, acting as a liaison between support and engineering, and ensuring issues are properly vetted before reaching the engineering team. The ideal candidate will have extensive experience with Apache Spark and related technologies, and will contribute to improving troubleshooting processes and customer satisfaction.
Qualification
- 12+ years of industry experience developing, testing, and sustaining applications in Python, Java, or Scala.
- Experience with compiling, building, and navigating the Apache Spark source code.
- Ability to identify and apply patches/bug fixes to the Apache Spark source code.
- Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
- Hands-on experience with Spark-related technologies.
Responsibility
- Troubleshoot and resolve complex customer issues related to Apache Spark core internals, Spark SQL, Structured Streaming, and Databricks Delta.
- Provide best practices guidance on Spark runtime performance and usage of Spark core libraries and APIs.
- Assist the support team with detailed troubleshooting guides and runbooks.
- Contribute to automation and tooling programs for efficient troubleshooting.
- Collaborate with the Spark Engineering Team to communicate upcoming features and releases.
- Identify Spark bugs and suggest workarounds.
- Demonstrate ownership and coordinate with engineering and escalation teams to resolve customer issues.
- Participate in on-call rotation for support.
