Staff Software Engineer, Metrics and Logging
Staff Software Engineer, Metrics and Logging
Databricks
Databricks is seeking a Staff Software Engineer for their Logging Platform team, responsible for building scalable logging solutions that enhance observability across services. The role involves designing a next-generation logging platform, optimizing log delivery, and mentoring engineers.
Qualification
- BS (or higher) in Computer Science, or a related field.
- 7+ years of production-level experience in Scala, Rust, Go, Python, Java, C++, or similar languages.
- Experience with building scalable systems and logging infrastructure.
- Strong understanding of observability principles and practices.
- Ability to collaborate effectively with cross-functional teams.
Responsibility
- Build the future of logging at Databricks by designing and scaling the next-generation logging platform that processes petabytes of logs daily.
- Develop and optimize log delivery pipelines for low-latency, high-throughput log ingestion and querying.
- Enhance log accessibility and usability by developing tools for efficient log search and analysis.
- Collaborate with teams to define best practices for structured logging and improve developer experience.
- Optimize log retention, indexing, and query performance to improve reliability and cost-efficiency.
- Mentor and uplevel engineers, fostering a culture of technical excellence.
