Staff Software Engineer , Search Ranking (Applied AI)
Staff Software Engineer , Search Ranking (Applied AI)
Staff Software Engineer , Search Ranking (Applied AI)
Databricks
The Staff Software Engineer position at Databricks focuses on enhancing the Search Quality of AI/ML-powered products. The role involves developing and deploying machine learning-based search relevance models, designing automated ML and NLP pipelines, and collaborating with cross-functional teams to improve the search and discovery experience for customers.
Qualification
- BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
- 10+ years experience developing search relevance systems at scale in production or in high-impact research environments.
- Experience applying LLM to search relevance.
- Experience in one or more of the following: Query understanding, NLP, Text mining, Recommendations, Personalization, Discovery, Conversational AI.
- Strong understanding of computer science fundamentals.
- Contributions to well-used open-source projects.
Responsibility
- Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services.
- Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration.
- Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience.
- Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.
