Staff Software Engineer - Machine Learning (Search)

Key Responsibilities

• Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. 
• Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. 
• Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. 
• Contribute to building a robust framework for evaluating search ranking improvements - both offline and online.

What We’re Looking For

• BS+ (M.S. or PhD preferred) in Computer Science, or a related field.
• 10+ years experience developing search relevance systems at scale in production or in high-impact research environments.
• Experience applying LLM to search relevance
• Experience in one or more of the following:  
  • Query understanding
  • NLP
  • Text mining
  • Recommendations
  • Personalization
  • Discovery
  • Conversational AI 
• Strong understanding of computer science fundamentals.
  • Contributions to well-used open-source projects