Join Databricks: Pioneering the Future of Data and AI

At Databricks, we are driven by a passion to empower data teams in tackling the world's most challenging problems—from revolutionizing transportation to accelerating medical innovations. Our mission is to build and operate the premier data and AI infrastructure platform, enabling our customers to leverage deep data insights for transformative business improvements. If you are passionate about advancing data and AI technologies and are eager to lead a cutting-edge product to success, we invite you to join our dynamic team at Databricks

About the Role:

Enterprise customers prioritize the quality of Retrieval-Augmented Generation (RAG) and Large Language Model (LLM) applications. However, without a robust platform to evaluate this quality, making informed, data-driven decisions to enhance these systems over time becomes nearly impossible. The AI Agent Evaluation team is dedicated to addressing this critical need. By leveraging LLMs and specialized models, we assess the quality of RAG and LLM application responses across multiple dimensions, including correctness, relevance, and toxicity.

We empower our customers to build, optimize, and monitor their LLM and RAG applications at scale, efficiently and effectively. This year, we proudly announced the Public Preview of our AI Agent Evaluation suite at the Data and AI Summit. Now, we seek an exceptional engineering leader to elevate this product to General Availability, shape its strategic direction, and propel it to new heights.

Key Responsibilities:

Lead the product strategy and development for the AI Agent Evaluation.

Drive the platform from Public Preview to General Availability.

Innovate and optimize to ensure the highest quality and performance.

Collaborate with cross-functional teams to deliver scalable solutions.

Engage with customers to understand their needs and enhance their experience.

5+ years of AI Infra experience

Experience building highly-available cloud services

Building, growing, and managing high performance teams

Experience in defining and meeting SLOs for highly-available systems

Ability to attract and hire engineers who meet the Databricks hiring standards

Knowledge of database internals (highly Preferred)

BS in Computer Science (Masters or PhD Preferred)