product updateGitHub

GitHub Copilot Evals enters public preview to help users optimize Copilot

TL;DR

GitHub Copilot Evals is now in public preview. GitHub says users can use it to optimize GitHub Copilot for themselves as their prompts, models, skills, and tools change.

1 min read
0

GitHub Copilot Evals is now in public preview, GitHub announced on November 17, 2026 in its changelog.

According to GitHub, users can use Copilot Evals to optimize GitHub Copilot for themselves. The announcement frames the tool around a question: as prompts, models, skills, and tools change, are users still getting the most out of Copilot?

What GitHub states

  • Status: public preview
  • Purpose: optimizing GitHub Copilot for an individual user's setup
  • Variables named: prompts, models, skills, and tools

Pricing, availability by plan, supported models, and benchmark or scoring details are not stated in the announcement summary.

What this means

Copilot setups combine several parts that change over time: the prompts a user writes, the models selected, and the skills and tools attached. GitHub positions Copilot Evals as a way to check how that combination performs, rather than assuming it keeps working well after each change. The public preview label means the feature is available for testing and may change before general release.

Comments

Loading...