GitHub Copilot Evals enters public preview to help users optimize Copilot
GitHub Copilot Evals is now in public preview. GitHub says users can use it to optimize GitHub Copilot for themselves as their prompts, models, skills, and tools change.
GitHub Copilot Evals is now in public preview, GitHub announced on November 17, 2026 in its changelog.
According to GitHub, users can use Copilot Evals to optimize GitHub Copilot for themselves. The announcement frames the tool around a question: as prompts, models, skills, and tools change, are users still getting the most out of Copilot?
What GitHub states
- Status: public preview
- Purpose: optimizing GitHub Copilot for an individual user's setup
- Variables named: prompts, models, skills, and tools
Pricing, availability by plan, supported models, and benchmark or scoring details are not stated in the announcement summary.
What this means
Copilot setups combine several parts that change over time: the prompts a user writes, the models selected, and the skills and tools attached. GitHub positions Copilot Evals as a way to check how that combination performs, rather than assuming it keeps working well after each change. The public preview label means the feature is available for testing and may change before general release.
Related Articles
GitHub Copilot team customizations now generally available for organization teams
GitHub announced that team customizations for GitHub Copilot are generally available for organization teams. The feature lets teams share the Copilot plugins they rely on without asking every member to repeat the same setup.
Anthropic Adds Experimental Code Mode to Claude Code v2.1.323, Chaining Tool Calls in JavaScript
Anthropic has added an experimental Code Mode to Claude Code v2.1.323. Claude can write JavaScript that chains Bash, Read and Edit calls in one step, and keep talking while long commands run.
OpenAI's GPT-6.2 Astra and GPT-6.2 Sol are generally available in GitHub Copilot
OpenAI's GPT-6.2 Astra and GPT-6.2 Sol are now generally available in GitHub Copilot, according to the GitHub changelog. GitHub says both models are designed for agentic coding and code review, with stronger coding judgment than earlier GPT-6 models.
Perplexity Brain Can Now Create and Update Agent Skills; 80,000+ Personal Skills Written for 20,000+ Users
Perplexity said on November 18, 2026, that Brain, the personalization system for its Computer agent, can now create and update reusable agent skills. According to the company, Brain wrote more than 80,000 personal skills for over 20,000 users between August 1, 2026, and November 14, 2026.
Comments
Loading...