Anthropic tests AI agent marketplace with 186 deals totaling $4,000 among employees
Anthropic conducted an internal experiment called Project Deal where AI agents represented 69 employees as buyers and sellers in a classified marketplace. The agents completed 186 real transactions totaling over $4,000, revealing that more advanced models achieved better outcomes but users couldn't detect the performance disparity.
Anthropic tests AI agent marketplace with 186 deals totaling $4,000 among employees
Anthropic conducted an internal experiment where AI agents autonomously negotiated purchases and sales on behalf of human users, completing 186 transactions worth more than $4,000.
The experiment, called Project Deal, involved 69 Anthropic employees who each received a $100 budget (distributed via gift cards) to buy items from coworkers. AI agents represented both buyers and sellers, handling all negotiation and deal-making.
Experiment structure
Anthropic ran four separate marketplaces with different AI models. One marketplace was "real" — using the company's most advanced model with deals actually honored after completion. Three additional marketplaces were created for comparative study.
Each employee participated with real money and real goods, though Anthropic describes this as "only a pilot experiment with a self-selected participant pool."
Key findings
The company identified several concerning patterns:
Model quality disparity: Users represented by more advanced models achieved "objectively better outcomes" according to Anthropic. However, users couldn't detect this performance gap, raising what the company calls "agent quality gaps" where people on the losing end don't realize they're worse off.
Instruction irrelevance: Initial instructions given to the agents had no measurable effect on sale likelihood or negotiated prices, suggesting the models may override or ignore certain user preferences.
Transaction volume: Despite the limited participant pool, agents completed 186 deals, indicating high activity levels when AI handles negotiation overhead.
What this means
Project Deal demonstrates both the potential and risks of AI-to-AI commerce. The ability to complete 186 transactions among 69 people shows agents can reduce friction in peer-to-peer marketplaces. But the undetected performance gaps present a fairness problem: if users with access to better models systematically extract more value without others noticing, it creates invisible economic stratification.
The finding that initial instructions don't affect outcomes is particularly notable. It suggests current AI agents may be difficult to control through natural language directives alone, with implications for how users can meaningfully direct agent behavior in commercial settings.
Anthropic hasn't announced plans to commercialize Project Deal, but the experiment provides early data on how AI agents might reshape commerce when negotiating with each other rather than humans.
Related Articles
METR report: Anthropic's unreleased Model 4 scores 178.6 on AECI, ahead of Opus 5.5
METR's new report discloses three unreleased Anthropic models, Model 2, Model 3 and Model 4. Model 4 scores 178.6 on Anthropic's AECI index, about 3.9 points above Opus 5.5. Anthropic co-founder Sam McCandlish confirmed the report's main findings but said much information was removed.
Perplexity launches 'teammates' AI agents inside Computer, exclusive to $200-a-month Max plan
Perplexity has launched 'teammates,' personal AI agents built on Perplexity Computer that handle ongoing work autonomously with minimal supervision. The feature is exclusive to Perplexity Max subscribers, who pay $200 a month or $2,000 a year, on web and iOS.
METR Report: Anthropic's AI Development Pace May Have Doubled Due to Internal AI Use
A new report from AI research nonprofit METR says AI use within Anthropic may have doubled the company's pace of AI development. The rate at which Anthropic's models are improving as of October is roughly twice the rate between March 2024 and October 2025, according to The Information.
Anthropic launches Personal Finance in Claude with read-only Plaid access for US Pro, Max and Ultra users
Anthropic announced Personal Finance in Claude, a feature that connects bank and credit card accounts through Plaid with read-only access. Conversations in the Personal Finance hub are not used to train Anthropic's models. It is available only to Pro, Max and Ultra subscribers in the US.
Comments
Loading...