Cursor · GPT-5.6 Sol
Product documentation · External evaluation
DeepSWE tests models with mini-swe-agent, not this product’s agent. Evaluator configuration: gpt-5.6-sol[max] · v1.1
Source checked: Oct 3, 2026
Datacurve
DeepSWE
Datacurve · Coding models in the evaluator’s agent. What it measures: Repository task completion. Version 1.1 grades committed code changes in a separate environment. Results depend on the tested agent and reasoning configuration.
- Publisher
- Datacurve
- Scope
- Coding models in the evaluator’s agent
- What it measures
- Repository task completion
- Source checked
- Oct 3, 2026
Scope
A model benchmark describes the tested model and task. It does not measure the whole tool, its interface, or every available plan.
- Match the benchmark version and model configuration.
Documented models with evaluation sources
These model names appear in both the product documentation and an external evaluation. Endpoint revisions, settings and the complete tool workflow have not been matched.
GitHub Copilot · GPT-5.6 Sol
Product documentation · External evaluation
DeepSWE tests models with mini-swe-agent, not this product’s agent. Evaluator configuration: gpt-5.6-sol[max] · v1.1
Source checked: Oct 3, 2026
GitHub Copilot · Gemini 3.8 Flash
Product documentation · External evaluation
DeepSWE tests models with mini-swe-agent, not this product’s agent. Evaluator configuration: gemini-3.8-flash[high] · v1.1
Source checked: Oct 3, 2026
Tools in this category
A model benchmark describes the tested model and task. It does not measure the whole tool, its interface, or every available plan.
GitHub Copilot
AI coding tools
An AI coding assistant integrated across GitHub and popular development environments.
