SWE-bench VerifiedCoding
46.8/ 100
Verified
Last Verified: 2025-05-21Mistral AI
Resolving real-world GitHub issues. Verified subset ensures solvable issues.
Beta version: *Information might not be fully accurate. Please report any discrepancies.
Beta version: *Information might not be fully accurate. Please report any discrepancies.
Latest Data
2025-05-21
Context Window
128k
tokens
Input Cost
$0.10
per 1M tokens
Output Cost
$0.30
per 1M tokens
Parameters
24B
model footprint
Performance Analysis // Verified Benchmarks
Resolving real-world GitHub issues. Verified subset ensures solvable issues.