Alibaba · 32B · Dense
Best open-source coding model at release
Use Cases
| Quant | Bits | VRAM | Quality | Status |
|---|---|---|---|---|
| Q2_K | 2 | 10.7 GB | low | — |
| Q3_K_M | 3 | 14.8 GB | moderate | — |
| Q4_K_M | 4 | 16.9 GB | good | — |
| Q5_K_M | 5 | 21 GB | good | — |
| Q6_K | 6 | 25.1 GB | excellent | — |
| Q8_0 | 8 | 33.3 GB | excellent | — |
| F16 | 16 | 66.1 GB | lossless | — |
GPUs that run Qwen 2.5 Coder 32B
Qwen 2.5 Coder 32B needs about 16.9 GB of VRAM at Q4_K_M, so it runs comfortably on a GPU with 20 GB of VRAM or more (39 of the GPUs we track). Common cards, smallest first:
| VRAM | GPUs |
|---|---|
| 20 GB | RTX 4000 SFF Ada , RX 7900 XT , RTX 4000 Ada |
| 24 GB | RTX 4090 , RX 7900 XTX , RTX 3090 Ti |
| 32 GB | RTX 5090 , RTX 5000 Ada , Tesla V100 32GB |
About this model
Qwen 2.5 Coder series of models are now updated in 6 sizes: 0.5B, 1.5B, 3B, 7B, 14B and 32B.
There are significant improvements in code generation, code reasoning and code fixing. The 32B model has competitive performance with OpenAI’s GPT-4o.
32B:
ollama run qwen2.5-coder:32b
14B:
ollama run qwen2.5-coder:14b
7B:
ollama run qwen2.5-coder:7b
3B:
ollama run qwen2.5-coder:3b
1.5B:
ollama run qwen2.5-coder:1.5b
0.5B:
ollama run qwen2.5-coder:0.5b
Code capabilities reaching state of the art for open-source models
Code Generation: Qwen2.5 Coder 32B Instruct, as the flagship model of this open-source release, has achieved the best performance among open-source models on multiple popular code generation benchmarks (EvalPlus, LiveCodeBench, BigCodeBench), and has competitive performance with GPT-4o.
Code Repair: Code repair is an important programming skill. Qwen2.5 Coder 32B Instruct can help users fix errors in their code, making programming more efficient. Aider is a popular benchmark for code repair, and Qwen2.5 Coder 32B Instruct scored 73.7, performing comparably to GPT-4o on Aider.
Code Reasoning: Code reasoning refers to the model’s ability to learn the process of code execution and accurately predict the model’s inputs and outputs. The recently released Qwen2.5 Coder 7B Instruct has already shown impressive performance in code reasoning, and this 32B model takes it a step further.
Multiple programming languages
An intelligent programming assistant should be familiar with all programming languages. Qwen 2.5 Coder 32B performs excellent across more than 40 programming languages, scoring 65.9 on McEval, with impressive performances in languages like Haskell and Racket. The Qwen team used their own unique data cleaning and balancing during the pre-training phase.
Additionally, the multi-language code repair capabilities of Qwen 2.5 Coder 32B Instruct remain impressive, aiding users in understanding and modifying programming languages they are familiar with, significantly reducing the learning cost of unfamiliar languages. Similar to McEval, MdEval is a multi-language code repair benchmark, where Qwen 2.5 Coder 32B Instruct scored 75.2, ranking first among all open-source models.
Human Preference
To evaluate the alignment performance of Qwen 2.5 Coder 32B Instruct with human preferences, we constructed an internal annotated code preference evaluation benchmark called Code Arena (similar to Arena Hard). We used GPT-4o as the evaluation model for preference alignment, employing an ‘A vs. B win’ evaluation method, which measures the percentage of instances in the test set where model A’s score exceeds model B’s. The results below demonstrate the advantages of Qwen 2.5 Coder 32B Instruct in preference alignment.