AkiliCode-14B: Repair-Oriented Post-Training for an Open 14B Code Model Technical Report
MsingiAI
We present AkiliCode-14B, a research-preview code model obtained by post-training Qwen2.5-Coder-14B through a three-stage pipeline: (1) instruction tuning, (2) execution-aware reinforcement learning, and (3) failure-focused repair training. The final stage is explicitly designed to teach code revision from failed attempts rather than to solve random easy problems from scratch. Relative to our best Stage 2 checkpoint, the promoted Stage 3 checkpoint improves HumanEval+ from 60.98 to 62.80 and MBPP+ from 65.08 to 65.61, while BigCodeBench-Instruct decreases from 45.61 to 45.09. On CRUXEval-O, the promoted checkpoint reaches 49.75. On a Live-CodeBench v6 official-style reimplementation over 1,055 problems, the same checkpoint obtains 11.37 single-greedy pass@1, with 100.0% extraction success and 98.58% syntax-valid outputs. The dominant failure mode on LiveCodeBench is wrong answers rather than parsing, syntax, or extraction failure. Our main conclusion is mixed but useful: repair-oriented post-training improves local function-level synthesis in this run, but does not close the gap on hidden-test algorithmic generalization. We release AkiliCode-14B as a research preview and use this report to document both what worked and what did not.