Unsloth releases GGUF version of Cohere North-Mini-Code 1.0 (30B A3B MoE) on Hugging Face
Original: unsloth/North-Mini-Code-1.0-GGUF · Hugging Face
Unsloth has published a GGUF conversion of Cohere's new North-Mini-Code 1.0, a 30B total / 3B active MoE coding model, enabling local inference.
Unsloth uploaded a GGUF version of Cohere's North-Mini-Code 1.0 to Hugging Face, making local inference possible for this 30B A3B MoE coding-focused model. The poster links the release to llama.cpp PR #24260, suggesting new architecture support may be required. No benchmarks or test results have been shared yet; this is an early community resource post.
Unsloth 是一個專門針對大型語言模型(LLM)進行 GGUF 格式轉換與量化優化的開源工具與社群,長期活躍於 Hugging Face 平台。此次他們將 Cohere 最新發布的 North-Mini-Code 1.0 模型轉換為 GGUF 格式,並公開上傳至 Hugging Face 供社群下載使用。
Free shows the 3-line summary; Pro unlocks the full deep summary (~300 words) so you never have to click through.
See Pro plans →Want the original English / full article?
Read on r/LocalLLaMA top day →Related
Summaries are AI-generated; the original article is authoritative.