GGUF models by unsloth

391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
Lfm2-2.6B-Exp
Lfm · unsloth
Params2.57B
Context125K
Q4_K_M1.6 GB
Tool use
KE
Kernelllm
Kernelllm · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
IN
Januscoder-14B
InternLM · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingReasoningTool use
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
Coding
HE
Hermes-4-405B
Hermes · unsloth
Params405B
Context128K
Q4_K_M243.1 GB
ReasoningRoleplayTool use
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool useVision
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningTool use
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
IN
Internvl3-8B-Instruct
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool useVision
IN
Internvl3-14B
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool useVision
GP
Gpt-Oss-Safeguard-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
Tool use
IN
Intellect-2
Intellect · unsloth
Params32.8B
Context40K
Q4_K_M19.9 GB
ReasoningTool use
IN
Internvl3-38B-Instruct
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool useVision
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
CodingTool use
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
ReasoningTool use
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
IN
Internvl3-38B
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
CodingTool useVision
RE
Reka-Flash-3
Reka · unsloth
Params20.9B
Context32K
Q4_K_M13.6 GB
GGUF
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
CodingReasoningTool use
ER
Ernie-4.5-300B-A47B-Pt
Ernie · unsloth
Params299B
Context128K
Q4_K_M180.2 GB
GGUF
LL
Cogito-V2-Preview-Llama-405B
Llama · unsloth
Params406B
Context128K
Q4_K_M243.1 GB
ReasoningTool use
CO
Cogito-671B-V2.1
Cogito · unsloth
Params671B
Context160K
Q4_K_M405.4 GB
ReasoningTool use
LL
Llama 3.1 Tulu 3 8B
Llama · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MA
Mai-Ds-R1
Mai · unsloth
Params671B
Context160K
Q4_K_M404.7 GB
CodingReasoningTool use
OL
Olmo-2-0325-32B-Instruct
OLMo · unsloth
Params32.2B
Context4K
Q4_K_M19.5 GB
GGUF
CO
C4Ai-Command-A-03-2025
Command R · unsloth
Params111B
Context256K
Q4_K_M67.1 GB
Tool use
LL
Llama 3.1 Tulu 3 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Keep browsing