GGUF models by unsloth
391 GGUF models quantized by unsloth on Hugging Face. Sizes run from 33M to 2780B parameters. The longest trained context is 10240K tokens.
LF
Lfm2-2.6B-Exp
Lfm · unsloth
Params2.57B
Context125K
Q4_K_M1.6 GB
KE
Kernelllm
Kernelllm · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
Januscoder-14B
InternLM · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama-3_1-Nemotron-Ultra-253B-V1
Llama · unsloth
Params253B
Context128K
Q4_K_M150.9 GB
HE
Hermes-4-405B
Hermes · unsloth
Params405B
Context128K
Q4_K_M243.1 GB
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
IN
Internvl3-8B-Instruct
Internvl · unsloth
Params7.61B
Context32K
Q4_K_M4.7 GB
IN
Internvl3-14B
Internvl · unsloth
Params14.8B
Context32K
Q4_K_M9.0 GB
GP
Gpt-Oss-Safeguard-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
IN
Intellect-2
Intellect · unsloth
Params32.8B
Context40K
Q4_K_M19.9 GB
IN
Internvl3-38B-Instruct
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
IN
Internvl3-38B
Internvl · unsloth
Params32.8B
Context32K
Q4_K_M19.8 GB
RE
Reka-Flash-3
Reka · unsloth
Params20.9B
Context32K
Q4_K_M13.6 GB
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
ER
Ernie-4.5-300B-A47B-Pt
Ernie · unsloth
Params299B
Context128K
Q4_K_M180.2 GB
LL
Cogito-V2-Preview-Llama-405B
Llama · unsloth
Params406B
Context128K
Q4_K_M243.1 GB
CO
Cogito-671B-V2.1
Cogito · unsloth
Params671B
Context160K
Q4_K_M405.4 GB
LL
Llama 3.1 Tulu 3 8B
Llama · unsloth
Params8.03B
Context128K
Q4_K_M4.9 GB
MA
Mai-Ds-R1
Mai · unsloth
Params671B
Context160K
Q4_K_M404.7 GB
OL
Olmo-2-0325-32B-Instruct
OLMo · unsloth
Params32.2B
Context4K
Q4_K_M19.5 GB
CO
C4Ai-Command-A-03-2025
Command R · unsloth
Params111B
Context256K
Q4_K_M67.1 GB
LL
Llama 3.1 Tulu 3 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB