GGUF models that fit in 4 GB
79024 GGUF language models have at least one quant whose estimated memory use is 4 GB or less at 8K context. Each card shows the largest quant that fits. Sizes run from 1M to 20260731B parameters. The longest trained context is 1280000K tokens.
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Best fitIQ2_XXS 4.0 GB
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Best fitQ4_1 1.5 GB
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
AS
Aspire 8B model stock i1
Aspire · mradermacher
Params8B
Context8K
Best fitIQ2_XXS 4.0 GB
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Best fitQ6_K 3.8 GB
QW
Heretic Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Best fitQ3_K_L 4.0 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Best fitQ2_K 4.0 GB
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Best fitQ6_K 3.6 GB
ZE
zed industries zeta 2
Zeta · bartowski
Params8.25B
Context32K
Q4_K_M5.2 GB
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Best fitIQ4_XS 4.0 GB
OL
open r1 OlympicCoder 7B
Olympiccoder · bartowski
Params7.62B
Context32K
Best fitQ2_K 4.0 GB
VI
Vinci MLE 8B 1.0
Vinci · mradermacher
Params8.79B
Context128K
Best fitIQ1_S 4.0 GB
CU
CursorCore QW2.5 1.5B i1
Cursorcore · mradermacher
Params1.54B
Context32K
Best fitQ6_K 2.0 GB
QW
Qwen_Qwen3 VL 2B Instruct
Qwen · lmstudio-community
Params1.72B
Context256K
Best fitQ8_0 3.3 GB
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Best fitIQ1_S 4.0 GB
QW
Bella Bartender Qwen3 1.7b
Qwen · mradermacher
Params1.72B
Context40K
Best fitQ6_K 2.9 GB
GW
Vt Gwen 2.5 3b Q4_k_m Gguf
Gwen · vinhnx90
Params3.09B
Context32K
Best fitQ4_K_M 2.7 GB
GM
GmshNet 8B v0.1
Gmshnet · hexera-org
Params7.62B
Context32K
Best fitQ2_K 4.0 GB
QW
Models Qwen Qwen2 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Best fitQ2_K 4.0 GB
LL
Llama3.3 8B Instruct Thinking Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Best fitIQ2_XXS 4.0 GB
RP
RPBizkit v11 12B Base
Rpbizkit · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · mradermacher
Params8.83B
Context16K
Best fitIQ2_XS 4.0 GB
HO
K2-Horizon-375B-A23B
Horizon · bartowski
Params379B
Context512K
Q4_K_M237.8 GB
SP
Spark X2.6 1.7B
Spark · mradermacher
Params1.71B
Context1024K
Best fitQ6_K 2.4 GB
LL
Llama 3.2 1B NSFW Open Erotic
Llama · Novaciano
Params1.5B
Context128K
Smallest1.0 GB
QW
Qwen 3.8 27b Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Mistral Nemo Instruct 2407 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
NO
Nova-1.1-0.8B
Nova · mradermacher
Params1.01B
Context256K
Best fitQ5_K_M 1.7 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Best fitIQ2_S 3.9 GB
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Best fitIQ1_S 4.0 GB