General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
OR
Ornith 1.5 35B A3B DFlash
Ornith · na0x2c6
Params386M
Context256K
Smallest0.4 GB
LL
Llama 3.2 3B Instruct Heretic Ablitered Uncensored
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
SM
SmolLM 135M
SmolLM · HuggingFaceTB
Params135M
Context2K
Smallest0.1 GB
MI
teknium_airoboros-mistral2.2-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 1.7B Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
MI
Mistral Pygmalion 7B
Mistral · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
BO
Boundary 4x7b MoE i1
Boundary · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
RW
rwkv7 g1h 1.5b i1
Rwkv · RemySkye
Params1.53B
Context1024K
Q4_K_M1.1 GB
AI
jondurbin_airoboros-c34b-2.1
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
HO
K2 Horizon 3.7B Heretic
Horizon · mradermacher
Params5.06B
Context512K
Q4_K_M3.2 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GE
Gemma 4 26B A4B It SOMPOA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
OpenHermes-2.5-Mistral-7B-x2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3-14B-128K
Qwen · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
ID
ideogram4 turbo
Ideogram · ChrisColeTech
Params9.28B
Context256K
Q4_K_M5.0 GB
MI
severian_anima-phi-neptune-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
PopiT Qwen3 4B Medical SFT 1128
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
EX
EXAONE-4.0-32B
Exaone · LGAI-EXAONE
Params32B
Context128K
Q4_K_M19.3 GB
GE
gemmuguinho 636m
Gemmuguinho · Papuguinho
Params636M
Context32K
Q4_K_M0.5 GB
UN
ajibawa-2023_uncensored-jordan-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
QW
WhereOPD Qwen3.5 4B
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
OP
openthaigpt 1.0.0 beta 13B chat
Openthaigpt · TheBloke
Params13.1B
Context4K
Q4_K_M7.9 GB
DE
DeepNarra-Paham-Experimental
Deepnarra · DeepNarra
Params952M
Context2K
Smallest0.3 GB