General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
MA
manaca 1b base
Manaca · NANI-Nithin
Params1.72B
Context4K
Q4_K_M1.1 GB
AI
airoboros l2 13b gpt4 2.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
OP
openbuddy_openbuddy-zephyr-7b-v14.1
Openbuddy · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen3.5 122B A10B Abliterix
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.8 27B Uncensored noMTP Q4 K M OpenCode
Qwen · oceanonline
Params27B
Context256K
Q4_K_M16.5 GB
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
AI
jondurbin_airoboros-c34b-3.1.2
Airoboros · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
LF
LFM2.5 1.2B JP 202606
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Genz 70b
Genz · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Hermes 3 Llama 3.1 8B Lorablated
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
MI
kolibri-vikhr-mistral-0427
Mistral · Vikhrmodels
Params7.6B
Context32K
Q4_K_M4.6 GB
OR
ddh0_orcamaidxl-17b-32k
Orcamaidxl · TheBloke
Params17.5B
Context32K
Q4_K_M10.5 GB
MI
mlabonne_neuralhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
EU
EuroLLM 9B Instruct
Eurollm · bartowski
Params9.15B
Context4K
Q4_K_M5.6 GB
QW
Qwen2.5 32B AGI
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
LLaMA2 13B Tiefighter i1
Llama · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
WI
ehartford_wizardlm-7b-v1.0-uncensored
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
PI
piano-medley-7b
Piano · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
discoresearch_discolm-70b
Discolm · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB