General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
BA
BarryFutureman NeuralTurdusVariant1 7B
Barryfutureman · RichardErkhov
Params7B
Context—
Q4_K_M0.0 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 14B Abliterated
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
HO
K2 Horizon 3.7B
Horizon · IFM
Params5.06B
Context512K
Q4_K_M3.2 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LF
LFM2.5-350M
Lfm · weareapexcreators
Params354M
Context125K
Smallest0.4 GB
GI
GigaChat3.1 10B A1.8B
Gigachat · ai-sage
Params10.7B
Context256K
Q4_K_M6.5 GB
QW
Qwen3 30B A3B
Qwen · bartowski
Params30.5B
Context32K
Q4_K_M18.6 GB
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
GE
Sprinkle Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
VAGOsolutions Llama 3 SauerkrautLM 70b Instruct
Llama · RichardErkhov
Params6B
Context—
Q4_K_M0.0 GB
GE
gemma-2b-it
Gemma · lmstudio-ai
Params2.51B
Context8K
Q4_K_M1.5 GB
LF
LFM2.5 230M LocalAI
Lfm · weareapexcreators
Params230M
Context125K
Smallest0.2 GB
MA
magnum v4 12b
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
MI
Mistral Small Instruct 2409
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
SP
Spark X2.6 4B
Spark · bartowski
Params4.11B
Context1024K
Q4_K_M2.6 GB
LL
Llama 3.2 3B Instruct abliterated
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GE
gemma 4 E4B it uncensored
Gemma · TrevorJS
Params7.5B
Context128K
Q4_K_M5.3 GB
MI
MiniCPM5 2B LocalAI
MiniCPM · weareapexcreators
Params2.52B
Context128K
Smallest2.7 GB
NA
Nanbeige4.2 3B
Nanbeige · bartowski
Params4.17B
Context256K
Q4_K_M2.7 GB
ST
StartLux Decision v1 9B Q8 0
Startlux · startlux-models
Params8.95B
Context256K
Smallest9.5 GB
WI
ehartford_wizardlm-7b-uncensored
Wizardlm · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
DE
Decider 35b A3B
Decider · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
RavenX CyberAgent Qwen3.6 35B A3B Opus 4.7 OpenMythos Pentester BugHunter RATH
Qwen · deadbydawn101
Params35.5B
Context256K
Q4_K_M21.7 GB
LF
LFM2.5 1.2B Instruct LocalAI
Lfm · weareapexcreators
Params1.17B
Context125K
Smallest1.2 GB
QW
Qwen3 1.7B
Qwen · lmstudio-community
Params2.03B
Context32K
Q4_K_M1.3 GB
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
PI
PII Tracer
Pii · perplexity-ai
Params596M
Context32K
Smallest1.2 GB
MI
open-orca_mistral-7b-openorca
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB