General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
QW
ISO27001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
SL
SlimOrca 13B
Slimorca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LE
ignos_leoscorpius-greennode-platypus-7b-v1
Leoscorpius · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniMax H3 GGUF MiniStack
Minimax · woodfireind
Params20.1B
Context256K
Q4_K_M2.5 GB
LF
LFM2.5 1.2B JP
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
OP
q-bert_optimus-7b
Optimus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.8 35B A3B Distill
Qwen · ngquocvinh
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
nruaif_kimiko-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
VO
VoxCPM-0.5B
Voxcpm · bluryar
Params728M
Context32K
Smallest0.5 GB
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
IC
IceEspressoRPv2 7b i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
teknium_mistral-trismegistus-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
Airolima Chronos Grad L2 13B
Airolima · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
ME
merlyn education corpus qa v2
Merlyn · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
janhq_mistral-7b-instruct-v0.2-dare
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
snap1 2B
MiniCPM · logitlab
Params2.52B
Context128K
Q4_K_M1.6 GB
SW
Swallow 7B
Swallow · TheBloke
Params6.83B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 8B Ultra Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
JE
Jebadiah 4b v2
Jebadiah · frontier-infra
Params4.33B
Context256K
Q4_K_M2.8 GB
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen2.5 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB