General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
BO
boto-9B
Boto · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
FI
adaptllm_finance-llm-13b
Finance · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Llama 7b
Llama · QuantFactory
Params6.74B
Context2K
Q4_K_M4.1 GB
GL
Glimmer 31B v1.0
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OR
Ornith 1.5 35B A3B
Ornith · NANI-Nithin
Params35.5B
Context256K
Q4_K_M21.7 GB
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
CY
Cydonia 24B v4.1
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
SM
SmolLM2-135M
SmolLM · ggml-org
Params135M
Context8K
Q4_K_M0.1 GB
CH
austism_chronos-hermes-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
LL
Tiamat 8b 1.2 Llama 3 DPO i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
KA
KangalKhan Alpha Emerald 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
MI
Mistral 7B Instruct v0.2 GGUF smashed
Mistral · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
UM
Umievo Itr012 Gleipnir 7B
Umievo · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7xExperiment26-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ZE
Zen Voyager
Zen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
TR
Trion-M-7b
Trion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GP
GPT4chan 8B
Gpt · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MO
MoNeuTrix MoE 4x7B
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB