General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
YI
Yi 1.5 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
DE
DeepSeek V4.1 Flash 1017 ELVEZ Q2
DeepSeek · elvezjp
Params485M
Context—
Smallest1.0 GB
HU
Hunyuan MT 7B
Hunyuan · imikeliu
Params7.5B
Context256K
Q4_K_M4.6 GB
PH
phonon 40m fr
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
JE
JEV 27B
Jev · prithivMLmods
Params27B
Context256K
Q4_K_M16.5 GB
LL
4 alokk llama 3 8b English to Hinglish
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
ME
Merotheon 31B
Merotheon · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
MI
MiniMax M2.7
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.8 GB
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Carnice Qwen3.6 MoE 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
CO
Confucius4 T3PO
Confucius · netease-youdao
Params14.8B
Context32K
Smallest10.5 GB
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GR
Granite 4.0 H Small
Granite · ibm-granite
Params32.2B
Context1024K
Q4_K_M19.5 GB
HO
K2-Horizon-7B
Horizon · bartowski
Params9B
Context512K
Q4_K_M5.8 GB
LF
LFM2.5-24B-A2B
Lfm · OS-Software
Params24B
Context128K
Q4_K_M14.5 GB
ST
StartLux Decision v1 27B BF16
Startlux · startlux-models
Params27B
Context256K
Smallest53.8 GB
SP
Spark X2.5 4B
Spark · ngquocvinh
Params4.1B
Context1024K
Q4_K_M2.6 GB
MI
Mistral 7B v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
LL
Ostrich 70B
Llama · some1nostr
Params70.6B
Context8K
Smallest34.3 GB
ME
G4 MeroMero 26B A4B
Meromero · zerofata
Params25.2B
Context256K
Q4_K_M16.8 GB
CO
CohereForAI aya 23 35B
Cohereforai · RichardErkhov
Params35B
Context—
Q4_K_M0.0 GB
GR
Granite 3.3 2b Instruct
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
PH
phonon 40m pt
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
OR
Ornith-1.5-35B
Ornith · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB