General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
GE
Amoral Gemma3 4B
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
FE
Feyospace S1 OBLITERATED
Feyospace · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 9B
Qwen · hakergeniusz
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
Gemma 2 9b It
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
LU
Lumimaid Magnum 12B
Lumimaid · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
models--automerger--Inex12T3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Hermes-2-Theta-Llama-3-8B-32k
Llama · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
CA
CarbonBeagle 11B
Carbonbeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
TR
TripleTrouble
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
SA
SauerkrautLM 7b LaserChat
Sauerkrautlm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
deepthought 8b llama v0.01 alpha
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
MI
arc53_docsgpt-7b-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
ChatLaw2E_plain_7B
Chatlaw · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
LT
LTX 2.5 22B dev uncensored ROCmFPX
Ltx · Harsha001
Params13.1B
Context—
Smallest14.7 GB
LL
Llama-3.3-8B-Instruct
Llama · Mungert
Params8B
Context8K
Q4_K_M5.3 GB
NE
nexus security
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
DO
Dolphin3 Cyber 8B
Dolphin · ScottzillaSystems
Params8B
Context128K
Q4_K_M4.9 GB
PA
janhq_pandora-v1-13b
Pandora · TheBloke
Params12.5B
Context32K
Q4_K_M7.5 GB
OP
rombodawg_open_gpt4_8x7b_v0.2
Open · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
rossascends_mistral_7b_dolphin2.1_lima0.5_fp16
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB