General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
HE
HermesLimaRP L2 7B
Hermeslimarp · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
NeoHorse 1 4B Max Heretic Uncensored TURBO
Neohorse · prithivMLmods
Params4.21B
Context256K
Q4_K_M2.7 GB
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
OL
OLMo 2 0425 1B Instruct
OLMo · allenai
Params1.48B
Context4K
Q4_K_M0.9 GB
LL
Llama 3.1 8B Instruct Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
LL
Meta Llama 3.1 8B Instruct
Llama · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
QW
Huihui Qwen3.5 4B Abliterated
Qwen · interimlabs
Params4.21B
Context256K
Smallest2.7 GB
NO
NoisyGRPO_7B
Noisygrpo · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
PI
ddh0_pirouette-7b
Pirouette · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
qwen3 tts 0 6b base mix precision
Qwen · Arm
Params83M
Context64K
Smallest0.1 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct absolute heresy i1
Llama · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
AE
Aetheria L2 70B
Aetheria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
RA
RakutenAI 2.0 Mini Instruct
Rakutenai · mmnga
Params1.53B
Context128K
Q4_K_M0.9 GB
GL
GLM 4 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
QW
Josiefied Qwen3 30B A3B Abliterated v1
Qwen · Disya
Params30.5B
Context40K
Q4_K_M18.6 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · crusoeai
Params34.4B
Context32K
Q4_K_M20.7 GB
YI
Yi 6B i1
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
ZI
Zion_Alpha_Instruction_Tuned
Zion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenELM 1_1B Instruct
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
NE
Nemotron 3 Nano 4B
Nemotron · bartowski
Params3.97B
Context1024K
Q4_K_M3.0 GB
OU
Oumuamua-7b-instruct-v2
Oumuamua · mradermacher
Params7.33B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--Inex12M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
FL
Flux
Flux · StableDiffusionVN
Params4.76B
Context512
Smallest2.7 GB
GE
muraqib judge
Gemma · mohamedbalkhi169
Params7.46B
Context128K
Q4_K_M4.9 GB