General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GL
GLM 5.3 Flash
GLM · batiai
Params313B
Context1024K
Q4_K_M188.7 GB
AN
sao10k_ana-v1-m7
Ana · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
EX
EXAONE 3.5 2.4B Instruct 2
Exaone · ThomasBaruzier
Params2.67B
Context32K
Q4_K_M1.6 GB
MI
Mistral 7B Instruct DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.2B
Context8K
Q4_K_M5.8 GB
LF
LFM2 350M Extract
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen3 8B Q8 0 full v2
Qwen · luckypoolio
Params8.19B
Context40K
Smallest8.7 GB
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
BO
Boptruth Agatha 7B i1
Boptruth · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
EM
Emotion Companion 7b
Emotion · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SM
SmolLM2 135M Instruct
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Qwen2.5 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 4B RpRMax v1
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 27B Heretic Abliterated Uncensored
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
OG
models--automerger--OgnoExperiment27-7B
Ogno · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 32B Instruct Abliterated v2
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CY
Cydonia 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
CH
ChatGPT 5 Q8 0
Chatgpt · Hack337
Params494M
Context32K
Smallest0.5 GB
IC
IceEspressoRPv6 i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
gpt2 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
NO
Nova-13B
Nova · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB