General GGUF models
134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
hpc assistant qwen3 4b
Qwen · VaibhavKKM
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 4B 2507 abliterated
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Q4_K_M5.1 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest15.2 GB
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
PY
Pygmalion 2 7B
Pygmalion · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
OR
Ornith-1.5-35B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
DE
decider 2b
Decider · Mapika
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Granite 4.0 H 350m
Granite · ibm-granite
Params340M
Context1024K
Q4_K_M0.2 GB
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
AB
Hy MT2 7B Abliterated Bf16
Abliterated · alexwkleung
Params7.5B
Context256K
Q4_K_M4.6 GB
GP
GPT OSS 20B Uncensored HauhauCS Balanced
gpt-oss · HauhauCS
Params20.9B
Context128K
Smallest12.1 GB
QW
qwen3 tts 12hz 1.7b ru stress
Qwen · sknyazev
Params142M
Context32K
Smallest0.2 GB
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
japanese stablelm instruct beta 7B
Japanese · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
YI
ehartford_dolphin-2_2-yi-34b
Yi · TheBloke
Params34.4B
Context16K
Q4_K_M20.7 GB
HU
humanizer-12b
Humanizer · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.8 Flash Next
Qwen · jamesrogers
Params177B
Context256K
Smallest126.8 GB
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
LL
tulu v1 llama2 70b i1
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Q4_K_M2.5 GB
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Q4_K_M0.2 GB
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB