General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2 Horizon MoVA 36B A4B
Horizon · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
MY
MythoMax L2 13B
Mythomax · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GL
glm 5.3
GLM · antirez
Params754B
Context1024K
Smallest211.1 GB
GGUF
QW
Qwen3 0.6b Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
GL
Models Zai Org GLM 4.6V Flash
GLM · MaziyarPanahi
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
GP
Models ArliAI Gpt Oss 20b Derestricted
gpt-oss · MaziyarPanahi
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
GGUF
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
GP
Huihui Gpt Oss 20b Mxfp4 Abliterated v2
gpt-oss · huihui-ai
Params20.9B
Context128K
Smallest13.8 GB
GGUF
MI
MistralRP Noromaid NSFW Mistral 7B
Mistral · Ttimofeyka
Params7.24B
Context32K
Smallest4.1 GB
GGUF
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored
Qwen · 0bserverx
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
QW
Qwen3.8-27B-DFlash2
Qwen · incoai
Params1.92B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local)
Qwen · fairfieldt
Params157B
Context256K
Smallest105.6 GB
GGUF
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · bartowski
Params8.89B
Context1024K
Q4_K_M6.5 GB
GGUF
GE
gemma 7b it
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GGUF
GE
supergemma4 26b uncensored gguf v2
Gemma · Jiunsong
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
TE
HY MT1.5 7B
Tencent · tencent
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
NE
NemoMix Unleashed 12B
Nemomix · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · nvidia
Params1.11B
Context256K
Smallest1.0 GB
GGUF
QW
DFlash
Qwen · Alittlehammmer
Params1.73B
Context256K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
NE
Models Nvidia Nemotron Orchestrator 8B
Nemotron · MaziyarPanahi
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LL
Llama 2 7B
Llama · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · bartowski
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
DI
Dirty Muse Writer v01 Uncensored Erotica NSFW i1
Dirty · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TR
Models Arcee Ai Trinity Mini
Trinity · MaziyarPanahi
Params26B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Impish_LLAMA_4B_V2
Llama · SicariusSicariiStuff
Params4.5B
Context128K
Q4_K_M2.8 GB
GGUF

Other uses

Keep browsing