GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · nyan-ame
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.8-27B
Qwen · LxBarn
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwopus3.5 27B v3 Abliterated
Qwopus · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
MI
Pixtral
Mistral · ggml-org
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MI
kolibri-vikhr-mistral-0427
Mistral · Vikhrmodels
Params7.6B
Context32K
Q4_K_M4.6 GB
GGUF
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
MI
mlabonne_neuralhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
RE
Realistic Vision V6.0 B1
Realistic · second-state
Params1.07B
Context—
Smallest1.5 GB
GGUF
MI
MiniCPM V 4.7 35B A3B
MiniCPM · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Vision
TR
Trida2.0 4B
Trida · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
EU
EuroLLM 9B Instruct
Eurollm · bartowski
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 32B AGI
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
NE
NeoHorse 1 4B
Neohorse · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Qwen3.5 4B EmperoAI Qwen3.8 Distill
Qwen · insraq
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
AM
AMALIA 9B 0626 SFT
Amalia · NoxNotreve
Params9.15B
Context32K
Q4_K_M5.6 GB
GGUF
GR
Granite 34b Code Instruct 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
Coding
GE
gemma 4 26B A4B it qat uncensored heretic UDmerge
Gemma · EZForever
Params25.2B
Context256K
Smallest14.2 GB
Vision
JA
Jais-3-MoVA-36B-A4B
Jais · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
Reasoning
MI
mathstral-7B-v0.1
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
QwQ 32B Abliterated
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Vision
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
NO
Novel Humanize 4b
Novel · bartowski
Params4.02B
Context40K
Q4_K_M2.6 GB
ReasoningTool use
NI
Ninja-v1-NSFW-RP
Ninja · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
Roleplay
QW
Qwen3Vl 235b A22B Instruct
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
Vision
HU
HuatuoGPT O1 7B
Huatuogpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Reasoning
WA
Wan2.1 T2V 14B LightX2V StepCfgDistill VACE
Wan · QuantStack
Params17.3B
Context—
Q4_K_M11.6 GB
GGUF
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningRoleplayTool use

Keep browsing