GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AP
Apollo 1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GE
Gemma-4-E2B-It
Gemma · mdev64
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
ME
Medgemma 27b Text It
Medgemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DE
DeepSeek Coder V2 Instruct
DeepSeek · gaianet
Params236B
Context160K
Q4_K_M142.5 GB
Coding
LL
Einstein-v6.1-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen3.8-Flash-Next
Qwen · qtum
Params177B
Context256K
Smallest82.0 GB
ReasoningTool use
CO
Codegemma 2b
Codegemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
GE
Genstruct-7B
Genstruct · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
Smaug 34B v0.1
Smaug · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GE
gemma-7b-it
Gemma · sayhan
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mistral Large Instruct
Mistral · InferenceIllusionist
Params123B
Context32K
Q4_K_M73.2 GB
GGUF
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
calme-2.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
NE
Stockmark Nemotron 3 Nano Omni JapanDocReader
Nemotron · dtrknt
Params31.6B
Context1024K
Smallest21.9 GB
ReasoningTool useVision
GL
LongWriter Glm4 9b
GLM · duyntnet
Params9.4B
Context1024K
Q4_K_M6.3 GB
GGUF
QW
Qwen3.8 27B DSpark
Qwen · magnitudedev
Params1.36B
Context256K
Smallest1.5 GB
ReasoningTool use
QW
Qwen2.5 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
CI
Cicikus_v2_3B
Cicikus · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
DI
Dinghy Law 8b v1
Dinghy · mradermacher
Params7.95B
Context256K
Q4_K_M4.9 GB
GGUF
XC
XCurOS 1.2 8B VLBF16 Instruct
Xcuros · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
CH
Chichu Video 1.0
Chichu · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
MANGO Qwen3 Omni 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool useVision
AR
Art v0 3B
Art · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
SE
semcoder semcoder 1030
Semcoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
LF
LFM2.5 8B A1B
Lfm · thenukegun10x
Params8.47B
Context125K
Smallest3.5 GB
ReasoningTool use
MI
Codestral-22B-v0.1-hf
Mistral · second-state
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
VI
vicuna 33b v1.3
Vicuna · shaowenchen
Params32.5B
Context2K
Smallest13.5 GB
GGUF
RA
Rain 7B v0.1 i1
Rain · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
TEMPURA Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
ReasoningVision

Keep browsing