GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
AP
Apollo 1 8B
Apollo · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma-4-E2B-It
Gemma · mdev64
Params4.65B
Context128K
Q4_K_M3.1 GB
ME
Medgemma 27b Text It
Medgemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
DE
DeepSeek Coder V2 Instruct
DeepSeek · gaianet
Params236B
Context160K
Q4_K_M142.5 GB
LL
Einstein-v6.1-Llama3-8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8-Flash-Next
Qwen · qtum
Params177B
Context256K
Smallest82.0 GB
CO
Codegemma 2b
Codegemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Genstruct-7B
Genstruct · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Smaug 34B v0.1
Smaug · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GE
gemma-7b-it
Gemma · sayhan
Params8.54B
Context8K
Q4_K_M5.1 GB
MI
Mistral Large Instruct
Mistral · InferenceIllusionist
Params123B
Context32K
Q4_K_M73.2 GB
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
calme-2.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
Stockmark Nemotron 3 Nano Omni JapanDocReader
Nemotron · dtrknt
Params31.6B
Context1024K
Smallest21.9 GB
GL
LongWriter Glm4 9b
GLM · duyntnet
Params9.4B
Context1024K
Q4_K_M6.3 GB
QW
Qwen3.8 27B DSpark
Qwen · magnitudedev
Params1.36B
Context256K
Smallest1.5 GB
QW
Qwen2.5 3B Instruct
Qwen · duyntnet
Params3.09B
Context32K
Q4_K_M1.9 GB
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
CI
Cicikus_v2_3B
Cicikus · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
DI
Dinghy Law 8b v1
Dinghy · mradermacher
Params7.95B
Context256K
Q4_K_M4.9 GB
XC
XCurOS 1.2 8B VLBF16 Instruct
Xcuros · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
CH
Chichu Video 1.0
Chichu · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
MANGO Qwen3 Omni 30B A3B Instruct
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
AR
Art v0 3B
Art · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
SE
semcoder semcoder 1030
Semcoder · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
LF
LFM2.5 8B A1B
Lfm · thenukegun10x
Params8.47B
Context125K
Smallest3.5 GB
MI
Codestral-22B-v0.1-hf
Mistral · second-state
Params22.2B
Context32K
Q4_K_M13.3 GB
VI
vicuna 33b v1.3
Vicuna · shaowenchen
Params32.5B
Context2K
Smallest13.5 GB
RA
Rain 7B v0.1 i1
Rain · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
QW
TEMPURA Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB