GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NE
Nemotron-3.5-Embed-8B
Nemotron · maternion
Params7.95B
Context256K
Q4_K_M4.9 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
LF
LFM2.5 2.6B Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen Image 2.1 Uncensored
Qwen · kacakto
Params7.12B
Context—
Q4_K_M4.6 GB
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
Cosmos Reason2 8B
Cosmos · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LF
LFM2.5 8B A1B SOMPOA Heresy
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
novel humanize 4b imatrix
Qwen · liodon-ai
Params4.02B
Context40K
Q4_K_M2.5 GB
GE
lemon mint gemma ko 7b it v0.41
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
CH
henk717_chronoboros-33b
Chronoboros · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
FO
Foundation Sec 8B Instruct
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Liberated Qwen1.5 14B
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
TH
Thero 1 Flash
Thero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.8 Flash Next Mixed Quant SSD PLE
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
ER
10Eros Max Hybrid Beta5
Eros · chfm
Params20.1B
Context—
Q4_K_M11.6 GB
FA
Falcon3 7B Instruct Heretic v2
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
DR
Dracarys2 72B Instruct
Dracarys · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
ME
Medgemma 27b Text It
Medgemma · second-state
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
BG
Motherlode Code Small En v0.1
BGE · RiverRider
Params33M
Context512
Smallest0.1 GB
GE
Google Gemma 4 12B It
Gemma · sigmanih
Params11.9B
Context256K
Q4_K_M7.4 GB
SA
Sailor-14B-Chat
Sailor · duyntnet
Params14.2B
Context32K
Q4_K_M9.2 GB
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
DR
drama-3
Drama · Harsha001
Params35.8B
Context—
Smallest20.1 GB
MI
minimax video prompt enhancer 2.6b
Minimax · geocine
Params2.7B
Context128K
Q4_K_M1.7 GB
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
spec for testing
Qwen · ggml-org
Params1.92B
Context40K
Q4_K_M0.3 GB