GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron-3.5-Embed-8B
Nemotron · maternion
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
LF
LFM2.5 2.6B Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
LL
Llama 3.2 1B
Llama · duyntnet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · kacakto
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
LL
Medichat Llama3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
CO
Cosmos Reason2 8B
Cosmos · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LF
LFM2.5 8B A1B SOMPOA Heresy
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
QW
novel humanize 4b imatrix
Qwen · liodon-ai
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
GE
lemon mint gemma ko 7b it v0.41
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
CH
henk717_chronoboros-33b
Chronoboros · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
FO
Foundation Sec 8B Instruct
Foundation · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Liberated Qwen1.5 14B
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
CodingTool use
TH
Thero 1 Flash
Thero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next Mixed Quant SSD PLE
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
ReasoningTool useVision
ER
10Eros Max Hybrid Beta5
Eros · chfm
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
FA
Falcon3 7B Instruct Heretic v2
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
ReasoningTool use
DR
Dracarys2 72B Instruct
Dracarys · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
ME
Medgemma 27b Text It
Medgemma · second-state
Params27B
Context128K
Q4_K_M16.5 GB
Vision
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
BG
Motherlode Code Small En v0.1
BGE · RiverRider
Params33M
Context512
Smallest0.1 GB
CodingEmbedding
GE
Google Gemma 4 12B It
Gemma · sigmanih
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
SA
Sailor-14B-Chat
Sailor · duyntnet
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
PH
microsoft phi 4 GGUF IQ2 XXS
Phi · sigmanih
Params14.7B
Context16K
Smallest0.0 GB
GGUF
DR
drama-3
Drama · Harsha001
Params35.8B
Context—
Smallest20.1 GB
GGUF
MI
minimax video prompt enhancer 2.6b
Minimax · geocine
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
spec for testing
Qwen · ggml-org
Params1.92B
Context40K
Q4_K_M0.3 GB
ReasoningTool use

Keep browsing