GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next
Qwen · baa-ai
Params177B
Context256K
Smallest4.1 GB
ReasoningTool useVision
DE
deepseek math 7b instruct
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
ST
stablelm-2-12b
Stablelm · mradermacher
Params12.1B
Context4K
Q4_K_M7.4 GB
Coding
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Shaeh
Params177B
Context256K
Q4_K_M2.6 GB
ReasoningTool useVision
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
ReasoningTool use
CA
calme-3.1-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · god8868
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
HU
Hubble 4B V1C
Hubble · TheDrummer
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · Quant-Cartel
Params69B
Context32K
Smallest14.5 GB
GGUF
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
SE
SeaLLMs v3 1.5B
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
Qwen3 Omni 30B A3B Instruct
Qwen · TrevorJS
Params3.54B
Context64K
Q4_K_M18.6 GB
Vision
MI
MiniMaxAI.MiniMax M2.7
Minimax · DevQuasar
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB
GGUF
MO
Monstral 123B v2
Monstral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Tool use
FA
FastH3 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M19.8 GB
GGUF
HE
HelpingAI2.5 10B
Helpingai · mradermacher
Params10.2B
Context128K
Q4_K_M6.2 GB
Tool use
GR
Grok Oss Apollyon 24B Heretic
Grok · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Reasoning
QW
Qwen1.5 110B
Qwen · mradermacher
Params111B
Context32K
Smallest23.6 GB
GGUF
CH
Chat_Noir 24b v2
Chat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
PH
Phi 3 mini code finetune 128k instruct v1
Phi · RDson
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Arch Agent 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
HU
Huihui LFM2.5 1.2B Instruct Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
SR
SRPO for ComfyUI
Srpo · wikeeyang
Params11.9B
Context—
Smallest7.5 GB
GGUF
OP
openPangu VL 7B
Openpangu · HelloSun
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool useVision
TU
Turn Detector
Turn · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
QW
Simia Tau SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing