GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next
Qwen · baa-ai
Params177B
Context256K
Smallest4.1 GB
DE
deepseek math 7b instruct
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
ST
stablelm-2-12b
Stablelm · mradermacher
Params12.1B
Context4K
Q4_K_M7.4 GB
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Shaeh
Params177B
Context256K
Q4_K_M2.6 GB
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
CA
calme-3.1-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
QW
Qwen Image 2.1 Uncensored
Qwen · god8868
Params7.12B
Context—
Q4_K_M4.6 GB
HU
Hubble 4B V1C
Hubble · TheDrummer
Params4.51B
Context128K
Q4_K_M2.8 GB
DU
Dusk-Miqu-70B
Dusk · Quant-Cartel
Params69B
Context32K
Smallest14.5 GB
BO
Borealis 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SE
SeaLLMs v3 1.5B
Seallms · RichardErkhov
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen3 Omni 30B A3B Instruct
Qwen · TrevorJS
Params3.54B
Context64K
Q4_K_M18.6 GB
MI
MiniMaxAI.MiniMax M2.7
Minimax · DevQuasar
Params229B
Context192K
Q4_K_M138.3 GB
LL
yayi2 30B llama
Llama · TheBloke
Params30.4B
Context4K
Q4_K_M18.2 GB
MO
Monstral 123B v2
Monstral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
FA
FastH3 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M19.8 GB
HE
HelpingAI2.5 10B
Helpingai · mradermacher
Params10.2B
Context128K
Q4_K_M6.2 GB
GR
Grok Oss Apollyon 24B Heretic
Grok · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen1.5 110B
Qwen · mradermacher
Params111B
Context32K
Smallest23.6 GB
CH
Chat_Noir 24b v2
Chat · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
PH
Phi 3 mini code finetune 128k instruct v1
Phi · RDson
Params3.82B
Context128K
Q4_K_M2.4 GB
QW
Arch Agent 7B
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
HU
Huihui LFM2.5 1.2B Instruct Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
SR
SRPO for ComfyUI
Srpo · wikeeyang
Params11.9B
Context—
Smallest7.5 GB
OP
openPangu VL 7B
Openpangu · HelloSun
Params8.03B
Context128K
Q4_K_M4.9 GB
TU
Turn Detector
Turn · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
QW
Simia Tau SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB