GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.1 8B Reason Blend 888k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
OR
Orca 2 13B SFT v5
Orca · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen Flash abliterated Strata
Qwen · Hanselor
Params—
Context—
Smallest0.0 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · ThomasBaruzier
Params4.51B
Context128K
Q4_K_M2.8 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · duyntnet
Params14B
Context128K
Q4_K_M8.6 GB
MU
Muse Glimmer 30B ROCmFP4 Strix Halo DFlash
Muse · kingjones777
Params28B
Context128K
Smallest1.5 GB
FA
Falcon H1 1.5B Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB
LL
Llama 2 7b Chat Hf
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
YI
SG Raccoon Yi 55B
Yi · TheBloke
Params55.6B
Context4K
Q4_K_M33.3 GB
ME
m42-health_med42-70b
Med · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
QW
Qwen2.5 7B Instruct 1M Heretic
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
PA
mihaiii_pallas-0.5-frankenmerge
Pallas · TheBloke
Params36B
Context195K
Q4_K_M21.6 GB
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mmnga-o
Params8.89B
Context1024K
Q4_K_M6.5 GB
CH
austism_chronos-wizardlm-uc-scot-st-13b
Chronos · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
MY
MythoLogic-Mini-7b
Mythologic · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
BA
bagel 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GL
GLM 4.7 Flash heretic
GLM · ThalisAI
Params30B
Context198K
Q4_K_M18.1 GB
PH
Phi 3 mini 4k instruct imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
LT
joyai echo ltx25 echoVid
Ltx · joeygambino
Params21B
Context—
Q4_K_M14.2 GB
CO
Cosmos Reason1 7B Heretic
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Swift 1.5 Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
TI
jeff31415_tinyllama-1.1b-1t-openorca
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
Deepseek Llm 7b Chat Abliterated
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.8 Flash Next Mooney
Qwen · DJLougen
Params177B
Context256K
Smallest2.8 GB
AU
Audar TTS V1 Flash
Audar · audarai
Params553M
Context32K
Q4_K_M0.5 GB