GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
HE
HelpingAI 3B hindi i1
Helpingai · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
HA
Hathor_Unstable-L3-8B-v0.3
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Swift Qwen3.8 27B Uncensored MTP Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
IN
Internlm2_5 20b Chat
InternLM · bartowski
Params19.9B
Context32K
Q4_K_M12.0 GB
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
AT
Athene 70B
Athene · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MY
MythoLogic L2 13B
Mythologic · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
AR
Arcee Nova
Arcee · arcee-ai
Params72.7B
Context32K
Q4_K_M47.4 GB
BO
NbAiLab/borealis2-26b-a4b-preview
Borealis · NbAiLab
Params25.2B
Context256K
Q4_K_M16.8 GB
LF
LFM2.5-350M
Lfm · ensu-app
Params354M
Context125K
Q4_K_M0.2 GB
AR
Armenian GPT 1.0 3B
Armenian · ArmGPT
Params3.43B
Context256K
Q4_K_M2.1 GB
DI
diar streaming sortformer 4spk v2.1
Diar · handy-computer
Params118M
Context—
Smallest0.1 GB
QW
Models Qwen Qwen2.5 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.8 Flash Next Abliterated GSQ-RCO IQ3_XXS Calibrated Mixed Hybrid
Qwen · arytekSI
Params177B
Context256K
Smallest83.1 GB
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
qwen3 coder next 80b redteam
Qwen · rafw007
Params79.7B
Context256K
Q4_K_M48.6 GB
BO
Borealis 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
HE
HelpingAI 3B coder
Helpingai · QuantFactory
Params3.48B
Context125K
Q4_K_M2.1 GB
QW
calme-2.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ST
stable-code-instruct-3b
Stable · lmstudio-community
Params2.8B
Context16K
Q4_K_M1.7 GB
NE
Nemotron 3.5 Super 120B A12B NVFP4 Strata Blackwell
Nemotron · Cudecnik
Params124B
Context1024K
Smallest71.6 GB
QW
Qwen3 Nemotron 32B RLBFF
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
CodeQwen1.5 7B Chat
Qwen · Qwen
Params7.25B
Context64K
Q4_K_M4.7 GB
DE
deepseek coder 7b instruct v1.5
DeepSeek · LoneStriker
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Minimax-M2.7
Minimax · mudler
Params230B
Context192K
Smallest69.1 GB
NE
Nemotron 3.5 Bolt 74B A9B 24GB Metal
Nemotron · UraionLabs
Params74B
Context256K
Smallest24.2 GB