GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma ko 7b translate v0.5 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · Myric
Params121B
Context1024K
Smallest81.0 GB
ReasoningTool useVision
LL
Skywork O1 Open Llama3.1 8B
Llama · QuantFactory
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
PH
R3 Phi 4 Reasoning Plus LoRA 5K v1.1
Phi · mradermacher
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
FI
Firefly v4
Firefly · Guilherme34
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
LL
Llama 3.2 3B Instruct imatrix
Llama · liodon-ai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
ST
stablelm-2-12b
Stablelm · mradermacher
Params12.1B
Context4K
Q4_K_M7.4 GB
Coding
CE
Cerebrum 1.0 8x7b
Cerebrum · backyardai
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
LexiFun
Llama · Orenguteng
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
AI
airoboros 33b gpt4 1.4 SuperHOT 8k i1
Airoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
Latxa Llama 3.1 70B Instruct v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
CO
Codefu 7b v0.1
Codefu · duyntnet
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NA
Nautilus 70B v0.1
Nautilus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen2.5 72B Instruct Abliterated v2
Qwen · zetasepic
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
LL
Replete-Coder-Llama3-8B
Llama · BenevolenceMessiah
Params8.03B
Context8K
Q4_K_M4.9 GB
CodingTool use
LU
Luth LFM2 1.2B
Luth · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
ST
stablelm-zephyr-3b
Stablelm · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AN
M3.1 24B Animus V4 Final
Animus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
QW
Qwen 7B Chat
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
MO
Moonshine Tiny (Ukrainian)
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
QW
Ohmatic Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MO
MobileLLM 1.5B
Mobilellm · mradermacher
Params1.56B
Context4K
Q4_K_M1.1 GB
GGUF
MI
MiniMax H3 NVFP4
Minimax · brurpo
Params33.1B
Context—
Smallest11.4 GB
GGUF
KU
Yehor.kulyk En Uk
Kulyk · csabakecskemeti
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
CA
Captain Eris Violet GRPO v0.420 i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 8x7B Yes Instruct LimaRP
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
WI
Wizard Vicuna 13B Uncensored
Wizard · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
EX
K-EXAONE-236B-A23B
Exaone · LGAI-EXAONE
Params237B
Context256K
Q4_K_M143.5 GB
ReasoningTool use
EX
EXAONE 3.5 32B Instruct
Exaone · mradermacher
Params32B
Context32K
Q4_K_M19.3 GB
GGUF
EV
EvoLLM JP v1 7B
Evollm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing